2024-07-26T08:03:44.170 INFO:root:teuthology version: 0.0.1.dev379+g53ce146 2024-07-26T08:03:44.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-26T08:03:44.301 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705 branch: wip-vshankar-testing-20240725.121331-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} email: vshankar@redhat.com first_in_suite: false job_id: '7818705' kernel: client: branch: testing flavor: default kdb: 1 sha1: 3e9255e907100f88049f320ca33d977e29155d12 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240725.121331-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: client dirsize rbytes: false global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240725.121331-debug sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5532 sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 sleep_before_teardown: 0 subset: 1001/1024 suite: fs suite_branch: wip-vshankar-testing-20240725.121331-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN4sDOSYnRFGUvG10KEqIIVB9IwFUO/IHPuRE7EgE8nAbSPfGdI6WpRJD7gZdvOu419sLb6fJLEInOGEhXS2VKw= smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2zmCkzXJznnIsMvMDrUkerP5N/rAVymi2d+2u4ZwJhsTB7HgQl0MOF8pILlN02GFYW3irEMFXCs9IT4waKOmg= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEcBBgd8Rt5yc/i5Q6GFeVDWSp7oaYeOVpYTNepa9692RXm0qeYhovzmaXWTf4IdAwvg1MjekoqQ9p7KYMwgWjE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 53ce1462e129f6eb4071986336534c740fdebd31 timestamp: 2024-07-26_04:18:59 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 2024-07-26T08:03:44.301 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa; will attempt to use it 2024-07-26T08:03:44.302 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks 2024-07-26T08:03:44.302 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-07-26T08:03:44.303 INFO:teuthology.task.internal:Checking packages... 2024-07-26T08:03:44.326 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528' 2024-07-26T08:03:44.326 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-07-26T08:03:44.327 INFO:teuthology.packaging:ref: None 2024-07-26T08:03:44.327 INFO:teuthology.packaging:tag: None 2024-07-26T08:03:44.327 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240725.121331-debug 2024-07-26T08:03:44.327 INFO:teuthology.packaging:sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:03:44.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240725.121331-debug 2024-07-26T08:03:44.474 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5320.ge8f88bb1 2024-07-26T08:03:44.476 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-07-26T08:03:44.482 INFO:teuthology.task.internal:no buildpackages task found 2024-07-26T08:03:44.482 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-07-26T08:03:44.498 INFO:teuthology.task.internal:Saving configuration 2024-07-26T08:03:44.519 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-07-26T08:03:44.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-07-26T08:03:44.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-26 07:58:35.559691', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN4sDOSYnRFGUvG10KEqIIVB9IwFUO/IHPuRE7EgE8nAbSPfGdI6WpRJD7gZdvOu419sLb6fJLEInOGEhXS2VKw='} 2024-07-26T08:03:44.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-26 07:58:35.556860', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2zmCkzXJznnIsMvMDrUkerP5N/rAVymi2d+2u4ZwJhsTB7HgQl0MOF8pILlN02GFYW3irEMFXCs9IT4waKOmg='} 2024-07-26T08:03:44.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-26 07:58:35.558420', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEcBBgd8Rt5yc/i5Q6GFeVDWSp7oaYeOVpYTNepa9692RXm0qeYhovzmaXWTf4IdAwvg1MjekoqQ9p7KYMwgWjE='} 2024-07-26T08:03:44.591 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-07-26T08:03:44.597 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-07-26T08:03:44.597 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-07-26T08:03:44.598 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-07-26T08:03:44.598 INFO:teuthology.run_tasks:Running task console_log... 2024-07-26T08:03:44.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f748d6cfac0>, signals=[15]) 2024-07-26T08:03:44.687 INFO:teuthology.run_tasks:Running task internal.connect... 2024-07-26T08:03:44.693 INFO:teuthology.task.internal:Opening connections... 2024-07-26T08:03:44.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:03:44.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:03:44.771 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-07-26T08:03:44.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:03:44.844 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-07-26T08:03:44.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:03:44.919 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-07-26T08:03:45.011 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-07-26T08:03:45.031 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-07-26T08:03:45.031 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-07-26T08:03:45.093 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-07-26T08:03:45.093 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-07-26T08:03:45.093 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-26T08:03:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-26T08:03:45.095 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-07-26T08:03:45.118 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-07-26T08:03:45.139 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-07-26T08:03:45.140 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-07-26T08:03:45.198 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-07-26T08:03:45.198 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-26T08:03:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-26T08:03:45.200 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-07-26T08:03:45.217 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-07-26T08:03:45.235 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-07-26T08:03:45.235 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-26T08:03:45.297 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-07-26T08:03:45.298 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-26T08:03:45.298 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-26T08:03:45.298 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-26T08:03:45.298 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-07-26T08:03:45.317 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-07-26T08:03:45.329 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-07-26T08:03:45.336 INFO:teuthology.task.internal:Checking for old test directory... 2024-07-26T08:03:45.336 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-07-26T08:03:45.339 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-07-26T08:03:45.341 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-07-26T08:03:45.357 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-07-26T08:03:45.362 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-07-26T08:03:45.362 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-07-26T08:03:45.396 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-07-26T08:03:45.399 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-07-26T08:03:45.427 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-07-26T08:03:45.507 INFO:teuthology.run_tasks:Running task kernel... 2024-07-26T08:03:45.522 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': '3e9255e907100f88049f320ca33d977e29155d12'} 2024-07-26T08:03:45.523 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-07-26T08:03:45.523 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-07-26T08:03:45.523 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-26T08:03:45.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T08:03:45.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-07-26T08:03:45.725 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T08:03:45.725 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3e9255e907100f88049f320ca33d977e29155d12"... 2024-07-26T08:03:45.725 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-07-26T08:03:45.743 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-437.el9.x86_64 2024-07-26T08:03:45.744 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T08:03:45.744 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-07-26T08:03:45.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum upgrade -y linux-firmware 2024-07-26T08:03:48.911 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-07-26T08:03:54.317 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-07-26T08:03:59.134 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-07-26T08:04:00.926 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 18 kB 00:00 2024-07-26T08:04:01.897 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-07-26T08:04:07.536 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-07-26T08:04:09.844 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-07-26T08:04:09.850 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 1 Package 2024-07-26T08:04:09.851 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:04:09.851 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 383 M 2024-07-26T08:04:09.851 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-07-26T08:04:22.936 INFO:teuthology.orchestra.run.smithi043.stdout:linux-firmware-20240716-145.el9.noarch.rpm 29 MB/s | 383 MB 00:13 2024-07-26T08:04:22.937 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-07-26T08:04:22.938 INFO:teuthology.orchestra.run.smithi043.stdout:Total 29 MB/s | 383 MB 00:13 2024-07-26T08:04:26.168 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-07-26T08:04:26.251 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-07-26T08:04:26.290 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-07-26T08:04:29.621 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-07-26T08:04:29.621 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-07-26T08:04:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-07-26T08:04:39.777 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T08:04:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T08:04:40.480 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T08:04:40.481 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T08:04:41.254 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T08:04:41.254 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:04:41.254 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-07-26T08:04:41.254 INFO:teuthology.orchestra.run.smithi043.stdout: linux-firmware-20240716-145.el9.noarch 2024-07-26T08:04:41.254 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:04:41.255 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-07-26T08:04:41.559 INFO:teuthology.task.kernel:Downloading kernel 3e9255e907100f88049f320ca33d977e29155d12 on client.0... 2024-07-26T08:04:41.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T08:04:41.716 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ 2024-07-26T08:04:41.716 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.10.0_g3e9255e90710-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ --input-file=- 2024-07-26T08:04:41.719 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi043.front.sepia.ceph.com to complete... 2024-07-26T08:04:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26 08:04:47 URL:https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/kernel-6.10.0_g3e9255e90710-1.x86_64.rpm [358399635/358399635] -> "/tmp/kernel.x86_64.rpm" [1] 2024-07-26T08:04:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:FINISHED --2024-07-26 08:04:47-- 2024-07-26T08:04:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:Total wall clock time: 6.3s 2024-07-26T08:04:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:Downloaded: 1 files, 342M in 6.0s (57.0 MB/s) 2024-07-26T08:04:48.003 INFO:teuthology.task.kernel:Installing kernel 3e9255e907100f88049f320ca33d977e29155d12 on client.0... 2024-07-26T08:04:48.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-07-26T08:04:50.160 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying... ######################################## 2024-07-26T08:04:50.208 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing... ######################################## 2024-07-26T08:04:50.262 INFO:teuthology.orchestra.run.smithi043.stdout:Updating / installing... 2024-07-26T08:04:58.597 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-6.10.0_g3e9255e90710-1 ######################################## 2024-07-26T08:05:39.163 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-07-26T08:05:39.164 DEBUG:teuthology.orchestra.run.smithi043:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-07-26T08:05:39.251 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/System.map-6.10.0-g3e9255e90710 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/config-6.10.0-g3e9255e90710 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/vmlinuz-6.10.0-g3e9255e90710 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/System.map 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/config 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-07-26T08:05:39.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32c-intel.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx2.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-07-26T08:05:39.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-amd.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-intel.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm.ko 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto 2024-07-26T08:05:39.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ansi_cprng.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/anubis.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/arc4.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_memcpy.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_pq.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_raid6_recov.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_tx.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_xor.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/raid6test.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authenc.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authencesn.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blake2b_generic.ko 2024-07-26T08:05:39.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_common.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_generic.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/camellia_generic.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast5_generic.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast6_generic.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast_common.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ccm.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cmac.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crc32_generic.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_engine.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_user.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cts.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/des_generic.ko 2024-07-26T08:05:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/dh_generic.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecc.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecdh_generic.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/echainiv.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/essiv.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/fcrypt.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/khazad.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4hc.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/md4.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/michael_mic.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcbc.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcrypt.ko 2024-07-26T08:05:39.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/rmd160.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/seed.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/serpent_generic.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tcrypt.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tea.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_common.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_generic.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/vmac.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/wp512.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xcbc.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xor.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xxhash_generic.ko 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers 2024-07-26T08:05:39.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_ipmi.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_pad.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/ec_sys.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/platform_profile.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbs.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbshc.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/video.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/acard-ahci.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ahci_platform.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ata_generic.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/libahci_platform.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_acpi.ko 2024-07-26T08:05:39.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ali.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_amd.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_artop.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atiixp.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atp867x.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd640.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd64x.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cypress.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_efar.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt366.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt37x.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x2n.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x3.ko 2024-07-26T08:05:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it8213.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it821x.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_jmicron.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_marvell.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_mpiix.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_netcell.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ninja32.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87410.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87415.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_oldpiix.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_opti.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_optidma.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pcmcia.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc2027x.ko 2024-07-26T08:05:39.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_piccolo.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_rdc.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sch.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_serverworks.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sil680.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sis.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sl82c105.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_triflex.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_via.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pdc_adma.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_inic162x.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_mv.ko 2024-07-26T08:05:39.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_nv.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_promise.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_qstor.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil24.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sis.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_svw.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sx4.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_uli.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_via.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_vsc.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay/ks0108.ko 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base 2024-07-26T08:05:39.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-i2c.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-mmio.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma/bcma.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe/aoe.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/brd.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd/drbd.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/floppy.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/loop.ko 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx 2024-07-26T08:05:39.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/nbd.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk/null_blk.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/pktcdvd.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/rbd.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/virtio_blk.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkfront.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram/zram.ko 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char 2024-07-26T08:05:39.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hangcheck-timer.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/amd-rng.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/intel-rng.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/via-rng.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/virtio-rng.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_si.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-07-26T08:05:39.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/lp.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave/mwave.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ppdev.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tlclk.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_atmel.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_infineon.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_nsc.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/uv_mmtimer.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/virtio_console.ko 2024-07-26T08:05:39.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/p4-clockmod.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/powernow-k8.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/speedstep-lib.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-07-26T08:05:39.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-aes.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-sha.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca/dca.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw/dw_dmac.ko 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat 2024-07-26T08:05:39.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat/ioatdma.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/amd64_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/e752x_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/edac_mce_amd.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3000_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3200_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5100_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5400_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7300_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7core_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i82975x_edac.ko 2024-07-26T08:05:39.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/ie31200_edac.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/sb_edac.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/x38_edac.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/edd.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/iscsi_ibft.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-ich.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-viperboard.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-appleir.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-aureal.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-axff.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-dr.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elecom.ko 2024-07-26T08:05:39.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elo.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-emsff.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gaff.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gt683r.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gyration.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-kbd.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-mouse.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtekff.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-hyperv.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-icade.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-keytouch.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-kye.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lcpower.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-led.ko 2024-07-26T08:05:39.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lenovo.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-dj.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-multitouch.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-ortek.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-penmount.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-petalynx.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-picolcd.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-pl.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-plantronics.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-primax.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-rmi.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-arvo.ko 2024-07-26T08:05:39.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-common.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-isku.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kone.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-konepure.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-lua.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-pyra.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-ryos.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-savu.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-saitek.ko 2024-07-26T08:05:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-samsung.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sensor-hub.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sjoy.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sony.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-speedlink.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-steelseries.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sunplus.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-thrustmaster.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tivo.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tmff.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-topseed.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-twinhan.ko 2024-07-26T08:05:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-uclogic.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-waltop.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-wiimote.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-xinmo.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zpff.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zydacron.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/uhid.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/wacom.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_balloon.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_utils.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_vmbus.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru.ko 2024-07-26T08:05:39.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru3.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/acpi_power_meter.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7414.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7418.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adc128d818.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1025.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1026.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1029.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1031.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm9240.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ads7828.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7410.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7411.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7462.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7470.ko 2024-07-26T08:05:39.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7475.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7x10.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/amc6821.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/applesmc.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asb100.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asc7621.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asus_atk0110.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/atxp1.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/coretemp.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dme1737.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds1621.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds620.ko 2024-07-26T08:05:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc1403.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc6w201.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71805f.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71882fg.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f75375s.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fam15h_power.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fschmd.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g760a.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g762.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl518sm.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl520sm.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/hwmon-vid.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5500_temp.ko 2024-07-26T08:05:39.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5k_amb.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmaem.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmpex.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina209.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina2xx.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/it87.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k10temp.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k8temp.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lineage-pem.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm63.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm73.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm75.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm77.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm78.ko 2024-07-26T08:05:39.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm80.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm83.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm85.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm87.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm90.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm92.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm93.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95234.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95241.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95245.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc2945.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4151.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4215.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4222.ko 2024-07-26T08:05:39.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4245.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4260.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4261.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max16065.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1619.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1668.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max197.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6639.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6650.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6697.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/mcp3021.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6683.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775-core.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775.ko 2024-07-26T08:05:39.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct7802.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87360.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87427.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pcf8591.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max16064.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max34440.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max8688.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-07-26T08:05:39.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/powr1220.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5627.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5636.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch56xx-common.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht15.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht21.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/shtc1.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sis5595.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47b397.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m1.ko 2024-07-26T08:05:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m192.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/thmc50.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp102.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp103.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp401.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp421.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via-cputemp.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via686a.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt1211.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt8231.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627ehf.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627hf.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83781d.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83791d.ko 2024-07-26T08:05:39.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83792d.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83793.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83795.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l785ts.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l786ng.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-07-26T08:05:39.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-i801.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-isch.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-parport.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-07-26T08:05:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-via.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-dev.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-mux.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-smbus.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-stub.ko 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core 2024-07-26T08:05:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_cm.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_core.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_umad.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/iw_cm.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_cm.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-07-26T08:05:39.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input 2024-07-26T08:05:39.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/fm801-gp.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/gameport.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/joydev.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard/gpio_keys.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/appletouch.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/bcm5974.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/cyapatp.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/elan_i2c.ko 2024-07-26T08:05:39.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/sermouse.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_usb.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/vsxxxaa.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4/rmi_core.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/altera_ps2.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/arc_ps2.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/serio_raw.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/sparse-keymap.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-blinkm.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lm3530.ko 2024-07-26T08:05:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lp3944.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-ss4200.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache/bcache.ko 2024-07-26T08:05:39.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-bio-prison.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache-smq.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-crypt.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-delay.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-flakey.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-log-userspace.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-multipath.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-queue-length.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-raid.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-round-robin.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-service-time.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-switch.ko 2024-07-26T08:05:39.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-thin-pool.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-verity.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid0.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid1.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid10.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid456.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptbase.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptctl.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptfc.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptlan.ko 2024-07-26T08:05:39.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptsas.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptscsih.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptspi.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_ich.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_sch.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/mfd-core.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/sm501.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/viperboard.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/vx855.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/wl1273-core.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-07-26T08:05:39.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds9802als.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds990x.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/bh1770glc.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710/cb710.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/at24.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/max6875.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/enclosure.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/hpilo.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29003.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29020.ko 2024-07-26T08:05:39.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-me.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-txe.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru/gru.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xp.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpc.ko 2024-07-26T08:05:39.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_7xx1.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_core.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tsl2550.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_balloon.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding/bonding.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53/b53_common.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/bcm-sf2.ko 2024-07-26T08:05:39.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6060.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dummy.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/eql.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/8390.ko 2024-07-26T08:05:39.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere/et131x.ko 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-07-26T08:05:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e 2024-07-26T08:05:39.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-07-26T08:05:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-07-26T08:05:39.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-07-26T08:05:39.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dnet.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ethoc.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/fealnx.ko 2024-07-26T08:05:39.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e100.ko 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf 2024-07-26T08:05:39.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/jme.ko 2024-07-26T08:05:39.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/skge.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-07-26T08:05:39.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-07-26T08:05:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/atp.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-07-26T08:05:39.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis190.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis900.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-07-26T08:05:39.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/cassini.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/niu.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sungem.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti/tlan.ko 2024-07-26T08:05:39.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/geneve.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154/fakelb.ko 2024-07-26T08:05:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ifb.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan/ipvlan.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvlan.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvtap.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-regmap.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mii.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/net_failover.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/netconsole.ko 2024-07-26T08:05:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/nlmon.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs-lynx.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/amd.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm7xxx.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm87xx.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/broadcom.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/cicada.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/davicom.ko 2024-07-26T08:05:39.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/dp83640.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/et1011c.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/icplus.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/lxt.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/marvell.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/micrel.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/national.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/phylink.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/qsemi.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/realtek.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/smsc.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/ste10Xp.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/vitesse.ko 2024-07-26T08:05:39.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/bsd_comp.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_async.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_deflate.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_generic.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_mppe.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_synctty.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppoe.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppox.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pptp.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slhc.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slip.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/sungem_phy.ko 2024-07-26T08:05:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tap.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_activebackup.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_broadcast.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_random.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tun.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/veth.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/virtio_net.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan/vxlan.ko 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback 2024-07-26T08:05:39.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback/xen-netback.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netfront.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb/ntb.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme-core.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_cs.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_pc.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_serial.ko 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci 2024-07-26T08:05:39.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie/aer_inject.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/xen-pcifront.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/i82092.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/pd6729.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/yenta_socket.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform 2024-07-26T08:05:39.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acer-wmi.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acerhdf.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/apple-gmux.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-laptop.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-wmi.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/classmate-laptop.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/hdaps.ko 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel 2024-07-26T08:05:39.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel_ips.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/msi-wmi.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/mxm-wmi.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-laptop.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-q10.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/topstar-laptop.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_haps.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi-bmof.ko 2024-07-26T08:05:39.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_common.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_msr.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-gpio.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-ldisc.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps_parport.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/pps_core.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp_kvm.ko 2024-07-26T08:05:39.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/fmpm.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-bq32k.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1286.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1307.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1374.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1511.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1553.ko 2024-07-26T08:05:39.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1672.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1742.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds2404.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds3232.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-em3027.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-fm3130.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl12022.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl1208.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m41t80.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t35.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t59.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-max6900.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-msm6242.ko 2024-07-26T08:05:39.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf2127.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf85063.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8523.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8563.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8583.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rp5c01.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rs5c372.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8025.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8581.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-x1205.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-9xxx.ko 2024-07-26T08:05:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-sas.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-xxxx.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/BusLogic.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/a100u2w.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid/aacraid.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/advansys.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/am53c974.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/atp870u.ko 2024-07-26T08:05:39.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa/bfa.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ch.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor/csiostor.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-07-26T08:05:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dc395x.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dmx3191d.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r/esas2r.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esp_scsi.ko 2024-07-26T08:05:39.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/fcoe.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic/fnic.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hpsa.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hptiop.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hv_storvsc.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/initio.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ipr.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ips.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci/isci.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_tcp.ko 2024-07-26T08:05:39.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc/libfc.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi_tcp.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas/libsas.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc/lpfc.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-07-26T08:05:39.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas/mvsas.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvumi.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pmcraid.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla1280.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx 2024-07-26T08:05:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/raid_class.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_debug.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_fc.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_sas.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_spi.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_srp.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ses.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/st.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/stex.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/virtio_scsi.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/vmw_pvscsi.ko 2024-07-26T08:05:39.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/wd719x.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb/ssb.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback/tcm_loop.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_file.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_iblock.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_mod.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_pscsi.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_user.ko 2024-07-26T08:05:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-07-26T08:05:39.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_gsm.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_hdlc.ko 2024-07-26T08:05:39.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/nozomi.ko 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/arc_uart.ko 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm/jsm.ko 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core/ufshcd-core.ko 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio 2024-07-26T08:05:39.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_aec.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_cif.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_pci_generic.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_sercos3.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-acm.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-wdm.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usblp.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usbtmc.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host/sl811-hcd.ko 2024-07-26T08:05:39.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/mdc800.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/microtek.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/adutux.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/appledisplay.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi26.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi62.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ezusb.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/idmouse.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/iowarrior.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/isight_firmware.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ldusb.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/legousbtower.ko 2024-07-26T08:05:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/trancevibrator.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usb3503.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usblcd.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usbsevseg.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/uss720.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/yurex.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy/phy-generic.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/aircable.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ark3116.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/belkin_sa.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ch341.ko 2024-07-26T08:05:39.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cp210x.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cyberjack.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cypress_m8.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/digi_acceleport.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/empeg.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ftdi_sio.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/garmin_gps.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_edgeport.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_ti.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipaq.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipw.ko 2024-07-26T08:05:39.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ir-usb.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan_pda.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kl5kusb105.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kobil_sct.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mct_u232.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7720.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7840.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/navman.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/omninet.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/opticon.ko 2024-07-26T08:05:39.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/option.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/oti6858.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/pl2303.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcaux.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcserial.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/quatech2.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/safe_serial.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/sierra.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/spcp8x5.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ssu100.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/symbolserial.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-07-26T08:05:39.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_debug.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_wwan.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/visor.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/whiteheat.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/xsens_mt.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/uas.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-alauda.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-cypress.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-datafab.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-freecom.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-isd200.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-07-26T08:05:39.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-karma.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-onetouch.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-realtek.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr09.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr55.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-usbat.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/usb-storage.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-core.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-host.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci 2024-07-26T08:05:39.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_iotlb.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_net.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_scsi.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/apple_bl.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/lcd.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/platform_lcd.ko 2024-07-26T08:05:39.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_balloon.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_mmio.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_ring.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2482.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2490.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-07-26T08:05:39.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_smem.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_therm.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/wire.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim1535_wdt.ko 2024-07-26T08:05:39.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim7101_wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/f71808e_wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/hpwdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/i6300esb.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ib700wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ibmasr.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it8712f_wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it87_wdt.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/machzwd.ko 2024-07-26T08:05:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/nv_tco.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_pci.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_usb.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sch311x_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/softdog.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sp5100_tco.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/via_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83877f_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83977f_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/wdt_pci.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/xen_wdt.ko 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen 2024-07-26T08:05:39.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-acpi-processor.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-evtchn.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntalloc.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntdev.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-privcmd.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs/xenfs.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p/9p.ko 2024-07-26T08:05:39.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs/affs.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs/befs.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/binfmt_misc.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs/btrfs.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles/cachefiles.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph/ceph.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda/coda.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs/cramfs.ko 2024-07-26T08:05:39.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm/dlm.ko 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs/ecryptfs.ko 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs/f2fs.ko 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/fat.ko 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/msdos.ko 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/vfat.ko 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse 2024-07-26T08:05:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/cuse.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/fuse.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2/gfs2.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs/hfs.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus/hfsplus.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs/isofs.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs/jfs.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd/lockd.ko 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix 2024-07-26T08:05:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix/minix.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs/netfs.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfs.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv3.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv4.ko 2024-07-26T08:05:39.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/grace.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/nfs_acl.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd/nfsd.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2/nilfs2.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-celtic.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-centeuro.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-croatian.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-cyrillic.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-gaelic.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-greek.ko 2024-07-26T08:05:39.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-iceland.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-inuit.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-roman.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-romanian.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-turkish.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1250.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1251.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1255.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp737.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp775.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp850.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp852.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp855.ko 2024-07-26T08:05:39.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp857.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp860.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp861.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp862.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp863.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp864.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp865.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp866.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp869.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp874.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp932.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp936.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp949.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp950.ko 2024-07-26T08:05:39.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_euc-jp.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-1.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-13.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-14.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-15.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-2.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-3.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-4.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-5.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-6.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-7.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-9.ko 2024-07-26T08:05:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-r.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-ru.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-u.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_ucs2_utils.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_utf8.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-07-26T08:05:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs/overlay.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore/ramoops.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs/reiserfs.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs/romfs.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client/cifs.ko 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common 2024-07-26T08:05:39.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_arc4.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_md4.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs/squashfs.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv/sysv.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf/udf.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs/ufs.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs/xfs.ko 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel 2024-07-26T08:05:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu/rcutorture.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/torture.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/asn1_encoder.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc-itu-t.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc8.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libaescfb.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libarc4.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libdes.ko 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim 2024-07-26T08:05:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim/dimlib.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/libcrc32c.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lru_cache.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4_compress.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4hc_compress.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math/cordic.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6/raid6_pq.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon/reed_solomon.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_bm.ko 2024-07-26T08:05:39.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_fsm.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_kmp.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd/zstd_compress.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm/hwpoison-inject.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/6lowpan.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_dest.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_fragment.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_hop.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_ipv6.ko 2024-07-26T08:05:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_mobility.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_routing.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_udp.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/garp.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/mrp.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/p8022.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/psnap.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/stp.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q/8021q.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_fd.ko 2024-07-26T08:05:39.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_rdma.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_virtio.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv/batman-adv.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/br_netfilter.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/bridge.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_among.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arp.ko 2024-07-26T08:05:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_limit.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_log.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_snat.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_stp.ko 2024-07-26T08:05:39.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtables.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph/libceph.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/failover.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/pktgen.ko 2024-07-26T08:05:39.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_diag.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv4.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv6.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver/dns_resolver.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/dsa_core.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_brcm.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_dsa.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_none.ko 2024-07-26T08:05:39.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_trailer.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154_socket.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ah4.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/esp4.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/fou.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/gre.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/inet_diag.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_gre.ko 2024-07-26T08:05:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_tunnel.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_vti.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipcomp.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipip.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arp_tables.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-07-26T08:05:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_security.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_bic.ko 2024-07-26T08:05:39.374 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_dctcp.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_diag.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_highspeed.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_htcp.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_hybla.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_illinois.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_lp.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_scalable.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_vegas.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_veno.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_westwood.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_yeah.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tunnel4.ko 2024-07-26T08:05:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_diag.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_tunnel.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/xfrm4_tunnel.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ah6.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/esp6.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/fou6.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_tunnel.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_vti.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ipcomp6.ko 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter 2024-07-26T08:05:39.376 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-07-26T08:05:39.377 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/sit.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/tunnel6.ko 2024-07-26T08:05:39.378 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/xfrm6_tunnel.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key/af_key.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_core.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_debugfs.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_eth.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip6.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_netlink.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ppp.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc/llc.ko 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154 2024-07-26T08:05:39.379 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154/mac802154.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls/mpls_gso.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-07-26T08:05:39.380 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-07-26T08:05:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conncount.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-07-26T08:05:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_h323.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_irc.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sane.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sip.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_dup_netdev.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table_inet.ko 2024-07-26T08:05:39.383 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_log_syslog.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_amanda.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_ftp.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_irc.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_sip.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_tftp.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_synproxy_core.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_tables.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_acct.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_log.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_osf.ko 2024-07-26T08:05:39.384 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_queue.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_chain_nat.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_compat.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_ct.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_dup_netdev.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fib.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fwd_netdev.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_hash.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_limit.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_log.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_masq.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_nat.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_numgen.ko 2024-07-26T08:05:39.385 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_queue.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_quota.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_redir.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject_inet.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_socket.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_tunnel.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_AUDIT.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CHECKSUM.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CLASSIFY.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CT.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_DSCP.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HL.ko 2024-07-26T08:05:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HMARK.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_IDLETIMER.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LED.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LOG.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_MASQUERADE.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NETMAP.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFLOG.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFQUEUE.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_RATEEST.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_REDIRECT.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_SECMARK.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPMSS.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-07-26T08:05:39.387 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TEE.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TPROXY.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TRACE.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_addrtype.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_bpf.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cgroup.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cluster.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_comment.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connbytes.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlabel.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlimit.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connmark.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_conntrack.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cpu.ko 2024-07-26T08:05:39.388 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dccp.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_devgroup.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dscp.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ecn.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_esp.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hashlimit.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_helper.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hl.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipcomp.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_iprange.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipvs.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_l2tp.ko 2024-07-26T08:05:39.389 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_length.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_limit.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mac.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mark.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_multiport.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nat.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nfacct.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_osf.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_owner.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_physdev.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_pkttype.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_policy.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_quota.ko 2024-07-26T08:05:39.390 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_rateest.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_realm.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_recent.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_sctp.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_set.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_socket.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_state.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_statistic.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_string.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_tcpmss.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_time.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_u32.ko 2024-07-26T08:05:39.391 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink/netlink_diag.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh/nsh.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/openvswitch.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-geneve.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-gre.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-vxlan.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet/af_packet_diag.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_rdma.ko 2024-07-26T08:05:39.392 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_tcp.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_csum.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_gact.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_mirred.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_nat.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_pedit.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_police.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_simple.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_skbedit.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_vlan.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_basic.ko 2024-07-26T08:05:39.393 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_bpf.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_flow.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_fw.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_route.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_u32.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_cmp.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_ipset.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_meta.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_nbyte.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_text.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_u32.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_choke.ko 2024-07-26T08:05:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_codel.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_drr.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_fq.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_gred.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hfsc.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hhf.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_htb.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_ingress.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio_lib.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_multiq.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_netem.ko 2024-07-26T08:05:39.395 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_pie.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_plug.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_prio.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_qfq.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_red.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfb.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfq.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_tbf.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_teql.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp_diag.ko 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss 2024-07-26T08:05:39.396 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/sunrpc.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc_diag.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix/unix_diag.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock.ko 2024-07-26T08:05:39.397 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_diag.ko 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_loopback.ko 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm/xfrm_ipcomp.ko 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys/trusted.ko 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias.bin 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.alias.bin 2024-07-26T08:05:39.398 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.bin 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.modinfo 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep.bin 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.devname 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.order 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.softdep 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols.bin 2024-07-26T08:05:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T08:05:39.403 DEBUG:teuthology.task.kernel:get_image_version: 6.10.0-g3e9255e90710 2024-07-26T08:05:39.403 DEBUG:teuthology.orchestra.run.smithi043:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout:postinstall scriptlet (using /bin/sh): 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/bin/kernel-install add 6.10.0-g3e9255e90710 /lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout:for file in vmlinuz System.map config; do 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: if ! cmp --silent "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710"; then 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: cp "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710" 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: fi 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout:done 2024-07-26T08:05:39.429 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -d "/lib/modules/6.10.0-g3e9255e90710/dtb" ] && \ 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: ! diff -rq "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" >/dev/null 2>&1; then 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: rm -rf "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: cp -r "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:if [ ! -e "/lib/modules/6.10.0-g3e9255e90710/modules.dep" ]; then 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/sbin/depmod 6.10.0-g3e9255e90710 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:preuninstall scriptlet (using /bin/sh): 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-install remove 6.10.0-g3e9255e90710 2024-07-26T08:05:39.430 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-07-26T08:05:39.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 68.el9 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8264254 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-26T08:05:39.519 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-26T08:05:39.520 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-07-26T08:05:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:05:39.521 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-07-26T08:05:39.521 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-26T08:05:39.522 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 6.10.0-g3e9255e90710 2024-07-26T08:05:39.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-26T08:05:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-07-26T08:05:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-26T08:05:41.379 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-07-26T08:05:41.381 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-07-26T08:05:41.396 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.AjcExMtTWK 2024-07-26T08:05:41.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AjcExMtTWK 2024-07-26T08:05:41.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.AjcExMtTWK 2024-07-26T08:05:41.599 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.AjcExMtTWK is 6KB 2024-07-26T08:05:41.648 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.AjcExMtTWK 2024-07-26T08:05:41.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-07-26T08:05:41.726 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-26T08:05:41.726 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-26T08:05:41.727 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-26T08:05:41.727 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710.conf 2024-07-26T08:05:41.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710 2024-07-26T08:05:41.902 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-07-26T08:06:11.906 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-07-26T08:06:11.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-07-26T08:06:11.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:06:30.370 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-07-26T08:06:39.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-07-26T08:06:39.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:06:42.430 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-07-26T08:06:54.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-07-26T08:06:54.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:07:26.303 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-07-26T08:07:26.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-07-26T08:07:26.926 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.10.0-g3e9255e90710"... 2024-07-26T08:07:26.926 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-07-26T08:07:26.965 INFO:teuthology.orchestra.run.smithi043.stdout:6.10.0-g3e9255e90710 2024-07-26T08:07:26.966 DEBUG:teuthology.task.kernel:current kernel version is 6.10.0-g3e9255e90710 vs 6.10.0-g3e9255e90710 2024-07-26T08:07:26.966 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-26T08:07:26.966 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-26T08:07:27.967 DEBUG:teuthology.parallel:result is None 2024-07-26T08:07:27.968 INFO:teuthology.run_tasks:Running task internal.base... 2024-07-26T08:07:27.976 INFO:teuthology.task.internal:Creating test directory... 2024-07-26T08:07:27.977 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-26T08:07:27.982 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-26T08:07:27.985 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-26T08:07:28.028 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-07-26T08:07:28.035 INFO:teuthology.run_tasks:Running task internal.archive... 2024-07-26T08:07:28.053 INFO:teuthology.task.internal:Creating archive directory... 2024-07-26T08:07:28.053 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-26T08:07:28.058 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-26T08:07:28.060 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-26T08:07:28.174 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-07-26T08:07:28.182 INFO:teuthology.task.internal:Enabling coredump saving... 2024-07-26T08:07:28.182 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-26T08:07:28.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T08:07:28.199 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-26T08:07:28.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T08:07:28.216 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-26T08:07:28.220 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-26T08:07:28.242 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-26T08:07:28.277 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T08:07:28.291 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T08:07:28.314 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T08:07:28.314 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T08:07:28.355 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T08:07:28.397 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T08:07:28.401 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-07-26T08:07:28.413 INFO:teuthology.task.internal:Configuring sudo... 2024-07-26T08:07:28.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-26T08:07:28.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-26T08:07:28.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-26T08:07:28.486 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-07-26T08:07:28.496 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-07-26T08:07:28.496 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-26T08:07:28.503 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-26T08:07:28.505 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-26T08:07:28.542 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T08:07:28.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T08:07:28.761 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T08:07:28.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T08:07:28.917 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:07:28.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-26T08:07:28.987 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T08:07:29.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T08:07:29.089 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T08:07:29.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T08:07:29.219 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:07:29.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-26T08:07:29.287 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T08:07:29.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T08:07:29.382 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T08:07:29.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T08:07:29.505 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:07:29.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-26T08:07:29.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-07-26T08:07:29.577 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-07-26T08:07:29.582 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-07-26T08:07:29.614 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T08:07:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T08:07:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T08:07:30.102 INFO:teuthology.run_tasks:Running task internal.timer... 2024-07-26T08:07:30.110 INFO:teuthology.task.internal:Starting timer... 2024-07-26T08:07:30.111 INFO:teuthology.run_tasks:Running task pcp... 2024-07-26T08:07:30.124 INFO:teuthology.run_tasks:Running task selinux... 2024-07-26T08:07:30.134 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-07-26T08:07:30.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-07-26T08:07:30.319 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-07-26T08:07:30.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-07-26T08:07:30.398 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-07-26T08:07:30.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-07-26T08:07:30.475 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-07-26T08:07:30.477 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-07-26T08:07:30.478 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-07-26T08:07:30.533 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-07-26T08:07:30.533 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-07-26T08:07:30.561 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-07-26T08:07:30.563 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-07-26T08:07:30.594 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-07-26T08:07:30.595 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2024-07-26T08:07:30.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T08:07:30.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T08:07:30.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T08:07:30.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T08:07:30.693 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T08:07:30.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T08:07:30.719 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-07-26T08:07:30.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-07-26T08:07:30.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-07-26T08:07:30.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-07-26T08:07:30.839 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-07-26T08:07:30.848 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-07-26T08:07:30.852 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-07-26T08:07:30.968 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-07-26T08:07:30.979 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-07-26T08:07:30.980 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi063.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-07-26T08:13:57.144 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2024-07-26T08:13:57.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-07-26T08:13:57.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:13:57.268 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-07-26T08:13:57.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-07-26T08:13:57.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-07-26T08:13:57.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:13:57.507 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-07-26T08:13:57.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-07-26T08:13:57.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-07-26T08:13:57.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T08:13:57.678 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-07-26T08:13:57.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-07-26T08:13:57.757 INFO:teuthology.run_tasks:Running task clock... 2024-07-26T08:13:57.767 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-07-26T08:13:57.768 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-26T08:13:57.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T08:13:57.776 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-26T08:13:57.776 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T08:13:57.778 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-26T08:13:57.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T08:13:57.811 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-26T08:13:57.827 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-26T08:13:57.829 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-26T08:13:57.844 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-26T08:13:57.852 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-07-26T08:13:57.864 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-07-26T08:13:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-07-26T08:13:57.870 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-26T08:13:57.878 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-26T08:13:57.880 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-07-26T08:13:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-26T08:13:57.894 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-26T08:13:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-26T08:13:57.918 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-26T08:13:57.949 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-07-26T08:13:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T08:13:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-07-26T08:13:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.964 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-07-26T08:13:57.968 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T08:13:57.968 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-07-26T08:13:57.968 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.968 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.968 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.968 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:57.999 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-07-26T08:13:58.036 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-07-26T08:13:58.080 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-26T08:13:58.124 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-26T08:13:58.276 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-07-26T08:13:58.285 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T08:13:58.285 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-07-26T08:13:58.285 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:58.285 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:58.285 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:58.285 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T08:13:58.287 INFO:teuthology.run_tasks:Running task install... 2024-07-26T08:13:58.296 DEBUG:teuthology.task.install:project ceph 2024-07-26T08:13:58.296 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528'}} 2024-07-26T08:13:58.296 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528'} 2024-07-26T08:13:58.296 INFO:teuthology.task.install:Using flavor: default 2024-07-26T08:13:58.302 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-07-26T08:13:58.302 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-07-26T08:13:58.302 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'tag': None, 'wait_for_package': False} 2024-07-26T08:13:58.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:13:58.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'tag': None, 'wait_for_package': False} 2024-07-26T08:13:58.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:13:58.307 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'tag': None, 'wait_for_package': False} 2024-07-26T08:13:58.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:13:58.451 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/ 2024-07-26T08:13:58.452 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5320.ge8f88bb1 2024-07-26T08:13:58.465 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/ 2024-07-26T08:13:58.466 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5320.ge8f88bb1 2024-07-26T08:13:58.470 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/ 2024-07-26T08:13:58.470 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5320.ge8f88bb1 2024-07-26T08:13:58.566 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-26T08:13:58.566 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:13:58.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-26T08:13:58.577 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-26T08:13:58.577 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:13:58.577 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-26T08:13:58.586 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-26T08:13:58.587 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:13:58.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-26T08:13:58.607 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-26T08:13:58.607 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-26T08:13:58.617 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-26T08:13:58.617 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-26T08:13:58.659 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-26T08:13:58.660 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-26T08:13:58.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-26T08:13:58.687 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-26T08:13:58.755 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-26T08:13:58.766 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-26T08:13:58.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-26T08:13:58.819 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-07-26T08:13:58.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-07-26T08:13:58.832 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-07-26T08:13:58.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-07-26T08:13:58.915 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-26T08:13:59.004 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-07-26T08:13:59.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-07-26T08:13:59.049 INFO:teuthology.orchestra.run.smithi133.stdout:45 files removed 2024-07-26T08:13:59.073 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-07-26T08:13:59.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-26T08:13:59.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-26T08:13:59.348 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-07-26T08:13:59.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-26T08:13:59.662 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 257 kB/s | 83 kB 00:00 2024-07-26T08:13:59.691 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 263 kB/s | 83 kB 00:00 2024-07-26T08:13:59.988 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 85 kB/s | 24 kB 00:00 2024-07-26T08:14:00.041 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 78 kB/s | 24 kB 00:00 2024-07-26T08:14:00.208 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 222 kB/s | 83 kB 00:00 2024-07-26T08:14:00.289 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 7.1 kB/s | 1.9 kB 00:00 2024-07-26T08:14:00.367 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-07-26T08:14:00.708 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 59 kB/s | 24 kB 00:00 2024-07-26T08:14:01.184 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-07-26T08:14:02.099 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.2 MB 00:00 2024-07-26T08:14:02.339 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-07-26T08:14:02.450 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-07-26T08:14:04.313 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-07-26T08:14:04.710 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-07-26T08:14:05.757 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-07-26T08:14:08.930 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.5 MB 00:00 2024-07-26T08:14:09.434 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-07-26T08:14:10.723 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-07-26T08:14:11.426 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-07-26T08:14:11.515 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:02 2024-07-26T08:14:11.610 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-07-26T08:14:12.782 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-07-26T08:14:13.482 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 18 kB 00:00 2024-07-26T08:14:14.478 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-07-26T08:14:17.342 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-07-26T08:14:19.445 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-07-26T08:14:19.681 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T08:14:19.682 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T08:14:19.694 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-26T08:14:19.695 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-26T08:14:19.695 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-26T08:14:19.696 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-26T08:14:19.698 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-26T08:14:19.701 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-26T08:14:19.701 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-26T08:14:19.770 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 6.6 k 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.5 M 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 872 k 2024-07-26T08:14:19.809 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 148 k 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 1.5 M 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 149 k 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 14 M 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 7.4 M 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 49 k 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 10 M 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 44 M 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 274 k 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 771 k 2024-07-26T08:14:22.856 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 225 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 27 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 18 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 32 k 2024-07-26T08:14:22.857 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 765 k 2024-07-26T08:14:22.858 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 127 k 2024-07-26T08:14:22.858 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-26T08:14:22.858 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-26T08:14:22.858 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-26T08:14:22.858 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-26T08:14:22.859 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-26T08:14:22.859 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-26T08:14:22.859 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 188 k 2024-07-26T08:14:22.859 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 372 k 2024-07-26T08:14:22.859 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 355 k 2024-07-26T08:14:22.860 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 116 k 2024-07-26T08:14:22.860 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 86 k 2024-07-26T08:14:22.860 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T08:14:22.860 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 170 k 2024-07-26T08:14:22.860 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-26T08:14:22.860 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-26T08:14:22.861 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-26T08:14:22.862 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.4 M 2024-07-26T08:14:22.862 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T08:14:22.862 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-26T08:14:22.862 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 20 M 2024-07-26T08:14:22.863 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 34 k 2024-07-26T08:14:22.864 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 2.3 M 2024-07-26T08:14:22.864 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 284 k 2024-07-26T08:14:22.864 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 4.9 M 2024-07-26T08:14:22.864 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 18 M 2024-07-26T08:14:22.865 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 16 k 2024-07-26T08:14:22.865 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 25 k 2024-07-26T08:14:22.865 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-26T08:14:22.865 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-26T08:14:22.865 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-26T08:14:22.866 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-26T08:14:22.866 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-26T08:14:22.866 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-26T08:14:22.866 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-26T08:14:22.866 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 158 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 503 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.3 M 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-26T08:14:22.867 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-26T08:14:22.868 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 45 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 138 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-26T08:14:22.869 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-26T08:14:22.870 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-26T08:14:22.871 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-26T08:14:22.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-26T08:14:22.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-26T08:14:22.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-26T08:14:22.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-26T08:14:22.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-26T08:14:22.872 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-26T08:14:22.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-26T08:14:22.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-26T08:14:22.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-26T08:14:22.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-26T08:14:22.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-26T08:14:22.873 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-26T08:14:22.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-26T08:14:22.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-26T08:14:22.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-26T08:14:22.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-26T08:14:22.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-26T08:14:22.874 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-26T08:14:22.875 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:14:22.876 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-07-26T08:14:22.877 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-07-26T08:14:22.877 INFO:teuthology.orchestra.run.smithi063.stdout:Install 148 Packages 2024-07-26T08:14:22.877 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 12 Packages 2024-07-26T08:14:22.877 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:14:22.882 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 233 M 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(1/160): ceph-19.0.0-5320.ge8f88bb1.el9.x86_64. 34 kB/s | 6.6 kB 00:00 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(2/160): ceph-fuse-19.0.0-5320.ge8f88bb1.el9.x8 1.9 MB/s | 872 kB 00:00 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(3/160): ceph-immutable-object-cache-19.0.0-532 2.2 MB/s | 148 kB 00:00 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(4/160): ceph-mds-19.0.0-5320.ge8f88bb1.el9.x86 2.8 MB/s | 2.3 MB 00:00 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(5/160): ceph-mgr-19.0.0-5320.ge8f88bb1.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(6/160): ceph-base-19.0.0-5320.ge8f88bb1.el9.x8 2.8 MB/s | 5.5 MB 00:01 2024-07-26T08:14:22.883 INFO:teuthology.orchestra.run.smithi063.stdout:(7/160): ceph-common-19.0.0-5320.ge8f88bb1.el9. 8.1 MB/s | 20 MB 00:02 2024-07-26T08:14:22.885 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T08:14:22.885 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T08:14:22.885 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-26T08:14:22.885 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-26T08:14:22.885 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-07-26T08:14:22.886 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 6.6 k 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.5 M 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 872 k 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 148 k 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 1.5 M 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 149 k 2024-07-26T08:14:22.887 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 14 M 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 7.4 M 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 49 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 10 M 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 44 M 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 274 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 771 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 225 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 27 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 18 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-26T08:14:22.888 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 32 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 765 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 127 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 188 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 372 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 355 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 116 k 2024-07-26T08:14:22.889 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 86 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 170 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-26T08:14:22.890 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.4 M 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 20 M 2024-07-26T08:14:22.891 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 34 k 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 2.3 M 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 284 k 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 4.9 M 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 18 M 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 16 k 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 25 k 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-26T08:14:22.892 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 158 k 2024-07-26T08:14:22.893 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 503 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.3 M 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-26T08:14:22.894 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-26T08:14:22.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 45 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 138 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-26T08:14:22.896 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-26T08:14:22.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-26T08:14:22.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-26T08:14:22.899 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-26T08:14:22.900 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:14:22.901 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi043.stdout:Install 148 Packages 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 12 Packages 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 233 M 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-26T08:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-07-26T08:14:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 6.6 k 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.5 M 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 872 k 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 148 k 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 1.5 M 2024-07-26T08:14:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 149 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 14 M 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 7.4 M 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 49 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 10 M 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 44 M 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 274 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 771 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 225 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-shell x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 27 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 18 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-26T08:14:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 32 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 765 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 127 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 188 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 372 k 2024-07-26T08:14:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 355 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 116 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 86 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 170 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-26T08:14:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.4 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 20 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 34 k 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 2.3 M 2024-07-26T08:14:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 284 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 4.9 M 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 18 M 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 16 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 25 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 158 k 2024-07-26T08:14:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 503 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.3 M 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-26T08:14:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 45 k 2024-07-26T08:14:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 138 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-26T08:14:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-26T08:14:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-26T08:14:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-26T08:14:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-07-26T08:14:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout:Install 148 Packages 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 12 Packages 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 233 M 2024-07-26T08:14:22.917 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-07-26T08:14:23.138 INFO:teuthology.orchestra.run.smithi043.stdout:(1/160): ceph-19.0.0-5320.ge8f88bb1.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-07-26T08:14:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:(8/160): ceph-radosgw-19.0.0-5320.ge8f88bb1.el9 30 MB/s | 10 MB 00:00 2024-07-26T08:14:23.285 INFO:teuthology.orchestra.run.smithi133.stdout:(1/160): ceph-19.0.0-5320.ge8f88bb1.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-07-26T08:14:23.286 INFO:teuthology.orchestra.run.smithi063.stdout:(9/160): ceph-mon-19.0.0-5320.ge8f88bb1.el9.x86 4.7 MB/s | 4.9 MB 00:01 2024-07-26T08:14:23.311 INFO:teuthology.orchestra.run.smithi063.stdout:(10/160): ceph-selinux-19.0.0-5320.ge8f88bb1.el 274 kB/s | 25 kB 00:00 2024-07-26T08:14:23.338 INFO:teuthology.orchestra.run.smithi043.stdout:(2/160): ceph-fuse-19.0.0-5320.ge8f88bb1.el9.x8 4.3 MB/s | 872 kB 00:00 2024-07-26T08:14:23.386 INFO:teuthology.orchestra.run.smithi063.stdout:(11/160): cephfs-mirror-19.0.0-5320.ge8f88bb1.e 2.9 MB/s | 225 kB 00:00 2024-07-26T08:14:23.397 INFO:teuthology.orchestra.run.smithi043.stdout:(3/160): ceph-immutable-object-cache-19.0.0-532 2.5 MB/s | 148 kB 00:00 2024-07-26T08:14:23.420 INFO:teuthology.orchestra.run.smithi063.stdout:(12/160): cephfs-shell-19.0.0-5320.ge8f88bb1.el 812 kB/s | 27 kB 00:00 2024-07-26T08:14:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:(13/160): libcephfs-devel-19.0.0-5320.ge8f88bb1 476 kB/s | 32 kB 00:00 2024-07-26T08:14:23.587 INFO:teuthology.orchestra.run.smithi063.stdout:(14/160): libcephfs2-19.0.0-5320.ge8f88bb1.el9. 7.5 MB/s | 765 kB 00:00 2024-07-26T08:14:23.635 INFO:teuthology.orchestra.run.smithi133.stdout:(2/160): ceph-fuse-19.0.0-5320.ge8f88bb1.el9.x8 2.4 MB/s | 872 kB 00:00 2024-07-26T08:14:23.654 INFO:teuthology.orchestra.run.smithi063.stdout:(15/160): libcephsqlite-19.0.0-5320.ge8f88bb1.e 2.3 MB/s | 158 kB 00:00 2024-07-26T08:14:23.694 INFO:teuthology.orchestra.run.smithi133.stdout:(3/160): ceph-immutable-object-cache-19.0.0-532 2.5 MB/s | 148 kB 00:00 2024-07-26T08:14:23.697 INFO:teuthology.orchestra.run.smithi043.stdout:(4/160): ceph-base-19.0.0-5320.ge8f88bb1.el9.x8 6.5 MB/s | 5.5 MB 00:00 2024-07-26T08:14:23.704 INFO:teuthology.orchestra.run.smithi063.stdout:(16/160): librados-devel-19.0.0-5320.ge8f88bb1. 2.5 MB/s | 127 kB 00:00 2024-07-26T08:14:23.781 INFO:teuthology.orchestra.run.smithi043.stdout:(5/160): ceph-mds-19.0.0-5320.ge8f88bb1.el9.x86 5.9 MB/s | 2.3 MB 00:00 2024-07-26T08:14:23.796 INFO:teuthology.orchestra.run.smithi063.stdout:(17/160): libradosstriper1-19.0.0-5320.ge8f88bb 5.4 MB/s | 503 kB 00:00 2024-07-26T08:14:23.956 INFO:teuthology.orchestra.run.smithi043.stdout:(6/160): ceph-mgr-19.0.0-5320.ge8f88bb1.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-07-26T08:14:24.305 INFO:teuthology.orchestra.run.smithi063.stdout:(18/160): librgw2-19.0.0-5320.ge8f88bb1.el9.x86 10 MB/s | 5.3 MB 00:00 2024-07-26T08:14:24.372 INFO:teuthology.orchestra.run.smithi063.stdout:(19/160): python3-ceph-argparse-19.0.0-5320.ge8 679 kB/s | 45 kB 00:00 2024-07-26T08:14:24.402 INFO:teuthology.orchestra.run.smithi133.stdout:(4/160): ceph-mds-19.0.0-5320.ge8f88bb1.el9.x86 3.2 MB/s | 2.3 MB 00:00 2024-07-26T08:14:24.431 INFO:teuthology.orchestra.run.smithi063.stdout:(20/160): python3-ceph-common-19.0.0-5320.ge8f8 2.3 MB/s | 138 kB 00:00 2024-07-26T08:14:24.439 INFO:teuthology.orchestra.run.smithi043.stdout:(7/160): ceph-mon-19.0.0-5320.ge8f88bb1.el9.x86 7.4 MB/s | 4.9 MB 00:00 2024-07-26T08:14:24.477 INFO:teuthology.orchestra.run.smithi133.stdout:(5/160): ceph-base-19.0.0-5320.ge8f88bb1.el9.x8 4.0 MB/s | 5.5 MB 00:01 2024-07-26T08:14:24.481 INFO:teuthology.orchestra.run.smithi063.stdout:(21/160): python3-cephfs-19.0.0-5320.ge8f88bb1. 3.7 MB/s | 188 kB 00:00 2024-07-26T08:14:24.581 INFO:teuthology.orchestra.run.smithi063.stdout:(22/160): python3-rados-19.0.0-5320.ge8f88bb1.e 3.6 MB/s | 372 kB 00:00 2024-07-26T08:14:24.673 INFO:teuthology.orchestra.run.smithi063.stdout:(23/160): python3-rbd-19.0.0-5320.ge8f88bb1.el9 3.8 MB/s | 355 kB 00:00 2024-07-26T08:14:24.757 INFO:teuthology.orchestra.run.smithi063.stdout:(24/160): python3-rgw-19.0.0-5320.ge8f88bb1.el9 1.4 MB/s | 116 kB 00:00 2024-07-26T08:14:24.857 INFO:teuthology.orchestra.run.smithi063.stdout:(25/160): rbd-fuse-19.0.0-5320.ge8f88bb1.el9.x8 863 kB/s | 86 kB 00:00 2024-07-26T08:14:25.061 INFO:teuthology.orchestra.run.smithi133.stdout:(6/160): ceph-mgr-19.0.0-5320.ge8f88bb1.el9.x86 2.3 MB/s | 1.5 MB 00:00 2024-07-26T08:14:25.195 INFO:teuthology.orchestra.run.smithi133.stdout:(7/160): ceph-mon-19.0.0-5320.ge8f88bb1.el9.x86 6.8 MB/s | 4.9 MB 00:00 2024-07-26T08:14:25.207 INFO:teuthology.orchestra.run.smithi063.stdout:(26/160): rbd-mirror-19.0.0-5320.ge8f88bb1.el9. 8.8 MB/s | 3.1 MB 00:00 2024-07-26T08:14:25.266 INFO:teuthology.orchestra.run.smithi063.stdout:(27/160): rbd-nbd-19.0.0-5320.ge8f88bb1.el9.x86 2.8 MB/s | 170 kB 00:00 2024-07-26T08:14:25.273 INFO:teuthology.orchestra.run.smithi043.stdout:(8/160): ceph-radosgw-19.0.0-5320.ge8f88bb1.el9 12 MB/s | 10 MB 00:00 2024-07-26T08:14:25.325 INFO:teuthology.orchestra.run.smithi063.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5320.g 589 kB/s | 34 kB 00:00 2024-07-26T08:14:25.383 INFO:teuthology.orchestra.run.smithi063.stdout:(29/160): ceph-mgr-cephadm-19.0.0-5320.ge8f88bb 2.5 MB/s | 149 kB 00:00 2024-07-26T08:14:25.545 INFO:teuthology.orchestra.run.smithi133.stdout:(8/160): ceph-common-19.0.0-5320.ge8f88bb1.el9. 8.1 MB/s | 20 MB 00:02 2024-07-26T08:14:25.557 INFO:teuthology.orchestra.run.smithi043.stdout:(9/160): ceph-common-19.0.0-5320.ge8f88bb1.el9. 7.3 MB/s | 20 MB 00:02 2024-07-26T08:14:25.582 INFO:teuthology.orchestra.run.smithi043.stdout:(10/160): ceph-selinux-19.0.0-5320.ge8f88bb1.el 82 kB/s | 25 kB 00:00 2024-07-26T08:14:25.612 INFO:teuthology.orchestra.run.smithi133.stdout:(9/160): ceph-selinux-19.0.0-5320.ge8f88bb1.el9 378 kB/s | 25 kB 00:00 2024-07-26T08:14:25.666 INFO:teuthology.orchestra.run.smithi043.stdout:(11/160): cephfs-mirror-19.0.0-5320.ge8f88bb1.e 2.7 MB/s | 225 kB 00:00 2024-07-26T08:14:25.766 INFO:teuthology.orchestra.run.smithi043.stdout:(12/160): cephfs-shell-19.0.0-5320.ge8f88bb1.el 272 kB/s | 27 kB 00:00 2024-07-26T08:14:25.849 INFO:teuthology.orchestra.run.smithi043.stdout:(13/160): libcephfs-devel-19.0.0-5320.ge8f88bb1 384 kB/s | 32 kB 00:00 2024-07-26T08:14:25.920 INFO:teuthology.orchestra.run.smithi133.stdout:(10/160): ceph-radosgw-19.0.0-5320.ge8f88bb1.el 14 MB/s | 10 MB 00:00 2024-07-26T08:14:26.000 INFO:teuthology.orchestra.run.smithi043.stdout:(14/160): libcephfs2-19.0.0-5320.ge8f88bb1.el9. 5.0 MB/s | 765 kB 00:00 2024-07-26T08:14:26.004 INFO:teuthology.orchestra.run.smithi133.stdout:(11/160): cephfs-mirror-19.0.0-5320.ge8f88bb1.e 2.7 MB/s | 225 kB 00:00 2024-07-26T08:14:26.079 INFO:teuthology.orchestra.run.smithi133.stdout:(12/160): cephfs-shell-19.0.0-5320.ge8f88bb1.el 361 kB/s | 27 kB 00:00 2024-07-26T08:14:26.083 INFO:teuthology.orchestra.run.smithi043.stdout:(15/160): libcephsqlite-19.0.0-5320.ge8f88bb1.e 1.9 MB/s | 158 kB 00:00 2024-07-26T08:14:26.155 INFO:teuthology.orchestra.run.smithi133.stdout:(13/160): libcephfs-devel-19.0.0-5320.ge8f88bb1 424 kB/s | 32 kB 00:00 2024-07-26T08:14:26.159 INFO:teuthology.orchestra.run.smithi043.stdout:(16/160): librados-devel-19.0.0-5320.ge8f88bb1. 1.7 MB/s | 127 kB 00:00 2024-07-26T08:14:26.230 INFO:teuthology.orchestra.run.smithi133.stdout:(14/160): libcephfs2-19.0.0-5320.ge8f88bb1.el9. 10 MB/s | 765 kB 00:00 2024-07-26T08:14:26.280 INFO:teuthology.orchestra.run.smithi133.stdout:(15/160): libcephsqlite-19.0.0-5320.ge8f88bb1.e 3.1 MB/s | 158 kB 00:00 2024-07-26T08:14:26.325 INFO:teuthology.orchestra.run.smithi063.stdout:(30/160): ceph-mgr-dashboard-19.0.0-5320.ge8f88 15 MB/s | 14 MB 00:00 2024-07-26T08:14:26.330 INFO:teuthology.orchestra.run.smithi133.stdout:(16/160): librados-devel-19.0.0-5320.ge8f88bb1. 2.5 MB/s | 127 kB 00:00 2024-07-26T08:14:26.406 INFO:teuthology.orchestra.run.smithi133.stdout:(17/160): libradosstriper1-19.0.0-5320.ge8f88bb 6.6 MB/s | 503 kB 00:00 2024-07-26T08:14:26.451 INFO:teuthology.orchestra.run.smithi043.stdout:(17/160): ceph-osd-19.0.0-5320.ge8f88bb1.el9.x8 7.1 MB/s | 18 MB 00:02 2024-07-26T08:14:26.509 INFO:teuthology.orchestra.run.smithi043.stdout:(18/160): libradosstriper1-19.0.0-5320.ge8f88bb 1.4 MB/s | 503 kB 00:00 2024-07-26T08:14:26.601 INFO:teuthology.orchestra.run.smithi043.stdout:(19/160): python3-ceph-argparse-19.0.0-5320.ge8 496 kB/s | 45 kB 00:00 2024-07-26T08:14:26.702 INFO:teuthology.orchestra.run.smithi043.stdout:(20/160): python3-ceph-common-19.0.0-5320.ge8f8 1.4 MB/s | 138 kB 00:00 2024-07-26T08:14:26.798 INFO:teuthology.orchestra.run.smithi133.stdout:(18/160): librgw2-19.0.0-5320.ge8f88bb1.el9.x86 13 MB/s | 5.3 MB 00:00 2024-07-26T08:14:26.802 INFO:teuthology.orchestra.run.smithi043.stdout:(21/160): python3-cephfs-19.0.0-5320.ge8f88bb1. 1.8 MB/s | 188 kB 00:00 2024-07-26T08:14:26.839 INFO:teuthology.orchestra.run.smithi133.stdout:(19/160): python3-ceph-argparse-19.0.0-5320.ge8 1.1 MB/s | 45 kB 00:00 2024-07-26T08:14:26.877 INFO:teuthology.orchestra.run.smithi043.stdout:(22/160): python3-rados-19.0.0-5320.ge8f88bb1.e 4.9 MB/s | 372 kB 00:00 2024-07-26T08:14:26.883 INFO:teuthology.orchestra.run.smithi063.stdout:(31/160): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-07-26T08:14:26.906 INFO:teuthology.orchestra.run.smithi133.stdout:(20/160): python3-ceph-common-19.0.0-5320.ge8f8 2.0 MB/s | 138 kB 00:00 2024-07-26T08:14:26.953 INFO:teuthology.orchestra.run.smithi043.stdout:(23/160): python3-rbd-19.0.0-5320.ge8f88bb1.el9 4.7 MB/s | 355 kB 00:00 2024-07-26T08:14:26.975 INFO:teuthology.orchestra.run.smithi063.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5320.ge8 3.0 MB/s | 284 kB 00:00 2024-07-26T08:14:26.990 INFO:teuthology.orchestra.run.smithi133.stdout:(21/160): python3-cephfs-19.0.0-5320.ge8f88bb1. 2.2 MB/s | 188 kB 00:00 2024-07-26T08:14:27.028 INFO:teuthology.orchestra.run.smithi043.stdout:(24/160): python3-rgw-19.0.0-5320.ge8f88bb1.el9 1.5 MB/s | 116 kB 00:00 2024-07-26T08:14:27.051 INFO:teuthology.orchestra.run.smithi063.stdout:(33/160): ceph-mgr-rook-19.0.0-5320.ge8f88bb1.e 655 kB/s | 49 kB 00:00 2024-07-26T08:14:27.082 INFO:teuthology.orchestra.run.smithi133.stdout:(22/160): python3-rados-19.0.0-5320.ge8f88bb1.e 4.0 MB/s | 372 kB 00:00 2024-07-26T08:14:27.120 INFO:teuthology.orchestra.run.smithi043.stdout:(25/160): rbd-fuse-19.0.0-5320.ge8f88bb1.el9.x8 950 kB/s | 86 kB 00:00 2024-07-26T08:14:27.174 INFO:teuthology.orchestra.run.smithi133.stdout:(23/160): python3-rbd-19.0.0-5320.ge8f88bb1.el9 3.8 MB/s | 355 kB 00:00 2024-07-26T08:14:27.201 INFO:teuthology.orchestra.run.smithi063.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5320.ge 110 kB/s | 16 kB 00:00 2024-07-26T08:14:27.254 INFO:teuthology.orchestra.run.smithi043.stdout:(26/160): librgw2-19.0.0-5320.ge8f88bb1.el9.x86 6.6 MB/s | 5.3 MB 00:00 2024-07-26T08:14:27.257 INFO:teuthology.orchestra.run.smithi133.stdout:(24/160): python3-rgw-19.0.0-5320.ge8f88bb1.el9 1.4 MB/s | 116 kB 00:00 2024-07-26T08:14:27.268 INFO:teuthology.orchestra.run.smithi063.stdout:(35/160): ceph-volume-19.0.0-5320.ge8f88bb1.el9 4.0 MB/s | 274 kB 00:00 2024-07-26T08:14:27.321 INFO:teuthology.orchestra.run.smithi043.stdout:(27/160): rbd-nbd-19.0.0-5320.ge8f88bb1.el9.x86 2.5 MB/s | 170 kB 00:00 2024-07-26T08:14:27.324 INFO:teuthology.orchestra.run.smithi133.stdout:(25/160): rbd-fuse-19.0.0-5320.ge8f88bb1.el9.x8 1.3 MB/s | 86 kB 00:00 2024-07-26T08:14:27.360 INFO:teuthology.orchestra.run.smithi063.stdout:(36/160): cephadm-19.0.0-5320.ge8f88bb1.el9.noa 8.2 MB/s | 771 kB 00:00 2024-07-26T08:14:27.396 INFO:teuthology.orchestra.run.smithi043.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5320.g 463 kB/s | 34 kB 00:00 2024-07-26T08:14:27.460 INFO:teuthology.orchestra.run.smithi063.stdout:(37/160): cephfs-top-19.0.0-5320.ge8f88bb1.el9. 182 kB/s | 18 kB 00:00 2024-07-26T08:14:27.541 INFO:teuthology.orchestra.run.smithi133.stdout:(26/160): rbd-mirror-19.0.0-5320.ge8f88bb1.el9. 14 MB/s | 3.1 MB 00:00 2024-07-26T08:14:27.563 INFO:teuthology.orchestra.run.smithi043.stdout:(29/160): rbd-mirror-19.0.0-5320.ge8f88bb1.el9. 7.0 MB/s | 3.1 MB 00:00 2024-07-26T08:14:27.591 INFO:teuthology.orchestra.run.smithi133.stdout:(27/160): rbd-nbd-19.0.0-5320.ge8f88bb1.el9.x86 3.3 MB/s | 170 kB 00:00 2024-07-26T08:14:27.596 INFO:teuthology.orchestra.run.smithi043.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5320.ge8f88bb 749 kB/s | 149 kB 00:00 2024-07-26T08:14:27.602 INFO:teuthology.orchestra.run.smithi063.stdout:(38/160): fuse-2.9.9-16.el9.x86_64.rpm 564 kB/s | 80 kB 00:00 2024-07-26T08:14:27.642 INFO:teuthology.orchestra.run.smithi133.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5320.g 687 kB/s | 34 kB 00:00 2024-07-26T08:14:27.725 INFO:teuthology.orchestra.run.smithi133.stdout:(29/160): ceph-mgr-cephadm-19.0.0-5320.ge8f88bb 1.8 MB/s | 149 kB 00:00 2024-07-26T08:14:27.846 INFO:teuthology.orchestra.run.smithi063.stdout:(39/160): ceph-osd-19.0.0-5320.ge8f88bb1.el9.x8 3.3 MB/s | 18 MB 00:05 2024-07-26T08:14:27.952 INFO:teuthology.orchestra.run.smithi063.stdout:(40/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-07-26T08:14:28.003 INFO:teuthology.orchestra.run.smithi063.stdout:(41/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-07-26T08:14:28.028 INFO:teuthology.orchestra.run.smithi063.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-07-26T08:14:28.095 INFO:teuthology.orchestra.run.smithi063.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-07-26T08:14:28.153 INFO:teuthology.orchestra.run.smithi063.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-07-26T08:14:28.153 INFO:teuthology.orchestra.run.smithi063.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-07-26T08:14:28.179 INFO:teuthology.orchestra.run.smithi063.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-07-26T08:14:28.212 INFO:teuthology.orchestra.run.smithi063.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-07-26T08:14:28.543 INFO:teuthology.orchestra.run.smithi133.stdout:(30/160): ceph-mgr-dashboard-19.0.0-5320.ge8f88 17 MB/s | 14 MB 00:00 2024-07-26T08:14:28.697 INFO:teuthology.orchestra.run.smithi043.stdout:(31/160): ceph-mgr-dashboard-19.0.0-5320.ge8f88 12 MB/s | 14 MB 00:01 2024-07-26T08:14:28.839 INFO:teuthology.orchestra.run.smithi043.stdout:(32/160): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-07-26T08:14:28.868 INFO:teuthology.orchestra.run.smithi133.stdout:(31/160): ceph-mgr-diskprediction-local-19.0.0- 23 MB/s | 7.4 MB 00:00 2024-07-26T08:14:28.872 INFO:teuthology.orchestra.run.smithi043.stdout:(33/160): ceph-mgr-modules-core-19.0.0-5320.ge8 1.6 MB/s | 284 kB 00:00 2024-07-26T08:14:28.898 INFO:teuthology.orchestra.run.smithi043.stdout:(34/160): ceph-mgr-rook-19.0.0-5320.ge8f88bb1.e 859 kB/s | 49 kB 00:00 2024-07-26T08:14:28.926 INFO:teuthology.orchestra.run.smithi133.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5320.ge8 4.8 MB/s | 284 kB 00:00 2024-07-26T08:14:28.968 INFO:teuthology.orchestra.run.smithi043.stdout:(35/160): ceph-prometheus-alerts-19.0.0-5320.ge 174 kB/s | 16 kB 00:00 2024-07-26T08:14:28.976 INFO:teuthology.orchestra.run.smithi133.stdout:(33/160): ceph-mgr-rook-19.0.0-5320.ge8f88bb1.e 988 kB/s | 49 kB 00:00 2024-07-26T08:14:29.015 INFO:teuthology.orchestra.run.smithi043.stdout:(36/160): ceph-volume-19.0.0-5320.ge8f88bb1.el9 2.3 MB/s | 274 kB 00:00 2024-07-26T08:14:29.026 INFO:teuthology.orchestra.run.smithi133.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5320.ge 331 kB/s | 16 kB 00:00 2024-07-26T08:14:29.077 INFO:teuthology.orchestra.run.smithi133.stdout:(35/160): ceph-volume-19.0.0-5320.ge8f88bb1.el9 5.4 MB/s | 274 kB 00:00 2024-07-26T08:14:29.082 INFO:teuthology.orchestra.run.smithi043.stdout:(37/160): cephadm-19.0.0-5320.ge8f88bb1.el9.noa 6.7 MB/s | 771 kB 00:00 2024-07-26T08:14:29.107 INFO:teuthology.orchestra.run.smithi043.stdout:(38/160): cephfs-top-19.0.0-5320.ge8f88bb1.el9. 200 kB/s | 18 kB 00:00 2024-07-26T08:14:29.144 INFO:teuthology.orchestra.run.smithi133.stdout:(36/160): cephadm-19.0.0-5320.ge8f88bb1.el9.noa 11 MB/s | 771 kB 00:00 2024-07-26T08:14:29.180 INFO:teuthology.orchestra.run.smithi063.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 689 kB/s | 689 kB 00:00 2024-07-26T08:14:29.194 INFO:teuthology.orchestra.run.smithi133.stdout:(37/160): cephfs-top-19.0.0-5320.ge8f88bb1.el9. 365 kB/s | 18 kB 00:00 2024-07-26T08:14:29.255 INFO:teuthology.orchestra.run.smithi063.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 905 kB/s | 943 kB 00:01 2024-07-26T08:14:29.283 INFO:teuthology.orchestra.run.smithi043.stdout:(39/160): fuse-2.9.9-16.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-07-26T08:14:29.433 INFO:teuthology.orchestra.run.smithi043.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-07-26T08:14:29.466 INFO:teuthology.orchestra.run.smithi043.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-07-26T08:14:29.558 INFO:teuthology.orchestra.run.smithi043.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-07-26T08:14:29.617 INFO:teuthology.orchestra.run.smithi043.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-07-26T08:14:29.709 INFO:teuthology.orchestra.run.smithi043.stdout:(44/160): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-07-26T08:14:29.759 INFO:teuthology.orchestra.run.smithi043.stdout:(45/160): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-07-26T08:14:29.761 INFO:teuthology.orchestra.run.smithi133.stdout:(38/160): ceph-osd-19.0.0-5320.ge8f88bb1.el9.x8 3.8 MB/s | 18 MB 00:04 2024-07-26T08:14:29.818 INFO:teuthology.orchestra.run.smithi043.stdout:(46/160): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-07-26T08:14:29.880 INFO:teuthology.orchestra.run.smithi063.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 35 kB/s | 22 kB 00:00 2024-07-26T08:14:29.926 INFO:teuthology.orchestra.run.smithi043.stdout:(47/160): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2024-07-26T08:14:29.947 INFO:teuthology.orchestra.run.smithi063.stdout:(51/160): boost-program-options-1.75.0-8.el9.x8 139 kB/s | 107 kB 00:00 2024-07-26T08:14:30.110 INFO:teuthology.orchestra.run.smithi043.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-07-26T08:14:30.169 INFO:teuthology.orchestra.run.smithi043.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-07-26T08:14:30.412 INFO:teuthology.orchestra.run.smithi133.stdout:(39/160): ceph-test-19.0.0-5320.ge8f88bb1.el9.x 9.2 MB/s | 44 MB 00:04 2024-07-26T08:14:30.436 INFO:teuthology.orchestra.run.smithi133.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 64 kB/s | 80 kB 00:01 2024-07-26T08:14:30.589 INFO:teuthology.orchestra.run.smithi063.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 51 kB/s | 33 kB 00:00 2024-07-26T08:14:30.653 INFO:teuthology.orchestra.run.smithi043.stdout:(50/160): ceph-test-19.0.0-5320.ge8f88bb1.el9.x 8.7 MB/s | 44 MB 00:05 2024-07-26T08:14:30.669 INFO:teuthology.orchestra.run.smithi043.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 43 kB/s | 22 kB 00:00 2024-07-26T08:14:30.720 INFO:teuthology.orchestra.run.smithi043.stdout:(52/160): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-07-26T08:14:30.737 INFO:teuthology.orchestra.run.smithi043.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 493 kB/s | 33 kB 00:00 2024-07-26T08:14:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 368 kB/s | 18 kB 00:00 2024-07-26T08:14:30.837 INFO:teuthology.orchestra.run.smithi043.stdout:(55/160): libaio-devel-0.3.111-13.el9.x86_64.rp 226 kB/s | 11 kB 00:00 2024-07-26T08:14:30.896 INFO:teuthology.orchestra.run.smithi043.stdout:(56/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-07-26T08:14:30.929 INFO:teuthology.orchestra.run.smithi043.stdout:(57/160): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-07-26T08:14:30.955 INFO:teuthology.orchestra.run.smithi043.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 783 kB/s | 45 kB 00:00 2024-07-26T08:14:31.047 INFO:teuthology.orchestra.run.smithi043.stdout:(59/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.2 MB/s | 3.0 MB 00:00 2024-07-26T08:14:31.089 INFO:teuthology.orchestra.run.smithi043.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 4.3 MB/s | 581 kB 00:00 2024-07-26T08:14:31.095 INFO:teuthology.orchestra.run.smithi133.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 602 kB/s | 803 kB 00:01 2024-07-26T08:14:31.114 INFO:teuthology.orchestra.run.smithi043.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 385 kB/s | 25 kB 00:00 2024-07-26T08:14:31.114 INFO:teuthology.orchestra.run.smithi063.stdout:(53/160): ceph-test-19.0.0-5320.ge8f88bb1.el9.x 5.7 MB/s | 44 MB 00:07 2024-07-26T08:14:31.139 INFO:teuthology.orchestra.run.smithi063.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 249 kB/s | 313 kB 00:01 2024-07-26T08:14:31.147 INFO:teuthology.orchestra.run.smithi043.stdout:(62/160): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-07-26T08:14:31.173 INFO:teuthology.orchestra.run.smithi043.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 571 kB/s | 47 kB 00:00 2024-07-26T08:14:31.206 INFO:teuthology.orchestra.run.smithi043.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-07-26T08:14:31.232 INFO:teuthology.orchestra.run.smithi043.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 608 kB/s | 35 kB 00:00 2024-07-26T08:14:31.245 INFO:teuthology.orchestra.run.smithi133.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 235 kB/s | 195 kB 00:00 2024-07-26T08:14:31.265 INFO:teuthology.orchestra.run.smithi043.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-07-26T08:14:31.337 INFO:teuthology.orchestra.run.smithi133.stdout:(43/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 281 kB/s | 253 kB 00:00 2024-07-26T08:14:31.516 INFO:teuthology.orchestra.run.smithi043.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-07-26T08:14:31.616 INFO:teuthology.orchestra.run.smithi043.stdout:(68/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-07-26T08:14:31.675 INFO:teuthology.orchestra.run.smithi043.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-07-26T08:14:31.681 INFO:teuthology.orchestra.run.smithi063.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 32 kB/s | 18 kB 00:00 2024-07-26T08:14:31.706 INFO:teuthology.orchestra.run.smithi063.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-07-26T08:14:31.733 INFO:teuthology.orchestra.run.smithi043.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-07-26T08:14:31.775 INFO:teuthology.orchestra.run.smithi043.stdout:(71/160): postgresql-contrib-13.14-1.el9.x86_64 3.4 MB/s | 911 kB 00:00 2024-07-26T08:14:31.851 INFO:teuthology.orchestra.run.smithi043.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-07-26T08:14:31.876 INFO:teuthology.orchestra.run.smithi043.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 879 kB/s | 87 kB 00:00 2024-07-26T08:14:32.071 INFO:teuthology.orchestra.run.smithi133.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 129 kB/s | 106 kB 00:00 2024-07-26T08:14:32.109 INFO:teuthology.orchestra.run.smithi043.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 263 kB/s | 61 kB 00:00 2024-07-26T08:14:32.138 INFO:teuthology.orchestra.run.smithi133.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 169 kB/s | 135 kB 00:00 2024-07-26T08:14:32.185 INFO:teuthology.orchestra.run.smithi043.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-07-26T08:14:32.232 INFO:teuthology.orchestra.run.smithi063.stdout:(57/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.8 MB/s | 3.0 MB 00:01 2024-07-26T08:14:32.263 INFO:teuthology.orchestra.run.smithi133.stdout:(46/160): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-07-26T08:14:32.310 INFO:teuthology.orchestra.run.smithi043.stdout:(76/160): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-07-26T08:14:32.407 INFO:teuthology.orchestra.run.smithi063.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-07-26T08:14:32.488 INFO:teuthology.orchestra.run.smithi133.stdout:(47/160): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-07-26T08:14:32.524 INFO:teuthology.orchestra.run.smithi063.stdout:(59/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-07-26T08:14:32.572 INFO:teuthology.orchestra.run.smithi133.stdout:(48/160): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-07-26T08:14:32.585 INFO:teuthology.orchestra.run.smithi043.stdout:(77/160): postgresql-server-13.14-1.el9.x86_64. 6.4 MB/s | 5.8 MB 00:00 2024-07-26T08:14:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 86 kB/s | 26 kB 00:00 2024-07-26T08:14:32.614 INFO:teuthology.orchestra.run.smithi133.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-07-26T08:14:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:(79/160): python3-jinja2-2.11.3-6.el9.noarch.rp 541 kB/s | 248 kB 00:00 2024-07-26T08:14:32.685 INFO:teuthology.orchestra.run.smithi133.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 656 kB/s | 22 kB 00:00 2024-07-26T08:14:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 231 kB/s | 19 kB 00:00 2024-07-26T08:14:32.701 INFO:teuthology.orchestra.run.smithi133.stdout:(51/160): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-07-26T08:14:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:(81/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-07-26T08:14:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:(82/160): python3-markupsafe-1.1.1-12.el9.x86_6 418 kB/s | 35 kB 00:00 2024-07-26T08:14:32.740 INFO:teuthology.orchestra.run.smithi133.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 788 kB/s | 33 kB 00:00 2024-07-26T08:14:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-07-26T08:14:32.838 INFO:teuthology.orchestra.run.smithi043.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-07-26T08:14:32.848 INFO:teuthology.orchestra.run.smithi133.stdout:(53/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-07-26T08:14:32.863 INFO:teuthology.orchestra.run.smithi043.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 847 kB/s | 77 kB 00:00 2024-07-26T08:14:32.888 INFO:teuthology.orchestra.run.smithi043.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 856 kB/s | 42 kB 00:00 2024-07-26T08:14:32.890 INFO:teuthology.orchestra.run.smithi133.stdout:(54/160): python3-requests-2.25.1-8.el9.noarch. 152 kB/s | 125 kB 00:00 2024-07-26T08:14:32.915 INFO:teuthology.orchestra.run.smithi133.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-07-26T08:14:32.930 INFO:teuthology.orchestra.run.smithi043.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-07-26T08:14:32.964 INFO:teuthology.orchestra.run.smithi043.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-07-26T08:14:32.966 INFO:teuthology.orchestra.run.smithi133.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-07-26T08:14:32.991 INFO:teuthology.orchestra.run.smithi133.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-07-26T08:14:32.997 INFO:teuthology.orchestra.run.smithi043.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-07-26T08:14:33.014 INFO:teuthology.orchestra.run.smithi043.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-07-26T08:14:33.049 INFO:teuthology.orchestra.run.smithi043.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-07-26T08:14:33.049 INFO:teuthology.orchestra.run.smithi133.stdout:(58/160): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-07-26T08:14:33.098 INFO:teuthology.orchestra.run.smithi043.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 848 kB/s | 42 kB 00:00 2024-07-26T08:14:33.103 INFO:teuthology.orchestra.run.smithi133.stdout:(59/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 329 kB/s | 45 kB 00:00 2024-07-26T08:14:33.134 INFO:teuthology.orchestra.run.smithi133.stdout:(60/160): python3-urllib3-1.26.5-6.el9.noarch.r 216 kB/s | 215 kB 00:00 2024-07-26T08:14:33.159 INFO:teuthology.orchestra.run.smithi133.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 460 kB/s | 25 kB 00:00 2024-07-26T08:14:33.183 INFO:teuthology.orchestra.run.smithi063.stdout:(60/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 40 kB/s | 25 kB 00:00 2024-07-26T08:14:33.184 INFO:teuthology.orchestra.run.smithi133.stdout:(62/160): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-07-26T08:14:33.224 INFO:teuthology.orchestra.run.smithi043.stdout:(93/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.2 MB/s | 5.1 MB 00:00 2024-07-26T08:14:33.235 INFO:teuthology.orchestra.run.smithi133.stdout:(63/160): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-07-26T08:14:33.249 INFO:teuthology.orchestra.run.smithi043.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 295 kB/s | 44 kB 00:00 2024-07-26T08:14:33.260 INFO:teuthology.orchestra.run.smithi133.stdout:(64/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-07-26T08:14:33.285 INFO:teuthology.orchestra.run.smithi133.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-07-26T08:14:33.291 INFO:teuthology.orchestra.run.smithi043.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-07-26T08:14:33.310 INFO:teuthology.orchestra.run.smithi133.stdout:(66/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-07-26T08:14:33.316 INFO:teuthology.orchestra.run.smithi043.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 542 kB/s | 36 kB 00:00 2024-07-26T08:14:33.333 INFO:teuthology.orchestra.run.smithi063.stdout:(61/160): librdkafka-1.6.1-102.el9.x86_64.rpm 602 kB/s | 662 kB 00:01 2024-07-26T08:14:33.349 INFO:teuthology.orchestra.run.smithi043.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 823 kB/s | 47 kB 00:00 2024-07-26T08:14:33.383 INFO:teuthology.orchestra.run.smithi043.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-07-26T08:14:33.391 INFO:teuthology.orchestra.run.smithi063.stdout:(62/160): libtool-2.4.6-46.el9.x86_64.rpm 591 kB/s | 581 kB 00:00 2024-07-26T08:14:33.394 INFO:teuthology.orchestra.run.smithi133.stdout:(67/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-07-26T08:14:33.408 INFO:teuthology.orchestra.run.smithi043.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-07-26T08:14:33.442 INFO:teuthology.orchestra.run.smithi043.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-07-26T08:14:33.509 INFO:teuthology.orchestra.run.smithi133.stdout:(68/160): postgresql-contrib-13.14-1.el9.x86_64 18 MB/s | 911 kB 00:00 2024-07-26T08:14:33.509 INFO:teuthology.orchestra.run.smithi133.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-07-26T08:14:33.509 INFO:teuthology.orchestra.run.smithi043.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-07-26T08:14:33.510 INFO:teuthology.orchestra.run.smithi043.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-07-26T08:14:33.512 INFO:teuthology.orchestra.run.smithi133.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-07-26T08:14:33.587 INFO:teuthology.orchestra.run.smithi133.stdout:(71/160): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-07-26T08:14:33.629 INFO:teuthology.orchestra.run.smithi133.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-07-26T08:14:33.654 INFO:teuthology.orchestra.run.smithi133.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-07-26T08:14:33.738 INFO:teuthology.orchestra.run.smithi133.stdout:(74/160): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-07-26T08:14:33.763 INFO:teuthology.orchestra.run.smithi133.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-07-26T08:14:33.788 INFO:teuthology.orchestra.run.smithi133.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-07-26T08:14:33.813 INFO:teuthology.orchestra.run.smithi133.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-07-26T08:14:33.839 INFO:teuthology.orchestra.run.smithi133.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-07-26T08:14:33.864 INFO:teuthology.orchestra.run.smithi133.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-07-26T08:14:33.889 INFO:teuthology.orchestra.run.smithi133.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-07-26T08:14:33.914 INFO:teuthology.orchestra.run.smithi133.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-07-26T08:14:33.942 INFO:teuthology.orchestra.run.smithi063.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 63 kB/s | 47 kB 00:00 2024-07-26T08:14:33.990 INFO:teuthology.orchestra.run.smithi133.stdout:(82/160): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-07-26T08:14:34.010 INFO:teuthology.orchestra.run.smithi043.stdout:(103/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-07-26T08:14:34.015 INFO:teuthology.orchestra.run.smithi133.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-07-26T08:14:34.040 INFO:teuthology.orchestra.run.smithi133.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-07-26T08:14:34.057 INFO:teuthology.orchestra.run.smithi133.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-07-26T08:14:34.074 INFO:teuthology.orchestra.run.smithi133.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-07-26T08:14:34.108 INFO:teuthology.orchestra.run.smithi133.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-07-26T08:14:34.135 INFO:teuthology.orchestra.run.smithi133.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-07-26T08:14:34.168 INFO:teuthology.orchestra.run.smithi133.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-07-26T08:14:34.192 INFO:teuthology.orchestra.run.smithi133.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-07-26T08:14:34.218 INFO:teuthology.orchestra.run.smithi133.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-07-26T08:14:34.219 INFO:teuthology.orchestra.run.smithi043.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 2.7 MB/s | 548 kB 00:00 2024-07-26T08:14:34.275 INFO:teuthology.orchestra.run.smithi063.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 213 kB/s | 188 kB 00:00 2024-07-26T08:14:34.277 INFO:teuthology.orchestra.run.smithi043.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-07-26T08:14:34.285 INFO:teuthology.orchestra.run.smithi133.stdout:(92/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-07-26T08:14:34.303 INFO:teuthology.orchestra.run.smithi043.stdout:(106/160): lua-devel-5.4.4-4.el9.x86_64.rpm 27 kB/s | 22 kB 00:00 2024-07-26T08:14:34.309 INFO:teuthology.orchestra.run.smithi063.stdout:(65/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 300 kB/s | 292 kB 00:00 2024-07-26T08:14:34.310 INFO:teuthology.orchestra.run.smithi133.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 452 kB/s | 42 kB 00:00 2024-07-26T08:14:34.328 INFO:teuthology.orchestra.run.smithi043.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 409 kB/s | 19 kB 00:00 2024-07-26T08:14:34.335 INFO:teuthology.orchestra.run.smithi133.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-07-26T08:14:34.361 INFO:teuthology.orchestra.run.smithi133.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-07-26T08:14:34.386 INFO:teuthology.orchestra.run.smithi133.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-07-26T08:14:34.411 INFO:teuthology.orchestra.run.smithi133.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-07-26T08:14:34.428 INFO:teuthology.orchestra.run.smithi043.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 972 kB/s | 26 kB 00:00 2024-07-26T08:14:34.436 INFO:teuthology.orchestra.run.smithi133.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-07-26T08:14:34.462 INFO:teuthology.orchestra.run.smithi133.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-07-26T08:14:34.462 INFO:teuthology.orchestra.run.smithi043.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-07-26T08:14:34.487 INFO:teuthology.orchestra.run.smithi133.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-07-26T08:14:34.495 INFO:teuthology.orchestra.run.smithi043.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-07-26T08:14:34.512 INFO:teuthology.orchestra.run.smithi133.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-07-26T08:14:34.529 INFO:teuthology.orchestra.run.smithi043.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 4.6 MB/s | 151 kB 00:00 2024-07-26T08:14:34.537 INFO:teuthology.orchestra.run.smithi133.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-07-26T08:14:34.626 INFO:teuthology.orchestra.run.smithi063.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 51 kB/s | 35 kB 00:00 2024-07-26T08:14:34.629 INFO:teuthology.orchestra.run.smithi043.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-07-26T08:14:34.696 INFO:teuthology.orchestra.run.smithi043.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-07-26T08:14:34.747 INFO:teuthology.orchestra.run.smithi043.stdout:(114/160): protobuf-compiler-3.14.0-13.el9.x86_ 694 kB/s | 863 kB 00:01 2024-07-26T08:14:34.822 INFO:teuthology.orchestra.run.smithi043.stdout:(115/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 348 kB/s | 43 kB 00:00 2024-07-26T08:14:34.871 INFO:teuthology.orchestra.run.smithi133.stdout:(103/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-07-26T08:14:34.896 INFO:teuthology.orchestra.run.smithi133.stdout:(104/160): lua-devel-5.4.4-4.el9.x86_64.rpm 58 kB/s | 22 kB 00:00 2024-07-26T08:14:34.922 INFO:teuthology.orchestra.run.smithi043.stdout:(116/160): python3-cachetools-4.2.4-1.el9.noarc 184 kB/s | 32 kB 00:00 2024-07-26T08:14:34.974 INFO:teuthology.orchestra.run.smithi043.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 94 kB/s | 14 kB 00:00 2024-07-26T08:14:34.988 INFO:teuthology.orchestra.run.smithi133.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-07-26T08:14:35.013 INFO:teuthology.orchestra.run.smithi133.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-07-26T08:14:35.015 INFO:teuthology.orchestra.run.smithi043.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 1.9 MB/s | 172 kB 00:00 2024-07-26T08:14:35.039 INFO:teuthology.orchestra.run.smithi133.stdout:(107/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-07-26T08:14:35.057 INFO:teuthology.orchestra.run.smithi043.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 4.3 MB/s | 358 kB 00:00 2024-07-26T08:14:35.064 INFO:teuthology.orchestra.run.smithi133.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-07-26T08:14:35.089 INFO:teuthology.orchestra.run.smithi133.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-07-26T08:14:35.090 INFO:teuthology.orchestra.run.smithi043.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-07-26T08:14:35.115 INFO:teuthology.orchestra.run.smithi133.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-07-26T08:14:35.132 INFO:teuthology.orchestra.run.smithi043.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 2.8 MB/s | 216 kB 00:00 2024-07-26T08:14:35.156 INFO:teuthology.orchestra.run.smithi133.stdout:(111/160): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-07-26T08:14:35.174 INFO:teuthology.orchestra.run.smithi043.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-07-26T08:14:35.181 INFO:teuthology.orchestra.run.smithi133.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-07-26T08:14:35.191 INFO:teuthology.orchestra.run.smithi043.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 677 kB/s | 11 kB 00:00 2024-07-26T08:14:35.208 INFO:teuthology.orchestra.run.smithi043.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 1.1 MB/s | 18 kB 00:00 2024-07-26T08:14:35.233 INFO:teuthology.orchestra.run.smithi043.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 961 kB/s | 23 kB 00:00 2024-07-26T08:14:35.250 INFO:teuthology.orchestra.run.smithi133.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-07-26T08:14:35.251 INFO:teuthology.orchestra.run.smithi043.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-07-26T08:14:35.274 INFO:teuthology.orchestra.run.smithi133.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-07-26T08:14:35.276 INFO:teuthology.orchestra.run.smithi043.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 815 kB/s | 20 kB 00:00 2024-07-26T08:14:35.299 INFO:teuthology.orchestra.run.smithi133.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-07-26T08:14:35.333 INFO:teuthology.orchestra.run.smithi133.stdout:(116/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-07-26T08:14:35.358 INFO:teuthology.orchestra.run.smithi133.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-07-26T08:14:35.376 INFO:teuthology.orchestra.run.smithi043.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-07-26T08:14:35.384 INFO:teuthology.orchestra.run.smithi133.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-07-26T08:14:35.393 INFO:teuthology.orchestra.run.smithi043.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-07-26T08:14:35.409 INFO:teuthology.orchestra.run.smithi133.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-07-26T08:14:35.427 INFO:teuthology.orchestra.run.smithi043.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.4 MB/s | 79 kB 00:00 2024-07-26T08:14:35.476 INFO:teuthology.orchestra.run.smithi133.stdout:(120/160): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-07-26T08:14:35.501 INFO:teuthology.orchestra.run.smithi133.stdout:(121/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-07-26T08:14:35.519 INFO:teuthology.orchestra.run.smithi043.stdout:(131/160): libarrow-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-07-26T08:14:35.526 INFO:teuthology.orchestra.run.smithi133.stdout:(122/160): python3-google-auth-2.32.0-1.el9.noa 1.8 MB/s | 216 kB 00:00 2024-07-26T08:14:35.544 INFO:teuthology.orchestra.run.smithi043.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 497 kB/s | 58 kB 00:00 2024-07-26T08:14:35.551 INFO:teuthology.orchestra.run.smithi063.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 3.7 MB/s | 4.7 MB 00:01 2024-07-26T08:14:35.552 INFO:teuthology.orchestra.run.smithi133.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-07-26T08:14:35.577 INFO:teuthology.orchestra.run.smithi133.stdout:(124/160): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-07-26T08:14:35.603 INFO:teuthology.orchestra.run.smithi133.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 350 kB/s | 18 kB 00:00 2024-07-26T08:14:35.618 INFO:teuthology.orchestra.run.smithi063.stdout:(68/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-07-26T08:14:35.620 INFO:teuthology.orchestra.run.smithi043.stdout:(133/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-07-26T08:14:35.627 INFO:teuthology.orchestra.run.smithi133.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-07-26T08:14:35.645 INFO:teuthology.orchestra.run.smithi043.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-07-26T08:14:35.653 INFO:teuthology.orchestra.run.smithi133.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-07-26T08:14:35.670 INFO:teuthology.orchestra.run.smithi133.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-07-26T08:14:35.670 INFO:teuthology.orchestra.run.smithi043.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-07-26T08:14:35.695 INFO:teuthology.orchestra.run.smithi133.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-07-26T08:14:35.720 INFO:teuthology.orchestra.run.smithi133.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-07-26T08:14:35.721 INFO:teuthology.orchestra.run.smithi043.stdout:(136/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 902 kB/s | 90 kB 00:00 2024-07-26T08:14:35.737 INFO:teuthology.orchestra.run.smithi133.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-07-26T08:14:35.746 INFO:teuthology.orchestra.run.smithi043.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2024-07-26T08:14:35.771 INFO:teuthology.orchestra.run.smithi133.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-07-26T08:14:35.776 INFO:teuthology.orchestra.run.smithi063.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-07-26T08:14:35.779 INFO:teuthology.orchestra.run.smithi043.stdout:(138/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-07-26T08:14:35.796 INFO:teuthology.orchestra.run.smithi133.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-07-26T08:14:35.805 INFO:teuthology.orchestra.run.smithi043.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-07-26T08:14:35.830 INFO:teuthology.orchestra.run.smithi043.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 1.5 MB/s | 36 kB 00:00 2024-07-26T08:14:35.838 INFO:teuthology.orchestra.run.smithi133.stdout:(134/160): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-07-26T08:14:35.855 INFO:teuthology.orchestra.run.smithi043.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-26T08:14:35.863 INFO:teuthology.orchestra.run.smithi133.stdout:(135/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-07-26T08:14:35.889 INFO:teuthology.orchestra.run.smithi133.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-07-26T08:14:35.889 INFO:teuthology.orchestra.run.smithi043.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-07-26T08:14:35.914 INFO:teuthology.orchestra.run.smithi133.stdout:(137/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 765 kB/s | 90 kB 00:00 2024-07-26T08:14:35.922 INFO:teuthology.orchestra.run.smithi043.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-07-26T08:14:35.939 INFO:teuthology.orchestra.run.smithi133.stdout:(138/160): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-07-26T08:14:35.948 INFO:teuthology.orchestra.run.smithi043.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 828 kB/s | 20 kB 00:00 2024-07-26T08:14:35.965 INFO:teuthology.orchestra.run.smithi133.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-07-26T08:14:35.981 INFO:teuthology.orchestra.run.smithi043.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-07-26T08:14:35.990 INFO:teuthology.orchestra.run.smithi133.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-07-26T08:14:36.015 INFO:teuthology.orchestra.run.smithi043.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-07-26T08:14:36.015 INFO:teuthology.orchestra.run.smithi133.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-26T08:14:36.041 INFO:teuthology.orchestra.run.smithi133.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-07-26T08:14:36.066 INFO:teuthology.orchestra.run.smithi133.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-26T08:14:36.082 INFO:teuthology.orchestra.run.smithi043.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-07-26T08:14:36.091 INFO:teuthology.orchestra.run.smithi133.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-07-26T08:14:36.116 INFO:teuthology.orchestra.run.smithi133.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-07-26T08:14:36.141 INFO:teuthology.orchestra.run.smithi133.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-26T08:14:36.174 INFO:teuthology.orchestra.run.smithi043.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-07-26T08:14:36.175 INFO:teuthology.orchestra.run.smithi133.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-07-26T08:14:36.226 INFO:teuthology.orchestra.run.smithi133.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-07-26T08:14:36.324 INFO:teuthology.orchestra.run.smithi043.stdout:(149/160): librados2-19.0.0-5320.ge8f88bb1.el9. 11 MB/s | 3.4 MB 00:00 2024-07-26T08:14:36.451 INFO:teuthology.orchestra.run.smithi133.stdout:(149/160): librbd1-19.0.0-5320.ge8f88bb1.el9.x8 11 MB/s | 3.1 MB 00:00 2024-07-26T08:14:36.452 INFO:teuthology.orchestra.run.smithi063.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 160 kB/s | 133 kB 00:00 2024-07-26T08:14:36.491 INFO:teuthology.orchestra.run.smithi043.stdout:(150/160): librbd1-19.0.0-5320.ge8f88bb1.el9.x8 7.7 MB/s | 3.1 MB 00:00 2024-07-26T08:14:36.608 INFO:teuthology.orchestra.run.smithi043.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 353 kB/s | 41 kB 00:00 2024-07-26T08:14:36.610 INFO:teuthology.orchestra.run.smithi063.stdout:(71/160): postgresql-contrib-13.14-1.el9.x86_64 860 kB/s | 911 kB 00:01 2024-07-26T08:14:36.735 INFO:teuthology.orchestra.run.smithi133.stdout:(150/160): librados2-19.0.0-5320.ge8f88bb1.el9. 5.7 MB/s | 3.4 MB 00:00 2024-07-26T08:14:36.777 INFO:teuthology.orchestra.run.smithi043.stdout:(152/160): NetworkManager-tui-1.48.2-2.el9.x86_ 1.4 MB/s | 247 kB 00:00 2024-07-26T08:14:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:(153/160): NetworkManager-libnm-1.48.2-2.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-07-26T08:14:36.909 INFO:teuthology.orchestra.run.smithi043.stdout:(154/160): NetworkManager-1.48.2-2.el9.x86_64.r 3.1 MB/s | 2.3 MB 00:00 2024-07-26T08:14:36.934 INFO:teuthology.orchestra.run.smithi043.stdout:(155/160): elfutils-debuginfod-client-0.191-4.e 235 kB/s | 37 kB 00:00 2024-07-26T08:14:36.985 INFO:teuthology.orchestra.run.smithi043.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 1.4 MB/s | 207 kB 00:00 2024-07-26T08:14:37.085 INFO:teuthology.orchestra.run.smithi043.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 1.4 MB/s | 260 kB 00:00 2024-07-26T08:14:37.152 INFO:teuthology.orchestra.run.smithi063.stdout:(72/160): postgresql-server-13.14-1.el9.x86_64. 4.2 MB/s | 5.8 MB 00:01 2024-07-26T08:14:37.169 INFO:teuthology.orchestra.run.smithi043.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-07-26T08:14:37.369 INFO:teuthology.orchestra.run.smithi063.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 115 kB/s | 87 kB 00:00 2024-07-26T08:14:37.385 INFO:teuthology.orchestra.run.smithi133.stdout:(151/160): NetworkManager-1.48.2-2.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-07-26T08:14:37.410 INFO:teuthology.orchestra.run.smithi133.stdout:(152/160): NetworkManager-team-1.48.2-2.el9.x86 63 kB/s | 41 kB 00:00 2024-07-26T08:14:37.511 INFO:teuthology.orchestra.run.smithi063.stdout:(74/160): protobuf-3.14.0-13.el9.x86_64.rpm 976 kB/s | 1.0 MB 00:01 2024-07-26T08:14:37.652 INFO:teuthology.orchestra.run.smithi043.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 1.1 MB 00:00 2024-07-26T08:14:37.710 INFO:teuthology.orchestra.run.smithi133.stdout:(153/160): NetworkManager-libnm-1.48.2-2.el9.x8 1.4 MB/s | 1.8 MB 00:01 2024-07-26T08:14:38.095 INFO:teuthology.orchestra.run.smithi063.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 84 kB/s | 61 kB 00:00 2024-07-26T08:14:38.160 INFO:teuthology.orchestra.run.smithi133.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 49 kB/s | 37 kB 00:00 2024-07-26T08:14:38.248 INFO:teuthology.orchestra.run.smithi043.stdout:(160/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-07-26T08:14:38.248 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-07-26T08:14:38.248 INFO:teuthology.orchestra.run.smithi043.stdout:Total 15 MB/s | 233 MB 00:16 2024-07-26T08:14:38.353 INFO:teuthology.orchestra.run.smithi133.stdout:(155/160): NetworkManager-tui-1.48.2-2.el9.x86_ 256 kB/s | 247 kB 00:00 2024-07-26T08:14:38.420 INFO:teuthology.orchestra.run.smithi063.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 269 kB/s | 244 kB 00:00 2024-07-26T08:14:38.522 INFO:teuthology.orchestra.run.smithi063.stdout:(77/160): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-07-26T08:14:38.611 INFO:teuthology.orchestra.run.smithi133.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 243 kB/s | 207 kB 00:00 2024-07-26T08:14:38.978 INFO:teuthology.orchestra.run.smithi063.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 281 kB/s | 248 kB 00:00 2024-07-26T08:14:39.053 INFO:teuthology.orchestra.run.smithi133.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 291 kB/s | 260 kB 00:00 2024-07-26T08:14:39.095 INFO:teuthology.orchestra.run.smithi063.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 38 kB/s | 26 kB 00:00 2024-07-26T08:14:39.113 INFO:teuthology.orchestra.run.smithi063.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 32 kB/s | 19 kB 00:00 2024-07-26T08:14:39.462 INFO:teuthology.orchestra.run.smithi133.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 1.2 MB/s | 1.4 MB 00:01 2024-07-26T08:14:39.755 INFO:teuthology.orchestra.run.smithi063.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 53 kB/s | 35 kB 00:00 2024-07-26T08:14:39.787 INFO:teuthology.orchestra.run.smithi133.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-07-26T08:14:39.855 INFO:teuthology.orchestra.run.smithi063.stdout:(82/160): python3-mako-1.1.4-6.el9.noarch.rpm 197 kB/s | 172 kB 00:00 2024-07-26T08:14:40.104 INFO:teuthology.orchestra.run.smithi133.stdout:(160/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.0 MB/s | 1.1 MB 00:01 2024-07-26T08:14:40.111 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-07-26T08:14:40.111 INFO:teuthology.orchestra.run.smithi133.stdout:Total 13 MB/s | 233 MB 00:17 2024-07-26T08:14:40.497 INFO:teuthology.orchestra.run.smithi063.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.7 MB/s | 5.1 MB 00:01 2024-07-26T08:14:40.647 INFO:teuthology.orchestra.run.smithi063.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 281 kB/s | 250 kB 00:00 2024-07-26T08:14:40.739 INFO:teuthology.orchestra.run.smithi063.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 251 kB/s | 222 kB 00:00 2024-07-26T08:14:41.264 INFO:teuthology.orchestra.run.smithi063.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 101 kB/s | 77 kB 00:00 2024-07-26T08:14:41.348 INFO:teuthology.orchestra.run.smithi063.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 60 kB/s | 42 kB 00:00 2024-07-26T08:14:41.348 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-07-26T08:14:41.542 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-07-26T08:14:41.542 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-07-26T08:14:41.673 INFO:teuthology.orchestra.run.smithi063.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 288 kB/s | 269 kB 00:00 2024-07-26T08:14:41.714 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-07-26T08:14:42.022 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-07-26T08:14:42.022 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-07-26T08:14:42.115 INFO:teuthology.orchestra.run.smithi063.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 187 kB/s | 159 kB 00:00 2024-07-26T08:14:42.257 INFO:teuthology.orchestra.run.smithi063.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 307 kB/s | 279 kB 00:00 2024-07-26T08:14:42.407 INFO:teuthology.orchestra.run.smithi063.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 69 kB/s | 51 kB 00:00 2024-07-26T08:14:42.807 INFO:teuthology.orchestra.run.smithi063.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 77 kB/s | 54 kB 00:00 2024-07-26T08:14:43.066 INFO:teuthology.orchestra.run.smithi063.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 63 kB/s | 42 kB 00:00 2024-07-26T08:14:43.403 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-07-26T08:14:43.404 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-07-26T08:14:43.499 INFO:teuthology.orchestra.run.smithi063.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 64 kB/s | 44 kB 00:00 2024-07-26T08:14:44.008 INFO:teuthology.orchestra.run.smithi063.stdout:(95/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.3 MB/s | 16 MB 00:01 2024-07-26T08:14:44.033 INFO:teuthology.orchestra.run.smithi063.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 235 kB/s | 221 kB 00:00 2024-07-26T08:14:44.225 INFO:teuthology.orchestra.run.smithi063.stdout:(97/160): qatlib-service-24.02.0-1.el9.x86_64.r 49 kB/s | 36 kB 00:00 2024-07-26T08:14:44.715 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-07-26T08:14:44.715 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-07-26T08:14:44.725 INFO:teuthology.orchestra.run.smithi063.stdout:(98/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 66 kB/s | 47 kB 00:00 2024-07-26T08:14:44.934 INFO:teuthology.orchestra.run.smithi063.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 82 kB/s | 58 kB 00:00 2024-07-26T08:14:44.959 INFO:teuthology.orchestra.run.smithi063.stdout:(100/160): socat-1.7.4.1-6.el9.x86_64.rpm 328 kB/s | 304 kB 00:00 2024-07-26T08:14:45.485 INFO:teuthology.orchestra.run.smithi063.stdout:(101/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 126 kB/s | 96 kB 00:00 2024-07-26T08:14:45.626 INFO:teuthology.orchestra.run.smithi063.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-07-26T08:14:45.651 INFO:teuthology.orchestra.run.smithi063.stdout:(103/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 89 kB/s | 64 kB 00:00 2024-07-26T08:14:45.726 INFO:teuthology.orchestra.run.smithi063.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-07-26T08:14:45.752 INFO:teuthology.orchestra.run.smithi063.stdout:(105/160): lua-devel-5.4.4-4.el9.x86_64.rpm 84 kB/s | 22 kB 00:00 2024-07-26T08:14:45.811 INFO:teuthology.orchestra.run.smithi063.stdout:(106/160): gperftools-libs-2.9.1-2.el9.x86_64.r 3.6 MB/s | 309 kB 00:00 2024-07-26T08:14:45.836 INFO:teuthology.orchestra.run.smithi063.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-07-26T08:14:45.861 INFO:teuthology.orchestra.run.smithi063.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-07-26T08:14:45.886 INFO:teuthology.orchestra.run.smithi063.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-07-26T08:14:45.912 INFO:teuthology.orchestra.run.smithi063.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-07-26T08:14:45.939 INFO:teuthology.orchestra.run.smithi063.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 5.5 MB/s | 151 kB 00:00 2024-07-26T08:14:45.981 INFO:teuthology.orchestra.run.smithi063.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-07-26T08:14:46.023 INFO:teuthology.orchestra.run.smithi063.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-07-26T08:14:46.040 INFO:teuthology.orchestra.run.smithi063.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-07-26T08:14:46.065 INFO:teuthology.orchestra.run.smithi063.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-07-26T08:14:46.082 INFO:teuthology.orchestra.run.smithi063.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 839 kB/s | 14 kB 00:00 2024-07-26T08:14:46.107 INFO:teuthology.orchestra.run.smithi063.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-07-26T08:14:46.174 INFO:teuthology.orchestra.run.smithi063.stdout:(118/160): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-07-26T08:14:46.200 INFO:teuthology.orchestra.run.smithi063.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-07-26T08:14:46.225 INFO:teuthology.orchestra.run.smithi063.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-07-26T08:14:46.250 INFO:teuthology.orchestra.run.smithi063.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 4.2 MB/s | 216 kB 00:00 2024-07-26T08:14:46.284 INFO:teuthology.orchestra.run.smithi063.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-07-26T08:14:46.309 INFO:teuthology.orchestra.run.smithi063.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-07-26T08:14:46.334 INFO:teuthology.orchestra.run.smithi063.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-07-26T08:14:46.360 INFO:teuthology.orchestra.run.smithi063.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-07-26T08:14:46.385 INFO:teuthology.orchestra.run.smithi063.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-07-26T08:14:46.410 INFO:teuthology.orchestra.run.smithi063.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-07-26T08:14:46.452 INFO:teuthology.orchestra.run.smithi063.stdout:(128/160): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-07-26T08:14:46.519 INFO:teuthology.orchestra.run.smithi063.stdout:(129/160): python3-grpcio-1.46.7-10.el9.x86_64. 6.9 MB/s | 2.0 MB 00:00 2024-07-26T08:14:46.545 INFO:teuthology.orchestra.run.smithi063.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.4 MB/s | 79 kB 00:00 2024-07-26T08:14:46.570 INFO:teuthology.orchestra.run.smithi063.stdout:(131/160): python3-logutils-0.3.5-21.el9.noarch 395 kB/s | 46 kB 00:00 2024-07-26T08:14:46.595 INFO:teuthology.orchestra.run.smithi063.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-07-26T08:14:46.737 INFO:teuthology.orchestra.run.smithi063.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 116 kB/s | 16 kB 00:00 2024-07-26T08:14:46.763 INFO:teuthology.orchestra.run.smithi063.stdout:(134/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-07-26T08:14:46.788 INFO:teuthology.orchestra.run.smithi063.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-07-26T08:14:46.813 INFO:teuthology.orchestra.run.smithi063.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-07-26T08:14:46.838 INFO:teuthology.orchestra.run.smithi063.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-07-26T08:14:46.880 INFO:teuthology.orchestra.run.smithi063.stdout:(138/160): python3-kubernetes-26.1.0-2.el9.noar 2.2 MB/s | 1.0 MB 00:00 2024-07-26T08:14:46.906 INFO:teuthology.orchestra.run.smithi063.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 881 kB/s | 59 kB 00:00 2024-07-26T08:14:46.931 INFO:teuthology.orchestra.run.smithi063.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-07-26T08:14:46.956 INFO:teuthology.orchestra.run.smithi063.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-26T08:14:46.982 INFO:teuthology.orchestra.run.smithi063.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-07-26T08:14:47.008 INFO:teuthology.orchestra.run.smithi063.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-26T08:14:47.032 INFO:teuthology.orchestra.run.smithi063.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-07-26T08:14:47.058 INFO:teuthology.orchestra.run.smithi063.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-07-26T08:14:47.083 INFO:teuthology.orchestra.run.smithi063.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-26T08:14:47.108 INFO:teuthology.orchestra.run.smithi063.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-07-26T08:14:47.175 INFO:teuthology.orchestra.run.smithi063.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-07-26T08:14:47.434 INFO:teuthology.orchestra.run.smithi063.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 8.9 MB/s | 2.3 MB 00:00 2024-07-26T08:14:47.484 INFO:teuthology.orchestra.run.smithi063.stdout:(150/160): librados2-19.0.0-5320.ge8f88bb1.el9. 8.4 MB/s | 3.4 MB 00:00 2024-07-26T08:14:47.534 INFO:teuthology.orchestra.run.smithi063.stdout:(151/160): NetworkManager-libnm-1.48.2-2.el9.x8 18 MB/s | 1.8 MB 00:00 2024-07-26T08:14:47.585 INFO:teuthology.orchestra.run.smithi063.stdout:(152/160): NetworkManager-tui-1.48.2-2.el9.x86_ 4.9 MB/s | 247 kB 00:00 2024-07-26T08:14:47.610 INFO:teuthology.orchestra.run.smithi063.stdout:(153/160): NetworkManager-team-1.48.2-2.el9.x86 325 kB/s | 41 kB 00:00 2024-07-26T08:14:47.636 INFO:teuthology.orchestra.run.smithi063.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 731 kB/s | 37 kB 00:00 2024-07-26T08:14:47.685 INFO:teuthology.orchestra.run.smithi063.stdout:(155/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-07-26T08:14:47.736 INFO:teuthology.orchestra.run.smithi063.stdout:(156/160): librbd1-19.0.0-5320.ge8f88bb1.el9.x8 5.0 MB/s | 3.1 MB 00:00 2024-07-26T08:14:47.761 INFO:teuthology.orchestra.run.smithi063.stdout:(157/160): elfutils-libelf-0.191-4.el9.x86_64.r 1.3 MB/s | 207 kB 00:00 2024-07-26T08:14:47.803 INFO:teuthology.orchestra.run.smithi063.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-07-26T08:14:47.895 INFO:teuthology.orchestra.run.smithi063.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2024-07-26T08:14:48.037 INFO:teuthology.orchestra.run.smithi063.stdout:(160/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 8.0 MB/s | 2.4 MB 00:00 2024-07-26T08:14:48.044 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-07-26T08:14:48.044 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.3 MB/s | 233 MB 00:28 2024-07-26T08:14:49.298 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-07-26T08:14:49.512 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-07-26T08:14:49.512 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-07-26T08:14:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-07-26T08:14:49.843 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-26T08:14:50.107 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-26T08:14:50.160 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-26T08:14:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-26T08:14:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-26T08:14:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-26T08:14:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-26T08:14:50.726 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:14:50.851 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:14:50.877 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:14:50.973 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:14:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T08:14:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-26T08:14:51.230 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-26T08:14:51.289 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-26T08:14:51.316 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:14:51.422 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:14:51.451 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T08:14:51.480 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-07-26T08:14:51.481 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-07-26T08:14:51.496 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T08:14:51.518 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T08:14:51.541 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T08:14:51.735 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T08:14:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-07-26T08:14:51.822 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T08:14:51.900 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-26T08:14:51.976 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-26T08:14:52.019 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-26T08:14:52.082 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-26T08:14:52.155 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-26T08:14:52.186 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-26T08:14:52.195 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T08:14:52.256 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T08:14:52.297 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-26T08:14:52.370 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:14:52.448 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:14:52.642 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:14:52.744 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-26T08:14:52.771 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-26T08:14:52.802 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-26T08:14:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-26T08:14:52.902 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-26T08:14:52.955 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-26T08:14:53.006 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-26T08:14:53.056 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-26T08:14:53.057 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:14:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-26T08:14:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-26T08:14:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-26T08:14:53.240 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-26T08:14:53.244 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:14:53.270 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-26T08:14:53.285 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:14:53.305 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-26T08:14:53.389 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-26T08:14:53.423 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:14:53.433 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 35/172 2024-07-26T08:14:53.458 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T08:14:53.481 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 36/172 2024-07-26T08:14:53.505 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 37/172 2024-07-26T08:14:53.526 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-26T08:14:53.584 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-26T08:14:53.628 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-26T08:14:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-26T08:14:53.816 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-26T08:14:53.835 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-26T08:14:53.881 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-26T08:14:53.889 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-26T08:14:53.906 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:14:54.055 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:14:54.091 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T08:14:54.188 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T08:14:54.219 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T08:14:54.298 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T08:14:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-26T08:14:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-26T08:14:54.530 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-26T08:14:54.558 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-26T08:14:54.599 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-26T08:14:54.635 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T08:14:54.637 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 48/172 2024-07-26T08:14:54.687 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-26T08:14:54.834 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T08:14:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-26T08:14:54.910 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-26T08:14:54.997 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-26T08:14:55.081 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-26T08:14:55.152 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-26T08:14:55.184 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-26T08:14:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-26T08:14:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-26T08:14:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-26T08:14:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-26T08:14:55.362 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-26T08:14:55.404 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-26T08:14:55.411 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T08:14:55.499 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T08:14:55.539 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-26T08:14:55.582 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-26T08:14:55.622 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-26T08:14:55.646 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:14:55.720 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-26T08:14:55.730 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:14:55.765 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-26T08:14:55.807 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-26T08:14:55.831 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-26T08:14:55.855 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-26T08:14:55.929 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-26T08:14:56.028 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:14:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-26T08:14:56.208 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-26T08:14:56.243 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-26T08:14:56.282 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-26T08:14:56.332 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-26T08:14:56.436 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-26T08:14:56.453 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-26T08:14:56.476 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-26T08:14:56.515 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-26T08:14:56.523 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-26T08:14:56.554 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-26T08:14:56.569 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-26T08:14:56.593 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-26T08:14:56.627 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-26T08:14:56.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-26T08:14:56.660 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-26T08:14:56.703 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-26T08:14:56.713 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-26T08:14:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-26T08:14:56.753 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-26T08:14:56.825 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-26T08:14:56.866 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-26T08:14:56.891 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-26T08:14:56.898 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-26T08:14:56.968 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-26T08:14:56.999 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-26T08:14:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-26T08:14:57.056 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T08:14:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-26T08:14:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-26T08:14:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 35/172 2024-07-26T08:14:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 36/172 2024-07-26T08:14:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 37/172 2024-07-26T08:14:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-26T08:14:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-26T08:14:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-26T08:14:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-26T08:14:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-26T08:14:57.871 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-26T08:14:57.917 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-26T08:14:57.969 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-26T08:14:57.996 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-26T08:14:58.026 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-26T08:14:58.079 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-26T08:14:58.166 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-26T08:14:58.207 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-26T08:14:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-07-26T08:14:58.395 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-26T08:14:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-26T08:14:58.422 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-26T08:14:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-26T08:14:58.499 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-26T08:14:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-26T08:14:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-26T08:14:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-26T08:14:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-26T08:14:58.693 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-26T08:14:58.795 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-26T08:14:58.854 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-26T08:14:58.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-26T08:14:58.951 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-26T08:14:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-26T08:14:59.004 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 48/172 2024-07-26T08:14:59.081 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-26T08:14:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-26T08:14:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:14:59.253 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-26T08:14:59.314 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-26T08:14:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:14:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:14:59.383 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-26T08:14:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:14:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T08:14:59.522 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-26T08:14:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-26T08:14:59.614 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-26T08:14:59.702 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-26T08:14:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-26T08:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-26T08:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-26T08:14:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-26T08:14:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:14:59.848 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-26T08:14:59.919 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-26T08:14:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:14:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T08:14:59.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-26T08:15:00.014 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T08:15:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T08:15:00.057 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-26T08:15:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T08:15:00.245 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T08:15:00.263 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-26T08:15:00.332 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-26T08:15:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T08:15:00.388 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-26T08:15:00.471 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-26T08:15:00.524 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-26T08:15:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-26T08:15:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-26T08:15:00.573 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-26T08:15:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-26T08:15:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-26T08:15:00.624 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-26T08:15:00.669 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T08:15:00.679 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-26T08:15:00.713 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-26T08:15:00.730 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T08:15:00.824 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:15:00.898 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:15:00.909 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-26T08:15:00.937 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-26T08:15:00.983 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T08:15:01.061 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T08:15:01.088 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 105/172 2024-07-26T08:15:01.097 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T08:15:01.101 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-26T08:15:01.124 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-26T08:15:01.152 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-26T08:15:01.191 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-26T08:15:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-26T08:15:01.246 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-26T08:15:01.246 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-26T08:15:01.279 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-26T08:15:01.303 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-26T08:15:01.354 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-26T08:15:01.355 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-26T08:15:01.406 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-26T08:15:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-26T08:15:01.446 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-26T08:15:01.460 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-26T08:15:01.489 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-26T08:15:01.510 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-26T08:15:01.526 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-26T08:15:01.558 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-26T08:15:01.588 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-26T08:15:01.622 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-26T08:15:01.631 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-26T08:15:01.635 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-26T08:15:01.653 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T08:15:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-26T08:15:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-26T08:15:01.732 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T08:15:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-26T08:15:01.762 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 109/172 2024-07-26T08:15:01.792 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-26T08:15:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-26T08:15:01.857 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 35/172 2024-07-26T08:15:01.866 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-26T08:15:01.903 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 36/172 2024-07-26T08:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-26T08:15:01.929 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 37/172 2024-07-26T08:15:02.005 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-26T08:15:02.062 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-26T08:15:02.081 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-26T08:15:02.140 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-26T08:15:02.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T08:15:02.283 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-26T08:15:02.340 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-26T08:15:02.906 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-26T08:15:02.996 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-26T08:15:03.030 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-26T08:15:03.066 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-26T08:15:03.115 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-26T08:15:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-26T08:15:03.162 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 48/172 2024-07-26T08:15:03.204 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-26T08:15:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-26T08:15:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-26T08:15:03.365 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-26T08:15:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-26T08:15:03.423 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-26T08:15:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-26T08:15:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-26T08:15:03.511 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-26T08:15:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-26T08:15:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-26T08:15:03.644 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-26T08:15:03.683 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-26T08:15:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-26T08:15:03.719 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-26T08:15:03.767 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-26T08:15:03.802 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-26T08:15:03.846 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-26T08:15:03.888 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-26T08:15:03.936 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-26T08:15:03.977 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-26T08:15:04.031 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-26T08:15:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:04.073 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-26T08:15:04.087 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-26T08:15:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:04.115 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-26T08:15:04.217 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-26T08:15:04.247 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-26T08:15:04.287 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-26T08:15:04.321 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-26T08:15:04.346 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-26T08:15:04.423 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-26T08:15:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-26T08:15:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-26T08:15:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-26T08:15:04.656 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:04.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-26T08:15:04.697 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-26T08:15:04.702 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T08:15:04.737 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-26T08:15:04.766 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-26T08:15:04.795 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T08:15:04.795 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-26T08:15:04.795 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-26T08:15:04.795 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:04.801 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-26T08:15:04.826 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-26T08:15:04.828 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T08:15:04.868 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-26T08:15:04.902 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-26T08:15:04.982 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-26T08:15:04.992 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-26T08:15:05.041 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-26T08:15:05.072 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-26T08:15:05.130 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-26T08:15:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-26T08:15:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T08:15:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-26T08:15:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-26T08:15:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-26T08:15:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-26T08:15:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-26T08:15:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-26T08:15:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-26T08:15:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-26T08:15:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-26T08:15:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-26T08:15:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-26T08:15:06.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-26T08:15:06.924 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-26T08:15:06.960 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-26T08:15:06.995 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-26T08:15:07.390 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-26T08:15:07.402 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-26T08:15:07.453 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T08:15:07.498 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-26T08:15:07.592 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T08:15:07.646 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 105/172 2024-07-26T08:15:07.706 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-26T08:15:08.329 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-26T08:15:08.356 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T08:15:08.459 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T08:15:08.492 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 109/172 2024-07-26T08:15:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-26T08:15:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-26T08:15:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-26T08:15:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-26T08:15:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-26T08:15:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T08:15:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T08:15:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 105/172 2024-07-26T08:15:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-26T08:15:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-26T08:15:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T08:15:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T08:15:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 109/172 2024-07-26T08:15:11.309 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:11.346 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:12.091 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T08:15:12.248 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T08:15:12.249 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-26T08:15:12.249 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-26T08:15:12.249 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:12.292 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T08:15:12.424 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:12.459 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:13.054 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T08:15:13.096 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T08:15:13.188 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T08:15:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-26T08:15:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-26T08:15:13.188 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:13.222 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T08:15:16.647 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T08:15:16.647 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-07-26T08:15:16.647 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-07-26T08:15:16.648 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-07-26T08:15:16.648 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-07-26T08:15:16.648 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-07-26T08:15:16.648 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /root 2024-07-26T08:15:16.648 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-07-26T08:15:16.648 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:16.826 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T08:15:16.841 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T08:15:16.841 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:16.841 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-26T08:15:16.842 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:18.427 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T08:15:18.454 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T08:15:18.454 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:18.454 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-26T08:15:18.454 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T08:15:18.454 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T08:15:18.454 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T08:15:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T08:15:18.701 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:18.701 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-26T08:15:18.702 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T08:15:18.702 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T08:15:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:19.170 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T08:15:19.194 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T08:15:19.194 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:19.194 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-26T08:15:19.194 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T08:15:19.194 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T08:15:19.194 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:19.300 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-26T08:15:19.358 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-26T08:15:19.412 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-26T08:15:19.598 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-26T08:15:19.655 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-26T08:15:19.732 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-26T08:15:19.829 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-26T08:15:19.976 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-26T08:15:20.013 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-26T08:15:20.053 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-26T08:15:20.089 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-26T08:15:20.450 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T08:15:20.479 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T08:15:20.511 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 129/172 2024-07-26T08:15:20.575 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 130/172 2024-07-26T08:15:20.610 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T08:15:23.769 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T08:15:23.824 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T08:15:24.788 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T08:15:24.816 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T08:15:24.927 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T08:15:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 134/172 2024-07-26T08:15:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T08:15:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T08:15:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-26T08:15:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T08:15:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T08:15:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T08:15:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T08:15:25.295 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 137/172 2024-07-26T08:15:25.350 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 138/172 2024-07-26T08:15:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T08:15:25.379 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-07-26T08:15:25.379 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-07-26T08:15:25.380 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-07-26T08:15:25.380 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-07-26T08:15:25.380 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-07-26T08:15:25.380 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-07-26T08:15:25.380 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-07-26T08:15:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:25.551 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T08:15:25.568 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T08:15:25.568 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:25.568 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-26T08:15:25.568 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:25.912 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T08:15:25.912 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-07-26T08:15:25.912 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-07-26T08:15:25.912 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-07-26T08:15:25.913 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-07-26T08:15:25.913 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-07-26T08:15:25.913 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-07-26T08:15:25.913 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-07-26T08:15:25.913 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:26.156 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T08:15:26.219 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T08:15:26.220 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:26.220 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-26T08:15:26.220 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-26T08:15:26.346 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T08:15:26.369 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T08:15:26.369 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:26.369 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-26T08:15:26.369 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T08:15:26.369 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T08:15:26.369 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:26.414 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T08:15:26.436 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T08:15:26.436 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:26.436 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-26T08:15:26.436 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:26.481 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T08:15:26.504 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T08:15:26.504 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:26.504 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-26T08:15:26.504 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T08:15:26.504 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T08:15:26.504 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:26.823 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T08:15:26.846 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T08:15:26.847 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:26.847 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-26T08:15:26.847 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T08:15:26.847 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T08:15:26.847 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:27.204 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T08:15:27.230 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T08:15:27.231 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:27.231 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-26T08:15:27.231 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T08:15:27.231 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T08:15:27.231 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:27.471 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T08:15:27.494 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T08:15:27.494 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:27.494 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-26T08:15:27.494 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T08:15:27.494 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T08:15:27.494 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:27.988 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T08:15:28.012 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T08:15:28.012 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:28.012 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-26T08:15:28.012 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T08:15:28.012 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T08:15:28.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:28.031 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T08:15:28.119 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-26T08:15:28.138 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T08:15:28.138 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:28.138 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-26T08:15:28.138 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T08:15:28.139 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T08:15:28.139 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:28.178 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-26T08:15:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-26T08:15:28.399 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T08:15:28.489 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T08:15:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-26T08:15:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T08:15:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T08:15:28.489 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:28.573 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-26T08:15:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-26T08:15:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-26T08:15:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-26T08:15:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T08:15:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-26T08:15:29.114 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T08:15:29.114 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:29.115 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-26T08:15:29.115 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T08:15:29.115 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T08:15:29.115 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:29.130 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-26T08:15:29.162 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-26T08:15:29.190 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-26T08:15:29.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-26T08:15:29.360 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-26T08:15:29.454 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-26T08:15:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T08:15:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T08:15:29.662 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 129/172 2024-07-26T08:15:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-26T08:15:29.728 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 130/172 2024-07-26T08:15:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T08:15:29.781 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-26T08:15:29.876 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-26T08:15:29.994 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-26T08:15:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-26T08:15:30.263 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-26T08:15:30.303 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-26T08:15:30.335 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-26T08:15:31.031 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T08:15:31.071 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T08:15:31.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 129/172 2024-07-26T08:15:31.219 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 144/172 2024-07-26T08:15:31.274 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 130/172 2024-07-26T08:15:31.284 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 145/172 2024-07-26T08:15:31.306 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T08:15:31.332 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 146/172 2024-07-26T08:15:31.365 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-26T08:15:31.392 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-26T08:15:31.573 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T08:15:31.618 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-26T08:15:31.658 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 151/172 2024-07-26T08:15:31.699 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-26T08:15:31.728 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T08:15:31.766 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-26T08:15:32.338 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:32.382 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:32.402 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T08:15:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T08:15:33.242 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 156/172 2024-07-26T08:15:33.348 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-26T08:15:33.389 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-26T08:15:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-26T08:15:33.500 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-26T08:15:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-26T08:15:33.560 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T08:15:33.585 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-26T08:15:33.586 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T08:15:33.670 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T08:15:33.695 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-26T08:15:33.695 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T08:15:33.788 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T08:15:33.813 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-26T08:15:33.818 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:33.818 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:34.000 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:34.000 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T08:15:34.083 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T08:15:34.116 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T08:15:34.142 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-26T08:15:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T08:15:34.194 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T08:15:34.206 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:34.310 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T08:15:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 134/172 2024-07-26T08:15:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T08:15:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T08:15:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-26T08:15:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T08:15:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T08:15:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T08:15:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T08:15:34.701 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 137/172 2024-07-26T08:15:34.752 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 138/172 2024-07-26T08:15:35.186 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T08:15:35.255 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T08:15:35.762 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-26T08:15:35.788 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T08:15:35.813 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T08:15:35.813 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:35.813 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-26T08:15:35.813 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T08:15:35.813 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T08:15:35.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:35.856 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T08:15:35.879 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T08:15:35.879 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:35.879 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-26T08:15:35.879 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:35.932 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T08:15:35.955 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T08:15:35.955 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:35.956 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-26T08:15:35.956 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T08:15:35.956 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T08:15:35.956 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:36.290 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T08:15:36.314 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T08:15:36.315 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:36.315 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-26T08:15:36.315 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T08:15:36.315 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T08:15:36.315 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:36.431 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T08:15:36.454 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T08:15:36.631 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T08:15:36.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 134/172 2024-07-26T08:15:36.856 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T08:15:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T08:15:36.929 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:36.929 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-26T08:15:36.929 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T08:15:36.929 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T08:15:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:36.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T08:15:37.030 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T08:15:37.180 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 137/172 2024-07-26T08:15:37.265 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 138/172 2024-07-26T08:15:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-26T08:15:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T08:15:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T08:15:38.515 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:38.515 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-26T08:15:38.515 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T08:15:38.515 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T08:15:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T08:15:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T08:15:38.736 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:38.736 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-26T08:15:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T08:15:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T08:15:38.944 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-26T08:15:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T08:15:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T08:15:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T08:15:39.473 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T08:15:39.473 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T08:15:39.473 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-26T08:15:39.473 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T08:15:39.473 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T08:15:39.473 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:40.355 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:40.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 1/172 2024-07-26T08:15:40.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2/172 2024-07-26T08:15:40.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 3/172 2024-07-26T08:15:40.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 4/172 2024-07-26T08:15:40.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 5/172 2024-07-26T08:15:40.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 6/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 7/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 11/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 12/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 13/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 15/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 16/172 2024-07-26T08:15:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 17/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 18/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 19/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 20/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 21/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 22/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 23/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 24/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 25/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 26/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 27/172 2024-07-26T08:15:40.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 28/172 2024-07-26T08:15:40.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 29/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 30/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 31/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 32/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 33/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 34/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 35/172 2024-07-26T08:15:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 36/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 37/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 38/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 39/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-26T08:15:40.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-26T08:15:40.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-26T08:15:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-26T08:15:40.392 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-26T08:15:40.393 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-26T08:15:40.394 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-26T08:15:40.395 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-26T08:15:40.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-26T08:15:40.397 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 151/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-26T08:15:40.398 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-26T08:15:40.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T08:15:40.400 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-26T08:15:40.936 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 144/172 2024-07-26T08:15:40.978 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 145/172 2024-07-26T08:15:41.018 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 146/172 2024-07-26T08:15:41.050 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-26T08:15:41.077 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-26T08:15:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T08:15:41.315 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-26T08:15:41.347 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 151/172 2024-07-26T08:15:41.394 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-26T08:15:41.424 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T08:15:41.470 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-26T08:15:42.023 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:42.063 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:42.084 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:43.001 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 156/172 2024-07-26T08:15:43.095 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-26T08:15:43.137 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-26T08:15:43.214 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:43.214 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:43.214 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:43.215 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.2-8.el9.noarch 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.7.4-5.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.217 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.218 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.4-9.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-26T08:15:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.220 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: lua-5.4.4-4.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-13.14-1.el9.x86_64 2024-07-26T08:15:43.221 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-26T08:15:43.223 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-26T08:15:43.224 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply-3.11-14.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-26T08:15:43.225 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-26T08:15:43.226 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-26T08:15:43.227 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-26T08:15:43.227 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-26T08:15:43.227 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-26T08:15:43.227 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.228 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:43.229 INFO:teuthology.orchestra.run.smithi133.stdout: re2-1:20211101-3.el9.x86_64 2024-07-26T08:15:43.229 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-26T08:15:43.229 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-26T08:15:43.229 INFO:teuthology.orchestra.run.smithi133.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-26T08:15:43.229 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-26T08:15:43.229 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-26T08:15:43.230 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-26T08:15:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-26T08:15:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:15:43.230 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-07-26T08:15:43.256 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-26T08:15:43.281 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-26T08:15:43.306 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T08:15:43.333 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-26T08:15:43.333 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T08:15:43.417 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T08:15:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-26T08:15:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T08:15:43.529 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T08:15:43.554 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-26T08:15:43.559 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:43.559 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:43.654 DEBUG:teuthology.parallel:result is None 2024-07-26T08:15:43.739 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:43.740 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T08:15:43.815 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T08:15:43.840 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T08:15:43.866 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-26T08:15:43.932 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:44.551 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 144/172 2024-07-26T08:15:44.615 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 145/172 2024-07-26T08:15:44.671 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 146/172 2024-07-26T08:15:44.709 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-26T08:15:44.747 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-26T08:15:45.120 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T08:15:45.202 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-26T08:15:45.243 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 151/172 2024-07-26T08:15:45.288 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-26T08:15:45.350 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T08:15:45.405 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-26T08:15:46.397 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:46.450 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:46.519 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T08:15:47.998 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 156/172 2024-07-26T08:15:48.141 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-26T08:15:48.214 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-26T08:15:48.361 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-26T08:15:48.409 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-26T08:15:48.450 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-26T08:15:48.510 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T08:15:48.563 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-26T08:15:48.563 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T08:15:48.710 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T08:15:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-26T08:15:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T08:15:48.926 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T08:15:48.968 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-26T08:15:49.003 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:49.004 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:49.348 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T08:15:49.349 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T08:15:49.494 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T08:15:49.547 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T08:15:49.607 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-26T08:15:49.747 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:50.012 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:50.012 INFO:teuthology.orchestra.run.smithi043.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-07-26T08:15:50.013 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 1/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 3/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 4/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 5/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 6/172 2024-07-26T08:15:50.072 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 7/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 11/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 12/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 13/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 15/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 16/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 17/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 18/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 19/172 2024-07-26T08:15:50.073 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 20/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 21/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 22/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 23/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 24/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 25/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 26/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 27/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 28/172 2024-07-26T08:15:50.074 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 29/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 30/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 31/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 32/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 33/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 34/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 35/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 36/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 37/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 38/172 2024-07-26T08:15:50.088 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 39/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-26T08:15:50.089 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-26T08:15:50.090 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-26T08:15:50.091 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-26T08:15:50.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-26T08:15:50.093 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-26T08:15:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-26T08:15:50.095 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-26T08:15:50.096 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-26T08:15:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 151/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-26T08:15:50.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T08:15:50.099 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-26T08:15:53.169 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:53.169 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.170 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.171 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.172 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-26T08:15:53.173 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-26T08:15:53.174 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-26T08:15:53.175 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.14-1.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-26T08:15:53.176 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-26T08:15:53.177 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-26T08:15:53.178 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-26T08:15:53.179 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-26T08:15:53.180 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.181 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-3.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-26T08:15:53.182 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-07-26T08:15:53.183 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-07-26T08:15:53.627 DEBUG:teuthology.parallel:result is None 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 1/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 3/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 4/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 5/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 6/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 7/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T08:15:56.577 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 11/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 12/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 13/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 15/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 16/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 17/172 2024-07-26T08:15:56.578 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 18/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 19/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 20/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 21/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 22/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 23/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 24/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 25/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 26/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 27/172 2024-07-26T08:15:56.579 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 28/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 29/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 30/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 31/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 32/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 33/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 34/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 35/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 36/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 37/172 2024-07-26T08:15:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 38/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 39/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-26T08:15:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-26T08:15:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-26T08:15:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-26T08:15:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-26T08:15:56.597 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-26T08:15:56.598 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-26T08:15:56.599 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-26T08:15:56.600 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 151/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T08:15:56.601 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-26T08:15:56.602 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-26T08:15:56.603 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-26T08:15:56.603 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-26T08:15:56.603 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T08:15:56.603 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-26T08:15:59.058 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-26T08:15:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.060 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.061 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-26T08:15:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-26T08:15:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-26T08:15:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.14-1.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-26T08:15:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-26T08:15:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-26T08:15:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-26T08:15:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-26T08:15:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-26T08:15:59.070 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-3.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-26T08:15:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-26T08:15:59.072 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-26T08:15:59.072 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:15:59.072 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-07-26T08:15:59.702 DEBUG:teuthology.parallel:result is None 2024-07-26T08:15:59.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:15:59.852 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-26T08:15:59.914 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-5320.ge8f88bb1.el9 2024-07-26T08:15:59.915 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5320.ge8f88bb1.el9 2024-07-26T08:15:59.915 INFO:teuthology.task.install:The correct ceph version 19.0.0-5320.ge8f88bb1 is installed. 2024-07-26T08:15:59.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:16:00.061 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-26T08:16:00.087 INFO:teuthology.orchestra.run.smithi063.stdout:19.0.0-5320.ge8f88bb1.el9 2024-07-26T08:16:00.087 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5320.ge8f88bb1.el9 2024-07-26T08:16:00.087 INFO:teuthology.task.install:The correct ceph version 19.0.0-5320.ge8f88bb1 is installed. 2024-07-26T08:16:00.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:16:00.237 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-26T08:16:00.264 INFO:teuthology.orchestra.run.smithi133.stdout:19.0.0-5320.ge8f88bb1.el9 2024-07-26T08:16:00.264 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5320.ge8f88bb1.el9 2024-07-26T08:16:00.264 INFO:teuthology.task.install:The correct ceph version 19.0.0-5320.ge8f88bb1 is installed. 2024-07-26T08:16:00.266 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-07-26T08:16:00.266 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:16:00.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-26T08:16:00.339 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:16:00.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-26T08:16:00.372 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:16:00.372 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-26T08:16:00.403 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-07-26T08:16:00.403 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:16:00.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-07-26T08:16:00.469 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-26T08:16:00.578 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:16:00.578 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-07-26T08:16:00.604 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-26T08:16:00.670 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:16:00.671 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-07-26T08:16:00.700 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-26T08:16:00.766 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-07-26T08:16:00.766 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:16:00.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-26T08:16:00.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-26T08:16:00.939 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:16:00.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-26T08:16:00.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-26T08:16:01.029 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:16:01.029 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-26T08:16:01.053 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-26T08:16:01.116 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-07-26T08:16:01.116 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:16:01.117 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-07-26T08:16:01.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-26T08:16:01.305 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:16:01.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-07-26T08:16:01.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-26T08:16:01.394 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:16:01.394 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-07-26T08:16:01.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-26T08:16:01.482 INFO:teuthology.run_tasks:Running task cephadm... 2024-07-26T08:16:01.815 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client dirsize rbytes': False}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-07-26T08:16:01.815 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:16:01.816 INFO:tasks.cephadm:Cluster fsid is 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:16:01.816 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-07-26T08:16:01.816 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.43', 'mon.b': '172.21.15.63', 'mon.c': '172.21.15.133'} 2024-07-26T08:16:01.817 INFO:tasks.cephadm:First mon is mon.a on smithi043 2024-07-26T08:16:01.817 INFO:tasks.cephadm:First mgr is x 2024-07-26T08:16:01.817 INFO:tasks.cephadm:Normalizing hostnames... 2024-07-26T08:16:01.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname $(hostname -s) 2024-07-26T08:16:01.900 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname $(hostname -s) 2024-07-26T08:16:01.925 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname $(hostname -s) 2024-07-26T08:16:01.949 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-07-26T08:16:01.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:16:02.096 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/81524/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5320-ge8f88bb1', 'node_name': '172.21.4.69+confusa07', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5320.ge8f88bb1'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-07-25 16:18:49.953482', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240725.121331-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/81524/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5320-ge8f88bb1', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5320.ge8f88bb1'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-07-25 15:10:42.298781', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240725.121331-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-07-26T08:16:02.241 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20240725.121331-debug, sha1 e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:16:02.242 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm 2024-07-26T08:16:02.242 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm 2024-07-26T08:16:02.243 DEBUG:teuthology.orchestra.run.smithi043:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:02.683 INFO:teuthology.orchestra.run.smithi043.stdout:-rw-r--r--. 1 ubuntu ubuntu 789811 Jul 26 08:16 /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:02.683 DEBUG:teuthology.orchestra.run.smithi063:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r--. 1 ubuntu ubuntu 789811 Jul 26 08:16 /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.043 DEBUG:teuthology.orchestra.run.smithi133:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r--. 1 ubuntu ubuntu 789811 Jul 26 08:16 /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.425 DEBUG:teuthology.orchestra.run.smithi043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.489 DEBUG:teuthology.orchestra.run.smithi063:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.509 DEBUG:teuthology.orchestra.run.smithi133:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-26T08:16:03.546 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 on all hosts... 2024-07-26T08:16:03.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 pull 2024-07-26T08:16:03.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 pull 2024-07-26T08:16:03.556 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 pull 2024-07-26T08:16:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T08:16:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T08:16:05.146 INFO:teuthology.orchestra.run.smithi043.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T08:16:36.961 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-07-26T08:16:36.983 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T08:16:36.984 INFO:teuthology.orchestra.run.smithi063.stdout: "image_id": "ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8", 2024-07-26T08:16:36.984 INFO:teuthology.orchestra.run.smithi063.stdout: "repo_digests": [ 2024-07-26T08:16:36.984 INFO:teuthology.orchestra.run.smithi063.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2" 2024-07-26T08:16:36.984 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-07-26T08:16:36.984 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-07-26T08:16:37.739 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-07-26T08:16:37.740 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T08:16:37.740 INFO:teuthology.orchestra.run.smithi133.stdout: "image_id": "ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8", 2024-07-26T08:16:37.740 INFO:teuthology.orchestra.run.smithi133.stdout: "repo_digests": [ 2024-07-26T08:16:37.740 INFO:teuthology.orchestra.run.smithi133.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2" 2024-07-26T08:16:37.740 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-07-26T08:16:37.740 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-07-26T08:16:50.487 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:16:50.487 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T08:16:50.487 INFO:teuthology.orchestra.run.smithi043.stdout: "image_id": "ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8", 2024-07-26T08:16:50.487 INFO:teuthology.orchestra.run.smithi043.stdout: "repo_digests": [ 2024-07-26T08:16:50.487 INFO:teuthology.orchestra.run.smithi043.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2" 2024-07-26T08:16:50.487 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T08:16:50.488 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:16:50.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph 2024-07-26T08:16:50.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph 2024-07-26T08:16:50.654 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph 2024-07-26T08:16:50.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /etc/ceph 2024-07-26T08:16:50.777 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /etc/ceph 2024-07-26T08:16:50.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /etc/ceph 2024-07-26T08:16:50.835 INFO:tasks.cephadm:Writing seed config... 2024-07-26T08:16:50.945 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-07-26T08:16:50.945 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-07-26T08:16:50.946 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-07-26T08:16:50.947 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-07-26T08:16:50.948 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:16:50.948 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-07-26T08:16:51.011 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False [mds] mds_bal_replicate_threshold = 1 2024-07-26T08:16:51.012 DEBUG:teuthology.orchestra.run.smithi043:mon.a> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service 2024-07-26T08:16:51.065 DEBUG:teuthology.orchestra.run.smithi043:mgr.x> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x.service 2024-07-26T08:16:51.114 INFO:tasks.cephadm:Bootstrapping... 2024-07-26T08:16:51.114 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 -v bootstrap --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.43 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-07-26T08:16:51.406 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-07-26T08:16:51.406 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', '-v', 'bootstrap', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.43', '--skip-admin-label'] 2024-07-26T08:16:51.407 INFO:teuthology.orchestra.run.smithi043.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-07-26T08:16:51.407 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying podman|docker is present... 2024-07-26T08:16:51.467 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 5.1.2 2024-07-26T08:16:51.468 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying lvm2 is present... 2024-07-26T08:16:51.468 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying time synchronization is in place... 2024-07-26T08:16:51.485 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-07-26T08:16:51.485 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-07-26T08:16:51.500 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-07-26T08:16:51.500 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-07-26T08:16:51.523 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2024-07-26T08:16:51.543 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2024-07-26T08:16:51.543 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2024-07-26T08:16:51.543 INFO:teuthology.orchestra.run.smithi043.stdout:Repeating the final host check... 2024-07-26T08:16:51.601 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 5.1.2 2024-07-26T08:16:51.601 INFO:teuthology.orchestra.run.smithi043.stdout:podman (/bin/podman) version 5.1.2 is present 2024-07-26T08:16:51.601 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl is present 2024-07-26T08:16:51.601 INFO:teuthology.orchestra.run.smithi043.stdout:lvcreate is present 2024-07-26T08:16:51.619 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-07-26T08:16:51.619 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-07-26T08:16:51.639 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-07-26T08:16:51.640 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-07-26T08:16:51.664 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2024-07-26T08:16:51.684 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2024-07-26T08:16:51.684 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2024-07-26T08:16:51.685 INFO:teuthology.orchestra.run.smithi043.stdout:Host looks OK 2024-07-26T08:16:51.685 INFO:teuthology.orchestra.run.smithi043.stdout:Cluster fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:16:51.686 INFO:teuthology.orchestra.run.smithi043.stdout:Acquiring lock 140631292834960 on /run/cephadm/4bbb8ba0-4b27-11ef-bcb6-c7b262605968.lock 2024-07-26T08:16:51.686 INFO:teuthology.orchestra.run.smithi043.stdout:Lock 140631292834960 acquired on /run/cephadm/4bbb8ba0-4b27-11ef-bcb6-c7b262605968.lock 2024-07-26T08:16:51.687 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 3300 ... 2024-07-26T08:16:51.688 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 6789 ... 2024-07-26T08:16:51.689 INFO:teuthology.orchestra.run.smithi043.stdout:Base mon IP(s) is [172.21.15.43:3300, 172.21.15.43:6789], mon addrv is [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-07-26T08:16:51.703 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.43 metric 100 2024-07-26T08:16:51.703 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.43 metric 100 2024-07-26T08:16:51.715 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-07-26T08:16:51.716 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-07-26T08:16:51.716 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-07-26T08:16:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-07-26T08:16:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-07-26T08:16:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-07-26T08:16:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-07-26T08:16:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-07-26T08:16:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-07-26T08:16:51.731 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2024-07-26T08:16:51.731 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2024-07-26T08:16:51.731 INFO:teuthology.orchestra.run.smithi043.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-07-26T08:16:51.733 INFO:teuthology.orchestra.run.smithi043.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-07-26T08:16:51.736 INFO:teuthology.orchestra.run.smithi043.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Getting image source signatures 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:27b44fafaf0d8ddf6712bf077b0e069fd1632e81c2016bcdf9194ad64e762303 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:43735fbce9214f061a6894341d7822563f5aafe16fc7532189f4415cff6d2d91 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying config sha256:ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 2024-07-26T08:16:52.439 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Writing manifest to image destination 2024-07-26T08:16:53.780 INFO:teuthology.orchestra.run.smithi043.stdout:ceph: stdout ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:16:53.780 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph version: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:16:53.780 INFO:teuthology.orchestra.run.smithi043.stdout:Extracting ceph user uid/gid from container image... 2024-07-26T08:16:55.013 INFO:teuthology.orchestra.run.smithi043.stdout:stat: stdout 167 167 2024-07-26T08:16:55.013 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial keys... 2024-07-26T08:16:56.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQB3W6NmHMb0HxAA1DHMrSInVsvhdWFv9CaCSw== 2024-07-26T08:16:57.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQB4W6NmDVY3LxAAkUjx3UrvKX4khUSyIlvFJQ== 2024-07-26T08:16:58.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQB6W6NmscspABAAAZvUysfAAzERzIdWpp1Gwg== 2024-07-26T08:16:58.678 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial monmap... 2024-07-26T08:16:59.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-07-26T08:16:59.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-07-26T08:16:59.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool for a [v2:172.21.15.43:3300,v1:172.21.15.43:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: set fsid to 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:16:59.963 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mon... 2024-07-26T08:17:01.241 INFO:teuthology.orchestra.run.smithi043.stdout:create mon.a on 2024-07-26T08:17:01.645 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-07-26T08:17:01.915 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-07-26T08:17:02.248 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968.target → /etc/systemd/system/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968.target. 2024-07-26T08:17:02.248 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968.target → /etc/systemd/system/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968.target. 2024-07-26T08:17:02.643 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a 2024-07-26T08:17:02.643 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service: Unit ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service not loaded. 2024-07-26T08:17:02.935 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968.target.wants/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@.service. 2024-07-26T08:17:03.643 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 podman[31987]: 2024-07-26 08:17:03.37807187 +0000 UTC m=+0.167733739 container create 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T08:17:03.643 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 podman[31987]: 2024-07-26 08:17:03.640127333 +0000 UTC m=+0.429789205 container init 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:17:03.807 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T08:17:03.807 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-07-26T08:17:03.823 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T08:17:03.823 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-07-26T08:17:03.823 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-07-26T08:17:03.823 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2024-07-26T08:17:03.824 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon to start... 2024-07-26T08:17:03.824 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon... 2024-07-26T08:17:03.966 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 podman[31987]: 2024-07-26 08:17:03.651022775 +0000 UTC m=+0.440684625 container start 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:17:03.966 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 bash[31987]: 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe 2024-07-26T08:17:03.966 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 systemd[1]: Started Ceph mon.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:17:03.966 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 ceph-mon[32006]: mkfs 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:03.967 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:03 smithi043 ceph-mon[32006]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: monmap epoch 1 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: last_changed 2024-07-26T08:16:59.259085+0000 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: min_mon_release 19 (squid) 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: election_strategy: 1 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:17:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: fsmap 2024-07-26T08:17:05.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: osdmap e1: 0 total, 0 up, 0 in 2024-07-26T08:17:05.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: mgrmap e1: no daemons active 2024-07-26T08:17:05.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:04 smithi043 ceph-mon[32006]: from='client.? 172.21.15.43:0/2194392293' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-07-26T08:17:05.222 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout cluster: 2024-07-26T08:17:05.223 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout id: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:05.223 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-07-26T08:17:05.223 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:05.223 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout services: 2024-07-26T08:17:05.223 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.745628s) 2024-07-26T08:17:05.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-07-26T08:17:05.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-07-26T08:17:05.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:05.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout data: 2024-07-26T08:17:05.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-07-26T08:17:05.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-07-26T08:17:05.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-07-26T08:17:05.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pgs: 2024-07-26T08:17:05.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:05.225 INFO:teuthology.orchestra.run.smithi043.stdout:mon is available 2024-07-26T08:17:05.225 INFO:teuthology.orchestra.run.smithi043.stdout:Assimilating anything we can from ceph.conf... 2024-07-26T08:17:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:05 smithi043 ceph-mon[32006]: from='client.? 172.21.15.43:0/1769411095' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-07-26T08:17:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:05 smithi043 ceph-mon[32006]: from='client.? 172.21.15.43:0/1769411095' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-07-26T08:17:06.534 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-07-26T08:17:06.535 INFO:teuthology.orchestra.run.smithi043.stdout:Generating new minimal ceph.conf... 2024-07-26T08:17:07.360 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:07 smithi043 ceph-mon[32006]: from='client.? 172.21.15.43:0/3299511241' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:17:10.916 INFO:teuthology.orchestra.run.smithi043.stdout:Restarting the monitor... 2024-07-26T08:17:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:10 smithi043 systemd[1]: Stopping Ceph mon.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:17:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a[32002]: 2024-07-26T08:17:14.782+0000 7fd4b0800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T08:17:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a[32002]: 2024-07-26T08:17:14.782+0000 7fd4b0800640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-07-26T08:17:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:14 smithi043 podman[32246]: 2024-07-26 08:17:14.946680386 +0000 UTC m=+3.652217413 container died 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-07-26T08:17:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:17 smithi043 podman[32246]: 2024-07-26 08:17:17.947874258 +0000 UTC m=+6.653411282 container cleanup 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-26T08:17:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:17 smithi043 bash[32246]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a 2024-07-26T08:17:18.501 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 podman[32259]: 2024-07-26 08:17:18.243619859 +0000 UTC m=+3.277336421 container remove 6be9c515eb63b99c8784d3b6683a6c5aa4ffcfb1f01c4e30b75b9c50a21664fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True) 2024-07-26T08:17:18.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service: Deactivated successfully. 2024-07-26T08:17:18.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 systemd[1]: Stopped Ceph mon.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:17:18.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service: Consumed 2.092s CPU time. 2024-07-26T08:17:18.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 systemd[1]: Starting Ceph mon.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:17:19.187 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 podman[32365]: 2024-07-26 08:17:18.805444098 +0000 UTC m=+0.032649020 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:17:19.187 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:18 smithi043 podman[32365]: 2024-07-26 08:17:18.935435679 +0000 UTC m=+0.162640643 container create c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:17:19.321 INFO:teuthology.orchestra.run.smithi043.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 podman[32365]: 2024-07-26 08:17:19.186378713 +0000 UTC m=+0.413583653 container init c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 podman[32365]: 2024-07-26 08:17:19.196993759 +0000 UTC m=+0.424198699 container start c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 bash[32365]: c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: set uid:gid to 167:167 (ceph:ceph) 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev), process ceph-mon, pid 2 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: pidfile_write: ignore empty --pid-file 2024-07-26T08:17:19.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: load: jerasure load: lrc 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 systemd[1]: Started Ceph mon.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: RocksDB version: 7.9.2 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Git sha 0 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Compile date 2024-07-25 13:49:38 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: DB SUMMARY 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: DB Session ID: KOPRNV9D87UISLXPGJPT 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: CURRENT file: CURRENT 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: IDENTITY file: IDENTITY 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94945 ; 2024-07-26T08:17:19.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.error_if_exists: 0 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.create_if_missing: 0 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.paranoid_checks: 1 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.flush_verify_memtable_count: 1 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.env: 0x5633be448280 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.fs: PosixFileSystem 2024-07-26T08:17:19.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.info_log: 0x5633ded67060 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_file_opening_threads: 16 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.statistics: (nil) 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.use_fsync: 0 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_log_file_size: 0 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.log_file_time_to_roll: 0 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.keep_log_file_num: 1000 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.recycle_log_file_num: 0 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.allow_fallocate: 1 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.allow_mmap_reads: 0 2024-07-26T08:17:19.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.allow_mmap_writes: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.use_direct_reads: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.create_missing_column_families: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.db_log_dir: 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.wal_dir: 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.table_cache_numshardbits: 6 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.WAL_ttl_seconds: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.WAL_size_limit_MB: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.is_fd_close_on_exec: 1 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.advise_random_on_open: 1 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.db_write_buffer_size: 0 2024-07-26T08:17:19.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.write_buffer_manager: 0x5633ded6b5e0 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.use_adaptive_mutex: 0 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.rate_limiter: (nil) 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.wal_recovery_mode: 2 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.enable_thread_tracking: 0 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.enable_pipelined_write: 0 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.unordered_write: 0 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-07-26T08:17:19.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-07-26T08:17:19.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.row_cache: None 2024-07-26T08:17:19.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.wal_filter: None 2024-07-26T08:17:19.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-07-26T08:17:19.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.allow_ingest_behind: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.two_write_queues: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.manual_wal_flush: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.wal_compression: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.atomic_flush: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.persist_stats_to_disk: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.write_dbid_to_manifest: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.log_readahead_size: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.best_efforts_recovery: 0 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-07-26T08:17:19.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.allow_data_in_errors: 0 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.db_host_id: __hostname__ 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.enforce_single_del_contracts: true 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_background_jobs: 2 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_background_compactions: -1 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_subcompactions: 1 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.delayed_write_rate : 16777216 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_total_wal_size: 0 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.stats_dump_period_sec: 600 2024-07-26T08:17:19.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.stats_persist_period_sec: 600 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_open_files: -1 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bytes_per_sync: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.wal_bytes_per_sync: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.strict_bytes_per_sync: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_readahead_size: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_background_flushes: -1 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Compression algorithms supported: 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kZSTD supported: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kXpressCompression supported: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kBZip2Compression supported: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-07-26T08:17:19.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kLZ4Compression supported: 1 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kZlibCompression supported: 1 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kLZ4HCCompression supported: 1 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: kSnappyCompression supported: 1 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Fast CRC32 supported: Supported on x86 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: DMutex implementation: pthread_mutex_t 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.merge_operator: 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_filter: None 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_filter_factory: None 2024-07-26T08:17:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.sst_partitioner_factory: None 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.memtable_factory: SkipListFactory 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.table_factory: BlockBasedTable 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5633ded66c00) 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: cache_index_and_filter_blocks: 1 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: pin_top_level_index_and_filter: 1 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_type: 0 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: data_block_index_type: 0 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_shortening: 1 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: data_block_hash_table_util_ratio: 0.750000 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: checksum: 4 2024-07-26T08:17:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout: no_block_cache: 0 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache: 0x5633dad2b610 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_name: BinnedLRUCache 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_options: 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: capacity : 536870912 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: num_shard_bits : 4 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: strict_capacity_limit : 0 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: high_pri_pool_ratio: 0.000 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_compressed: (nil) 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: persistent_cache: (nil) 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_size: 4096 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_size_deviation: 10 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_restart_interval: 16 2024-07-26T08:17:19.484 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_block_restart_interval: 1 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: metadata_block_size: 4096 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: partition_filters: 0 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: use_delta_encoding: 1 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: filter_policy: bloomfilter 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: whole_key_filtering: 1 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: verify_compression: 0 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: read_amp_bytes_per_bit: 0 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: format_version: 5 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: enable_index_compression: 1 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_align: 0 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: max_auto_readahead_size: 262144 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: prepopulate_block_cache: 0 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: initial_auto_readahead_size: 8192 2024-07-26T08:17:19.485 INFO:journalctl@ceph.mon.a.smithi043.stdout: num_file_reads_for_auto_readahead: 2 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.write_buffer_size: 33554432 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_write_buffer_number: 2 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression: NoCompression 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression: Disabled 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.prefix_extractor: nullptr 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.num_levels: 7 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-07-26T08:17:19.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.window_bits: -14 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.level: 32767 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.strategy: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-07-26T08:17:19.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.enabled: false 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.target_file_size_base: 67108864 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.target_file_size_multiplier: 1 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-07-26T08:17:19.488 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-07-26T08:17:19.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.arena_block_size: 1048576 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.disable_auto_compactions: 0 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-07-26T08:17:19.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.inplace_update_support: 0 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.inplace_update_num_locks: 10000 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.memtable_huge_page_size: 0 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.bloom_locality: 0 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.max_successive_merges: 0 2024-07-26T08:17:19.491 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.optimize_filters_for_hits: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.paranoid_file_checks: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.force_consistency_checks: 1 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.report_bg_io_stats: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.ttl: 2592000 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.periodic_compaction_seconds: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.enable_blob_files: false 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.min_blob_size: 0 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.blob_file_size: 268435456 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.blob_compression_type: NoCompression 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.enable_blob_garbage_collection: false 2024-07-26T08:17:19.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.blob_file_starting_level: 0 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bf0f8ad1-0423-4c5a-93f9-2230b15bc6e8 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721981839319392, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721981839322032, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91133, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 89174, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11615, "raw_average_key_size": 48, "raw_value_size": 82622, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1721981839, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bf0f8ad1-0423-4c5a-93f9-2230b15bc6e8", "db_session_id": "KOPRNV9D87UISLXPGJPT", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721981839322276, "job": 1, "event": "recovery_finished"} 2024-07-26T08:17:19.493 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5633ded8aa80 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: DB pointer 0x5633dfb2a000 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** DB Stats ** 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T08:17:19.494 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** Compaction Stats [default] ** 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: L0 2/0 90.86 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 46.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: Sum 2/0 90.86 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 46.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 46.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** Compaction Stats [default] ** 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-07-26T08:17:19.495 INFO:journalctl@ceph.mon.a.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 46.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative compaction: 0.00 GB write, 11.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval compaction: 0.00 GB write, 11.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-07-26T08:17:19.496 INFO:journalctl@ceph.mon.a.smithi043.stdout: Block cache BinnedLRUCache@0x5633dad2b610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: starting mon.a rank 0 at public addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] at bind addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???) e1 preinit fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).mds e1 new map 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).mds e1 print_map 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: e1 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: btime 2024-07-26T08:17:03:796007+0000 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: legacy client fscid: -1 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout: No filesystems configured 2024-07-26T08:17:19.497 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: monmap epoch 1 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: last_changed 2024-07-26T08:16:59.259085+0000 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: min_mon_release 19 (squid) 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: election_strategy: 1 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:17:19.498 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: fsmap 2024-07-26T08:17:19.499 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: osdmap e1: 0 total, 0 up, 0 in 2024-07-26T08:17:19.499 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:19 smithi043 ceph-mon[32384]: mgrmap e1: no daemons active 2024-07-26T08:17:20.864 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote config to /etc/ceph/ceph.conf 2024-07-26T08:17:20.891 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-07-26T08:17:20.891 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mgr... 2024-07-26T08:17:20.892 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 0.0.0.0:9283 ... 2024-07-26T08:17:20.893 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 0.0.0.0:8765 ... 2024-07-26T08:17:21.311 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x 2024-07-26T08:17:21.311 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x.service: Unit ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x.service not loaded. 2024-07-26T08:17:21.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:21 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2770664982' entity='client.admin' 2024-07-26T08:17:21.583 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968.target.wants/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@.service. 2024-07-26T08:17:21.983 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:21 smithi043 systemd[1]: Starting Ceph mgr.x for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:17:22.298 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:21 smithi043 podman[32595]: 2024-07-26 08:17:21.985437412 +0000 UTC m=+0.118025006 container create 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:17:22.298 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:21 smithi043 podman[32595]: 2024-07-26 08:17:21.899523789 +0000 UTC m=+0.032111349 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:17:22.298 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:22 smithi043 podman[32595]: 2024-07-26 08:17:22.222226588 +0000 UTC m=+0.354814189 container init 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-07-26T08:17:22.298 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:22 smithi043 podman[32595]: 2024-07-26 08:17:22.232797314 +0000 UTC m=+0.365384882 container start 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:17:22.339 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T08:17:22.339 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-07-26T08:17:22.356 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T08:17:22.357 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-07-26T08:17:22.357 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-07-26T08:17:22.357 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2024-07-26T08:17:22.377 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T08:17:22.377 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-07-26T08:17:22.394 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T08:17:22.394 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-07-26T08:17:22.394 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-07-26T08:17:22.395 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-07-26T08:17:22.395 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr to start... 2024-07-26T08:17:22.395 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr... 2024-07-26T08:17:22.554 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:22 smithi043 bash[32595]: 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 2024-07-26T08:17:22.554 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:22 smithi043 systemd[1]: Started Ceph mgr.x for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:17:23.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:23 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/162356907' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-26T08:17:24.325 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:24.328 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:17:24.328 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:17:24.328 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-07-26T08:17:24.328 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:24.329 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-26T08:17:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-26T08:17:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "btime": "2024-07-26T08:17:03:796007+0000", 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-07-26T08:17:03.797353+0000", 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T08:17:24.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:24.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-26T08:17:24.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:17:24.337 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (1/15)... 2024-07-26T08:17:27.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:27 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1654925061' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-26T08:17:27.826 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:27.826 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:17:27.826 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:17:27.827 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-07-26T08:17:27.827 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-26T08:17:27.827 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-26T08:17:27.827 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-26T08:17:27.827 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-26T08:17:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-26T08:17:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-07-26T08:17:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-26T08:17:27.829 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-07-26T08:17:27.829 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:27.829 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-07-26T08:17:27.829 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-26T08:17:27.830 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:27.830 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-26T08:17:27.830 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-26T08:17:27.831 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.831 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-26T08:17:27.831 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:27.831 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-26T08:17:27.831 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-26T08:17:27.832 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-26T08:17:27.833 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-26T08:17:27.833 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-26T08:17:27.833 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-26T08:17:27.833 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-26T08:17:27.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-26T08:17:27.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-26T08:17:27.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-26T08:17:27.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-26T08:17:27.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:27.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "btime": "2024-07-26T08:17:03:796007+0000", 2024-07-26T08:17:27.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-26T08:17:27.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-26T08:17:27.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-26T08:17:27.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-07-26T08:17:27.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-26T08:17:27.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-26T08:17:27.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-26T08:17:27.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-26T08:17:27.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-07-26T08:17:27.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:27.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T08:17:27.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-26T08:17:27.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:27.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-07-26T08:17:03.797353+0000", 2024-07-26T08:17:27.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T08:17:27.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:27.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-26T08:17:27.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:17:27.840 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (2/15)... 2024-07-26T08:17:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: Activating manager daemon x 2024-07-26T08:17:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: mgrmap e2: x(active, starting, since 0.0146142s) 2024-07-26T08:17:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T08:17:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T08:17:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T08:17:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:17:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T08:17:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: Manager daemon x is now available 2024-07-26T08:17:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:17:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' 2024-07-26T08:17:29.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:29 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:17:30.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:30 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' 2024-07-26T08:17:30.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:30 smithi043 ceph-mon[32384]: from='mgr.14100 172.21.15.43:0/1692412118' entity='mgr.x' 2024-07-26T08:17:30.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:30 smithi043 ceph-mon[32384]: mgrmap e3: x(active, since 1.02647s) 2024-07-26T08:17:31.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:31 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1855185288' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-26T08:17:31.548 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:31.548 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:17:31.549 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:17:31.550 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-07-26T08:17:31.550 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-26T08:17:31.550 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-07-26T08:17:31.551 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:31.556 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-07-26T08:17:31.556 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-26T08:17:31.556 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:31.556 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-26T08:17:31.557 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "btime": "2024-07-26T08:17:03:796007+0000", 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-07-26T08:17:31.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T08:17:31.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-26T08:17:31.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T08:17:31.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-07-26T08:17:03.797353+0000", 2024-07-26T08:17:31.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T08:17:31.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-07-26T08:17:31.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-26T08:17:31.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:17:31.561 INFO:teuthology.orchestra.run.smithi043.stdout:mgr is available 2024-07-26T08:17:32.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:32 smithi043 ceph-mon[32384]: mgrmap e4: x(active, since 2s) 2024-07-26T08:17:33.131 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:33.131 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2024-07-26T08:17:33.132 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:33.132 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-07-26T08:17:33.132 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-07-26T08:17:33.132 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-07-26T08:17:33.132 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-07-26T08:17:33.132 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-07-26T08:17:33.133 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-07-26T08:17:33.133 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:33.133 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2024-07-26T08:17:33.133 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-07-26T08:17:33.133 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-07-26T08:17:33.134 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling cephadm module... 2024-07-26T08:17:33.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:33 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/831686043' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-07-26T08:17:34.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:34 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1204727895' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-07-26T08:17:34.483 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:34 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ignoring --setuser ceph since I am not root 2024-07-26T08:17:34.483 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:34 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ignoring --setgroup ceph since I am not root 2024-07-26T08:17:35.430 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:35 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1204727895' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-07-26T08:17:35.430 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:35 smithi043 ceph-mon[32384]: mgrmap e5: x(active, since 5s) 2024-07-26T08:17:36.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3661774731' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-07-26T08:17:36.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:17:36.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-07-26T08:17:36.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-26T08:17:36.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-07-26T08:17:36.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-07-26T08:17:36.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:17:36.565 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2024-07-26T08:17:36.565 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 5... 2024-07-26T08:17:40.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: Active manager daemon x restarted 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: Activating manager daemon x 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: osdmap e2: 0 total, 0 up, 0 in 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: mgrmap e6: x(active, starting, since 0.0109339s) 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: Manager daemon x is now available 2024-07-26T08:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:40 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:41.967 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: Found migration_current of "None". Setting to last migration. 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:41.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:41 smithi043 ceph-mon[32384]: mgrmap e7: x(active, since 1.01899s) 2024-07-26T08:17:42.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:17:42.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-07-26T08:17:42.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2024-07-26T08:17:42.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:17:42.284 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 5 is available 2024-07-26T08:17:42.285 INFO:teuthology.orchestra.run.smithi043.stdout:Setting orchestrator backend to cephadm... 2024-07-26T08:17:42.605 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:17:42.294+0000 7f24d6200640 -1 log_channel(cephadm) log [ERR] : [26/Jul/2024:08:17:42] ENGINE Error in HTTPServer.serve 2024-07-26T08:17:42.675 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: Traceback (most recent call last): 2024-07-26T08:17:42.675 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._connections.run(self.expiration_interval) 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._run(expiration_interval) 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:17:42.676 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:17:42.677 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:17:42.677 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: s = self.context.wrap_socket( 2024-07-26T08:17:42.677 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: return self.sslsocket_class._create( 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self.do_handshake() 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._sslobj.do_handshake() 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:17:42.678 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:17:42.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-mon[32384]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-07-26T08:17:42.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-mon[32384]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-07-26T08:17:42.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-mon[32384]: [26/Jul/2024:08:17:42] ENGINE Bus STARTING 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-mon[32384]: [26/Jul/2024:08:17:42] ENGINE Serving on https://172.21.15.43:7150 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-mon[32384]: [26/Jul/2024:08:17:42] ENGINE Error in HTTPServer.serve 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: Traceback (most recent call last): 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._connections.run(self.expiration_interval) 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._run(expiration_interval) 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:17:42.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: s = self.context.wrap_socket( 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: return self.sslsocket_class._create( 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: self.do_handshake() 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._sslobj.do_handshake() 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:17:42.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:42 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:17:43.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:43 smithi043 ceph-mon[32384]: [26/Jul/2024:08:17:42] ENGINE Serving on http://172.21.15.43:8765 2024-07-26T08:17:43.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:43 smithi043 ceph-mon[32384]: [26/Jul/2024:08:17:42] ENGINE Bus STARTED 2024-07-26T08:17:43.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:43 smithi043 ceph-mon[32384]: mgrmap e8: x(active, since 2s) 2024-07-26T08:17:43.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:43 smithi043 ceph-mon[32384]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:17:43.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:43 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:43.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:43 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:17:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout value unchanged 2024-07-26T08:17:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:Generating ssh key... 2024-07-26T08:17:45.583 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:45 smithi043 ceph-mon[32384]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:17:46.647 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-mon[32384]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:17:46.647 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-mon[32384]: Generating ssh key... 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: Generating public/private rsa key pair. 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: Your identification has been saved in /tmp/tmpxtweswok/key 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: Your public key has been saved in /tmp/tmpxtweswok/key.pub 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: The key fingerprint is: 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: SHA256:f0YJ78pXLeP8o9oa0aX9Gd0MazIfx/AuypZD9pW1GuU ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: The key's randomart image is: 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: +---[RSA 3072]----+ 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | | 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | | 2024-07-26T08:17:46.984 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | . o. | 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | o..+O+| 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | S .*o*+@| 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | . o+*+E*| 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | .++*==o| 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | . =Bo+o | 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: | o==+..o| 2024-07-26T08:17:46.985 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:17:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: +----[SHA256]-----+ 2024-07-26T08:17:47.915 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:47 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:47.916 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:47 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:48.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:48 smithi043 ceph-mon[32384]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:17:49.027 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:17:49.031 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-07-26T08:17:49.031 INFO:teuthology.orchestra.run.smithi043.stdout:Adding key to root@localhost authorized_keys... 2024-07-26T08:17:49.031 INFO:teuthology.orchestra.run.smithi043.stdout:Adding host smithi043... 2024-07-26T08:17:50.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:50 smithi043 ceph-mon[32384]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:17:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:52 smithi043 ceph-mon[32384]: Deploying cephadm binary to smithi043 2024-07-26T08:17:56.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Added host 'smithi043' with addr '172.21.15.43' 2024-07-26T08:17:56.249 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying unmanaged mon service... 2024-07-26T08:17:56.850 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:56 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:17:56.851 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:56 smithi043 ceph-mon[32384]: Added host smithi043 2024-07-26T08:17:56.851 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:56 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:17:58.220 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-07-26T08:17:58.220 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying unmanaged mgr service... 2024-07-26T08:17:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:58 smithi043 ceph-mon[32384]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:17:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:58 smithi043 ceph-mon[32384]: Saving service mon spec with placement count:5 2024-07-26T08:17:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:17:58 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:18:00.030 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-07-26T08:18:00.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:00 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:18:00.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:00 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:18:00.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:00 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:18:01.579 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:01 smithi043 ceph-mon[32384]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:18:01.579 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:01 smithi043 ceph-mon[32384]: Saving service mgr spec with placement count:2 2024-07-26T08:18:01.579 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:01 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3356900621' entity='client.admin' 2024-07-26T08:18:02.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:02 smithi043 ceph-mon[32384]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:03.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:03 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:18:03.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1578693196' entity='client.admin' 2024-07-26T08:18:03.844 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling the dashboard module... 2024-07-26T08:18:04.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:04 smithi043 ceph-mon[32384]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:04.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:04 smithi043 ceph-mon[32384]: from='mgr.14118 172.21.15.43:0/3105196767' entity='mgr.x' 2024-07-26T08:18:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:05 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/590267488' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-07-26T08:18:05.733 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:05 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ignoring --setuser ceph since I am not root 2024-07-26T08:18:05.733 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:05 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ignoring --setgroup ceph since I am not root 2024-07-26T08:18:06.388 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:06 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/590267488' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-07-26T08:18:06.388 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:06 smithi043 ceph-mon[32384]: mgrmap e9: x(active, since 24s) 2024-07-26T08:18:07.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:07 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/811600022' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-07-26T08:18:08.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:18:08.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-07-26T08:18:08.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-26T08:18:08.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-07-26T08:18:08.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-07-26T08:18:08.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:18:08.096 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2024-07-26T08:18:08.097 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 9... 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: Active manager daemon x restarted 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: Activating manager daemon x 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: osdmap e3: 0 total, 0 up, 0 in 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: mgrmap e10: x(active, starting, since 0.00906435s) 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T08:18:12.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: Manager daemon x is now available 2024-07-26T08:18:12.068 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:11 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:18:13.134 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:12 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:18:13.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:12 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:18:13.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:12 smithi043 ceph-mon[32384]: mgrmap e11: x(active, since 1.00969s) 2024-07-26T08:18:13.816 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-07-26T08:18:13.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-07-26T08:18:13.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2024-07-26T08:18:13.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-07-26T08:18:13.817 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 9 is available 2024-07-26T08:18:13.817 INFO:teuthology.orchestra.run.smithi043.stdout:Generating a dashboard self-signed certificate... 2024-07-26T08:18:14.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:13 smithi043 ceph-mon[32384]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-07-26T08:18:14.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:13 smithi043 ceph-mon[32384]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-07-26T08:18:14.855 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:14 smithi043 ceph-mon[32384]: mgrmap e12: x(active, since 2s) 2024-07-26T08:18:14.855 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:14 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:15.194 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:18:15.075+0000 7f73a5e00640 -1 log_channel(cephadm) log [ERR] : [26/Jul/2024:08:18:15] ENGINE Error in HTTPServer.serve 2024-07-26T08:18:15.195 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: Traceback (most recent call last): 2024-07-26T08:18:15.195 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:18:15.195 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._connections.run(self.expiration_interval) 2024-07-26T08:18:15.195 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:18:15.195 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._run(expiration_interval) 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: s = self.context.wrap_socket( 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:18:17.882 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: return self.sslsocket_class._create( 2024-07-26T08:18:17.883 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:18:17.883 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self.do_handshake() 2024-07-26T08:18:17.883 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:18:17.883 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._sslobj.do_handshake() 2024-07-26T08:18:17.883 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:18:17.883 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:18:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:18:17.884 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-07-26T08:18:17.884 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial admin user... 2024-07-26T08:18:17.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: [26/Jul/2024:08:18:14] ENGINE Bus STARTING 2024-07-26T08:18:17.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: [26/Jul/2024:08:18:15] ENGINE Serving on https://172.21.15.43:7150 2024-07-26T08:18:17.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: [26/Jul/2024:08:18:15] ENGINE Error in HTTPServer.serve 2024-07-26T08:18:17.884 INFO:journalctl@ceph.mon.a.smithi043.stdout: Traceback (most recent call last): 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._connections.run(self.expiration_interval) 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._run(expiration_interval) 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: s = self.context.wrap_socket( 2024-07-26T08:18:17.885 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: return self.sslsocket_class._create( 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: self.do_handshake() 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._sslobj.do_handshake() 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: [26/Jul/2024:08:18:15] ENGINE Serving on http://172.21.15.43:8765 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: [26/Jul/2024:08:18:15] ENGINE Bus STARTED 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:17.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:16 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:18.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:18 smithi043 ceph-mon[32384]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:18:18.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:18.496 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$m9LRvQfA9tAL8RYxyjDw/uuZ6O6UXAzTKluMshVbRhXISbjDvzJKC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1721981897, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-07-26T08:18:18.496 INFO:teuthology.orchestra.run.smithi043.stdout:Fetching dashboard port number... 2024-07-26T08:18:19.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:19 smithi043 ceph-mon[32384]: mgrmap e13: x(active, since 6s) 2024-07-26T08:18:20.148 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 8443 2024-07-26T08:18:20.185 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T08:18:20.185 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-07-26T08:18:20.211 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T08:18:20.212 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-07-26T08:18:20.212 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-07-26T08:18:20.212 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-07-26T08:18:20.220 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph Dashboard is now available at: 2024-07-26T08:18:20.220 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:20.221 INFO:teuthology.orchestra.run.smithi043.stdout: URL: https://smithi043.front.sepia.ceph.com:8443/ 2024-07-26T08:18:20.221 INFO:teuthology.orchestra.run.smithi043.stdout: User: admin 2024-07-26T08:18:20.221 INFO:teuthology.orchestra.run.smithi043.stdout: Password: wxo4obdqa4 2024-07-26T08:18:20.221 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:20.221 INFO:teuthology.orchestra.run.smithi043.stdout:Saving cluster configuration to /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config directory 2024-07-26T08:18:20.395 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:20 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/116925043' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-07-26T08:18:22.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-07-26T08:18:22.013 INFO:teuthology.orchestra.run.smithi043.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-07-26T08:18:22.013 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.013 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-07-26T08:18:22.013 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout:Or, if you are only running a single cluster on this host: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout:Please consider enabling telemetry to help improve Ceph: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: ceph telemetry on 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout:For more information see: 2024-07-26T08:18:22.014 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.015 INFO:teuthology.orchestra.run.smithi043.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-07-26T08:18:22.015 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:22.015 INFO:teuthology.orchestra.run.smithi043.stdout:Bootstrap complete. 2024-07-26T08:18:22.129 INFO:tasks.cephadm:Fetching config... 2024-07-26T08:18:22.130 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:18:22.130 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-07-26T08:18:22.186 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-07-26T08:18:22.186 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:18:22.186 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-07-26T08:18:22.230 INFO:tasks.cephadm:Fetching mon keyring... 2024-07-26T08:18:22.230 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:18:22.230 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/keyring of=/dev/stdout 2024-07-26T08:18:22.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:22 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3972008903' entity='client.admin' 2024-07-26T08:18:22.345 INFO:tasks.cephadm:Fetching pub ssh key... 2024-07-26T08:18:22.346 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:18:22.346 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-07-26T08:18:22.445 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-07-26T08:18:22.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-26T08:18:22.544 INFO:teuthology.orchestra.run.smithi043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:18:22.574 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-26T08:18:22.618 INFO:teuthology.orchestra.run.smithi063.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:18:22.630 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-26T08:18:22.671 INFO:teuthology.orchestra.run.smithi133.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUdoQk+URzG1TGK0NnNJGRgn4yaDmS2ZRZ47beQQbwd+ieadDL4K3TrQYsGdkrAWpU+GOLKRe4vwCdZHqffx19Nbpp1TqABDOVfx4NU+g73SiHBW8IwfTOCE3MOnGV/lT7g53qGMlfTZnqY28o4w2ZErqYolTnWKFVaT+I72dEV5klyrgiux8zaY56ApG+RPDCbJ5tEPIHTRFxE9nn5UEbMyRNhN+eKuuprqn5CZdcZ57QDEHRTLgXgzsfgQgHse5ih2wcyrfJqUi7lDifOCnUCIvyy/3AI3PhA0KI5jihZBG38ByUz6bWGaK52o/NQocWxwFVWrKAARPNf6fpqqmNyMIQTuSMxEhPGCesmCFvFBMFJrlUmGtr51IfShpY4yIKxA6P9xbQMweROl7VX2Kar/9QvOqrzDCC+WtTWhzg9Ksit/WVPmh0f0MpVqUtUO0fak0niGMjv1l486elJlb3cPhkv9T42UAB2qLedJrwRXGMTRxXv5zKtT0SlE+rhXU= ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:18:22.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-07-26T08:18:23.129 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:27.127 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-07-26T08:18:27.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-07-26T08:18:27.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:27 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3224461982' entity='client.admin' 2024-07-26T08:18:27.917 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:31.132 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi063 2024-07-26T08:18:31.132 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:18:31.132 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/etc/ceph/ceph.conf 2024-07-26T08:18:31.152 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:18:31.152 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:18:31.210 INFO:tasks.cephadm:Adding host smithi063 to orchestrator... 2024-07-26T08:18:31.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch host add smithi063 2024-07-26T08:18:31.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:31 smithi043 ceph-mon[32384]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:18:31.507 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:31 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:31.507 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:31 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:18:31.507 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:31 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:18:31.507 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:31 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:18:31.507 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:31 smithi043 ceph-mon[32384]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:18:31.644 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:32 smithi043 ceph-mon[32384]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:18:33.580 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:33 smithi043 ceph-mon[32384]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:18:33.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:33 smithi043 ceph-mon[32384]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:33.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:33 smithi043 ceph-mon[32384]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:18:33.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:33 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:33.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:33 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:33.581 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:33 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:35.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:35 smithi043 ceph-mon[32384]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:35 smithi043 ceph-mon[32384]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:18:36.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:36 smithi043 ceph-mon[32384]: Deploying cephadm binary to smithi063 2024-07-26T08:18:37.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:37 smithi043 ceph-mon[32384]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:38.199 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi063' with addr '172.21.15.63' 2024-07-26T08:18:39.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch host ls --format=json 2024-07-26T08:18:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:39 smithi043 ceph-mon[32384]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:39 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:39 smithi043 ceph-mon[32384]: Added host smithi063 2024-07-26T08:18:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:39 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:18:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:39 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:39 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:40.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:40 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:40.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:40 smithi043 ceph-mon[32384]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:41.961 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:41.961 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}] 2024-07-26T08:18:42.756 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi133 2024-07-26T08:18:42.757 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:18:42.757 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.conf 2024-07-26T08:18:42.775 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:18:42.776 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:18:42.833 INFO:tasks.cephadm:Adding host smithi133 to orchestrator... 2024-07-26T08:18:42.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch host add smithi133 2024-07-26T08:18:43.301 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:43.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:43.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:18:43.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:43.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:18:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:18:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:18:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:43 smithi043 ceph-mon[32384]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:18:44.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:44 smithi043 ceph-mon[32384]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:18:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:44 smithi043 ceph-mon[32384]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:18:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:44 smithi043 ceph-mon[32384]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:18:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:44 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:44 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:44 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:45 smithi043 ceph-mon[32384]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:46.684 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:46 smithi043 ceph-mon[32384]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:18:47.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:47 smithi043 ceph-mon[32384]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:47.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:47 smithi043 ceph-mon[32384]: Deploying cephadm binary to smithi133 2024-07-26T08:18:48.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:48 smithi043 ceph-mon[32384]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:49.855 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi133' with addr '172.21.15.133' 2024-07-26T08:18:50.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch host ls --format=json 2024-07-26T08:18:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:51.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:50 smithi043 ceph-mon[32384]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:51.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:50 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:51.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:50 smithi043 ceph-mon[32384]: Added host smithi133 2024-07-26T08:18:51.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:50 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:18:51.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:50 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:51.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:50 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:52.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:52 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:53.332 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:18:53.333 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.133", "hostname": "smithi133", "labels": [], "status": ""}] 2024-07-26T08:18:53.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:53 smithi043 ceph-mon[32384]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:54.122 INFO:tasks.cephadm:Setting crush tunables to default 2024-07-26T08:18:54.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd crush tunables default 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:18:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:54 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:18:54.610 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:55 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:18:56.441 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:56 smithi043 ceph-mon[32384]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:18:57.248 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-07-26T08:18:57.335 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:57 smithi043 ceph-mon[32384]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:57.335 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:57 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2507815871' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-07-26T08:18:58.009 INFO:tasks.cephadm:Adding mon.a on smithi043 2024-07-26T08:18:58.009 INFO:tasks.cephadm:Adding mon.b on smithi063 2024-07-26T08:18:58.009 INFO:tasks.cephadm:Adding mon.c on smithi133 2024-07-26T08:18:58.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch apply mon '3;smithi043:172.21.15.43=a;smithi063:172.21.15.63=b;smithi133:172.21.15.133=c' 2024-07-26T08:18:58.256 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:18:58.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:58 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2507815871' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-07-26T08:18:58.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:58 smithi043 ceph-mon[32384]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:18:59.388 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:18:59 smithi043 ceph-mon[32384]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:18:59.995 INFO:teuthology.orchestra.run.smithi133.stdout:Scheduled mon update... 2024-07-26T08:19:00.599 DEBUG:teuthology.orchestra.run.smithi063:mon.b> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.b.service 2024-07-26T08:19:00.603 DEBUG:teuthology.orchestra.run.smithi133:mon.c> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.c.service 2024-07-26T08:19:00.605 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T08:19:00.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph mon dump -f json 2024-07-26T08:19:01.212 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi063:172.21.15.63=b;smithi133:172.21.15.133=c", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: Saving service mon spec with placement smithi043:172.21.15.43=a;smithi063:172.21.15.63=b;smithi133:172.21.15.133=c;count:3 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:00 smithi043 ceph-mon[32384]: Deploying daemon mon.c on smithi133 2024-07-26T08:19:03.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:02 smithi043 ceph-mon[32384]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:04.418 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:19:04.418 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","modified":"2024-07-26T08:16:59.259085Z","created":"2024-07-26T08:16:59.259085Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-07-26T08:19:04.418 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-07-26T08:19:04.697 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 podman[37022]: 2024-07-26 08:19:04.696541824 +0000 UTC m=+0.476804986 container init 690b7b291788330724b60214e96a73772dea8f2c796c6bf8767383f15a9a015a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 podman[37022]: 2024-07-26 08:19:04.701108267 +0000 UTC m=+0.481371429 container start 690b7b291788330724b60214e96a73772dea8f2c796c6bf8767383f15a9a015a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: set uid:gid to 167:167 (ceph:ceph) 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev), process ceph-mon, pid 2 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pidfile_write: ignore empty --pid-file 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: load: jerasure load: lrc 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: RocksDB version: 7.9.2 2024-07-26T08:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Git sha 0 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Compile date 2024-07-25 13:49:38 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: DB SUMMARY 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: DB Session ID: 7MVZ51602MN17SS8JVHW 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: CURRENT file: CURRENT 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: IDENTITY file: IDENTITY 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-07-26T08:19:05.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.error_if_exists: 0 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.create_if_missing: 0 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.paranoid_checks: 1 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.flush_verify_memtable_count: 1 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.env: 0x5580cf517280 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.fs: PosixFileSystem 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.info_log: 0x5580d5c63080 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_file_opening_threads: 16 2024-07-26T08:19:05.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.statistics: (nil) 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.use_fsync: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_log_file_size: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.log_file_time_to_roll: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.keep_log_file_num: 1000 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.recycle_log_file_num: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.allow_fallocate: 1 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.allow_mmap_reads: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.allow_mmap_writes: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.use_direct_reads: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-07-26T08:19:05.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.create_missing_column_families: 0 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.db_log_dir: 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.wal_dir: 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.table_cache_numshardbits: 6 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.WAL_ttl_seconds: 0 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.WAL_size_limit_MB: 0 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.is_fd_close_on_exec: 1 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.advise_random_on_open: 1 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.db_write_buffer_size: 0 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.write_buffer_manager: 0x5580d5c675e0 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-07-26T08:19:05.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.use_adaptive_mutex: 0 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.rate_limiter: (nil) 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.wal_recovery_mode: 2 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.enable_thread_tracking: 0 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.enable_pipelined_write: 0 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.unordered_write: 0 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.row_cache: None 2024-07-26T08:19:05.021 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.wal_filter: None 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.allow_ingest_behind: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.two_write_queues: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.manual_wal_flush: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.wal_compression: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.atomic_flush: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-07-26T08:19:05.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.persist_stats_to_disk: 0 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.write_dbid_to_manifest: 0 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.log_readahead_size: 0 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.best_efforts_recovery: 0 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.allow_data_in_errors: 0 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.db_host_id: __hostname__ 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.enforce_single_del_contracts: true 2024-07-26T08:19:05.024 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_background_jobs: 2 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_background_compactions: -1 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_subcompactions: 1 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.delayed_write_rate : 16777216 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_total_wal_size: 0 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.stats_dump_period_sec: 600 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.stats_persist_period_sec: 600 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_open_files: -1 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bytes_per_sync: 0 2024-07-26T08:19:05.025 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.wal_bytes_per_sync: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.strict_bytes_per_sync: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_readahead_size: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_background_flushes: -1 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Compression algorithms supported: 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kZSTD supported: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kXpressCompression supported: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kBZip2Compression supported: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kLZ4Compression supported: 1 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kZlibCompression supported: 1 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kLZ4HCCompression supported: 1 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: kSnappyCompression supported: 1 2024-07-26T08:19:05.026 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Fast CRC32 supported: Supported on x86 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: DMutex implementation: pthread_mutex_t 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.merge_operator: 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_filter: None 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_filter_factory: None 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.sst_partitioner_factory: None 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.memtable_factory: SkipListFactory 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.table_factory: BlockBasedTable 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5580d5c62c80) 2024-07-26T08:19:05.027 INFO:journalctl@ceph.mon.c.smithi133.stdout: cache_index_and_filter_blocks: 1 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: pin_top_level_index_and_filter: 1 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: index_type: 0 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: data_block_index_type: 0 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: index_shortening: 1 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: data_block_hash_table_util_ratio: 0.750000 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: checksum: 4 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: no_block_cache: 0 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_cache: 0x5580d1c27610 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_cache_name: BinnedLRUCache 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_cache_options: 2024-07-26T08:19:05.028 INFO:journalctl@ceph.mon.c.smithi133.stdout: capacity : 536870912 2024-07-26T08:19:05.029 INFO:journalctl@ceph.mon.c.smithi133.stdout: num_shard_bits : 4 2024-07-26T08:19:05.029 INFO:journalctl@ceph.mon.c.smithi133.stdout: strict_capacity_limit : 0 2024-07-26T08:19:05.029 INFO:journalctl@ceph.mon.c.smithi133.stdout: high_pri_pool_ratio: 0.000 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_cache_compressed: (nil) 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: persistent_cache: (nil) 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_size: 4096 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_size_deviation: 10 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_restart_interval: 16 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: index_block_restart_interval: 1 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: metadata_block_size: 4096 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: partition_filters: 0 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: use_delta_encoding: 1 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: filter_policy: bloomfilter 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: whole_key_filtering: 1 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: verify_compression: 0 2024-07-26T08:19:05.030 INFO:journalctl@ceph.mon.c.smithi133.stdout: read_amp_bytes_per_bit: 0 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: format_version: 5 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: enable_index_compression: 1 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: block_align: 0 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: max_auto_readahead_size: 262144 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: prepopulate_block_cache: 0 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: initial_auto_readahead_size: 8192 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout: num_file_reads_for_auto_readahead: 2 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.write_buffer_size: 33554432 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_write_buffer_number: 2 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression: NoCompression 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression: Disabled 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.prefix_extractor: nullptr 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-07-26T08:19:05.031 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.num_levels: 7 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-07-26T08:19:05.032 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.window_bits: -14 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.level: 32767 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.strategy: 0 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.enabled: false 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.target_file_size_base: 67108864 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.target_file_size_multiplier: 1 2024-07-26T08:19:05.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-07-26T08:19:05.034 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.arena_block_size: 1048576 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.disable_auto_compactions: 0 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-07-26T08:19:05.035 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.inplace_update_support: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.inplace_update_num_locks: 10000 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.memtable_huge_page_size: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.bloom_locality: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.max_successive_merges: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.optimize_filters_for_hits: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.paranoid_file_checks: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.force_consistency_checks: 1 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.report_bg_io_stats: 0 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.ttl: 2592000 2024-07-26T08:19:05.036 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.periodic_compaction_seconds: 0 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.enable_blob_files: false 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.min_blob_size: 0 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.blob_file_size: 268435456 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.blob_compression_type: NoCompression 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.enable_blob_garbage_collection: false 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.blob_file_starting_level: 0 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-07-26T08:19:05.037 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 70e9509d-b330-4b95-8bdb-3eea9f1bbfc1 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721981944738308, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721981944738728, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1721981944, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "70e9509d-b330-4b95-8bdb-3eea9f1bbfc1", "db_session_id": "7MVZ51602MN17SS8JVHW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721981944738824, "job": 1, "event": "recovery_finished"} 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5580d5c84a80 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: DB pointer 0x5580d6a24000 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-07-26T08:19:05.038 INFO:journalctl@ceph.mon.c.smithi133.stdout: ** DB Stats ** 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: ** Compaction Stats [default] ** 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-26T08:19:05.039 INFO:journalctl@ceph.mon.c.smithi133.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: ** Compaction Stats [default] ** 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-07-26T08:19:05.040 INFO:journalctl@ceph.mon.c.smithi133.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: AddFile(Keys): cumulative 0, interval 0 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: Block cache BinnedLRUCache@0x5580d1c27610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout: ** File Read Latency Histogram By Level [default] ** 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: using public_addr v2:172.21.15.133:0/0 -> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-07-26T08:19:05.041 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: starting mon.c rank -1 at public addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] at bind addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(???) e0 preinit fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 bash[37022]: 690b7b291788330724b60214e96a73772dea8f2c796c6bf8767383f15a9a015a 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 systemd[1]: Started Ceph mon.c for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).mds e1 new map 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).mds e1 print_map 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: e1 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: btime 2024-07-26T08:17:03:796007+0000 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: legacy client fscid: -1 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: 2024-07-26T08:19:05.042 INFO:journalctl@ceph.mon.c.smithi133.stdout: No filesystems configured 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:19:05.043 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Deploying cephadm binary to smithi063 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Added host smithi063 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:19:05.044 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:05.045 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Deploying cephadm binary to smithi133 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Added host smithi133 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:05.046 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:05.047 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2507815871' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2507815871' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:05.048 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi063:172.21.15.63=b;smithi133:172.21.15.133=c", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Saving service mon spec with placement smithi043:172.21.15.43=a;smithi063:172.21.15.63=b;smithi133:172.21.15.133=c;count:3 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: Deploying daemon mon.c on smithi133 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:05.049 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:04 smithi133 ceph-mon[37053]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-07-26T08:19:06.186 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T08:19:06.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph mon dump -f json 2024-07-26T08:19:06.448 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: mon.a calling monitor election 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: mon.c calling monitor election 2024-07-26T08:19:10.129 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: monmap epoch 2 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: last_changed 2024-07-26T08:19:04.782715+0000 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: min_mon_release 19 (squid) 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: election_strategy: 1 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:10.130 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: fsmap 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: mgrmap e13: x(active, since 58s) 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: overall HEALTH_OK 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:10.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:09 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: mon.a calling monitor election 2024-07-26T08:19:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: mon.c calling monitor election 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: monmap epoch 2 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: last_changed 2024-07-26T08:19:04.782715+0000 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: min_mon_release 19 (squid) 2024-07-26T08:19:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: election_strategy: 1 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: fsmap 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: mgrmap e13: x(active, since 58s) 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: overall HEALTH_OK 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:09 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:10 smithi133 ceph-mon[37053]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:10 smithi133 ceph-mon[37053]: Deploying daemon mon.b on smithi063 2024-07-26T08:19:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:10 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:11.223 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:19:11.223 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":2,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","modified":"2024-07-26T08:19:04.782715Z","created":"2024-07-26T08:16:59.259085Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:3300","nonce":0},{"type":"v1","addr":"172.21.15.133:6789","nonce":0}]},"addr":"172.21.15.133:6789/0","public_addr":"172.21.15.133:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-07-26T08:19:11.223 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 2 2024-07-26T08:19:11.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:10 smithi043 ceph-mon[32384]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:11.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:10 smithi043 ceph-mon[32384]: Deploying daemon mon.b on smithi063 2024-07-26T08:19:11.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:10 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:12.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:11 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/565935772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T08:19:12.233 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:11 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:19:11.783+0000 7f73e6400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-07-26T08:19:12.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:11 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/565935772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T08:19:12.826 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T08:19:12.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph mon dump -f json 2024-07-26T08:19:13.084 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:19:13.205 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:12 smithi133 ceph-mon[37053]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:13.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:12 smithi043 ceph-mon[32384]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:13 smithi063 systemd[1]: Started Ceph mon.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:19:19.231 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-07-26T08:19:19.232 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","modified":"2024-07-26T08:19:13.858046Z","created":"2024-07-26T08:16:59.259085Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:3300","nonce":0},{"type":"v1","addr":"172.21.15.133:6789","nonce":0}]},"addr":"172.21.15.133:6789/0","public_addr":"172.21.15.133:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-07-26T08:19:19.232 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 3 2024-07-26T08:19:19.232 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:19.232 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: mon.c calling monitor election 2024-07-26T08:19:19.232 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: mon.a calling monitor election 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: monmap epoch 3 2024-07-26T08:19:19.233 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: last_changed 2024-07-26T08:19:13.858046+0000 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: min_mon_release 19 (squid) 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: election_strategy: 1 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: 2: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: fsmap 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: mgrmap e13: x(active, since 67s) 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: overall HEALTH_OK 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.234 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:18 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: mon.c calling monitor election 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: mon.a calling monitor election 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:19.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: monmap epoch 3 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:19.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: last_changed 2024-07-26T08:19:13.858046+0000 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: min_mon_release 19 (squid) 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: election_strategy: 1 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: 2: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: fsmap 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: mgrmap e13: x(active, since 67s) 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: overall HEALTH_OK 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:18 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:19.994 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-07-26T08:19:19.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config generate-minimal-conf 2024-07-26T08:19:20.212 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:19 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:20.212 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:19 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/3923403794' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T08:19:20.212 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:19 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:20.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:19 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:20.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:19 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/3923403794' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T08:19:20.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:19 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:20.483 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: mon.c calling monitor election 2024-07-26T08:19:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: mon.a calling monitor election 2024-07-26T08:19:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: monmap epoch 3 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: last_changed 2024-07-26T08:19:13.858046+0000 2024-07-26T08:19:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: min_mon_release 19 (squid) 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: election_strategy: 1 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: 2: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: fsmap 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: mgrmap e13: x(active, since 67s) 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: overall HEALTH_OK 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:21.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/3923403794' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T08:19:21.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:20 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: mon.b calling monitor election 2024-07-26T08:19:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:19:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: mon.b calling monitor election 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: mon.c calling monitor election 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: mon.a calling monitor election 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: monmap epoch 3 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: last_changed 2024-07-26T08:19:13.858046+0000 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: min_mon_release 19 (squid) 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: election_strategy: 1 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: 2: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-07-26T08:19:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: fsmap 2024-07-26T08:19:22.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:22.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: mgrmap e13: x(active, since 69s) 2024-07-26T08:19:22.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: overall HEALTH_OK 2024-07-26T08:19:22.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.020 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:21 smithi133 ceph-mon[37053]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: mon.b calling monitor election 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: mon.b calling monitor election 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: mon.c calling monitor election 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: mon.a calling monitor election 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-26T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: monmap epoch 3 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: last_changed 2024-07-26T08:19:13.858046+0000 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: min_mon_release 19 (squid) 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: election_strategy: 1 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: 2: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: fsmap 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: mgrmap e13: x(active, since 69s) 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: overall HEALTH_OK 2024-07-26T08:19:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:21 smithi063 ceph-mon[36747]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: mon.b calling monitor election 2024-07-26T08:19:22.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:19:22.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:22.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:22.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: mon.b calling monitor election 2024-07-26T08:19:22.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: mon.c calling monitor election 2024-07-26T08:19:22.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: mon.a calling monitor election 2024-07-26T08:19:22.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-26T08:19:22.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: monmap epoch 3 2024-07-26T08:19:22.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:22.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: last_changed 2024-07-26T08:19:13.858046+0000 2024-07-26T08:19:22.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: created 2024-07-26T08:16:59.259085+0000 2024-07-26T08:19:22.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: min_mon_release 19 (squid) 2024-07-26T08:19:22.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: election_strategy: 1 2024-07-26T08:19:22.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-07-26T08:19:22.160 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: 1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.c 2024-07-26T08:19:22.160 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: 2: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-07-26T08:19:22.160 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: fsmap 2024-07-26T08:19:22.160 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T08:19:22.160 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: mgrmap e13: x(active, since 69s) 2024-07-26T08:19:22.160 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: overall HEALTH_OK 2024-07-26T08:19:22.161 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.161 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.161 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.161 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.161 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:22.161 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:21 smithi043 ceph-mon[32384]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:22.910 INFO:teuthology.orchestra.run.smithi043.stdout:# minimal ceph.conf for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:22.910 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-07-26T08:19:22.910 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:19:22.910 INFO:teuthology.orchestra.run.smithi043.stdout: mon_host = [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-07-26T08:19:23.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:19:22.858+0000 7f73e6400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-07-26T08:19:23.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:23.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: Reconfiguring mon.a (unknown last config time)... 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:23.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:22 smithi043 ceph-mon[32384]: Reconfiguring daemon mon.a on smithi043 2024-07-26T08:19:23.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: Reconfiguring mon.a (unknown last config time)... 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:23.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:22 smithi133 ceph-mon[37053]: Reconfiguring daemon mon.a on smithi043 2024-07-26T08:19:23.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: Reconfiguring mon.a (unknown last config time)... 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:23.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:22 smithi063 ceph-mon[36747]: Reconfiguring daemon mon.a on smithi043 2024-07-26T08:19:23.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:23 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/4293300744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:23 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/4293300744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:24.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:23 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/4293300744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:24.442 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-07-26T08:19:24.442 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:19:24.442 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.conf 2024-07-26T08:19:24.537 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:19:24.537 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:24.670 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:19:24.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.conf 2024-07-26T08:19:24.696 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:19:24.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:24.761 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:19:24.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.conf 2024-07-26T08:19:24.793 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:19:24.793 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:24.860 INFO:tasks.cephadm:enabling module snap_schedule 2024-07-26T08:19:24.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-07-26T08:19:25.322 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:25.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:25.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:25.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:25.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: Reconfiguring mon.b (monmap changed)... 2024-07-26T08:19:25.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:25.494 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:25.495 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:25.495 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:25 smithi043 ceph-mon[32384]: Reconfiguring daemon mon.b on smithi063 2024-07-26T08:19:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: Reconfiguring mon.b (monmap changed)... 2024-07-26T08:19:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:25 smithi133 ceph-mon[37053]: Reconfiguring daemon mon.b on smithi063 2024-07-26T08:19:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: Reconfiguring mon.b (monmap changed)... 2024-07-26T08:19:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:25 smithi063 ceph-mon[36747]: Reconfiguring daemon mon.b on smithi063 2024-07-26T08:19:26.830 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: Reconfiguring mon.c (monmap changed)... 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: Reconfiguring daemon mon.c on smithi133 2024-07-26T08:19:26.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:26 smithi043 ceph-mon[32384]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: Reconfiguring mon.c (monmap changed)... 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: Reconfiguring daemon mon.c on smithi133 2024-07-26T08:19:27.001 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:26 smithi133 ceph-mon[37053]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:27.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: Reconfiguring mon.c (monmap changed)... 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: Reconfiguring daemon mon.c on smithi133 2024-07-26T08:19:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:26 smithi063 ceph-mon[36747]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2616711584' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:19:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:28 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:19:28.453 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ignoring --setuser ceph since I am not root 2024-07-26T08:19:28.453 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ignoring --setgroup ceph since I am not root 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2616711584' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:19:28.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:28 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:19:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='mgr.14150 172.21.15.43:0/111386389' entity='mgr.x' 2024-07-26T08:19:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2616711584' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:19:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:28 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:19:28.803 INFO:tasks.cephadm:Adding mgr.x on smithi043 2024-07-26T08:19:28.803 INFO:tasks.cephadm:Adding mgr.y on smithi063 2024-07-26T08:19:28.803 INFO:tasks.cephadm:Adding mgr.z on smithi133 2024-07-26T08:19:28.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch apply mgr '3;smithi043=x;smithi063=y;smithi133=z' 2024-07-26T08:19:29.056 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:19:29.369 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:29 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-26T08:19:29.369 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:29 smithi133 ceph-mon[37053]: mgrmap e14: x(active, since 76s) 2024-07-26T08:19:29.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:29 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-26T08:19:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:29 smithi043 ceph-mon[32384]: mgrmap e14: x(active, since 76s) 2024-07-26T08:19:29.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:29 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-26T08:19:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:29 smithi063 ceph-mon[36747]: mgrmap e14: x(active, since 76s) 2024-07-26T08:19:34.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: Active manager daemon x restarted 2024-07-26T08:19:34.842 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: Activating manager daemon x 2024-07-26T08:19:34.842 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: osdmap e5: 0 total, 0 up, 0 in 2024-07-26T08:19:34.842 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: mgrmap e15: x(active, starting, since 0.0103335s) 2024-07-26T08:19:34.842 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:34.842 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:34.843 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:34.843 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T08:19:34.843 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T08:19:34.843 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T08:19:34.843 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T08:19:34.843 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:34 smithi063 ceph-mon[36747]: Manager daemon x is now available 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: Active manager daemon x restarted 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: Activating manager daemon x 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: osdmap e5: 0 total, 0 up, 0 in 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: mgrmap e15: x(active, starting, since 0.0103335s) 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T08:19:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T08:19:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T08:19:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:34 smithi043 ceph-mon[32384]: Manager daemon x is now available 2024-07-26T08:19:35.009 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: Active manager daemon x restarted 2024-07-26T08:19:35.009 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: Activating manager daemon x 2024-07-26T08:19:35.009 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: osdmap e5: 0 total, 0 up, 0 in 2024-07-26T08:19:35.009 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: mgrmap e15: x(active, starting, since 0.0103335s) 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T08:19:35.010 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:34 smithi133 ceph-mon[37053]: Manager daemon x is now available 2024-07-26T08:19:35.527 INFO:teuthology.orchestra.run.smithi133.stdout:Scheduled mgr update... 2024-07-26T08:19:35.778 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:35.779 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:19:35.779 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:19:35.779 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:19:35.779 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:19:35.779 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: mgrmap e16: x(active, since 1.01469s) 2024-07-26T08:19:35.779 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:35.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: mgrmap e16: x(active, since 1.01469s) 2024-07-26T08:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:35.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: mgrmap e16: x(active, since 1.01469s) 2024-07-26T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:36.609 DEBUG:teuthology.orchestra.run.smithi063:mgr.y> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.y.service 2024-07-26T08:19:36.611 DEBUG:teuthology.orchestra.run.smithi133:mgr.z> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.z.service 2024-07-26T08:19:36.613 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-07-26T08:19:36.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-07-26T08:19:36.620 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-07-26T08:19:36.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set client debug_client 20 2024-07-26T08:19:36.665 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-07-26T08:19:36.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set client debug_ms 1 2024-07-26T08:19:36.712 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-07-26T08:19:36.712 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-07-26T08:19:36.759 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-07-26T08:19:36.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-07-26T08:19:36.808 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-07-26T08:19:36.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds debug_mds 20 2024-07-26T08:19:36.856 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-07-26T08:19:36.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-07-26T08:19:36.909 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-07-26T08:19:36.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds debug_ms 2 2024-07-26T08:19:36.957 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-07-26T08:19:36.958 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-07-26T08:19:37.013 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-07-26T08:19:37.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-07-26T08:19:37.065 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-07-26T08:19:37.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-07-26T08:19:37.118 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-07-26T08:19:37.118 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-07-26T08:19:37.180 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-07-26T08:19:37.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-07-26T08:19:37.231 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: Saving service mgr spec with placement smithi043=x;smithi063=y;smithi133=z;count:3 2024-07-26T08:19:37.231 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.231 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.231 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.231 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:37.249 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-07-26T08:19:37.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-07-26T08:19:37.313 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-07-26T08:19:37.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-07-26T08:19:37.365 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-07-26T08:19:37.366 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-07-26T08:19:37.429 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-07-26T08:19:37.429 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-07-26T08:19:37.490 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-07-26T08:19:37.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-07-26T08:19:37.491 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:19:37.294+0000 7fb4d6600640 -1 log_channel(cephadm) log [ERR] : [26/Jul/2024:08:19:37] ENGINE Error in HTTPServer.serve 2024-07-26T08:19:37.491 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: Traceback (most recent call last): 2024-07-26T08:19:37.491 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:19:37.491 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._connections.run(self.expiration_interval) 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._run(expiration_interval) 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: s = self.context.wrap_socket( 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: return self.sslsocket_class._create( 2024-07-26T08:19:37.492 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:19:37.493 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self.do_handshake() 2024-07-26T08:19:37.493 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:19:37.493 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: self._sslobj.do_handshake() 2024-07-26T08:19:37.493 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:19:37.493 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:19:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:19:37.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: Saving service mgr spec with placement smithi043=x;smithi063=y;smithi133=z;count:3 2024-07-26T08:19:37.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:37.548 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-07-26T08:19:37.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-07-26T08:19:37.557 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:37.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: Saving service mgr spec with placement smithi043=x;smithi063=y;smithi133=z;count:3 2024-07-26T08:19:37.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:37.572 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-07-26T08:19:37.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-07-26T08:19:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:37.616 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-07-26T08:19:37.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-07-26T08:19:37.674 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-07-26T08:19:37.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-07-26T08:19:37.735 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-07-26T08:19:37.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-07-26T08:19:37.800 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-07-26T08:19:37.802 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-07-26T08:19:37.802 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:37.882 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-07-26T08:19:37.882 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-07-26T08:19:37.943 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-07-26T08:19:37.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-07-26T08:19:37.944 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:38.012 DEBUG:tasks.cephadm:set 26 configs 2024-07-26T08:19:38.012 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi043') 2024-07-26T08:19:38.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:38.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:38.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:38.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: [26/Jul/2024:08:19:37] ENGINE Bus STARTING 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: mgrmap e17: x(active, since 2s) 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: [26/Jul/2024:08:19:37] ENGINE Serving on https://172.21.15.43:7150 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:38 smithi043 ceph-mon[32384]: [26/Jul/2024:08:19:37] ENGINE Error in HTTPServer.serve 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: Traceback (most recent call last): 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._connections.run(self.expiration_interval) 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._run(expiration_interval) 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:19:38.299 INFO:journalctl@ceph.mon.a.smithi043.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: s = self.context.wrap_socket( 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: return self.sslsocket_class._create( 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: self.do_handshake() 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: self._sslobj.do_handshake() 2024-07-26T08:19:38.300 INFO:journalctl@ceph.mon.a.smithi043.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:19:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: [26/Jul/2024:08:19:37] ENGINE Bus STARTING 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: mgrmap e17: x(active, since 2s) 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: [26/Jul/2024:08:19:37] ENGINE Serving on https://172.21.15.43:7150 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:38 smithi133 ceph-mon[37053]: [26/Jul/2024:08:19:37] ENGINE Error in HTTPServer.serve 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout: Traceback (most recent call last): 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout: self._connections.run(self.expiration_interval) 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:19:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout: self._run(expiration_interval) 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: s = self.context.wrap_socket( 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: return self.sslsocket_class._create( 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: self.do_handshake() 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: self._sslobj.do_handshake() 2024-07-26T08:19:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:19:38.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: [26/Jul/2024:08:19:37] ENGINE Bus STARTING 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: mgrmap e17: x(active, since 2s) 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: [26/Jul/2024:08:19:37] ENGINE Serving on https://172.21.15.43:7150 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:38 smithi063 ceph-mon[36747]: [26/Jul/2024:08:19:37] ENGINE Error in HTTPServer.serve 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout: Traceback (most recent call last): 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout: self._connections.run(self.expiration_interval) 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout: self._run(expiration_interval) 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: s = self.context.wrap_socket( 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: return self.sslsocket_class._create( 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: self.do_handshake() 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: self._sslobj.do_handshake() 2024-07-26T08:19:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T08:19:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:39 smithi043 ceph-mon[32384]: [26/Jul/2024:08:19:37] ENGINE Serving on http://172.21.15.43:8765 2024-07-26T08:19:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:39 smithi043 ceph-mon[32384]: [26/Jul/2024:08:19:37] ENGINE Bus STARTED 2024-07-26T08:19:39.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:39 smithi133 ceph-mon[37053]: [26/Jul/2024:08:19:37] ENGINE Serving on http://172.21.15.43:8765 2024-07-26T08:19:39.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:39 smithi133 ceph-mon[37053]: [26/Jul/2024:08:19:37] ENGINE Bus STARTED 2024-07-26T08:19:39.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:39 smithi063 ceph-mon[36747]: [26/Jul/2024:08:19:37] ENGINE Serving on http://172.21.15.43:8765 2024-07-26T08:19:39.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:39 smithi063 ceph-mon[36747]: [26/Jul/2024:08:19:37] ENGINE Bus STARTED 2024-07-26T08:19:40.131 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:41.489 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:41.592 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:41.592 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:41.593 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.594 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:41.594 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:41 smithi043 ceph-mon[32384]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:19:41.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:41.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:41 smithi063 ceph-mon[36747]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi043:/etc/ceph/ceph.conf 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi063:/etc/ceph/ceph.conf 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi133:/etc/ceph/ceph.conf 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.conf 2024-07-26T08:19:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:41 smithi133 ceph-mon[37053]: Updating smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:42 smithi133 ceph-mon[37053]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:42 smithi043 ceph-mon[32384]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:42 smithi063 ceph-mon[36747]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:44.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T08:19:44.137 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:44.137 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:44.137 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:44 smithi043 ceph-mon[32384]: Deploying daemon mgr.z on smithi133 2024-07-26T08:19:44.171 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:44.172 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:44 smithi133 ceph-mon[37053]: Deploying daemon mgr.z on smithi133 2024-07-26T08:19:44.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: Updating smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:44 smithi063 ceph-mon[36747]: Deploying daemon mgr.z on smithi133 2024-07-26T08:19:45.015 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:44 smithi133 systemd[1]: Starting Ceph mgr.z for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:19:45.409 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 podman[39890]: 2024-07-26 08:19:45.014773598 +0000 UTC m=+0.017255004 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:19:45.409 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 podman[39890]: 2024-07-26 08:19:45.115057008 +0000 UTC m=+0.117538413 container create 26bbfd43db7cc3d9978cdd2c2dd8872fe1fdeccd11f72a7677181a4a785650d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-z, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-07-26T08:19:45.409 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 podman[39890]: 2024-07-26 08:19:45.325443226 +0000 UTC m=+0.327924622 container init 26bbfd43db7cc3d9978cdd2c2dd8872fe1fdeccd11f72a7677181a4a785650d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:19:45.410 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 podman[39890]: 2024-07-26 08:19:45.32797898 +0000 UTC m=+0.330460377 container start 26bbfd43db7cc3d9978cdd2c2dd8872fe1fdeccd11f72a7677181a4a785650d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-z, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-07-26T08:19:45.410 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mgr[39909]: -- 172.21.15.133:0/1363868593 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55853e9c30e0 con 0x558543762480 2024-07-26T08:19:45.410 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 bash[39890]: 26bbfd43db7cc3d9978cdd2c2dd8872fe1fdeccd11f72a7677181a4a785650d0 2024-07-26T08:19:45.765 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 08:19:45 smithi133 systemd[1]: Started Ceph mgr.z for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T08:19:45.838 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:45.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:46.000 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:19:46.000 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:46.001 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:46.954 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:46 smithi063 ceph-mon[36747]: Deploying daemon mgr.y on smithi063 2024-07-26T08:19:46.955 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:46 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1818129937' entity='client.admin' 2024-07-26T08:19:46.955 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:46 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:19:47.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:46 smithi043 ceph-mon[32384]: Deploying daemon mgr.y on smithi063 2024-07-26T08:19:47.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:46 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1818129937' entity='client.admin' 2024-07-26T08:19:47.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:46 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:19:47.138 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:47.139 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:47.148 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:47.166 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:47.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:46 smithi133 ceph-mon[37053]: Deploying daemon mgr.y on smithi063 2024-07-26T08:19:47.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:46 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1818129937' entity='client.admin' 2024-07-26T08:19:47.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:46 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:19:47.312 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 systemd[1]: Starting Ceph mgr.y for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:19:47.568 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 podman[39109]: 2024-07-26 08:19:47.43406064 +0000 UTC m=+0.017749610 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:19:47.568 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 podman[39109]: 2024-07-26 08:19:47.532800696 +0000 UTC m=+0.116489652 container create cd5c040c0d7b78c291bcb60d08d766167577cd720052621f62af455f2589bc7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-y, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:19:47.743 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi043') 2024-07-26T08:19:48.067 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 podman[39109]: 2024-07-26 08:19:47.743478148 +0000 UTC m=+0.327167105 container init cd5c040c0d7b78c291bcb60d08d766167577cd720052621f62af455f2589bc7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-07-26T08:19:48.068 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 podman[39109]: 2024-07-26 08:19:47.746263057 +0000 UTC m=+0.329952024 container start cd5c040c0d7b78c291bcb60d08d766167577cd720052621f62af455f2589bc7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-07-26T08:19:48.068 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 ceph-mgr[39128]: -- 172.21.15.63:0/1505050545 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e746f90e0 con 0x556e74717a80 2024-07-26T08:19:48.068 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 bash[39109]: cd5c040c0d7b78c291bcb60d08d766167577cd720052621f62af455f2589bc7f 2024-07-26T08:19:48.068 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 08:19:47 smithi063 systemd[1]: Started Ceph mgr.y for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:19:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.795 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.806 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.806 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.821 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.822 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.828 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.833 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.834 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.839 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:48.896 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:48.896 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:48.896 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:48.896 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:48.897 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:49.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:19:50.208 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:19:50.208 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.208 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.208 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.208 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:50.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:19:50.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.285 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi043') 2024-07-26T08:19:50.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:19:50.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:19:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.037+0000 7f05a2400640 1 -- 172.21.15.43:0/723766583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c1040c0 msgr2=0x7f059c1044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.037+0000 7f05a2400640 1 --2- 172.21.15.43:0/723766583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c1040c0 0x7f059c1044d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f058c009900 tx=0x7f058c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.037+0000 7f05a2400640 1 -- 172.21.15.43:0/723766583 shutdown_connections 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.037+0000 7f05a2400640 1 --2- 172.21.15.43:0/723766583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c10d670 0x7f059c10fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.037+0000 7f05a2400640 1 --2- 172.21.15.43:0/723766583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c104af0 0x7f059c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.038+0000 7f05a2400640 1 --2- 172.21.15.43:0/723766583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c1040c0 0x7f059c1044d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.038+0000 7f05a2400640 1 -- 172.21.15.43:0/723766583 >> 172.21.15.43:0/723766583 conn(0x7f059c0fdcf0 msgr2=0x7f059c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.038+0000 7f05a2400640 1 -- 172.21.15.43:0/723766583 shutdown_connections 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.038+0000 7f05a2400640 1 -- 172.21.15.43:0/723766583 wait complete. 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.039+0000 7f05a2400640 1 Processor -- start 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.039+0000 7f05a2400640 1 -- start start 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.039+0000 7f05a2400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 0x7f059c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a2400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c104af0 0x7f059c19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a2400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c10d670 0x7f059c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a2400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f059c1132b0 con 0x7f059c104af0 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a2400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f059c113130 con 0x7f059c1040c0 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a2400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f059c113430 con 0x7f059c10d670 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 0x7f059c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 0x7f059c19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:54196/0 (socket says 172.21.15.43:54196) 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 -- 172.21.15.43:0/3357029651 learned_addr learned my addr 172.21.15.43:0/3357029651 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1a00640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c10d670 0x7f059c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f0593e00640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c104af0 0x7f059c19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 -- 172.21.15.43:0/3357029651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c10d670 msgr2=0x7f059c1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c10d670 0x7f059c1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 -- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c104af0 msgr2=0x7f059c19c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c104af0 0x7f059c19c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.040+0000 7f05a1000640 1 -- 172.21.15.43:0/3357029651 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059c1a1e30 con 0x7f059c1040c0 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.041+0000 7f05a1000640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 0x7f059c19bec0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f058c009230 tx=0x7f058c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.041+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c03f030 con 0x7f059c1040c0 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.041+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f058c031880 con 0x7f059c1040c0 2024-07-26T08:19:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.041+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c035070 con 0x7f059c1040c0 2024-07-26T08:19:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.041+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059c1a20c0 con 0x7f059c1040c0 2024-07-26T08:19:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.041+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059c1a8880 con 0x7f059c1040c0 2024-07-26T08:19:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.042+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059c06aef0 con 0x7f059c1040c0 2024-07-26T08:19:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.043+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 100892+0+0 (secure 0 0 0) 0x7f058c042030 con 0x7f059c1040c0 2024-07-26T08:19:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.044+0000 7f059a000640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f05800794a0 0x7f058007b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.044+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f058c0bb2f0 con 0x7f059c1040c0 2024-07-26T08:19:51.077 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: Reconfiguring mgr.x (unknown last config time)... 2024-07-26T08:19:51.077 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: Reconfiguring daemon mgr.x on smithi043 2024-07-26T08:19:51.077 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-26T08:19:51.077 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T08:19:51.078 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: Standby manager daemon z started 2024-07-26T08:19:51.078 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-26T08:19:51.078 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:51 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T08:19:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.045+0000 7f0593e00640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f05800794a0 0x7f058007b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.045+0000 7f0593e00640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f05800794a0 0x7f058007b9b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f059c100490 tx=0x7f0584005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:19:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.050+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f058c083ff0 con 0x7f059c1040c0 2024-07-26T08:19:51.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: Reconfiguring mgr.x (unknown last config time)... 2024-07-26T08:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: Reconfiguring daemon mgr.x on smithi043 2024-07-26T08:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-26T08:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T08:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: Standby manager daemon z started 2024-07-26T08:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-26T08:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:51 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T08:19:51.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.268+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f059c1a8a50 con 0x7f059c1040c0 2024-07-26T08:19:51.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.275+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 7 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f058c083b00 con 0x7f059c1040c0 2024-07-26T08:19:51.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.279+0000 7f059a000640 1 -- 172.21.15.43:0/3357029651 <== mon.2 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f058c08cf60 con 0x7f059c1040c0 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.281+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f05800794a0 msgr2=0x7f058007b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.281+0000 7f05a2400640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f05800794a0 0x7f058007b9b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f059c100490 tx=0x7f0584005f90 comp rx=0 tx=0).stop 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.281+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 msgr2=0x7f059c19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.281+0000 7f05a2400640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 0x7f059c19bec0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f058c009230 tx=0x7f058c004270 comp rx=0 tx=0).stop 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.282+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 shutdown_connections 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.282+0000 7f05a2400640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f05800794a0 0x7f058007b9b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.282+0000 7f05a2400640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f059c10d670 0x7f059c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.282+0000 7f05a2400640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c104af0 0x7f059c19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.282+0000 7f05a2400640 1 --2- 172.21.15.43:0/3357029651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f059c1040c0 0x7f059c19bec0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.282+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 >> 172.21.15.43:0/3357029651 conn(0x7f059c0fdcf0 msgr2=0x7f059c10c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:19:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.284+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 shutdown_connections 2024-07-26T08:19:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.284+0000 7f05a2400640 1 -- 172.21.15.43:0/3357029651 wait complete. 2024-07-26T08:19:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: Reconfiguring mgr.x (unknown last config time)... 2024-07-26T08:19:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: Reconfiguring daemon mgr.x on smithi043 2024-07-26T08:19:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-26T08:19:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T08:19:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: Standby manager daemon z started 2024-07-26T08:19:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-26T08:19:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:51 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.133:0/2567024355' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T08:19:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 -- 172.21.15.43:0/482444226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378108f00 msgr2=0x7f6378109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 --2- 172.21.15.43:0/482444226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378108f00 0x7f6378109310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6364009860 tx=0x7f636402a340 comp rx=0 tx=0).stop 2024-07-26T08:19:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 -- 172.21.15.43:0/482444226 shutdown_connections 2024-07-26T08:19:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 --2- 172.21.15.43:0/482444226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378108f00 0x7f6378109310 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 --2- 172.21.15.43:0/482444226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6378109850 0x7f6378110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 --2- 172.21.15.43:0/482444226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63781035c0 0x7f63781039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 -- 172.21.15.43:0/482444226 >> 172.21.15.43:0/482444226 conn(0x7f63780ff010 msgr2=0x7f6378101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 -- 172.21.15.43:0/482444226 shutdown_connections 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 -- 172.21.15.43:0/482444226 wait complete. 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.702+0000 7f637de00640 1 Processor -- start 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 -- start start 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 0x7f6378075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6378108f00 0x7f6378075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378109850 0x7f6378075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6378113630 con 0x7f6378108f00 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f63781134b0 con 0x7f63781035c0 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f637de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f63781137b0 con 0x7f6378109850 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f6376a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 0x7f6378075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f6376a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 0x7f6378075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:54212/0 (socket says 172.21.15.43:54212) 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f6376a00640 1 -- 172.21.15.43:0/583707983 learned_addr learned my addr 172.21.15.43:0/583707983 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.703+0000 7f6376000640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6378108f00 0x7f6378075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6377400640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378109850 0x7f6378075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6376a00640 1 -- 172.21.15.43:0/583707983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378109850 msgr2=0x7f6378075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6376a00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378109850 0x7f6378075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6376a00640 1 -- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6378108f00 msgr2=0x7f6378075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6376a00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6378108f00 0x7f6378075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6376a00640 1 -- 172.21.15.43:0/583707983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63781a8280 con 0x7f63781035c0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.704+0000 7f6376a00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 0x7f6378075140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f636800e9f0 tx=0x7f636800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.705+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636800cd80 con 0x7f63781035c0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.705+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6368010900 con 0x7f63781035c0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.705+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6368018920 con 0x7f63781035c0 2024-07-26T08:19:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.705+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63781a8570 con 0x7f63781035c0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.705+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781a8ad0 con 0x7f63781035c0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.706+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63781039d0 con 0x7f63781035c0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.707+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 100892+0+0 (secure 0 0 0) 0x7f6368018b00 con 0x7f63781035c0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.708+0000 7f637ca00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f635c0794a0 0x7f635c07b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.708+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f636809adc0 con 0x7f63781035c0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.709+0000 7f6376000640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f635c0794a0 0x7f635c07b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.710+0000 7f6376000640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f635c0794a0 0x7f635c07b9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6364035040 tx=0x7f63640056d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:19:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.713+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6368063b80 con 0x7f63781035c0 2024-07-26T08:19:51.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.952+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f637810b090 con 0x7f63781035c0 2024-07-26T08:19:51.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.962+0000 7f637ca00640 1 -- 172.21.15.43:0/583707983 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f63680680d0 con 0x7f63781035c0 2024-07-26T08:19:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.964+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f635c0794a0 msgr2=0x7f635c07b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.964+0000 7f637de00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f635c0794a0 0x7f635c07b9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6364035040 tx=0x7f63640056d0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.964+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 msgr2=0x7f6378075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.964+0000 7f637de00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 0x7f6378075140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f636800e9f0 tx=0x7f636800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 shutdown_connections 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f635c0794a0 0x7f635c07b9b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6378109850 0x7f6378075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6378108f00 0x7f6378075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 --2- 172.21.15.43:0/583707983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63781035c0 0x7f6378075140 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 >> 172.21.15.43:0/583707983 conn(0x7f63780ff010 msgr2=0x7f6378101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 shutdown_connections 2024-07-26T08:19:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:51.965+0000 7f637de00640 1 -- 172.21.15.43:0/583707983 wait complete. 2024-07-26T08:19:52.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:52 smithi043 ceph-mon[32384]: mgrmap e18: x(active, since 16s), standbys: z 2024-07-26T08:19:52.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-26T08:19:52.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:52 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:19:52.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:52 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:19:52.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:52 smithi063 ceph-mon[36747]: mgrmap e18: x(active, since 16s), standbys: z 2024-07-26T08:19:52.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-26T08:19:52.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:52 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:19:52.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:52 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:19:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:52 smithi133 ceph-mon[37053]: mgrmap e18: x(active, since 16s), standbys: z 2024-07-26T08:19:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-26T08:19:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:52 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:19:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:52 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:19:53.116 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:53 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-26T08:19:53.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:53 smithi043 ceph-mon[32384]: Standby manager daemon y started 2024-07-26T08:19:53.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:53 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T08:19:53.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:53 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-26T08:19:53.117 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:53 smithi043 ceph-mon[32384]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T08:19:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:53 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-26T08:19:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:53 smithi063 ceph-mon[36747]: Standby manager daemon y started 2024-07-26T08:19:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:53 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T08:19:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:53 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-26T08:19:53.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:53 smithi063 ceph-mon[36747]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T08:19:53.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:53 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-26T08:19:53.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:53 smithi133 ceph-mon[37053]: Standby manager daemon y started 2024-07-26T08:19:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:53 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T08:19:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:53 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-26T08:19:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:53 smithi133 ceph-mon[37053]: from='mgr.? 172.21.15.63:0/898683547' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T08:19:54.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-26T08:19:54.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:54 smithi043 ceph-mon[32384]: mgrmap e19: x(active, since 18s), standbys: z, y 2024-07-26T08:19:54.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-26T08:19:54.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:54 smithi063 ceph-mon[36747]: mgrmap e19: x(active, since 18s), standbys: z, y 2024-07-26T08:19:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-26T08:19:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:54 smithi133 ceph-mon[37053]: mgrmap e19: x(active, since 18s), standbys: z, y 2024-07-26T08:19:55.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 -- 172.21.15.43:0/877302175 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73a803edb0 msgr2=0x7f73a80412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 --2- 172.21.15.43:0/877302175 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73a803edb0 0x7f73a80412c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009bd0 tx=0x7f73b4005f90 comp rx=0 tx=0).stop 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 -- 172.21.15.43:0/877302175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c410b850 msgr2=0x7f73c41a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 --2- 172.21.15.43:0/877302175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c410b850 0x7f73c41a16a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00efd0 tx=0x7f73bc00c6a0 comp rx=0 tx=0).stop 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 -- 172.21.15.43:0/877302175 shutdown_connections 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 --2- 172.21.15.43:0/877302175 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73a803edb0 0x7f73a80412c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 --2- 172.21.15.43:0/877302175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c410b850 0x7f73c41a16a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 --2- 172.21.15.43:0/877302175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73c410af00 0x7f73c419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 --2- 172.21.15.43:0/877302175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c4105650 0x7f73c419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 -- 172.21.15.43:0/877302175 >> 172.21.15.43:0/877302175 conn(0x7f73c41010c0 msgr2=0x7f73c41034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 -- 172.21.15.43:0/877302175 shutdown_connections 2024-07-26T08:19:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:19:49.010+0000 7f73c3e00640 1 -- 172.21.15.43:0/877302175 wait complete. 2024-07-26T08:19:56.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:56 smithi063 ceph-mon[36747]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:56.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:56 smithi043 ceph-mon[32384]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:56 smithi133 ceph-mon[37053]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:19:58.371 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:19:58 smithi043 ceph-mon[32384]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:58.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:19:58 smithi133 ceph-mon[37053]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:19:58.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:19:58 smithi063 ceph-mon[36747]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:00.176 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:00 smithi043 ceph-mon[32384]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:00.176 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:00 smithi043 ceph-mon[32384]: overall HEALTH_OK 2024-07-26T08:20:00.344 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:00 smithi133 ceph-mon[37053]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:00.345 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:00 smithi133 ceph-mon[37053]: overall HEALTH_OK 2024-07-26T08:20:00.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:00 smithi063 ceph-mon[36747]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:00.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:00 smithi063 ceph-mon[36747]: overall HEALTH_OK 2024-07-26T08:20:00.842 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-07-26T08:20:02.366 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:02 smithi043 ceph-mon[32384]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:02.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:02 smithi133 ceph-mon[37053]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:02 smithi063 ceph-mon[36747]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:03.250 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 -- 172.21.15.43:0/4139989701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e100751e0 msgr2=0x7f3e100755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 --2- 172.21.15.43:0/4139989701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e100751e0 0x7f3e100755f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009900 tx=0x7f3e0002a410 comp rx=0 tx=0).stop 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 -- 172.21.15.43:0/4139989701 shutdown_connections 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 --2- 172.21.15.43:0/4139989701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 0x7f3e10111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 --2- 172.21.15.43:0/4139989701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e10075b30 0x7f3e1010f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 --2- 172.21.15.43:0/4139989701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e100751e0 0x7f3e100755f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 -- 172.21.15.43:0/4139989701 >> 172.21.15.43:0/4139989701 conn(0x7f3e100fee10 msgr2=0x7f3e10101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 -- 172.21.15.43:0/4139989701 shutdown_connections 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.715+0000 7f3e0f200640 1 -- 172.21.15.43:0/4139989701 wait complete. 2024-07-26T08:20:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.717+0000 7f3e0f200640 1 Processor -- start 2024-07-26T08:20:04.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.717+0000 7f3e0f200640 1 -- start start 2024-07-26T08:20:04.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100751e0 0x7f3e1019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:04.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 0x7f3e1019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:04.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 0x7f3e101a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:04.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10115660 con 0x7f3e10075b30 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101154e0 con 0x7f3e100751e0 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101157e0 con 0x7f3e1010f940 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 0x7f3e1019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 0x7f3e101a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 0x7f3e1019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54558/0 (socket says 172.21.15.43:54558) 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0d400640 1 -- 172.21.15.43:0/1123983538 learned_addr learned my addr 172.21.15.43:0/1123983538 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.718+0000 7f3e0de00640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100751e0 0x7f3e1019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0e800640 1 -- 172.21.15.43:0/1123983538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100751e0 msgr2=0x7f3e1019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0e800640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100751e0 0x7f3e1019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0e800640 1 -- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 msgr2=0x7f3e1019c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0e800640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 0x7f3e1019c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0e800640 1 -- 172.21.15.43:0/1123983538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e101a1ec0 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0d400640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 0x7f3e1019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e0e800640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 0x7f3e101a1790 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009fd0 tx=0x7f3e0800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.719+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800ce20 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.720+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101a21b0 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.720+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3e08005020 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.720+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08010720 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.720+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101a8910 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.721+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e100766f0 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.723+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f3e08005560 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.725+0000 7f3e06a00640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3df40b3b90 0x7f3df40b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.725+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3e080e2c60 con 0x7f3e1010f940 2024-07-26T08:20:04.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.725+0000 7f3e0de00640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3df40b3b90 0x7f3df40b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.726+0000 7f3e0de00640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3df40b3b90 0x7f3df40b60a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e00006010 tx=0x7f3e00000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.726+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3e080abe10 con 0x7f3e1010f940 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.941+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3e1019d080 con 0x7f3e1010f940 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.951+0000 7f3e06a00640 1 -- 172.21.15.43:0/1123983538 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f3e080ab710 con 0x7f3e1010f940 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3df40b3b90 msgr2=0x7f3df40b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3df40b3b90 0x7f3df40b60a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e00006010 tx=0x7f3e00000bc0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 msgr2=0x7f3e101a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 0x7f3e101a1790 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009fd0 tx=0x7f3e0800ef10 comp rx=0 tx=0).stop 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 shutdown_connections 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3df40b3b90 0x7f3df40b60a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1010f940 0x7f3e101a1790 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e10075b30 0x7f3e1019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 --2- 172.21.15.43:0/1123983538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100751e0 0x7f3e1019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:04.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.954+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 >> 172.21.15.43:0/1123983538 conn(0x7f3e100fee10 msgr2=0x7f3e10109450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:04.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.955+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 shutdown_connections 2024-07-26T08:20:04.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:03.955+0000 7f3e0f200640 1 -- 172.21.15.43:0/1123983538 wait complete. 2024-07-26T08:20:04.424 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:04 smithi043 ceph-mon[32384]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:04.424 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:04 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:04 smithi133 ceph-mon[37053]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:04 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:04.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:04 smithi063 ceph-mon[36747]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:04.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:04 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:06.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:06 smithi043 ceph-mon[32384]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:06.481 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi043') 2024-07-26T08:20:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:06 smithi133 ceph-mon[37053]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:06.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:06 smithi063 ceph-mon[36747]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:08.115 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:20:08.140 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:08 smithi043 ceph-mon[32384]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:08.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi043') 2024-07-26T08:20:08.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:08 smithi133 ceph-mon[37053]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:08.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:08 smithi063 ceph-mon[36747]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:09.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:10.306 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:10 smithi043 ceph-mon[32384]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:10 smithi133 ceph-mon[37053]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:10.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:10 smithi063 ceph-mon[36747]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:12.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:12 smithi063 ceph-mon[36747]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:12.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:12 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:12.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:12.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:12.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:12.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:12.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:12 smithi043 ceph-mon[32384]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:12 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:12 smithi133 ceph-mon[37053]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:12 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 -- 172.21.15.43:0/763533412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041057b0 msgr2=0x7f2304105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 --2- 172.21.15.43:0/763533412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041057b0 0x7f2304105bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009900 tx=0x7f22f802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 -- 172.21.15.43:0/763533412 shutdown_connections 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 --2- 172.21.15.43:0/763533412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f230410ba40 0x7f2304112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 --2- 172.21.15.43:0/763533412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410b0f0 0x7f230410b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 --2- 172.21.15.43:0/763533412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041057b0 0x7f2304105bc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 -- 172.21.15.43:0/763533412 >> 172.21.15.43:0/763533412 conn(0x7f2304101240 msgr2=0x7f2304103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 -- 172.21.15.43:0/763533412 shutdown_connections 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.343+0000 7f230c800640 1 -- 172.21.15.43:0/763533412 wait complete. 2024-07-26T08:20:14.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.344+0000 7f230c800640 1 Processor -- start 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.344+0000 7f230c800640 1 -- start start 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230c800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23041057b0 0x7f230419c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230c800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 0x7f230419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230c800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba40 0x7f23041a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230c800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2304115890 con 0x7f230410ba40 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230c800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2304115710 con 0x7f230410b0f0 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230c800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2304115a10 con 0x7f23041057b0 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba40 0x7f23041a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f2309400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 0x7f230419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f2309400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 0x7f230419c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37766/0 (socket says 172.21.15.43:37766) 2024-07-26T08:20:14.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f2309400640 1 -- 172.21.15.43:0/2630409403 learned_addr learned my addr 172.21.15.43:0/2630409403 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f230a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba40 0x7f23041a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52888/0 (socket says 172.21.15.43:52888) 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.345+0000 7f2309e00640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23041057b0 0x7f230419c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f2309400640 1 -- 172.21.15.43:0/2630409403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23041057b0 msgr2=0x7f230419c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f2309400640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23041057b0 0x7f230419c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f2309400640 1 -- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba40 msgr2=0x7f23041a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f2309400640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba40 0x7f23041a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f2309400640 1 -- 172.21.15.43:0/2630409403 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23041a2150 con 0x7f230410b0f0 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f2309400640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 0x7f230419c780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22f400d950 tx=0x7f22f400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4017070 con 0x7f230410b0f0 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23041a2440 con 0x7f230410b0f0 2024-07-26T08:20:14.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22f4009c30 con 0x7f230410b0f0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f40047a0 con 0x7f230410b0f0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.346+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041a8ba0 con 0x7f230410b0f0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.347+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2304105bc0 con 0x7f230410b0f0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.350+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f22f4004020 con 0x7f230410b0f0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.352+0000 7f22fea00640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22ec0b3b90 0x7f22ec0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.352+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22f40e1cf0 con 0x7f230410b0f0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.352+0000 7f2309e00640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22ec0b3b90 0x7f22ec0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.353+0000 7f2309e00640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22ec0b3b90 0x7f22ec0b60a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22f8006010 tx=0x7f22f8000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.356+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f22f4020020 con 0x7f230410b0f0 2024-07-26T08:20:14.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.555+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f230402e0c0 con 0x7f230410b0f0 2024-07-26T08:20:14.557 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:14 smithi043 ceph-mon[32384]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:14.557 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:14 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:14.557 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:14 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:14.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.562+0000 7f22fea00640 1 -- 172.21.15.43:0/2630409403 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v20)=0 v20) ==== 129+0+0 (secure 0 0 0) 0x7f22f40aaea0 con 0x7f230410b0f0 2024-07-26T08:20:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22ec0b3b90 msgr2=0x7f22ec0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22ec0b3b90 0x7f22ec0b60a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22f8006010 tx=0x7f22f8000bc0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 msgr2=0x7f230419c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 0x7f230419c780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22f400d950 tx=0x7f22f400de10 comp rx=0 tx=0).stop 2024-07-26T08:20:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 shutdown_connections 2024-07-26T08:20:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22ec0b3b90 0x7f22ec0b60a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba40 0x7f23041a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b0f0 0x7f230419c780 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 --2- 172.21.15.43:0/2630409403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23041057b0 0x7f230419c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 >> 172.21.15.43:0/2630409403 conn(0x7f2304101240 msgr2=0x7f230410a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:14.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.565+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 shutdown_connections 2024-07-26T08:20:14.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.566+0000 7f230c800640 1 -- 172.21.15.43:0/2630409403 wait complete. 2024-07-26T08:20:14.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:14 smithi063 ceph-mon[36747]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:14.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:14 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:14.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:14 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:14 smithi133 ceph-mon[37053]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:14 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:14 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:14.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.866+0000 7f919ec00640 1 -- 172.21.15.43:0/3430864479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810b120 msgr2=0x7f919810b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:14.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.866+0000 7f919ec00640 1 --2- 172.21.15.43:0/3430864479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810b120 0x7f919810b530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 -- 172.21.15.43:0/3430864479 shutdown_connections 2024-07-26T08:20:14.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 --2- 172.21.15.43:0/3430864479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919810ba70 0x7f91981122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:14.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 --2- 172.21.15.43:0/3430864479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810b120 0x7f919810b530 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 --2- 172.21.15.43:0/3430864479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f9198105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 -- 172.21.15.43:0/3430864479 >> 172.21.15.43:0/3430864479 conn(0x7f91981011f0 msgr2=0x7f9198103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 -- 172.21.15.43:0/3430864479 shutdown_connections 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.867+0000 7f919ec00640 1 -- 172.21.15.43:0/3430864479 wait complete. 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.868+0000 7f919ec00640 1 Processor -- start 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.868+0000 7f919ec00640 1 -- start start 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.868+0000 7f919ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f919819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.868+0000 7f919ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919810b120 0x7f919819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f919ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810ba70 0x7f91981a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f919ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9198115860 con 0x7f919810ba70 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f919ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f91981156e0 con 0x7f91981057e0 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f919ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f91981159e0 con 0x7f919810b120 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f919819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f919819c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39260/0 (socket says 172.21.15.43:39260) 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 -- 172.21.15.43:0/4284285599 learned_addr learned my addr 172.21.15.43:0/4284285599 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f919cc00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810ba70 0x7f91981a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197400640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919810b120 0x7f919819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 -- 172.21.15.43:0/4284285599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919810b120 msgr2=0x7f919819c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919810b120 0x7f919819c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 -- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810ba70 msgr2=0x7f91981a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810ba70 0x7f91981a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.869+0000 7f9197e00640 1 -- 172.21.15.43:0/4284285599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91981a2180 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.870+0000 7f9197e00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f919819c210 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f918800ea60 tx=0x7f918800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.870+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918800cde0 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.870+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91981a2470 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.870+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91880035f0 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.870+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188010690 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.870+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981a8bd0 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.871+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9198105bf0 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.874+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f91880037a0 con 0x7f91981057e0 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.875+0000 7f9194c00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f917c0b3b90 0x7f917c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.876+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f91880e24a0 con 0x7f91981057e0 2024-07-26T08:20:15.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.876+0000 7f9197400640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f917c0b3b90 0x7f917c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.876+0000 7f9197400640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f917c0b3b90 0x7f917c0b60a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f918402a9e0 tx=0x7f9184000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:15.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:14.880+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f91880ab650 con 0x7f91981057e0 2024-07-26T08:20:15.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.076+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f919802e0c0 con 0x7f91981057e0 2024-07-26T08:20:15.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.084+0000 7f9194c00640 1 -- 172.21.15.43:0/4284285599 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f91880aaf50 con 0x7f91981057e0 2024-07-26T08:20:15.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f917c0b3b90 msgr2=0x7f917c0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f917c0b3b90 0x7f917c0b60a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f918402a9e0 tx=0x7f9184000bc0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 msgr2=0x7f919819c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f919819c210 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f918800ea60 tx=0x7f918800ef20 comp rx=0 tx=0).stop 2024-07-26T08:20:15.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 shutdown_connections 2024-07-26T08:20:15.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f917c0b3b90 0x7f917c0b60a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919810b120 0x7f919819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f919810ba70 0x7f91981a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 --2- 172.21.15.43:0/4284285599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91981057e0 0x7f919819c210 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 >> 172.21.15.43:0/4284285599 conn(0x7f91981011f0 msgr2=0x7f9198104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:15.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.087+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 shutdown_connections 2024-07-26T08:20:15.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:15.088+0000 7f919ec00640 1 -- 172.21.15.43:0/4284285599 wait complete. 2024-07-26T08:20:15.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 -- 172.21.15.43:0/3030673422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10b860 msgr2=0x7fbe6c112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 --2- 172.21.15.43:0/3030673422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10b860 0x7fbe6c112090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009ca0 tx=0x7fbe6402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 -- 172.21.15.43:0/3030673422 shutdown_connections 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 --2- 172.21.15.43:0/3030673422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe6c10af10 0x7fbe6c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 --2- 172.21.15.43:0/3030673422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10b860 0x7fbe6c112090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 --2- 172.21.15.43:0/3030673422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c1055d0 0x7fbe6c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 -- 172.21.15.43:0/3030673422 >> 172.21.15.43:0/3030673422 conn(0x7fbe6c101040 msgr2=0x7fbe6c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 -- 172.21.15.43:0/3030673422 shutdown_connections 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.868+0000 7fbe71600640 1 -- 172.21.15.43:0/3030673422 wait complete. 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.869+0000 7fbe71600640 1 Processor -- start 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.869+0000 7fbe71600640 1 -- start start 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe71600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe6c1055d0 0x7fbe6c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe71600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10af10 0x7fbe6c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe71600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 0x7fbe6c1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe71600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c1156b0 con 0x7fbe6c10af10 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe71600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c115530 con 0x7fbe6c10b860 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe71600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c115830 con 0x7fbe6c1055d0 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe6b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10af10 0x7fbe6c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe70c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 0x7fbe6c1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe70c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 0x7fbe6c1a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37678/0 (socket says 172.21.15.43:37678) 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe70c00640 1 -- 172.21.15.43:0/4122651903 learned_addr learned my addr 172.21.15.43:0/4122651903 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe6b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10af10 0x7fbe6c19c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52838/0 (socket says 172.21.15.43:52838) 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.870+0000 7fbe6be00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe6c1055d0 0x7fbe6c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe70c00640 1 -- 172.21.15.43:0/4122651903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe6c1055d0 msgr2=0x7fbe6c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe70c00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe6c1055d0 0x7fbe6c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe70c00640 1 -- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10af10 msgr2=0x7fbe6c19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe70c00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10af10 0x7fbe6c19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe70c00640 1 -- 172.21.15.43:0/4122651903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c1a1f10 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe70c00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 0x7fbe6c1a17e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe64033040 tx=0x7fbe64003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64031650 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe640317f0 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6402f9c0 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.871+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6c1a21a0 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.872+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6c1a8960 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.873+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6c1059e0 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.875+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fbe6402fba0 con 0x7fbe6c10b860 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.876+0000 7fbe68c00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbe500b3c10 0x7fbe500b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.877+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbe641033f0 con 0x7fbe6c10b860 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.877+0000 7fbe6be00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbe500b3c10 0x7fbe500b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.878+0000 7fbe6be00640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbe500b3c10 0x7fbe500b6120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009bd0 tx=0x7fbe5c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:10.881+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbe6402fe90 con 0x7fbe6c10b860 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.090+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbe6c02e0c0 con 0x7fbe6c10b860 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.098+0000 7fbe68c00640 1 -- 172.21.15.43:0/4122651903 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) ==== 138+0+0 (secure 0 0 0) 0x7fbe640cc5a0 con 0x7fbe6c10b860 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbe500b3c10 msgr2=0x7fbe500b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbe500b3c10 0x7fbe500b6120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009bd0 tx=0x7fbe5c005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 msgr2=0x7fbe6c1a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 0x7fbe6c1a17e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe64033040 tx=0x7fbe64003c10 comp rx=0 tx=0).stop 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 shutdown_connections 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbe500b3c10 0x7fbe500b6120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe6c10b860 0x7fbe6c1a17e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe6c10af10 0x7fbe6c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 --2- 172.21.15.43:0/4122651903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe6c1055d0 0x7fbe6c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 >> 172.21.15.43:0/4122651903 conn(0x7fbe6c101040 msgr2=0x7fbe6c108440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 shutdown_connections 2024-07-26T08:20:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:11.102+0000 7fbe71600640 1 -- 172.21.15.43:0/4122651903 wait complete. 2024-07-26T08:20:15.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:15 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:15.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:15 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:16.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:16.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:16.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:16.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:16.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:16.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:16.019 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:15 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 -- 172.21.15.43:0/2035882632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c10fc80 msgr2=0x7ffb8c1164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 --2- 172.21.15.43:0/2035882632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c10fc80 0x7ffb8c1164b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009be0 tx=0x7ffb8402a6c0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 -- 172.21.15.43:0/2035882632 shutdown_connections 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 --2- 172.21.15.43:0/2035882632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c10f330 0x7ffb8c10f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 --2- 172.21.15.43:0/2035882632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c10fc80 0x7ffb8c1164b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 --2- 172.21.15.43:0/2035882632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 -- 172.21.15.43:0/2035882632 >> 172.21.15.43:0/2035882632 conn(0x7ffb8c078ff0 msgr2=0x7ffb8c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.599+0000 7ffb90e00640 1 -- 172.21.15.43:0/2035882632 shutdown_connections 2024-07-26T08:20:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.600+0000 7ffb90e00640 1 -- 172.21.15.43:0/2035882632 wait complete. 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 Processor -- start 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 -- start start 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb8c10f330 0x7ffb8c1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c10fc80 0x7ffb8c1a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c119a60 con 0x7ffb8c10f330 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1198e0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.601+0000 7ffb90e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c119be0 con 0x7ffb8c10fc80 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c1a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37736/0 (socket says 172.21.15.43:37736) 2024-07-26T08:20:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb8c10f330 0x7ffb8c1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 -- 172.21.15.43:0/1652601268 learned_addr learned my addr 172.21.15.43:0/1652601268 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8be00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c10fc80 0x7ffb8c1a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 -- 172.21.15.43:0/1652601268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c10fc80 msgr2=0x7ffb8c1a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c10fc80 0x7ffb8c1a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 -- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb8c10f330 msgr2=0x7ffb8c1a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb8c10f330 0x7ffb8c1a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 -- 172.21.15.43:0/1652601268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c1a62e0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.602+0000 7ffb8b400640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c1a0370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00e9c0 tx=0x7ffb7c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.603+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00ccc0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.603+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb7c0054f0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.603+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c010430 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.603+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c1a65d0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.603+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c1acd30 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.604+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8c109e00 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.606+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7ffb7c0046c0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.608+0000 7ffb83e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb700b3c10 0x7ffb700b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.608+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffb7c0e2410 con 0x7ffb8c1099f0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.608+0000 7ffb8aa00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb700b3c10 0x7ffb700b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:16.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.609+0000 7ffb8aa00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb700b3c10 0x7ffb700b6120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c109050 tx=0x7ffb7800b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.611+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffb7c0aaf70 con 0x7ffb8c1099f0 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.823+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ffb8c1a14a0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.832+0000 7ffb83e00640 1 -- 172.21.15.43:0/1652601268 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v19)=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7ffb7c0af4c0 con 0x7ffb8c1099f0 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb700b3c10 msgr2=0x7ffb700b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb700b3c10 0x7ffb700b6120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c109050 tx=0x7ffb7800b390 comp rx=0 tx=0).stop 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 msgr2=0x7ffb8c1a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c1a0370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00e9c0 tx=0x7ffb7c00ee80 comp rx=0 tx=0).stop 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 shutdown_connections 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb700b3c10 0x7ffb700b6120 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c10fc80 0x7ffb8c1a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb8c10f330 0x7ffb8c1a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 --2- 172.21.15.43:0/1652601268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb8c1099f0 0x7ffb8c1a0370 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 >> 172.21.15.43:0/1652601268 conn(0x7ffb8c078ff0 msgr2=0x7ffb8c10c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:16.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 shutdown_connections 2024-07-26T08:20:16.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.835+0000 7ffb90e00640 1 -- 172.21.15.43:0/1652601268 wait complete. 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 -- 172.21.15.43:0/4171804377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f020010af10 msgr2=0x7f020010b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 --2- 172.21.15.43:0/4171804377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f020010af10 0x7f020010b320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009900 tx=0x7f01e802a400 comp rx=0 tx=0).stop 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 -- 172.21.15.43:0/4171804377 shutdown_connections 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 --2- 172.21.15.43:0/4171804377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f020010b860 0x7f0200112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 --2- 172.21.15.43:0/4171804377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f020010af10 0x7f020010b320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 --2- 172.21.15.43:0/4171804377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02001055d0 0x7f02001059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 -- 172.21.15.43:0/4171804377 >> 172.21.15.43:0/4171804377 conn(0x7f0200101040 msgr2=0x7f0200103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 -- 172.21.15.43:0/4171804377 shutdown_connections 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.068+0000 7f01ff200640 1 -- 172.21.15.43:0/4171804377 wait complete. 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.069+0000 7f01ff200640 1 Processor -- start 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.069+0000 7f01ff200640 1 -- start start 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01ff200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02001055d0 0x7f020019bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01ff200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 0x7f020019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01ff200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f020010b860 0x7f02001a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01ff200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0200115640 con 0x7f02001055d0 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01ff200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f02001154c0 con 0x7f020010af10 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01ff200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f02001157c0 con 0x7f020010b860 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 0x7f020019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01fde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02001055d0 0x7f020019bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 0x7f020019c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37704/0 (socket says 172.21.15.43:37704) 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01f7e00640 1 -- 172.21.15.43:0/2327131475 learned_addr learned my addr 172.21.15.43:0/2327131475 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01fde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02001055d0 0x7f020019bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52852/0 (socket says 172.21.15.43:52852) 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.070+0000 7f01fe800640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f020010b860 0x7f02001a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f7e00640 1 -- 172.21.15.43:0/2327131475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f020010b860 msgr2=0x7f02001a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f7e00640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f020010b860 0x7f02001a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f7e00640 1 -- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02001055d0 msgr2=0x7f020019bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f7e00640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02001055d0 0x7f020019bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f7e00640 1 -- 172.21.15.43:0/2327131475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02001a1f60 con 0x7f020010af10 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f7e00640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 0x7f020019c590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005940 tx=0x7f01e80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e803f030 con 0x7f020010af10 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02001a21f0 con 0x7f020010af10 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01e80318f0 con 0x7f020010af10 2024-07-26T08:20:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8035070 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.071+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001a89b0 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.073+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02001059e0 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.075+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f01e8042030 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.076+0000 7f01f6a00640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01e40b3c90 0x7f01e40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.077+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f01e81026e0 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.077+0000 7f01fde00640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01e40b3c90 0x7f01e40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.077+0000 7f01fde00640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01e40b3c90 0x7f01e40b61a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009bd0 tx=0x7f01f0005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.082+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f01e80cb240 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.295+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f020019d120 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.305+0000 7f01f6a00640 1 -- 172.21.15.43:0/2327131475 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f01e80cf790 con 0x7f020010af10 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01e40b3c90 msgr2=0x7f01e40b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01e40b3c90 0x7f01e40b61a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009bd0 tx=0x7f01f0005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 msgr2=0x7f020019c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 0x7f020019c590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005940 tx=0x7f01e80042f0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 shutdown_connections 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01e40b3c90 0x7f01e40b61a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f020010b860 0x7f02001a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f020010af10 0x7f020019c590 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 --2- 172.21.15.43:0/2327131475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02001055d0 0x7f020019bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 >> 172.21.15.43:0/2327131475 conn(0x7f0200101040 msgr2=0x7f0200103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.308+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 shutdown_connections 2024-07-26T08:20:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:13.309+0000 7f01ff200640 1 -- 172.21.15.43:0/2327131475 wait complete. 2024-07-26T08:20:17.845 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:17 smithi043 ceph-mon[32384]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:17 smithi133 ceph-mon[37053]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:17 smithi063 ceph-mon[36747]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 -- 172.21.15.43:0/3334098722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff630075b30 msgr2=0x7ff63010f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 --2- 172.21.15.43:0/3334098722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff630075b30 0x7ff63010f3e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009860 tx=0x7ff61c02a340 comp rx=0 tx=0).stop 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 -- 172.21.15.43:0/3334098722 shutdown_connections 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 --2- 172.21.15.43:0/3334098722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff63010f920 0x7ff630111d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 --2- 172.21.15.43:0/3334098722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff630075b30 0x7ff63010f3e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 --2- 172.21.15.43:0/3334098722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff6300755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 -- 172.21.15.43:0/3334098722 >> 172.21.15.43:0/3334098722 conn(0x7ff6300fee10 msgr2=0x7ff630101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:19.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.071+0000 7ff636a00640 1 -- 172.21.15.43:0/3334098722 shutdown_connections 2024-07-26T08:20:19.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.072+0000 7ff636a00640 1 -- 172.21.15.43:0/3334098722 wait complete. 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 Processor -- start 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 -- start start 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff63019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff630075b30 0x7ff63019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63010f920 0x7ff6301a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301155f0 con 0x7ff6300751e0 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff630115470 con 0x7ff63010f920 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.073+0000 7ff636a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff630115770 con 0x7ff630075b30 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff63019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff63019bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34546/0 (socket says 172.21.15.43:34546) 2024-07-26T08:20:19.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff634c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff630075b30 0x7ff63019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:19.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 -- 172.21.15.43:0/2146613169 learned_addr learned my addr 172.21.15.43:0/2146613169 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:19.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff636000640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63010f920 0x7ff6301a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:19.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 -- 172.21.15.43:0/2146613169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff630075b30 msgr2=0x7ff63019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff630075b30 0x7ff63019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 -- 172.21.15.43:0/2146613169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63010f920 msgr2=0x7ff6301a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63010f920 0x7ff6301a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 -- 172.21.15.43:0/2146613169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6301a1f10 con 0x7ff6300751e0 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.074+0000 7ff635600640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff63019bfa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff62400e9c0 tx=0x7ff62400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.075+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62400ccc0 con 0x7ff6300751e0 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.075+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff6240054f0 con 0x7ff6300751e0 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.075+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6301a2200 con 0x7ff6300751e0 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.075+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624010430 con 0x7ff6300751e0 2024-07-26T08:20:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.075+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a8960 con 0x7ff6300751e0 2024-07-26T08:20:19.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.077+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6100052c0 con 0x7ff6300751e0 2024-07-26T08:20:19.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.079+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7ff6240046c0 con 0x7ff6300751e0 2024-07-26T08:20:19.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.081+0000 7ff62e000640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6180b3c10 0x7ff6180b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:19.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.081+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff6240e2270 con 0x7ff6300751e0 2024-07-26T08:20:19.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.081+0000 7ff634c00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6180b3c10 0x7ff6180b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.082+0000 7ff634c00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6180b3c10 0x7ff6180b6120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009830 tx=0x7ff61c0056d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.085+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff6240ab420 con 0x7ff6300751e0 2024-07-26T08:20:19.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.279+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7ff6100055b0 con 0x7ff6300751e0 2024-07-26T08:20:19.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.289+0000 7ff62e000640 1 -- 172.21.15.43:0/2146613169 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v23)=0 v23) ==== 117+0+0 (secure 0 0 0) 0x7ff6240aad20 con 0x7ff6300751e0 2024-07-26T08:20:19.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.291+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6180b3c10 msgr2=0x7ff6180b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:19.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.291+0000 7ff636a00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6180b3c10 0x7ff6180b6120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009830 tx=0x7ff61c0056d0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.291+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 msgr2=0x7ff63019bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:19.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.291+0000 7ff636a00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff63019bfa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff62400e9c0 tx=0x7ff62400ee80 comp rx=0 tx=0).stop 2024-07-26T08:20:19.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 shutdown_connections 2024-07-26T08:20:19.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6180b3c10 0x7ff6180b6120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff630075b30 0x7ff63019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63010f920 0x7ff6301a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 --2- 172.21.15.43:0/2146613169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6300751e0 0x7ff63019bfa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:19.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 >> 172.21.15.43:0/2146613169 conn(0x7ff6300fee10 msgr2=0x7ff6301019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:19.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 shutdown_connections 2024-07-26T08:20:19.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:19.292+0000 7ff636a00640 1 -- 172.21.15.43:0/2146613169 wait complete. 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3462932918' entity='client.admin' 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:19 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2146613169' entity='client.admin' 2024-07-26T08:20:20.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3462932918' entity='client.admin' 2024-07-26T08:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:19 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2146613169' entity='client.admin' 2024-07-26T08:20:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3462932918' entity='client.admin' 2024-07-26T08:20:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:19 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2146613169' entity='client.admin' 2024-07-26T08:20:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 -- 172.21.15.43:0/1911023927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c108d20 msgr2=0x7f2c5c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 --2- 172.21.15.43:0/1911023927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c108d20 0x7f2c5c109130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009900 tx=0x7f2c4802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 -- 172.21.15.43:0/1911023927 shutdown_connections 2024-07-26T08:20:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 --2- 172.21.15.43:0/1911023927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 0x7f2c5c10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 --2- 172.21.15.43:0/1911023927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c108d20 0x7f2c5c109130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 --2- 172.21.15.43:0/1911023927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c1033e0 0x7f2c5c1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 -- 172.21.15.43:0/1911023927 >> 172.21.15.43:0/1911023927 conn(0x7f2c5c0fee30 msgr2=0x7f2c5c101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.814+0000 7f2c61400640 1 -- 172.21.15.43:0/1911023927 shutdown_connections 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.815+0000 7f2c61400640 1 -- 172.21.15.43:0/1911023927 wait complete. 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 Processor -- start 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 -- start start 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c1033e0 0x7f2c5c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 0x7f2c5c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 0x7f2c5c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c1134a0 con 0x7f2c5c1033e0 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c113320 con 0x7f2c5c109670 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.816+0000 7f2c61400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c113620 con 0x7f2c5c108d20 2024-07-26T08:20:21.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c5b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 0x7f2c5c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c5b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 0x7f2c5c075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:34676/0 (socket says 172.21.15.43:34676) 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c5b400640 1 -- 172.21.15.43:0/3279635822 learned_addr learned my addr 172.21.15.43:0/3279635822 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c60a00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 0x7f2c5c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c5be00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c1033e0 0x7f2c5c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c60a00640 1 -- 172.21.15.43:0/3279635822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 msgr2=0x7f2c5c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c60a00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 0x7f2c5c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c60a00640 1 -- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c1033e0 msgr2=0x7f2c5c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c60a00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c1033e0 0x7f2c5c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.817+0000 7f2c60a00640 1 -- 172.21.15.43:0/3279635822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c1a80b0 con 0x7f2c5c109670 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c5be00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c1033e0 0x7f2c5c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c5b400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 0x7f2c5c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:21.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c60a00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 0x7f2c5c075bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009fd0 tx=0x7f2c5400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400ce20 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c54005020 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c1a83a0 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c1a88e0 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.818+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54010720 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.820+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c0052c0 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.824+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f2c54004b20 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.825+0000 7f2c58c00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2c400b3c10 0x7f2c400b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.825+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2c540e24b0 con 0x7f2c5c109670 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.825+0000 7f2c5be00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2c400b3c10 0x7f2c400b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.826+0000 7f2c5be00640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2c400b3c10 0x7f2c400b6120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c076b90 tx=0x7f2c4c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:21.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.829+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2c540ab700 con 0x7f2c5c109670 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.069+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2c3c0055b0 con 0x7f2c5c109670 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.076+0000 7f2c58c00640 1 -- 172.21.15.43:0/3279635822 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f2c540ab000 con 0x7f2c5c109670 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2c400b3c10 msgr2=0x7f2c400b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2c400b3c10 0x7f2c400b6120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c076b90 tx=0x7f2c4c005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 msgr2=0x7f2c5c075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 0x7f2c5c075bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009fd0 tx=0x7f2c5400ef10 comp rx=0 tx=0).stop 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 shutdown_connections 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2c400b3c10 0x7f2c400b6120 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c5c108d20 0x7f2c5c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c5c109670 0x7f2c5c075bc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 --2- 172.21.15.43:0/3279635822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5c1033e0 0x7f2c5c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:21.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.078+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 >> 172.21.15.43:0/3279635822 conn(0x7f2c5c0fee30 msgr2=0x7f2c5c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:21.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.079+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 shutdown_connections 2024-07-26T08:20:21.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.079+0000 7f2c61400640 1 -- 172.21.15.43:0/3279635822 wait complete. 2024-07-26T08:20:22.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:21 smithi043 ceph-mon[32384]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:22.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:21 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:21 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:21 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/46284825' entity='client.admin' 2024-07-26T08:20:22.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:21 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:21 smithi133 ceph-mon[37053]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:21 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:21 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:21 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/46284825' entity='client.admin' 2024-07-26T08:20:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:21 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:21 smithi063 ceph-mon[36747]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:22.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:21 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:21 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:21 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/46284825' entity='client.admin' 2024-07-26T08:20:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:21 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 -- 172.21.15.43:0/1530351623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 msgr2=0x7f940c10f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 --2- 172.21.15.43:0/1530351623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c10f740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009860 tx=0x7f93f402a340 comp rx=0 tx=0).stop 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 -- 172.21.15.43:0/1530351623 shutdown_connections 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 --2- 172.21.15.43:0/1530351623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 --2- 172.21.15.43:0/1530351623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c10f740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 --2- 172.21.15.43:0/1530351623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 0x7f940c109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.487+0000 7f9411600640 1 -- 172.21.15.43:0/1530351623 >> 172.21.15.43:0/1530351623 conn(0x7f940c078ff0 msgr2=0x7f940c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.488+0000 7f9411600640 1 -- 172.21.15.43:0/1530351623 shutdown_connections 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.488+0000 7f9411600640 1 -- 172.21.15.43:0/1530351623 wait complete. 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.489+0000 7f9411600640 1 Processor -- start 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.489+0000 7f9411600640 1 -- start start 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9411600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 0x7f940c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9411600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9411600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9411600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f940c119a60 con 0x7f940c10fc80 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9411600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f940c1198e0 con 0x7f940c10f330 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9411600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f940c119be0 con 0x7f940c1099f0 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9410c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9410c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34528/0 (socket says 172.21.15.43:34528) 2024-07-26T08:20:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f9410c00640 1 -- 172.21.15.43:0/3462932918 learned_addr learned my addr 172.21.15.43:0/3462932918 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f940be00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 0x7f940c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.490+0000 7f940b400640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9410c00640 1 -- 172.21.15.43:0/3462932918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 msgr2=0x7f940c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9410c00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 0x7f940c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9410c00640 1 -- 172.21.15.43:0/3462932918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 msgr2=0x7f940c1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9410c00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9410c00640 1 -- 172.21.15.43:0/3462932918 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c1a6380 con 0x7f940c10fc80 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f940be00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 0x7f940c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f940b400640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9410c00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1a5c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9404009fd0 tx=0x7f940400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9404004b20 con 0x7f940c10fc80 2024-07-26T08:20:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9404003e40 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c1a6670 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.491+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940400b630 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.492+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c1acdd0 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.493+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c109e00 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.495+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f940401d020 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.497+0000 7f9408c00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f93f00b3c10 0x7f93f00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.497+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f94040e2a70 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.497+0000 7f940be00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f93f00b3c10 0x7f93f00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.498+0000 7f940be00640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f93f00b3c10 0x7f93f00b6120 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009fc0 tx=0x7f93fc005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.499+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9404024030 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.706+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f940c1a1540 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.712+0000 7f9408c00640 1 -- 172.21.15.43:0/3462932918 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7f940c1a1540 con 0x7f940c10fc80 2024-07-26T08:20:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f93f00b3c10 msgr2=0x7f93f00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f93f00b3c10 0x7f93f00b6120 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009fc0 tx=0x7f93fc005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 msgr2=0x7f940c1a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1a5c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9404009fd0 tx=0x7f940400c800 comp rx=0 tx=0).stop 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 shutdown_connections 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f93f00b3c10 0x7f93f00b6120 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f940c10fc80 0x7f940c1a5c50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f940c10f330 0x7f940c1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 --2- 172.21.15.43:0/3462932918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f940c1099f0 0x7f940c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.715+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 >> 172.21.15.43:0/3462932918 conn(0x7f940c078ff0 msgr2=0x7f940c10b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.716+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 shutdown_connections 2024-07-26T08:20:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:18.716+0000 7f9411600640 1 -- 172.21.15.43:0/3462932918 wait complete. 2024-07-26T08:20:22.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.838+0000 7f628a000640 1 -- 172.21.15.43:0/1131171921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 msgr2=0x7f62841120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.838+0000 7f628a000640 1 --2- 172.21.15.43:0/1131171921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841120b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f627c009ca0 tx=0x7f627c02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 -- 172.21.15.43:0/1131171921 shutdown_connections 2024-07-26T08:20:22.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 --2- 172.21.15.43:0/1131171921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f628410af30 0x7f628410b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 --2- 172.21.15.43:0/1131171921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841120b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 --2- 172.21.15.43:0/1131171921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f6284105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 -- 172.21.15.43:0/1131171921 >> 172.21.15.43:0/1131171921 conn(0x7f6284101060 msgr2=0x7f62841034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 -- 172.21.15.43:0/1131171921 shutdown_connections 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.839+0000 7f628a000640 1 -- 172.21.15.43:0/1131171921 wait complete. 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.840+0000 7f628a000640 1 Processor -- start 2024-07-26T08:20:22.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 -- start start 2024-07-26T08:20:22.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f628419bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f628410af30 0x7f628419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6284115680 con 0x7f628410b880 2024-07-26T08:20:22.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6284115500 con 0x7f62841055f0 2024-07-26T08:20:22.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f628a000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6284115800 con 0x7f628410af30 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f6289600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f6288c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f628419bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f6288c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f628419bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39394/0 (socket says 172.21.15.43:39394) 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.841+0000 7f6288c00640 1 -- 172.21.15.43:0/2677278949 learned_addr learned my addr 172.21.15.43:0/2677278949 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6283e00640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f628410af30 0x7f628419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6288c00640 1 -- 172.21.15.43:0/2677278949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f628410af30 msgr2=0x7f628419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6288c00640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f628410af30 0x7f628419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6288c00640 1 -- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 msgr2=0x7f62841a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6288c00640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6288c00640 1 -- 172.21.15.43:0/2677278949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62841a1f40 con 0x7f62841055f0 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6289600640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.842+0000 7f6288c00640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f628419bfd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f627800d950 tx=0x7f627800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.843+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278017030 con 0x7f62841055f0 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.843+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6278004020 con 0x7f62841055f0 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.843+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780047a0 con 0x7f62841055f0 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.843+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62841a2230 con 0x7f62841055f0 2024-07-26T08:20:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.843+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62841a8990 con 0x7f62841055f0 2024-07-26T08:20:22.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.844+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6284105a00 con 0x7f62841055f0 2024-07-26T08:20:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.846+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f62780041d0 con 0x7f62841055f0 2024-07-26T08:20:22.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.848+0000 7f6281600640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f626c0b3c90 0x7f626c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:22.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.848+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f62780e1cd0 con 0x7f62841055f0 2024-07-26T08:20:22.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.848+0000 7f6283e00640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f626c0b3c90 0x7f626c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.849+0000 7f6283e00640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f626c0b3c90 0x7f626c0b61a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f62841047f0 tx=0x7f627000b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:22.850+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f62780aaf00 con 0x7f62841055f0 2024-07-26T08:20:23.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.060+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f628402e0c0 con 0x7f62841055f0 2024-07-26T08:20:23.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.071+0000 7f6281600640 1 -- 172.21.15.43:0/2677278949 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v28)=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f62780aa800 con 0x7f62841055f0 2024-07-26T08:20:23.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f626c0b3c90 msgr2=0x7f626c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f626c0b3c90 0x7f626c0b61a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f62841047f0 tx=0x7f627000b390 comp rx=0 tx=0).stop 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 msgr2=0x7f628419bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f628419bfd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f627800d950 tx=0x7f627800de10 comp rx=0 tx=0).stop 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 shutdown_connections 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f626c0b3c90 0x7f626c0b61a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f628410af30 0x7f628419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628410b880 0x7f62841a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 --2- 172.21.15.43:0/2677278949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62841055f0 0x7f628419bfd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.074+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 >> 172.21.15.43:0/2677278949 conn(0x7f6284101060 msgr2=0x7f628410a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:23.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.075+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 shutdown_connections 2024-07-26T08:20:23.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:23.075+0000 7f628a000640 1 -- 172.21.15.43:0/2677278949 wait complete. 2024-07-26T08:20:23.479 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:20:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 -- 172.21.15.43:0/2472352770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 msgr2=0x7ffb9c1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 --2- 172.21.15.43:0/2472352770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1023f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009900 tx=0x7ffb8c02a410 comp rx=0 tx=0).stop 2024-07-26T08:20:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 -- 172.21.15.43:0/2472352770 shutdown_connections 2024-07-26T08:20:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 --2- 172.21.15.43:0/2472352770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c107420 0x7ffb9c107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 --2- 172.21.15.43:0/2472352770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c102930 0x7ffb9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 --2- 172.21.15.43:0/2472352770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1023f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 -- 172.21.15.43:0/2472352770 >> 172.21.15.43:0/2472352770 conn(0x7ffb9c0fdcf0 msgr2=0x7ffb9c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 -- 172.21.15.43:0/2472352770 shutdown_connections 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.911+0000 7ffb9b200640 1 -- 172.21.15.43:0/2472352770 wait complete. 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.912+0000 7ffb9b200640 1 Processor -- start 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.912+0000 7ffb9b200640 1 -- start start 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 0x7ffb9c1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c107420 0x7ffb9c1a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c119a00 con 0x7ffb9c102930 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c119880 con 0x7ffb9c107420 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c119b80 con 0x7ffb9c101fe0 2024-07-26T08:20:23.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb99400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 0x7ffb9c1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:34686/0 (socket says 172.21.15.43:34686) 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb99e00640 1 -- 172.21.15.43:0/46284825 learned_addr learned my addr 172.21.15.43:0/46284825 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb99400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 0x7ffb9c1a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34602/0 (socket says 172.21.15.43:34602) 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.913+0000 7ffb9a800640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c107420 0x7ffb9c1a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb99400640 1 -- 172.21.15.43:0/46284825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 msgr2=0x7ffb9c1a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb99400640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb99400640 1 -- 172.21.15.43:0/46284825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c107420 msgr2=0x7ffb9c1a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb99400640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c107420 0x7ffb9c1a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb99400640 1 -- 172.21.15.43:0/46284825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c1a6340 con 0x7ffb9c102930 2024-07-26T08:20:23.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb99400640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 0x7ffb9c1a0970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c06a4c0 tx=0x7ffb8800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.914+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800cc40 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.915+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb8800cde0 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.915+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88018810 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.915+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9c1a6630 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.915+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb9c1acd90 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.916+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb9c106e60 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.920+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7ffb88010b40 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.923+0000 7ffb92a00640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb800b3c10 0x7ffb800b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.923+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffb880e2810 con 0x7ffb9c102930 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.923+0000 7ffb99e00640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb800b3c10 0x7ffb800b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:23.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.924+0000 7ffb99e00640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb800b3c10 0x7ffb800b6120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0096c0 tx=0x7ffb8c005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.927+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffb880ab370 con 0x7ffb9c102930 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.159+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ffb9c1a1500 con 0x7ffb9c102930 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.164+0000 7ffb92a00640 1 -- 172.21.15.43:0/46284825 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7ffb9c1a1500 con 0x7ffb9c102930 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb800b3c10 msgr2=0x7ffb800b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb800b3c10 0x7ffb800b6120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0096c0 tx=0x7ffb8c005a20 comp rx=0 tx=0).stop 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 msgr2=0x7ffb9c1a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 0x7ffb9c1a0970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c06a4c0 tx=0x7ffb8800ee50 comp rx=0 tx=0).stop 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 shutdown_connections 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffb800b3c10 0x7ffb800b6120 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c107420 0x7ffb9c1a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c102930 0x7ffb9c1a0970 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 --2- 172.21.15.43:0/46284825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9c101fe0 0x7ffb9c1a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:23.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.168+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 >> 172.21.15.43:0/46284825 conn(0x7ffb9c0fdcf0 msgr2=0x7ffb9c104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:23.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.169+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 shutdown_connections 2024-07-26T08:20:23.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.169+0000 7ffb9b200640 1 -- 172.21.15.43:0/46284825 wait complete. 2024-07-26T08:20:24.322 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:24 smithi043 ceph-mon[32384]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:24.322 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:24 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:24 smithi133 ceph-mon[37053]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:24 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:24.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.536+0000 7f49c3e00640 1 -- 172.21.15.43:0/3692019077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c41055f0 msgr2=0x7f49c4105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.536+0000 7f49c3e00640 1 --2- 172.21.15.43:0/3692019077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c41055f0 0x7f49c4105a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ca0 tx=0x7f49b402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 -- 172.21.15.43:0/3692019077 shutdown_connections 2024-07-26T08:20:24.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 --2- 172.21.15.43:0/3692019077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c410b880 0x7f49c41120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 --2- 172.21.15.43:0/3692019077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c410b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 --2- 172.21.15.43:0/3692019077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c41055f0 0x7f49c4105a00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 -- 172.21.15.43:0/3692019077 >> 172.21.15.43:0/3692019077 conn(0x7f49c4101040 msgr2=0x7f49c4103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:24.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 -- 172.21.15.43:0/3692019077 shutdown_connections 2024-07-26T08:20:24.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.537+0000 7f49c3e00640 1 -- 172.21.15.43:0/3692019077 wait complete. 2024-07-26T08:20:24.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.538+0000 7f49c3e00640 1 Processor -- start 2024-07-26T08:20:24.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.538+0000 7f49c3e00640 1 -- start start 2024-07-26T08:20:24.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c41055f0 0x7f49c419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c410b880 0x7f49c41a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f49c41156d0 con 0x7f49c410af30 2024-07-26T08:20:24.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f49c4115550 con 0x7f49c41055f0 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f49c4115850 con 0x7f49c410b880 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c41055f0 0x7f49c419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49ba000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c41055f0 0x7f49c419c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39418/0 (socket says 172.21.15.43:39418) 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49ba000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c419c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34648/0 (socket says 172.21.15.43:34648) 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c2a00640 1 -- 172.21.15.43:0/4160871839 learned_addr learned my addr 172.21.15.43:0/4160871839 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:24.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.539+0000 7f49c3400640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c410b880 0x7f49c41a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3400640 1 -- 172.21.15.43:0/4160871839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c41055f0 msgr2=0x7f49c419c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3400640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c41055f0 0x7f49c419c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3400640 1 -- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 msgr2=0x7f49c419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3400640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c419c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3400640 1 -- 172.21.15.43:0/4160871839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c41a1f90 con 0x7f49c410b880 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49ba000640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3400640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c410b880 0x7f49c41a1860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00e970 tx=0x7f49bc00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:24.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00ccc0 con 0x7f49c410b880 2024-07-26T08:20:24.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c41a2280 con 0x7f49c410b880 2024-07-26T08:20:24.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49bc005020 con 0x7f49c410b880 2024-07-26T08:20:24.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc004a00 con 0x7f49c410b880 2024-07-26T08:20:24.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.540+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c41a89e0 con 0x7f49c410b880 2024-07-26T08:20:24.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.542+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c4105a00 con 0x7f49c410b880 2024-07-26T08:20:24.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.544+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f49bc0051d0 con 0x7f49c410b880 2024-07-26T08:20:24.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.546+0000 7f49bbe00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f49a80b3c10 0x7f49a80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.546+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f49bc0e2030 con 0x7f49c410b880 2024-07-26T08:20:24.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.546+0000 7f49c2a00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f49a80b3c10 0x7f49a80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.547+0000 7f49c2a00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f49a80b3c10 0x7f49a80b6120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009a60 tx=0x7f49b4005d80 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:24.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.550+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f49bc0ab1e0 con 0x7f49c410b880 2024-07-26T08:20:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:24 smithi063 ceph-mon[36747]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:24 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:24.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 -- 172.21.15.43:0/1361475787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f676410f9c0 msgr2=0x7f6764111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 --2- 172.21.15.43:0/1361475787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f676410f9c0 0x7f6764111de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f675c009ca0 tx=0x7f675c02a950 comp rx=0 tx=0).stop 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 -- 172.21.15.43:0/1361475787 shutdown_connections 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 --2- 172.21.15.43:0/1361475787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f676410f9c0 0x7f6764111de0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 --2- 172.21.15.43:0/1361475787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6764102760 0x7f676410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 --2- 172.21.15.43:0/1361475787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6764101e10 0x7f6764102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 -- 172.21.15.43:0/1361475787 >> 172.21.15.43:0/1361475787 conn(0x7f67640fdcf0 msgr2=0x7f6764100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 -- 172.21.15.43:0/1361475787 shutdown_connections 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.709+0000 7f676a400640 1 -- 172.21.15.43:0/1361475787 wait complete. 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.711+0000 7f676a400640 1 Processor -- start 2024-07-26T08:20:24.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 -- start start 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 0x7f676419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6764102760 0x7f676419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676410f9c0 0x7f67641a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67641155d0 con 0x7f676410f9c0 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6764115450 con 0x7f6764102760 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.712+0000 7f676a400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6764115750 con 0x7f6764101e10 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 0x7f676419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 0x7f676419bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:34656/0 (socket says 172.21.15.43:34656) 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 -- 172.21.15.43:0/875387727 learned_addr learned my addr 172.21.15.43:0/875387727 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6763e00640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6764102760 0x7f676419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769a00640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676410f9c0 0x7f67641a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 -- 172.21.15.43:0/875387727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6764102760 msgr2=0x7f676419c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6764102760 0x7f676419c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 -- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676410f9c0 msgr2=0x7f67641a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676410f9c0 0x7f67641a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.713+0000 7f6769000640 1 -- 172.21.15.43:0/875387727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67641a1e70 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.714+0000 7f6769000640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 0x7f676419bf00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f675800e9f0 tx=0x7f675800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.716+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675800cd80 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.716+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6758010900 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.716+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67641a2160 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.716+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758018920 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.716+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67641a88c0 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.718+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6764102220 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.722+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f6758018bc0 con 0x7f6764101e10 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.724+0000 7f6761600640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f674c0b3c10 0x7f674c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.725+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f67580e23f0 con 0x7f6764101e10 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.725+0000 7f6763e00640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f674c0b3c10 0x7f674c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.726+0000 7f6763e00640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f674c0b3c10 0x7f674c0b6120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6764110df0 tx=0x7f6750005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.727+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f67580ab640 con 0x7f6764101e10 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.968+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f67641a8b20 con 0x7f6764101e10 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.977+0000 7f6761600640 1 -- 172.21.15.43:0/875387727 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f67580aaf40 con 0x7f6764101e10 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f674c0b3c10 msgr2=0x7f674c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f674c0b3c10 0x7f674c0b6120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6764110df0 tx=0x7f6750005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 msgr2=0x7f676419bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 0x7f676419bf00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f675800e9f0 tx=0x7f675800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 shutdown_connections 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f674c0b3c10 0x7f674c0b6120 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676410f9c0 0x7f67641a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6764102760 0x7f676419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 --2- 172.21.15.43:0/875387727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6764101e10 0x7f676419bf00 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f675800e9f0 tx=0x7f675800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.980+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 >> 172.21.15.43:0/875387727 conn(0x7f67640fdcf0 msgr2=0x7f67641094d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:24.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.981+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 shutdown_connections 2024-07-26T08:20:24.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:20.981+0000 7f676a400640 1 -- 172.21.15.43:0/875387727 wait complete. 2024-07-26T08:20:24.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.758+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f49c419d150 con 0x7f49c410b880 2024-07-26T08:20:24.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.768+0000 7f49bbe00640 1 -- 172.21.15.43:0/4160871839 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v29)=0 v29) ==== 125+0+0 (secure 0 0 0) 0x7f49bc0aaae0 con 0x7f49c410b880 2024-07-26T08:20:24.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f49a80b3c10 msgr2=0x7f49a80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f49a80b3c10 0x7f49a80b6120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009a60 tx=0x7f49b4005d80 comp rx=0 tx=0).stop 2024-07-26T08:20:24.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c410b880 msgr2=0x7f49c41a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c410b880 0x7f49c41a1860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00e970 tx=0x7f49bc00ee30 comp rx=0 tx=0).stop 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 shutdown_connections 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f49a80b3c10 0x7f49a80b6120 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c410b880 0x7f49c41a1860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c410af30 0x7f49c419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 --2- 172.21.15.43:0/4160871839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49c41055f0 0x7f49c419c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 >> 172.21.15.43:0/4160871839 conn(0x7f49c4101040 msgr2=0x7f49c410a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:24.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 shutdown_connections 2024-07-26T08:20:24.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:24.772+0000 7f49c3e00640 1 -- 172.21.15.43:0/4160871839 wait complete. 2024-07-26T08:20:25.897 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:25 smithi043 ceph-mon[32384]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:25.897 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:25 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:26.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:25 smithi063 ceph-mon[36747]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:26.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:25 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:25 smithi133 ceph-mon[37053]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:25 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:26.742 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi043') 2024-07-26T08:20:26.742 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi043') 2024-07-26T08:20:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 -- 172.21.15.43:0/2882907889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c076db0 msgr2=0x7fa08c0751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 --2- 172.21.15.43:0/2882907889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c076db0 0x7fa08c0751e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009860 tx=0x7fa07c02a340 comp rx=0 tx=0).stop 2024-07-26T08:20:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 -- 172.21.15.43:0/2882907889 shutdown_connections 2024-07-26T08:20:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 --2- 172.21.15.43:0/2882907889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa08c075800 0x7fa08c075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 --2- 172.21.15.43:0/2882907889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c113cb0 0x7fa08c116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 --2- 172.21.15.43:0/2882907889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c076db0 0x7fa08c0751e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 -- 172.21.15.43:0/2882907889 >> 172.21.15.43:0/2882907889 conn(0x7fa08c0fee70 msgr2=0x7fa08c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 -- 172.21.15.43:0/2882907889 shutdown_connections 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.412+0000 7fa08b200640 1 -- 172.21.15.43:0/2882907889 wait complete. 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.413+0000 7fa08b200640 1 Processor -- start 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.413+0000 7fa08b200640 1 -- start start 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c075800 0x7fa08c1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c076db0 0x7fa08c1a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa08c113cb0 0x7fa08c1a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c119a30 con 0x7fa08c076db0 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1198b0 con 0x7fa08c075800 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c119bb0 con 0x7fa08c113cb0 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa083e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c076db0 0x7fa08c1a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa089e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c075800 0x7fa08c1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa083e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c076db0 0x7fa08c1a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34616/0 (socket says 172.21.15.43:34616) 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa083e00640 1 -- 172.21.15.43:0/2884224604 learned_addr learned my addr 172.21.15.43:0/2884224604 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.414+0000 7fa08a800640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa08c113cb0 0x7fa08c1a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa089e00640 1 -- 172.21.15.43:0/2884224604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa08c113cb0 msgr2=0x7fa08c1a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa089e00640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa08c113cb0 0x7fa08c1a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa089e00640 1 -- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c076db0 msgr2=0x7fa08c1a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa089e00640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c076db0 0x7fa08c1a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa089e00640 1 -- 172.21.15.43:0/2884224604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c1a6390 con 0x7fa08c075800 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa089e00640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c075800 0x7fa08c1a0420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa07c02a860 tx=0x7fa07c02aeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c037040 con 0x7fa08c075800 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa07c033bd0 con 0x7fa08c075800 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c1a6620 con 0x7fa08c075800 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.415+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c003850 con 0x7fa08c075800 2024-07-26T08:20:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.416+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c1acde0 con 0x7fa08c075800 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.417+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c075c10 con 0x7fa08c075800 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.420+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fa07c042020 con 0x7fa08c075800 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.422+0000 7fa082a00640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa0700b3c10 0x7fa0700b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.422+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa07c1010d0 con 0x7fa08c075800 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.422+0000 7fa083e00640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa0700b3c10 0x7fa0700b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.423+0000 7fa083e00640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa0700b3c10 0x7fa0700b6120 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa08c115b50 tx=0x7fa074005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.426+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa07c0ca280 con 0x7fa08c075800 2024-07-26T08:20:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.640+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa08c1a1550 con 0x7fa08c075800 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.648+0000 7fa082a00640 1 -- 172.21.15.43:0/2884224604 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7fa07c0c9b80 con 0x7fa08c075800 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.650+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa0700b3c10 msgr2=0x7fa0700b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa0700b3c10 0x7fa0700b6120 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa08c115b50 tx=0x7fa074005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c075800 msgr2=0x7fa08c1a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c075800 0x7fa08c1a0420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa07c02a860 tx=0x7fa07c02aeb0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 shutdown_connections 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa0700b3c10 0x7fa0700b6120 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa08c113cb0 0x7fa08c1a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa08c076db0 0x7fa08c1a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 --2- 172.21.15.43:0/2884224604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa08c075800 0x7fa08c1a0420 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 >> 172.21.15.43:0/2884224604 conn(0x7fa08c0fee70 msgr2=0x7fa08c10fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 shutdown_connections 2024-07-26T08:20:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:21.651+0000 7fa08b200640 1 -- 172.21.15.43:0/2884224604 wait complete. 2024-07-26T08:20:27.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 -- 172.21.15.43:0/4200362455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104080 msgr2=0x7feac8104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:27.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 --2- 172.21.15.43:0/4200362455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104080 0x7feac8104490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feabc009900 tx=0x7feabc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 -- 172.21.15.43:0/4200362455 shutdown_connections 2024-07-26T08:20:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 --2- 172.21.15.43:0/4200362455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac8104ab0 0x7feac810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 --2- 172.21.15.43:0/4200362455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 0x7feac810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 --2- 172.21.15.43:0/4200362455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104080 0x7feac8104490 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 -- 172.21.15.43:0/4200362455 >> 172.21.15.43:0/4200362455 conn(0x7feac80fdcf0 msgr2=0x7feac8100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.715+0000 7feacea00640 1 -- 172.21.15.43:0/4200362455 shutdown_connections 2024-07-26T08:20:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.716+0000 7feacea00640 1 -- 172.21.15.43:0/4200362455 wait complete. 2024-07-26T08:20:27.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.718+0000 7feacea00640 1 Processor -- start 2024-07-26T08:20:27.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.718+0000 7feacea00640 1 -- start start 2024-07-26T08:20:27.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac8104080 0x7feac819c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:27.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 0x7feac819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:27.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 0x7feac81a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:27.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feac8113410 con 0x7feac8104ab0 2024-07-26T08:20:27.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacea00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feac8113290 con 0x7feac810d630 2024-07-26T08:20:27.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7feac8113590 con 0x7feac8104080 2024-07-26T08:20:27.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feaccc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 0x7feac819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:27.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feaccc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 0x7feac819c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51698/0 (socket says 172.21.15.43:51698) 2024-07-26T08:20:27.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feaccc00640 1 -- 172.21.15.43:0/1792155027 learned_addr learned my addr 172.21.15.43:0/1792155027 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:27.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feacd600640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac8104080 0x7feac819c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:27.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feace000640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 0x7feac81a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:27.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.719+0000 7feaccc00640 1 -- 172.21.15.43:0/1792155027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac8104080 msgr2=0x7feac819c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:27.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feaccc00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac8104080 0x7feac819c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feaccc00640 1 -- 172.21.15.43:0/1792155027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 msgr2=0x7feac81a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:27.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feaccc00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 0x7feac81a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feaccc00640 1 -- 172.21.15.43:0/1792155027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac81a1f90 con 0x7feac8104ab0 2024-07-26T08:20:27.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feace000640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 0x7feac81a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:27.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feaccc00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 0x7feac819c5c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feab400e9c0 tx=0x7feab400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:27.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab400ccc0 con 0x7feac8104ab0 2024-07-26T08:20:27.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feab40054f0 con 0x7feac8104ab0 2024-07-26T08:20:27.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4010430 con 0x7feac8104ab0 2024-07-26T08:20:27.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac81a2280 con 0x7feac8104ab0 2024-07-26T08:20:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.720+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac81a89e0 con 0x7feac8104ab0 2024-07-26T08:20:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.722+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac8104490 con 0x7feac8104ab0 2024-07-26T08:20:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.725+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7feab40046c0 con 0x7feac8104ab0 2024-07-26T08:20:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.726+0000 7feac6000640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7feab00b3b90 0x7feab00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.726+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feab40e25b0 con 0x7feac8104ab0 2024-07-26T08:20:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.727+0000 7feacd600640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7feab00b3b90 0x7feab00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.727+0000 7feacd600640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7feab00b3b90 0x7feab00b60a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feabc009230 tx=0x7feabc0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.728+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7feab4055600 con 0x7feac8104ab0 2024-07-26T08:20:27.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.942+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7feac819d150 con 0x7feac8104ab0 2024-07-26T08:20:27.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.948+0000 7feac6000640 1 -- 172.21.15.43:0/1792155027 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v30)=0 v30) ==== 127+0+0 (secure 0 0 0) 0x7feac819d150 con 0x7feac8104ab0 2024-07-26T08:20:27.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7feab00b3b90 msgr2=0x7feab00b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:27.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7feab00b3b90 0x7feab00b60a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feabc009230 tx=0x7feabc0058d0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 msgr2=0x7feac819c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 0x7feac819c5c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feab400e9c0 tx=0x7feab400edc0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 shutdown_connections 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7feab00b3b90 0x7feab00b60a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac810d630 0x7feac81a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feac8104ab0 0x7feac819c5c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 --2- 172.21.15.43:0/1792155027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac8104080 0x7feac819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:27.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.952+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 >> 172.21.15.43:0/1792155027 conn(0x7feac80fdcf0 msgr2=0x7feac8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:27.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.953+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 shutdown_connections 2024-07-26T08:20:27.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:27.953+0000 7feacea00640 1 -- 172.21.15.43:0/1792155027 wait complete. 2024-07-26T08:20:28.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:27 smithi043 ceph-mon[32384]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:27 smithi063 ceph-mon[36747]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:27 smithi133 ceph-mon[37053]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:28.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:28 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1792155027' entity='client.admin' 2024-07-26T08:20:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:28 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1792155027' entity='client.admin' 2024-07-26T08:20:29.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:28 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1792155027' entity='client.admin' 2024-07-26T08:20:30.182 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:29 smithi043 ceph-mon[32384]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:30.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:29 smithi133 ceph-mon[37053]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:30.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:29 smithi063 ceph-mon[36747]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:31.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 -- 172.21.15.43:0/4145113829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f00108d20 msgr2=0x7f0f00109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:31.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 --2- 172.21.15.43:0/4145113829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f00108d20 0x7f0f00109130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009900 tx=0x7f0ee802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 -- 172.21.15.43:0/4145113829 shutdown_connections 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 --2- 172.21.15.43:0/4145113829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 0x7f0f0010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 --2- 172.21.15.43:0/4145113829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f00108d20 0x7f0f00109130 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 --2- 172.21.15.43:0/4145113829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f001033e0 0x7f0f001037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 -- 172.21.15.43:0/4145113829 >> 172.21.15.43:0/4145113829 conn(0x7f0f000fee70 msgr2=0x7f0f001012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 -- 172.21.15.43:0/4145113829 shutdown_connections 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.895+0000 7f0eff200640 1 -- 172.21.15.43:0/4145113829 wait complete. 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.896+0000 7f0eff200640 1 Processor -- start 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.896+0000 7f0eff200640 1 -- start start 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0eff200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f001033e0 0x7f0f0019c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:31.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0eff200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f00108d20 0x7f0f0019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0eff200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 0x7f0f001a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0eff200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00113450 con 0x7f0f00108d20 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0eff200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001132d0 con 0x7f0f001033e0 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0eff200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001135d0 con 0x7f0f00109670 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0efd400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f00108d20 0x7f0f0019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0efd400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f00108d20 0x7f0f0019c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51720/0 (socket says 172.21.15.43:51720) 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0efd400640 1 -- 172.21.15.43:0/64031311 learned_addr learned my addr 172.21.15.43:0/64031311 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0efe800640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 0x7f0f001a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.897+0000 7f0efde00640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f001033e0 0x7f0f0019c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efe800640 1 -- 172.21.15.43:0/64031311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f001033e0 msgr2=0x7f0f0019c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:31.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efe800640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f001033e0 0x7f0f0019c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efe800640 1 -- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f00108d20 msgr2=0x7f0f0019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efe800640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f00108d20 0x7f0f0019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efe800640 1 -- 172.21.15.43:0/64031311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f001a1f90 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efde00640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f001033e0 0x7f0f0019c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0efe800640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 0x7f0f001a1860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009fd0 tx=0x7f0ef800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800ce20 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ef8005020 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.898+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8010720 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.899+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f001a2280 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.899+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001a89e0 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.900+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f001037f0 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.902+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f0ef8005560 con 0x7f0f00109670 2024-07-26T08:20:31.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.904+0000 7f0ef6a00640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ee40b3c10 0x7f0ee40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.904+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0ef80e2610 con 0x7f0f00109670 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.904+0000 7f0efde00640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ee40b3c10 0x7f0ee40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.905+0000 7f0efde00640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ee40b3c10 0x7f0ee40b6120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009fc0 tx=0x7f0ef0005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:30.905+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0ef80ab860 con 0x7f0f00109670 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.112+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f0f0019d150 con 0x7f0f00109670 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.120+0000 7f0ef6a00640 1 -- 172.21.15.43:0/64031311 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v31)=0 v31) ==== 119+0+0 (secure 0 0 0) 0x7f0f0019d150 con 0x7f0f00109670 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ee40b3c10 msgr2=0x7f0ee40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ee40b3c10 0x7f0ee40b6120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009fc0 tx=0x7f0ef0005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 msgr2=0x7f0f001a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 0x7f0f001a1860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009fd0 tx=0x7f0ef800ef10 comp rx=0 tx=0).stop 2024-07-26T08:20:31.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 shutdown_connections 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ee40b3c10 0x7f0ee40b6120 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f00109670 0x7f0f001a1860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f00108d20 0x7f0f0019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 --2- 172.21.15.43:0/64031311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f001033e0 0x7f0f0019c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.123+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 >> 172.21.15.43:0/64031311 conn(0x7f0f000fee70 msgr2=0x7f0f0010e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.124+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 shutdown_connections 2024-07-26T08:20:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.124+0000 7f0eff200640 1 -- 172.21.15.43:0/64031311 wait complete. 2024-07-26T08:20:32.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:32 smithi043 ceph-mon[32384]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:32.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:32 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:32.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:32 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:32 smithi133 ceph-mon[37053]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:32 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:32 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:32 smithi063 ceph-mon[36747]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:32 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:32 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.965+0000 7f4cd2200640 1 -- 172.21.15.43:0/1290973124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc1033e0 msgr2=0x7f4ccc1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.965+0000 7f4cd2200640 1 --2- 172.21.15.43:0/1290973124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc1037f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009900 tx=0x7f4cc002a410 comp rx=0 tx=0).stop 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 -- 172.21.15.43:0/1290973124 shutdown_connections 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 --2- 172.21.15.43:0/1290973124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc108d20 0x7f4ccc109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 --2- 172.21.15.43:0/1290973124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ccc109670 0x7f4ccc10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 --2- 172.21.15.43:0/1290973124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc1037f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 -- 172.21.15.43:0/1290973124 >> 172.21.15.43:0/1290973124 conn(0x7f4ccc0fee70 msgr2=0x7f4ccc1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 -- 172.21.15.43:0/1290973124 shutdown_connections 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.966+0000 7f4cd2200640 1 -- 172.21.15.43:0/1290973124 wait complete. 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.967+0000 7f4cd2200640 1 Processor -- start 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.967+0000 7f4cd2200640 1 -- start start 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.967+0000 7f4cd2200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 0x7f4ccc19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ccc109670 0x7f4ccc1a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc113450 con 0x7f4ccc108d20 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd2200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc1132d0 con 0x7f4ccc109670 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd2200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc1135d0 con 0x7f4ccc1033e0 2024-07-26T08:20:33.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 0x7f4ccc19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd0e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 0x7f4ccc19c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51752/0 (socket says 172.21.15.43:51752) 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4ccbe00640 1 -- 172.21.15.43:0/4280987261 learned_addr learned my addr 172.21.15.43:0/4280987261 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd1800640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ccc109670 0x7f4ccc1a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd0e00640 1 -- 172.21.15.43:0/4280987261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ccc109670 msgr2=0x7f4ccc1a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd0e00640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ccc109670 0x7f4ccc1a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd0e00640 1 -- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 msgr2=0x7f4ccc19c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd0e00640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 0x7f4ccc19c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4cd0e00640 1 -- 172.21.15.43:0/4280987261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc1a1ff0 con 0x7f4ccc1033e0 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.968+0000 7f4ccbe00640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 0x7f4ccc19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.969+0000 7f4cd0e00640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc19c080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0005940 tx=0x7f4cc0004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.969+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc003f030 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.969+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc1a2280 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.969+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4cc0004440 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.969+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0035070 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.969+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc1a8a40 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.970+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc1037f0 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.973+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f4cc0042030 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.974+0000 7f4cc9600640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4cb40b3b90 0x7f4cb40b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.974+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4cc0102560 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.975+0000 7f4ccbe00640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4cb40b3b90 0x7f4cb40b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.975+0000 7f4ccbe00640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4cb40b3b90 0x7f4cb40b60a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc107700 tx=0x7f4cb8005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.976+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f4cc00cb710 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.200+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f4ccc19d1b0 con 0x7f4ccc1033e0 2024-07-26T08:20:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.206+0000 7f4cc9600640 1 -- 172.21.15.43:0/4280987261 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f4cc00cb010 con 0x7f4ccc1033e0 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4cb40b3b90 msgr2=0x7f4cb40b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4cb40b3b90 0x7f4cb40b60a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc107700 tx=0x7f4cb8005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc1033e0 msgr2=0x7f4ccc19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc19c080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0005940 tx=0x7f4cc0004040 comp rx=0 tx=0).stop 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 shutdown_connections 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4cb40b3b90 0x7f4cb40b60a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ccc109670 0x7f4ccc1a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ccc108d20 0x7f4ccc19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 --2- 172.21.15.43:0/4280987261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc1033e0 0x7f4ccc19c080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.209+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 >> 172.21.15.43:0/4280987261 conn(0x7f4ccc0fee70 msgr2=0x7f4ccc1083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.210+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 shutdown_connections 2024-07-26T08:20:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.210+0000 7f4cd2200640 1 -- 172.21.15.43:0/4280987261 wait complete. 2024-07-26T08:20:33.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:33 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:33.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:33 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:33.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:33 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:34.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:34 smithi043 ceph-mon[32384]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:34 smithi133 ceph-mon[37053]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:34 smithi063 ceph-mon[36747]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:34.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.025+0000 7fe39da00640 1 -- 172.21.15.43:0/2429666757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 msgr2=0x7fe398116180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:34.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.025+0000 7fe39da00640 1 --2- 172.21.15.43:0/2429666757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe398116180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe390009900 tx=0x7fe39002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 -- 172.21.15.43:0/2429666757 shutdown_connections 2024-07-26T08:20:34.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 --2- 172.21.15.43:0/2429666757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe398116180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 --2- 172.21.15.43:0/2429666757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe398075800 0x7fe398075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 --2- 172.21.15.43:0/2429666757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398076db0 0x7fe3980751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 -- 172.21.15.43:0/2429666757 >> 172.21.15.43:0/2429666757 conn(0x7fe3980fee70 msgr2=0x7fe3981012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 -- 172.21.15.43:0/2429666757 shutdown_connections 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.026+0000 7fe39da00640 1 -- 172.21.15.43:0/2429666757 wait complete. 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.027+0000 7fe39da00640 1 Processor -- start 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.027+0000 7fe39da00640 1 -- start start 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.027+0000 7fe39da00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398075800 0x7fe3981a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.027+0000 7fe39da00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe398076db0 0x7fe3981a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe3981a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe398119a10 con 0x7fe398113cb0 2024-07-26T08:20:34.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39da00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe398119890 con 0x7fe398076db0 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39da00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe398119b90 con 0x7fe398075800 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe3981a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe3981a5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51776/0 (socket says 172.21.15.43:51776) 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398075800 0x7fe3981a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe39d000640 1 -- 172.21.15.43:0/3087840879 learned_addr learned my addr 172.21.15.43:0/3087840879 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397400640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe398076db0 0x7fe3981a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397e00640 1 -- 172.21.15.43:0/3087840879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe398076db0 msgr2=0x7fe3981a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397e00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe398076db0 0x7fe3981a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397e00640 1 -- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 msgr2=0x7fe3981a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397e00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe3981a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.028+0000 7fe397e00640 1 -- 172.21.15.43:0/3087840879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3981a6310 con 0x7fe398075800 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.029+0000 7fe397e00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398075800 0x7fe3981a03a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe38800eb00 tx=0x7fe38800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:34.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.029+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388010430 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.029+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe388010aa0 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.029+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981a6600 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.029+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388017b30 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.029+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3981acd60 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.031+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe398075c10 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.033+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fe388010c50 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.034+0000 7fe394c00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe37c0b3b90 0x7fe37c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.034+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe3880e2a80 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.034+0000 7fe397400640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe37c0b3b90 0x7fe37c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.035+0000 7fe397400640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe37c0b3b90 0x7fe37c0b60a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3980ffd60 tx=0x7fe384005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.038+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe3880abc30 con 0x7fe398075800 2024-07-26T08:20:34.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.247+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe398112a40 con 0x7fe398075800 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.258+0000 7fe394c00640 1 -- 172.21.15.43:0/3087840879 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7fe3880ab530 con 0x7fe398075800 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe37c0b3b90 msgr2=0x7fe37c0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe37c0b3b90 0x7fe37c0b60a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3980ffd60 tx=0x7fe384005f90 comp rx=0 tx=0).stop 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398075800 msgr2=0x7fe3981a03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398075800 0x7fe3981a03a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe38800eb00 tx=0x7fe38800c2d0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 shutdown_connections 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe37c0b3b90 0x7fe37c0b60a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe398113cb0 0x7fe3981a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe398076db0 0x7fe3981a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 --2- 172.21.15.43:0/3087840879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe398075800 0x7fe3981a03a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 >> 172.21.15.43:0/3087840879 conn(0x7fe3980fee70 msgr2=0x7fe39810fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 shutdown_connections 2024-07-26T08:20:34.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:34.261+0000 7fe39da00640 1 -- 172.21.15.43:0/3087840879 wait complete. 2024-07-26T08:20:35.135 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi043') 2024-07-26T08:20:35.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.860+0000 7f1a44400640 1 -- 172.21.15.43:0/537271448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 msgr2=0x7f1a3c1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.860+0000 7f1a44400640 1 --2- 172.21.15.43:0/537271448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 0x7f1a3c1039d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009900 tx=0x7f1a3002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 -- 172.21.15.43:0/537271448 shutdown_connections 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 --2- 172.21.15.43:0/537271448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c108f00 0x7f1a3c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 --2- 172.21.15.43:0/537271448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c109850 0x7f1a3c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 --2- 172.21.15.43:0/537271448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 0x7f1a3c1039d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 -- 172.21.15.43:0/537271448 >> 172.21.15.43:0/537271448 conn(0x7f1a3c0ff010 msgr2=0x7f1a3c101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 -- 172.21.15.43:0/537271448 shutdown_connections 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.861+0000 7f1a44400640 1 -- 172.21.15.43:0/537271448 wait complete. 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.862+0000 7f1a44400640 1 Processor -- start 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.862+0000 7f1a44400640 1 -- start start 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.862+0000 7f1a44400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 0x7f1a3c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a44400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c108f00 0x7f1a3c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a44400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 0x7f1a3c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a44400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c113680 con 0x7f1a3c1035c0 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a44400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c113500 con 0x7f1a3c108f00 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a44400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c113800 con 0x7f1a3c109850 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 0x7f1a3c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c108f00 0x7f1a3c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 0x7f1a3c19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:43686/0 (socket says 172.21.15.43:43686) 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c108f00 0x7f1a3c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36342/0 (socket says 172.21.15.43:36342) 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 -- 172.21.15.43:0/2230376756 learned_addr learned my addr 172.21.15.43:0/2230376756 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a41a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 0x7f1a3c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 -- 172.21.15.43:0/2230376756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c108f00 msgr2=0x7f1a3c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c108f00 0x7f1a3c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 -- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 msgr2=0x7f1a3c199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 0x7f1a3c199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.863+0000 7f1a42400640 1 -- 172.21.15.43:0/2230376756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c19ff20 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.864+0000 7f1a42400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 0x7f1a3c19f7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400eb10 tx=0x7f1a3400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.864+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004b20 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.864+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a34004cc0 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.864+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34010720 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.864+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c1a0210 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.864+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c1a6970 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.865+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3c1039d0 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.868+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f1a340108e0 con 0x7f1a3c109850 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.869+0000 7f1a3a000640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a240b3b90 0x7f1a240b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.869+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1a340e2750 con 0x7f1a3c109850 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.869+0000 7f1a41a00640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a240b3b90 0x7f1a240b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.870+0000 7f1a41a00640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a240b3b90 0x7f1a240b60a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a30006010 tx=0x7f1a30000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:31.870+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1a340ab900 con 0x7f1a3c109850 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.081+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f1a3c19b0e0 con 0x7f1a3c109850 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.089+0000 7f1a3a000640 1 -- 172.21.15.43:0/2230376756 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v32)=0 v32) ==== 116+0+0 (secure 0 0 0) 0x7f1a3c19b0e0 con 0x7f1a3c109850 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a240b3b90 msgr2=0x7f1a240b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a240b3b90 0x7f1a240b60a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a30006010 tx=0x7f1a30000bc0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 msgr2=0x7f1a3c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 0x7f1a3c19f7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400eb10 tx=0x7f1a3400c2d0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 shutdown_connections 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a240b3b90 0x7f1a240b60a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a3c109850 0x7f1a3c19f7f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a3c108f00 0x7f1a3c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 --2- 172.21.15.43:0/2230376756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c1035c0 0x7f1a3c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 >> 172.21.15.43:0/2230376756 conn(0x7f1a3c0ff010 msgr2=0x7f1a3c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 shutdown_connections 2024-07-26T08:20:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:32.092+0000 7f1a44400640 1 -- 172.21.15.43:0/2230376756 wait complete. 2024-07-26T08:20:35.414 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:35 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:35.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:35 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:35.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:35 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 -- 172.21.15.43:0/47656378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 msgr2=0x7f14ec109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 --2- 172.21.15.43:0/47656378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 0x7f14ec109310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009900 tx=0x7f14dc02a410 comp rx=0 tx=0).stop 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 -- 172.21.15.43:0/47656378 shutdown_connections 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 --2- 172.21.15.43:0/47656378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec109850 0x7f14ec110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 --2- 172.21.15.43:0/47656378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 0x7f14ec109310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 --2- 172.21.15.43:0/47656378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ec1035c0 0x7f14ec1039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.925+0000 7f14f3400640 1 -- 172.21.15.43:0/47656378 >> 172.21.15.43:0/47656378 conn(0x7f14ec0ff010 msgr2=0x7f14ec101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:35.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.926+0000 7f14f3400640 1 -- 172.21.15.43:0/47656378 shutdown_connections 2024-07-26T08:20:35.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.926+0000 7f14f3400640 1 -- 172.21.15.43:0/47656378 wait complete. 2024-07-26T08:20:35.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.927+0000 7f14f3400640 1 Processor -- start 2024-07-26T08:20:35.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.927+0000 7f14f3400640 1 -- start start 2024-07-26T08:20:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.927+0000 7f14f3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 0x7f14ec199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.927+0000 7f14f3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 0x7f14ec19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.927+0000 7f14f3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ec109850 0x7f14ec19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec113630 con 0x7f14ec108f00 2024-07-26T08:20:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f3400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1134b0 con 0x7f14ec1035c0 2024-07-26T08:20:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f3400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1137b0 con 0x7f14ec109850 2024-07-26T08:20:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 0x7f14ec199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14ebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 0x7f14ec19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 0x7f14ec199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:48822/0 (socket says 172.21.15.43:48822) 2024-07-26T08:20:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 -- 172.21.15.43:0/2785898479 learned_addr learned my addr 172.21.15.43:0/2785898479 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 -- 172.21.15.43:0/2785898479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ec109850 msgr2=0x7f14ec19f7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ec109850 0x7f14ec19f7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 -- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 msgr2=0x7f14ec19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 0x7f14ec19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.928+0000 7f14f0a00640 1 -- 172.21.15.43:0/2785898479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec19fef0 con 0x7f14ec1035c0 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.929+0000 7f14f0a00640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 0x7f14ec199f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14e000e9f0 tx=0x7f14e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.929+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e000cd80 con 0x7f14ec1035c0 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.929+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14e0010900 con 0x7f14ec1035c0 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.929+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec1a01e0 con 0x7f14ec1035c0 2024-07-26T08:20:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.929+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0018930 con 0x7f14ec1035c0 2024-07-26T08:20:35.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.929+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec1a6940 con 0x7f14ec1035c0 2024-07-26T08:20:35.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.930+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ec1039d0 con 0x7f14ec1035c0 2024-07-26T08:20:35.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.933+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f14e0010ab0 con 0x7f14ec1035c0 2024-07-26T08:20:35.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.934+0000 7f14e9600640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14d40b3c10 0x7f14d40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:35.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.934+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f14e00e23d0 con 0x7f14ec1035c0 2024-07-26T08:20:35.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.934+0000 7f14ebe00640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14d40b3c10 0x7f14d40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:35.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.935+0000 7f14ebe00640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14d40b3c10 0x7f14d40b6120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005940 tx=0x7f14dc0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:35.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:35.938+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f14e00ab580 con 0x7f14ec1035c0 2024-07-26T08:20:36.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.145+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f14ec02e0c0 con 0x7f14ec1035c0 2024-07-26T08:20:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.156+0000 7f14e9600640 1 -- 172.21.15.43:0/2785898479 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v35)=0 v35) ==== 133+0+0 (secure 0 0 0) 0x7f14e00aae80 con 0x7f14ec1035c0 2024-07-26T08:20:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14d40b3c10 msgr2=0x7f14d40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14d40b3c10 0x7f14d40b6120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005940 tx=0x7f14dc0058d0 comp rx=0 tx=0).stop 2024-07-26T08:20:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 msgr2=0x7f14ec199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 0x7f14ec199f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14e000e9f0 tx=0x7f14e000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 shutdown_connections 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14d40b3c10 0x7f14d40b6120 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14ec109850 0x7f14ec19f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec108f00 0x7f14ec19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 --2- 172.21.15.43:0/2785898479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14ec1035c0 0x7f14ec199f80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 >> 172.21.15.43:0/2785898479 conn(0x7f14ec0ff010 msgr2=0x7f14ec101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 shutdown_connections 2024-07-26T08:20:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:36.160+0000 7f14f3400640 1 -- 172.21.15.43:0/2785898479 wait complete. 2024-07-26T08:20:36.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:36 smithi043 ceph-mon[32384]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:36.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:36 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' 2024-07-26T08:20:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:36 smithi063 ceph-mon[36747]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:36 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' 2024-07-26T08:20:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:36 smithi133 ceph-mon[37053]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:36 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' 2024-07-26T08:20:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:20:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:20:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:20:37.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.454 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.454 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.454 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.454 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.454 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.454 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.756 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.756 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.757 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4bbb8ba0-4b27-11ef-bcb6-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi043') 2024-07-26T08:20:37.757 INFO:tasks.cephadm:Deploying OSDs... 2024-07-26T08:20:37.757 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:20:37.758 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-07-26T08:20:37.816 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-26T08:20:37.816 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-07-26T08:20:37.868 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-26T08:20:37.868 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:37.868 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-07-26T08:20:37.868 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:37.868 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:37.869 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-07-26 08:18:26.550923326 +0000 2024-07-26T08:20:37.869 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-07-26 08:13:04.555590459 +0000 2024-07-26T08:20:37.869 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-07-26 08:13:04.555590459 +0000 2024-07-26T08:20:37.869 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-07-26 08:13:04.555590459 +0000 2024-07-26T08:20:37.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-26T08:20:37.951 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-07-26T08:20:37.951 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-07-26T08:20:37.951 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000295241 s, 1.7 MB/s 2024-07-26T08:20:37.955 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-26T08:20:38.014 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-07-26T08:20:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-26T08:20:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:38.068 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-07-26T08:20:38.068 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:38.068 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:38.068 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-07-26 08:18:26.639922244 +0000 2024-07-26T08:20:38.069 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-07-26 08:13:05.146583351 +0000 2024-07-26T08:20:38.069 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-07-26 08:13:05.146583351 +0000 2024-07-26T08:20:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-07-26 08:13:05.146583351 +0000 2024-07-26T08:20:38.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-26T08:20:38.152 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-07-26T08:20:38.152 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-07-26T08:20:38.152 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000269315 s, 1.9 MB/s 2024-07-26T08:20:38.156 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-26T08:20:38.213 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-07-26T08:20:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-07-26 08:18:26.700921503 +0000 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-07-26 08:13:05.737576244 +0000 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-07-26 08:13:05.737576244 +0000 2024-07-26T08:20:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-07-26 08:13:05.737576244 +0000 2024-07-26T08:20:38.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-26T08:20:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-07-26T08:20:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-07-26T08:20:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000263528 s, 1.9 MB/s 2024-07-26T08:20:38.345 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-26T08:20:38.399 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-07-26T08:20:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-26T08:20:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:38.450 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-07-26T08:20:38.450 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:38.450 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:38.451 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-07-26 08:18:26.762920750 +0000 2024-07-26T08:20:38.451 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-07-26 08:13:06.275569774 +0000 2024-07-26T08:20:38.451 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-07-26 08:13:06.275569774 +0000 2024-07-26T08:20:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-07-26 08:13:06.275569774 +0000 2024-07-26T08:20:38.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-26T08:20:38.525 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:38 smithi043 ceph-mon[32384]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:38.534 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-07-26T08:20:38.534 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-07-26T08:20:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000267383 s, 1.9 MB/s 2024-07-26T08:20:38.539 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-26T08:20:38.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:38 smithi063 ceph-mon[36747]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:38.599 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-07-26T08:20:38.599 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-07-26T08:20:38.618 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-26T08:20:38.618 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-07-26T08:20:38.677 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-26T08:20:38.677 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:38.677 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-07-26T08:20:38.678 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:38.678 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:38.678 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-07-26 08:19:47.248136078 +0000 2024-07-26T08:20:38.678 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-07-26 08:11:43.148195833 +0000 2024-07-26T08:20:38.678 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-07-26 08:11:43.148195833 +0000 2024-07-26T08:20:38.678 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-07-26 08:11:43.148195833 +0000 2024-07-26T08:20:38.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-26T08:20:38.749 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-07-26T08:20:38.749 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-07-26T08:20:38.749 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000318814 s, 1.6 MB/s 2024-07-26T08:20:38.751 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-26T08:20:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:38 smithi133 ceph-mon[37053]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:38.810 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-07-26T08:20:38.868 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-26T08:20:38.868 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:38.868 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-07-26T08:20:38.868 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:38.868 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:38.868 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-07-26 08:19:47.249136069 +0000 2024-07-26T08:20:38.869 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-07-26 08:11:43.481192584 +0000 2024-07-26T08:20:38.869 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-07-26 08:11:43.481192584 +0000 2024-07-26T08:20:38.869 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-07-26 08:11:43.481192584 +0000 2024-07-26T08:20:38.869 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-26T08:20:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-07-26T08:20:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-07-26T08:20:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000236728 s, 2.2 MB/s 2024-07-26T08:20:38.935 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-26T08:20:38.992 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-07-26 08:19:47.249136069 +0000 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-07-26 08:11:43.826189217 +0000 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-07-26 08:11:43.826189217 +0000 2024-07-26T08:20:39.051 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-07-26 08:11:43.826189217 +0000 2024-07-26T08:20:39.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-26T08:20:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-07-26T08:20:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-07-26T08:20:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000235979 s, 2.2 MB/s 2024-07-26T08:20:39.119 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-26T08:20:39.176 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-07-26 08:19:47.250136059 +0000 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-07-26 08:11:44.179185772 +0000 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-07-26 08:11:44.179185772 +0000 2024-07-26T08:20:39.234 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-07-26 08:11:44.179185772 +0000 2024-07-26T08:20:39.235 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-26T08:20:39.300 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-07-26T08:20:39.300 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-07-26T08:20:39.300 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000369994 s, 1.4 MB/s 2024-07-26T08:20:39.301 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-26T08:20:39.360 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-07-26T08:20:39.360 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-07-26T08:20:39.379 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-26T08:20:39.379 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-07-26T08:20:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-26T08:20:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:39.438 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-07-26T08:20:39.438 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:39.438 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:39.439 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-07-26 08:19:44.838909105 +0000 2024-07-26T08:20:39.439 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-07-26 08:11:32.907351096 +0000 2024-07-26T08:20:39.439 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-07-26 08:11:32.907351096 +0000 2024-07-26T08:20:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-07-26 08:11:32.907351096 +0000 2024-07-26T08:20:39.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-26T08:20:39.507 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-07-26T08:20:39.507 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-07-26T08:20:39.507 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000303514 s, 1.7 MB/s 2024-07-26T08:20:39.509 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-26T08:20:39.567 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-07-26T08:20:39.623 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-26T08:20:39.623 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:39.623 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-07-26T08:20:39.623 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:39.624 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:39.624 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-07-26 08:19:44.838909105 +0000 2024-07-26T08:20:39.624 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-07-26 08:11:33.232345068 +0000 2024-07-26T08:20:39.624 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-07-26 08:11:33.232345068 +0000 2024-07-26T08:20:39.624 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-07-26 08:11:33.232345068 +0000 2024-07-26T08:20:39.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-26T08:20:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-07-26T08:20:39.689 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-07-26T08:20:39.689 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000210505 s, 2.4 MB/s 2024-07-26T08:20:39.690 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-26T08:20:39.747 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-07-26 08:19:44.839909086 +0000 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-07-26 08:11:33.549339189 +0000 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-07-26 08:11:33.549339189 +0000 2024-07-26T08:20:39.803 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-07-26 08:11:33.549339189 +0000 2024-07-26T08:20:39.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-26T08:20:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-07-26T08:20:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-07-26T08:20:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000246576 s, 2.1 MB/s 2024-07-26T08:20:39.868 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-26T08:20:39.925 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-07-26T08:20:39.980 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-07-26 08:19:44.839909086 +0000 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-07-26 08:11:33.887332920 +0000 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-07-26 08:11:33.887332920 +0000 2024-07-26T08:20:39.981 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-07-26 08:11:33.887332920 +0000 2024-07-26T08:20:39.981 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-26T08:20:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-07-26T08:20:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-07-26T08:20:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000223433 s, 2.3 MB/s 2024-07-26T08:20:40.045 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-26T08:20:40.102 INFO:tasks.cephadm:Deploying osd.0 on smithi043 with /dev/vg_nvme/lv_4... 2024-07-26T08:20:40.102 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-26T08:20:40.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:40 smithi043 ceph-mon[32384]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:40.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:40 smithi063 ceph-mon[36747]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:40.578 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:20:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:40 smithi133 ceph-mon[37053]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:42.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:42 smithi063 ceph-mon[36747]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:42.583 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:42 smithi043 ceph-mon[32384]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:42 smithi133 ceph-mon[37053]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-26T08:20:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-26T08:20:43.335 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-07-26T08:20:43.335 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-07-26T08:20:43.335 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0368848 s, 284 MB/s 2024-07-26T08:20:43.336 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 2024-07-26T08:20:43.336 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-07-26T08:20:44.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_4 2024-07-26T08:20:44.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:44 smithi063 ceph-mon[36747]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:20:44.726 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:44 smithi043 ceph-mon[32384]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:44 smithi133 ceph-mon[37053]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:46.424 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:46 smithi043 ceph-mon[32384]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:46.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:46 smithi063 ceph-mon[36747]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:46 smithi133 ceph-mon[37053]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:46.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 -- 172.21.15.43:0/2239251280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b010b0f0 msgr2=0x7fc9b010b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 --2- 172.21.15.43:0/2239251280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b010b0f0 0x7fc9b010b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc998009900 tx=0x7fc99802a410 comp rx=0 tx=0).stop 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 -- 172.21.15.43:0/2239251280 shutdown_connections 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 --2- 172.21.15.43:0/2239251280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b010b0f0 0x7fc9b010b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 --2- 172.21.15.43:0/2239251280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 0x7fc9b0112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 --2- 172.21.15.43:0/2239251280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b01057b0 0x7fc9b0105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 -- 172.21.15.43:0/2239251280 >> 172.21.15.43:0/2239251280 conn(0x7fc9b0101240 msgr2=0x7fc9b0103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 -- 172.21.15.43:0/2239251280 shutdown_connections 2024-07-26T08:20:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.768+0000 7fc9b6200640 1 -- 172.21.15.43:0/2239251280 wait complete. 2024-07-26T08:20:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.769+0000 7fc9b6200640 1 Processor -- start 2024-07-26T08:20:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 -- start start 2024-07-26T08:20:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 0x7fc9b019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 0x7fc9b019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 0x7fc9b01a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0115870 con 0x7fc9b010ba40 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b01156f0 con 0x7fc9b010b0f0 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9b6200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b01159f0 con 0x7fc9b01057b0 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9afe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 0x7fc9b01a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9af400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 0x7fc9b019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9aea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 0x7fc9b019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9afe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 0x7fc9b01a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48232/0 (socket says 172.21.15.43:48232) 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9af400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 0x7fc9b019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:47850/0 (socket says 172.21.15.43:47850) 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9aea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 0x7fc9b019c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37998/0 (socket says 172.21.15.43:37998) 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.770+0000 7fc9af400640 1 -- 172.21.15.43:0/3362875064 learned_addr learned my addr 172.21.15.43:0/3362875064 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9af400640 1 -- 172.21.15.43:0/3362875064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 msgr2=0x7fc9b019c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9af400640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 0x7fc9b019c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9af400640 1 -- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 msgr2=0x7fc9b01a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:20:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9af400640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 0x7fc9b01a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:20:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9af400640 1 -- 172.21.15.43:0/3362875064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b01a2150 con 0x7fc9b01057b0 2024-07-26T08:20:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9aea00640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 0x7fc9b019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:20:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.771+0000 7fc9af400640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 0x7fc9b019c1e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000eb90 tx=0x7fc9a000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.772+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0004d20 con 0x7fc9b01057b0 2024-07-26T08:20:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.772+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9a000ee90 con 0x7fc9b01057b0 2024-07-26T08:20:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.772+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b01a2440 con 0x7fc9b01057b0 2024-07-26T08:20:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.772+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0010720 con 0x7fc9b01057b0 2024-07-26T08:20:46.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.772+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b01a8ba0 con 0x7fc9b01057b0 2024-07-26T08:20:46.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.773+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b0105bc0 con 0x7fc9b01057b0 2024-07-26T08:20:46.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.776+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fc9a0005580 con 0x7fc9b01057b0 2024-07-26T08:20:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.777+0000 7fc9a7e00640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9940b3c90 0x7fc9940b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:20:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.778+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc9a00e2860 con 0x7fc9b01057b0 2024-07-26T08:20:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.778+0000 7fc9aea00640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9940b3c90 0x7fc9940b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:20:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.778+0000 7fc9aea00640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9940b3c90 0x7fc9940b61a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc99802aa00 tx=0x7fc998000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:20:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.779+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc9a0055600 con 0x7fc9b01057b0 2024-07-26T08:20:46.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:20:46.993+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc9b0063230 con 0x7fc9940b3c90 2024-07-26T08:20:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:20:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:20:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:47.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:20:47.717 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:20:47.717 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:20:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:20:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:48 smithi063 ceph-mon[36747]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:48 smithi063 ceph-mon[36747]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:20:48.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:48 smithi043 ceph-mon[32384]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:48.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:48 smithi043 ceph-mon[32384]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:20:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:48 smithi133 ceph-mon[37053]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:48 smithi133 ceph-mon[37053]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:20:50.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:50 smithi043 ceph-mon[32384]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:50 smithi063 ceph-mon[36747]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:50 smithi133 ceph-mon[37053]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:51.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:51 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3902602089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dce96d84-5cb4-44d8-8562-8b0c37d34d3e"}]: dispatch 2024-07-26T08:20:51.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:51 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3902602089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dce96d84-5cb4-44d8-8562-8b0c37d34d3e"}]': finished 2024-07-26T08:20:51.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:20:51.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:51 smithi043 ceph-mon[32384]: osdmap e6: 1 total, 0 up, 1 in 2024-07-26T08:20:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:51 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3902602089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dce96d84-5cb4-44d8-8562-8b0c37d34d3e"}]: dispatch 2024-07-26T08:20:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:51 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3902602089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dce96d84-5cb4-44d8-8562-8b0c37d34d3e"}]': finished 2024-07-26T08:20:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:20:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:51 smithi133 ceph-mon[37053]: osdmap e6: 1 total, 0 up, 1 in 2024-07-26T08:20:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:51 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3902602089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dce96d84-5cb4-44d8-8562-8b0c37d34d3e"}]: dispatch 2024-07-26T08:20:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:51 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3902602089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dce96d84-5cb4-44d8-8562-8b0c37d34d3e"}]': finished 2024-07-26T08:20:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:20:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:51 smithi063 ceph-mon[36747]: osdmap e6: 1 total, 0 up, 1 in 2024-07-26T08:20:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:52 smithi043 ceph-mon[32384]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:52 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2402548607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:20:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:52 smithi133 ceph-mon[37053]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:52 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2402548607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:20:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:52 smithi063 ceph-mon[36747]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:52 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2402548607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:20:53.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:53 smithi043 ceph-mon[32384]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:53.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:53 smithi133 ceph-mon[37053]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:53.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:53 smithi063 ceph-mon[36747]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:55.660 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:55 smithi043 ceph-mon[32384]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:55 smithi133 ceph-mon[37053]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:56.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:55 smithi063 ceph-mon[36747]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:57.867 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:57 smithi043 ceph-mon[32384]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:57.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:57 smithi063 ceph-mon[36747]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:57 smithi133 ceph-mon[37053]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:59.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:59 smithi043 ceph-mon[32384]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:20:59.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-26T08:20:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:20:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:20:59 smithi043 ceph-mon[32384]: Deploying daemon osd.0 on smithi043 2024-07-26T08:21:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:59 smithi133 ceph-mon[37053]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-26T08:21:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:20:59 smithi133 ceph-mon[37053]: Deploying daemon osd.0 on smithi043 2024-07-26T08:21:00.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:59 smithi063 ceph-mon[36747]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:00.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-26T08:21:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:20:59 smithi063 ceph-mon[36747]: Deploying daemon osd.0 on smithi043 2024-07-26T08:21:01.894 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:01 smithi043 ceph-mon[32384]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:01 smithi133 ceph-mon[37053]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:02.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:01 smithi063 ceph-mon[36747]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:03.932 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:03 smithi043 ceph-mon[32384]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:03 smithi133 ceph-mon[37053]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:03 smithi063 ceph-mon[36747]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:05.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:05 smithi043 ceph-mon[32384]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:05 smithi133 ceph-mon[37053]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:06.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:05 smithi063 ceph-mon[36747]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:07.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:07 smithi043 ceph-mon[32384]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:08.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:07 smithi133 ceph-mon[37053]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:07 smithi063 ceph-mon[36747]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:08.911 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:08.911 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:08.911 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:09.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:09.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:09 smithi043 ceph-mon[32384]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:10.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:09 smithi133 ceph-mon[37053]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:10.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:09 smithi063 ceph-mon[36747]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:12.454 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-26T08:21:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:12.847 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 0 on host 'smithi043' 2024-07-26T08:21:12.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.844+0000 7fc9a7e00640 1 -- 172.21.15.43:0/3362875064 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9b0063230 con 0x7fc9940b3c90 2024-07-26T08:21:12.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9940b3c90 msgr2=0x7fc9940b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:12.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9940b3c90 0x7fc9940b61a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc99802aa00 tx=0x7fc998000bc0 comp rx=0 tx=0).stop 2024-07-26T08:21:12.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 msgr2=0x7fc9b019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:12.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 0x7fc9b019c1e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000eb90 tx=0x7fc9a000c6a0 comp rx=0 tx=0).stop 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 shutdown_connections 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9940b3c90 0x7fc9940b61a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9b010ba40 0x7fc9b01a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b010b0f0 0x7fc9b019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 --2- 172.21.15.43:0/3362875064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b01057b0 0x7fc9b019c1e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 >> 172.21.15.43:0/3362875064 conn(0x7fc9b0101240 msgr2=0x7fc9b010a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.848+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 shutdown_connections 2024-07-26T08:21:12.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:21:12.849+0000 7fc9b6200640 1 -- 172.21.15.43:0/3362875064 wait complete. 2024-07-26T08:21:13.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-26T08:21:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: osdmap e7: 1 total, 0 up, 1 in 2024-07-26T08:21:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:21:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:13.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-26T08:21:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: osdmap e7: 1 total, 0 up, 1 in 2024-07-26T08:21:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:21:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:13.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-26T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: osdmap e7: 1 total, 0 up, 1 in 2024-07-26T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:13.585 DEBUG:teuthology.orchestra.run.smithi043:osd.0> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.0.service 2024-07-26T08:21:13.590 INFO:tasks.cephadm:Deploying osd.1 on smithi063 with /dev/vg_nvme/lv_4... 2024-07-26T08:21:13.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-26T08:21:13.849 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:21:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:14 smithi133 ceph-mon[37053]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:14 smithi133 ceph-mon[37053]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:21:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:14 smithi133 ceph-mon[37053]: osdmap e8: 1 total, 0 up, 1 in 2024-07-26T08:21:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:14 smithi063 ceph-mon[36747]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:14 smithi063 ceph-mon[36747]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:14 smithi063 ceph-mon[36747]: osdmap e8: 1 total, 0 up, 1 in 2024-07-26T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:14 smithi043 ceph-mon[32384]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:14 smithi043 ceph-mon[32384]: from='osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:21:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:14 smithi043 ceph-mon[32384]: osdmap e8: 1 total, 0 up, 1 in 2024-07-26T08:21:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:15.415 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:15 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:21:15.415 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:15 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:21:15.415 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:15.415 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:15 smithi043 ceph-mon[32384]: osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] boot 2024-07-26T08:21:15.415 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:15 smithi043 ceph-mon[32384]: osdmap e9: 1 total, 1 up, 1 in 2024-07-26T08:21:15.445 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:15 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:21:15.445 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:15 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:21:15.445 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:15.445 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:15 smithi063 ceph-mon[36747]: osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] boot 2024-07-26T08:21:15.445 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:15 smithi063 ceph-mon[36747]: osdmap e9: 1 total, 1 up, 1 in 2024-07-26T08:21:15.501 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-26T08:21:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:15 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:21:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:15 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:21:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T08:21:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:15 smithi133 ceph-mon[37053]: osd.0 [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] boot 2024-07-26T08:21:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:15 smithi133 ceph-mon[37053]: osdmap e9: 1 total, 1 up, 1 in 2024-07-26T08:21:15.584 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-26T08:21:15.597 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-07-26T08:21:15.597 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-07-26T08:21:15.597 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113124 s, 927 MB/s 2024-07-26T08:21:15.597 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-07-26T08:21:16.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_4 2024-07-26T08:21:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:21:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:16 smithi133 ceph-mon[37053]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:16 smithi133 ceph-mon[37053]: osdmap e10: 1 total, 1 up, 1 in 2024-07-26T08:21:16.533 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:16 smithi063 ceph-mon[36747]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:16.533 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:16 smithi063 ceph-mon[36747]: osdmap e10: 1 total, 1 up, 1 in 2024-07-26T08:21:16.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:16 smithi043 ceph-mon[32384]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T08:21:16.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:16 smithi043 ceph-mon[32384]: osdmap e10: 1 total, 1 up, 1 in 2024-07-26T08:21:18.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 -- 172.21.15.63:0/4179384823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 msgr2=0x7f91641028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 --2- 172.21.15.63:0/4179384823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f91641028c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9158009900 tx=0x7f915802a410 comp rx=0 tx=0).stop 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 -- 172.21.15.63:0/4179384823 shutdown_connections 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 --2- 172.21.15.63:0/4179384823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9164108740 0x7f916410ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 --2- 172.21.15.63:0/4179384823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9164107df0 0x7f9164108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 --2- 172.21.15.63:0/4179384823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f91641028c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 -- 172.21.15.63:0/4179384823 >> 172.21.15.63:0/4179384823 conn(0x7f9164079170 msgr2=0x7f9164079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 -- 172.21.15.63:0/4179384823 shutdown_connections 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.044+0000 7f9168e68640 1 -- 172.21.15.63:0/4179384823 wait complete. 2024-07-26T08:21:18.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.045+0000 7f9168e68640 1 Processor -- start 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.045+0000 7f9168e68640 1 -- start start 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.045+0000 7f9168e68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f916410fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.045+0000 7f9168e68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9164107df0 0x7f916410ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.045+0000 7f9168e68640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9164108740 0x7f9164110480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.045+0000 7f9168e68640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91641136c0 con 0x7f9164107df0 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f9168e68640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113540 con 0x7f91641024b0 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f9168e68640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113840 con 0x7f9164108740 2024-07-26T08:21:18.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f916410fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f916410fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34940/0 (socket says 172.21.15.63:34940) 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 -- 172.21.15.63:0/1766315112 learned_addr learned my addr 172.21.15.63:0/1766315112 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f9162d9d640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9164108740 0x7f9164110480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 -- 172.21.15.63:0/1766315112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9164108740 msgr2=0x7f9164110480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9164108740 0x7f9164110480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 -- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9164107df0 msgr2=0x7f916410ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9164107df0 0x7f916410ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 -- 172.21.15.63:0/1766315112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91641a8290 con 0x7f91641024b0 2024-07-26T08:21:18.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f916259c640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f916410fa00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9158006010 tx=0x7f9158003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:21:18.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915803f070 con 0x7f91641024b0 2024-07-26T08:21:18.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91641a8520 con 0x7f91641024b0 2024-07-26T08:21:18.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9158031df0 con 0x7f91641024b0 2024-07-26T08:21:18.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.046+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158035030 con 0x7f91641024b0 2024-07-26T08:21:18.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.047+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91641a8a80 con 0x7f91641024b0 2024-07-26T08:21:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.048+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9164103730 con 0x7f91641024b0 2024-07-26T08:21:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.049+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f9158042070 con 0x7f91641024b0 2024-07-26T08:21:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.050+0000 7f91537fe640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f914c0b3b90 0x7f914c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.050+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f9158102c60 con 0x7f91641024b0 2024-07-26T08:21:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.050+0000 7f9161d9b640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f914c0b3b90 0x7f914c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:21:18.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.051+0000 7f9161d9b640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f914c0b3b90 0x7f914c0b60a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9164079930 tx=0x7f9154006c90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:21:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.054+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f91580cbc50 con 0x7f91641024b0 2024-07-26T08:21:18.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:18.245+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9164063230 con 0x7f914c0b3b90 2024-07-26T08:21:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:18 smithi063 ceph-mon[36747]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:18.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:18 smithi043 ceph-mon[32384]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:18 smithi133 ceph-mon[37053]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi043 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 17094M 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi043 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 17094M 2024-07-26T08:21:19.523 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.524 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:19.524 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:19.524 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi043 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 17094M 2024-07-26T08:21:19.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:19.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:19.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:19.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:20.424 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:20 smithi063 ceph-mon[36747]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:20.693 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:20 smithi133 ceph-mon[37053]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:20.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:20 smithi043 ceph-mon[32384]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:21.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:21 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/121141143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]: dispatch 2024-07-26T08:21:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:21 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]: dispatch 2024-07-26T08:21:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:21 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]': finished 2024-07-26T08:21:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:21 smithi043 ceph-mon[32384]: osdmap e11: 2 total, 1 up, 2 in 2024-07-26T08:21:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:21 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/3482770976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:21:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:21 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/121141143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]: dispatch 2024-07-26T08:21:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:21 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]: dispatch 2024-07-26T08:21:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:21 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]': finished 2024-07-26T08:21:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:21 smithi063 ceph-mon[36747]: osdmap e11: 2 total, 1 up, 2 in 2024-07-26T08:21:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:21 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/3482770976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:21:21.622 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:21 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/121141143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]: dispatch 2024-07-26T08:21:21.623 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:21 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]: dispatch 2024-07-26T08:21:21.623 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:21 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2eae29bd-b685-4687-be6b-b9bc8014a1f1"}]': finished 2024-07-26T08:21:21.623 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:21.623 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:21 smithi133 ceph-mon[37053]: osdmap e11: 2 total, 1 up, 2 in 2024-07-26T08:21:21.623 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:21 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/3482770976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:21:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:22 smithi063 ceph-mon[36747]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:22 smithi043 ceph-mon[32384]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:22.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:22 smithi133 ceph-mon[37053]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:24 smithi063 ceph-mon[36747]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:24.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:24 smithi043 ceph-mon[32384]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:24.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:24 smithi133 ceph-mon[37053]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:26.379 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:26 smithi063 ceph-mon[36747]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:26.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:26 smithi043 ceph-mon[32384]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:26.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:26 smithi133 ceph-mon[37053]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:28.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:28 smithi063 ceph-mon[36747]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-26T08:21:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:28.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:28 smithi043 ceph-mon[32384]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:28.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-26T08:21:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:28 smithi133 ceph-mon[37053]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-26T08:21:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:29.389 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:29 smithi063 ceph-mon[36747]: Deploying daemon osd.1 on smithi063 2024-07-26T08:21:29.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:29 smithi043 ceph-mon[32384]: Deploying daemon osd.1 on smithi063 2024-07-26T08:21:29.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:29 smithi133 ceph-mon[37053]: Deploying daemon osd.1 on smithi063 2024-07-26T08:21:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:30 smithi063 ceph-mon[36747]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:30.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:30 smithi043 ceph-mon[32384]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:30 smithi133 ceph-mon[37053]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:31 smithi133 ceph-mon[37053]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:31.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:31 smithi063 ceph-mon[36747]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:31.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:31 smithi043 ceph-mon[32384]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:32.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:32.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:32.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:32.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:32.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:33.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:33 smithi133 ceph-mon[37053]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:33 smithi063 ceph-mon[36747]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:33.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:33 smithi043 ceph-mon[32384]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:35.926 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:35 smithi063 ceph-mon[36747]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:35.926 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:35.926 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:35.927 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:35.927 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:35.927 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:35.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:35 smithi043 ceph-mon[32384]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:35.990 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 1 on host 'smithi063' 2024-07-26T08:21:35.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.988+0000 7f91537fe640 1 -- 172.21.15.63:0/1766315112 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9164063230 con 0x7f914c0b3b90 2024-07-26T08:21:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f914c0b3b90 msgr2=0x7f914c0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f914c0b3b90 0x7f914c0b60a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9164079930 tx=0x7f9154006c90 comp rx=0 tx=0).stop 2024-07-26T08:21:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 msgr2=0x7f916410fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f916410fa00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9158006010 tx=0x7f9158003d50 comp rx=0 tx=0).stop 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 shutdown_connections 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f914c0b3b90 0x7f914c0b60a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9164108740 0x7f9164110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9164107df0 0x7f916410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 --2- 172.21.15.63:0/1766315112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91641024b0 0x7f916410fa00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 >> 172.21.15.63:0/1766315112 conn(0x7f9164079170 msgr2=0x7f9164100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 shutdown_connections 2024-07-26T08:21:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:21:35.991+0000 7f9168e68640 1 -- 172.21.15.63:0/1766315112 wait complete. 2024-07-26T08:21:36.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:35 smithi133 ceph-mon[37053]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.749 DEBUG:teuthology.orchestra.run.smithi063:osd.1> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.1.service 2024-07-26T08:21:36.752 INFO:tasks.cephadm:Deploying osd.2 on smithi133 with /dev/vg_nvme/lv_4... 2024-07-26T08:21:36.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-26T08:21:36.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:36.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:36 smithi063 ceph-mon[36747]: from='osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T08:21:36.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:36 smithi063 ceph-mon[36747]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T08:21:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:36 smithi043 ceph-mon[32384]: from='osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T08:21:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:36 smithi043 ceph-mon[32384]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T08:21:37.009 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:21:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:36 smithi133 ceph-mon[37053]: from='osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T08:21:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:36 smithi133 ceph-mon[37053]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T08:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:38 smithi133 ceph-mon[37053]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:38 smithi133 ceph-mon[37053]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-26T08:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:38 smithi133 ceph-mon[37053]: from='osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:38 smithi133 ceph-mon[37053]: osdmap e12: 2 total, 1 up, 2 in 2024-07-26T08:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:38 smithi133 ceph-mon[37053]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:21:38.275 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-mon[36747]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:38.275 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-mon[36747]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-26T08:21:38.275 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:38.275 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-mon[36747]: from='osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:21:38.275 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-mon[36747]: osdmap e12: 2 total, 1 up, 2 in 2024-07-26T08:21:38.275 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-mon[36747]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:21:38.275 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1[42607]: 2024-07-26T08:21:38.001+0000 7f061567d640 -1 osd.1 0 waiting for initial osdmap 2024-07-26T08:21:38.275 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:21:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1[42607]: 2024-07-26T08:21:38.009+0000 7f061147b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:21:38.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:38 smithi043 ceph-mon[32384]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:38 smithi043 ceph-mon[32384]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-26T08:21:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:38 smithi043 ceph-mon[32384]: from='osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:21:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:38 smithi043 ceph-mon[32384]: osdmap e12: 2 total, 1 up, 2 in 2024-07-26T08:21:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:38 smithi043 ceph-mon[32384]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:21:38.695 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-26T08:21:38.785 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-26T08:21:38.798 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-07-26T08:21:38.799 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-07-26T08:21:38.799 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115511 s, 908 MB/s 2024-07-26T08:21:38.799 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-07-26T08:21:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:39 smithi133 ceph-mon[37053]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:21:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:39 smithi133 ceph-mon[37053]: osdmap e13: 2 total, 1 up, 2 in 2024-07-26T08:21:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:39.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:39 smithi063 ceph-mon[36747]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:21:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:39 smithi063 ceph-mon[36747]: osdmap e13: 2 total, 1 up, 2 in 2024-07-26T08:21:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:39.410 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_4 2024-07-26T08:21:39.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:39 smithi043 ceph-mon[32384]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:21:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:39 smithi043 ceph-mon[32384]: osdmap e13: 2 total, 1 up, 2 in 2024-07-26T08:21:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:39.664 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:21:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:21:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:21:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] boot 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: osdmap e14: 2 total, 2 up, 2 in 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:40.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:40.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] boot 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: osdmap e14: 2 total, 2 up, 2 in 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:40.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:40.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: osd.1 [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] boot 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: osdmap e14: 2 total, 2 up, 2 in 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:21:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.241+0000 7fb350691640 1 -- 172.21.15.133:0/2619470260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 msgr2=0x7fb34810efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.241+0000 7fb350691640 1 --2- 172.21.15.133:0/2619470260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34810efd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb340009ca0 tx=0x7fb34002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:21:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 -- 172.21.15.133:0/2619470260 shutdown_connections 2024-07-26T08:21:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 --2- 172.21.15.133:0/2619470260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34810efd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 --2- 172.21.15.133:0/2619470260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb348107e50 0x7fb348108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 --2- 172.21.15.133:0/2619470260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb348102510 0x7fb348102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 -- 172.21.15.133:0/2619470260 >> 172.21.15.133:0/2619470260 conn(0x7fb3480791a0 msgr2=0x7fb3480795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 -- 172.21.15.133:0/2619470260 shutdown_connections 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 -- 172.21.15.133:0/2619470260 wait complete. 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 Processor -- start 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.242+0000 7fb350691640 1 -- start start 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb348102510 0x7fb34819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb348107e50 0x7fb34819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb348112620 con 0x7fb348107e50 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481124a0 con 0x7fb348102510 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481127a0 con 0x7fb3481087a0 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34819f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40966/0 (socket says 172.21.15.133:40966) 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 -- 172.21.15.133:0/497258937 learned_addr learned my addr 172.21.15.133:0/497258937 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34e42d640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb348102510 0x7fb34819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 -- 172.21.15.133:0/497258937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb348102510 msgr2=0x7fb34819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb348102510 0x7fb34819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 -- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb348107e50 msgr2=0x7fb34819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb348107e50 0x7fb34819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 -- 172.21.15.133:0/497258937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3481a0010 con 0x7fb3481087a0 2024-07-26T08:21:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb34ec2e640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34819f8e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb340005cc0 tx=0x7fb340003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:21:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3400317d0 con 0x7fb3481087a0 2024-07-26T08:21:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb340004510 con 0x7fb3481087a0 2024-07-26T08:21:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3481a02a0 con 0x7fb3481087a0 2024-07-26T08:21:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.243+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34002fca0 con 0x7fb3481087a0 2024-07-26T08:21:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.244+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3481a6a60 con 0x7fb3481087a0 2024-07-26T08:21:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.244+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb348103790 con 0x7fb3481087a0 2024-07-26T08:21:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.246+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fb3400046c0 con 0x7fb3481087a0 2024-07-26T08:21:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.246+0000 7fb33f7fe640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3340b3c10 0x7fb3340b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:21:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.247+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2524+0+0 (secure 0 0 0) 0x7fb340103df0 con 0x7fb3481087a0 2024-07-26T08:21:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.247+0000 7fb34e42d640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3340b3c10 0x7fb3340b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:21:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.248+0000 7fb34e42d640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3340b3c10 0x7fb3340b6120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb344009990 tx=0x7fb344009110 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:21:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.250+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb3400ccbc0 con 0x7fb3481087a0 2024-07-26T08:21:41.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:41 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi063 2024-07-26T08:21:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:41 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 17088M 2024-07-26T08:21:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:41 smithi063 ceph-mon[36747]: osdmap e15: 2 total, 2 up, 2 in 2024-07-26T08:21:41.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:41.432+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb348063230 con 0x7fb3340b3c10 2024-07-26T08:21:41.433 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:41 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi063 2024-07-26T08:21:41.433 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:41 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 17088M 2024-07-26T08:21:41.433 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:41 smithi133 ceph-mon[37053]: osdmap e15: 2 total, 2 up, 2 in 2024-07-26T08:21:41.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:41 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi063 2024-07-26T08:21:41.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:41 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 17088M 2024-07-26T08:21:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:41 smithi043 ceph-mon[32384]: osdmap e15: 2 total, 2 up, 2 in 2024-07-26T08:21:42.194 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:42 smithi133 ceph-mon[37053]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:42.195 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:21:42.195 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:21:42.195 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:42.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:42 smithi063 ceph-mon[36747]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:21:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:21:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:42.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:42 smithi043 ceph-mon[32384]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:21:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:21:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:43.225 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:43 smithi133 ceph-mon[37053]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:21:43.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:43 smithi063 ceph-mon[36747]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:21:43.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:43 smithi043 ceph-mon[32384]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:21:44.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:44 smithi133 ceph-mon[37053]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:44.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:44 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/4292087565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]: dispatch 2024-07-26T08:21:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:44 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]: dispatch 2024-07-26T08:21:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:44 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]': finished 2024-07-26T08:21:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:21:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:44 smithi133 ceph-mon[37053]: osdmap e16: 3 total, 2 up, 3 in 2024-07-26T08:21:44.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:44 smithi063 ceph-mon[36747]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:44 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/4292087565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]: dispatch 2024-07-26T08:21:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:44 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]: dispatch 2024-07-26T08:21:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:44 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]': finished 2024-07-26T08:21:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:21:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:44 smithi063 ceph-mon[36747]: osdmap e16: 3 total, 2 up, 3 in 2024-07-26T08:21:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:44 smithi043 ceph-mon[32384]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:44 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/4292087565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]: dispatch 2024-07-26T08:21:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:44 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]: dispatch 2024-07-26T08:21:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:44 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db61971e-05a7-4ea1-8c58-162bd956e3e4"}]': finished 2024-07-26T08:21:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:21:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:44 smithi043 ceph-mon[32384]: osdmap e16: 3 total, 2 up, 3 in 2024-07-26T08:21:45.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:45 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/1278811791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:21:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:45 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/1278811791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:21:45.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:45 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/1278811791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:21:46.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:46 smithi043 ceph-mon[32384]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:46 smithi133 ceph-mon[37053]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:46.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:46 smithi063 ceph-mon[36747]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:48 smithi133 ceph-mon[37053]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:48.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:48 smithi043 ceph-mon[32384]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:48 smithi063 ceph-mon[36747]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:50.409 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:50 smithi133 ceph-mon[37053]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:50.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:50 smithi043 ceph-mon[32384]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:50 smithi063 ceph-mon[36747]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:51.363 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-26T08:21:51.363 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:51.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-26T08:21:51.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:51.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-26T08:21:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:52.423 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:52 smithi133 ceph-mon[37053]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:52.423 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:52 smithi133 ceph-mon[37053]: Deploying daemon osd.2 on smithi133 2024-07-26T08:21:52.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:52 smithi043 ceph-mon[32384]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:52.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:52 smithi043 ceph-mon[32384]: Deploying daemon osd.2 on smithi133 2024-07-26T08:21:52.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:52 smithi063 ceph-mon[36747]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:52.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:52 smithi063 ceph-mon[36747]: Deploying daemon osd.2 on smithi133 2024-07-26T08:21:54.331 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:54 smithi133 ceph-mon[37053]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:54.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:54 smithi043 ceph-mon[32384]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:54.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:54 smithi063 ceph-mon[36747]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:56.403 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:56 smithi133 ceph-mon[37053]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:56.403 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:56.403 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:56.403 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:56.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:56 smithi043 ceph-mon[32384]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:56.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:56 smithi063 ceph-mon[36747]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:21:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.355 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:58 smithi133 ceph-mon[37053]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:58.355 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.355 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.355 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:58.355 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:58.355 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:21:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:58 smithi043 ceph-mon[32384]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:21:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:58 smithi063 ceph-mon[36747]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:21:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:21:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:21:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:21:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:21:59.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.410+0000 7fb33f7fe640 1 -- 172.21.15.133:0/497258937 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb348063230 con 0x7fb3340b3c10 2024-07-26T08:21:59.412 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 2 on host 'smithi133' 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3340b3c10 msgr2=0x7fb3340b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3340b3c10 0x7fb3340b6120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb344009990 tx=0x7fb344009110 comp rx=0 tx=0).stop 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 msgr2=0x7fb34819f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34819f8e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb340005cc0 tx=0x7fb340003f90 comp rx=0 tx=0).stop 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 shutdown_connections 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3340b3c10 0x7fb3340b6120 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3481087a0 0x7fb34819f8e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.412+0000 7fb350691640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb348107e50 0x7fb34819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.413+0000 7fb350691640 1 --2- 172.21.15.133:0/497258937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb348102510 0x7fb34819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:21:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.413+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 >> 172.21.15.133:0/497258937 conn(0x7fb3480791a0 msgr2=0x7fb348101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:21:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.413+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 shutdown_connections 2024-07-26T08:21:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:21:59.413+0000 7fb350691640 1 -- 172.21.15.133:0/497258937 wait complete. 2024-07-26T08:22:00.034 DEBUG:teuthology.orchestra.run.smithi133:osd.2> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.2.service 2024-07-26T08:22:00.037 INFO:tasks.cephadm:Deploying osd.3 on smithi043 with /dev/vg_nvme/lv_3... 2024-07-26T08:22:00.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-26T08:22:00.253 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:00 smithi133 ceph-mon[37053]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:22:00.254 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:00.254 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:00.254 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:00.254 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:00 smithi133 ceph-mon[37053]: from='osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T08:22:00.254 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:00 smithi133 ceph-mon[37053]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T08:22:00.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:00 smithi043 ceph-mon[32384]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:22:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:00 smithi043 ceph-mon[32384]: from='osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T08:22:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:00 smithi043 ceph-mon[32384]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T08:22:00.511 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:22:00.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:00 smithi063 ceph-mon[36747]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:22:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:00 smithi063 ceph-mon[36747]: from='osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T08:22:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:00 smithi063 ceph-mon[36747]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T08:22:01.516 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2[43450]: 2024-07-26T08:22:01.425+0000 7ff78c049640 -1 osd.2 0 waiting for initial osdmap 2024-07-26T08:22:01.516 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2[43450]: 2024-07-26T08:22:01.430+0000 7ff787e47640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:22:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-mon[37053]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-26T08:22:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-mon[37053]: osdmap e17: 3 total, 2 up, 3 in 2024-07-26T08:22:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-mon[37053]: from='osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:22:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-mon[37053]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:22:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:01 smithi133 ceph-mon[37053]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:22:01.685 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:01 smithi043 ceph-mon[32384]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-26T08:22:01.686 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:01 smithi043 ceph-mon[32384]: osdmap e17: 3 total, 2 up, 3 in 2024-07-26T08:22:01.686 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:01.686 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:01 smithi043 ceph-mon[32384]: from='osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:22:01.686 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:01 smithi043 ceph-mon[32384]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:22:01.686 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:01 smithi043 ceph-mon[32384]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:01 smithi063 ceph-mon[36747]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-26T08:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:01 smithi063 ceph-mon[36747]: osdmap e17: 3 total, 2 up, 3 in 2024-07-26T08:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:01 smithi063 ceph-mon[36747]: from='osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:01 smithi063 ceph-mon[36747]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:01 smithi063 ceph-mon[36747]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-26T08:22:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:02 smithi133 ceph-mon[37053]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:22:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:02 smithi133 ceph-mon[37053]: osdmap e18: 3 total, 2 up, 3 in 2024-07-26T08:22:02.701 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:02 smithi043 ceph-mon[32384]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:22:02.701 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:02.701 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:02 smithi043 ceph-mon[32384]: osdmap e18: 3 total, 2 up, 3 in 2024-07-26T08:22:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:02 smithi063 ceph-mon[36747]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:22:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:02 smithi063 ceph-mon[36747]: osdmap e18: 3 total, 2 up, 3 in 2024-07-26T08:22:03.354 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-26T08:22:03.533 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-26T08:22:03.571 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-07-26T08:22:03.572 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-07-26T08:22:03.572 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0317044 s, 331 MB/s 2024-07-26T08:22:03.572 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-07-26T08:22:03.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:22:03.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:22:03.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:03.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] boot 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: osdmap e19: 3 total, 3 up, 3 in 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: pgmap v81: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi133 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 17088M 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:03.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:03.609 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] boot 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: osdmap e19: 3 total, 3 up, 3 in 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: pgmap v81: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi133 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 17088M 2024-07-26T08:22:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: osd.2 [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] boot 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: osdmap e19: 3 total, 3 up, 3 in 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: pgmap v81: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi133 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 17088M 2024-07-26T08:22:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:04.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_3 2024-07-26T08:22:04.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-26T08:22:04.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 ceph-mon[36747]: osdmap e20: 3 total, 3 up, 3 in 2024-07-26T08:22:04.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:04.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:04.715 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46695]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T08:22:04.715 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46695]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:04.715 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:04.715 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46695]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:04.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-26T08:22:04.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 ceph-mon[32384]: osdmap e20: 3 total, 3 up, 3 in 2024-07-26T08:22:04.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:04.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56201]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56201]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56201]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56220]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56220]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:04.733 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56220]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-26T08:22:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 ceph-mon[37053]: osdmap e20: 3 total, 3 up, 3 in 2024-07-26T08:22:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T08:22:04.998 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T08:22:04.998 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:04.998 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:04.998 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46698]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:22:05.163 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56233]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56233]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56233]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56242]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56242]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:04 smithi043 sudo[56242]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47329]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47332]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47332]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47332]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.266 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47323]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.267 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 08:22:04 smithi133 sudo[47326]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:04 smithi063 sudo[46701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 sudo[46701]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 sudo[46704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 sudo[46704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 sudo[46704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T08:22:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 sudo[46704]: pam_unix(sudo:session): session closed for user root 2024-07-26T08:22:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-26T08:22:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: osdmap e21: 3 total, 3 up, 3 in 2024-07-26T08:22:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:05 smithi043 ceph-mon[32384]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: osdmap e21: 3 total, 3 up, 3 in 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:05 smithi133 ceph-mon[37053]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: osdmap e21: 3 total, 3 up, 3 in 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T08:22:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:05 smithi063 ceph-mon[36747]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T08:22:06.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:06 smithi043 ceph-mon[32384]: osdmap e22: 3 total, 3 up, 3 in 2024-07-26T08:22:06.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:06 smithi043 ceph-mon[32384]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-07-26T08:22:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:06 smithi133 ceph-mon[37053]: osdmap e22: 3 total, 3 up, 3 in 2024-07-26T08:22:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:06 smithi133 ceph-mon[37053]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-07-26T08:22:06.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:06 smithi063 ceph-mon[36747]: osdmap e22: 3 total, 3 up, 3 in 2024-07-26T08:22:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:06 smithi063 ceph-mon[36747]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-07-26T08:22:07.616 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:07 smithi043 ceph-mon[32384]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:07.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:07 smithi133 ceph-mon[37053]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:07.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:07 smithi063 ceph-mon[36747]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 -- 172.21.15.43:0/658238968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 msgr2=0x7f0360111f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 --2- 172.21.15.43:0/658238968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 0x7f0360111f30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f035c009ca0 tx=0x7f035c02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:22:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 -- 172.21.15.43:0/658238968 shutdown_connections 2024-07-26T08:22:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 --2- 172.21.15.43:0/658238968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 0x7f0360111f30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 --2- 172.21.15.43:0/658238968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0360075b30 0x7f036010f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 --2- 172.21.15.43:0/658238968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03600751e0 0x7f03600755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 -- 172.21.15.43:0/658238968 >> 172.21.15.43:0/658238968 conn(0x7f036007b280 msgr2=0x7f036007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:22:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.818+0000 7f0368800640 1 -- 172.21.15.43:0/658238968 shutdown_connections 2024-07-26T08:22:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.819+0000 7f0368800640 1 -- 172.21.15.43:0/658238968 wait complete. 2024-07-26T08:22:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.820+0000 7f0368800640 1 Processor -- start 2024-07-26T08:22:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.820+0000 7f0368800640 1 -- start start 2024-07-26T08:22:07.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0368800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 0x7f036019c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:07.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0368800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0360075b30 0x7f036019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:07.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0368800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 0x7f03601a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:07.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0368800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0360115810 con 0x7f036010faf0 2024-07-26T08:22:07.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0368800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0360115690 con 0x7f03600751e0 2024-07-26T08:22:07.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0368800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0360115990 con 0x7f0360075b30 2024-07-26T08:22:07.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0366800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 0x7f03601a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:07.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0365e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 0x7f036019c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:07.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0365e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 0x7f036019c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:44894/0 (socket says 172.21.15.43:44894) 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0365e00640 1 -- 172.21.15.43:0/494243792 learned_addr learned my addr 172.21.15.43:0/494243792 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.821+0000 7f0365400640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0360075b30 0x7f036019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f0365e00640 1 -- 172.21.15.43:0/494243792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0360075b30 msgr2=0x7f036019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f0365e00640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0360075b30 0x7f036019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f0365e00640 1 -- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 msgr2=0x7f03601a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f0365e00640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 0x7f03601a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f0365e00640 1 -- 172.21.15.43:0/494243792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03601a2090 con 0x7f03600751e0 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f0365e00640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 0x7f036019c120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f035400e9f0 tx=0x7f035400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:22:07.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035400cd80 con 0x7f03600751e0 2024-07-26T08:22:07.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.822+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f03540054f0 con 0x7f03600751e0 2024-07-26T08:22:07.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.823+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0354010690 con 0x7f03600751e0 2024-07-26T08:22:07.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.823+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03601a2380 con 0x7f03600751e0 2024-07-26T08:22:07.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.823+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03601a8ae0 con 0x7f03600751e0 2024-07-26T08:22:07.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.824+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03600755f0 con 0x7f03600751e0 2024-07-26T08:22:07.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.826+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f03540046c0 con 0x7f03600751e0 2024-07-26T08:22:07.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.828+0000 7f035aa00640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03480b3ca0 0x7f03480b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:07.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.828+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3452+0+0 (secure 0 0 0) 0x7f03540e2e30 con 0x7f03600751e0 2024-07-26T08:22:07.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.828+0000 7f0365400640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03480b3ca0 0x7f03480b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:07.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.829+0000 7f0365400640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03480b3ca0 0x7f03480b61b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0360111660 tx=0x7f0350005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:22:07.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:07.830+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f03540ab6e0 con 0x7f03600751e0 2024-07-26T08:22:08.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:08.048+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0360108c70 con 0x7f03480b3ca0 2024-07-26T08:22:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:08 smithi133 ceph-mon[37053]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:22:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:22:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:22:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:08.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:08 smithi043 ceph-mon[32384]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:22:08.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:22:08.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:22:08.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:08 smithi063 ceph-mon[36747]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:22:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:22:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:22:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:09.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:09 smithi133 ceph-mon[37053]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:09.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:09 smithi063 ceph-mon[36747]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:09.859 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:09 smithi043 ceph-mon[32384]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:11.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:11 smithi043 ceph-mon[32384]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 51 KiB/s wr, 4 op/s 2024-07-26T08:22:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:11 smithi133 ceph-mon[37053]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 51 KiB/s wr, 4 op/s 2024-07-26T08:22:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:11 smithi063 ceph-mon[36747]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 51 KiB/s wr, 4 op/s 2024-07-26T08:22:12.842 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:12 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1424611169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]: dispatch 2024-07-26T08:22:12.843 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:12 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]: dispatch 2024-07-26T08:22:12.843 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:12 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]': finished 2024-07-26T08:22:12.843 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:12.843 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:12 smithi043 ceph-mon[32384]: osdmap e23: 4 total, 3 up, 4 in 2024-07-26T08:22:12.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:12 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1424611169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]: dispatch 2024-07-26T08:22:13.032 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:12 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]: dispatch 2024-07-26T08:22:13.032 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:12 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]': finished 2024-07-26T08:22:13.032 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:13.032 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:12 smithi063 ceph-mon[36747]: osdmap e23: 4 total, 3 up, 4 in 2024-07-26T08:22:13.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:12 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1424611169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]: dispatch 2024-07-26T08:22:13.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:12 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]: dispatch 2024-07-26T08:22:13.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:12 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6"}]': finished 2024-07-26T08:22:13.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:13.033 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:12 smithi133 ceph-mon[37053]: osdmap e23: 4 total, 3 up, 4 in 2024-07-26T08:22:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:13 smithi043 ceph-mon[32384]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 37 KiB/s wr, 3 op/s 2024-07-26T08:22:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:13 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3928698266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:22:14.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:13 smithi133 ceph-mon[37053]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 37 KiB/s wr, 3 op/s 2024-07-26T08:22:14.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:13 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3928698266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:22:14.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:13 smithi063 ceph-mon[36747]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 37 KiB/s wr, 3 op/s 2024-07-26T08:22:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:13 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3928698266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:22:15.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:15 smithi043 ceph-mon[32384]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 29 KiB/s wr, 2 op/s 2024-07-26T08:22:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:15 smithi133 ceph-mon[37053]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 29 KiB/s wr, 2 op/s 2024-07-26T08:22:16.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:15 smithi063 ceph-mon[36747]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 29 KiB/s wr, 2 op/s 2024-07-26T08:22:17.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:17 smithi043 ceph-mon[32384]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T08:22:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:17 smithi133 ceph-mon[37053]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T08:22:18.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:17 smithi063 ceph-mon[36747]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T08:22:19.951 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:19 smithi043 ceph-mon[32384]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T08:22:20.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:19 smithi133 ceph-mon[37053]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T08:22:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:19 smithi063 ceph-mon[36747]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T08:22:21.933 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:21 smithi043 ceph-mon[32384]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:21.933 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-26T08:22:21.933 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:21.933 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:21 smithi043 ceph-mon[32384]: Deploying daemon osd.3 on smithi043 2024-07-26T08:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:21 smithi133 ceph-mon[37053]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-26T08:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:21 smithi133 ceph-mon[37053]: Deploying daemon osd.3 on smithi043 2024-07-26T08:22:22.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:21 smithi063 ceph-mon[36747]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:22.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-26T08:22:22.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:21 smithi063 ceph-mon[36747]: Deploying daemon osd.3 on smithi043 2024-07-26T08:22:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:23 smithi043 ceph-mon[32384]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:24.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:23 smithi133 ceph-mon[37053]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:24.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:23 smithi063 ceph-mon[36747]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:25.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:25 smithi043 ceph-mon[32384]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:25 smithi133 ceph-mon[37053]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:26.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:25 smithi063 ceph-mon[36747]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:27 smithi043 ceph-mon[32384]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:28.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:27 smithi133 ceph-mon[37053]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:27 smithi063 ceph-mon[36747]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:29.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:29 smithi043 ceph-mon[32384]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:30.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:29 smithi133 ceph-mon[37053]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:30.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:29 smithi063 ceph-mon[36747]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:30.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:30.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:30.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:31.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:31.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:31.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:31.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:31.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:31.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:31 smithi043 ceph-mon[32384]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:32.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:31 smithi133 ceph-mon[37053]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:32.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:31 smithi063 ceph-mon[36747]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:33 smithi043 ceph-mon[32384]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:34.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:33 smithi133 ceph-mon[37053]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:34.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:33 smithi063 ceph-mon[36747]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T08:22:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T08:22:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T08:22:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T08:22:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:35.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.956+0000 7f035aa00640 1 -- 172.21.15.43:0/494243792 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0360108c70 con 0x7f03480b3ca0 2024-07-26T08:22:35.960 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 3 on host 'smithi043' 2024-07-26T08:22:35.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03480b3ca0 msgr2=0x7f03480b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03480b3ca0 0x7f03480b61b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0360111660 tx=0x7f0350005f90 comp rx=0 tx=0).stop 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 msgr2=0x7f036019c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 0x7f036019c120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f035400e9f0 tx=0x7f035400edf0 comp rx=0 tx=0).stop 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 shutdown_connections 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03480b3ca0 0x7f03480b61b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0360075b30 0x7f036019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036010faf0 0x7f03601a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 --2- 172.21.15.43:0/494243792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03600751e0 0x7f036019c120 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 >> 172.21.15.43:0/494243792 conn(0x7f036007b280 msgr2=0x7f0360107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 shutdown_connections 2024-07-26T08:22:35.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:22:35.960+0000 7f0368800640 1 -- 172.21.15.43:0/494243792 wait complete. 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: osdmap e24: 4 total, 3 up, 4 in 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:36.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:36.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: osdmap e24: 4 total, 3 up, 4 in 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-26T08:22:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: osdmap e24: 4 total, 3 up, 4 in 2024-07-26T08:22:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:22:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:22:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:36.791 DEBUG:teuthology.orchestra.run.smithi043:osd.3> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.3.service 2024-07-26T08:22:36.795 INFO:tasks.cephadm:Deploying osd.4 on smithi063 with /dev/vg_nvme/lv_3... 2024-07-26T08:22:36.795 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-26T08:22:37.065 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:22:37.305 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:37 smithi043 ceph-mon[32384]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:22:37.305 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:37 smithi043 ceph-mon[32384]: osdmap e25: 4 total, 3 up, 4 in 2024-07-26T08:22:37.305 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:37.305 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:37.305 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:37 smithi043 ceph-mon[32384]: from='osd.3 ' entity='osd.3' 2024-07-26T08:22:37.453 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:37 smithi063 ceph-mon[36747]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:22:37.453 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:37 smithi063 ceph-mon[36747]: osdmap e25: 4 total, 3 up, 4 in 2024-07-26T08:22:37.453 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:37.454 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:37.454 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:37 smithi063 ceph-mon[36747]: from='osd.3 ' entity='osd.3' 2024-07-26T08:22:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:37 smithi133 ceph-mon[37053]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:22:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:37 smithi133 ceph-mon[37053]: osdmap e25: 4 total, 3 up, 4 in 2024-07-26T08:22:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:37 smithi133 ceph-mon[37053]: from='osd.3 ' entity='osd.3' 2024-07-26T08:22:38.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] boot 2024-07-26T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: osdmap e26: 4 total, 4 up, 4 in 2024-07-26T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:38 smithi043 ceph-mon[32384]: osdmap e27: 4 total, 4 up, 4 in 2024-07-26T08:22:38.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:22:38.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:22:38.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:38.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:38.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] boot 2024-07-26T08:22:38.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: osdmap e26: 4 total, 4 up, 4 in 2024-07-26T08:22:38.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:38 smithi063 ceph-mon[36747]: osdmap e27: 4 total, 4 up, 4 in 2024-07-26T08:22:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:22:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:22:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-07-26T08:22:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T08:22:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: osd.3 [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] boot 2024-07-26T08:22:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: osdmap e26: 4 total, 4 up, 4 in 2024-07-26T08:22:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:38 smithi133 ceph-mon[37053]: osdmap e27: 4 total, 4 up, 4 in 2024-07-26T08:22:38.867 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-26T08:22:38.950 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-26T08:22:38.963 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-07-26T08:22:38.964 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-07-26T08:22:38.964 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112873 s, 929 MB/s 2024-07-26T08:22:38.964 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-07-26T08:22:39.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_3 2024-07-26T08:22:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:22:40.155 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:40 smithi063 ceph-mon[36747]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 508 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:40.155 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:40 smithi063 ceph-mon[36747]: osdmap e28: 4 total, 4 up, 4 in 2024-07-26T08:22:40.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:40 smithi043 ceph-mon[32384]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 508 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:40 smithi043 ceph-mon[32384]: osdmap e28: 4 total, 4 up, 4 in 2024-07-26T08:22:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:40 smithi133 ceph-mon[37053]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 508 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:40 smithi133 ceph-mon[37053]: osdmap e28: 4 total, 4 up, 4 in 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 -- 172.21.15.63:0/3274199713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 msgr2=0x7f4eac108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/3274199713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac108200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009900 tx=0x7f4ea002a410 comp rx=0 tx=0).stop 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 -- 172.21.15.63:0/3274199713 shutdown_connections 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/3274199713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eac108740 0x7f4eac10ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/3274199713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac108200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/3274199713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac1024b0 0x7f4eac1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.525+0000 7f4eb42c4640 1 -- 172.21.15.63:0/3274199713 >> 172.21.15.63:0/3274199713 conn(0x7f4eac079170 msgr2=0x7f4eac079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:22:41.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.526+0000 7f4eb42c4640 1 -- 172.21.15.63:0/3274199713 shutdown_connections 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.526+0000 7f4eb42c4640 1 -- 172.21.15.63:0/3274199713 wait complete. 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.526+0000 7f4eb42c4640 1 Processor -- start 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.526+0000 7f4eb42c4640 1 -- start start 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.526+0000 7f4eb42c4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eac1024b0 0x7f4eac104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.526+0000 7f4eb42c4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac105070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb42c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac108740 0x7f4eac1055b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb42c4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac112550 con 0x7f4eac1024b0 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb42c4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1123d0 con 0x7f4eac107df0 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb42c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1126d0 con 0x7f4eac108740 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac105070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:41.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac105070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36814/0 (socket says 172.21.15.63:36814) 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 -- 172.21.15.63:0/2805583302 learned_addr learned my addr 172.21.15.63:0/2805583302 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb2861640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac108740 0x7f4eac1055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 -- 172.21.15.63:0/2805583302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac108740 msgr2=0x7f4eac1055b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac108740 0x7f4eac1055b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 -- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eac1024b0 msgr2=0x7f4eac104b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eac1024b0 0x7f4eac104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 -- 172.21.15.63:0/2805583302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac1a8280 con 0x7f4eac107df0 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb185f640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac105070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005940 tx=0x7f4ea00042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea003f030 con 0x7f4eac107df0 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ea00318f0 con 0x7f4eac107df0 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1a8510 con 0x7f4eac107df0 2024-07-26T08:22:41.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0035070 con 0x7f4eac107df0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.527+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac1a8a70 con 0x7f4eac107df0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.529+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac1028c0 con 0x7f4eac107df0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.531+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f4ea0042030 con 0x7f4eac107df0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.531+0000 7f4eab7fe640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4e940b3c20 0x7f4e940b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.532+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3884+0+0 (secure 0 0 0) 0x7f4ea0103360 con 0x7f4eac107df0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.532+0000 7f4eb2060640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4e940b3c20 0x7f4e940b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.533+0000 7f4eb2060640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4e940b3c20 0x7f4e940b6130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40058c0 tx=0x7f4ea4005850 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:22:41.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.535+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f4ea00cbb00 con 0x7f4eac107df0 2024-07-26T08:22:41.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:22:41.728+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4eac10b580 con 0x7f4e940b3c20 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 507 MiB used, 357 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:42.374 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.375 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:22:42.375 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:22:42.375 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 507 MiB used, 357 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:22:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:22:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 507 MiB used, 357 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-07-26T08:22:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:22:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:43.380 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:43 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi043 2024-07-26T08:22:43.380 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:43 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 8547M 2024-07-26T08:22:43.380 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:43 smithi063 ceph-mon[36747]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:22:43.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:43 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi043 2024-07-26T08:22:43.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:43 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 8547M 2024-07-26T08:22:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:43 smithi043 ceph-mon[32384]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:22:43.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:43 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi043 2024-07-26T08:22:43.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:43 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 8547M 2024-07-26T08:22:43.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:43 smithi133 ceph-mon[37053]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:22:44.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:44 smithi063 ceph-mon[36747]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:22:44.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:44 smithi043 ceph-mon[32384]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:22:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:44 smithi133 ceph-mon[37053]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:45 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/3106280815' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]: dispatch 2024-07-26T08:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:45 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]: dispatch 2024-07-26T08:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:45 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]': finished 2024-07-26T08:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:45 smithi063 ceph-mon[36747]: osdmap e29: 5 total, 4 up, 5 in 2024-07-26T08:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:45 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/2864879627' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:22:45.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:45 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/3106280815' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]: dispatch 2024-07-26T08:22:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:45 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]: dispatch 2024-07-26T08:22:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:45 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]': finished 2024-07-26T08:22:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:22:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:45 smithi043 ceph-mon[32384]: osdmap e29: 5 total, 4 up, 5 in 2024-07-26T08:22:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:45 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/2864879627' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:22:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:45 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/3106280815' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]: dispatch 2024-07-26T08:22:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:45 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]: dispatch 2024-07-26T08:22:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:45 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d643d69-23cc-46a6-9d86-2ca64b4ac93b"}]': finished 2024-07-26T08:22:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:22:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:45 smithi133 ceph-mon[37053]: osdmap e29: 5 total, 4 up, 5 in 2024-07-26T08:22:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:45 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/2864879627' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:22:46.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:46 smithi043 ceph-mon[32384]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-07-26T08:22:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:46 smithi133 ceph-mon[37053]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-07-26T08:22:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:46 smithi063 ceph-mon[36747]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-07-26T08:22:48.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:48 smithi043 ceph-mon[32384]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:22:48.749 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:48 smithi063 ceph-mon[36747]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:22:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:48 smithi133 ceph-mon[37053]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:22:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:50 smithi063 ceph-mon[36747]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-07-26T08:22:50.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:50 smithi043 ceph-mon[32384]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-07-26T08:22:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:50 smithi133 ceph-mon[37053]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-07-26T08:22:52.429 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:52 smithi063 ceph-mon[36747]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:52.430 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-26T08:22:52.430 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:52 smithi043 ceph-mon[32384]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-26T08:22:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:52 smithi133 ceph-mon[37053]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-26T08:22:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:22:53.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:53 smithi043 ceph-mon[32384]: Deploying daemon osd.4 on smithi063 2024-07-26T08:22:53.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:53 smithi063 ceph-mon[36747]: Deploying daemon osd.4 on smithi063 2024-07-26T08:22:53.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:53 smithi133 ceph-mon[37053]: Deploying daemon osd.4 on smithi063 2024-07-26T08:22:54.477 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:54 smithi063 ceph-mon[36747]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:54 smithi043 ceph-mon[32384]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:54 smithi133 ceph-mon[37053]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:55.665 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:55 smithi063 ceph-mon[36747]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:55.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:55 smithi043 ceph-mon[32384]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:55.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:55 smithi133 ceph-mon[37053]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:57.942 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:57 smithi063 ceph-mon[36747]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:57.942 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:57.942 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:57.942 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:57.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:57 smithi043 ceph-mon[32384]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:57.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:57 smithi133 ceph-mon[37053]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:22:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:22:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:22:59.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:22:59 smithi043 ceph-mon[32384]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:22:59 smithi133 ceph-mon[37053]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:00.030 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:22:59 smithi063 ceph-mon[36747]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:00.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.390+0000 7f4eab7fe640 1 -- 172.21.15.63:0/2805583302 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4eac10b580 con 0x7f4e940b3c20 2024-07-26T08:23:00.391 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 4 on host 'smithi063' 2024-07-26T08:23:00.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4e940b3c20 msgr2=0x7f4e940b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:00.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4e940b3c20 0x7f4e940b6130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40058c0 tx=0x7f4ea4005850 comp rx=0 tx=0).stop 2024-07-26T08:23:00.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 msgr2=0x7f4eac105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:00.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac105070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005940 tx=0x7f4ea00042f0 comp rx=0 tx=0).stop 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 shutdown_connections 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4e940b3c20 0x7f4e940b6130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac108740 0x7f4eac1055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4eac107df0 0x7f4eac105070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 --2- 172.21.15.63:0/2805583302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eac1024b0 0x7f4eac104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 >> 172.21.15.63:0/2805583302 conn(0x7f4eac079170 msgr2=0x7f4eac06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 shutdown_connections 2024-07-26T08:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:23:00.392+0000 7f4eb42c4640 1 -- 172.21.15.63:0/2805583302 wait complete. 2024-07-26T08:23:01.064 DEBUG:teuthology.orchestra.run.smithi063:osd.4> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.4.service 2024-07-26T08:23:01.067 INFO:tasks.cephadm:Deploying osd.5 on smithi133 with /dev/vg_nvme/lv_3... 2024-07-26T08:23:01.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-26T08:23:01.325 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:23:01.371 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 08:23:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T08:23:01.179+0000 7f95756ff640 -1 osd.4 0 log_to_monitors true 2024-07-26T08:23:01.650 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:01.650 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:01.650 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:01 smithi133 ceph-mon[37053]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:01.651 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:01 smithi133 ceph-mon[37053]: from='osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T08:23:01.651 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:01 smithi133 ceph-mon[37053]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T08:23:01.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:01 smithi043 ceph-mon[32384]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:01 smithi043 ceph-mon[32384]: from='osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T08:23:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:01 smithi043 ceph-mon[32384]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T08:23:01.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:01 smithi063 ceph-mon[36747]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:01 smithi063 ceph-mon[36747]: from='osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T08:23:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:01 smithi063 ceph-mon[36747]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T08:23:02.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-26T08:23:02.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: from='osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:23:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: osdmap e30: 5 total, 4 up, 5 in 2024-07-26T08:23:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:23:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: from='osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: osdmap e30: 5 total, 4 up, 5 in 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:02.718 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:02.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-26T08:23:02.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:02.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: from='osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:23:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: osdmap e30: 5 total, 4 up, 5 in 2024-07-26T08:23:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:23:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:03.225 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-26T08:23:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-26T08:23:03.317 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T08:23:03.154+0000 7f9571681640 -1 osd.4 0 waiting for initial osdmap 2024-07-26T08:23:03.318 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T08:23:03.160+0000 7f9569477640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:23:03.319 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-07-26T08:23:03.319 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-07-26T08:23:03.319 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112767 s, 930 MB/s 2024-07-26T08:23:03.319 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: osdmap e31: 5 total, 4 up, 5 in 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: from='osd.4 ' entity='osd.4' 2024-07-26T08:23:03.612 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: osdmap e31: 5 total, 4 up, 5 in 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: from='osd.4 ' entity='osd.4' 2024-07-26T08:23:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:23:03.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: osdmap e31: 5 total, 4 up, 5 in 2024-07-26T08:23:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T08:23:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: from='osd.4 ' entity='osd.4' 2024-07-26T08:23:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:03.954 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_3 2024-07-26T08:23:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:23:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:23:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:23:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] boot 2024-07-26T08:23:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: osdmap e32: 5 total, 5 up, 5 in 2024-07-26T08:23:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:05.320 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:23:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:23:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] boot 2024-07-26T08:23:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: osdmap e32: 5 total, 5 up, 5 in 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: osd.4 [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] boot 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: osdmap e32: 5 total, 5 up, 5 in 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 -- 172.21.15.133:0/2315644566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc102490 msgr2=0x7f97dc1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 --2- 172.21.15.133:0/2315644566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc102490 0x7f97dc1028a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009900 tx=0x7f97d802a410 comp rx=0 tx=0).stop 2024-07-26T08:23:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 -- 172.21.15.133:0/2315644566 shutdown_connections 2024-07-26T08:23:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 --2- 172.21.15.133:0/2315644566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97dc108720 0x7f97dc10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 --2- 172.21.15.133:0/2315644566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97dc107dd0 0x7f97dc1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 --2- 172.21.15.133:0/2315644566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc102490 0x7f97dc1028a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 -- 172.21.15.133:0/2315644566 >> 172.21.15.133:0/2315644566 conn(0x7f97dc079160 msgr2=0x7f97dc079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 -- 172.21.15.133:0/2315644566 shutdown_connections 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 -- 172.21.15.133:0/2315644566 wait complete. 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 Processor -- start 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.783+0000 7f97e35b6640 1 -- start start 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e35b6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97dc102490 0x7f97dc19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e35b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97dc107dd0 0x7f97dc19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e35b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 0x7f97dc19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e35b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc112550 con 0x7f97dc107dd0 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e35b6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1123d0 con 0x7f97dc102490 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e35b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1126d0 con 0x7f97dc108720 2024-07-26T08:23:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 0x7f97dc19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 0x7f97dc19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58446/0 (socket says 172.21.15.133:58446) 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 -- 172.21.15.133:0/1869163842 learned_addr learned my addr 172.21.15.133:0/1869163842 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1352640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97dc102490 0x7f97dc19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 -- 172.21.15.133:0/1869163842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97dc102490 msgr2=0x7f97dc19ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97dc102490 0x7f97dc19ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 -- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97dc107dd0 msgr2=0x7f97dc19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97dc107dd0 0x7f97dc19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 -- 172.21.15.133:0/1869163842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc1a6090 con 0x7f97dc108720 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97e1b53640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 0x7f97dc19b880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97d400eaa0 tx=0x7f97d400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.784+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d400cdb0 con 0x7f97dc108720 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.785+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f97d4005020 con 0x7f97dc108720 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.785+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc1a6380 con 0x7f97dc108720 2024-07-26T08:23:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.785+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d40116d0 con 0x7f97dc108720 2024-07-26T08:23:05.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.785+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc1a6940 con 0x7f97dc108720 2024-07-26T08:23:05.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.786+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc103710 con 0x7f97dc108720 2024-07-26T08:23:05.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.788+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f97d40051d0 con 0x7f97dc108720 2024-07-26T08:23:05.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.788+0000 7f97ce7fc640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f97c80b3c50 0x7f97c80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:05.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.789+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4316+0+0 (secure 0 0 0) 0x7f97d40e3260 con 0x7f97dc108720 2024-07-26T08:23:05.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.789+0000 7f97e1352640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f97c80b3c50 0x7f97c80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:05.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.790+0000 7f97e1352640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f97c80b3c50 0x7f97c80b6160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97dc06c130 tx=0x7f97d80058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:23:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.792+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f97d4016030 con 0x7f97dc108720 2024-07-26T08:23:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:05.975+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f97dc063230 con 0x7f97c80b3c50 2024-07-26T08:23:06.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:06.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi063 2024-07-26T08:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 8544M 2024-07-26T08:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: osdmap e33: 5 total, 5 up, 5 in 2024-07-26T08:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:06.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi063 2024-07-26T08:23:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 8544M 2024-07-26T08:23:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: osdmap e33: 5 total, 5 up, 5 in 2024-07-26T08:23:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:23:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:23:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:06.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi063 2024-07-26T08:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 8544M 2024-07-26T08:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: osdmap e33: 5 total, 5 up, 5 in 2024-07-26T08:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:07.441 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:07 smithi133 ceph-mon[37053]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:23:07.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:07 smithi043 ceph-mon[32384]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:23:07.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:07 smithi063 ceph-mon[36747]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:23:08.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:08 smithi043 ceph-mon[32384]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:08.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:08 smithi133 ceph-mon[37053]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:08.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:08 smithi063 ceph-mon[36747]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:09 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/2777458791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]: dispatch 2024-07-26T08:23:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:09 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]: dispatch 2024-07-26T08:23:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:09 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]': finished 2024-07-26T08:23:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:09 smithi133 ceph-mon[37053]: osdmap e34: 6 total, 5 up, 6 in 2024-07-26T08:23:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:09 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/1023472713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:23:09.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:09 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/2777458791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]: dispatch 2024-07-26T08:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:09 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]: dispatch 2024-07-26T08:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:09 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]': finished 2024-07-26T08:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:09 smithi043 ceph-mon[32384]: osdmap e34: 6 total, 5 up, 6 in 2024-07-26T08:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:09 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/1023472713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:23:09.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:09 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/2777458791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]: dispatch 2024-07-26T08:23:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:09 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]: dispatch 2024-07-26T08:23:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:09 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd66c187-2fc3-4e36-bf8c-6e9af071950f"}]': finished 2024-07-26T08:23:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:09 smithi063 ceph-mon[36747]: osdmap e34: 6 total, 5 up, 6 in 2024-07-26T08:23:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:09 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/1023472713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:23:10.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:10 smithi043 ceph-mon[32384]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:10.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:10 smithi133 ceph-mon[37053]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:10.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:10 smithi063 ceph-mon[36747]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:12.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:12 smithi043 ceph-mon[32384]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:12 smithi133 ceph-mon[37053]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:12.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:12 smithi063 ceph-mon[36747]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:14.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:14 smithi043 ceph-mon[32384]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:14.514 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:14 smithi133 ceph-mon[37053]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:14 smithi063 ceph-mon[36747]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:15.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-26T08:23:15.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-26T08:23:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:15.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-26T08:23:15.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:16 smithi133 ceph-mon[37053]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:16 smithi133 ceph-mon[37053]: Deploying daemon osd.5 on smithi133 2024-07-26T08:23:16.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:16 smithi043 ceph-mon[32384]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:16.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:16 smithi043 ceph-mon[32384]: Deploying daemon osd.5 on smithi133 2024-07-26T08:23:16.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:16 smithi063 ceph-mon[36747]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:16 smithi063 ceph-mon[36747]: Deploying daemon osd.5 on smithi133 2024-07-26T08:23:18.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:18 smithi043 ceph-mon[32384]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:18 smithi133 ceph-mon[37053]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:18.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:18 smithi063 ceph-mon[36747]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:20.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:20 smithi043 ceph-mon[32384]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:20 smithi133 ceph-mon[37053]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:20 smithi063 ceph-mon[36747]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:21.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:21.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:21.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:21.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:21.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:21.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:22.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:22 smithi133 ceph-mon[37053]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:22 smithi063 ceph-mon[36747]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:22.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:22 smithi043 ceph-mon[32384]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:23.773 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 5 on host 'smithi133' 2024-07-26T08:23:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.772+0000 7f97ce7fc640 1 -- 172.21.15.133:0/1869163842 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f97dc063230 con 0x7f97c80b3c50 2024-07-26T08:23:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f97c80b3c50 msgr2=0x7f97c80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f97c80b3c50 0x7f97c80b6160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97dc06c130 tx=0x7f97d80058d0 comp rx=0 tx=0).stop 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 msgr2=0x7f97dc19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 0x7f97dc19b880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97d400eaa0 tx=0x7f97d400ef60 comp rx=0 tx=0).stop 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 shutdown_connections 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f97c80b3c50 0x7f97c80b6160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97dc108720 0x7f97dc19b880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97dc107dd0 0x7f97dc19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 --2- 172.21.15.133:0/1869163842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97dc102490 0x7f97dc19ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 >> 172.21.15.133:0/1869163842 conn(0x7f97dc079160 msgr2=0x7f97dc100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:23:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 shutdown_connections 2024-07-26T08:23:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:23:23.775+0000 7f97e35b6640 1 -- 172.21.15.133:0/1869163842 wait complete. 2024-07-26T08:23:24.468 DEBUG:teuthology.orchestra.run.smithi133:osd.5> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.5.service 2024-07-26T08:23:24.470 INFO:tasks.cephadm:Deploying osd.6 on smithi043 with /dev/vg_nvme/lv_2... 2024-07-26T08:23:24.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-26T08:23:24.494 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:24 smithi133 ceph-mon[37053]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:24.494 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.494 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.494 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.494 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.558 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:24 smithi043 ceph-mon[32384]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:24.558 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.558 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.558 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:24 smithi063 ceph-mon[36747]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:24.960 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:23:25.403 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:25 smithi043 ceph-mon[32384]: from='osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T08:23:25.403 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:25 smithi043 ceph-mon[32384]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T08:23:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:25 smithi133 ceph-mon[37053]: from='osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T08:23:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:25 smithi133 ceph-mon[37053]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T08:23:25.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:25 smithi063 ceph-mon[36747]: from='osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T08:23:25.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:25 smithi063 ceph-mon[36747]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T08:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:26 smithi043 ceph-mon[32384]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:26 smithi043 ceph-mon[32384]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-26T08:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:26 smithi043 ceph-mon[32384]: from='osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:26 smithi043 ceph-mon[32384]: osdmap e35: 6 total, 5 up, 6 in 2024-07-26T08:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:26 smithi043 ceph-mon[32384]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:23:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:26 smithi063 ceph-mon[36747]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:26 smithi063 ceph-mon[36747]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-26T08:23:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:26 smithi063 ceph-mon[36747]: from='osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:23:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:26 smithi063 ceph-mon[36747]: osdmap e35: 6 total, 5 up, 6 in 2024-07-26T08:23:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:26 smithi063 ceph-mon[36747]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:23:26.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:26 smithi133 ceph-mon[37053]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:26.727 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:26 smithi133 ceph-mon[37053]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-26T08:23:26.727 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:26.727 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:26 smithi133 ceph-mon[37053]: from='osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:23:26.727 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:26 smithi133 ceph-mon[37053]: osdmap e35: 6 total, 5 up, 6 in 2024-07-26T08:23:26.727 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:26 smithi133 ceph-mon[37053]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:23:27.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T08:23:27.000+0000 7f734bb73640 -1 osd.5 0 waiting for initial osdmap 2024-07-26T08:23:27.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T08:23:27.007+0000 7f7343969640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:23:27.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: osdmap e36: 6 total, 5 up, 6 in 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: from='osd.5 ' entity='osd.5' 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] boot 2024-07-26T08:23:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:27 smithi063 ceph-mon[36747]: osdmap e37: 6 total, 6 up, 6 in 2024-07-26T08:23:27.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:23:27.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: osdmap e36: 6 total, 5 up, 6 in 2024-07-26T08:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: from='osd.5 ' entity='osd.5' 2024-07-26T08:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] boot 2024-07-26T08:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:27 smithi043 ceph-mon[32384]: osdmap e37: 6 total, 6 up, 6 in 2024-07-26T08:23:27.762 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-26T08:23:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:23:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: osdmap e36: 6 total, 5 up, 6 in 2024-07-26T08:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: from='osd.5 ' entity='osd.5' 2024-07-26T08:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T08:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: osd.5 [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] boot 2024-07-26T08:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:27 smithi133 ceph-mon[37053]: osdmap e37: 6 total, 6 up, 6 in 2024-07-26T08:23:27.941 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-26T08:23:27.979 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-07-26T08:23:27.979 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-07-26T08:23:27.979 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0312174 s, 336 MB/s 2024-07-26T08:23:27.979 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:28 smithi063 ceph-mon[36747]: osdmap e38: 6 total, 6 up, 6 in 2024-07-26T08:23:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:23:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:28.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:28 smithi043 ceph-mon[32384]: osdmap e38: 6 total, 6 up, 6 in 2024-07-26T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:23:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-07-26T08:23:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:23:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:28.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:28.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:28.769 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:28.769 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:28.769 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:28 smithi133 ceph-mon[37053]: osdmap e38: 6 total, 6 up, 6 in 2024-07-26T08:23:28.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_2 2024-07-26T08:23:29.427 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:23:29.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:29 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi133 2024-07-26T08:23:29.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:29 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 8544M 2024-07-26T08:23:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:29 smithi063 ceph-mon[36747]: osdmap e39: 6 total, 6 up, 6 in 2024-07-26T08:23:29.587 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:29 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi133 2024-07-26T08:23:29.587 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:29 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 8544M 2024-07-26T08:23:29.587 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:29 smithi043 ceph-mon[32384]: osdmap e39: 6 total, 6 up, 6 in 2024-07-26T08:23:29.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:29 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi133 2024-07-26T08:23:29.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:29 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 8544M 2024-07-26T08:23:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:29 smithi133 ceph-mon[37053]: osdmap e39: 6 total, 6 up, 6 in 2024-07-26T08:23:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:30 smithi063 ceph-mon[36747]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:30.646 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:30 smithi043 ceph-mon[32384]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:30 smithi133 ceph-mon[37053]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:31.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 -- 172.21.15.43:0/1134971818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10af10 msgr2=0x7fcc0c10b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:31.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 --2- 172.21.15.43:0/1134971818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10af10 0x7fcc0c10b320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009860 tx=0x7fcbf802a340 comp rx=0 tx=0).stop 2024-07-26T08:23:31.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 -- 172.21.15.43:0/1134971818 shutdown_connections 2024-07-26T08:23:31.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 --2- 172.21.15.43:0/1134971818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10af10 0x7fcc0c10b320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:31.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 --2- 172.21.15.43:0/1134971818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c10b860 0x7fcc0c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:31.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 --2- 172.21.15.43:0/1134971818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:31.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 -- 172.21.15.43:0/1134971818 >> 172.21.15.43:0/1134971818 conn(0x7fcc0c101040 msgr2=0x7fcc0c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:23:31.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 -- 172.21.15.43:0/1134971818 shutdown_connections 2024-07-26T08:23:31.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.757+0000 7fcc11000640 1 -- 172.21.15.43:0/1134971818 wait complete. 2024-07-26T08:23:31.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.758+0000 7fcc11000640 1 Processor -- start 2024-07-26T08:23:31.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.758+0000 7fcc11000640 1 -- start start 2024-07-26T08:23:31.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc11000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:31.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc11000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc0c10af10 0x7fcc0c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc11000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10b860 0x7fcc0c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc11000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c115640 con 0x7fcc0c1055d0 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc11000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1154c0 con 0x7fcc0c10af10 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc11000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1157c0 con 0x7fcc0c10b860 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc0b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc0b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c19c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47750/0 (socket says 172.21.15.43:47750) 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc0b400640 1 -- 172.21.15.43:0/3149429289 learned_addr learned my addr 172.21.15.43:0/3149429289 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc0aa00640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc0c10af10 0x7fcc0c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.759+0000 7fcc0be00640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10b860 0x7fcc0c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.760+0000 7fcc0b400640 1 -- 172.21.15.43:0/3149429289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10b860 msgr2=0x7fcc0c1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.760+0000 7fcc0b400640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10b860 0x7fcc0c1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.760+0000 7fcc0b400640 1 -- 172.21.15.43:0/3149429289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc0c10af10 msgr2=0x7fcc0c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.760+0000 7fcc0b400640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc0c10af10 0x7fcc0c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.760+0000 7fcc0b400640 1 -- 172.21.15.43:0/3149429289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c1a1fe0 con 0x7fcc0c1055d0 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.760+0000 7fcc0b400640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c19c070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e9f0 tx=0x7fcbfc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.761+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc00cd80 con 0x7fcc0c1055d0 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.761+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c1a22d0 con 0x7fcc0c1055d0 2024-07-26T08:23:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.761+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcbfc010900 con 0x7fcc0c1055d0 2024-07-26T08:23:31.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.761+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0188d0 con 0x7fcc0c1055d0 2024-07-26T08:23:31.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.761+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c1a8a30 con 0x7fcc0c1055d0 2024-07-26T08:23:31.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.762+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0c1059e0 con 0x7fcc0c1055d0 2024-07-26T08:23:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.766+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fcbfc010ab0 con 0x7fcc0c1055d0 2024-07-26T08:23:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.768+0000 7fcc03e00640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbf00b3c20 0x7fcbf00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:23:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.768+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4748+0+0 (secure 0 0 0) 0x7fcbfc0e36e0 con 0x7fcc0c1055d0 2024-07-26T08:23:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.768+0000 7fcc0aa00640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbf00b3c20 0x7fcbf00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:23:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.769+0000 7fcc0aa00640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbf00b3c20 0x7fcbf00b6130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8035040 tx=0x7fcbf80056d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:23:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.770+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcbfc0ab430 con 0x7fcc0c1055d0 2024-07-26T08:23:31.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:23:31.988+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcc0c063230 con 0x7fcbf00b3c20 2024-07-26T08:23:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:32 smithi063 ceph-mon[36747]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-07-26T08:23:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:23:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:23:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:32.722 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:32 smithi043 ceph-mon[32384]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-07-26T08:23:32.722 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:23:32.722 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:23:32.722 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:32 smithi133 ceph-mon[37053]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-07-26T08:23:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:23:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:23:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:33.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:33 smithi043 ceph-mon[32384]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:23:33.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:33 smithi063 ceph-mon[36747]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:23:33.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:33 smithi133 ceph-mon[37053]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:23:34.411 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:34 smithi043 ceph-mon[32384]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:23:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:34 smithi063 ceph-mon[36747]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:23:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:34 smithi133 ceph-mon[37053]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:23:36.676 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:36 smithi043 ceph-mon[32384]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-07-26T08:23:36.676 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3743802063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]: dispatch 2024-07-26T08:23:36.676 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:36 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]: dispatch 2024-07-26T08:23:36.676 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:36 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]': finished 2024-07-26T08:23:36.676 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:36 smithi043 ceph-mon[32384]: osdmap e40: 7 total, 6 up, 7 in 2024-07-26T08:23:36.677 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:23:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:36 smithi133 ceph-mon[37053]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-07-26T08:23:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:36 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3743802063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]: dispatch 2024-07-26T08:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:36 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]: dispatch 2024-07-26T08:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:36 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]': finished 2024-07-26T08:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:36 smithi133 ceph-mon[37053]: osdmap e40: 7 total, 6 up, 7 in 2024-07-26T08:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:23:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:36 smithi063 ceph-mon[36747]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-07-26T08:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:36 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3743802063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]: dispatch 2024-07-26T08:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:36 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]: dispatch 2024-07-26T08:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:36 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff098a4b-47d7-4d9f-856a-dc459c4c50de"}]': finished 2024-07-26T08:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:36 smithi063 ceph-mon[36747]: osdmap e40: 7 total, 6 up, 7 in 2024-07-26T08:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:23:37.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:37 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3647899609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:23:37.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:37 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3647899609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:23:37.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:37 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3647899609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:23:38.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:38 smithi043 ceph-mon[32384]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:23:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:38 smithi133 ceph-mon[37053]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:23:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:38 smithi063 ceph-mon[36747]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:23:40.596 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:40 smithi043 ceph-mon[32384]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-07-26T08:23:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:40 smithi133 ceph-mon[37053]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-07-26T08:23:40.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:40 smithi063 ceph-mon[36747]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-07-26T08:23:42.612 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:42 smithi043 ceph-mon[32384]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:42.619 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:42 smithi063 ceph-mon[36747]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:42 smithi133 ceph-mon[37053]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:44.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:44 smithi043 ceph-mon[32384]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:44 smithi133 ceph-mon[37053]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:44.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:44 smithi063 ceph-mon[36747]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:46.670 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:46 smithi043 ceph-mon[32384]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:46.671 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-26T08:23:46.671 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:46 smithi133 ceph-mon[37053]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-26T08:23:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:46 smithi063 ceph-mon[36747]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:46.831 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-26T08:23:46.831 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:47.723 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:47 smithi043 ceph-mon[32384]: Deploying daemon osd.6 on smithi043 2024-07-26T08:23:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:47 smithi133 ceph-mon[37053]: Deploying daemon osd.6 on smithi043 2024-07-26T08:23:47.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:47 smithi063 ceph-mon[36747]: Deploying daemon osd.6 on smithi043 2024-07-26T08:23:48.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:48 smithi043 ceph-mon[32384]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:48 smithi133 ceph-mon[37053]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:48 smithi063 ceph-mon[36747]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:50.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:50 smithi043 ceph-mon[32384]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:50 smithi133 ceph-mon[37053]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:50 smithi063 ceph-mon[36747]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:51.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:51 smithi043 ceph-mon[32384]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:51 smithi133 ceph-mon[37053]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:51 smithi063 ceph-mon[36747]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:53.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:53 smithi043 ceph-mon[32384]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:54.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:53 smithi133 ceph-mon[37053]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:54.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:53 smithi063 ceph-mon[36747]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:55.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:55 smithi043 ceph-mon[32384]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:55.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:55.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:55.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:55 smithi133 ceph-mon[37053]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:56.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:55 smithi063 ceph-mon[36747]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:56.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:23:56.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:57.857 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:57 smithi043 ceph-mon[32384]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:57 smithi133 ceph-mon[37053]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:58.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:57 smithi063 ceph-mon[36747]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:59 smithi043 ceph-mon[32384]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-26T08:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:23:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:59 smithi133 ceph-mon[37053]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-26T08:23:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:23:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:23:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:59 smithi063 ceph-mon[36747]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-26T08:23:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:23:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:23:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:23:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:00.204 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 6 on host 'smithi043' 2024-07-26T08:24:00.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.201+0000 7fcc03e00640 1 -- 172.21.15.43:0/3149429289 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcc0c063230 con 0x7fcbf00b3c20 2024-07-26T08:24:00.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbf00b3c20 msgr2=0x7fcbf00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbf00b3c20 0x7fcbf00b6130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8035040 tx=0x7fcbf80056d0 comp rx=0 tx=0).stop 2024-07-26T08:24:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 msgr2=0x7fcc0c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c19c070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e9f0 tx=0x7fcbfc00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:24:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 shutdown_connections 2024-07-26T08:24:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbf00b3c20 0x7fcbf00b6130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc0c10b860 0x7fcc0c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc0c10af10 0x7fcc0c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 --2- 172.21.15.43:0/3149429289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc0c1055d0 0x7fcc0c19c070 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 >> 172.21.15.43:0/3149429289 conn(0x7fcc0c101040 msgr2=0x7fcc0c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:24:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.205+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 shutdown_connections 2024-07-26T08:24:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:00.206+0000 7fcc11000640 1 -- 172.21.15.43:0/3149429289 wait complete. 2024-07-26T08:24:00.629 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: osdmap e41: 7 total, 6 up, 7 in 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:00.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:00.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: osdmap e41: 7 total, 6 up, 7 in 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:24:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-26T08:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: osdmap e41: 7 total, 6 up, 7 in 2024-07-26T08:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:01.027 DEBUG:teuthology.orchestra.run.smithi043:osd.6> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.6.service 2024-07-26T08:24:01.033 INFO:tasks.cephadm:Deploying osd.7 on smithi063 with /dev/vg_nvme/lv_2... 2024-07-26T08:24:01.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-26T08:24:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:24:01.561 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:01 smithi043 ceph-mon[32384]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:24:01.561 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:01.561 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:01 smithi043 ceph-mon[32384]: osdmap e42: 7 total, 6 up, 7 in 2024-07-26T08:24:01.562 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:01.686 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:01 smithi063 ceph-mon[36747]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:24:01.687 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:01.687 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:01 smithi063 ceph-mon[36747]: osdmap e42: 7 total, 6 up, 7 in 2024-07-26T08:24:01.687 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:01 smithi133 ceph-mon[37053]: from='osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:24:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:01 smithi133 ceph-mon[37053]: osdmap e42: 7 total, 6 up, 7 in 2024-07-26T08:24:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:02.606 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:02 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:24:02.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:02 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:24:02.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:02 smithi043 ceph-mon[32384]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:24:02.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:02.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:02 smithi043 ceph-mon[32384]: osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] boot 2024-07-26T08:24:02.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:02 smithi043 ceph-mon[32384]: osdmap e43: 7 total, 7 up, 7 in 2024-07-26T08:24:02.707 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:02 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:24:02.708 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:02 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:24:02.708 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:02 smithi063 ceph-mon[36747]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:24:02.708 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:02.708 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:02 smithi063 ceph-mon[36747]: osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] boot 2024-07-26T08:24:02.708 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:02 smithi063 ceph-mon[36747]: osdmap e43: 7 total, 7 up, 7 in 2024-07-26T08:24:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:02 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:24:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:02 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:24:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:02 smithi133 ceph-mon[37053]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-07-26T08:24:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T08:24:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:02 smithi133 ceph-mon[37053]: osd.6 [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] boot 2024-07-26T08:24:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:02 smithi133 ceph-mon[37053]: osdmap e43: 7 total, 7 up, 7 in 2024-07-26T08:24:03.395 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-26T08:24:03.492 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-26T08:24:03.511 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-07-26T08:24:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-07-26T08:24:03.511 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0166024 s, 632 MB/s 2024-07-26T08:24:03.511 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-07-26T08:24:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:03 smithi043 ceph-mon[32384]: osdmap e44: 7 total, 7 up, 7 in 2024-07-26T08:24:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:03 smithi043 ceph-mon[32384]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:03.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:03 smithi133 ceph-mon[37053]: osdmap e44: 7 total, 7 up, 7 in 2024-07-26T08:24:03.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:03 smithi133 ceph-mon[37053]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:03.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:03 smithi063 ceph-mon[36747]: osdmap e44: 7 total, 7 up, 7 in 2024-07-26T08:24:03.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:03 smithi063 ceph-mon[36747]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:04.148 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_2 2024-07-26T08:24:04.408 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:24:05.890 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:05 smithi063 ceph-mon[36747]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:05.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:05 smithi043 ceph-mon[32384]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:05 smithi133 ceph-mon[37053]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 -- 172.21.15.63:0/4601619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c1035f0 msgr2=0x7f585c103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 --2- 172.21.15.63:0/4601619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c1035f0 0x7f585c103a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f584c009900 tx=0x7f584c02a410 comp rx=0 tx=0).stop 2024-07-26T08:24:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 -- 172.21.15.63:0/4601619 shutdown_connections 2024-07-26T08:24:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 --2- 172.21.15.63:0/4601619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585c109830 0x7f585c110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 --2- 172.21.15.63:0/4601619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c108ee0 0x7f585c1092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 --2- 172.21.15.63:0/4601619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c1035f0 0x7f585c103a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.101+0000 7f5863cb7640 1 -- 172.21.15.63:0/4601619 >> 172.21.15.63:0/4601619 conn(0x7f585c07b340 msgr2=0x7f585c07b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:24:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.102+0000 7f5863cb7640 1 -- 172.21.15.63:0/4601619 shutdown_connections 2024-07-26T08:24:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.102+0000 7f5863cb7640 1 -- 172.21.15.63:0/4601619 wait complete. 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.102+0000 7f5863cb7640 1 Processor -- start 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.102+0000 7f5863cb7640 1 -- start start 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5863cb7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585c1035f0 0x7f585c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5863cb7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c108ee0 0x7f585c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5863cb7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 0x7f585c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5863cb7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113690 con 0x7f585c108ee0 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5863cb7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113510 con 0x7f585c109830 2024-07-26T08:24:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5863cb7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113810 con 0x7f585c1035f0 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 0x7f585c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 0x7f585c075bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34262/0 (socket says 172.21.15.63:34262) 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 -- 172.21.15.63:0/2971069453 learned_addr learned my addr 172.21.15.63:0/2971069453 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5861a53640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585c1035f0 0x7f585c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 -- 172.21.15.63:0/2971069453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585c1035f0 msgr2=0x7f585c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585c1035f0 0x7f585c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5861252640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c108ee0 0x7f585c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 -- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c108ee0 msgr2=0x7f585c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c108ee0 0x7f585c075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 -- 172.21.15.63:0/2971069453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c1a82a0 con 0x7f585c109830 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.103+0000 7f5862254640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 0x7f585c075bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f585400eaa0 tx=0x7f585400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.104+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585400cdb0 con 0x7f585c109830 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.104+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5854005020 con 0x7f585c109830 2024-07-26T08:24:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.104+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c1a8590 con 0x7f585c109830 2024-07-26T08:24:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.104+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58540116d0 con 0x7f585c109830 2024-07-26T08:24:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.104+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c1a8b50 con 0x7f585c109830 2024-07-26T08:24:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.105+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c103a00 con 0x7f585c109830 2024-07-26T08:24:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.106+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f58540051d0 con 0x7f585c109830 2024-07-26T08:24:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.107+0000 7f5852ffd640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f58480b3c20 0x7f58480b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.107+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5180+0+0 (secure 0 0 0) 0x7f58540e35e0 con 0x7f585c109830 2024-07-26T08:24:06.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.108+0000 7f5861a53640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f58480b3c20 0x7f58480b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.109+0000 7f5861a53640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f58480b3c20 0x7f58480b6130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f585c076b90 tx=0x7f584c0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:24:06.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.110+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5854016030 con 0x7f585c109830 2024-07-26T08:24:06.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:06.306+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f585c063230 con 0x7f58480b3c20 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi043 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.024 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 5698M 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:07.025 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi043 2024-07-26T08:24:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 5698M 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:07.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi043 2024-07-26T08:24:07.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 5698M 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:07 smithi063 ceph-mon[36747]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:08.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:07 smithi043 ceph-mon[32384]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:08.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:07 smithi133 ceph-mon[37053]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:09.189 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:08 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/2720063229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]: dispatch 2024-07-26T08:24:09.189 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:08 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]: dispatch 2024-07-26T08:24:09.189 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:08 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]': finished 2024-07-26T08:24:09.189 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:09.189 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:08 smithi063 ceph-mon[36747]: osdmap e45: 8 total, 7 up, 8 in 2024-07-26T08:24:09.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:08 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/2720063229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]: dispatch 2024-07-26T08:24:09.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:08 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]: dispatch 2024-07-26T08:24:09.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:08 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]': finished 2024-07-26T08:24:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:08 smithi043 ceph-mon[32384]: osdmap e45: 8 total, 7 up, 8 in 2024-07-26T08:24:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:08 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/2720063229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]: dispatch 2024-07-26T08:24:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:08 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]: dispatch 2024-07-26T08:24:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:08 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2265c2c-251d-48f2-9310-172326a91490"}]': finished 2024-07-26T08:24:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:08 smithi133 ceph-mon[37053]: osdmap e45: 8 total, 7 up, 8 in 2024-07-26T08:24:10.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:09 smithi043 ceph-mon[32384]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:10.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:09 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/1005705391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:24:10.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:09 smithi133 ceph-mon[37053]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:10.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:09 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/1005705391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:24:10.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:09 smithi063 ceph-mon[36747]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:10.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:09 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/1005705391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:24:12.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:11 smithi043 ceph-mon[32384]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:12.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:11 smithi133 ceph-mon[37053]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:12.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:11 smithi063 ceph-mon[36747]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:14.022 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:13 smithi063 ceph-mon[36747]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:14.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:13 smithi043 ceph-mon[32384]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:14.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:13 smithi133 ceph-mon[37053]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:16.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:15 smithi043 ceph-mon[32384]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:15 smithi133 ceph-mon[37053]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:16.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:15 smithi063 ceph-mon[36747]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:17.122 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-26T08:24:17.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:17.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:16 smithi063 ceph-mon[36747]: Deploying daemon osd.7 on smithi063 2024-07-26T08:24:17.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-26T08:24:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:16 smithi043 ceph-mon[32384]: Deploying daemon osd.7 on smithi063 2024-07-26T08:24:17.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-26T08:24:17.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:17.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:16 smithi133 ceph-mon[37053]: Deploying daemon osd.7 on smithi063 2024-07-26T08:24:18.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:17 smithi063 ceph-mon[36747]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:18.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:17 smithi043 ceph-mon[32384]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:17 smithi133 ceph-mon[37053]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:19 smithi063 ceph-mon[36747]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:20.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:19 smithi043 ceph-mon[32384]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:20.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:19 smithi133 ceph-mon[37053]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:22.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:21 smithi063 ceph-mon[36747]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:22.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:22.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:22.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:22.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:21 smithi043 ceph-mon[32384]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:21 smithi133 ceph-mon[37053]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:24.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:23 smithi043 ceph-mon[32384]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:23 smithi133 ceph-mon[37053]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:24.306 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:23 smithi063 ceph-mon[36747]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:25.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.492+0000 7f5852ffd640 1 -- 172.21.15.63:0/2971069453 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f585c063230 con 0x7f58480b3c20 2024-07-26T08:24:25.493 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 7 on host 'smithi063' 2024-07-26T08:24:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f58480b3c20 msgr2=0x7f58480b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f58480b3c20 0x7f58480b6130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f585c076b90 tx=0x7f584c0058d0 comp rx=0 tx=0).stop 2024-07-26T08:24:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 msgr2=0x7f585c075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 0x7f585c075bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f585400eaa0 tx=0x7f585400ef60 comp rx=0 tx=0).stop 2024-07-26T08:24:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 shutdown_connections 2024-07-26T08:24:25.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f58480b3c20 0x7f58480b6130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f585c109830 0x7f585c075bc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c108ee0 0x7f585c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 --2- 172.21.15.63:0/2971069453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585c1035f0 0x7f585c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.494+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 >> 172.21.15.63:0/2971069453 conn(0x7f585c07b340 msgr2=0x7f585c106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:24:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.495+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 shutdown_connections 2024-07-26T08:24:25.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:24:25.495+0000 7f5863cb7640 1 -- 172.21.15.63:0/2971069453 wait complete. 2024-07-26T08:24:25.813 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.814 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:26.181 DEBUG:teuthology.orchestra.run.smithi063:osd.7> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.7.service 2024-07-26T08:24:26.183 INFO:tasks.cephadm:Deploying osd.8 on smithi133 with /dev/vg_nvme/lv_2... 2024-07-26T08:24:26.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-26T08:24:26.445 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:24:26.817 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:26 smithi133 ceph-mon[37053]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-26T08:24:26.817 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:26.817 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:26 smithi133 ceph-mon[37053]: from='osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:24:26.817 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:26 smithi133 ceph-mon[37053]: osdmap e46: 8 total, 7 up, 8 in 2024-07-26T08:24:26.817 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:26 smithi133 ceph-mon[37053]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-mon[36747]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-26T08:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-mon[36747]: from='osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-mon[36747]: osdmap e46: 8 total, 7 up, 8 in 2024-07-26T08:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-mon[36747]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:24:26.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T08:24:26.649+0000 7f43b4c23640 -1 osd.7 0 waiting for initial osdmap 2024-07-26T08:24:26.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 08:24:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T08:24:26.659+0000 7f43b0a21640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:24:26.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:26 smithi043 ceph-mon[32384]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-26T08:24:26.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:26 smithi043 ceph-mon[32384]: from='osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:24:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:26 smithi043 ceph-mon[32384]: osdmap e46: 8 total, 7 up, 8 in 2024-07-26T08:24:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:26 smithi043 ceph-mon[32384]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:24:27.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:27 smithi043 ceph-mon[32384]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:27 smithi043 ceph-mon[32384]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:24:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:27 smithi043 ceph-mon[32384]: osdmap e47: 8 total, 7 up, 8 in 2024-07-26T08:24:27.992 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:27 smithi133 ceph-mon[37053]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:27.992 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:27 smithi133 ceph-mon[37053]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:24:27.993 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:27.993 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:27 smithi133 ceph-mon[37053]: osdmap e47: 8 total, 7 up, 8 in 2024-07-26T08:24:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:27 smithi063 ceph-mon[36747]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-07-26T08:24:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:27 smithi063 ceph-mon[36747]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:24:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:27 smithi063 ceph-mon[36747]: osdmap e47: 8 total, 7 up, 8 in 2024-07-26T08:24:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-26T08:24:28.459 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-26T08:24:28.473 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-07-26T08:24:28.473 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-07-26T08:24:28.473 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011926 s, 879 MB/s 2024-07-26T08:24:28.473 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-07-26T08:24:28.737 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:28 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:24:28.737 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:28 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:24:28.737 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:28.737 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:28 smithi063 ceph-mon[36747]: osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] boot 2024-07-26T08:24:28.737 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:28 smithi063 ceph-mon[36747]: osdmap e48: 8 total, 8 up, 8 in 2024-07-26T08:24:28.869 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:28 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:24:28.869 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:28 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:24:28.869 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:28.869 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:28 smithi133 ceph-mon[37053]: osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] boot 2024-07-26T08:24:28.869 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:28 smithi133 ceph-mon[37053]: osdmap e48: 8 total, 8 up, 8 in 2024-07-26T08:24:28.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:28 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:24:28.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:28 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:24:28.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T08:24:28.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:28 smithi043 ceph-mon[32384]: osd.7 [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] boot 2024-07-26T08:24:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:28 smithi043 ceph-mon[32384]: osdmap e48: 8 total, 8 up, 8 in 2024-07-26T08:24:29.179 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_2 2024-07-26T08:24:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: pgmap v183: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: osdmap e49: 8 total, 8 up, 8 in 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi063 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 5696M 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: pgmap v183: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: osdmap e49: 8 total, 8 up, 8 in 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi063 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 5696M 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: pgmap v183: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: osdmap e49: 8 total, 8 up, 8 in 2024-07-26T08:24:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-07-26T08:24:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi063 2024-07-26T08:24:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 5696M 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2730810550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104d50 msgr2=0x7f0e4010d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2730810550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104d50 0x7f0e4010d2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009900 tx=0x7f0e3002a410 comp rx=0 tx=0).stop 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2730810550 shutdown_connections 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2730810550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104d50 0x7f0e4010d2a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2730810550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e4010d860 0x7f0e4010fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2730810550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e40104400 0x7f0e40104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2730810550 >> 172.21.15.133:0/2730810550 conn(0x7f0e40079170 msgr2=0x7f0e40079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2730810550 shutdown_connections 2024-07-26T08:24:31.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.174+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2730810550 wait complete. 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.175+0000 7f0e47b2a640 1 Processor -- start 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.175+0000 7f0e47b2a640 1 -- start start 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.175+0000 7f0e47b2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 0x7f0e4019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.175+0000 7f0e47b2a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40104d50 0x7f0e4019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.175+0000 7f0e47b2a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e4010d860 0x7f0e4019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e47b2a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40113640 con 0x7f0e40104d50 2024-07-26T08:24:31.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e47b2a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e401134c0 con 0x7f0e4010d860 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e47b2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0e401137c0 con 0x7f0e40104400 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 0x7f0e4019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 0x7f0e4019a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56578/0 (socket says 172.21.15.133:56578) 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 -- 172.21.15.133:0/2474472538 learned_addr learned my addr 172.21.15.133:0/2474472538 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e460c7640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e4010d860 0x7f0e4019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 -- 172.21.15.133:0/2474472538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e4010d860 msgr2=0x7f0e4019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e4010d860 0x7f0e4019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 -- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40104d50 msgr2=0x7f0e4019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40104d50 0x7f0e4019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 -- 172.21.15.133:0/2474472538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4019ffa0 con 0x7f0e40104400 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e458c6640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 0x7f0e4019a030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009fd0 tx=0x7f0e3c00c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c011470 con 0x7f0e40104400 2024-07-26T08:24:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e401a0290 con 0x7f0e40104400 2024-07-26T08:24:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e3c011ae0 con 0x7f0e40104400 2024-07-26T08:24:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c01ab60 con 0x7f0e40104400 2024-07-26T08:24:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.176+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e401a69f0 con 0x7f0e40104400 2024-07-26T08:24:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.178+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4006b950 con 0x7f0e40104400 2024-07-26T08:24:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.179+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f0e3c01ad00 con 0x7f0e40104400 2024-07-26T08:24:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.179+0000 7f0e36ffd640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e2c0b3c20 0x7f0e2c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.180+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5612+0+0 (secure 0 0 0) 0x7f0e3c0e3740 con 0x7f0e40104400 2024-07-26T08:24:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.180+0000 7f0e450c5640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e2c0b3c20 0x7f0e2c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:31.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.181+0000 7f0e450c5640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e2c0b3c20 0x7f0e2c0b6130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e300096c0 tx=0x7f0e30000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:24:31.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.184+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0e3c016030 con 0x7f0e40104400 2024-07-26T08:24:31.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:31.366+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0e401006c0 con 0x7f0e2c0b3c20 2024-07-26T08:24:31.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:31 smithi043 ceph-mon[32384]: osdmap e50: 8 total, 8 up, 8 in 2024-07-26T08:24:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:31 smithi133 ceph-mon[37053]: osdmap e50: 8 total, 8 up, 8 in 2024-07-26T08:24:31.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:31 smithi063 ceph-mon[36747]: osdmap e50: 8 total, 8 up, 8 in 2024-07-26T08:24:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:32 smithi043 ceph-mon[32384]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:32.508 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:32 smithi133 ceph-mon[37053]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:32.508 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:32.508 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:32.508 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:32 smithi063 ceph-mon[36747]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:33.442 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:33 smithi133 ceph-mon[37053]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:33.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:33 smithi043 ceph-mon[32384]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:33.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:33 smithi063 ceph-mon[36747]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:34.381 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:34 smithi133 ceph-mon[37053]: pgmap v187: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:34.381 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:34 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/1082360880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]: dispatch 2024-07-26T08:24:34.381 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:34 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]: dispatch 2024-07-26T08:24:34.381 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:34 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]': finished 2024-07-26T08:24:34.381 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:34.381 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:34 smithi133 ceph-mon[37053]: osdmap e51: 9 total, 8 up, 9 in 2024-07-26T08:24:34.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:34 smithi043 ceph-mon[32384]: pgmap v187: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:34 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/1082360880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]: dispatch 2024-07-26T08:24:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:34 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]: dispatch 2024-07-26T08:24:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:34 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]': finished 2024-07-26T08:24:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:34 smithi043 ceph-mon[32384]: osdmap e51: 9 total, 8 up, 9 in 2024-07-26T08:24:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:34 smithi063 ceph-mon[36747]: pgmap v187: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:34 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/1082360880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]: dispatch 2024-07-26T08:24:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:34 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]: dispatch 2024-07-26T08:24:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:34 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13ecadf6-6a1a-4f91-a2b2-eac06fb449d3"}]': finished 2024-07-26T08:24:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:34 smithi063 ceph-mon[36747]: osdmap e51: 9 total, 8 up, 9 in 2024-07-26T08:24:35.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:35 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/679436999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:24:35.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:35 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/679436999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:24:35.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:35 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/679436999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:24:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:36 smithi133 ceph-mon[37053]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-07-26T08:24:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:36 smithi133 ceph-mon[37053]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-07-26T08:24:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:36 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:24:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:36 smithi063 ceph-mon[36747]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-07-26T08:24:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:36 smithi063 ceph-mon[36747]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-07-26T08:24:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:36 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:24:36.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:36 smithi043 ceph-mon[32384]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-07-26T08:24:36.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:36 smithi043 ceph-mon[32384]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-07-26T08:24:36.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:36 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:24:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:38 smithi133 ceph-mon[37053]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-07-26T08:24:38.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:38 smithi063 ceph-mon[36747]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-07-26T08:24:38.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:38 smithi043 ceph-mon[32384]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-07-26T08:24:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:40 smithi133 ceph-mon[37053]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-07-26T08:24:40.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:40 smithi063 ceph-mon[36747]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-07-26T08:24:40.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:40 smithi043 ceph-mon[32384]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-07-26T08:24:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-26T08:24:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:41.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-26T08:24:41.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:41.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-26T08:24:41.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:42 smithi133 ceph-mon[37053]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-07-26T08:24:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:42 smithi133 ceph-mon[37053]: Deploying daemon osd.8 on smithi133 2024-07-26T08:24:42.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:42 smithi063 ceph-mon[36747]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-07-26T08:24:42.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:42 smithi063 ceph-mon[36747]: Deploying daemon osd.8 on smithi133 2024-07-26T08:24:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:42 smithi043 ceph-mon[32384]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-07-26T08:24:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:42 smithi043 ceph-mon[32384]: Deploying daemon osd.8 on smithi133 2024-07-26T08:24:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:44 smithi133 ceph-mon[37053]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-07-26T08:24:44.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:44 smithi063 ceph-mon[36747]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-07-26T08:24:44.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:44 smithi043 ceph-mon[32384]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-07-26T08:24:46.532 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:46 smithi133 ceph-mon[37053]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:46.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:46 smithi063 ceph-mon[36747]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:46.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:46 smithi043 ceph-mon[32384]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:47.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:47.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:48.440 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:48 smithi133 ceph-mon[37053]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:48 smithi063 ceph-mon[36747]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:48.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:48 smithi043 ceph-mon[32384]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:49.871 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 8 on host 'smithi133' 2024-07-26T08:24:49.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.870+0000 7f0e36ffd640 1 -- 172.21.15.133:0/2474472538 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0e401006c0 con 0x7f0e2c0b3c20 2024-07-26T08:24:49.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e2c0b3c20 msgr2=0x7f0e2c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:49.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e2c0b3c20 0x7f0e2c0b6130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e300096c0 tx=0x7f0e30000bc0 comp rx=0 tx=0).stop 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 msgr2=0x7f0e4019a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 0x7f0e4019a030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009fd0 tx=0x7f0e3c00c270 comp rx=0 tx=0).stop 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 shutdown_connections 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e2c0b3c20 0x7f0e2c0b6130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e4010d860 0x7f0e4019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40104d50 0x7f0e4019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 --2- 172.21.15.133:0/2474472538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e40104400 0x7f0e4019a030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 >> 172.21.15.133:0/2474472538 conn(0x7f0e40079170 msgr2=0x7f0e400fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 shutdown_connections 2024-07-26T08:24:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:24:49.872+0000 7f0e47b2a640 1 -- 172.21.15.133:0/2474472538 wait complete. 2024-07-26T08:24:50.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:50 smithi043 ceph-mon[32384]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:50.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:50.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:50 smithi063 ceph-mon[36747]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:50.584 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:50 smithi133 ceph-mon[37053]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:50.584 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:50.584 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:50.612 DEBUG:teuthology.orchestra.run.smithi133:osd.8> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.8.service 2024-07-26T08:24:50.614 INFO:tasks.cephadm:Deploying osd.9 on smithi043 with /dev/vg_nvme/lv_1... 2024-07-26T08:24:50.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-26T08:24:51.114 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:24:51.497 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:51 smithi133 ceph-mon[37053]: from='osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T08:24:51.498 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:51 smithi133 ceph-mon[37053]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T08:24:51.498 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:51.498 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:51.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:51 smithi063 ceph-mon[36747]: from='osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T08:24:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:51 smithi063 ceph-mon[36747]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T08:24:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:51.600 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:51 smithi043 ceph-mon[32384]: from='osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T08:24:51.600 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:51 smithi043 ceph-mon[32384]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T08:24:51.600 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:51.600 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:52.480 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:52 smithi133 ceph-mon[37053]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:52.480 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:52 smithi133 ceph-mon[37053]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-26T08:24:52.480 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:52.480 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:52 smithi133 ceph-mon[37053]: from='osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:24:52.480 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:52 smithi133 ceph-mon[37053]: osdmap e52: 9 total, 8 up, 9 in 2024-07-26T08:24:52.481 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:52 smithi133 ceph-mon[37053]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:24:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:52 smithi063 ceph-mon[36747]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:52 smithi063 ceph-mon[36747]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-26T08:24:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:52 smithi063 ceph-mon[36747]: from='osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:24:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:52 smithi063 ceph-mon[36747]: osdmap e52: 9 total, 8 up, 9 in 2024-07-26T08:24:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:52 smithi063 ceph-mon[36747]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:24:52.612 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:52 smithi043 ceph-mon[32384]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:52.612 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:52 smithi043 ceph-mon[32384]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-26T08:24:52.612 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:52.612 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:52 smithi043 ceph-mon[32384]: from='osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:24:52.612 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:52 smithi043 ceph-mon[32384]: osdmap e52: 9 total, 8 up, 9 in 2024-07-26T08:24:52.613 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:52 smithi043 ceph-mon[32384]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:24:53.325 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:24:53.326 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.326 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: osdmap e53: 9 total, 8 up, 9 in 2024-07-26T08:24:53.326 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T08:24:53.015+0000 7f930638a640 -1 osd.8 0 waiting for initial osdmap 2024-07-26T08:24:53.326 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T08:24:53.029+0000 7f92fd96b640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:24:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:24:53.503 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.503 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: osdmap e53: 9 total, 8 up, 9 in 2024-07-26T08:24:53.503 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.504 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: from='osd.8 ' entity='osd.8' 2024-07-26T08:24:53.504 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.504 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] boot 2024-07-26T08:24:53.504 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:53 smithi043 ceph-mon[32384]: osdmap e54: 9 total, 9 up, 9 in 2024-07-26T08:24:53.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:24:53.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: osdmap e53: 9 total, 8 up, 9 in 2024-07-26T08:24:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: from='osd.8 ' entity='osd.8' 2024-07-26T08:24:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] boot 2024-07-26T08:24:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:53 smithi063 ceph-mon[36747]: osdmap e54: 9 total, 9 up, 9 in 2024-07-26T08:24:53.620 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.620 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: from='osd.8 ' entity='osd.8' 2024-07-26T08:24:53.620 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T08:24:53.620 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: osd.8 [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] boot 2024-07-26T08:24:53.620 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:53 smithi133 ceph-mon[37053]: osdmap e54: 9 total, 9 up, 9 in 2024-07-26T08:24:53.894 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-26T08:24:54.069 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-26T08:24:54.111 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-07-26T08:24:54.111 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-07-26T08:24:54.111 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0347249 s, 302 MB/s 2024-07-26T08:24:54.112 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:54.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:54.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:54.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:54 smithi043 ceph-mon[32384]: osdmap e55: 9 total, 9 up, 9 in 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:54.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:54.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:54 smithi133 ceph-mon[37053]: osdmap e55: 9 total, 9 up, 9 in 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:24:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:54 smithi063 ceph-mon[36747]: osdmap e55: 9 total, 9 up, 9 in 2024-07-26T08:24:55.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_1 2024-07-26T08:24:55.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:55 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi133 2024-07-26T08:24:55.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:55 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 5696M 2024-07-26T08:24:55.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:55 smithi043 ceph-mon[32384]: osdmap e56: 9 total, 9 up, 9 in 2024-07-26T08:24:55.567 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:24:55.646 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:55 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi133 2024-07-26T08:24:55.647 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:55 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 5696M 2024-07-26T08:24:55.647 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:55 smithi133 ceph-mon[37053]: osdmap e56: 9 total, 9 up, 9 in 2024-07-26T08:24:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:55 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi133 2024-07-26T08:24:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:55 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 5696M 2024-07-26T08:24:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:55 smithi063 ceph-mon[36747]: osdmap e56: 9 total, 9 up, 9 in 2024-07-26T08:24:56.591 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:56 smithi043 ceph-mon[32384]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 523 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:24:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:56 smithi133 ceph-mon[37053]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 523 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:24:56.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:56 smithi063 ceph-mon[36747]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 523 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:24:57.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 -- 172.21.15.43:0/2005530159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c01057e0 msgr2=0x7fa5c0105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:57.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 --2- 172.21.15.43:0/2005530159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c01057e0 0x7fa5c0105bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009900 tx=0x7fa5b402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:24:57.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 -- 172.21.15.43:0/2005530159 shutdown_connections 2024-07-26T08:24:57.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 --2- 172.21.15.43:0/2005530159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c010b120 0x7fa5c010b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:57.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 --2- 172.21.15.43:0/2005530159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:57.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 --2- 172.21.15.43:0/2005530159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c01057e0 0x7fa5c0105bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:57.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 -- 172.21.15.43:0/2005530159 >> 172.21.15.43:0/2005530159 conn(0x7fa5c01011f0 msgr2=0x7fa5c0103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:24:57.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.902+0000 7fa5c8600640 1 -- 172.21.15.43:0/2005530159 shutdown_connections 2024-07-26T08:24:57.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.903+0000 7fa5c8600640 1 -- 172.21.15.43:0/2005530159 wait complete. 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 Processor -- start 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 -- start start 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 0x7fa5c019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c010b120 0x7fa5c019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c01158c0 con 0x7fa5c010ba70 2024-07-26T08:24:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0115740 con 0x7fa5c010b120 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.904+0000 7fa5c8600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0115a40 con 0x7fa5c01057e0 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 0x7fa5c019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 0x7fa5c019c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:38300/0 (socket says 172.21.15.43:38300) 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46570/0 (socket says 172.21.15.43:46570) 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 -- 172.21.15.43:0/3021505193 learned_addr learned my addr 172.21.15.43:0/3021505193 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:24:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5200640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c010b120 0x7fa5c019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 -- 172.21.15.43:0/3021505193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c010b120 msgr2=0x7fa5c019c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c010b120 0x7fa5c019c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 -- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 msgr2=0x7fa5c01a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5c00640 1 -- 172.21.15.43:0/3021505193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c01a21a0 con 0x7fa5c01057e0 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c6600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:24:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.905+0000 7fa5c5200640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c010b120 0x7fa5c019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.906+0000 7fa5c5c00640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 0x7fa5c019c230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40314b0 tx=0x7fa5b4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.906+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b403f070 con 0x7fa5c01057e0 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.906+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5b4031bf0 con 0x7fa5c01057e0 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.906+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4035030 con 0x7fa5c01057e0 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.906+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c01a2430 con 0x7fa5c01057e0 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.906+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c01a8bf0 con 0x7fa5c01057e0 2024-07-26T08:24:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.907+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c0106a60 con 0x7fa5c01057e0 2024-07-26T08:24:57.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.910+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fa5b4042070 con 0x7fa5c01057e0 2024-07-26T08:24:57.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.911+0000 7fa5be000640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5a80b3c20 0x7fa5a80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:24:57.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.912+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6044+0+0 (secure 0 0 0) 0x7fa5b41041a0 con 0x7fa5c01057e0 2024-07-26T08:24:57.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.912+0000 7fa5c5200640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5a80b3c20 0x7fa5a80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:24:57.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.913+0000 7fa5c5200640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5a80b3c20 0x7fa5a80b6130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0103b00 tx=0x7fa5ac005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:24:57.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:57.914+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa5b40cc030 con 0x7fa5c01057e0 2024-07-26T08:24:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:24:58.127+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa5c0063230 con 0x7fa5a80b3c20 2024-07-26T08:24:58.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:58 smithi043 ceph-mon[32384]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 523 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:24:58.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:58 smithi133 ceph-mon[37053]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 523 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:24:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:58.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:58 smithi063 ceph-mon[36747]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 523 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:24:58.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:24:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:24:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:24:59.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:24:59 smithi043 ceph-mon[32384]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:59.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:24:59 smithi133 ceph-mon[37053]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:24:59.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:24:59 smithi063 ceph-mon[36747]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:25:00.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:00 smithi043 ceph-mon[32384]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:25:00.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:00 smithi133 ceph-mon[37053]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:25:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:00 smithi063 ceph-mon[36747]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:25:02.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:02 smithi043 ceph-mon[32384]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-07-26T08:25:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:02 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3898866737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4273c6ec-9a65-4f59-8200-0aad0c554159"}]: dispatch 2024-07-26T08:25:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:02 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3898866737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4273c6ec-9a65-4f59-8200-0aad0c554159"}]': finished 2024-07-26T08:25:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:02 smithi043 ceph-mon[32384]: osdmap e57: 10 total, 9 up, 10 in 2024-07-26T08:25:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:02 smithi133 ceph-mon[37053]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-07-26T08:25:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:02 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3898866737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4273c6ec-9a65-4f59-8200-0aad0c554159"}]: dispatch 2024-07-26T08:25:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:02 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3898866737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4273c6ec-9a65-4f59-8200-0aad0c554159"}]': finished 2024-07-26T08:25:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:02 smithi133 ceph-mon[37053]: osdmap e57: 10 total, 9 up, 10 in 2024-07-26T08:25:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:02 smithi063 ceph-mon[36747]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-07-26T08:25:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:02 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3898866737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4273c6ec-9a65-4f59-8200-0aad0c554159"}]: dispatch 2024-07-26T08:25:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:02 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3898866737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4273c6ec-9a65-4f59-8200-0aad0c554159"}]': finished 2024-07-26T08:25:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:02 smithi063 ceph-mon[36747]: osdmap e57: 10 total, 9 up, 10 in 2024-07-26T08:25:03.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2257728700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:25:03.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:03 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2257728700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:25:03.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:03 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2257728700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:25:04.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:04 smithi043 ceph-mon[32384]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:25:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:04 smithi133 ceph-mon[37053]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:25:04.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:04 smithi063 ceph-mon[36747]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T08:25:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:05 smithi133 ceph-mon[37053]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-07-26T08:25:05.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:05 smithi063 ceph-mon[36747]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-07-26T08:25:05.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:05 smithi043 ceph-mon[32384]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-07-26T08:25:07.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:07 smithi043 ceph-mon[32384]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T08:25:08.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:07 smithi133 ceph-mon[37053]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T08:25:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:07 smithi063 ceph-mon[36747]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T08:25:09.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:09 smithi043 ceph-mon[32384]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:09 smithi133 ceph-mon[37053]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:10.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:09 smithi063 ceph-mon[36747]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:11 smithi043 ceph-mon[32384]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:11 smithi133 ceph-mon[37053]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:11 smithi063 ceph-mon[36747]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:12.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-26T08:25:12.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:12.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:12 smithi043 ceph-mon[32384]: Deploying daemon osd.9 on smithi043 2024-07-26T08:25:12.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-26T08:25:12.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:12.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:12 smithi063 ceph-mon[36747]: Deploying daemon osd.9 on smithi043 2024-07-26T08:25:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-26T08:25:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:12 smithi133 ceph-mon[37053]: Deploying daemon osd.9 on smithi043 2024-07-26T08:25:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:13 smithi043 ceph-mon[32384]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:14.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:13 smithi133 ceph-mon[37053]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:14.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:13 smithi063 ceph-mon[36747]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:15.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:15 smithi043 ceph-mon[32384]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:15 smithi133 ceph-mon[37053]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:16.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:15 smithi063 ceph-mon[36747]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:17.965 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:17 smithi043 ceph-mon[32384]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:17 smithi133 ceph-mon[37053]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:18.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:17 smithi063 ceph-mon[36747]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:19.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:19 smithi043 ceph-mon[32384]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:20.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:19 smithi133 ceph-mon[37053]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:19 smithi063 ceph-mon[36747]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:21.976 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:21 smithi043 ceph-mon[32384]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:21.976 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:21.976 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:21.976 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:21 smithi133 ceph-mon[37053]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:21 smithi063 ceph-mon[36747]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:23.972 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:23 smithi043 ceph-mon[32384]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:24.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:23 smithi133 ceph-mon[37053]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:23 smithi063 ceph-mon[36747]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T08:25:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T08:25:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T08:25:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T08:25:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:26.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.418+0000 7fa5be000640 1 -- 172.21.15.43:0/3021505193 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa5c0063230 con 0x7fa5a80b3c20 2024-07-26T08:25:26.421 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 9 on host 'smithi043' 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5a80b3c20 msgr2=0x7fa5a80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5a80b3c20 0x7fa5a80b6130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0103b00 tx=0x7fa5ac005f90 comp rx=0 tx=0).stop 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 msgr2=0x7fa5c019c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 0x7fa5c019c230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40314b0 tx=0x7fa5b4003c10 comp rx=0 tx=0).stop 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 shutdown_connections 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5a80b3c20 0x7fa5a80b6130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5c010ba70 0x7fa5c01a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:26.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5c010b120 0x7fa5c019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:26.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 --2- 172.21.15.43:0/3021505193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c01057e0 0x7fa5c019c230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:26.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.422+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 >> 172.21.15.43:0/3021505193 conn(0x7fa5c01011f0 msgr2=0x7fa5c0104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:25:26.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.423+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 shutdown_connections 2024-07-26T08:25:26.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:25:26.423+0000 7fa5c8600640 1 -- 172.21.15.43:0/3021505193 wait complete. 2024-07-26T08:25:27.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: osdmap e58: 10 total, 9 up, 10 in 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:27.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-26T08:25:27.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: osdmap e58: 10 total, 9 up, 10 in 2024-07-26T08:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:27.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-26T08:25:27.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: osdmap e58: 10 total, 9 up, 10 in 2024-07-26T08:25:27.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:27.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:25:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-07-26T08:25:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:27.463 DEBUG:teuthology.orchestra.run.smithi043:osd.9> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.9.service 2024-07-26T08:25:27.468 INFO:tasks.cephadm:Deploying osd.10 on smithi063 with /dev/vg_nvme/lv_1... 2024-07-26T08:25:27.468 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-26T08:25:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:25:27.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-mon[32384]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:27.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-mon[32384]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:25:27.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-mon[32384]: osdmap e59: 10 total, 9 up, 10 in 2024-07-26T08:25:27.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:27.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:27.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-mon[32384]: from='osd.9 ' entity='osd.9' 2024-07-26T08:25:27.935 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T08:25:27.680+0000 7fbfb8200640 -1 osd.9 0 waiting for initial osdmap 2024-07-26T08:25:27.935 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 08:25:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T08:25:27.718+0000 7fbfad800640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:25:28.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:27 smithi063 ceph-mon[36747]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:28.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:27 smithi063 ceph-mon[36747]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:25:28.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:27 smithi063 ceph-mon[36747]: osdmap e59: 10 total, 9 up, 10 in 2024-07-26T08:25:28.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:28.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:28.123 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:27 smithi063 ceph-mon[36747]: from='osd.9 ' entity='osd.9' 2024-07-26T08:25:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:27 smithi133 ceph-mon[37053]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:27 smithi133 ceph-mon[37053]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-07-26T08:25:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:27 smithi133 ceph-mon[37053]: osdmap e59: 10 total, 9 up, 10 in 2024-07-26T08:25:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:27 smithi133 ceph-mon[37053]: from='osd.9 ' entity='osd.9' 2024-07-26T08:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:28 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:28 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:28 smithi043 ceph-mon[32384]: osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] boot 2024-07-26T08:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:28 smithi043 ceph-mon[32384]: osdmap e60: 10 total, 10 up, 10 in 2024-07-26T08:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:29.253 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:28 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:25:29.254 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:28 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:25:29.254 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:29.254 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:28 smithi063 ceph-mon[36747]: osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] boot 2024-07-26T08:25:29.254 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:28 smithi063 ceph-mon[36747]: osdmap e60: 10 total, 10 up, 10 in 2024-07-26T08:25:29.254 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:28 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:25:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:28 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:25:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:28 smithi133 ceph-mon[37053]: osd.9 [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] boot 2024-07-26T08:25:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:28 smithi133 ceph-mon[37053]: osdmap e60: 10 total, 10 up, 10 in 2024-07-26T08:25:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T08:25:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-26T08:25:29.870 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-26T08:25:29.884 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-07-26T08:25:29.884 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-07-26T08:25:29.884 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112892 s, 929 MB/s 2024-07-26T08:25:29.884 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-07-26T08:25:30.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:29 smithi063 ceph-mon[36747]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:29 smithi043 ceph-mon[32384]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:30.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:29 smithi133 ceph-mon[37053]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-07-26T08:25:30.704 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_1 2024-07-26T08:25:30.984 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.b/config 2024-07-26T08:25:31.003 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:30 smithi063 ceph-mon[36747]: osdmap e61: 10 total, 10 up, 10 in 2024-07-26T08:25:31.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:30 smithi043 ceph-mon[32384]: osdmap e61: 10 total, 10 up, 10 in 2024-07-26T08:25:31.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:30 smithi133 ceph-mon[37053]: osdmap e61: 10 total, 10 up, 10 in 2024-07-26T08:25:32.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:31 smithi043 ceph-mon[32384]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:32.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:31 smithi133 ceph-mon[37053]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:32.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:31 smithi063 ceph-mon[36747]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 -- 172.21.15.63:0/685916496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc102490 msgr2=0x7fe5fc1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 --2- 172.21.15.63:0/685916496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc102490 0x7fe5fc1028a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009900 tx=0x7fe5f802a410 comp rx=0 tx=0).stop 2024-07-26T08:25:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 -- 172.21.15.63:0/685916496 shutdown_connections 2024-07-26T08:25:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 --2- 172.21.15.63:0/685916496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 --2- 172.21.15.63:0/685916496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5fc108720 0x7fe5fc10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 --2- 172.21.15.63:0/685916496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc102490 0x7fe5fc1028a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 -- 172.21.15.63:0/685916496 >> 172.21.15.63:0/685916496 conn(0x7fe5fc079160 msgr2=0x7fe5fc079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 -- 172.21.15.63:0/685916496 shutdown_connections 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.853+0000 7fe604386640 1 -- 172.21.15.63:0/685916496 wait complete. 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 Processor -- start 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 -- start start 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5fc102490 0x7fe5fc103c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5fc108720 0x7fe5fc104700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc1125a0 con 0x7fe5fc102490 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc112420 con 0x7fe5fc107dd0 2024-07-26T08:25:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe604386640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc112720 con 0x7fe5fc108720 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.854+0000 7fe601921640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1041c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55284/0 (socket says 172.21.15.63:55284) 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 -- 172.21.15.63:0/865253376 learned_addr learned my addr 172.21.15.63:0/865253376 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe602923640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5fc108720 0x7fe5fc104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 -- 172.21.15.63:0/865253376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5fc108720 msgr2=0x7fe5fc104700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5fc108720 0x7fe5fc104700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 -- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5fc102490 msgr2=0x7fe5fc103c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5fc102490 0x7fe5fc103c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 -- 172.21.15.63:0/865253376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5fc1a82a0 con 0x7fe5fc107dd0 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe601921640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1041c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00d740 tx=0x7fe5ec00dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec017070 con 0x7fe5fc107dd0 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5ec00de50 con 0x7fe5fc107dd0 2024-07-26T08:25:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5fc1a8590 con 0x7fe5fc107dd0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec004d90 con 0x7fe5fc107dd0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.855+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5fc1a8b00 con 0x7fe5fc107dd0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.857+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5fc1028a0 con 0x7fe5fc107dd0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.858+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fe5ec005000 con 0x7fe5fc107dd0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.859+0000 7fe5f37fe640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe5e80b3c20 0x7fe5e80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.859+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6476+0+0 (secure 0 0 0) 0x7fe5ec0e3390 con 0x7fe5fc107dd0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.859+0000 7fe602122640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe5e80b3c20 0x7fe5e80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.861+0000 7fe602122640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe5e80b3c20 0x7fe5e80b6130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009230 tx=0x7fe5f8000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:25:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:32.862+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe5ec0ab110 con 0x7fe5fc107dd0 2024-07-26T08:25:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:33.059+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe5fc06a8e0 con 0x7fe5e80b3c20 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi043 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 4273M 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='client.24554 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:25:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:25:33.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:25:33.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi043 2024-07-26T08:25:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 4273M 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:33.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='client.24554 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:25:33.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:25:33.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:25:33.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi043 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 4273M 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='client.24554 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:25:34.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:35.958 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:35 smithi063 ceph-mon[36747]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:35.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:35 smithi043 ceph-mon[32384]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:36.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:35 smithi133 ceph-mon[37053]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/1878355149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]: dispatch 2024-07-26T08:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:36 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]: dispatch 2024-07-26T08:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:36 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]': finished 2024-07-26T08:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:36 smithi043 ceph-mon[32384]: osdmap e62: 11 total, 10 up, 11 in 2024-07-26T08:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.63:0/3381038554' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:25:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:36 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/1878355149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]: dispatch 2024-07-26T08:25:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:36 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]: dispatch 2024-07-26T08:25:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:36 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]': finished 2024-07-26T08:25:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:36 smithi133 ceph-mon[37053]: osdmap e62: 11 total, 10 up, 11 in 2024-07-26T08:25:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:36 smithi133 ceph-mon[37053]: from='client.? 172.21.15.63:0/3381038554' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:25:37.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:36 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/1878355149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]: dispatch 2024-07-26T08:25:37.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:36 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]: dispatch 2024-07-26T08:25:37.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:36 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8edd2a1c-458b-4853-894d-572b92611d54"}]': finished 2024-07-26T08:25:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:36 smithi063 ceph-mon[36747]: osdmap e62: 11 total, 10 up, 11 in 2024-07-26T08:25:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:36 smithi063 ceph-mon[36747]: from='client.? 172.21.15.63:0/3381038554' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:25:37.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:37 smithi043 ceph-mon[32384]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:38.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:37 smithi133 ceph-mon[37053]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:38.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:37 smithi063 ceph-mon[36747]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:39.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:39 smithi043 ceph-mon[32384]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:40.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:39 smithi133 ceph-mon[37053]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:40.026 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:39 smithi063 ceph-mon[36747]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:41.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:41 smithi063 ceph-mon[36747]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:41.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:41 smithi043 ceph-mon[32384]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:42.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:41 smithi133 ceph-mon[37053]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:43.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:43 smithi043 ceph-mon[32384]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-26T08:25:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:43 smithi043 ceph-mon[32384]: Deploying daemon osd.10 on smithi063 2024-07-26T08:25:44.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:43 smithi133 ceph-mon[37053]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:44.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-26T08:25:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:43 smithi133 ceph-mon[37053]: Deploying daemon osd.10 on smithi063 2024-07-26T08:25:44.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:43 smithi063 ceph-mon[36747]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-26T08:25:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:43 smithi063 ceph-mon[36747]: Deploying daemon osd.10 on smithi063 2024-07-26T08:25:45.799 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:45 smithi063 ceph-mon[36747]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:45.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:45 smithi043 ceph-mon[32384]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:46.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:45 smithi133 ceph-mon[37053]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:47.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:47 smithi063 ceph-mon[36747]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:47.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:47 smithi043 ceph-mon[32384]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:48.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:47 smithi133 ceph-mon[37053]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:48.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:48.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:48.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:48.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:48.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:48.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:49.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:49 smithi043 ceph-mon[32384]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:50.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:49 smithi133 ceph-mon[37053]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:50.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:49 smithi063 ceph-mon[36747]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:51 smithi043 ceph-mon[32384]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:51.991 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:51 smithi063 ceph-mon[36747]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:51.991 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:51.991 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:51.991 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:51.991 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:51.991 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:51 smithi133 ceph-mon[37053]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:52.360 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 10 on host 'smithi063' 2024-07-26T08:25:52.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.359+0000 7fe5f37fe640 1 -- 172.21.15.63:0/865253376 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe5fc06a8e0 con 0x7fe5e80b3c20 2024-07-26T08:25:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe5e80b3c20 msgr2=0x7fe5e80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe5e80b3c20 0x7fe5e80b6130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009230 tx=0x7fe5f8000bc0 comp rx=0 tx=0).stop 2024-07-26T08:25:52.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 msgr2=0x7fe5fc1041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1041c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00d740 tx=0x7fe5ec00dc00 comp rx=0 tx=0).stop 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 shutdown_connections 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe5e80b3c20 0x7fe5e80b6130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5fc108720 0x7fe5fc104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc107dd0 0x7fe5fc1041c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 --2- 172.21.15.63:0/865253376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5fc102490 0x7fe5fc103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 >> 172.21.15.63:0/865253376 conn(0x7fe5fc079160 msgr2=0x7fe5fc1060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 shutdown_connections 2024-07-26T08:25:52.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-07-26T08:25:52.362+0000 7fe604386640 1 -- 172.21.15.63:0/865253376 wait complete. 2024-07-26T08:25:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:52 smithi043 ceph-mon[32384]: from='osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T08:25:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:52 smithi043 ceph-mon[32384]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T08:25:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:52 smithi133 ceph-mon[37053]: from='osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T08:25:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:52 smithi133 ceph-mon[37053]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T08:25:53.046 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:25:53.046 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:53.046 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:53.046 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:52 smithi063 ceph-mon[36747]: from='osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T08:25:53.046 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:52 smithi063 ceph-mon[36747]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T08:25:53.072 DEBUG:teuthology.orchestra.run.smithi063:osd.10> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.10.service 2024-07-26T08:25:53.075 INFO:tasks.cephadm:Deploying osd.11 on smithi133 with /dev/vg_nvme/lv_1... 2024-07-26T08:25:53.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-26T08:25:53.335 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:25:54.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-mon[36747]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:54.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-mon[36747]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-26T08:25:54.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-mon[36747]: from='osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:25:54.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-mon[36747]: osdmap e63: 11 total, 10 up, 11 in 2024-07-26T08:25:54.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-mon[36747]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:25:54.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:54.558 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T08:25:54.367+0000 7f97ef7fe640 -1 osd.10 0 waiting for initial osdmap 2024-07-26T08:25:54.558 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 08:25:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T08:25:54.380+0000 7f97eb5fc640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:25:54.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:54 smithi133 ceph-mon[37053]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:54.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:54 smithi133 ceph-mon[37053]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-26T08:25:54.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:54 smithi133 ceph-mon[37053]: from='osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:25:54.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:54 smithi133 ceph-mon[37053]: osdmap e63: 11 total, 10 up, 11 in 2024-07-26T08:25:54.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:54 smithi133 ceph-mon[37053]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:25:54.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:54.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:54 smithi043 ceph-mon[32384]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:54 smithi043 ceph-mon[32384]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-26T08:25:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:54 smithi043 ceph-mon[32384]: from='osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:25:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:54 smithi043 ceph-mon[32384]: osdmap e63: 11 total, 10 up, 11 in 2024-07-26T08:25:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:54 smithi043 ceph-mon[32384]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-07-26T08:25:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.109 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-26T08:25:55.202 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-26T08:25:55.215 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-07-26T08:25:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-07-26T08:25:55.215 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108863 s, 963 MB/s 2024-07-26T08:25:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-07-26T08:25:55.504 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:25:55.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: osdmap e64: 11 total, 10 up, 11 in 2024-07-26T08:25:55.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] boot 2024-07-26T08:25:55.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:55 smithi133 ceph-mon[37053]: osdmap e65: 11 total, 11 up, 11 in 2024-07-26T08:25:55.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:25:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: osdmap e64: 11 total, 10 up, 11 in 2024-07-26T08:25:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] boot 2024-07-26T08:25:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:55 smithi063 ceph-mon[36747]: osdmap e65: 11 total, 11 up, 11 in 2024-07-26T08:25:55.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-07-26T08:25:55.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: osdmap e64: 11 total, 10 up, 11 in 2024-07-26T08:25:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T08:25:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: osd.10 [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] boot 2024-07-26T08:25:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:55 smithi043 ceph-mon[32384]: osdmap e65: 11 total, 11 up, 11 in 2024-07-26T08:25:55.873 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_1 2024-07-26T08:25:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:25:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:25:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: osdmap e66: 11 total, 11 up, 11 in 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:25:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:25:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: osdmap e66: 11 total, 11 up, 11 in 2024-07-26T08:25:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:56.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:56.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: osdmap e66: 11 total, 11 up, 11 in 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:25:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:25:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:25:57.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:57 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi063 2024-07-26T08:25:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:57 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 4272M 2024-07-26T08:25:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:57 smithi133 ceph-mon[37053]: osdmap e67: 11 total, 11 up, 11 in 2024-07-26T08:25:57.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:57 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi063 2024-07-26T08:25:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:57 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 4272M 2024-07-26T08:25:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:57 smithi043 ceph-mon[32384]: osdmap e67: 11 total, 11 up, 11 in 2024-07-26T08:25:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 -- 172.21.15.133:0/4176364238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c103590 msgr2=0x7f642c1039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 --2- 172.21.15.133:0/4176364238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c103590 0x7f642c1039a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f641c009900 tx=0x7f641c02a410 comp rx=0 tx=0).stop 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 -- 172.21.15.133:0/4176364238 shutdown_connections 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 --2- 172.21.15.133:0/4176364238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c109820 0x7f642c110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 --2- 172.21.15.133:0/4176364238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c108ed0 0x7f642c1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 --2- 172.21.15.133:0/4176364238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c103590 0x7f642c1039a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 -- 172.21.15.133:0/4176364238 >> 172.21.15.133:0/4176364238 conn(0x7f642c07b280 msgr2=0x7f642c07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 -- 172.21.15.133:0/4176364238 shutdown_connections 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.778+0000 7f6431434640 1 -- 172.21.15.133:0/4176364238 wait complete. 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.779+0000 7f6431434640 1 Processor -- start 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.779+0000 7f6431434640 1 -- start start 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f6431434640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c103590 0x7f642c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f6431434640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 0x7f642c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f6431434640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c109820 0x7f642c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f6431434640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f642c113730 con 0x7f642c109820 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f6431434640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1135b0 con 0x7f642c103590 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f6431434640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1138b0 con 0x7f642c108ed0 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 0x7f642c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 0x7f642c19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43580/0 (socket says 172.21.15.133:43580) 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 -- 172.21.15.133:0/2890826294 learned_addr learned my addr 172.21.15.133:0/2890826294 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642affd640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c103590 0x7f642c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 -- 172.21.15.133:0/2890826294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c103590 msgr2=0x7f642c19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c103590 0x7f642c19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 -- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c109820 msgr2=0x7f642c19f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c109820 0x7f642c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 -- 172.21.15.133:0/2890826294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c1a00b0 con 0x7f642c108ed0 2024-07-26T08:25:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642affd640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c103590 0x7f642c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.780+0000 7f642a7fc640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 0x7f642c19a6e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6420006fd0 tx=0x7f642000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.781+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420011830 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.781+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c1a03a0 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.781+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6420016070 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.781+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642000f2e0 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.781+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c1a6b00 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.782+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c103a20 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.784+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f64200119d0 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.784+0000 7f6413fff640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64140b3c20 0x7f64140b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.785+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6909+0+0 (secure 0 0 0) 0x7f64200e3500 con 0x7f642c108ed0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.785+0000 7f642affd640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64140b3c20 0x7f64140b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.786+0000 7f642affd640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64140b3c20 0x7f64140b6130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f641c0314b0 tx=0x7f641c005fd0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:25:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.789+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f64200ab0d0 con 0x7f642c108ed0 2024-07-26T08:25:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:57 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi063 2024-07-26T08:25:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:57 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 4272M 2024-07-26T08:25:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:57 smithi063 ceph-mon[36747]: osdmap e67: 11 total, 11 up, 11 in 2024-07-26T08:25:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:25:57.973+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f642c063230 con 0x7f64140b3c20 2024-07-26T08:25:58.674 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:58 smithi133 ceph-mon[37053]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:25:58.674 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:25:58.674 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:25:58.674 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:58.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:58 smithi043 ceph-mon[32384]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:25:58.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:25:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:25:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:58 smithi063 ceph-mon[36747]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:25:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T08:25:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T08:25:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:25:59.696 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:25:59 smithi133 ceph-mon[37053]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:25:59.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:25:59 smithi043 ceph-mon[32384]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:25:59.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:25:59 smithi063 ceph-mon[36747]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:26:00.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:00 smithi133 ceph-mon[37053]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-07-26T08:26:00.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:00 smithi043 ceph-mon[32384]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-07-26T08:26:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:00 smithi063 ceph-mon[36747]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-07-26T08:26:01.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/1032971016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]: dispatch 2024-07-26T08:26:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]: dispatch 2024-07-26T08:26:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]': finished 2024-07-26T08:26:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: osdmap e68: 12 total, 11 up, 12 in 2024-07-26T08:26:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:26:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:01 smithi043 ceph-mon[32384]: from='client.? 172.21.15.133:0/1758888999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:26:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/1032971016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]: dispatch 2024-07-26T08:26:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]: dispatch 2024-07-26T08:26:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]': finished 2024-07-26T08:26:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: osdmap e68: 12 total, 11 up, 12 in 2024-07-26T08:26:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:26:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:01 smithi133 ceph-mon[37053]: from='client.? 172.21.15.133:0/1758888999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:26:01.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/1032971016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]: dispatch 2024-07-26T08:26:01.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]: dispatch 2024-07-26T08:26:01.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b14cd08-5f61-4099-ade0-1f87dcee15d5"}]': finished 2024-07-26T08:26:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: osdmap e68: 12 total, 11 up, 12 in 2024-07-26T08:26:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T08:26:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:01 smithi063 ceph-mon[36747]: from='client.? 172.21.15.133:0/1758888999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T08:26:03.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:03 smithi043 ceph-mon[32384]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-07-26T08:26:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:03 smithi133 ceph-mon[37053]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-07-26T08:26:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:03 smithi063 ceph-mon[36747]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-07-26T08:26:05.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:05 smithi043 ceph-mon[32384]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-07-26T08:26:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:05 smithi133 ceph-mon[37053]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-07-26T08:26:06.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:05 smithi063 ceph-mon[36747]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-07-26T08:26:07.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:07 smithi043 ceph-mon[32384]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T08:26:07.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-26T08:26:07.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:08.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:07 smithi133 ceph-mon[37053]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T08:26:08.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-26T08:26:08.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:07 smithi063 ceph-mon[36747]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T08:26:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-26T08:26:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:08.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:08 smithi043 ceph-mon[32384]: Deploying daemon osd.11 on smithi133 2024-07-26T08:26:09.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:08 smithi133 ceph-mon[37053]: Deploying daemon osd.11 on smithi133 2024-07-26T08:26:09.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:08 smithi063 ceph-mon[36747]: Deploying daemon osd.11 on smithi133 2024-07-26T08:26:09.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:09 smithi043 ceph-mon[32384]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:09 smithi133 ceph-mon[37053]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:10.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:09 smithi063 ceph-mon[36747]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:11.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:11 smithi043 ceph-mon[32384]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:11 smithi133 ceph-mon[37053]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:11 smithi063 ceph-mon[36747]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:13.919 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:13 smithi133 ceph-mon[37053]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:13.919 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:13.919 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:13.920 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:13 smithi043 ceph-mon[32384]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:14.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:13 smithi063 ceph-mon[36747]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:14.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:15 smithi133 ceph-mon[37053]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:15 smithi043 ceph-mon[32384]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:15 smithi063 ceph-mon[36747]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:16.830 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 11 on host 'smithi133' 2024-07-26T08:26:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.828+0000 7f6413fff640 1 -- 172.21.15.133:0/2890826294 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f642c063230 con 0x7f64140b3c20 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.830+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64140b3c20 msgr2=0x7f64140b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.830+0000 7f6431434640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64140b3c20 0x7f64140b6130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f641c0314b0 tx=0x7f641c005fd0 comp rx=0 tx=0).stop 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.830+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 msgr2=0x7f642c19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.830+0000 7f6431434640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 0x7f642c19a6e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6420006fd0 tx=0x7f642000b8e0 comp rx=0 tx=0).stop 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.830+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 shutdown_connections 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.830+0000 7f6431434640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64140b3c20 0x7f64140b6130 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.831+0000 7f6431434640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f642c108ed0 0x7f642c19a6e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.831+0000 7f6431434640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c109820 0x7f642c19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.831+0000 7f6431434640 1 --2- 172.21.15.133:0/2890826294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f642c103590 0x7f642c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.831+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 >> 172.21.15.133:0/2890826294 conn(0x7f642c07b280 msgr2=0x7f642c107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.831+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 shutdown_connections 2024-07-26T08:26:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:16.831+0000 7f6431434640 1 -- 172.21.15.133:0/2890826294 wait complete. 2024-07-26T08:26:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:17.551 DEBUG:teuthology.orchestra.run.smithi133:osd.11> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.11.service 2024-07-26T08:26:17.553 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-07-26T08:26:17.554 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd stat -f json 2024-07-26T08:26:18.041 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:18 smithi133 ceph-mon[37053]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:18 smithi133 ceph-mon[37053]: from='osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T08:26:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:18 smithi133 ceph-mon[37053]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T08:26:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:18 smithi063 ceph-mon[36747]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:18 smithi063 ceph-mon[36747]: from='osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T08:26:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:18 smithi063 ceph-mon[36747]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T08:26:18.398 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:18 smithi043 ceph-mon[32384]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:18.398 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:18 smithi043 ceph-mon[32384]: from='osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T08:26:18.398 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:18 smithi043 ceph-mon[32384]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T08:26:19.200 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-mon[37053]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-26T08:26:19.200 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:19.200 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-mon[37053]: from='osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:26:19.200 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-mon[37053]: osdmap e69: 12 total, 11 up, 12 in 2024-07-26T08:26:19.200 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-mon[37053]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:26:19.200 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-mon[37053]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:26:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:19 smithi043 ceph-mon[32384]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-26T08:26:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:19 smithi043 ceph-mon[32384]: from='osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:26:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:19 smithi043 ceph-mon[32384]: osdmap e69: 12 total, 11 up, 12 in 2024-07-26T08:26:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:19 smithi043 ceph-mon[32384]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:26:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:19 smithi043 ceph-mon[32384]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:26:19.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:19 smithi063 ceph-mon[36747]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-26T08:26:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:19 smithi063 ceph-mon[36747]: from='osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:26:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:19 smithi063 ceph-mon[36747]: osdmap e69: 12 total, 11 up, 12 in 2024-07-26T08:26:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:19 smithi063 ceph-mon[36747]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-07-26T08:26:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:19 smithi063 ceph-mon[36747]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-07-26T08:26:20.095 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T08:26:19.800+0000 7f811b2aa640 -1 osd.11 0 waiting for initial osdmap 2024-07-26T08:26:20.095 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 08:26:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T08:26:19.815+0000 7f81130a0640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:20 smithi043 ceph-mon[32384]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:20 smithi043 ceph-mon[32384]: osdmap e70: 12 total, 11 up, 12 in 2024-07-26T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:20 smithi043 ceph-mon[32384]: from='osd.11 ' entity='osd.11' 2024-07-26T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.426 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:20 smithi133 ceph-mon[37053]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:20.427 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.427 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:20 smithi133 ceph-mon[37053]: osdmap e70: 12 total, 11 up, 12 in 2024-07-26T08:26:20.427 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.427 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:20 smithi133 ceph-mon[37053]: from='osd.11 ' entity='osd.11' 2024-07-26T08:26:20.427 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:20 smithi063 ceph-mon[36747]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:20 smithi063 ceph-mon[36747]: osdmap e70: 12 total, 11 up, 12 in 2024-07-26T08:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:20 smithi063 ceph-mon[36747]: from='osd.11 ' entity='osd.11' 2024-07-26T08:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.603+0000 7fd2f2200640 1 -- 172.21.15.43:0/1941476298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 msgr2=0x7fd2ec1039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.603+0000 7fd2f2200640 1 --2- 172.21.15.43:0/1941476298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec1039a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009900 tx=0x7fd2dc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 -- 172.21.15.43:0/1941476298 shutdown_connections 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 --2- 172.21.15.43:0/1941476298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 0x7fd2ec110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 --2- 172.21.15.43:0/1941476298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2ec108ed0 0x7fd2ec1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 --2- 172.21.15.43:0/1941476298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec1039a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 -- 172.21.15.43:0/1941476298 >> 172.21.15.43:0/1941476298 conn(0x7fd2ec07b280 msgr2=0x7fd2ec07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 -- 172.21.15.43:0/1941476298 shutdown_connections 2024-07-26T08:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.604+0000 7fd2f2200640 1 -- 172.21.15.43:0/1941476298 wait complete. 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.605+0000 7fd2f2200640 1 Processor -- start 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.605+0000 7fd2f2200640 1 -- start start 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2f2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec19c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2f2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2ec108ed0 0x7fd2ec19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2f2200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 0x7fd2ec1a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2f2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec113620 con 0x7fd2ec103590 2024-07-26T08:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2f2200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec1134a0 con 0x7fd2ec108ed0 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2f2200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec1137a0 con 0x7fd2ec109820 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2eb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec19c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2eb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec19c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37616/0 (socket says 172.21.15.43:37616) 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2eb400640 1 -- 172.21.15.43:0/3133163667 learned_addr learned my addr 172.21.15.43:0/3133163667 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2ebe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 0x7fd2ec1a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2eaa00640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2ec108ed0 0x7fd2ec19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2ebe00640 1 -- 172.21.15.43:0/3133163667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2ec108ed0 msgr2=0x7fd2ec19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.606+0000 7fd2ebe00640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2ec108ed0 0x7fd2ec19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2ebe00640 1 -- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 msgr2=0x7fd2ec19c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2ebe00640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec19c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2ebe00640 1 -- 172.21.15.43:0/3133163667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec1a2160 con 0x7fd2ec109820 2024-07-26T08:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2ebe00640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 0x7fd2ec1a1a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009fd0 tx=0x7fd2e400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400ce20 con 0x7fd2ec109820 2024-07-26T08:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec1a2450 con 0x7fd2ec109820 2024-07-26T08:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2e4005020 con 0x7fd2ec109820 2024-07-26T08:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4010720 con 0x7fd2ec109820 2024-07-26T08:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.607+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec1a8bb0 con 0x7fd2ec109820 2024-07-26T08:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.609+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ec1039a0 con 0x7fd2ec109820 2024-07-26T08:26:20.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.611+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fd2e4048080 con 0x7fd2ec109820 2024-07-26T08:26:20.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.612+0000 7fd2e3e00640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd2d00b3c20 0x7fd2d00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:20.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.613+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7062+0+0 (secure 0 0 0) 0x7fd2e40e4160 con 0x7fd2ec109820 2024-07-26T08:26:20.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.613+0000 7fd2eb400640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd2d00b3c20 0x7fd2d00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:20.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.613+0000 7fd2eb400640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd2d00b3c20 0x7fd2d00b6130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc005f70 tx=0x7fd2dc005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:20.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.614+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd2e40abbf0 con 0x7fd2ec109820 2024-07-26T08:26:20.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.827+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd2ec19d320 con 0x7fd2ec109820 2024-07-26T08:26:20.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.829+0000 7fd2e3e00640 1 -- 172.21.15.43:0/3133163667 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fd2ec19d320 con 0x7fd2ec109820 2024-07-26T08:26:20.830 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.831+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd2d00b3c20 msgr2=0x7fd2d00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.831+0000 7fd2f2200640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd2d00b3c20 0x7fd2d00b6130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc005f70 tx=0x7fd2dc005a20 comp rx=0 tx=0).stop 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.831+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 msgr2=0x7fd2ec1a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.831+0000 7fd2f2200640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 0x7fd2ec1a1a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009fd0 tx=0x7fd2e400ef10 comp rx=0 tx=0).stop 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 shutdown_connections 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd2d00b3c20 0x7fd2d00b6130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec109820 0x7fd2ec1a1a30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2ec108ed0 0x7fd2ec19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 --2- 172.21.15.43:0/3133163667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec103590 0x7fd2ec19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:20.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 >> 172.21.15.43:0/3133163667 conn(0x7fd2ec07b280 msgr2=0x7fd2ec106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:20.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 shutdown_connections 2024-07-26T08:26:20.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:20.832+0000 7fd2f2200640 1 -- 172.21.15.43:0/3133163667 wait complete. 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: purged_snaps scrub starts 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: purged_snaps scrub ok 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] boot 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: osdmap e71: 12 total, 12 up, 12 in 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:21 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3133163667' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: purged_snaps scrub starts 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: purged_snaps scrub ok 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] boot 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: osdmap e71: 12 total, 12 up, 12 in 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:21 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3133163667' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-26T08:26:21.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: purged_snaps scrub starts 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: purged_snaps scrub ok 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: osd.11 [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] boot 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: osdmap e71: 12 total, 12 up, 12 in 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:21 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3133163667' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-26T08:26:21.682 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1721982380,"num_in_osds":12,"osd_in_since":1721982360,"num_remapped_pgs":0} 2024-07-26T08:26:21.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:26:22.141 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:22.356 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:22 smithi043 ceph-mon[32384]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:22.356 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:22 smithi043 ceph-mon[32384]: Detected new or changed devices on smithi133 2024-07-26T08:26:22.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:22 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 4272M 2024-07-26T08:26:22.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:22 smithi043 ceph-mon[32384]: osdmap e72: 12 total, 12 up, 12 in 2024-07-26T08:26:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:22 smithi133 ceph-mon[37053]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:22 smithi133 ceph-mon[37053]: Detected new or changed devices on smithi133 2024-07-26T08:26:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:22 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 4272M 2024-07-26T08:26:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:22 smithi133 ceph-mon[37053]: osdmap e72: 12 total, 12 up, 12 in 2024-07-26T08:26:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:22 smithi063 ceph-mon[36747]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-07-26T08:26:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:22 smithi063 ceph-mon[36747]: Detected new or changed devices on smithi133 2024-07-26T08:26:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:22 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 4272M 2024-07-26T08:26:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:22 smithi063 ceph-mon[36747]: osdmap e72: 12 total, 12 up, 12 in 2024-07-26T08:26:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 -- 172.21.15.43:0/3597198133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd18104200 msgr2=0x7fcd18104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/3597198133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd18104200 0x7fcd18104610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009900 tx=0x7fcd0c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.407 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:24 smithi043 ceph-mon[32384]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 -- 172.21.15.43:0/3597198133 shutdown_connections 2024-07-26T08:26:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/3597198133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd1810d660 0x7fcd1810fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/3597198133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104b50 0x7fcd1810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/3597198133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd18104200 0x7fcd18104610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 -- 172.21.15.43:0/3597198133 >> 172.21.15.43:0/3597198133 conn(0x7fcd180fdd00 msgr2=0x7fcd18100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 -- 172.21.15.43:0/3597198133 shutdown_connections 2024-07-26T08:26:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.404+0000 7fcd1ea00640 1 -- 172.21.15.43:0/3597198133 wait complete. 2024-07-26T08:26:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.406+0000 7fcd1ea00640 1 Processor -- start 2024-07-26T08:26:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.406+0000 7fcd1ea00640 1 -- start start 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.406+0000 7fcd1ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104200 0x7fcd1819c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd18104b50 0x7fcd1819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd1810d660 0x7fcd181a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1ea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18113450 con 0x7fcd18104200 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1ea00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181132d0 con 0x7fcd1810d660 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1ea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181135d0 con 0x7fcd18104b50 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104200 0x7fcd1819c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd18104b50 0x7fcd1819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd18104b50 0x7fcd1819c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:53710/0 (socket says 172.21.15.43:53710) 2024-07-26T08:26:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104200 0x7fcd1819c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37642/0 (socket says 172.21.15.43:37642) 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1cc00640 1 -- 172.21.15.43:0/563533422 learned_addr learned my addr 172.21.15.43:0/563533422 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.407+0000 7fcd1e000640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd1810d660 0x7fcd181a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1e000640 1 -- 172.21.15.43:0/563533422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd18104b50 msgr2=0x7fcd1819c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1e000640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd18104b50 0x7fcd1819c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1e000640 1 -- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104200 msgr2=0x7fcd1819c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1e000640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104200 0x7fcd1819c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1e000640 1 -- 172.21.15.43:0/563533422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd181a1f70 con 0x7fcd1810d660 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1e000640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd1810d660 0x7fcd181a1840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000ec50 tx=0x7fcd1000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003b70 con 0x7fcd1810d660 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcd10003d10 con 0x7fcd1810d660 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100108b0 con 0x7fcd1810d660 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.408+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd181a2260 con 0x7fcd1810d660 2024-07-26T08:26:24.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.409+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181a89c0 con 0x7fcd1810d660 2024-07-26T08:26:24.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.410+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd18104610 con 0x7fcd1810d660 2024-07-26T08:26:24.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.412+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fcd10004b40 con 0x7fcd1810d660 2024-07-26T08:26:24.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.414+0000 7fcd16000640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcd000b3ca0 0x7fcd000b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:24.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.414+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fcd100e3e90 con 0x7fcd1810d660 2024-07-26T08:26:24.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.414+0000 7fcd1d600640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcd000b3ca0 0x7fcd000b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:24.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.415+0000 7fcd1d600640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcd000b3ca0 0x7fcd000b61b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006010 tx=0x7fcd0c000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:24.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.415+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcd100ab8a0 con 0x7fcd1810d660 2024-07-26T08:26:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:24 smithi133 ceph-mon[37053]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:24 smithi063 ceph-mon[36747]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:24.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.619+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd181a8cb0 con 0x7fcd1810d660 2024-07-26T08:26:24.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.620+0000 7fcd16000640 1 -- 172.21.15.43:0/563533422 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18713 (secure 0 0 0) 0x7fcd100ab1a0 con 0x7fcd1810d660 2024-07-26T08:26:24.622 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:26:24.623 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":72,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:26:21.826594+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:26:24.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.623+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcd000b3ca0 msgr2=0x7fcd000b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:24.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.623+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcd000b3ca0 0x7fcd000b61b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006010 tx=0x7fcd0c000bc0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.623+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd1810d660 msgr2=0x7fcd181a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:24.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.623+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd1810d660 0x7fcd181a1840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000ec50 tx=0x7fcd1000c6a0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 shutdown_connections 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcd000b3ca0 0x7fcd000b61b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd18104b50 0x7fcd1819c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd1810d660 0x7fcd181a1840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 --2- 172.21.15.43:0/563533422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd18104200 0x7fcd1819c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 >> 172.21.15.43:0/563533422 conn(0x7fcd180fdd00 msgr2=0x7fcd18101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 shutdown_connections 2024-07-26T08:26:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:24.624+0000 7fcd1ea00640 1 -- 172.21.15.43:0/563533422 wait complete. 2024-07-26T08:26:25.438 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:25 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/563533422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:26:25.500 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-26T08:22:02.663853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-26T08:26:25.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-07-26T08:26:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:25 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/563533422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:26:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:25 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/563533422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:26:25.983 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:26.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:26 smithi133 ceph-mon[37053]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:26.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:26 smithi043 ceph-mon[32384]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:26 smithi063 ceph-mon[36747]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:28.167 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:28 smithi043 ceph-mon[32384]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:28.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.225+0000 7fc8f9600640 1 -- 172.21.15.43:0/3671421317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4109670 msgr2=0x7fc8f410fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:28.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.225+0000 7fc8f9600640 1 --2- 172.21.15.43:0/3671421317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4109670 0x7fc8f410fea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009ca0 tx=0x7fc8ec02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.225+0000 7fc8f9600640 1 -- 172.21.15.43:0/3671421317 shutdown_connections 2024-07-26T08:26:28.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.225+0000 7fc8f9600640 1 --2- 172.21.15.43:0/3671421317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f4108d20 0x7fc8f4109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.225+0000 7fc8f9600640 1 --2- 172.21.15.43:0/3671421317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4109670 0x7fc8f410fea0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.226+0000 7fc8f9600640 1 --2- 172.21.15.43:0/3671421317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f41033e0 0x7fc8f41037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.226+0000 7fc8f9600640 1 -- 172.21.15.43:0/3671421317 >> 172.21.15.43:0/3671421317 conn(0x7fc8f40fee70 msgr2=0x7fc8f41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:28.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.226+0000 7fc8f9600640 1 -- 172.21.15.43:0/3671421317 shutdown_connections 2024-07-26T08:26:28.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.226+0000 7fc8f9600640 1 -- 172.21.15.43:0/3671421317 wait complete. 2024-07-26T08:26:28.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.227+0000 7fc8f9600640 1 Processor -- start 2024-07-26T08:26:28.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.227+0000 7fc8f9600640 1 -- start start 2024-07-26T08:26:28.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f9600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 0x7fc8f4075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:28.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4108d20 0x7fc8f4075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4109670 0x7fc8f4075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f41134a0 con 0x7fc8f4109670 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f9600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4113320 con 0x7fc8f4108d20 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f9600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4113620 con 0x7fc8f41033e0 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 0x7fc8f4075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.228+0000 7fc8f3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 0x7fc8f4075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:53240/0 (socket says 172.21.15.43:53240) 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8f3e00640 1 -- 172.21.15.43:0/1513691066 learned_addr learned my addr 172.21.15.43:0/1513691066 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8f8c00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4109670 0x7fc8f4075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4108d20 0x7fc8f4075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 -- 172.21.15.43:0/1513691066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 msgr2=0x7fc8f4075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 0x7fc8f4075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 -- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4109670 msgr2=0x7fc8f4075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4109670 0x7fc8f4075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 -- 172.21.15.43:0/1513691066 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f41a80b0 con 0x7fc8f4108d20 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8f3e00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 0x7fc8f4075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.229+0000 7fc8ebe00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4108d20 0x7fc8f4075680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406b3c0 tx=0x7fc8dc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.230+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00cc40 con 0x7fc8f4108d20 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.230+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8dc00cde0 con 0x7fc8f4108d20 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.230+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc018810 con 0x7fc8f4108d20 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.230+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f41a83a0 con 0x7fc8f4108d20 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.230+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41a8890 con 0x7fc8f4108d20 2024-07-26T08:26:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.231+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f41037f0 con 0x7fc8f4108d20 2024-07-26T08:26:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.233+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc8dc010b40 con 0x7fc8f4108d20 2024-07-26T08:26:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.235+0000 7fc8f1600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8d80b3ca0 0x7fc8d80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.235+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc8dc0e3bf0 con 0x7fc8f4108d20 2024-07-26T08:26:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.235+0000 7fc8f3e00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8d80b3ca0 0x7fc8d80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.236+0000 7fc8f3e00640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8d80b3ca0 0x7fc8d80b61b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4076b90 tx=0x7fc8e4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.239+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc8dc0aaf20 con 0x7fc8f4108d20 2024-07-26T08:26:28.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.439+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8f402e0c0 con 0x7fc8f4108d20 2024-07-26T08:26:28.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.440+0000 7fc8f1600640 1 -- 172.21.15.43:0/1513691066 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fc8dc0af470 con 0x7fc8f4108d20 2024-07-26T08:26:28.443 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8d80b3ca0 msgr2=0x7fc8d80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8d80b3ca0 0x7fc8d80b61b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4076b90 tx=0x7fc8e4005f90 comp rx=0 tx=0).stop 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4108d20 msgr2=0x7fc8f4075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4108d20 0x7fc8f4075680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406b3c0 tx=0x7fc8dc00ee50 comp rx=0 tx=0).stop 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 shutdown_connections 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8d80b3ca0 0x7fc8d80b61b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4109670 0x7fc8f4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8f4108d20 0x7fc8f4075680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 --2- 172.21.15.43:0/1513691066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8f41033e0 0x7fc8f4075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:28.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.442+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 >> 172.21.15.43:0/1513691066 conn(0x7fc8f40fee70 msgr2=0x7fc8f41072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:28.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.443+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 shutdown_connections 2024-07-26T08:26:28.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:28.443+0000 7fc8f9600640 1 -- 172.21.15.43:0/1513691066 wait complete. 2024-07-26T08:26:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:28 smithi133 ceph-mon[37053]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:28.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:28 smithi063 ceph-mon[36747]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:29.259 INFO:tasks.cephadm:Adding mds.a on smithi043 2024-07-26T08:26:29.259 INFO:tasks.cephadm:Adding mds.d on smithi043 2024-07-26T08:26:29.259 INFO:tasks.cephadm:Adding mds.g on smithi043 2024-07-26T08:26:29.259 INFO:tasks.cephadm:Adding mds.j on smithi043 2024-07-26T08:26:29.259 INFO:tasks.cephadm:Adding mds.b on smithi063 2024-07-26T08:26:29.259 INFO:tasks.cephadm:Adding mds.e on smithi063 2024-07-26T08:26:29.260 INFO:tasks.cephadm:Adding mds.h on smithi063 2024-07-26T08:26:29.260 INFO:tasks.cephadm:Adding mds.k on smithi063 2024-07-26T08:26:29.260 INFO:tasks.cephadm:Adding mds.c on smithi133 2024-07-26T08:26:29.260 INFO:tasks.cephadm:Adding mds.f on smithi133 2024-07-26T08:26:29.260 INFO:tasks.cephadm:Adding mds.i on smithi133 2024-07-26T08:26:29.260 INFO:tasks.cephadm:Adding mds.l on smithi133 2024-07-26T08:26:29.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph orch apply mds all '12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l' 2024-07-26T08:26:29.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:29 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1513691066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T08:26:29.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:29 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1513691066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T08:26:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.c/config 2024-07-26T08:26:29.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:29 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1513691066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T08:26:30.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:30 smithi133 ceph-mon[37053]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:30.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:30 smithi043 ceph-mon[32384]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:30 smithi063 ceph-mon[36747]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.207+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1545214002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b010faf0 msgr2=0x7fa4b0111f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.207+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1545214002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b010faf0 0x7fa4b0111f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009ca0 tx=0x7fa4a802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.207+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1545214002 shutdown_connections 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1545214002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b010faf0 0x7fa4b0111f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1545214002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0075b30 0x7fa4b010f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1545214002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4b00751e0 0x7fa4b00755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1545214002 >> 172.21.15.133:0/1545214002 conn(0x7fa4b007b280 msgr2=0x7fa4b007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1545214002 shutdown_connections 2024-07-26T08:26:31.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1545214002 wait complete. 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 Processor -- start 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.208+0000 7fa4b7cc1640 1 -- start start 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4b00751e0 0x7fa4b019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 0x7fa4b019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b010faf0 0x7fa4b01a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b01158c0 con 0x7fa4b010faf0 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0115740 con 0x7fa4b00751e0 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0115a40 con 0x7fa4b0075b30 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 0x7fa4b019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 0x7fa4b019c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54296/0 (socket says 172.21.15.133:54296) 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 -- 172.21.15.133:0/1123939022 learned_addr learned my addr 172.21.15.133:0/1123939022 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-07-26T08:26:31.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b5a5d640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4b00751e0 0x7fa4b019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b625e640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b010faf0 0x7fa4b01a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 -- 172.21.15.133:0/1123939022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4b00751e0 msgr2=0x7fa4b019c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4b00751e0 0x7fa4b019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 -- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b010faf0 msgr2=0x7fa4b01a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b010faf0 0x7fa4b01a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 -- 172.21.15.133:0/1123939022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b01a2240 con 0x7fa4b0075b30 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b625e640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b010faf0 0x7fa4b01a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b525c640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 0x7fa4b019c870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000b450 tx=0x7fa4a000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0015020 con 0x7fa4b0075b30 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa4a0011d60 con 0x7fa4b0075b30 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b01a2530 con 0x7fa4b0075b30 2024-07-26T08:26:31.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000f340 con 0x7fa4b0075b30 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.209+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b01a8c90 con 0x7fa4b0075b30 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.210+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b0075670 con 0x7fa4b0075b30 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.212+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fa4a0018020 con 0x7fa4b0075b30 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.212+0000 7fa4a6ffd640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa49c0b3c20 0x7fa49c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.212+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fa4a00e3960 con 0x7fa4b0075b30 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.213+0000 7fa4b5a5d640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa49c0b3c20 0x7fa49c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.214+0000 7fa4b5a5d640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa49c0b3c20 0x7fa49c0b6130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00a810 tx=0x7fa4ac008040 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:31.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.216+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa4a001f020 con 0x7fa4b0075b30 2024-07-26T08:26:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.403+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l", "target": ["mon-mgr", ""]}) -- 0x7fa4b0102960 con 0x7fa49c0b3c20 2024-07-26T08:26:31.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.424+0000 7fa4a6ffd640 1 -- 172.21.15.133:0/1123939022 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa4b0102960 con 0x7fa49c0b3c20 2024-07-26T08:26:31.425 INFO:teuthology.orchestra.run.smithi133.stdout:Scheduled mds.all update... 2024-07-26T08:26:31.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa49c0b3c20 msgr2=0x7fa49c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:31.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa49c0b3c20 0x7fa49c0b6130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00a810 tx=0x7fa4ac008040 comp rx=0 tx=0).stop 2024-07-26T08:26:31.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 msgr2=0x7fa4b019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 0x7fa4b019c870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000b450 tx=0x7fa4a000b910 comp rx=0 tx=0).stop 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 shutdown_connections 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa49c0b3c20 0x7fa49c0b6130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4b0075b30 0x7fa4b019c870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b010faf0 0x7fa4b01a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 --2- 172.21.15.133:0/1123939022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4b00751e0 0x7fa4b019c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 >> 172.21.15.133:0/1123939022 conn(0x7fa4b007b280 msgr2=0x7fa4b0101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 shutdown_connections 2024-07-26T08:26:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-07-26T08:26:31.426+0000 7fa4b7cc1640 1 -- 172.21.15.133:0/1123939022 wait complete. 2024-07-26T08:26:32.072 DEBUG:teuthology.orchestra.run.smithi043:mds.a> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service 2024-07-26T08:26:32.081 DEBUG:teuthology.orchestra.run.smithi043:mds.d> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service 2024-07-26T08:26:32.126 DEBUG:teuthology.orchestra.run.smithi043:mds.g> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service 2024-07-26T08:26:32.175 DEBUG:teuthology.orchestra.run.smithi043:mds.j> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service 2024-07-26T08:26:32.220 DEBUG:teuthology.orchestra.run.smithi063:mds.b> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service 2024-07-26T08:26:32.222 DEBUG:teuthology.orchestra.run.smithi063:mds.e> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service 2024-07-26T08:26:32.265 DEBUG:teuthology.orchestra.run.smithi063:mds.h> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service 2024-07-26T08:26:32.309 DEBUG:teuthology.orchestra.run.smithi063:mds.k> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service 2024-07-26T08:26:32.352 DEBUG:teuthology.orchestra.run.smithi133:mds.c> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.c.service 2024-07-26T08:26:32.354 DEBUG:teuthology.orchestra.run.smithi133:mds.f> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.f.service 2024-07-26T08:26:32.397 DEBUG:teuthology.orchestra.run.smithi133:mds.i> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.i.service 2024-07-26T08:26:32.415 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:32 smithi133 ceph-mon[37053]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:32.415 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:32.415 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:32.416 DEBUG:teuthology.orchestra.run.smithi133:mds.l> sudo journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service 2024-07-26T08:26:32.459 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-07-26T08:26:32.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:26:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:32 smithi043 ceph-mon[32384]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:32 smithi063 ceph-mon[36747]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:26:32.938 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:33.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:26:33.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l;count:12 2024-07-26T08:26:33.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:33.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:33.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:33.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:33.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:33.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:33.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:33.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l;count:12 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:33.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:26:33.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l;count:12 2024-07-26T08:26:33.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:34.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:34 smithi043 ceph-mon[32384]: Deploying daemon mds.l on smithi133 2024-07-26T08:26:34.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:34 smithi043 ceph-mon[32384]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:34.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:34 smithi133 ceph-mon[37053]: Deploying daemon mds.l on smithi133 2024-07-26T08:26:34.505 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:34 smithi133 ceph-mon[37053]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:34.506 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 systemd[1]: Starting Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:26:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:34 smithi063 ceph-mon[36747]: Deploying daemon mds.l on smithi133 2024-07-26T08:26:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:34 smithi063 ceph-mon[36747]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:34.765 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 podman[68099]: 2024-07-26 08:26:34.406831993 +0000 UTC m=+0.017155543 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:26:34.765 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 podman[68099]: 2024-07-26 08:26:34.529656597 +0000 UTC m=+0.139980139 container create d9e83c5a987858b1871a6317b4d796132b6f0b57268ee4ab65331db9464b4548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True) 2024-07-26T08:26:35.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 podman[68099]: 2024-07-26 08:26:34.76640832 +0000 UTC m=+0.376731862 container init d9e83c5a987858b1871a6317b4d796132b6f0b57268ee4ab65331db9464b4548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:26:35.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 podman[68099]: 2024-07-26 08:26:34.76928053 +0000 UTC m=+0.379604070 container start d9e83c5a987858b1871a6317b4d796132b6f0b57268ee4ab65331db9464b4548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:26:35.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 ceph-mds[68118]: -- 172.21.15.133:0/3180617647 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55642d4f7860 con 0x556431699a80 2024-07-26T08:26:35.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: starting mds.l at 2024-07-26T08:26:35.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 bash[68099]: d9e83c5a987858b1871a6317b4d796132b6f0b57268ee4ab65331db9464b4548 2024-07-26T08:26:35.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:26:34 smithi133 systemd[1]: Started Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:35.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 -- 172.21.15.43:0/1802257325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c1055d0 msgr2=0x7fc85c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 --2- 172.21.15.43:0/1802257325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c1055d0 0x7fc85c1059e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009900 tx=0x7fc84c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 -- 172.21.15.43:0/1802257325 shutdown_connections 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 --2- 172.21.15.43:0/1802257325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c10b860 0x7fc85c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 --2- 172.21.15.43:0/1802257325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc85c10af10 0x7fc85c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 --2- 172.21.15.43:0/1802257325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c1055d0 0x7fc85c1059e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 -- 172.21.15.43:0/1802257325 >> 172.21.15.43:0/1802257325 conn(0x7fc85c101040 msgr2=0x7fc85c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 -- 172.21.15.43:0/1802257325 shutdown_connections 2024-07-26T08:26:35.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.329+0000 7fc85b200640 1 -- 172.21.15.43:0/1802257325 wait complete. 2024-07-26T08:26:35.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.331+0000 7fc85b200640 1 Processor -- start 2024-07-26T08:26:35.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.331+0000 7fc85b200640 1 -- start start 2024-07-26T08:26:35.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc85b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc85c1055d0 0x7fc85c19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:35.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc85b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 0x7fc85c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:35.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc85b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c10b860 0x7fc85c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:35.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc85b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c115660 con 0x7fc85c1055d0 2024-07-26T08:26:35.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc85b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1154e0 con 0x7fc85c10af10 2024-07-26T08:26:35.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc85b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1157e0 con 0x7fc85c10b860 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc851400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 0x7fc85c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.332+0000 7fc851400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 0x7fc85c19c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:40868/0 (socket says 172.21.15.43:40868) 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 -- 172.21.15.43:0/384250305 learned_addr learned my addr 172.21.15.43:0/384250305 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc85a800640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c10b860 0x7fc85c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc859e00640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc85c1055d0 0x7fc85c19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 -- 172.21.15.43:0/384250305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c10b860 msgr2=0x7fc85c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c10b860 0x7fc85c1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 -- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc85c1055d0 msgr2=0x7fc85c19bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc85c1055d0 0x7fc85c19bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 -- 172.21.15.43:0/384250305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c1a1f40 con 0x7fc85c10af10 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.333+0000 7fc851400640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 0x7fc85c19c570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc84400e9f0 tx=0x7fc84400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.334+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400ccc0 con 0x7fc85c10af10 2024-07-26T08:26:35.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.334+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc844010900 con 0x7fc85c10af10 2024-07-26T08:26:35.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.334+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844018900 con 0x7fc85c10af10 2024-07-26T08:26:35.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.334+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c1a2230 con 0x7fc85c10af10 2024-07-26T08:26:35.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.334+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1a8990 con 0x7fc85c10af10 2024-07-26T08:26:35.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.335+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c1059e0 con 0x7fc85c10af10 2024-07-26T08:26:35.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.338+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc844010ab0 con 0x7fc85c10af10 2024-07-26T08:26:35.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.340+0000 7fc853400640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8400b3c20 0x7fc8400b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:35.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.340+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc8440e3cc0 con 0x7fc85c10af10 2024-07-26T08:26:35.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.340+0000 7fc859e00640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8400b3c20 0x7fc8400b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:35.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.341+0000 7fc859e00640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8400b3c20 0x7fc8400b6130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0096c0 tx=0x7fc84c009630 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:35.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.344+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc8440ea080 con 0x7fc85c10af10 2024-07-26T08:26:35.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.585+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc85c10d690 con 0x7fc85c10af10 2024-07-26T08:26:35.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.586+0000 7fc853400640 1 -- 172.21.15.43:0/384250305 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fc8440ab640 con 0x7fc85c10af10 2024-07-26T08:26:35.588 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:26:35.588 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"btime":"2024-07-26T08:26:34:807712+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-26T08:26:35.588 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-07-26T08:26:35.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8400b3c20 msgr2=0x7fc8400b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:35.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8400b3c20 0x7fc8400b6130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0096c0 tx=0x7fc84c009630 comp rx=0 tx=0).stop 2024-07-26T08:26:35.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 msgr2=0x7fc85c19c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:35.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 0x7fc85c19c570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc84400e9f0 tx=0x7fc84400eeb0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 shutdown_connections 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc8400b3c20 0x7fc8400b6130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85c10b860 0x7fc85c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c10af10 0x7fc85c19c570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 --2- 172.21.15.43:0/384250305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc85c1055d0 0x7fc85c19bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 >> 172.21.15.43:0/384250305 conn(0x7fc85c101040 msgr2=0x7fc85c10a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 shutdown_connections 2024-07-26T08:26:35.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:35.589+0000 7fc85b200640 1 -- 172.21.15.43:0/384250305 wait complete. 2024-07-26T08:26:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:boot 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: fsmap 1 up:standby 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: Deploying daemon mds.k on smithi063 2024-07-26T08:26:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:35 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/384250305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:36.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:36.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:boot 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: fsmap 1 up:standby 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: Deploying daemon mds.k on smithi063 2024-07-26T08:26:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:35 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/384250305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:boot 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: fsmap 1 up:standby 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: Deploying daemon mds.k on smithi063 2024-07-26T08:26:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:35 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/384250305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:37.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:26:37 smithi063 systemd[1]: Started Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:38.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:37 smithi043 ceph-mon[32384]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:37 smithi133 ceph-mon[37053]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:38.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:37 smithi063 ceph-mon[36747]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:38.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:38.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:38.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:boot 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: fsmap 2 up:standby 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:39.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:38 smithi043 ceph-mon[32384]: Deploying daemon mds.j on smithi043 2024-07-26T08:26:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:26:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:boot 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: fsmap 2 up:standby 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:38 smithi133 ceph-mon[37053]: Deploying daemon mds.j on smithi043 2024-07-26T08:26:39.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:boot 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: fsmap 2 up:standby 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:38 smithi063 ceph-mon[36747]: Deploying daemon mds.j on smithi043 2024-07-26T08:26:39.874 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:40.022 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:39 smithi043 ceph-mon[32384]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:40.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:39 smithi063 ceph-mon[36747]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:40.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:39 smithi133 ceph-mon[37053]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:40.909 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:40 smithi043 systemd[1]: Starting Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:26:41.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:41 smithi043 podman[77218]: 2024-07-26 08:26:41.34104082 +0000 UTC m=+0.033641322 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:26:41.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:41 smithi043 podman[77218]: 2024-07-26 08:26:41.452101009 +0000 UTC m=+0.144701546 container create 5e3c181654526cee0fe6e2749c1e259a682d8c0a6bfd74917b4c41b2cefeb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0) 2024-07-26T08:26:42.187 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:41 smithi043 ceph-mon[32384]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:42.188 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:41 smithi043 podman[77218]: 2024-07-26 08:26:41.950876186 +0000 UTC m=+0.643476740 container init 5e3c181654526cee0fe6e2749c1e259a682d8c0a6bfd74917b4c41b2cefeb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True) 2024-07-26T08:26:42.188 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:41 smithi043 podman[77218]: 2024-07-26 08:26:41.960485699 +0000 UTC m=+0.653086218 container start 5e3c181654526cee0fe6e2749c1e259a682d8c0a6bfd74917b4c41b2cefeb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724) 2024-07-26T08:26:42.188 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:42 smithi043 ceph-mds[77259]: -- 172.21.15.43:0/3976137753 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558deccb1860 con 0x558df0e53600 2024-07-26T08:26:42.188 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:42 smithi043 bash[77218]: 5e3c181654526cee0fe6e2749c1e259a682d8c0a6bfd74917b4c41b2cefeb3fc 2024-07-26T08:26:42.188 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: starting mds.j at 2024-07-26T08:26:42.188 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:26:42 smithi043 systemd[1]: Started Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:42.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:41 smithi133 ceph-mon[37053]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:41 smithi063 ceph-mon[36747]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:42.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 -- 172.21.15.43:0/1319028347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0113e60 msgr2=0x7f3ab0116350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:42.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 --2- 172.21.15.43:0/1319028347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0113e60 0x7f3ab0116350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009be0 tx=0x7f3aa802a6c0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 -- 172.21.15.43:0/1319028347 shutdown_connections 2024-07-26T08:26:42.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 --2- 172.21.15.43:0/1319028347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0113e60 0x7f3ab0116350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 --2- 172.21.15.43:0/1319028347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab0075b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 --2- 172.21.15.43:0/1319028347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab0076d60 0x7f3ab00751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 -- 172.21.15.43:0/1319028347 >> 172.21.15.43:0/1319028347 conn(0x7f3ab007b340 msgr2=0x7f3ab007b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:42.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 -- 172.21.15.43:0/1319028347 shutdown_connections 2024-07-26T08:26:42.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.392+0000 7f3ab7400640 1 -- 172.21.15.43:0/1319028347 wait complete. 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.393+0000 7f3ab7400640 1 Processor -- start 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 -- start start 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab01a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0076d60 0x7f3ab01a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab0113e60 0x7f3ab01a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0119c00 con 0x7f3ab0113e60 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0119a80 con 0x7f3ab0075720 2024-07-26T08:26:42.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.394+0000 7f3ab7400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0119d80 con 0x7f3ab0076d60 2024-07-26T08:26:42.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab01a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:42.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab01a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:40902/0 (socket says 172.21.15.43:40902) 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 -- 172.21.15.43:0/684766379 learned_addr learned my addr 172.21.15.43:0/684766379 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab5400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab0113e60 0x7f3ab01a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3aafe00640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0076d60 0x7f3ab01a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 -- 172.21.15.43:0/684766379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0076d60 msgr2=0x7f3ab01a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0076d60 0x7f3ab01a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 -- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab0113e60 msgr2=0x7f3ab01a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab0113e60 0x7f3ab01a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.395+0000 7f3ab4a00640 1 -- 172.21.15.43:0/684766379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01a64a0 con 0x7f3ab0075720 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.396+0000 7f3ab4a00640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab01a0530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400e9c0 tx=0x7f3aa400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.396+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400cde0 con 0x7f3ab0075720 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.396+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3aa40035f0 con 0x7f3ab0075720 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.396+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab01a6790 con 0x7f3ab0075720 2024-07-26T08:26:42.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.396+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4010690 con 0x7f3ab0075720 2024-07-26T08:26:42.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.396+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab01acef0 con 0x7f3ab0075720 2024-07-26T08:26:42.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.398+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab0075b30 con 0x7f3ab0075720 2024-07-26T08:26:42.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.400+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f3aa40037a0 con 0x7f3ab0075720 2024-07-26T08:26:42.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.402+0000 7f3aad600640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3a980b3ca0 0x7f3a980b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:42.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.402+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f3aa40e3ba0 con 0x7f3ab0075720 2024-07-26T08:26:42.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.402+0000 7f3aafe00640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3a980b3ca0 0x7f3a980b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:42.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.403+0000 7f3aafe00640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3a980b3ca0 0x7f3a980b61b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ab007b790 tx=0x7f3a9c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:42.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.406+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3aa40ab520 con 0x7f3ab0075720 2024-07-26T08:26:42.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.652+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ab01a1660 con 0x7f3ab0075720 2024-07-26T08:26:42.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.653+0000 7f3aad600640 1 -- 172.21.15.43:0/684766379 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2257 (secure 0 0 0) 0x7f3aa40aae20 con 0x7f3ab0075720 2024-07-26T08:26:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:26:42.656 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"btime":"2024-07-26T08:26:37:818453+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-26T08:26:42.656 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2024-07-26T08:26:42.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3a980b3ca0 msgr2=0x7f3a980b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:42.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3a980b3ca0 0x7f3a980b61b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ab007b790 tx=0x7f3a9c005f90 comp rx=0 tx=0).stop 2024-07-26T08:26:42.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 msgr2=0x7f3ab01a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab01a0530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400e9c0 tx=0x7f3aa400ee80 comp rx=0 tx=0).stop 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 shutdown_connections 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3a980b3ca0 0x7f3a980b61b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab0076d60 0x7f3ab01a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab0113e60 0x7f3ab01a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 --2- 172.21.15.43:0/684766379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0075720 0x7f3ab01a0530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 >> 172.21.15.43:0/684766379 conn(0x7f3ab007b340 msgr2=0x7f3ab0112ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 shutdown_connections 2024-07-26T08:26:42.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:42.656+0000 7f3ab7400640 1 -- 172.21.15.43:0/684766379 wait complete. 2024-07-26T08:26:43.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:43.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: Deploying daemon mds.d on smithi043 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/684766379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:boot 2024-07-26T08:26:43.460 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:43 smithi043 ceph-mon[32384]: fsmap 3 up:standby 2024-07-26T08:26:43.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: Deploying daemon mds.d on smithi043 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/684766379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:boot 2024-07-26T08:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:43 smithi133 ceph-mon[37053]: fsmap 3 up:standby 2024-07-26T08:26:43.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: Deploying daemon mds.d on smithi043 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/684766379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:boot 2024-07-26T08:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:43 smithi063 ceph-mon[36747]: fsmap 3 up:standby 2024-07-26T08:26:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:44 smithi043 ceph-mon[32384]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:44 smithi133 ceph-mon[37053]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:44.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:44 smithi063 ceph-mon[36747]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:45.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:26:46.221 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:45 smithi043 systemd[1]: Starting Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:26:46.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:46 smithi043 ceph-mon[32384]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:46.477 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 podman[77609]: 2024-07-26 08:26:46.144512682 +0000 UTC m=+0.040683356 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:26:46.477 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 podman[77609]: 2024-07-26 08:26:46.251966354 +0000 UTC m=+0.148137051 container create 705d87625700188f90b0017c5a0e9ee766283352b745b0bcc070c432353aedd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:26:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:46 smithi133 ceph-mon[37053]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:46.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:46 smithi063 ceph-mon[36747]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:46.704 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:46.861 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 podman[77609]: 2024-07-26 08:26:46.589354224 +0000 UTC m=+0.485524939 container init 705d87625700188f90b0017c5a0e9ee766283352b745b0bcc070c432353aedd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0) 2024-07-26T08:26:46.861 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 podman[77609]: 2024-07-26 08:26:46.599624514 +0000 UTC m=+0.495795231 container start 705d87625700188f90b0017c5a0e9ee766283352b745b0bcc070c432353aedd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-07-26T08:26:46.861 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 bash[77609]: 705d87625700188f90b0017c5a0e9ee766283352b745b0bcc070c432353aedd2 2024-07-26T08:26:46.861 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 systemd[1]: Started Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:46.861 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 ceph-mds[77653]: -- 172.21.15.43:0/1951208691 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564420d19860 con 0x564424ebb600 2024-07-26T08:26:46.862 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:26:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: starting mds.d at 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: Deploying daemon mds.e on smithi063 2024-07-26T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:26:47.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:boot 2024-07-26T08:26:47.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:47 smithi063 ceph-mon[36747]: fsmap 4 up:standby 2024-07-26T08:26:48.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:48.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:48.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:48.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: Deploying daemon mds.e on smithi063 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:boot 2024-07-26T08:26:48.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:47 smithi043 ceph-mon[32384]: fsmap 4 up:standby 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: Deploying daemon mds.e on smithi063 2024-07-26T08:26:48.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:26:48.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:boot 2024-07-26T08:26:48.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:47 smithi133 ceph-mon[37053]: fsmap 4 up:standby 2024-07-26T08:26:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 -- 172.21.15.43:0/3382048868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 msgr2=0x7f0c741164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 --2- 172.21.15.43:0/3382048868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741164b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009900 tx=0x7f0c6c02a410 comp rx=0 tx=0).stop 2024-07-26T08:26:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 -- 172.21.15.43:0/3382048868 shutdown_connections 2024-07-26T08:26:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 --2- 172.21.15.43:0/3382048868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7410f330 0x7f0c7410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 --2- 172.21.15.43:0/3382048868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741164b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 --2- 172.21.15.43:0/3382048868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c741099f0 0x7f0c74109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 -- 172.21.15.43:0/3382048868 >> 172.21.15.43:0/3382048868 conn(0x7f0c74078ff0 msgr2=0x7f0c74107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 -- 172.21.15.43:0/3382048868 shutdown_connections 2024-07-26T08:26:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.017+0000 7f0c78e00640 1 -- 172.21.15.43:0/3382048868 wait complete. 2024-07-26T08:26:49.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.018+0000 7f0c78e00640 1 Processor -- start 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.018+0000 7f0c78e00640 1 -- start start 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c78e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c741099f0 0x7f0c741a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c78e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7410f330 0x7f0c741a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c78e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c78e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74119ad0 con 0x7f0c741099f0 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c78e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74119950 con 0x7f0c7410fc80 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c78e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74119c50 con 0x7f0c7410f330 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c73400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c741099f0 0x7f0c741a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c73e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c73e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741a5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:45104/0 (socket says 172.21.15.43:45104) 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c73e00640 1 -- 172.21.15.43:0/2304844294 learned_addr learned my addr 172.21.15.43:0/2304844294 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.019+0000 7f0c72a00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7410f330 0x7f0c741a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c73e00640 1 -- 172.21.15.43:0/2304844294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7410f330 msgr2=0x7f0c741a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c73e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7410f330 0x7f0c741a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c73e00640 1 -- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c741099f0 msgr2=0x7f0c741a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c73e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c741099f0 0x7f0c741a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c73e00640 1 -- 172.21.15.43:0/2304844294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c741a6310 con 0x7f0c7410fc80 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c73e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741a5be0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0314b0 tx=0x7f0c6c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c03f070 con 0x7f0c7410fc80 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c6c031be0 con 0x7f0c7410fc80 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c741a65a0 con 0x7f0c7410fc80 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c035030 con 0x7f0c7410fc80 2024-07-26T08:26:49.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.020+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c741acd60 con 0x7f0c7410fc80 2024-07-26T08:26:49.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.022+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7410ac70 con 0x7f0c7410fc80 2024-07-26T08:26:49.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.024+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f0c6c042070 con 0x7f0c7410fc80 2024-07-26T08:26:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.026+0000 7f0c6be00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0c580b3c20 0x7f0c580b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.026+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f0c6c104480 con 0x7f0c7410fc80 2024-07-26T08:26:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.026+0000 7f0c73400640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0c580b3c20 0x7f0c580b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.027+0000 7f0c73400640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0c580b3c20 0x7f0c580b6130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005fd0 tx=0x7f0c64009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.027+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0c6c0cb7b0 con 0x7f0c7410fc80 2024-07-26T08:26:49.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:48 smithi063 systemd[1]: Starting Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:26:49.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.270+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c74109e00 con 0x7f0c7410fc80 2024-07-26T08:26:49.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.271+0000 7f0c6be00640 1 -- 172.21.15.43:0/2304844294 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7f0c74109e00 con 0x7f0c7410fc80 2024-07-26T08:26:49.273 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:26:49.273 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"btime":"2024-07-26T08:26:47:218831+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-26T08:26:49.273 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-07-26T08:26:49.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0c580b3c20 msgr2=0x7f0c580b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0c580b3c20 0x7f0c580b6130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005fd0 tx=0x7f0c64009500 comp rx=0 tx=0).stop 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 msgr2=0x7f0c741a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741a5be0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0314b0 tx=0x7f0c6c003b90 comp rx=0 tx=0).stop 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 shutdown_connections 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0c580b3c20 0x7f0c580b6130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7410f330 0x7f0c741a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7410fc80 0x7f0c741a5be0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 --2- 172.21.15.43:0/2304844294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c741099f0 0x7f0c741a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.274+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 >> 172.21.15.43:0/2304844294 conn(0x7f0c74078ff0 msgr2=0x7f0c74079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.275+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 shutdown_connections 2024-07-26T08:26:49.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:49.275+0000 7f0c78e00640 1 -- 172.21.15.43:0/2304844294 wait complete. 2024-07-26T08:26:49.460 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 podman[67730]: 2024-07-26 08:26:49.066685694 +0000 UTC m=+0.017417483 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:26:49.460 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 podman[67730]: 2024-07-26 08:26:49.206627884 +0000 UTC m=+0.157359661 container create 54c1bf4eb7eb671d252b468f1d1510326c24fef8e8b13f14e33235062c3735d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:26:49.460 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 podman[67730]: 2024-07-26 08:26:49.459390443 +0000 UTC m=+0.410122215 container init 54c1bf4eb7eb671d252b468f1d1510326c24fef8e8b13f14e33235062c3735d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-07-26T08:26:49.799 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 podman[67730]: 2024-07-26 08:26:49.462197651 +0000 UTC m=+0.412929422 container start 54c1bf4eb7eb671d252b468f1d1510326c24fef8e8b13f14e33235062c3735d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-07-26T08:26:49.799 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mds[67750]: -- 172.21.15.63:0/2084714852 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648ca01b860 con 0x5648ce1bda80 2024-07-26T08:26:49.800 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: starting mds.e at 2024-07-26T08:26:49.800 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 bash[67730]: 54c1bf4eb7eb671d252b468f1d1510326c24fef8e8b13f14e33235062c3735d1 2024-07-26T08:26:49.800 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:26:49 smithi063 systemd[1]: Started Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2304844294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:50.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2304844294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2304844294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:50.156 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:51.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:50 smithi063 ceph-mon[36747]: Deploying daemon mds.f on smithi133 2024-07-26T08:26:51.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:26:51.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:50 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:boot 2024-07-26T08:26:51.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:50 smithi063 ceph-mon[36747]: fsmap 5 up:standby 2024-07-26T08:26:51.186 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:50 smithi133 ceph-mon[37053]: Deploying daemon mds.f on smithi133 2024-07-26T08:26:51.186 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:26:51.186 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:50 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:boot 2024-07-26T08:26:51.186 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:50 smithi133 ceph-mon[37053]: fsmap 5 up:standby 2024-07-26T08:26:51.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:50 smithi043 ceph-mon[32384]: Deploying daemon mds.f on smithi133 2024-07-26T08:26:51.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:26:51.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:50 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:boot 2024-07-26T08:26:51.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:50 smithi043 ceph-mon[32384]: fsmap 5 up:standby 2024-07-26T08:26:51.963 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:51 smithi133 ceph-mon[37053]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:52.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:26:52.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:51 smithi043 ceph-mon[32384]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:52.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:51 smithi063 ceph-mon[36747]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:52.515 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 08:26:52 smithi133 systemd[1]: Started Ceph mds.f for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:52.635 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: Deploying daemon mds.c on smithi133 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T08:26:53.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6834/1306232427,v1:172.21.15.133:6835/1306232427] up:boot 2024-07-26T08:26:53.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:53 smithi133 ceph-mon[37053]: fsmap 6 up:standby 2024-07-26T08:26:53.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: Deploying daemon mds.c on smithi133 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6834/1306232427,v1:172.21.15.133:6835/1306232427] up:boot 2024-07-26T08:26:53.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:53 smithi043 ceph-mon[32384]: fsmap 6 up:standby 2024-07-26T08:26:53.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: Deploying daemon mds.c on smithi133 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6834/1306232427,v1:172.21.15.133:6835/1306232427] up:boot 2024-07-26T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:53 smithi063 ceph-mon[36747]: fsmap 6 up:standby 2024-07-26T08:26:54.724 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:54 smithi133 systemd[1]: Starting Ceph mds.c for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 -- 172.21.15.43:0/1260894068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc1033c0 msgr2=0x7f64bc1037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1260894068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc1033c0 0x7f64bc1037d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009900 tx=0x7f64ac02a410 comp rx=0 tx=0).stop 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 -- 172.21.15.43:0/1260894068 shutdown_connections 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1260894068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc109650 0x7f64bc10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1260894068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 0x7f64bc109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1260894068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc1033c0 0x7f64bc1037d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 -- 172.21.15.43:0/1260894068 >> 172.21.15.43:0/1260894068 conn(0x7f64bc0fee10 msgr2=0x7f64bc101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 -- 172.21.15.43:0/1260894068 shutdown_connections 2024-07-26T08:26:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.997+0000 7f64c0a00640 1 -- 172.21.15.43:0/1260894068 wait complete. 2024-07-26T08:26:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.999+0000 7f64c0a00640 1 Processor -- start 2024-07-26T08:26:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:54.999+0000 7f64c0a00640 1 -- start start 2024-07-26T08:26:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64c0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 0x7f64bc199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64c0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 0x7f64bc19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64c0a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc109650 0x7f64bc19f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64c0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc1134a0 con 0x7f64bc108d00 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64c0a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc113320 con 0x7f64bc1033c0 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64c0a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc113620 con 0x7f64bc109650 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 0x7f64bc199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64bbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc109650 0x7f64bc19f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 0x7f64bc199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59574/0 (socket says 172.21.15.43:59574) 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64bb400640 1 -- 172.21.15.43:0/1464749091 learned_addr learned my addr 172.21.15.43:0/1464749091 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:26:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.000+0000 7f64baa00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 0x7f64bc19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:55.006 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:54 smithi133 podman[68707]: 2024-07-26 08:26:54.723436539 +0000 UTC m=+0.090190480 container create 4515fb61174c9e0aee4fc43c9ed546007cfd1b00b50337831241a7396069bbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-07-26T08:26:55.006 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:54 smithi133 podman[68707]: 2024-07-26 08:26:54.650387008 +0000 UTC m=+0.017140947 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:26:55.006 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:55 smithi133 podman[68707]: 2024-07-26 08:26:55.001947073 +0000 UTC m=+0.368701004 container init 4515fb61174c9e0aee4fc43c9ed546007cfd1b00b50337831241a7396069bbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64bb400640 1 -- 172.21.15.43:0/1464749091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc109650 msgr2=0x7f64bc19f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64bb400640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc109650 0x7f64bc19f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64bb400640 1 -- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 msgr2=0x7f64bc19a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64bb400640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 0x7f64bc19a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64bb400640 1 -- 172.21.15.43:0/1464749091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc19fd60 con 0x7f64bc1033c0 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64baa00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 0x7f64bc19a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64bb400640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 0x7f64bc199df0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0314b0 tx=0x7f64ac003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.001+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac03f070 con 0x7f64bc1033c0 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.002+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f64ac031bf0 con 0x7f64bc1033c0 2024-07-26T08:26:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.002+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac035030 con 0x7f64bc1033c0 2024-07-26T08:26:55.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.002+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64bc19fff0 con 0x7f64bc1033c0 2024-07-26T08:26:55.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.002+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64bc1a67b0 con 0x7f64bc1033c0 2024-07-26T08:26:55.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.003+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64bc1037d0 con 0x7f64bc1033c0 2024-07-26T08:26:55.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.006+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f64ac042070 con 0x7f64bc1033c0 2024-07-26T08:26:55.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.008+0000 7f64b3e00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64a00b3ca0 0x7f64a00b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:26:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.009+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f64ac103c90 con 0x7f64bc1033c0 2024-07-26T08:26:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.009+0000 7f64baa00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64a00b3ca0 0x7f64a00b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:26:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.010+0000 7f64baa00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64a00b3ca0 0x7f64a00b61b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f64bc108640 tx=0x7f64a8005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:26:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.012+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f64ac0cb610 con 0x7f64bc1033c0 2024-07-26T08:26:55.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.259+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64bc02e0c0 con 0x7f64bc1033c0 2024-07-26T08:26:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.260+0000 7f64b3e00640 1 -- 172.21.15.43:0/1464749091 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5554 (secure 0 0 0) 0x7f64ac0caf10 con 0x7f64bc1033c0 2024-07-26T08:26:55.262 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:26:55.262 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"btime":"2024-07-26T08:26:52:824277+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-07-26T08:26:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-07-26T08:26:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64a00b3ca0 msgr2=0x7f64a00b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64a00b3ca0 0x7f64a00b61b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f64bc108640 tx=0x7f64a8005f90 comp rx=0 tx=0).stop 2024-07-26T08:26:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 msgr2=0x7f64bc199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:26:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 0x7f64bc199df0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0314b0 tx=0x7f64ac003c10 comp rx=0 tx=0).stop 2024-07-26T08:26:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 shutdown_connections 2024-07-26T08:26:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f64a00b3ca0 0x7f64a00b61b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc109650 0x7f64bc19f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64bc108d00 0x7f64bc19a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 --2- 172.21.15.43:0/1464749091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64bc1033c0 0x7f64bc199df0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:26:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.263+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 >> 172.21.15.43:0/1464749091 conn(0x7f64bc0fee10 msgr2=0x7f64bc101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:26:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.264+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 shutdown_connections 2024-07-26T08:26:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:26:55.264+0000 7f64c0a00640 1 -- 172.21.15.43:0/1464749091 wait complete. 2024-07-26T08:26:55.266 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:55 smithi133 podman[68707]: 2024-07-26 08:26:55.004691528 +0000 UTC m=+0.371445468 container start 4515fb61174c9e0aee4fc43c9ed546007cfd1b00b50337831241a7396069bbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-07-26T08:26:55.266 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:55 smithi133 ceph-mds[68726]: -- 172.21.15.133:0/2394564808 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c410239860 con 0x55c4143dba80 2024-07-26T08:26:55.266 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: starting mds.c at 2024-07-26T08:26:55.267 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:55 smithi133 bash[68707]: 4515fb61174c9e0aee4fc43c9ed546007cfd1b00b50337831241a7396069bbd8 2024-07-26T08:26:55.267 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:26:55 smithi133 systemd[1]: Started Ceph mds.c for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: Deploying daemon mds.h on smithi063 2024-07-26T08:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1464749091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T08:26:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:boot 2024-07-26T08:26:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:56 smithi063 ceph-mon[36747]: fsmap 7 up:standby 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:56.431 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:56.432 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: Deploying daemon mds.h on smithi063 2024-07-26T08:26:56.432 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1464749091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:56.432 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T08:26:56.432 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:boot 2024-07-26T08:26:56.432 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:56 smithi133 ceph-mon[37053]: fsmap 7 up:standby 2024-07-26T08:26:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: Deploying daemon mds.h on smithi063 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1464749091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:boot 2024-07-26T08:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:56 smithi043 ceph-mon[32384]: fsmap 7 up:standby 2024-07-26T08:26:57.317 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 systemd[1]: Starting Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:26:57.666 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 podman[68033]: 2024-07-26 08:26:57.286447381 +0000 UTC m=+0.017709643 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:26:57.666 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 podman[68033]: 2024-07-26 08:26:57.420851249 +0000 UTC m=+0.152113509 container create b1ba0b1075a8fbb2d8f0ac010afc61acb1f9a8534b727644dcd20f87aeac557d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:26:57.666 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 podman[68033]: 2024-07-26 08:26:57.665185403 +0000 UTC m=+0.396447667 container init b1ba0b1075a8fbb2d8f0ac010afc61acb1f9a8534b727644dcd20f87aeac557d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T08:26:58.067 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 podman[68033]: 2024-07-26 08:26:57.667972246 +0000 UTC m=+0.399234510 container start b1ba0b1075a8fbb2d8f0ac010afc61acb1f9a8534b727644dcd20f87aeac557d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-07-26T08:26:58.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 ceph-mds[68052]: -- 172.21.15.63:0/955080174 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56106e6d7860 con 0x561072879180 2024-07-26T08:26:58.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: starting mds.h at 2024-07-26T08:26:58.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 bash[68033]: b1ba0b1075a8fbb2d8f0ac010afc61acb1f9a8534b727644dcd20f87aeac557d 2024-07-26T08:26:58.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:26:57 smithi063 systemd[1]: Started Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:26:58.102 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:26:58.471 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:58.471 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:58.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:58.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:58.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:26:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:26:58.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:58.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:26:58.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:26:58.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:26:58.590 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:26:59.453 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:59 smithi133 ceph-mon[37053]: Deploying daemon mds.i on smithi133 2024-07-26T08:26:59.453 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:26:59.453 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:59 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:boot 2024-07-26T08:26:59.453 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:26:59 smithi133 ceph-mon[37053]: fsmap 8 up:standby 2024-07-26T08:26:59.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:59 smithi043 ceph-mon[32384]: Deploying daemon mds.i on smithi133 2024-07-26T08:26:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:26:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:59 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:boot 2024-07-26T08:26:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:26:59 smithi043 ceph-mon[32384]: fsmap 8 up:standby 2024-07-26T08:26:59.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:59 smithi063 ceph-mon[36747]: Deploying daemon mds.i on smithi133 2024-07-26T08:26:59.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:26:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:59 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:boot 2024-07-26T08:26:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:26:59 smithi063 ceph-mon[36747]: fsmap 8 up:standby 2024-07-26T08:27:00.015 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:26:59 smithi133 systemd[1]: Starting Ceph mds.i for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:27:00.329 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:00 smithi043 ceph-mon[32384]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:00.392 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:00 smithi133 ceph-mon[37053]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:00.393 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 podman[69019]: 2024-07-26 08:27:00.033106973 +0000 UTC m=+0.017345510 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:27:00.393 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 podman[69019]: 2024-07-26 08:27:00.146618406 +0000 UTC m=+0.130856987 container create 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-07-26T08:27:00.393 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 podman[69019]: 2024-07-26 08:27:00.391715168 +0000 UTC m=+0.375953704 container init 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-07-26T08:27:00.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:00 smithi063 ceph-mon[36747]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:00.765 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 podman[69019]: 2024-07-26 08:27:00.394345466 +0000 UTC m=+0.378583992 container start 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-07-26T08:27:00.766 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 ceph-mds[69038]: -- 172.21.15.133:0/796139294 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f847c1860 con 0x560f88963180 2024-07-26T08:27:00.766 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i[69034]: starting mds.i at 2024-07-26T08:27:00.766 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 bash[69019]: 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab 2024-07-26T08:27:00.766 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 08:27:00 smithi133 systemd[1]: Started Ceph mds.i for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:27:00.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 -- 172.21.15.43:0/676970064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 msgr2=0x7f38ac10fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:00.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 --2- 172.21.15.43:0/676970064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac10fea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009be0 tx=0x7f38a402a6d0 comp rx=0 tx=0).stop 2024-07-26T08:27:00.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 -- 172.21.15.43:0/676970064 shutdown_connections 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 --2- 172.21.15.43:0/676970064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac10fea0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 --2- 172.21.15.43:0/676970064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 --2- 172.21.15.43:0/676970064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38ac1033e0 0x7f38ac1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 -- 172.21.15.43:0/676970064 >> 172.21.15.43:0/676970064 conn(0x7f38ac0fee70 msgr2=0x7f38ac1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 -- 172.21.15.43:0/676970064 shutdown_connections 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.895+0000 7f38abe00640 1 -- 172.21.15.43:0/676970064 wait complete. 2024-07-26T08:27:00.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.896+0000 7f38abe00640 1 Processor -- start 2024-07-26T08:27:00.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.896+0000 7f38abe00640 1 -- start start 2024-07-26T08:27:00.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38abe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38ac1033e0 0x7f38ac199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:00.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38abe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:00.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38abe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:00.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38abe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac113450 con 0x7f38ac1033e0 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38abe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1132d0 con 0x7f38ac108d20 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38abe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1135d0 con 0x7f38ac109670 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38aa000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38aa000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59604/0 (socket says 172.21.15.43:59604) 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38aa000640 1 -- 172.21.15.43:0/3274191797 learned_addr learned my addr 172.21.15.43:0/3274191797 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.897+0000 7f38aaa00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38ac1033e0 0x7f38ac199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38ab400640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38aa000640 1 -- 172.21.15.43:0/3274191797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 msgr2=0x7f38ac19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38aa000640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38aa000640 1 -- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38ac1033e0 msgr2=0x7f38ac199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:00.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38aa000640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38ac1033e0 0x7f38ac199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38aa000640 1 -- 172.21.15.43:0/3274191797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac19fdd0 con 0x7f38ac108d20 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38ab400640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38aa000640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac19a400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f389800e9f0 tx=0x7f389800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.898+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389800ccc0 con 0x7f38ac108d20 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.899+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3898010900 con 0x7f38ac108d20 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.899+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac1a00c0 con 0x7f38ac108d20 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.899+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898018900 con 0x7f38ac108d20 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.899+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac1a6820 con 0x7f38ac108d20 2024-07-26T08:27:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.900+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ac1037f0 con 0x7f38ac108d20 2024-07-26T08:27:00.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.902+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f3898010ab0 con 0x7f38ac108d20 2024-07-26T08:27:00.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.904+0000 7f38a3400640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f38900b3ca0 0x7f38900b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:00.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.904+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f38980e3bd0 con 0x7f38ac108d20 2024-07-26T08:27:00.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.904+0000 7f38aaa00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f38900b3ca0 0x7f38900b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.905+0000 7f38aaa00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f38900b3ca0 0x7f38900b61b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f389c009530 tx=0x7f389c009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:00.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:00.906+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f38980ab550 con 0x7f38ac108d20 2024-07-26T08:27:01.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.158+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38ac19af90 con 0x7f38ac108d20 2024-07-26T08:27:01.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.159+0000 7f38a3400640 1 -- 172.21.15.43:0/3274191797 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7204 (secure 0 0 0) 0x7f38ac19af90 con 0x7f38ac108d20 2024-07-26T08:27:01.161 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:27:01.161 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"btime":"2024-07-26T08:26:58:146807+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-07-26T08:27:01.161 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-07-26T08:27:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f38900b3ca0 msgr2=0x7f38900b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f38900b3ca0 0x7f38900b61b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f389c009530 tx=0x7f389c009260 comp rx=0 tx=0).stop 2024-07-26T08:27:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 msgr2=0x7f38ac19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac19a400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f389800e9f0 tx=0x7f389800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 shutdown_connections 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f38900b3ca0 0x7f38900b61b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38ac109670 0x7f38ac19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38ac108d20 0x7f38ac19a400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 --2- 172.21.15.43:0/3274191797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38ac1033e0 0x7f38ac199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 >> 172.21.15.43:0/3274191797 conn(0x7f38ac0fee70 msgr2=0x7f38ac1062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 shutdown_connections 2024-07-26T08:27:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:01.162+0000 7f38abe00640 1 -- 172.21.15.43:0/3274191797 wait complete. 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: Deploying daemon mds.g on smithi043 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3274191797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T08:27:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:boot 2024-07-26T08:27:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:01 smithi063 ceph-mon[36747]: fsmap 9 up:standby 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: Deploying daemon mds.g on smithi043 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3274191797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T08:27:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:boot 2024-07-26T08:27:01.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:01 smithi043 ceph-mon[32384]: fsmap 9 up:standby 2024-07-26T08:27:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: Deploying daemon mds.g on smithi043 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3274191797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:boot 2024-07-26T08:27:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:01 smithi133 ceph-mon[37053]: fsmap 9 up:standby 2024-07-26T08:27:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:03 smithi043 ceph-mon[32384]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:03 smithi133 ceph-mon[37053]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:03 smithi063 ceph-mon[36747]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:04.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:27:04.604 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:05 smithi043 ceph-mon[32384]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:05 smithi133 ceph-mon[37053]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:06.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:05 smithi063 ceph-mon[36747]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:06.233 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:27:05 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: starting mds.g at 2024-07-26T08:27:06.732 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:27:06 smithi043 bash[78423]: b63d4833ceb2db4c8fead9ce87c81981149a4e4ef904658a5942fef4e8834ee6 2024-07-26T08:27:06.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:27:06 smithi043 systemd[1]: Started Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:27:07.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 -- 172.21.15.43:0/2881891286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a581024a0 msgr2=0x7f8a581028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:07.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/2881891286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a581024a0 0x7f8a581028b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009900 tx=0x7f8a4802a410 comp rx=0 tx=0).stop 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 -- 172.21.15.43:0/2881891286 shutdown_connections 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/2881891286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a58107de0 0x7f8a581081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/2881891286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58108730 0x7f8a5810ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/2881891286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a581024a0 0x7f8a581028b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 -- 172.21.15.43:0/2881891286 >> 172.21.15.43:0/2881891286 conn(0x7f8a58079160 msgr2=0x7f8a58079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 -- 172.21.15.43:0/2881891286 shutdown_connections 2024-07-26T08:27:07.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.331+0000 7f8a5ec00640 1 -- 172.21.15.43:0/2881891286 wait complete. 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.333+0000 7f8a5ec00640 1 Processor -- start 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.333+0000 7f8a5ec00640 1 -- start start 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a581024a0 0x7f8a5819c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 0x7f8a5819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a58108730 0x7f8a581a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58113610 con 0x7f8a58108730 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58113490 con 0x7f8a58107de0 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58113790 con 0x7f8a581024a0 2024-07-26T08:27:07.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a581024a0 0x7f8a5819c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 0x7f8a5819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 0x7f8a5819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37014/0 (socket says 172.21.15.43:37014) 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a581024a0 0x7f8a5819c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:47090/0 (socket says 172.21.15.43:47090) 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57400640 1 -- 172.21.15.43:0/1287209210 learned_addr learned my addr 172.21.15.43:0/1287209210 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a5cc00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a58108730 0x7f8a581a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57400640 1 -- 172.21.15.43:0/1287209210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a581024a0 msgr2=0x7f8a5819c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57400640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a581024a0 0x7f8a5819c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.334+0000 7f8a57400640 1 -- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a58108730 msgr2=0x7f8a581a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a57400640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a58108730 0x7f8a581a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a57400640 1 -- 172.21.15.43:0/1287209210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a581a20d0 con 0x7f8a58107de0 2024-07-26T08:27:07.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a57400640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 0x7f8a5819c700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400e9a0 tx=0x7f8a4400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:07.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400cd80 con 0x7f8a58107de0 2024-07-26T08:27:07.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a581a23c0 con 0x7f8a58107de0 2024-07-26T08:27:07.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a440035f0 con 0x7f8a58107de0 2024-07-26T08:27:07.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44010690 con 0x7f8a58107de0 2024-07-26T08:27:07.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.335+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a581a8b20 con 0x7f8a58107de0 2024-07-26T08:27:07.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.337+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a58103720 con 0x7f8a58107de0 2024-07-26T08:27:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.341+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f8a440037a0 con 0x7f8a58107de0 2024-07-26T08:27:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.343+0000 7f8a54c00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8a3c0b3c20 0x7f8a3c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.343+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f8a440e3c70 con 0x7f8a58107de0 2024-07-26T08:27:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.343+0000 7f8a57e00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8a3c0b3c20 0x7f8a3c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.343+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8a440a7210 con 0x7f8a58107de0 2024-07-26T08:27:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.344+0000 7f8a57e00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8a3c0b3c20 0x7f8a3c0b6130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006010 tx=0x7f8a48000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:07.457 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.457 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.457 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: Deploying daemon mds.a on smithi043 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:07.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:27:07.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:boot 2024-07-26T08:27:07.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:07 smithi043 ceph-mon[32384]: fsmap 10 up:standby 2024-07-26T08:27:07.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.595+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a5819d290 con 0x7f8a58107de0 2024-07-26T08:27:07.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.597+0000 7f8a54c00640 1 -- 172.21.15.43:0/1287209210 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8857 (secure 0 0 0) 0x7f8a5819d290 con 0x7f8a58107de0 2024-07-26T08:27:07.598 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:27:07.599 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":11,"btime":"2024-07-26T08:27:06:712054+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24686,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-07-26T08:27:07.599 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 11 2024-07-26T08:27:07.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.599+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8a3c0b3c20 msgr2=0x7f8a3c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:07.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.599+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8a3c0b3c20 0x7f8a3c0b6130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006010 tx=0x7f8a48000bc0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.599+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 msgr2=0x7f8a5819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.599+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 0x7f8a5819c700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400e9a0 tx=0x7f8a4400ee60 comp rx=0 tx=0).stop 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 shutdown_connections 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8a3c0b3c20 0x7f8a3c0b6130 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a58108730 0x7f8a581a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a58107de0 0x7f8a5819c700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 --2- 172.21.15.43:0/1287209210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a581024a0 0x7f8a5819c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 >> 172.21.15.43:0/1287209210 conn(0x7f8a58079160 msgr2=0x7f8a5810d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 shutdown_connections 2024-07-26T08:27:07.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:07.600+0000 7f8a5ec00640 1 -- 172.21.15.43:0/1287209210 wait complete. 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: Deploying daemon mds.a on smithi043 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:boot 2024-07-26T08:27:07.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:07 smithi133 ceph-mon[37053]: fsmap 10 up:standby 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: Deploying daemon mds.a on smithi043 2024-07-26T08:27:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:27:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:boot 2024-07-26T08:27:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:07 smithi063 ceph-mon[36747]: fsmap 10 up:standby 2024-07-26T08:27:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:08 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1287209210' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:08 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1287209210' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:08.876 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:08 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1287209210' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:09.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:09 smithi043 ceph-mon[32384]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:09.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:09 smithi133 ceph-mon[37053]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:09.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:09 smithi063 ceph-mon[36747]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:10.665 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:10 smithi043 systemd[1]: Starting Ceph mds.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:27:10.965 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:10 smithi043 podman[78801]: 2024-07-26 08:27:10.570417629 +0000 UTC m=+0.039840475 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:27:10.965 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:10 smithi043 podman[78801]: 2024-07-26 08:27:10.66615853 +0000 UTC m=+0.135581372 container create fc56a7adad442c02393fcfea071c32f583fa5b534eccd6daf317e86e68981e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-07-26T08:27:10.965 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:10 smithi043 podman[78801]: 2024-07-26 08:27:10.962717908 +0000 UTC m=+0.432140840 container init fc56a7adad442c02393fcfea071c32f583fa5b534eccd6daf317e86e68981e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-07-26T08:27:11.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:27:11.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:10 smithi043 podman[78801]: 2024-07-26 08:27:10.973676277 +0000 UTC m=+0.443099108 container start fc56a7adad442c02393fcfea071c32f583fa5b534eccd6daf317e86e68981e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724) 2024-07-26T08:27:11.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:11 smithi043 bash[78801]: fc56a7adad442c02393fcfea071c32f583fa5b534eccd6daf317e86e68981e57 2024-07-26T08:27:11.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:11 smithi043 systemd[1]: Started Ceph mds.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:27:11.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:11 smithi043 ceph-mds[78820]: -- 172.21.15.43:0/83700142 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a92ac9860 con 0x563a96c6b180 2024-07-26T08:27:11.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:11 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: starting mds.a at 2024-07-26T08:27:11.559 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: Deploying daemon mds.b on smithi063 2024-07-26T08:27:12.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T08:27:12.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] up:boot 2024-07-26T08:27:12.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:12 smithi063 ceph-mon[36747]: fsmap 11 up:standby 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: Deploying daemon mds.b on smithi063 2024-07-26T08:27:12.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T08:27:12.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] up:boot 2024-07-26T08:27:12.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:12 smithi043 ceph-mon[32384]: fsmap 11 up:standby 2024-07-26T08:27:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: Deploying daemon mds.b on smithi063 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] up:boot 2024-07-26T08:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:12 smithi133 ceph-mon[37053]: fsmap 11 up:standby 2024-07-26T08:27:13.500 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 systemd[1]: Starting Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:27:13.757 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 podman[68336]: 2024-07-26 08:27:13.401802953 +0000 UTC m=+0.017442326 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:27:13.757 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 podman[68336]: 2024-07-26 08:27:13.52815355 +0000 UTC m=+0.143792914 container create 6ae92b5bc47520975b3a9b7c7b670c61747b95ec594c64624f19f4b2856c7a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:27:13.757 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 podman[68336]: 2024-07-26 08:27:13.756595428 +0000 UTC m=+0.372234811 container init 6ae92b5bc47520975b3a9b7c7b670c61747b95ec594c64624f19f4b2856c7a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:27:13.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 -- 172.21.15.43:0/2313820217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 msgr2=0x7f698c1037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:13.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 --2- 172.21.15.43:0/2313820217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c1037d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f697c009900 tx=0x7f697c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:27:13.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 -- 172.21.15.43:0/2313820217 shutdown_connections 2024-07-26T08:27:13.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 --2- 172.21.15.43:0/2313820217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c109650 0x7f698c10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 --2- 172.21.15.43:0/2313820217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c108d00 0x7f698c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 --2- 172.21.15.43:0/2313820217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c1037d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.775+0000 7f698be00640 1 -- 172.21.15.43:0/2313820217 >> 172.21.15.43:0/2313820217 conn(0x7f698c0fee10 msgr2=0x7f698c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.776+0000 7f698be00640 1 -- 172.21.15.43:0/2313820217 shutdown_connections 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.776+0000 7f698be00640 1 -- 172.21.15.43:0/2313820217 wait complete. 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.777+0000 7f698be00640 1 Processor -- start 2024-07-26T08:27:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.777+0000 7f698be00640 1 -- start start 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c108d00 0x7f698c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c109650 0x7f698c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1134a0 con 0x7f698c1033c0 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f698c113320 con 0x7f698c109650 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f698c113620 con 0x7f698c108d00 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55582/0 (socket says 172.21.15.43:55582) 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698aa00640 1 -- 172.21.15.43:0/646072027 learned_addr learned my addr 172.21.15.43:0/646072027 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698b400640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c109650 0x7f698c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.778+0000 7f698a000640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c108d00 0x7f698c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:13.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698aa00640 1 -- 172.21.15.43:0/646072027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c108d00 msgr2=0x7f698c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:13.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698aa00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c108d00 0x7f698c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698aa00640 1 -- 172.21.15.43:0/646072027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c109650 msgr2=0x7f698c075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698aa00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c109650 0x7f698c075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698aa00640 1 -- 172.21.15.43:0/646072027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c1a80d0 con 0x7f698c1033c0 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698a000640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c108d00 0x7f698c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698b400640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c109650 0x7f698c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.779+0000 7f698aa00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c075140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f697c0314b0 tx=0x7f697c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.780+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c03f070 con 0x7f698c1033c0 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.780+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f697c031bf0 con 0x7f698c1033c0 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.780+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c1a8360 con 0x7f698c1033c0 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.780+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c035030 con 0x7f698c1033c0 2024-07-26T08:27:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.780+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c1a8890 con 0x7f698c1033c0 2024-07-26T08:27:13.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.781+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698c1037d0 con 0x7f698c1033c0 2024-07-26T08:27:13.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.784+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f697c03bd10 con 0x7f698c1033c0 2024-07-26T08:27:13.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.785+0000 7f6983400640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69700b3ca0 0x7f69700b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:13.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.786+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f697c104640 con 0x7f698c1033c0 2024-07-26T08:27:13.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.786+0000 7f698a000640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69700b3ca0 0x7f69700b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:13.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.787+0000 7f698a000640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69700b3ca0 0x7f69700b61b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f698c1087a0 tx=0x7f6974005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:13.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:13.788+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f697c031da0 con 0x7f698c1033c0 2024-07-26T08:27:14.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.049+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f698c076440 con 0x7f698c1033c0 2024-07-26T08:27:14.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.050+0000 7f6983400640 1 -- 172.21.15.43:0/646072027 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9680 (secure 0 0 0) 0x7f697c0cb970 con 0x7f698c1033c0 2024-07-26T08:27:14.052 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:27:14.052 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":12,"btime":"2024-07-26T08:27:11:707985+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24686,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-07-26T08:27:14.053 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 12 2024-07-26T08:27:14.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69700b3ca0 msgr2=0x7f69700b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:14.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69700b3ca0 0x7f69700b61b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f698c1087a0 tx=0x7f6974005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:14.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 msgr2=0x7f698c075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:14.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c075140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f697c0314b0 tx=0x7f697c003c10 comp rx=0 tx=0).stop 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 shutdown_connections 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69700b3ca0 0x7f69700b61b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f698c108d00 0x7f698c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f698c109650 0x7f698c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 --2- 172.21.15.43:0/646072027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f698c1033c0 0x7f698c075140 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 >> 172.21.15.43:0/646072027 conn(0x7f698c0fee10 msgr2=0x7f698c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.054+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 shutdown_connections 2024-07-26T08:27:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:14.055+0000 7f698be00640 1 -- 172.21.15.43:0/646072027 wait complete. 2024-07-26T08:27:14.067 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 podman[68336]: 2024-07-26 08:27:13.759529445 +0000 UTC m=+0.375168811 container start 6ae92b5bc47520975b3a9b7c7b670c61747b95ec594c64624f19f4b2856c7a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240724) 2024-07-26T08:27:14.067 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 ceph-mds[68355]: -- 172.21.15.63:0/1064615832 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c07069860 con 0x558c0b20b180 2024-07-26T08:27:14.067 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: starting mds.b at 2024-07-26T08:27:14.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 bash[68336]: 6ae92b5bc47520975b3a9b7c7b670c61747b95ec594c64624f19f4b2856c7a96 2024-07-26T08:27:14.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:27:13 smithi063 systemd[1]: Started Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:27:14.367 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:14.367 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.367 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.368 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.368 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.368 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.368 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/646072027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:14.368 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:27:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/646072027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/646072027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:27:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:15 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] up:boot 2024-07-26T08:27:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:15 smithi043 ceph-mon[32384]: fsmap 12 up:standby 2024-07-26T08:27:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:27:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:15 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] up:boot 2024-07-26T08:27:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:15 smithi133 ceph-mon[37053]: fsmap 12 up:standby 2024-07-26T08:27:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:27:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:15.526 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:15 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] up:boot 2024-07-26T08:27:15.527 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:15 smithi063 ceph-mon[36747]: fsmap 12 up:standby 2024-07-26T08:27:15.527 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:27:15.527 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:16 smithi043 ceph-mon[32384]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:16 smithi063 ceph-mon[36747]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:16.506 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.506 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.506 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.506 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:16 smithi133 ceph-mon[37053]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:16.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:27:17.191 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:27:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:27:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:18.050 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:27:19.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:19.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:19.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:19 smithi043 ceph-mon[32384]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:19.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:19.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 -- 172.21.15.43:0/1204510224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410b0f0 msgr2=0x7f123410b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 --2- 172.21.15.43:0/1204510224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410b0f0 0x7f123410b500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1220009900 tx=0x7f122002a410 comp rx=0 tx=0).stop 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 -- 172.21.15.43:0/1204510224 shutdown_connections 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 --2- 172.21.15.43:0/1204510224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f123410ba40 0x7f1234112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 --2- 172.21.15.43:0/1204510224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410b0f0 0x7f123410b500 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 --2- 172.21.15.43:0/1204510224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 0x7f1234105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 -- 172.21.15.43:0/1204510224 >> 172.21.15.43:0/1204510224 conn(0x7f1234101240 msgr2=0x7f1234103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 -- 172.21.15.43:0/1204510224 shutdown_connections 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.681+0000 7f123aa00640 1 -- 172.21.15.43:0/1204510224 wait complete. 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.682+0000 7f123aa00640 1 Processor -- start 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.682+0000 7f123aa00640 1 -- start start 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f123aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 0x7f123419c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f123aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f123410b0f0 0x7f123419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f123aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410ba40 0x7f12341a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f123aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1234115870 con 0x7f123410ba40 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f123aa00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f12341156f0 con 0x7f123410b0f0 2024-07-26T08:27:19.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f123aa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f12341159f0 con 0x7f12341057b0 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f1238a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410ba40 0x7f12341a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f1233e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 0x7f123419c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f1233e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 0x7f123419c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:42770/0 (socket says 172.21.15.43:42770) 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f1233e00640 1 -- 172.21.15.43:0/1601641556 learned_addr learned my addr 172.21.15.43:0/1601641556 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.683+0000 7f1233400640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f123410b0f0 0x7f123419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.684+0000 7f1238a00640 1 -- 172.21.15.43:0/1601641556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 msgr2=0x7f123419c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.684+0000 7f1238a00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 0x7f123419c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.684+0000 7f1238a00640 1 -- 172.21.15.43:0/1601641556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f123410b0f0 msgr2=0x7f123419c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.684+0000 7f1238a00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f123410b0f0 0x7f123419c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.684+0000 7f1238a00640 1 -- 172.21.15.43:0/1601641556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12341a2150 con 0x7f123410ba40 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.684+0000 7f1238a00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410ba40 0x7f12341a1a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f122c009fd0 tx=0x7f122c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:19.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.685+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c00ce20 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.685+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12341a2440 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.685+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f122c005020 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.685+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c010720 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.685+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12341a8ba0 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.686+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1234105bc0 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.689+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f122c005560 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.691+0000 7f1230c00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f12180b3c20 0x7f12180b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.692+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f122c0e3fb0 con 0x7f123410ba40 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.692+0000 7f1233e00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f12180b3c20 0x7f12180b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.692+0000 7f1233e00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f12180b3c20 0x7f12180b6130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12240095f0 tx=0x7f1224005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:19.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.694+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f122c0ab930 con 0x7f123410ba40 2024-07-26T08:27:19.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.940+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f123419d310 con 0x7f123410ba40 2024-07-26T08:27:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.942+0000 7f1230c00640 1 -- 172.21.15.43:0/1601641556 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7f123419d310 con 0x7f123410ba40 2024-07-26T08:27:19.943 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:27:19.944 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"btime":"2024-07-26T08:27:14:184000+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24686,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-07-26T08:27:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2024-07-26T08:27:19.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f12180b3c20 msgr2=0x7f12180b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:19.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f12180b3c20 0x7f12180b6130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12240095f0 tx=0x7f1224005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:19.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410ba40 msgr2=0x7f12341a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:19.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410ba40 0x7f12341a1a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f122c009fd0 tx=0x7f122c00ef10 comp rx=0 tx=0).stop 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 shutdown_connections 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f12180b3c20 0x7f12180b6130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123410ba40 0x7f12341a1a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f123410b0f0 0x7f123419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 --2- 172.21.15.43:0/1601641556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12341057b0 0x7f123419c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 >> 172.21.15.43:0/1601641556 conn(0x7f1234101240 msgr2=0x7f123410a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:19.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 shutdown_connections 2024-07-26T08:27:19.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:19.945+0000 7f123aa00640 1 -- 172.21.15.43:0/1601641556 wait complete. 2024-07-26T08:27:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:19 smithi133 ceph-mon[37053]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:20.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:19 smithi063 ceph-mon[36747]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:20.918 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:20 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1601641556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:20.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-07-26T08:27:21.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:20 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1601641556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:21.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:20 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1601641556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:27:21.477 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:21.981 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:21 smithi043 ceph-mon[32384]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:21 smithi133 ceph-mon[37053]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:22.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:21 smithi063 ceph-mon[36747]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 -- 172.21.15.43:0/564366749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104330 msgr2=0x7fc6c0104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 --2- 172.21.15.43:0/564366749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104330 0x7fc6c0104740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009900 tx=0x7fc6b402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 -- 172.21.15.43:0/564366749 shutdown_connections 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 --2- 172.21.15.43:0/564366749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c010d8e0 0x7fc6c010fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 --2- 172.21.15.43:0/564366749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c0104c80 0x7fc6c010d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 --2- 172.21.15.43:0/564366749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104330 0x7fc6c0104740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 -- 172.21.15.43:0/564366749 >> 172.21.15.43:0/564366749 conn(0x7fc6c0079190 msgr2=0x7fc6c00795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.851+0000 7fc6c8200640 1 -- 172.21.15.43:0/564366749 shutdown_connections 2024-07-26T08:27:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.852+0000 7fc6c8200640 1 -- 172.21.15.43:0/564366749 wait complete. 2024-07-26T08:27:23.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 Processor -- start 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 -- start start 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c0104330 0x7fc6c019c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104c80 0x7fc6c019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 0x7fc6c01a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0113680 con 0x7fc6c010d8e0 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0113500 con 0x7fc6c0104c80 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.853+0000 7fc6c8200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0113800 con 0x7fc6c0104330 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 0x7fc6c01a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 0x7fc6c01a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55822/0 (socket says 172.21.15.43:55822) 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c6200640 1 -- 172.21.15.43:0/3561075983 learned_addr learned my addr 172.21.15.43:0/3561075983 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104c80 0x7fc6c019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c5800640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c0104330 0x7fc6c019c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 -- 172.21.15.43:0/3561075983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c0104330 msgr2=0x7fc6c019c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c0104330 0x7fc6c019c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 -- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 msgr2=0x7fc6c01a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 0x7fc6c01a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 -- 172.21.15.43:0/3561075983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c01a2220 con 0x7fc6c0104c80 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c6200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 0x7fc6c01a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.854+0000 7fc6c4e00640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104c80 0x7fc6c019c850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00e9c0 tx=0x7fc6ac00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.855+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac00cd80 con 0x7fc6c0104c80 2024-07-26T08:27:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.855+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6ac0035f0 con 0x7fc6c0104c80 2024-07-26T08:27:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.855+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac010690 con 0x7fc6c0104c80 2024-07-26T08:27:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.855+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c01a2510 con 0x7fc6c0104c80 2024-07-26T08:27:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.855+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c01a8c70 con 0x7fc6c0104c80 2024-07-26T08:27:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.856+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c0104740 con 0x7fc6c0104c80 2024-07-26T08:27:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.859+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc6ac0037a0 con 0x7fc6c0104c80 2024-07-26T08:27:23.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.860+0000 7fc6be000640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6a80b3ca0 0x7fc6a80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.861+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc6ac0e3c50 con 0x7fc6c0104c80 2024-07-26T08:27:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.861+0000 7fc6c5800640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6a80b3ca0 0x7fc6a80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.861+0000 7fc6c5800640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6a80b3ca0 0x7fc6a80b61b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4004770 tx=0x7fc6b4000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:23.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:23.862+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc6ac0ab660 con 0x7fc6c0104c80 2024-07-26T08:27:24.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.066+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc6c019d3e0 con 0x7fc6c0104c80 2024-07-26T08:27:24.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.067+0000 7fc6be000640 1 -- 172.21.15.43:0/3561075983 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7fc6c019d3e0 con 0x7fc6c0104c80 2024-07-26T08:27:24.068 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:27:24.068 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-07-26T08:27:24.068 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T08:27:24.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-07-26T08:27:24.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-07-26T08:27:24.069 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:27:24.069 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-07-26T08:27:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6a80b3ca0 msgr2=0x7fc6a80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6a80b3ca0 0x7fc6a80b61b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4004770 tx=0x7fc6b4000bc0 comp rx=0 tx=0).stop 2024-07-26T08:27:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104c80 msgr2=0x7fc6c019c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104c80 0x7fc6c019c850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00e9c0 tx=0x7fc6ac00ee80 comp rx=0 tx=0).stop 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 shutdown_connections 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6a80b3ca0 0x7fc6a80b61b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c010d8e0 0x7fc6c01a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c0104c80 0x7fc6c019c850 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 --2- 172.21.15.43:0/3561075983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c0104330 0x7fc6c019c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 >> 172.21.15.43:0/3561075983 conn(0x7fc6c0079190 msgr2=0x7fc6c00fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 shutdown_connections 2024-07-26T08:27:24.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:24.070+0000 7fc6c8200640 1 -- 172.21.15.43:0/3561075983 wait complete. 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.450 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:24 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3561075983' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-26T08:27:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:27:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:24 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3561075983' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-26T08:27:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:27:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:27:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:27:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:24 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3561075983' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-26T08:27:24.992 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-26T08:27:24.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-26T08:27:25.497 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:26 smithi063 ceph-mon[36747]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:26.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:26 smithi043 ceph-mon[32384]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:26 smithi133 ceph-mon[37053]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 -- 172.21.15.43:0/3217499542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c301033c0 msgr2=0x7f7c301037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 --2- 172.21.15.43:0/3217499542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c301033c0 0x7f7c301037d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009860 tx=0x7f7c2002a340 comp rx=0 tx=0).stop 2024-07-26T08:27:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 -- 172.21.15.43:0/3217499542 shutdown_connections 2024-07-26T08:27:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 --2- 172.21.15.43:0/3217499542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c30109650 0x7f7c3010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 --2- 172.21.15.43:0/3217499542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c30108d00 0x7f7c30109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 --2- 172.21.15.43:0/3217499542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c301033c0 0x7f7c301037d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.822+0000 7f7c35800640 1 -- 172.21.15.43:0/3217499542 >> 172.21.15.43:0/3217499542 conn(0x7f7c300fee10 msgr2=0x7f7c30101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.823+0000 7f7c35800640 1 -- 172.21.15.43:0/3217499542 shutdown_connections 2024-07-26T08:27:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.823+0000 7f7c35800640 1 -- 172.21.15.43:0/3217499542 wait complete. 2024-07-26T08:27:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.824+0000 7f7c35800640 1 Processor -- start 2024-07-26T08:27:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.824+0000 7f7c35800640 1 -- start start 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c35800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 0x7f7c3019c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c35800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c30108d00 0x7f7c3019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c35800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c30109650 0x7f7c301a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c35800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30113430 con 0x7f7c30108d00 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c35800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301132b0 con 0x7f7c301033c0 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c35800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301135b0 con 0x7f7c30109650 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c2f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c30108d00 0x7f7c3019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c2fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 0x7f7c3019c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c2fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 0x7f7c3019c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:53388/0 (socket says 172.21.15.43:53388) 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.825+0000 7f7c2fe00640 1 -- 172.21.15.43:0/2793286235 learned_addr learned my addr 172.21.15.43:0/2793286235 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c34e00640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c30109650 0x7f7c301a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c2fe00640 1 -- 172.21.15.43:0/2793286235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c30109650 msgr2=0x7f7c301a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c2fe00640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c30109650 0x7f7c301a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c2fe00640 1 -- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c30108d00 msgr2=0x7f7c3019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c2fe00640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c30108d00 0x7f7c3019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c2fe00640 1 -- 172.21.15.43:0/2793286235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c301a1fb0 con 0x7f7c301033c0 2024-07-26T08:27:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c34e00640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c30109650 0x7f7c301a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.826+0000 7f7c2fe00640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 0x7f7c3019c040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7c20035040 tx=0x7f7c2002af30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.827+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2003f020 con 0x7f7c301033c0 2024-07-26T08:27:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.827+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c301a2240 con 0x7f7c301033c0 2024-07-26T08:27:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.827+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c20033e50 con 0x7f7c301033c0 2024-07-26T08:27:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.827+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20037040 con 0x7f7c301033c0 2024-07-26T08:27:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.827+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c301a8a00 con 0x7f7c301033c0 2024-07-26T08:27:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.828+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c301037d0 con 0x7f7c301033c0 2024-07-26T08:27:27.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.831+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f7c20042020 con 0x7f7c301033c0 2024-07-26T08:27:27.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.832+0000 7f7c2cc00640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7c140b3ca0 0x7f7c140b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:27.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.833+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f7c20103a30 con 0x7f7c301033c0 2024-07-26T08:27:27.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.833+0000 7f7c2f400640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7c140b3ca0 0x7f7c140b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:27.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.834+0000 7f7c2f400640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7c140b3ca0 0x7f7c140b61b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c30107670 tx=0x7f7c18005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:27.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:27.834+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7c20049020 con 0x7f7c301033c0 2024-07-26T08:27:28.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.037+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7c3019d170 con 0x7f7c301033c0 2024-07-26T08:27:28.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.226+0000 7f7c2cc00640 1 -- 172.21.15.43:0/2793286235 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f7c3019d170 con 0x7f7c301033c0 2024-07-26T08:27:28.229 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-07-26T08:27:28.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.232+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7c140b3ca0 msgr2=0x7f7c140b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.232+0000 7f7c35800640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7c140b3ca0 0x7f7c140b61b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c30107670 tx=0x7f7c18005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.232+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 msgr2=0x7f7c3019c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.232+0000 7f7c35800640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 0x7f7c3019c040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7c20035040 tx=0x7f7c2002af30 comp rx=0 tx=0).stop 2024-07-26T08:27:28.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 shutdown_connections 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7c140b3ca0 0x7f7c140b61b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c30109650 0x7f7c301a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c30108d00 0x7f7c3019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 --2- 172.21.15.43:0/2793286235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c301033c0 0x7f7c3019c040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 >> 172.21.15.43:0/2793286235 conn(0x7f7c300fee10 msgr2=0x7f7c301083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 shutdown_connections 2024-07-26T08:27:28.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:28.233+0000 7f7c35800640 1 -- 172.21.15.43:0/2793286235 wait complete. 2024-07-26T08:27:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:28 smithi043 ceph-mon[32384]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:28 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2793286235' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T08:27:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:28 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T08:27:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:28 smithi133 ceph-mon[37053]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:28 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2793286235' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T08:27:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:28 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T08:27:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:28 smithi063 ceph-mon[36747]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:28 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2793286235' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T08:27:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:28 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T08:27:29.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-07-26T08:27:29.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:29 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-26T08:27:29.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:29 smithi043 ceph-mon[32384]: osdmap e73: 12 total, 12 up, 12 in 2024-07-26T08:27:29.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:29 smithi043 ceph-mon[32384]: osdmap e74: 12 total, 12 up, 12 in 2024-07-26T08:27:29.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:29 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-26T08:27:29.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:29 smithi133 ceph-mon[37053]: osdmap e73: 12 total, 12 up, 12 in 2024-07-26T08:27:29.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:29 smithi133 ceph-mon[37053]: osdmap e74: 12 total, 12 up, 12 in 2024-07-26T08:27:29.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:29 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-26T08:27:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:29 smithi063 ceph-mon[36747]: osdmap e73: 12 total, 12 up, 12 in 2024-07-26T08:27:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:29 smithi063 ceph-mon[36747]: osdmap e74: 12 total, 12 up, 12 in 2024-07-26T08:27:29.671 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:30.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:30 smithi043 ceph-mon[32384]: pgmap v298: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:30 smithi043 ceph-mon[32384]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:30 smithi043 ceph-mon[32384]: osdmap e75: 12 total, 12 up, 12 in 2024-07-26T08:27:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:30 smithi133 ceph-mon[37053]: pgmap v298: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:30 smithi133 ceph-mon[37053]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:30 smithi133 ceph-mon[37053]: osdmap e75: 12 total, 12 up, 12 in 2024-07-26T08:27:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:30 smithi063 ceph-mon[36747]: pgmap v298: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:30 smithi063 ceph-mon[36747]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:30 smithi063 ceph-mon[36747]: osdmap e75: 12 total, 12 up, 12 in 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 -- 172.21.15.43:0/136752055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c410ba70 msgr2=0x7fb1c41122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 --2- 172.21.15.43:0/136752055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c410ba70 0x7fb1c41122a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009ca0 tx=0x7fb1bc02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 -- 172.21.15.43:0/136752055 shutdown_connections 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 --2- 172.21.15.43:0/136752055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 --2- 172.21.15.43:0/136752055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c410ba70 0x7fb1c41122a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 --2- 172.21.15.43:0/136752055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c41057e0 0x7fb1c4105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 -- 172.21.15.43:0/136752055 >> 172.21.15.43:0/136752055 conn(0x7fb1c41011f0 msgr2=0x7fb1c4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:32.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 -- 172.21.15.43:0/136752055 shutdown_connections 2024-07-26T08:27:32.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.091+0000 7fb1ca200640 1 -- 172.21.15.43:0/136752055 wait complete. 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.092+0000 7fb1ca200640 1 Processor -- start 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 -- start start 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c41057e0 0x7fb1c419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c410ba70 0x7fb1c41a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4115850 con 0x7fb1c410ba70 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c41156d0 con 0x7fb1c41057e0 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1ca200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c41159d0 con 0x7fb1c410b120 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.093+0000 7fb1c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c410ba70 0x7fb1c41a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:32.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c419c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51370/0 (socket says 172.21.15.43:51370) 2024-07-26T08:27:32.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 -- 172.21.15.43:0/2293291909 learned_addr learned my addr 172.21.15.43:0/2293291909 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:32.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c3400640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c41057e0 0x7fb1c419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:32.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 -- 172.21.15.43:0/2293291909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c41057e0 msgr2=0x7fb1c419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c41057e0 0x7fb1c419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 -- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c410ba70 msgr2=0x7fb1c41a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c410ba70 0x7fb1c41a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 -- 172.21.15.43:0/2293291909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41a2170 con 0x7fb1c410b120 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.094+0000 7fb1c2a00640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c419c7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9f0 tx=0x7fb1ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.095+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00ccc0 con 0x7fb1c410b120 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.095+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c41a2460 con 0x7fb1c410b120 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.095+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1ac010900 con 0x7fb1c410b120 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.095+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac018900 con 0x7fb1c410b120 2024-07-26T08:27:32.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.095+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41a8bc0 con 0x7fb1c410b120 2024-07-26T08:27:32.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.096+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4105bf0 con 0x7fb1c410b120 2024-07-26T08:27:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.099+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fb1ac010ab0 con 0x7fb1c410b120 2024-07-26T08:27:32.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.100+0000 7fb1bbe00640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1a80b3c20 0x7fb1a80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:32.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.100+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7712+0+0 (secure 0 0 0) 0x7fb1ac0e3e00 con 0x7fb1c410b120 2024-07-26T08:27:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.101+0000 7fb1c3400640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1a80b3c20 0x7fb1a80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.101+0000 7fb1c3400640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1a80b3c20 0x7fb1a80b6130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009bd0 tx=0x7fb1b4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.102+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb1ac0aafe0 con 0x7fb1c410b120 2024-07-26T08:27:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:32.306+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fb1c410d8c0 con 0x7fb1c410b120 2024-07-26T08:27:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:32 smithi133 ceph-mon[37053]: pgmap v301: 33 pgs: 9 creating+peering, 16 unknown, 8 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:32 smithi063 ceph-mon[36747]: pgmap v301: 33 pgs: 9 creating+peering, 16 unknown, 8 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:32.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:32 smithi043 ceph-mon[32384]: pgmap v301: 33 pgs: 9 creating+peering, 16 unknown, 8 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.277+0000 7fb1bbe00640 1 -- 172.21.15.43:0/2293291909 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v76) ==== 171+0+0 (secure 0 0 0) 0x7fb1ac0af530 con 0x7fb1c410b120 2024-07-26T08:27:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-07-26T08:27:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1a80b3c20 msgr2=0x7fb1a80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1a80b3c20 0x7fb1a80b6130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009bd0 tx=0x7fb1b4005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 msgr2=0x7fb1c419c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c419c7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9f0 tx=0x7fb1ac00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 shutdown_connections 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1a80b3c20 0x7fb1a80b6130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c410b120 0x7fb1c419c7a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c410ba70 0x7fb1c41a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 --2- 172.21.15.43:0/2293291909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1c41057e0 0x7fb1c419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.283+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 >> 172.21.15.43:0/2293291909 conn(0x7fb1c41011f0 msgr2=0x7fb1c4108600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.285+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 shutdown_connections 2024-07-26T08:27:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:33.285+0000 7fb1ca200640 1 -- 172.21.15.43:0/2293291909 wait complete. 2024-07-26T08:27:33.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:33 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2293291909' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-07-26T08:27:33.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:33 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-07-26T08:27:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:33 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2293291909' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-07-26T08:27:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:33 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-07-26T08:27:33.640 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:33 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2293291909' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-07-26T08:27:33.640 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:33 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-07-26T08:27:34.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-26T08:27:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:34 smithi043 ceph-mon[32384]: pgmap v302: 33 pgs: 9 creating+peering, 3 unknown, 21 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:34 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-07-26T08:27:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:34 smithi043 ceph-mon[32384]: osdmap e76: 12 total, 12 up, 12 in 2024-07-26T08:27:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:34 smithi063 ceph-mon[36747]: pgmap v302: 33 pgs: 9 creating+peering, 3 unknown, 21 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:34 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-07-26T08:27:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:34 smithi063 ceph-mon[36747]: osdmap e76: 12 total, 12 up, 12 in 2024-07-26T08:27:34.718 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:34 smithi133 ceph-mon[37053]: pgmap v302: 33 pgs: 9 creating+peering, 3 unknown, 21 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:34 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-07-26T08:27:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:34 smithi133 ceph-mon[37053]: osdmap e76: 12 total, 12 up, 12 in 2024-07-26T08:27:35.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:35 smithi063 ceph-mon[36747]: osdmap e77: 12 total, 12 up, 12 in 2024-07-26T08:27:35.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:35 smithi043 ceph-mon[32384]: osdmap e77: 12 total, 12 up, 12 in 2024-07-26T08:27:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:35 smithi133 ceph-mon[37053]: osdmap e77: 12 total, 12 up, 12 in 2024-07-26T08:27:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:36 smithi063 ceph-mon[36747]: pgmap v305: 97 pgs: 6 creating+peering, 56 unknown, 35 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:36 smithi063 ceph-mon[36747]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:36 smithi063 ceph-mon[36747]: osdmap e78: 12 total, 12 up, 12 in 2024-07-26T08:27:36.609 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:36 smithi043 ceph-mon[32384]: pgmap v305: 97 pgs: 6 creating+peering, 56 unknown, 35 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:36.609 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:36 smithi043 ceph-mon[32384]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:36.609 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:36 smithi043 ceph-mon[32384]: osdmap e78: 12 total, 12 up, 12 in 2024-07-26T08:27:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:36 smithi133 ceph-mon[37053]: pgmap v305: 97 pgs: 6 creating+peering, 56 unknown, 35 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:36 smithi133 ceph-mon[37053]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:36 smithi133 ceph-mon[37053]: osdmap e78: 12 total, 12 up, 12 in 2024-07-26T08:27:37.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 -- 172.21.15.43:0/2427700874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5810d650 msgr2=0x7f1f5810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 --2- 172.21.15.43:0/2427700874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5810d650 0x7f1f5810fb40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009ca0 tx=0x7f1f5002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:27:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 -- 172.21.15.43:0/2427700874 shutdown_connections 2024-07-26T08:27:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 --2- 172.21.15.43:0/2427700874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f5810d650 0x7f1f5810fb40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 --2- 172.21.15.43:0/2427700874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f58104b40 0x7f1f5810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 --2- 172.21.15.43:0/2427700874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f581041f0 0x7f1f58104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:37.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 -- 172.21.15.43:0/2427700874 >> 172.21.15.43:0/2427700874 conn(0x7f1f580fdcf0 msgr2=0x7f1f58100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:37.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 -- 172.21.15.43:0/2427700874 shutdown_connections 2024-07-26T08:27:37.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.245+0000 7f1f57200640 1 -- 172.21.15.43:0/2427700874 wait complete. 2024-07-26T08:27:37.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.246+0000 7f1f57200640 1 Processor -- start 2024-07-26T08:27:37.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 -- start start 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 0x7f1f5819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58104b40 0x7f1f5819c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5810d650 0x7f1f581a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58113410 con 0x7f1f581041f0 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58113290 con 0x7f1f58104b40 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.247+0000 7f1f57200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58113590 con 0x7f1f5810d650 2024-07-26T08:27:37.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 0x7f1f5819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:37.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 0x7f1f5819bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36758/0 (socket says 172.21.15.43:36758) 2024-07-26T08:27:37.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 -- 172.21.15.43:0/3250129013 learned_addr learned my addr 172.21.15.43:0/3250129013 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:37.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55400640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58104b40 0x7f1f5819c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:37.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f56800640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5810d650 0x7f1f581a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:37.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 -- 172.21.15.43:0/3250129013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5810d650 msgr2=0x7f1f581a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:37.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5810d650 0x7f1f581a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:37.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 -- 172.21.15.43:0/3250129013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58104b40 msgr2=0x7f1f5819c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:37.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58104b40 0x7f1f5819c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:37.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55e00640 1 -- 172.21.15.43:0/3250129013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f581a1ed0 con 0x7f1f581041f0 2024-07-26T08:27:37.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f55400640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58104b40 0x7f1f5819c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:37.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.248+0000 7f1f56800640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5810d650 0x7f1f581a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:37.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.249+0000 7f1f55e00640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 0x7f1f5819bf60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800e9f0 tx=0x7f1f4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:37.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.249+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800cd80 con 0x7f1f581041f0 2024-07-26T08:27:37.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.249+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f581a21c0 con 0x7f1f581041f0 2024-07-26T08:27:37.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.249+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f480054f0 con 0x7f1f581041f0 2024-07-26T08:27:37.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.249+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48010690 con 0x7f1f581041f0 2024-07-26T08:27:37.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.249+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a8920 con 0x7f1f581041f0 2024-07-26T08:27:37.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.251+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f58104600 con 0x7f1f581041f0 2024-07-26T08:27:37.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.254+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f1f480046c0 con 0x7f1f581041f0 2024-07-26T08:27:37.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.255+0000 7f1f4ea00640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f3c0b3c20 0x7f1f3c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:37.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.255+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8094+0+0 (secure 0 0 0) 0x7f1f480e4180 con 0x7f1f581041f0 2024-07-26T08:27:37.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.256+0000 7f1f55400640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f3c0b3c20 0x7f1f3c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:37.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.256+0000 7f1f55400640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f3c0b3c20 0x7f1f3c0b6130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1f58101460 tx=0x7f1f44005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:37.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.258+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1f480ab810 con 0x7f1f581041f0 2024-07-26T08:27:37.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:37.508+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1f5819d090 con 0x7f1f581041f0 2024-07-26T08:27:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.319+0000 7f1f4ea00640 1 -- 172.21.15.43:0/3250129013 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1f480920c0 con 0x7f1f581041f0 2024-07-26T08:27:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 2 and data pool 3 2024-07-26T08:27:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.322+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f3c0b3c20 msgr2=0x7f1f3c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.322+0000 7f1f57200640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f3c0b3c20 0x7f1f3c0b6130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1f58101460 tx=0x7f1f44005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.322+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 msgr2=0x7f1f5819bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.322+0000 7f1f57200640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 0x7f1f5819bf60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800e9f0 tx=0x7f1f4800edf0 comp rx=0 tx=0).stop 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 shutdown_connections 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f3c0b3c20 0x7f1f3c0b6130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5810d650 0x7f1f581a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f58104b40 0x7f1f5819c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 --2- 172.21.15.43:0/3250129013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f581041f0 0x7f1f5819bf60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 >> 172.21.15.43:0/3250129013 conn(0x7f1f580fdcf0 msgr2=0x7f1f58101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 shutdown_connections 2024-07-26T08:27:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:38.323+0000 7f1f57200640 1 -- 172.21.15.43:0/3250129013 wait complete. 2024-07-26T08:27:38.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:38 smithi063 ceph-mon[36747]: pgmap v307: 97 pgs: 6 creating+peering, 31 unknown, 60 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:38.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:38 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3250129013' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-26T08:27:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:38 smithi063 ceph-mon[36747]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-07-26T08:27:38.711 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:38 smithi043 ceph-mon[32384]: pgmap v307: 97 pgs: 6 creating+peering, 31 unknown, 60 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:38.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:38 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3250129013' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-26T08:27:38.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:38 smithi043 ceph-mon[32384]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-07-26T08:27:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:38 smithi133 ceph-mon[37053]: pgmap v307: 97 pgs: 6 creating+peering, 31 unknown, 60 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:38 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3250129013' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-26T08:27:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:38 smithi133 ceph-mon[37053]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-07-26T08:27:39.311 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-07-26T08:27:39.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-07-26T08:27:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:39 smithi063 ceph-mon[36747]: osdmap e79: 12 total, 12 up, 12 in 2024-07-26T08:27:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:39 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3250129013' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-26T08:27:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:39 smithi063 ceph-mon[36747]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-07-26T08:27:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:39 smithi063 ceph-mon[36747]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-07-26T08:27:39.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:39 smithi043 ceph-mon[32384]: osdmap e79: 12 total, 12 up, 12 in 2024-07-26T08:27:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:39 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3250129013' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-26T08:27:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:39 smithi043 ceph-mon[32384]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-07-26T08:27:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:39 smithi043 ceph-mon[32384]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-07-26T08:27:39.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:39 smithi133 ceph-mon[37053]: osdmap e79: 12 total, 12 up, 12 in 2024-07-26T08:27:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:39 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3250129013' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-26T08:27:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:39 smithi133 ceph-mon[37053]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-07-26T08:27:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:39 smithi133 ceph-mon[37053]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-07-26T08:27:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:40 smithi063 ceph-mon[36747]: pgmap v309: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:40 smithi063 ceph-mon[36747]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-26T08:27:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:40 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:27:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] up:active 2024-07-26T08:27:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:40 smithi063 ceph-mon[36747]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:40 smithi063 ceph-mon[36747]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:40 smithi043 ceph-mon[32384]: pgmap v309: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:40 smithi043 ceph-mon[32384]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-26T08:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:40 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] up:active 2024-07-26T08:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:40 smithi043 ceph-mon[32384]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:40 smithi043 ceph-mon[32384]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:40 smithi133 ceph-mon[37053]: pgmap v309: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:40 smithi133 ceph-mon[37053]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-26T08:27:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:40 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:27:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] up:active 2024-07-26T08:27:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:40 smithi133 ceph-mon[37053]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:40 smithi133 ceph-mon[37053]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:41.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:27:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:27:41.726+0000 7f9181a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-26T08:27:42.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.053+0000 7f4444e00640 1 -- 172.21.15.43:0/3085860781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4440109650 msgr2=0x7f444010fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:42.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.053+0000 7f4444e00640 1 --2- 172.21.15.43:0/3085860781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4440109650 0x7f444010fe80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4438009ca0 tx=0x7f443802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 -- 172.21.15.43:0/3085860781 shutdown_connections 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 --2- 172.21.15.43:0/3085860781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 0x7f4440109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 --2- 172.21.15.43:0/3085860781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4440109650 0x7f444010fe80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 --2- 172.21.15.43:0/3085860781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44401033c0 0x7f44401037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 -- 172.21.15.43:0/3085860781 >> 172.21.15.43:0/3085860781 conn(0x7f44400fee10 msgr2=0x7f4440101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 -- 172.21.15.43:0/3085860781 shutdown_connections 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.054+0000 7f4444e00640 1 -- 172.21.15.43:0/3085860781 wait complete. 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.055+0000 7f4444e00640 1 Processor -- start 2024-07-26T08:27:42.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.055+0000 7f4444e00640 1 -- start start 2024-07-26T08:27:42.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4444e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 0x7f4440075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:42.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4444e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 0x7f4440075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:42.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4444e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4440109650 0x7f4440075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:42.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4444e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4440113430 con 0x7f44401033c0 2024-07-26T08:27:42.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4444e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44401132b0 con 0x7f4440109650 2024-07-26T08:27:42.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4444e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f44401135b0 con 0x7f4440108d00 2024-07-26T08:27:42.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f443f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 0x7f4440075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:42.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f443f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 0x7f4440075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36778/0 (socket says 172.21.15.43:36778) 2024-07-26T08:27:42.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f443f400640 1 -- 172.21.15.43:0/783538025 learned_addr learned my addr 172.21.15.43:0/783538025 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:42.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.056+0000 7f4436a00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 0x7f4440075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:42.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443fe00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4440109650 0x7f4440075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:42.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443f400640 1 -- 172.21.15.43:0/783538025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 msgr2=0x7f4440075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:42.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443f400640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 0x7f4440075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443f400640 1 -- 172.21.15.43:0/783538025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4440109650 msgr2=0x7f4440075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443f400640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4440109650 0x7f4440075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443f400640 1 -- 172.21.15.43:0/783538025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44401a80c0 con 0x7f44401033c0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f4436a00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 0x7f4440075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.057+0000 7f443f400640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 0x7f4440075140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f443000e9f0 tx=0x7f443000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.058+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443000cd80 con 0x7f44401033c0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.058+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4430010900 con 0x7f44401033c0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.058+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430018920 con 0x7f44401033c0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.058+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44401a83b0 con 0x7f44401033c0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.058+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44401a88a0 con 0x7f44401033c0 2024-07-26T08:27:42.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.059+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44401037d0 con 0x7f44401033c0 2024-07-26T08:27:42.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.062+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f4430010ab0 con 0x7f44401033c0 2024-07-26T08:27:42.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.064+0000 7f443cc00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44240b3ca0 0x7f44240b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:42.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.064+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8194+0+0 (secure 0 0 0) 0x7f44300e3fd0 con 0x7f44401033c0 2024-07-26T08:27:42.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.064+0000 7f4436a00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44240b3ca0 0x7f44240b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:42.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.065+0000 7f4436a00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44240b3ca0 0x7f44240b61b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4440105600 tx=0x7f4428005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:42.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.069+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f44300aaf90 con 0x7f44401033c0 2024-07-26T08:27:42.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.281+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f444002e0c0 con 0x7f44401033c0 2024-07-26T08:27:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.315+0000 7f443cc00640 1 -- 172.21.15.43:0/783538025 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7f44300af4e0 con 0x7f44401033c0 2024-07-26T08:27:42.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.320+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44240b3ca0 msgr2=0x7f44240b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.320+0000 7f4444e00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44240b3ca0 0x7f44240b61b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4440105600 tx=0x7f4428005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.321+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 msgr2=0x7f4440075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.321+0000 7f4444e00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 0x7f4440075140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f443000e9f0 tx=0x7f443000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.322+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 shutdown_connections 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.322+0000 7f4444e00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44240b3ca0 0x7f44240b61b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.322+0000 7f4444e00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4440108d00 0x7f4440075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.322+0000 7f4444e00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4440109650 0x7f4440075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.322+0000 7f4444e00640 1 --2- 172.21.15.43:0/783538025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44401033c0 0x7f4440075140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.322+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 >> 172.21.15.43:0/783538025 conn(0x7f44400fee10 msgr2=0x7f4440101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.323+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 shutdown_connections 2024-07-26T08:27:42.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:42.323+0000 7f4444e00640 1 -- 172.21.15.43:0/783538025 wait complete. 2024-07-26T08:27:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:42 smithi043 ceph-mon[32384]: pgmap v310: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 641 B/s wr, 2 op/s 2024-07-26T08:27:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:42 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/783538025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-07-26T08:27:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:42 smithi133 ceph-mon[37053]: pgmap v310: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 641 B/s wr, 2 op/s 2024-07-26T08:27:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:42 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/783538025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-07-26T08:27:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:42 smithi063 ceph-mon[36747]: pgmap v310: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 641 B/s wr, 2 op/s 2024-07-26T08:27:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:42 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/783538025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-07-26T08:27:43.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-07-26T08:27:43.675 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:43.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:43 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/783538025' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-07-26T08:27:43.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:43 smithi063 ceph-mon[36747]: osdmap e80: 12 total, 12 up, 12 in 2024-07-26T08:27:43.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:43 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/783538025' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-07-26T08:27:43.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:43 smithi043 ceph-mon[32384]: osdmap e80: 12 total, 12 up, 12 in 2024-07-26T08:27:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:43 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/783538025' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-07-26T08:27:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:43 smithi133 ceph-mon[37053]: osdmap e80: 12 total, 12 up, 12 in 2024-07-26T08:27:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:44 smithi043 ceph-mon[32384]: pgmap v312: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-07-26T08:27:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:44 smithi133 ceph-mon[37053]: pgmap v312: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-07-26T08:27:44.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:44 smithi063 ceph-mon[36747]: pgmap v312: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-07-26T08:27:46.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.015+0000 7fb4df200640 1 -- 172.21.15.43:0/3485941446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0075800 msgr2=0x7fb4e0075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.015+0000 7fb4df200640 1 --2- 172.21.15.43:0/3485941446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0075800 0x7fb4e0075c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc009900 tx=0x7fb4cc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 -- 172.21.15.43:0/3485941446 shutdown_connections 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 --2- 172.21.15.43:0/3485941446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0113cc0 0x7fb4e0116190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 --2- 172.21.15.43:0/3485941446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0075800 0x7fb4e0075c10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 --2- 172.21.15.43:0/3485941446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e0076db0 0x7fb4e00751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 -- 172.21.15.43:0/3485941446 >> 172.21.15.43:0/3485941446 conn(0x7fb4e00fee60 msgr2=0x7fb4e01012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 -- 172.21.15.43:0/3485941446 shutdown_connections 2024-07-26T08:27:46.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.016+0000 7fb4df200640 1 -- 172.21.15.43:0/3485941446 wait complete. 2024-07-26T08:27:46.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.017+0000 7fb4df200640 1 Processor -- start 2024-07-26T08:27:46.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 -- start start 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 0x7fb4e01a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0076db0 0x7fb4e01a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e0113cc0 0x7fb4e01a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0119a20 con 0x7fb4e0076db0 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e01198a0 con 0x7fb4e0075800 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.018+0000 7fb4df200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0119ba0 con 0x7fb4e0113cc0 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 0x7fb4e01a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 0x7fb4e01a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:48566/0 (socket says 172.21.15.43:48566) 2024-07-26T08:27:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 -- 172.21.15.43:0/410242520 learned_addr learned my addr 172.21.15.43:0/410242520 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dd400640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0076db0 0x7fb4e01a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4de800640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e0113cc0 0x7fb4e01a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 -- 172.21.15.43:0/410242520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e0113cc0 msgr2=0x7fb4e01a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e0113cc0 0x7fb4e01a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 -- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0076db0 msgr2=0x7fb4e01a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0076db0 0x7fb4e01a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.019+0000 7fb4dde00640 1 -- 172.21.15.43:0/410242520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01a63c0 con 0x7fb4e0075800 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.020+0000 7fb4dde00640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 0x7fb4e01a0450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000d950 tx=0x7fb4d000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.020+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0017030 con 0x7fb4e0075800 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.020+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4d0004020 con 0x7fb4e0075800 2024-07-26T08:27:46.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.020+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00047a0 con 0x7fb4e0075800 2024-07-26T08:27:46.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.020+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e01a66b0 con 0x7fb4e0075800 2024-07-26T08:27:46.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.020+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01ace10 con 0x7fb4e0075800 2024-07-26T08:27:46.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.021+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e0075c10 con 0x7fb4e0075800 2024-07-26T08:27:46.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.024+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fb4d00041d0 con 0x7fb4e0075800 2024-07-26T08:27:46.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.025+0000 7fb4d6a00640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb4c40b3c10 0x7fb4c40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:46.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.025+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8492+0+0 (secure 0 0 0) 0x7fb4d00e3730 con 0x7fb4e0075800 2024-07-26T08:27:46.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.026+0000 7fb4dd400640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb4c40b3c10 0x7fb4c40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:46.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.026+0000 7fb4dd400640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb4c40b3c10 0x7fb4c40b6120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0314b0 tx=0x7fb4cc0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:46.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.029+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb4d00aac20 con 0x7fb4e0075800 2024-07-26T08:27:46.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:46.233+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb4e002e0c0 con 0x7fb4e0075800 2024-07-26T08:27:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:46 smithi043 ceph-mon[32384]: pgmap v313: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T08:27:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:46 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/410242520' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T08:27:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:46 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T08:27:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:46 smithi133 ceph-mon[37053]: pgmap v313: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T08:27:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:46 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/410242520' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T08:27:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:46 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T08:27:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:46 smithi063 ceph-mon[36747]: pgmap v313: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T08:27:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:46 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/410242520' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T08:27:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:46 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T08:27:47.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.359+0000 7fb4d6a00640 1 -- 172.21.15.43:0/410242520 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7fb4d00aa520 con 0x7fb4e0075800 2024-07-26T08:27:47.364 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' created 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb4c40b3c10 msgr2=0x7fb4c40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb4c40b3c10 0x7fb4c40b6120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0314b0 tx=0x7fb4cc0058d0 comp rx=0 tx=0).stop 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 msgr2=0x7fb4e01a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 0x7fb4e01a0450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000d950 tx=0x7fb4d000de10 comp rx=0 tx=0).stop 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 shutdown_connections 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb4c40b3c10 0x7fb4c40b6120 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:47.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4e0113cc0 0x7fb4e01a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:47.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4e0076db0 0x7fb4e01a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:47.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 --2- 172.21.15.43:0/410242520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4e0075800 0x7fb4e01a0450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:47.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.368+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 >> 172.21.15.43:0/410242520 conn(0x7fb4e00fee60 msgr2=0x7fb4e010fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:47.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.370+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 shutdown_connections 2024-07-26T08:27:47.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:47.370+0000 7fb4df200640 1 -- 172.21.15.43:0/410242520 wait complete. 2024-07-26T08:27:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:47 smithi043 ceph-mon[32384]: osdmap e81: 12 total, 12 up, 12 in 2024-07-26T08:27:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:47 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-26T08:27:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:47 smithi043 ceph-mon[32384]: osdmap e82: 12 total, 12 up, 12 in 2024-07-26T08:27:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:47 smithi133 ceph-mon[37053]: osdmap e81: 12 total, 12 up, 12 in 2024-07-26T08:27:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:47 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-26T08:27:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:47 smithi133 ceph-mon[37053]: osdmap e82: 12 total, 12 up, 12 in 2024-07-26T08:27:47.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:47 smithi063 ceph-mon[36747]: osdmap e81: 12 total, 12 up, 12 in 2024-07-26T08:27:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:47 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-26T08:27:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:47 smithi063 ceph-mon[36747]: osdmap e82: 12 total, 12 up, 12 in 2024-07-26T08:27:48.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-07-26T08:27:48.394 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:48 smithi043 ceph-mon[32384]: pgmap v315: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T08:27:48.395 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:48 smithi043 ceph-mon[32384]: osdmap e83: 12 total, 12 up, 12 in 2024-07-26T08:27:48.706 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:48 smithi133 ceph-mon[37053]: pgmap v315: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T08:27:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:48 smithi133 ceph-mon[37053]: osdmap e83: 12 total, 12 up, 12 in 2024-07-26T08:27:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:48 smithi063 ceph-mon[36747]: pgmap v315: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T08:27:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:48 smithi063 ceph-mon[36747]: osdmap e83: 12 total, 12 up, 12 in 2024-07-26T08:27:50.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:50 smithi043 ceph-mon[32384]: pgmap v318: 129 pgs: 9 creating+peering, 23 unknown, 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-07-26T08:27:50.479 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:50 smithi043 ceph-mon[32384]: osdmap e84: 12 total, 12 up, 12 in 2024-07-26T08:27:50.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:50 smithi043 ceph-mon[32384]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:50 smithi133 ceph-mon[37053]: pgmap v318: 129 pgs: 9 creating+peering, 23 unknown, 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-07-26T08:27:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:50 smithi133 ceph-mon[37053]: osdmap e84: 12 total, 12 up, 12 in 2024-07-26T08:27:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:50 smithi133 ceph-mon[37053]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:50 smithi063 ceph-mon[36747]: pgmap v318: 129 pgs: 9 creating+peering, 23 unknown, 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-07-26T08:27:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:50 smithi063 ceph-mon[36747]: osdmap e84: 12 total, 12 up, 12 in 2024-07-26T08:27:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:50 smithi063 ceph-mon[36747]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T08:27:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 -- 172.21.15.43:0/2397868310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c075800 msgr2=0x7f445c075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 --2- 172.21.15.43:0/2397868310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c075800 0x7f445c075c10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4448009900 tx=0x7f444802a410 comp rx=0 tx=0).stop 2024-07-26T08:27:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 -- 172.21.15.43:0/2397868310 shutdown_connections 2024-07-26T08:27:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 --2- 172.21.15.43:0/2397868310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c113c90 0x7f445c116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 --2- 172.21.15.43:0/2397868310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c075800 0x7f445c075c10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 --2- 172.21.15.43:0/2397868310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c076db0 0x7f445c0751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 -- 172.21.15.43:0/2397868310 >> 172.21.15.43:0/2397868310 conn(0x7f445c0fee10 msgr2=0x7f445c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 -- 172.21.15.43:0/2397868310 shutdown_connections 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.068+0000 7f4462c00640 1 -- 172.21.15.43:0/2397868310 wait complete. 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 Processor -- start 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 -- start start 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c075800 0x7f445c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 0x7f445c1a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c113c90 0x7f445c1a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1199f0 con 0x7f445c076db0 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f445c119870 con 0x7f445c075800 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4462c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f445c119b70 con 0x7f445c113c90 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.070+0000 7f4460e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 0x7f445c1a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 0x7f445c1a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39176/0 (socket says 172.21.15.43:39176) 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 -- 172.21.15.43:0/1437896128 learned_addr learned my addr 172.21.15.43:0/1437896128 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4461800640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c075800 0x7f445c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4462200640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c113c90 0x7f445c1a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 -- 172.21.15.43:0/1437896128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c113c90 msgr2=0x7f445c1a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c113c90 0x7f445c1a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 -- 172.21.15.43:0/1437896128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c075800 msgr2=0x7f445c1a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c075800 0x7f445c1a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4460e00640 1 -- 172.21.15.43:0/1437896128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c1a63b0 con 0x7f445c076db0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4461800640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c075800 0x7f445c1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.071+0000 7f4462200640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c113c90 0x7f445c1a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.072+0000 7f4460e00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 0x7f445c1a09e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4448005940 tx=0x7f4448004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.072+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444803f030 con 0x7f445c076db0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.072+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4448004440 con 0x7f445c076db0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.072+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c1a6640 con 0x7f445c076db0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.072+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448035070 con 0x7f445c076db0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.072+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c1ace00 con 0x7f445c076db0 2024-07-26T08:27:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.073+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c0766f0 con 0x7f445c076db0 2024-07-26T08:27:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.076+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f4448042030 con 0x7f445c076db0 2024-07-26T08:27:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.078+0000 7f445a000640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44440b3c20 0x7f44440b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.078+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8985+0+0 (secure 0 0 0) 0x7f44481046b0 con 0x7f445c076db0 2024-07-26T08:27:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.078+0000 7f4461800640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44440b3c20 0x7f44440b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:51.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.079+0000 7f4461800640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44440b3c20 0x7f44440b6130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4450009fc0 tx=0x7f4450005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:51.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.081+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f44480cb360 con 0x7f445c076db0 2024-07-26T08:27:51.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.286+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f445c1129c0 con 0x7f445c076db0 2024-07-26T08:27:51.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.374+0000 7f445a000640 1 -- 172.21.15.43:0/1437896128 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7f44480cf8b0 con 0x7f445c076db0 2024-07-26T08:27:51.376 INFO:teuthology.orchestra.run.smithi043.stderr:set pool 4 allow_ec_overwrites to true 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.379+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44440b3c20 msgr2=0x7f44440b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.379+0000 7f4462c00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44440b3c20 0x7f44440b6130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4450009fc0 tx=0x7f4450005f90 comp rx=0 tx=0).stop 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.379+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 msgr2=0x7f445c1a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.379+0000 7f4462c00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 0x7f445c1a09e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4448005940 tx=0x7f4448004040 comp rx=0 tx=0).stop 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 shutdown_connections 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44440b3c20 0x7f44440b6130 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f445c113c90 0x7f445c1a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f445c076db0 0x7f445c1a09e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 --2- 172.21.15.43:0/1437896128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f445c075800 0x7f445c1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 >> 172.21.15.43:0/1437896128 conn(0x7f445c0fee10 msgr2=0x7f445c10fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:51.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 shutdown_connections 2024-07-26T08:27:51.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:51.380+0000 7f4462c00640 1 -- 172.21.15.43:0/1437896128 wait complete. 2024-07-26T08:27:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:51 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1437896128' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-07-26T08:27:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:51 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1437896128' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-07-26T08:27:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:51 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1437896128' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-07-26T08:27:52.253 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-07-26T08:27:52.710 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:52 smithi043 ceph-mon[32384]: pgmap v320: 129 pgs: 9 creating+peering, 9 unknown, 111 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:52 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1437896128' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-07-26T08:27:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:52 smithi043 ceph-mon[32384]: osdmap e85: 12 total, 12 up, 12 in 2024-07-26T08:27:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:52 smithi133 ceph-mon[37053]: pgmap v320: 129 pgs: 9 creating+peering, 9 unknown, 111 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:52 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1437896128' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-07-26T08:27:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:52 smithi133 ceph-mon[37053]: osdmap e85: 12 total, 12 up, 12 in 2024-07-26T08:27:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:52 smithi063 ceph-mon[36747]: pgmap v320: 129 pgs: 9 creating+peering, 9 unknown, 111 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:52 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1437896128' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-07-26T08:27:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:52 smithi063 ceph-mon[36747]: osdmap e85: 12 total, 12 up, 12 in 2024-07-26T08:27:54.666 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:54 smithi043 ceph-mon[32384]: pgmap v322: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:54 smithi133 ceph-mon[37053]: pgmap v322: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:54 smithi063 ceph-mon[36747]: pgmap v322: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 -- 172.21.15.43:0/659691672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34406b930 msgr2=0x7fd34406bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 --2- 172.21.15.43:0/659691672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34406b930 0x7fd34406bd40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd334009900 tx=0x7fd33402a410 comp rx=0 tx=0).stop 2024-07-26T08:27:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 -- 172.21.15.43:0/659691672 shutdown_connections 2024-07-26T08:27:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 --2- 172.21.15.43:0/659691672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34410ee00 0x7fd344118870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 --2- 172.21.15.43:0/659691672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 0x7fd34410e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 --2- 172.21.15.43:0/659691672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34406b930 0x7fd34406bd40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 -- 172.21.15.43:0/659691672 >> 172.21.15.43:0/659691672 conn(0x7fd34406e360 msgr2=0x7fd344070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 -- 172.21.15.43:0/659691672 shutdown_connections 2024-07-26T08:27:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.041+0000 7fd34b200640 1 -- 172.21.15.43:0/659691672 wait complete. 2024-07-26T08:27:55.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 Processor -- start 2024-07-26T08:27:55.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 -- start start 2024-07-26T08:27:55.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34406b930 0x7fd3441a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 0x7fd3441a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34410ee00 0x7fd3441aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd34411bdd0 con 0x7fd34406b930 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd34411bc50 con 0x7fd34410e4b0 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.043+0000 7fd34b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd34411bf50 con 0x7fd34410ee00 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34406b930 0x7fd3441a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 0x7fd3441a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34406b930 0x7fd3441a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39800/0 (socket says 172.21.15.43:39800) 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343e00640 1 -- 172.21.15.43:0/3897440071 learned_addr learned my addr 172.21.15.43:0/3897440071 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd349200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34410ee00 0x7fd3441aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 -- 172.21.15.43:0/3897440071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34410ee00 msgr2=0x7fd3441aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:55.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34410ee00 0x7fd3441aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 -- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34406b930 msgr2=0x7fd3441a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:55.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34406b930 0x7fd3441a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 -- 172.21.15.43:0/3897440071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3441aa910 con 0x7fd34410e4b0 2024-07-26T08:27:55.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.044+0000 7fd343400640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 0x7fd3441a4f40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd34406b100 tx=0x7fd33000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:55.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.045+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33000cc40 con 0x7fd34410e4b0 2024-07-26T08:27:55.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.045+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3441aac00 con 0x7fd34410e4b0 2024-07-26T08:27:55.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.045+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd33000cde0 con 0x7fd34410e4b0 2024-07-26T08:27:55.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.045+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3441b1360 con 0x7fd34410e4b0 2024-07-26T08:27:55.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.045+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330010430 con 0x7fd34410e4b0 2024-07-26T08:27:55.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.046+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34406bd40 con 0x7fd34410e4b0 2024-07-26T08:27:55.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.049+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fd330003f60 con 0x7fd34410e4b0 2024-07-26T08:27:55.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.050+0000 7fd340c00640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3280b3ca0 0x7fd3280b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.050+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8985+0+0 (secure 0 0 0) 0x7fd3300e44b0 con 0x7fd34410e4b0 2024-07-26T08:27:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.050+0000 7fd343e00640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3280b3ca0 0x7fd3280b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.051+0000 7fd343e00640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3280b3ca0 0x7fd3280b61b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd334005f70 tx=0x7fd334005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:55.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.051+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd3300ab840 con 0x7fd34410e4b0 2024-07-26T08:27:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.295+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd3441b15f0 con 0x7fd34410e4b0 2024-07-26T08:27:55.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.402+0000 7fd340c00640 1 -- 172.21.15.43:0/3897440071 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fd3300ab140 con 0x7fd34410e4b0 2024-07-26T08:27:55.404 INFO:teuthology.orchestra.run.smithi043.stderr:added data pool 4 to fsmap 2024-07-26T08:27:55.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.406+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3280b3ca0 msgr2=0x7fd3280b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:55.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.406+0000 7fd34b200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3280b3ca0 0x7fd3280b61b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd334005f70 tx=0x7fd334005a20 comp rx=0 tx=0).stop 2024-07-26T08:27:55.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.406+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 msgr2=0x7fd3441a4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:55.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.406+0000 7fd34b200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 0x7fd3441a4f40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd34406b100 tx=0x7fd33000ee50 comp rx=0 tx=0).stop 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 shutdown_connections 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3280b3ca0 0x7fd3280b61b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34410ee00 0x7fd3441aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd34410e4b0 0x7fd3441a4f40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 --2- 172.21.15.43:0/3897440071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd34406b930 0x7fd3441a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 >> 172.21.15.43:0/3897440071 conn(0x7fd34406e360 msgr2=0x7fd34410fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 shutdown_connections 2024-07-26T08:27:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:55.407+0000 7fd34b200640 1 -- 172.21.15.43:0/3897440071 wait complete. 2024-07-26T08:27:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:55 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3897440071' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-07-26T08:27:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:55 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-07-26T08:27:55.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:55 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3897440071' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-07-26T08:27:55.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:55 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-07-26T08:27:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:55 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3897440071' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-07-26T08:27:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:55 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-07-26T08:27:56.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:27:56.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:56 smithi043 ceph-mon[32384]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:56 smithi043 ceph-mon[32384]: osdmap e86: 12 total, 12 up, 12 in 2024-07-26T08:27:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:56 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-07-26T08:27:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:56 smithi043 ceph-mon[32384]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:56.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:56 smithi133 ceph-mon[37053]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:56.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:56 smithi133 ceph-mon[37053]: osdmap e86: 12 total, 12 up, 12 in 2024-07-26T08:27:56.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:56 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-07-26T08:27:56.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:56 smithi133 ceph-mon[37053]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:56.755 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:27:56.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:56 smithi063 ceph-mon[36747]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:56.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:56 smithi063 ceph-mon[36747]: osdmap e86: 12 total, 12 up, 12 in 2024-07-26T08:27:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:56 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-07-26T08:27:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:56 smithi063 ceph-mon[36747]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:27:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:57 smithi043 ceph-mon[32384]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:57 smithi043 ceph-mon[32384]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-07-26T08:27:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:57 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:27:57.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:57 smithi133 ceph-mon[37053]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:57.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:57 smithi133 ceph-mon[37053]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-07-26T08:27:57.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:57 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:27:57.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:57 smithi063 ceph-mon[36747]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:27:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:57 smithi063 ceph-mon[36747]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-07-26T08:27:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:57 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 -- 172.21.15.43:0/435205676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 msgr2=0x7fb9e8109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 --2- 172.21.15.43:0/435205676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8109110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009ca0 tx=0x7fb9d002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 -- 172.21.15.43:0/435205676 shutdown_connections 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 --2- 172.21.15.43:0/435205676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e8109650 0x7fb9e810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 --2- 172.21.15.43:0/435205676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8109110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 --2- 172.21.15.43:0/435205676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 0x7fb9e81037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 -- 172.21.15.43:0/435205676 >> 172.21.15.43:0/435205676 conn(0x7fb9e80fee10 msgr2=0x7fb9e8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 -- 172.21.15.43:0/435205676 shutdown_connections 2024-07-26T08:27:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.117+0000 7fb9eca00640 1 -- 172.21.15.43:0/435205676 wait complete. 2024-07-26T08:27:59.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.118+0000 7fb9eca00640 1 Processor -- start 2024-07-26T08:27:59.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.118+0000 7fb9eca00640 1 -- start start 2024-07-26T08:27:59.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9eca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 0x7fb9e8075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9eca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9eca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e8109650 0x7fb9e8075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9eca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8113480 con 0x7fb9e8108d00 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9eca00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8113300 con 0x7fb9e8109650 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9eca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8113600 con 0x7fb9e81033c0 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39818/0 (socket says 172.21.15.43:39818) 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9dea00640 1 -- 172.21.15.43:0/3128052023 learned_addr learned my addr 172.21.15.43:0/3128052023 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9e7400640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 0x7fb9e8075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:59.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.119+0000 7fb9e7e00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e8109650 0x7fb9e8075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:59.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e7400640 1 -- 172.21.15.43:0/3128052023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e8109650 msgr2=0x7fb9e8075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:59.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e7400640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e8109650 0x7fb9e8075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e7400640 1 -- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 msgr2=0x7fb9e8075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:59.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e7400640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e7400640 1 -- 172.21.15.43:0/3128052023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e81a80d0 con 0x7fb9e81033c0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9dea00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e7400640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 0x7fb9e8075140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9f0 tx=0x7fb9d800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800ccc0 con 0x7fb9e81033c0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9d80035f0 con 0x7fb9e81033c0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e81a83c0 con 0x7fb9e81033c0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.120+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800ce60 con 0x7fb9e81033c0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.121+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81a8950 con 0x7fb9e81033c0 2024-07-26T08:27:59.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.122+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e81037d0 con 0x7fb9e81033c0 2024-07-26T08:27:59.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.124+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fb9d8003b50 con 0x7fb9e81033c0 2024-07-26T08:27:59.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.126+0000 7fb9e4c00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9cc0b3ca0 0x7fb9cc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:27:59.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.126+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7fb9d80e4210 con 0x7fb9e81033c0 2024-07-26T08:27:59.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.126+0000 7fb9dea00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9cc0b3ca0 0x7fb9cc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:27:59.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.127+0000 7fb9dea00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9cc0b3ca0 0x7fb9cc0b61b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00098b0 tx=0x7fb9d0009800 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:27:59.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.128+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb9d80ab4f0 con 0x7fb9e81033c0 2024-07-26T08:27:59.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.368+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9e8076440 con 0x7fb9e81033c0 2024-07-26T08:27:59.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.370+0000 7fb9e4c00640 1 -- 172.21.15.43:0/3128052023 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11824 (secure 0 0 0) 0x7fb9d80aadf0 con 0x7fb9e81033c0 2024-07-26T08:27:59.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:27:59.372 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"btime":"2024-07-26T08:27:55:383801+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24686,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:27:55.298040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24733,"qdb_cluster":[24733]},"id":1}]} 2024-07-26T08:27:59.372 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9cc0b3ca0 msgr2=0x7fb9cc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9cc0b3ca0 0x7fb9cc0b61b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00098b0 tx=0x7fb9d0009800 comp rx=0 tx=0).stop 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 msgr2=0x7fb9e8075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 0x7fb9e8075140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9f0 tx=0x7fb9d800edf0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 shutdown_connections 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9cc0b3ca0 0x7fb9cc0b61b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9e8109650 0x7fb9e8075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e8108d00 0x7fb9e8075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 --2- 172.21.15.43:0/3128052023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e81033c0 0x7fb9e8075140 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 >> 172.21.15.43:0/3128052023 conn(0x7fb9e80fee10 msgr2=0x7fb9e8101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.373+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 shutdown_connections 2024-07-26T08:27:59.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:27:59.374+0000 7fb9eca00640 1 -- 172.21.15.43:0/3128052023 wait complete. 2024-07-26T08:28:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:59 smithi133 ceph-mon[37053]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:27:59 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3128052023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:28:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:59 smithi063 ceph-mon[36747]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:27:59 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3128052023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:28:00.102 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:59 smithi043 ceph-mon[32384]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:00.102 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:27:59 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3128052023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:28:00.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:28:00.664 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:01 smithi133 ceph-mon[37053]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:02.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:01 smithi063 ceph-mon[36747]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:02.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:01 smithi043 ceph-mon[32384]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:03.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 -- 172.21.15.43:0/467877772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58108ed0 msgr2=0x7ffa581092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/467877772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58108ed0 0x7ffa581092e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009900 tx=0x7ffa4002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 -- 172.21.15.43:0/467877772 shutdown_connections 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/467877772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58109820 0x7ffa58110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/467877772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58108ed0 0x7ffa581092e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/467877772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 0x7ffa581039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 -- 172.21.15.43:0/467877772 >> 172.21.15.43:0/467877772 conn(0x7ffa5807b280 msgr2=0x7ffa5807b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 -- 172.21.15.43:0/467877772 shutdown_connections 2024-07-26T08:28:03.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.078+0000 7ffa5fa00640 1 -- 172.21.15.43:0/467877772 wait complete. 2024-07-26T08:28:03.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.079+0000 7ffa5fa00640 1 Processor -- start 2024-07-26T08:28:03.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 -- start start 2024-07-26T08:28:03.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 0x7ffa5819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:03.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 0x7ffa5819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:03.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58109820 0x7ffa581a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:03.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113600 con 0x7ffa58108ed0 2024-07-26T08:28:03.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113480 con 0x7ffa58109820 2024-07-26T08:28:03.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5fa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113780 con 0x7ffa58103590 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa4fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 0x7ffa5819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa4fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 0x7ffa5819c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39838/0 (socket says 172.21.15.43:39838) 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa4fe00640 1 -- 172.21.15.43:0/4041408943 learned_addr learned my addr 172.21.15.43:0/4041408943 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.080+0000 7ffa5d000640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 0x7ffa5819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa5da00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58109820 0x7ffa581a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa4fe00640 1 -- 172.21.15.43:0/4041408943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 msgr2=0x7ffa5819c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa4fe00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 0x7ffa5819c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa4fe00640 1 -- 172.21.15.43:0/4041408943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58109820 msgr2=0x7ffa581a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa4fe00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58109820 0x7ffa581a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa4fe00640 1 -- 172.21.15.43:0/4041408943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581a2120 con 0x7ffa58108ed0 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa5d000640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 0x7ffa5819c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa5da00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58109820 0x7ffa581a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.081+0000 7ffa4fe00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 0x7ffa5819c750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa40005940 tx=0x7ffa40004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.082+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4003f030 con 0x7ffa58108ed0 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.082+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa40004440 con 0x7ffa58108ed0 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.082+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa581a23b0 con 0x7ffa58108ed0 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.082+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40035070 con 0x7ffa58108ed0 2024-07-26T08:28:03.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.082+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa581a8b70 con 0x7ffa58108ed0 2024-07-26T08:28:03.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.083+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa58104810 con 0x7ffa58108ed0 2024-07-26T08:28:03.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.086+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7ffa40042030 con 0x7ffa58108ed0 2024-07-26T08:28:03.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.087+0000 7ffa56000640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffa380b3c20 0x7ffa380b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:03.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.087+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7ffa401042a0 con 0x7ffa58108ed0 2024-07-26T08:28:03.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.088+0000 7ffa5d000640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffa380b3c20 0x7ffa380b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:03.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.089+0000 7ffa5d000640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffa380b3c20 0x7ffa380b6130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009fc0 tx=0x7ffa48005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:03.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.092+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffa400caf30 con 0x7ffa58108ed0 2024-07-26T08:28:03.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.299+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa581a8d40 con 0x7ffa58108ed0 2024-07-26T08:28:03.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.303+0000 7ffa56000640 1 -- 172.21.15.43:0/4041408943 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24385 (secure 0 0 0) 0x7ffa400cf480 con 0x7ffa58108ed0 2024-07-26T08:28:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:03.307 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":86,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:27:55.297726+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffa380b3c20 msgr2=0x7ffa380b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffa380b3c20 0x7ffa380b6130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009fc0 tx=0x7ffa48005f90 comp rx=0 tx=0).stop 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 msgr2=0x7ffa5819c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 0x7ffa5819c750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa40005940 tx=0x7ffa40004040 comp rx=0 tx=0).stop 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 shutdown_connections 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ffa380b3c20 0x7ffa380b6130 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa58109820 0x7ffa581a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa58108ed0 0x7ffa5819c750 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 --2- 172.21.15.43:0/4041408943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa58103590 0x7ffa5819c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:03.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 >> 172.21.15.43:0/4041408943 conn(0x7ffa5807b280 msgr2=0x7ffa58106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:03.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.306+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 shutdown_connections 2024-07-26T08:28:03.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:03.307+0000 7ffa5fa00640 1 -- 172.21.15.43:0/4041408943 wait complete. 2024-07-26T08:28:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:03 smithi133 ceph-mon[37053]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:03 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/4041408943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:03 smithi063 ceph-mon[36747]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:03 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/4041408943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:04.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:03 smithi043 ceph-mon[32384]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:04.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/4041408943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:04.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:28:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:05 smithi133 ceph-mon[37053]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:06.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:05 smithi063 ceph-mon[36747]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:06.115 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:05 smithi043 ceph-mon[32384]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 -- 172.21.15.43:0/105969763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 msgr2=0x7fa048077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 --2- 172.21.15.43:0/105969763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa048077780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa038009900 tx=0x7fa03802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 -- 172.21.15.43:0/105969763 shutdown_connections 2024-07-26T08:28:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 --2- 172.21.15.43:0/105969763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa048077cc0 0x7fa048113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 --2- 172.21.15.43:0/105969763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048114170 0x7fa048116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 --2- 172.21.15.43:0/105969763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa048077780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 -- 172.21.15.43:0/105969763 >> 172.21.15.43:0/105969763 conn(0x7fa048101200 msgr2=0x7fa048103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 -- 172.21.15.43:0/105969763 shutdown_connections 2024-07-26T08:28:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.130+0000 7fa04de00640 1 -- 172.21.15.43:0/105969763 wait complete. 2024-07-26T08:28:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.131+0000 7fa04de00640 1 Processor -- start 2024-07-26T08:28:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.131+0000 7fa04de00640 1 -- start start 2024-07-26T08:28:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa04de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa0481a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa04de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048077cc0 0x7fa0481a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa04de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa048114170 0x7fa0481a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa04de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa048119c80 con 0x7fa048077370 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa04de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa048119b00 con 0x7fa048077cc0 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa04de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa048119e00 con 0x7fa048114170 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa046a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa0481a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa046a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa0481a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56060/0 (socket says 172.21.15.43:56060) 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa046a00640 1 -- 172.21.15.43:0/818007399 learned_addr learned my addr 172.21.15.43:0/818007399 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa046000640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048077cc0 0x7fa0481a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.132+0000 7fa047400640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa048114170 0x7fa0481a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046a00640 1 -- 172.21.15.43:0/818007399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa048114170 msgr2=0x7fa0481a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046a00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa048114170 0x7fa0481a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046a00640 1 -- 172.21.15.43:0/818007399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048077cc0 msgr2=0x7fa0481a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046a00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048077cc0 0x7fa0481a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046a00640 1 -- 172.21.15.43:0/818007399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0481a6560 con 0x7fa048077370 2024-07-26T08:28:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046000640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048077cc0 0x7fa0481a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.133+0000 7fa046a00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa0481a05f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0380314b0 tx=0x7fa038003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.134+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03803f070 con 0x7fa048077370 2024-07-26T08:28:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.134+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa038031bf0 con 0x7fa048077370 2024-07-26T08:28:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.134+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0481a67f0 con 0x7fa048077370 2024-07-26T08:28:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.134+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038035030 con 0x7fa048077370 2024-07-26T08:28:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.134+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0481acfb0 con 0x7fa048077370 2024-07-26T08:28:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.135+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa048078880 con 0x7fa048077370 2024-07-26T08:28:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.137+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fa038042070 con 0x7fa048077370 2024-07-26T08:28:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.139+0000 7fa04ca00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa02c0b3c20 0x7fa02c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.139+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7fa0381049a0 con 0x7fa048077370 2024-07-26T08:28:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.139+0000 7fa046000640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa02c0b3c20 0x7fa02c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.140+0000 7fa046000640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa02c0b3c20 0x7fa02c0b6130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa0480794c0 tx=0x7fa030005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.141+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa0380cbc80 con 0x7fa048077370 2024-07-26T08:28:07.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.345+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa04810f330 con 0x7fa048077370 2024-07-26T08:28:07.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.349+0000 7fa04ca00640 1 -- 172.21.15.43:0/818007399 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24385 (secure 0 0 0) 0x7fa038031da0 con 0x7fa048077370 2024-07-26T08:28:07.353 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:07.353 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":86,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:27:55.297726+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:28:07.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa02c0b3c20 msgr2=0x7fa02c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:07.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa02c0b3c20 0x7fa02c0b6130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa0480794c0 tx=0x7fa030005f90 comp rx=0 tx=0).stop 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 msgr2=0x7fa0481a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa0481a05f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0380314b0 tx=0x7fa038003c10 comp rx=0 tx=0).stop 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 shutdown_connections 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa02c0b3c20 0x7fa02c0b6130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa048114170 0x7fa0481a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa048077cc0 0x7fa0481a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 --2- 172.21.15.43:0/818007399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa048077370 0x7fa0481a05f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 >> 172.21.15.43:0/818007399 conn(0x7fa048101200 msgr2=0x7fa048116210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 shutdown_connections 2024-07-26T08:28:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:07.353+0000 7fa04de00640 1 -- 172.21.15.43:0/818007399 wait complete. 2024-07-26T08:28:08.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:07 smithi133 ceph-mon[37053]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:07 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/818007399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:07 smithi063 ceph-mon[36747]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:07 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/818007399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:08.149 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:07 smithi043 ceph-mon[32384]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:08.149 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:07 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/818007399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:08.235 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:28:08.720 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:09 smithi133 ceph-mon[37053]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:10.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:09 smithi063 ceph-mon[36747]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:10.075 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:09 smithi043 ceph-mon[32384]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:10.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 -- 172.21.15.43:0/1665254808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04181141a0 msgr2=0x7f04181165c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:10.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 --2- 172.21.15.43:0/1665254808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04181141a0 0x7f04181165c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0410009ca0 tx=0x7f041002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:28:10.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 -- 172.21.15.43:0/1665254808 shutdown_connections 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 --2- 172.21.15.43:0/1665254808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04181141a0 0x7f04181165c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 --2- 172.21.15.43:0/1665254808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0418077cc0 0x7f0418113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 --2- 172.21.15.43:0/1665254808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0418077370 0x7f0418077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 -- 172.21.15.43:0/1665254808 >> 172.21.15.43:0/1665254808 conn(0x7f04181011f0 msgr2=0x7f0418103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.937+0000 7f041de00640 1 -- 172.21.15.43:0/1665254808 shutdown_connections 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.938+0000 7f041de00640 1 -- 172.21.15.43:0/1665254808 wait complete. 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.939+0000 7f041de00640 1 Processor -- start 2024-07-26T08:28:10.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.939+0000 7f041de00640 1 -- start start 2024-07-26T08:28:10.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f041de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 0x7f04181a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:10.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f041de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0418077cc0 0x7f04181a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:10.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f041de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04181141a0 0x7f04181a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f041de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0418119c60 con 0x7f0418077cc0 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f041de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0418119ae0 con 0x7f04181141a0 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f041de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0418119de0 con 0x7f0418077370 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f0416000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0418077cc0 0x7f04181a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f0416a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 0x7f04181a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f0416a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 0x7f04181a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:50926/0 (socket says 172.21.15.43:50926) 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f0416a00640 1 -- 172.21.15.43:0/385720229 learned_addr learned my addr 172.21.15.43:0/385720229 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:10.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.940+0000 7f0417400640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04181141a0 0x7f04181a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:10.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f0416a00640 1 -- 172.21.15.43:0/385720229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04181141a0 msgr2=0x7f04181a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:10.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f0416a00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04181141a0 0x7f04181a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:10.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f0416a00640 1 -- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0418077cc0 msgr2=0x7f04181a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:10.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f0416a00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0418077cc0 0x7f04181a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f0416a00640 1 -- 172.21.15.43:0/385720229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04181a6500 con 0x7f0418077370 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f0416a00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 0x7f04181a0590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f040800e9f0 tx=0x7f040800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800cd80 con 0x7f0418077370 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0408010900 con 0x7f0418077370 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.941+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408018920 con 0x7f0418077370 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.942+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04181a67f0 con 0x7f0418077370 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.942+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04181acf50 con 0x7f0418077370 2024-07-26T08:28:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.943+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0418077780 con 0x7f0418077370 2024-07-26T08:28:10.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.945+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f0408010ab0 con 0x7f0418077370 2024-07-26T08:28:10.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.947+0000 7f041ca00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03fc0b3c20 0x7f03fc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:10.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.947+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f04080e47d0 con 0x7f0418077370 2024-07-26T08:28:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.947+0000 7f0416000640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03fc0b3c20 0x7f03fc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.948+0000 7f0416000640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03fc0b3c20 0x7f03fc0b6130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04180795b0 tx=0x7f0404005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:10.948+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f04080ab460 con 0x7f0418077370 2024-07-26T08:28:11.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.194+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04181ad210 con 0x7f0418077370 2024-07-26T08:28:11.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.195+0000 7f041ca00640 1 -- 172.21.15.43:0/385720229 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11824 (secure 0 0 0) 0x7f04080af9b0 con 0x7f0418077370 2024-07-26T08:28:11.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:11.197 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"btime":"2024-07-26T08:27:55:383801+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24685,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24686,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:27:55.298040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24733,"qdb_cluster":[24733]},"id":1}]} 2024-07-26T08:28:11.198 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2024-07-26T08:28:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.198+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03fc0b3c20 msgr2=0x7f03fc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.198+0000 7f041de00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03fc0b3c20 0x7f03fc0b6130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04180795b0 tx=0x7f0404005f90 comp rx=0 tx=0).stop 2024-07-26T08:28:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.198+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 msgr2=0x7f04181a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.198+0000 7f041de00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 0x7f04181a0590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f040800e9f0 tx=0x7f040800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:28:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.198+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 shutdown_connections 2024-07-26T08:28:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f03fc0b3c20 0x7f03fc0b6130 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04181141a0 0x7f04181a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0418077cc0 0x7f04181a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 --2- 172.21.15.43:0/385720229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0418077370 0x7f04181a0590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 >> 172.21.15.43:0/385720229 conn(0x7f04181011f0 msgr2=0x7f0418103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 shutdown_connections 2024-07-26T08:28:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:11.199+0000 7f041de00640 1 -- 172.21.15.43:0/385720229 wait complete. 2024-07-26T08:28:11.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:11 smithi043 ceph-mon[32384]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:11 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/385720229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:28:12.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:28:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:11 smithi063 ceph-mon[36747]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:11 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/385720229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:28:12.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:11 smithi133 ceph-mon[37053]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:11 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/385720229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:28:12.521 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:13.911 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:13 smithi043 ceph-mon[32384]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:14.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:13 smithi063 ceph-mon[36747]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:14.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:13 smithi133 ceph-mon[37053]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 -- 172.21.15.43:0/3226036799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 msgr2=0x7f09b8109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 --2- 172.21.15.43:0/3226036799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 0x7f09b8109e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009900 tx=0x7f09a802a410 comp rx=0 tx=0).stop 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 -- 172.21.15.43:0/3226036799 shutdown_connections 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 --2- 172.21.15.43:0/3226036799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b810fc80 0x7f09b81164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 --2- 172.21.15.43:0/3226036799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 --2- 172.21.15.43:0/3226036799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 0x7f09b8109e00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 -- 172.21.15.43:0/3226036799 >> 172.21.15.43:0/3226036799 conn(0x7f09b8078ff0 msgr2=0x7f09b8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 -- 172.21.15.43:0/3226036799 shutdown_connections 2024-07-26T08:28:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.807+0000 7f09bda00640 1 -- 172.21.15.43:0/3226036799 wait complete. 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.808+0000 7f09bda00640 1 Processor -- start 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.808+0000 7f09bda00640 1 -- start start 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 0x7f09b81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bda00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b81a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bda00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b810fc80 0x7f09b81a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8119a80 con 0x7f09b81099f0 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bda00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8119900 con 0x7f09b810f330 2024-07-26T08:28:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bda00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8119c00 con 0x7f09b810fc80 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09afe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b81a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 0x7f09b81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09afe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b81a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:58074/0 (socket says 172.21.15.43:58074) 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09afe00640 1 -- 172.21.15.43:0/3553253685 learned_addr learned my addr 172.21.15.43:0/3553253685 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.809+0000 7f09bd000640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b810fc80 0x7f09b81a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09afe00640 1 -- 172.21.15.43:0/3553253685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b810fc80 msgr2=0x7f09b81a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09afe00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b810fc80 0x7f09b81a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09afe00640 1 -- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 msgr2=0x7f09b81a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09afe00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 0x7f09b81a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09afe00640 1 -- 172.21.15.43:0/3553253685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b81a6360 con 0x7f09b810f330 2024-07-26T08:28:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09afe00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b81a0990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09a000e9f0 tx=0x7f09a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a000ccc0 con 0x7f09b810f330 2024-07-26T08:28:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.810+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b81a6650 con 0x7f09b810f330 2024-07-26T08:28:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.811+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b81acdb0 con 0x7f09b810f330 2024-07-26T08:28:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.811+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f09a0010900 con 0x7f09b810f330 2024-07-26T08:28:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.811+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0018840 con 0x7f09b810f330 2024-07-26T08:28:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.812+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09940052c0 con 0x7f09b810f330 2024-07-26T08:28:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.814+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f09a0010430 con 0x7f09b810f330 2024-07-26T08:28:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.816+0000 7f09b5600640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f099c0b3ca0 0x7f099c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.816+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f09a00e40a0 con 0x7f09b810f330 2024-07-26T08:28:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.816+0000 7f09b7e00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f099c0b3ca0 0x7f099c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.817+0000 7f09b7e00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f099c0b3ca0 0x7f099c0b61b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009230 tx=0x7f09a80058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:14.820+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f09a0010720 con 0x7f09b810f330 2024-07-26T08:28:15.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.027+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09940055b0 con 0x7f09b810f330 2024-07-26T08:28:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.030+0000 7f09b5600640 1 -- 172.21.15.43:0/3553253685 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24385 (secure 0 0 0) 0x7f09a00aad30 con 0x7f09b810f330 2024-07-26T08:28:15.032 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:15.032 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":86,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:27:55.297726+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:28:15.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f099c0b3ca0 msgr2=0x7f099c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:15.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f099c0b3ca0 0x7f099c0b61b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009230 tx=0x7f09a80058d0 comp rx=0 tx=0).stop 2024-07-26T08:28:15.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 msgr2=0x7f09b81a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:15.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b81a0990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09a000e9f0 tx=0x7f09a000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:28:15.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 shutdown_connections 2024-07-26T08:28:15.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f099c0b3ca0 0x7f099c0b61b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:15.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b810fc80 0x7f09b81a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09b810f330 0x7f09b81a0990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 --2- 172.21.15.43:0/3553253685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09b81099f0 0x7f09b81a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 >> 172.21.15.43:0/3553253685 conn(0x7f09b8078ff0 msgr2=0x7f09b80796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 shutdown_connections 2024-07-26T08:28:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:15.033+0000 7f09bda00640 1 -- 172.21.15.43:0/3553253685 wait complete. 2024-07-26T08:28:15.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-26T08:27:37.509952+0000', 'modified': '2024-07-26T08:27:55.298040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24733}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24733': {'gid': 24733, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6841/445875183', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6840', 'nonce': 445875183}, {'type': 'v1', 'addr': '172.21.15.43:6841', 'nonce': 445875183}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24733, 'qdb_cluster': [24733]} 2024-07-26T08:28:15.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-26T08:28:15.902 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.a status 2024-07-26T08:28:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:15 smithi063 ceph-mon[36747]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:15 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3553253685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:16.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:15 smithi043 ceph-mon[32384]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:16.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:15 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3553253685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:15 smithi133 ceph-mon[37053]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:15 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3553253685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:16.403 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:18.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:17 smithi063 ceph-mon[36747]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:18.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:17 smithi043 ceph-mon[32384]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:17 smithi133 ceph-mon[37053]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:18.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.803+0000 7f955f000640 1 -- 172.21.15.43:0/618202653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077cc0 msgr2=0x7f9558113c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.803+0000 7f955f000640 1 --2- 172.21.15.43:0/618202653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077cc0 0x7f9558113c60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9544009900 tx=0x7f954402a410 comp rx=0 tx=0).stop 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 -- 172.21.15.43:0/618202653 shutdown_connections 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 --2- 172.21.15.43:0/618202653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95581141a0 0x7f95581165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 --2- 172.21.15.43:0/618202653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077cc0 0x7f9558113c60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 --2- 172.21.15.43:0/618202653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9558077370 0x7f9558077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 -- 172.21.15.43:0/618202653 >> 172.21.15.43:0/618202653 conn(0x7f95581011f0 msgr2=0x7f9558103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 -- 172.21.15.43:0/618202653 shutdown_connections 2024-07-26T08:28:18.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.804+0000 7f955f000640 1 -- 172.21.15.43:0/618202653 wait complete. 2024-07-26T08:28:18.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.805+0000 7f955f000640 1 Processor -- start 2024-07-26T08:28:18.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.805+0000 7f955f000640 1 -- start start 2024-07-26T08:28:18.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077370 0x7f95581a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 0x7f95581a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95581141a0 0x7f95581a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9558119c20 con 0x7f9558077370 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9558119aa0 con 0x7f9558077cc0 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9558119da0 con 0x7f95581141a0 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f9557400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 0x7f95581a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f9557e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077370 0x7f95581a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f9557400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 0x7f95581a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36396/0 (socket says 172.21.15.43:36396) 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f9557400640 1 -- 172.21.15.43:0/3875732817 learned_addr learned my addr 172.21.15.43:0/3875732817 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.806+0000 7f955d000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95581141a0 0x7f95581a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9557400640 1 -- 172.21.15.43:0/3875732817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95581141a0 msgr2=0x7f95581a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9557400640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95581141a0 0x7f95581a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9557400640 1 -- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077370 msgr2=0x7f95581a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9557400640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077370 0x7f95581a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9557400640 1 -- 172.21.15.43:0/3875732817 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95581a6520 con 0x7f9558077cc0 2024-07-26T08:28:18.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9557400640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 0x7f95581a0b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9544005940 tx=0x7f9544004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:18.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9554c00640 1 -- 172.21.15.43:0/3875732817 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954403f030 con 0x7f9558077cc0 2024-07-26T08:28:18.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9554c00640 1 -- 172.21.15.43:0/3875732817 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9544004440 con 0x7f9558077cc0 2024-07-26T08:28:18.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95581a67b0 con 0x7f9558077cc0 2024-07-26T08:28:18.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f9554c00640 1 -- 172.21.15.43:0/3875732817 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544035070 con 0x7f9558077cc0 2024-07-26T08:28:18.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.807+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95581acf70 con 0x7f9558077cc0 2024-07-26T08:28:18.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.811+0000 7f9565c31740 1 Processor -- start 2024-07-26T08:28:18.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.811+0000 7f9554c00640 1 -- 172.21.15.43:0/3875732817 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f9544042030 con 0x7f9558077cc0 2024-07-26T08:28:18.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.811+0000 7f9565c31740 1 -- start start 2024-07-26T08:28:18.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9565c31740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9565c31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8cf80a0 0x5644f90c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9565c31740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d00280 0x5644f90c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9565c31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5644f903c950 con 0x5644f8cf80a0 2024-07-26T08:28:18.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9565c31740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5644f902be50 con 0x5644f8d20f60 2024-07-26T08:28:18.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9565c31740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5644f902fe90 con 0x5644f8d00280 2024-07-26T08:28:18.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36398/0 (socket says 172.21.15.43:36398) 2024-07-26T08:28:18.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 -- 172.21.15.43:0/347600720 learned_addr learned my addr 172.21.15.43:0/347600720 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:18.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9557e00640 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8cf80a0 0x5644f90c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f9557400640 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d00280 0x5644f90c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 -- 172.21.15.43:0/347600720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d00280 msgr2=0x5644f90c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d00280 0x5644f90c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 -- 172.21.15.43:0/347600720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8cf80a0 msgr2=0x5644f90c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8cf80a0 0x5644f90c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.812+0000 7f955d000640 1 -- 172.21.15.43:0/347600720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f8fd30f0 con 0x5644f8d20f60 2024-07-26T08:28:18.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.813+0000 7f955d000640 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90c6550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9550009ca0 tx=0x7f9550011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919512325d697af9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.813+0000 7f954d600640 1 -- 172.21.15.43:0/347600720 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955001e070 con 0x5644f8d20f60 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.813+0000 7f954d600640 1 -- 172.21.15.43:0/347600720 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9550009e50 con 0x5644f8d20f60 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.813+0000 7f954d600640 1 -- 172.21.15.43:0/347600720 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955000ea50 con 0x5644f8d20f60 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.813+0000 7f9554c00640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f953c0b3c20 0x7f953c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9554c00640 1 -- 172.21.15.43:0/3875732817 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f95441042a0 con 0x7f9558077cc0 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9557e00640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f953c0b3c20 0x7f953c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 -- 172.21.15.43:0/347600720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 msgr2=0x5644f90c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90c6550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9550009ca0 tx=0x7f9550011810 comp rx=0 tx=0).stop 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 -- 172.21.15.43:0/347600720 shutdown_connections 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d00280 0x5644f90c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8cf80a0 0x5644f90c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 --2- 172.21.15.43:0/347600720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90c6550 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.814+0000 7f9565c31740 1 -- 172.21.15.43:0/347600720 >> 172.21.15.43:0/347600720 conn(0x5644f8d15350 msgr2=0x5644f90c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.815+0000 7f9565c31740 1 -- 172.21.15.43:0/347600720 shutdown_connections 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.815+0000 7f9565c31740 1 -- 172.21.15.43:0/347600720 wait complete. 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.815+0000 7f9557e00640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f953c0b3c20 0x7f953c0b6130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5644f90c51d0 tx=0x7f9548009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.815+0000 7f9565c31740 1 -- start start 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.815+0000 7f9565c31740 1 Processor -- start 2024-07-26T08:28:18.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8cf80a0 0x5644f90d2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90de020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5644f8e8f5f0 con 0x5644f8d00280 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5644f8fc8520 con 0x5644f8d20f60 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5644f90d4d30 con 0x5644f8cf80a0 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9565c31740 10 client.0 _ll_register_callbacks cb 0x5644f8fd7ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9557400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9557e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8cf80a0 0x5644f90d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9557400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50338/0 (socket says 172.21.15.43:50338) 2024-07-26T08:28:18.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f9557400640 1 -- 172.21.15.43:0/591030898 learned_addr learned my addr 172.21.15.43:0/591030898 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:18.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.816+0000 7f955d000640 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9557e00640 1 -- 172.21.15.43:0/591030898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 msgr2=0x5644f90de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9557e00640 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9557e00640 1 -- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 msgr2=0x5644f90d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9557e00640 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9557e00640 1 -- 172.21.15.43:0/591030898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f8d8c540 con 0x5644f8cf80a0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9557e00640 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8cf80a0 0x5644f90d2040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9548005fd0 tx=0x7f9548004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954446c695f66d88 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.817+0000 7f9542000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9542000640 1 -- 172.21.15.43:0/591030898 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954800f8f0 con 0x5644f8cf80a0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9542000640 1 -- 172.21.15.43:0/591030898 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f954800fa90 con 0x5644f8cf80a0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9550009e50 con 0x5644f8cf80a0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9542000640 1 -- 172.21.15.43:0/591030898 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f954800fc90 con 0x5644f8cf80a0 2024-07-26T08:28:18.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9565c31740 10 client.24838 fetch_fsmap learned FSMap version 17 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5644f90e0c80 con 0x5644f8cf80a0 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.818+0000 7f9542000640 1 -- 172.21.15.43:0/591030898 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9550009e50 con 0x5644f8cf80a0 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9542000640 1 -- 172.21.15.43:0/591030898 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f9548026070 con 0x5644f8cf80a0 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9565c31740 10 client.24838 fetch_fsmap finished waiting for FSMap version 17 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9565c31740 10 client.24838 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9565c31740 20 client.24838 populate_metadata read hostname 'smithi043' 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9565c31740 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cdf8e0 0x5644f90e4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9565c31740 4 client.24838 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:28:18.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644f903e8a0 con 0x5644f8cdf8e0 2024-07-26T08:28:18.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.819+0000 7f9557400640 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cdf8e0 0x5644f90e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.820+0000 7f9557400640 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cdf8e0 0x5644f90e4790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d89583371d60818c server_cookie=47899719961909d9 in_seq=0 out_seq=0 2024-07-26T08:28:18.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.820+0000 7f9542000640 10 client.24838 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:28:18.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9542000640 1 -- 172.21.15.43:0/591030898 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644f903e8a0 con 0x5644f8cdf8e0 2024-07-26T08:28:18.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9542000640 10 client.24838 handle_command_reply: tid=0 2024-07-26T08:28:18.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 client.24838 shutdown 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8cf80a0 msgr2=0x5644f90d2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8cf80a0 0x5644f90d2040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9548005fd0 tx=0x7f9548004ab0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 shutdown_connections 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cdf8e0 0x5644f90e4790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8d20f60 0x5644f90de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 --2- 172.21.15.43:0/591030898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8cf80a0 0x5644f90d2040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 >> 172.21.15.43:0/591030898 conn(0x5644f8d15350 msgr2=0x5644f90c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9542000640 0 client.24838 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.821+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 shutdown_connections 2024-07-26T08:28:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.822+0000 7f9565c31740 1 -- 172.21.15.43:0/591030898 wait complete. 2024-07-26T08:28:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.822+0000 7f9565c31740 20 client.24838 trim_cache size 0 max 16384 2024-07-26T08:28:18.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 Processor -- start 2024-07-26T08:28:18.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 -- start start 2024-07-26T08:28:18.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5644f90e2ad0 con 0x5644f8d00280 2024-07-26T08:28:18.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5644f90e31a0 con 0x5644f8cf80a0 2024-07-26T08:28:18.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.842+0000 7f9565c31740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5644f90e3870 con 0x5644f8d20f60 2024-07-26T08:28:18.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f955d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f955d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90de4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:59042/0 (socket says 172.21.15.43:59042) 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f955d000640 1 -- 172.21.15.43:0/1286985189 learned_addr learned my addr 172.21.15.43:0/1286985189 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557400640 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557e00640 1 -- 172.21.15.43:0/1286985189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 msgr2=0x5644f90de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557e00640 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90de4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557e00640 1 -- 172.21.15.43:0/1286985189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 msgr2=0x5644f90ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557e00640 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.843+0000 7f9557e00640 1 -- 172.21.15.43:0/1286985189 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f90c8b10 con 0x5644f8cf80a0 2024-07-26T08:28:18.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.844+0000 7f9557e00640 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90cc670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f954801c730 tx=0x7f95480047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30a3f9c5f85eb85 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:18.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.844+0000 7f954cc00640 1 -- 172.21.15.43:0/1286985189 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954800faf0 con 0x5644f8cf80a0 2024-07-26T08:28:18.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.844+0000 7f954cc00640 1 -- 172.21.15.43:0/1286985189 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f954801c7b0 con 0x5644f8cf80a0 2024-07-26T08:28:18.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.844+0000 7f954cc00640 1 -- 172.21.15.43:0/1286985189 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9548005260 con 0x5644f8cf80a0 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 -- 172.21.15.43:0/1286985189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 msgr2=0x5644f90cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90cc670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f954801c730 tx=0x7f95480047e0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 -- 172.21.15.43:0/1286985189 shutdown_connections 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 --2- 172.21.15.43:0/1286985189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90cc670 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 -- 172.21.15.43:0/1286985189 >> 172.21.15.43:0/1286985189 conn(0x5644f8d15350 msgr2=0x5644f90d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:18.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 -- 172.21.15.43:0/1286985189 shutdown_connections 2024-07-26T08:28:18.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.845+0000 7f9565c31740 1 -- 172.21.15.43:0/1286985189 wait complete. 2024-07-26T08:28:18.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.846+0000 7f9565c31740 1 -- start start 2024-07-26T08:28:18.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.846+0000 7f9565c31740 1 Processor -- start 2024-07-26T08:28:18.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90e6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5644f90e4610 con 0x5644f8d00280 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5644f90e3f40 con 0x5644f8cf80a0 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5644f90e4ce0 con 0x5644f8d20f60 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9565c31740 10 client.0 _ll_register_callbacks cb 0x7f9548003d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9557400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f955d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f9557e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f955d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90eb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:59046/0 (socket says 172.21.15.43:59046) 2024-07-26T08:28:18.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.847+0000 7f955d000640 1 -- 172.21.15.43:0/2325557694 learned_addr learned my addr 172.21.15.43:0/2325557694 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:18.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9557e00640 1 -- 172.21.15.43:0/2325557694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 msgr2=0x5644f90eb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9557e00640 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90eb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9557e00640 1 -- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 msgr2=0x5644f90e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9557e00640 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9557e00640 1 -- 172.21.15.43:0/2325557694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f90eb710 con 0x5644f8cf80a0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9557e00640 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90e5b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f954801c780 tx=0x7f9548004cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba2ee0c9cec446b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9542000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9542000640 1 -- 172.21.15.43:0/2325557694 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954801cd70 con 0x5644f8cf80a0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.848+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f954801c7b0 con 0x5644f8cf80a0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.849+0000 7f9542000640 1 -- 172.21.15.43:0/2325557694 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f9548036440 con 0x5644f8cf80a0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.849+0000 7f9542000640 1 -- 172.21.15.43:0/2325557694 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9548049050 con 0x5644f8cf80a0 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.849+0000 7f9565c31740 10 client.24812 fetch_fsmap learned FSMap version 17 2024-07-26T08:28:18.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.849+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5644f90ecad0 con 0x5644f8cf80a0 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.849+0000 7f9542000640 1 -- 172.21.15.43:0/2325557694 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f954801c7b0 con 0x5644f8cf80a0 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9542000640 1 -- 172.21.15.43:0/2325557694 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f9548026040 con 0x5644f8cf80a0 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9565c31740 10 client.24812 fetch_fsmap finished waiting for FSMap version 17 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9565c31740 10 client.24812 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9565c31740 20 client.24812 populate_metadata read hostname 'smithi043' 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9565c31740 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cb4c90 0x5644f91500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9565c31740 4 client.24812 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "status"}) -- 0x5644f903a340 con 0x5644f8cb4c90 2024-07-26T08:28:18.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.850+0000 7f9557400640 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cb4c90 0x5644f91500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:18.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9557400640 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cb4c90 0x5644f91500e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9963ecc3f90d258a server_cookie=5fdde8f1c45a94e3 in_seq=0 out_seq=0 2024-07-26T08:28:18.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9542000640 10 client.24812 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:28:18.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9542000640 1 -- 172.21.15.43:0/2325557694 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5644f903a340 con 0x5644f8cb4c90 2024-07-26T08:28:18.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9542000640 10 client.24812 handle_command_reply: tid=0 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9565c31740 1 client.24812 shutdown 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 msgr2=0x5644f90e5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.851+0000 7f9565c31740 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90e5b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f954801c780 tx=0x7f9548004cc0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 shutdown_connections 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5644f8cb4c90 0x5644f91500e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5644f8d20f60 0x5644f90eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5644f8d00280 0x5644f90e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 --2- 172.21.15.43:0/2325557694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5644f8cf80a0 0x5644f90e5b90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9542000640 0 client.24812 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 >> 172.21.15.43:0/2325557694 conn(0x5644f8d15350 msgr2=0x5644f90c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 shutdown_connections 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 1 -- 172.21.15.43:0/2325557694 wait complete. 2024-07-26T08:28:18.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.852+0000 7f9565c31740 20 client.24812 trim_cache size 0 max 16384 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24733, 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 40.528765309999997, 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 17, 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 86, 2024-07-26T08:28:18.856 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 86, 2024-07-26T08:28:18.857 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 67.750835241999994 2024-07-26T08:28:18.857 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:28:18.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f953c0b3c20 msgr2=0x7f953c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f953c0b3c20 0x7f953c0b6130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5644f90c51d0 tx=0x7f9548009500 comp rx=0 tx=0).stop 2024-07-26T08:28:18.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 msgr2=0x7f95581a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:18.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 0x7f95581a0b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9544005940 tx=0x7f9544004040 comp rx=0 tx=0).stop 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 shutdown_connections 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f953c0b3c20 0x7f953c0b6130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95581141a0 0x7f95581a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9558077cc0 0x7f95581a0b50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 --2- 172.21.15.43:0/3875732817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558077370 0x7f95581a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 >> 172.21.15.43:0/3875732817 conn(0x7f95581011f0 msgr2=0x7f9558103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.853+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 shutdown_connections 2024-07-26T08:28:18.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:18.854+0000 7f955f000640 1 -- 172.21.15.43:0/3875732817 wait complete. 2024-07-26T08:28:19.617 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-26T08:28:19.617 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:19.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs ls 2024-07-26T08:28:19.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:19 smithi043 ceph-mon[32384]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:20.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:19 smithi063 ceph-mon[36747]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:20.101 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:20.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:19 smithi133 ceph-mon[37053]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:22.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:21 smithi063 ceph-mon[36747]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:22.073 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:21 smithi043 ceph-mon[32384]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:21 smithi133 ceph-mon[37053]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 -- 172.21.15.43:0/2660190791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810ba40 msgr2=0x7ff228112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 --2- 172.21.15.43:0/2660190791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810ba40 0x7ff228112270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff220009be0 tx=0x7ff22002a6c0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 -- 172.21.15.43:0/2660190791 shutdown_connections 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 --2- 172.21.15.43:0/2660190791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22810b0f0 0x7ff22810b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 --2- 172.21.15.43:0/2660190791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810ba40 0x7ff228112270 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 --2- 172.21.15.43:0/2660190791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff228105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 -- 172.21.15.43:0/2660190791 >> 172.21.15.43:0/2660190791 conn(0x7ff228101240 msgr2=0x7ff228103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 -- 172.21.15.43:0/2660190791 shutdown_connections 2024-07-26T08:28:22.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.483+0000 7ff22ee00640 1 -- 172.21.15.43:0/2660190791 wait complete. 2024-07-26T08:28:22.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 Processor -- start 2024-07-26T08:28:22.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 -- start start 2024-07-26T08:28:22.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff22819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:22.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810b0f0 0x7ff22819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:22.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22810ba40 0x7ff2281a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:22.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff228115840 con 0x7ff22810b0f0 2024-07-26T08:28:22.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2281156c0 con 0x7ff2281057b0 2024-07-26T08:28:22.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.485+0000 7ff22ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff2281159c0 con 0x7ff22810ba40 2024-07-26T08:28:22.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff21fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810b0f0 0x7ff22819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff22819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff21fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810b0f0 0x7ff22819c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50364/0 (socket says 172.21.15.43:50364) 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff21fe00640 1 -- 172.21.15.43:0/429890511 learned_addr learned my addr 172.21.15.43:0/429890511 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff22819c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36444/0 (socket says 172.21.15.43:36444) 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff22ce00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22810ba40 0x7ff2281a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 -- 172.21.15.43:0/429890511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22810ba40 msgr2=0x7ff2281a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22810ba40 0x7ff2281a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 -- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810b0f0 msgr2=0x7ff22819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810b0f0 0x7ff22819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.486+0000 7ff227e00640 1 -- 172.21.15.43:0/429890511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281a2100 con 0x7ff2281057b0 2024-07-26T08:28:22.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.487+0000 7ff227e00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff22819c190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff218005fd0 tx=0x7ff21800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:22.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.487+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21800cd00 con 0x7ff2281057b0 2024-07-26T08:28:22.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.487+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2281a23f0 con 0x7ff2281057b0 2024-07-26T08:28:22.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.487+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff2180035f0 con 0x7ff2281057b0 2024-07-26T08:28:22.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.487+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218010690 con 0x7ff2281057b0 2024-07-26T08:28:22.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.487+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2281a8b50 con 0x7ff2281057b0 2024-07-26T08:28:22.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.489+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228105bc0 con 0x7ff2281057b0 2024-07-26T08:28:22.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.493+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7ff2180037a0 con 0x7ff2281057b0 2024-07-26T08:28:22.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.495+0000 7ff225600640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff20c0b3c20 0x7ff20c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:22.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.495+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7ff2180e4180 con 0x7ff2281057b0 2024-07-26T08:28:22.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.495+0000 7ff21fe00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff20c0b3c20 0x7ff20c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.496+0000 7ff21fe00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff20c0b3c20 0x7ff20c0b6130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff228104af0 tx=0x7ff210005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.499+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff218009510 con 0x7ff2281057b0 2024-07-26T08:28:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.745+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff22802e0c0 con 0x7ff2281057b0 2024-07-26T08:28:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.746+0000 7ff225600640 1 -- 172.21.15.43:0/429890511 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7ff2180ab460 con 0x7ff2281057b0 2024-07-26T08:28:22.748 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-26T08:28:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff20c0b3c20 msgr2=0x7ff20c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff20c0b3c20 0x7ff20c0b6130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff228104af0 tx=0x7ff210005f90 comp rx=0 tx=0).stop 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 msgr2=0x7ff22819c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff22819c190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff218005fd0 tx=0x7ff21800ee50 comp rx=0 tx=0).stop 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 shutdown_connections 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff20c0b3c20 0x7ff20c0b6130 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.749+0000 7ff22ee00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22810ba40 0x7ff2281a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.750+0000 7ff22ee00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff22810b0f0 0x7ff22819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.750+0000 7ff22ee00640 1 --2- 172.21.15.43:0/429890511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2281057b0 0x7ff22819c190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.750+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 >> 172.21.15.43:0/429890511 conn(0x7ff228101240 msgr2=0x7ff22810a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.750+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 shutdown_connections 2024-07-26T08:28:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:22.750+0000 7ff22ee00640 1 -- 172.21.15.43:0/429890511 wait complete. 2024-07-26T08:28:23.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:22 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/429890511' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T08:28:23.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:22 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/429890511' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T08:28:23.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:22 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/429890511' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T08:28:23.542 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-26T08:28:23.543 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-07-26T08:28:23.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:23.543 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-07-26T08:28:23.582 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 41939sec preferred_lft 41939sec 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-07-26T08:28:23.583 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T08:28:23.584 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-07-26T08:28:23.584 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-07-26T08:28:23.585 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-26T08:28:23.585 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:28:23.585 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:28:23.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-07-26T08:28:23.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-07-26T08:28:23.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-07-26T08:28:23.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-26T08:28:23.586 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:28:23.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:28:24.002 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:23 smithi043 ceph-mon[32384]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:24.002 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:28:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:23 smithi063 ceph-mon[36747]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:28:24.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:24.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:24.107 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-26T08:28:24.161 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:23 smithi133 ceph-mon[37053]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:24.161 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:28:24.167 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-07-26T08:28:24.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:24.171 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-07-26T08:28:24.223 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-07-26T08:28:24.223 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-26T08:28:24.223 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-07-26T08:28:24.223 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-07-26T08:28:24.223 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-26T08:28:24.223 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:28:24.223 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:28:24.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-07-26T08:28:24.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-07-26T08:28:24.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-07-26T08:28:24.224 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:28:24.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:28:25.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:25.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:25.169 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-07-26T08:28:25.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:25.216 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-07-26T08:28:25.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.279 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:28:25.279 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:28:25.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:25.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-07-26T08:28:25.279 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:28:25.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:28:25.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:25.495 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-07-26T08:28:25.495 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:28:25.495 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:28:25.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-07-26T08:28:25.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-26T08:28:25.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-07-26T08:28:25.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-07-26T08:28:25.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-07-26T08:28:25.496 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:28:25.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:28:25.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:25.830 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:28:25.830 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:28:25.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-07-26T08:28:25.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-07-26T08:28:25.830 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:28:25.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:28:26.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:26.032 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-07-26T08:28:26.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-26T08:28:26.032 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:26.072 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-07-26T08:28:26.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-26T08:28:26.072 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:26.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-07-26T08:28:26.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:26 smithi043 ceph-mon[32384]: pgmap v339: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:26.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:26.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:26.266 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-07-26T08:28:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:26 smithi063 ceph-mon[36747]: pgmap v339: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-07-26T08:28:26.353 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-07-26T08:28:26.354 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/ffc6a391e36a74d2449138d7192a7770d4fed72c30ef1769afee409a24fb9dbe/merged 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/751ff7e842818fc9300134748c04e9a426bfeca5fa841a1d8e7824d038f7558a/merged 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/dc500e497cef5d7b0cadd1cdc613442ddac138bf0fb1d27533ef83ec1e4f670f/merged 2024-07-26T08:28:26.355 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/4c41721906ac2f55a175eb8ed1cc971a394e2959e5a0858d8b8a7d9bda0117af/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/2e1f04ac5f99fb4b1169e7e22e6418f110f4adfb9d1d9199e5ba4400a5008d9d/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f4092fd352380b2d0ed8ba9d69829a5aa0ae3bb6f33e2308f9bf27a54d0d236/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/a20cc748d7a879bb7c4255948b3e5e314a3f718b540b08768de9d83814562d45/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/f69c19cf7c27cb54f00f55818c1c620646dc79fe92dc2cf71a39db7479c482fe/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3135487fe7f27a247b418d82a4654a8484f7729f6f4f40554a1720b33e48a975/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/e68a4dd947a182ed97285cdf2b958aa53290b7ca0815f339f5bdc814c1a7eab8/merged 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:26.356 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:26.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:26.357 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-07-26T08:28:26.398 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-07-26T08:28:26.399 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-07-26T08:28:26.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-07-26T08:28:26.513 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-07-26T08:28:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:26 smithi133 ceph-mon[37053]: pgmap v339: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-07-26T08:28:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-26T08:28:26.556 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/ffc6a391e36a74d2449138d7192a7770d4fed72c30ef1769afee409a24fb9dbe/merged 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/751ff7e842818fc9300134748c04e9a426bfeca5fa841a1d8e7824d038f7558a/merged 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/dc500e497cef5d7b0cadd1cdc613442ddac138bf0fb1d27533ef83ec1e4f670f/merged 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/4c41721906ac2f55a175eb8ed1cc971a394e2959e5a0858d8b8a7d9bda0117af/merged 2024-07-26T08:28:26.557 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/2e1f04ac5f99fb4b1169e7e22e6418f110f4adfb9d1d9199e5ba4400a5008d9d/merged 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f4092fd352380b2d0ed8ba9d69829a5aa0ae3bb6f33e2308f9bf27a54d0d236/merged 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/a20cc748d7a879bb7c4255948b3e5e314a3f718b540b08768de9d83814562d45/merged 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/f69c19cf7c27cb54f00f55818c1c620646dc79fe92dc2cf71a39db7479c482fe/merged 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3135487fe7f27a247b418d82a4654a8484f7729f6f4f40554a1720b33e48a975/merged 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/e68a4dd947a182ed97285cdf2b958aa53290b7ca0815f339f5bdc814c1a7eab8/merged 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:26.558 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:26.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:26.559 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-07-26T08:28:26.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:2024-07-26T08:28:26.748+0000 7fe260e0e480 -1 init, newargv = 0x7fe248004ba0 newargc=15 2024-07-26T08:28:26.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[83138]: starting ceph client 2024-07-26T08:28:26.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[83138]: starting fuse 2024-07-26T08:28:27.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-07-26T08:28:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:27 smithi133 ceph-mon[37053]: pgmap v340: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:27.820 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-07-26T08:28:27.863 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-07-26T08:28:27.863 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-07-26T08:28:27.863 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-07-26T08:28:27.864 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/ffc6a391e36a74d2449138d7192a7770d4fed72c30ef1769afee409a24fb9dbe/merged 2024-07-26T08:28:27.865 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/751ff7e842818fc9300134748c04e9a426bfeca5fa841a1d8e7824d038f7558a/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/dc500e497cef5d7b0cadd1cdc613442ddac138bf0fb1d27533ef83ec1e4f670f/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/4c41721906ac2f55a175eb8ed1cc971a394e2959e5a0858d8b8a7d9bda0117af/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/2e1f04ac5f99fb4b1169e7e22e6418f110f4adfb9d1d9199e5ba4400a5008d9d/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f4092fd352380b2d0ed8ba9d69829a5aa0ae3bb6f33e2308f9bf27a54d0d236/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/a20cc748d7a879bb7c4255948b3e5e314a3f718b540b08768de9d83814562d45/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/f69c19cf7c27cb54f00f55818c1c620646dc79fe92dc2cf71a39db7479c482fe/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3135487fe7f27a247b418d82a4654a8484f7729f6f4f40554a1720b33e48a975/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/e68a4dd947a182ed97285cdf2b958aa53290b7ca0815f339f5bdc814c1a7eab8/merged 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:27.866 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:28:27.867 INFO:teuthology.orchestra.run.smithi043.stdout:/home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:27.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:27.868 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-07-26T08:28:27.964 INFO:teuthology.orchestra.run.smithi043.stdout:119 2024-07-26T08:28:27.964 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-07-26T08:28:27.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-07-26T08:28:27.964 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-07-26T08:28:27.965 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.admin")) 2024-07-26T08:28:27.966 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-07-26T08:28:27.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:27.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:27.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:27 smithi043 ceph-mon[32384]: pgmap v340: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:28.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:27 smithi063 ceph-mon[36747]: pgmap v340: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:28.141 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.admin.83138.asok 2024-07-26T08:28:28.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:28.161 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.83138.asok 2024-07-26T08:28:28.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:28.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.83138.asok status 2024-07-26T08:28:28.467 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:28:28.467 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-07-26T08:28:28.467 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528", 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "admin", 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "83138", 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24856, 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-07-26T08:28:28.468 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 24856 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2669353838 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2669353838 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T08:28:28.469 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.24856 192.168.0.1:0/2669353838", 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/2669353838", 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 17, 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 86, 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-07-26T08:28:28.470 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:28:28.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:28.490 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-07-26T08:28:28.490 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:28.545 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-07-26T08:28:28.546 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:28.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:28.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:28.636 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-07-26T08:28:28.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-26T08:28:28.786 INFO:teuthology.orchestra.run.smithi043.stdout:# file: . 2024-07-26T08:28:28.786 INFO:teuthology.orchestra.run.smithi043.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-07-26T08:28:28.786 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:28.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:28:28.797 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:28:28.797 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T08:28:28.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd blocklist ls 2024-07-26T08:28:28.925 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:28:28.925 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:28:28.926 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:28:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:28:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:29.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:28:29.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:28:29.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:28:29.335 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:29.832 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:29 smithi043 ceph-mon[32384]: pgmap v341: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:30.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:29 smithi133 ceph-mon[37053]: pgmap v341: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:30.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:29 smithi063 ceph-mon[36747]: pgmap v341: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:31.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 -- 172.21.15.43:0/3942128543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 msgr2=0x7fc998116590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3942128543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc998116590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc990009ca0 tx=0x7fc99002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 -- 172.21.15.43:0/3942128543 shutdown_connections 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3942128543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc998113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3942128543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc998116590 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3942128543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 0x7fc998077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 -- 172.21.15.43:0/3942128543 >> 172.21.15.43:0/3942128543 conn(0x7fc998101240 msgr2=0x7fc998103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 -- 172.21.15.43:0/3942128543 shutdown_connections 2024-07-26T08:28:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.878+0000 7fc9a0400640 1 -- 172.21.15.43:0/3942128543 wait complete. 2024-07-26T08:28:31.882 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:31 smithi043 ceph-mon[32384]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.880+0000 7fc9a0400640 1 Processor -- start 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.880+0000 7fc9a0400640 1 -- start start 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc9a0400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 0x7fc9981a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc9a0400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc9981a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc9a0400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc9981a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc9a0400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc998119c30 con 0x7fc998114170 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc9a0400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc998119ab0 con 0x7fc998077370 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc9a0400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc998119db0 con 0x7fc998077cc0 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.881+0000 7fc99d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc9981a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc9981a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99da00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 0x7fc9981a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc9981a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:34960/0 (socket says 172.21.15.43:34960) 2024-07-26T08:28:31.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99d000640 1 -- 172.21.15.43:0/3914667965 learned_addr learned my addr 172.21.15.43:0/3914667965 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99da00640 1 -- 172.21.15.43:0/3914667965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 msgr2=0x7fc9981a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99da00640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc9981a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99da00640 1 -- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 msgr2=0x7fc9981a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99da00640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc9981a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99da00640 1 -- 172.21.15.43:0/3914667965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9981a64d0 con 0x7fc998077370 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99d000640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc9981a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.882+0000 7fc99e400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc9981a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.883+0000 7fc99da00640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 0x7fc9981a0560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98c005fd0 tx=0x7fc98c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.883+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c009c30 con 0x7fc998077370 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.883+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9981a67c0 con 0x7fc998077370 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.883+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc98c009dd0 con 0x7fc998077370 2024-07-26T08:28:31.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.883+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c010460 con 0x7fc998077370 2024-07-26T08:28:31.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.883+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9981acf20 con 0x7fc998077370 2024-07-26T08:28:31.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.884+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc998077780 con 0x7fc998077370 2024-07-26T08:28:31.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.887+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc98c0035f0 con 0x7fc998077370 2024-07-26T08:28:31.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.888+0000 7fc996000640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9800b3c20 0x7fc9800b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:31.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.888+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7fc98c0e3ae0 con 0x7fc998077370 2024-07-26T08:28:31.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.888+0000 7fc99d000640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9800b3c20 0x7fc9800b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:31.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.889+0000 7fc99d000640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9800b3c20 0x7fc9800b6130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc9980794c0 tx=0x7fc984005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:31.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:31.893+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc98c017020 con 0x7fc998077370 2024-07-26T08:28:32.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:31 smithi133 ceph-mon[37053]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:32.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:31 smithi063 ceph-mon[36747]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:32.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.112+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc99802e0c0 con 0x7fc998077370 2024-07-26T08:28:32.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.113+0000 7fc996000640 1 -- 172.21.15.43:0/3914667965 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v86) ==== 81+0+887 (secure 0 0 0) 0x7fc98c0aa770 con 0x7fc998077370 2024-07-26T08:28:32.114 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3742875375 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:32.114 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1444395529 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4108155415 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3582942481 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1591014211 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1663543642 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3446770894 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1663543642 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3742875375 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2150907670 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1482734723 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1482734723 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2372393330 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/711369665 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:32.115 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1785866462 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:32.116 INFO:teuthology.orchestra.run.smithi043.stderr:listed 15 entries 2024-07-26T08:28:32.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9800b3c20 msgr2=0x7fc9800b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:32.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9800b3c20 0x7fc9800b6130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc9980794c0 tx=0x7fc984005f90 comp rx=0 tx=0).stop 2024-07-26T08:28:32.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 msgr2=0x7fc9981a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:32.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 0x7fc9981a0560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98c005fd0 tx=0x7fc98c00dde0 comp rx=0 tx=0).stop 2024-07-26T08:28:32.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 shutdown_connections 2024-07-26T08:28:32.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9800b3c20 0x7fc9800b6130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:32.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc998077cc0 0x7fc9981a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:32.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc998114170 0x7fc9981a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:32.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 --2- 172.21.15.43:0/3914667965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc998077370 0x7fc9981a0560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:32.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.116+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 >> 172.21.15.43:0/3914667965 conn(0x7fc998101240 msgr2=0x7fc998116180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:32.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.117+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 shutdown_connections 2024-07-26T08:28:32.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:32.117+0000 7fc9a0400640 1 -- 172.21.15.43:0/3914667965 wait complete. 2024-07-26T08:28:32.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:32 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3914667965' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T08:28:33.014 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:28:33.014 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T08:28:33.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:32 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3914667965' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T08:28:33.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:32 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3914667965' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T08:28:33.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd blocklist ls 2024-07-26T08:28:33.554 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:33.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:33 smithi043 ceph-mon[32384]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:34.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:33 smithi133 ceph-mon[37053]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:34.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:33 smithi063 ceph-mon[36747]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-07-26T08:28:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-07-26T08:28:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-07-26T08:28:34.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-07-26T08:28:34.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-07-26T08:28:34.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-07-26T08:28:34.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-07-26T08:28:34.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-07-26T08:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-07-26T08:28:35.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-07-26T08:28:35.968 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]': finished 2024-07-26T08:28:35.969 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:35 smithi043 ceph-mon[32384]: osdmap e87: 12 total, 12 up, 12 in 2024-07-26T08:28:36.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 -- 172.21.15.43:0/1080127607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 msgr2=0x7f18d80751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:36.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1080127607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d80751e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009ca0 tx=0x7f18c802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 -- 172.21.15.43:0/1080127607 shutdown_connections 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1080127607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18d8113cb0 0x7f18d8116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1080127607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 0x7f18d8075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1080127607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d80751e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 -- 172.21.15.43:0/1080127607 >> 172.21.15.43:0/1080127607 conn(0x7f18d80fee70 msgr2=0x7f18d81012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 -- 172.21.15.43:0/1080127607 shutdown_connections 2024-07-26T08:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.036+0000 7f18d7e00640 1 -- 172.21.15.43:0/1080127607 wait complete. 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.038+0000 7f18d7e00640 1 Processor -- start 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.038+0000 7f18d7e00640 1 -- start start 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 0x7f18d81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d81a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18d8113cb0 0x7f18d81a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18d8119a30 con 0x7f18d8076db0 2024-07-26T08:28:36.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18d81198b0 con 0x7f18d8075800 2024-07-26T08:28:36.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f18d8119bb0 con 0x7f18d8113cb0 2024-07-26T08:28:36.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d81a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:36.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 0x7f18d81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d81a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56032/0 (socket says 172.21.15.43:56032) 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d6000640 1 -- 172.21.15.43:0/1505901391 learned_addr learned my addr 172.21.15.43:0/1505901391 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.039+0000 7f18d7400640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18d8113cb0 0x7f18d81a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6a00640 1 -- 172.21.15.43:0/1505901391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18d8113cb0 msgr2=0x7f18d81a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6a00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18d8113cb0 0x7f18d81a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6a00640 1 -- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 msgr2=0x7f18d81a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6a00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d81a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6a00640 1 -- 172.21.15.43:0/1505901391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d81a6370 con 0x7f18d8075800 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6000640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d81a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.040+0000 7f18d6a00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 0x7f18d81a0400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009ca0 tx=0x7f18c8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.041+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8031650 con 0x7f18d8075800 2024-07-26T08:28:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.041+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d81a6600 con 0x7f18d8075800 2024-07-26T08:28:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.041+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d81acdc0 con 0x7f18d8075800 2024-07-26T08:28:36.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.041+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18c8036030 con 0x7f18d8075800 2024-07-26T08:28:36.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.041+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c802f8c0 con 0x7f18d8075800 2024-07-26T08:28:36.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.042+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b4005290 con 0x7f18d8075800 2024-07-26T08:28:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.045+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f18c802fa60 con 0x7f18d8075800 2024-07-26T08:28:36.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.046+0000 7f18cf400640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18bc0b3ca0 0x7f18bc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:36.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.046+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f18c8105280 con 0x7f18d8075800 2024-07-26T08:28:36.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.046+0000 7f18d6000640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18bc0b3ca0 0x7f18bc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:36.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.047+0000 7f18d6000640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18bc0b3ca0 0x7f18bc0b61b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ffdd0 tx=0x7f18c000b480 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:36.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.051+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f18c80cc440 con 0x7f18d8075800 2024-07-26T08:28:36.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]': finished 2024-07-26T08:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:35 smithi063 ceph-mon[36747]: osdmap e87: 12 total, 12 up, 12 in 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-07-26T08:28:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]': finished 2024-07-26T08:28:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:35 smithi133 ceph-mon[37053]: osdmap e87: 12 total, 12 up, 12 in 2024-07-26T08:28:36.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.272+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18b4005580 con 0x7f18d8075800 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.273+0000 7f18cf400640 1 -- 172.21.15.43:0/1505901391 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v88) ==== 81+0+887 (secure 0 0 0) 0x7f18c80cbd40 con 0x7f18d8075800 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3742875375 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1444395529 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4108155415 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3582942481 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1591014211 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1663543642 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3446770894 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1663543642 2024-07-27T08:17:40.568271+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3742875375 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2150907670 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1482734723 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1482734723 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2372393330 2024-07-27T08:19:34.498126+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/711369665 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:36.279 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1785866462 2024-07-27T08:18:11.763386+0000 2024-07-26T08:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:listed 15 entries 2024-07-26T08:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18bc0b3ca0 msgr2=0x7f18bc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18bc0b3ca0 0x7f18bc0b61b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ffdd0 tx=0x7f18c000b480 comp rx=0 tx=0).stop 2024-07-26T08:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 msgr2=0x7f18d81a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 0x7f18d81a0400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009ca0 tx=0x7f18c8003ce0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 shutdown_connections 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18bc0b3ca0 0x7f18bc0b61b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18d8113cb0 0x7f18d81a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d8076db0 0x7f18d81a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 --2- 172.21.15.43:0/1505901391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18d8075800 0x7f18d81a0400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 >> 172.21.15.43:0/1505901391 conn(0x7f18d80fee70 msgr2=0x7f18d810fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 shutdown_connections 2024-07-26T08:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:36.278+0000 7f18d7e00640 1 -- 172.21.15.43:0/1505901391 wait complete. 2024-07-26T08:28:37.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:36 smithi063 ceph-mon[36747]: osdmap e88: 12 total, 12 up, 12 in 2024-07-26T08:28:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:36 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1505901391' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T08:28:37.141 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:36 smithi043 ceph-mon[32384]: osdmap e88: 12 total, 12 up, 12 in 2024-07-26T08:28:37.142 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1505901391' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T08:28:37.218 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-07-26T08:28:37.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:37.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-07-26T08:28:37.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:36 smithi133 ceph-mon[37053]: osdmap e88: 12 total, 12 up, 12 in 2024-07-26T08:28:37.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:36 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1505901391' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T08:28:37.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[83138]: fuse finished with error 0 and tester_r 0 2024-07-26T08:28:37.320 INFO:teuthology.orchestra.run:waiting for 300 2024-07-26T08:28:38.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:37 smithi063 ceph-mon[36747]: pgmap v347: 129 pgs: 1 activating, 2 peering, 126 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-07-26T08:28:38.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:37 smithi043 ceph-mon[32384]: pgmap v347: 129 pgs: 1 activating, 2 peering, 126 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-07-26T08:28:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:37 smithi133 ceph-mon[37053]: pgmap v347: 129 pgs: 1 activating, 2 peering, 126 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-07-26T08:28:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:39 smithi043 ceph-mon[32384]: pgmap v348: 129 pgs: 1 activating, 2 peering, 126 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:40.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:39 smithi133 ceph-mon[37053]: pgmap v348: 129 pgs: 1 activating, 2 peering, 126 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:40.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:39 smithi063 ceph-mon[36747]: pgmap v348: 129 pgs: 1 activating, 2 peering, 126 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:41 smithi043 ceph-mon[32384]: pgmap v349: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-07-26T08:28:42.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:41 smithi133 ceph-mon[37053]: pgmap v349: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-07-26T08:28:42.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:41 smithi063 ceph-mon[36747]: pgmap v349: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-07-26T08:28:43.422 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:28:43.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:28:43.422 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-07-26T08:28:43.499 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:28:43.971 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:43.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:43 smithi043 ceph-mon[32384]: pgmap v350: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-07-26T08:28:44.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:43 smithi063 ceph-mon[36747]: pgmap v350: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-07-26T08:28:44.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:43 smithi133 ceph-mon[37053]: pgmap v350: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-07-26T08:28:46.070 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:45 smithi043 ceph-mon[32384]: pgmap v351: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 103 B/s wr, 0 op/s; 58 B/s, 0 objects/s recovering 2024-07-26T08:28:46.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:45 smithi133 ceph-mon[37053]: pgmap v351: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 103 B/s wr, 0 op/s; 58 B/s, 0 objects/s recovering 2024-07-26T08:28:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:45 smithi063 ceph-mon[36747]: pgmap v351: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 103 B/s wr, 0 op/s; 58 B/s, 0 objects/s recovering 2024-07-26T08:28:46.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 -- 172.21.15.43:0/2438515916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 msgr2=0x7f90c010f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 --2- 172.21.15.43:0/2438515916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 0x7f90c010f400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009900 tx=0x7f90b002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 -- 172.21.15.43:0/2438515916 shutdown_connections 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 --2- 172.21.15.43:0/2438515916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 0x7f90c0111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 --2- 172.21.15.43:0/2438515916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 0x7f90c010f400 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 --2- 172.21.15.43:0/2438515916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 0x7f90c00755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 -- 172.21.15.43:0/2438515916 >> 172.21.15.43:0/2438515916 conn(0x7f90c00fee70 msgr2=0x7f90c01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 -- 172.21.15.43:0/2438515916 shutdown_connections 2024-07-26T08:28:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.430+0000 7f90c7200640 1 -- 172.21.15.43:0/2438515916 wait complete. 2024-07-26T08:28:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.431+0000 7f90c7200640 1 Processor -- start 2024-07-26T08:28:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 -- start start 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 0x7f90c019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 0x7f90c019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 0x7f90c01a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90c0115640 con 0x7f90c0075b30 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90c01154c0 con 0x7f90c010f940 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f90c01157c0 con 0x7f90c00751e0 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 0x7f90c019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 0x7f90c019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44550/0 (socket says 172.21.15.43:44550) 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c5e00640 1 -- 172.21.15.43:0/3979855527 learned_addr learned my addr 172.21.15.43:0/3979855527 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.432+0000 7f90c6800640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 0x7f90c01a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c5400640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 0x7f90c019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:46.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c6800640 1 -- 172.21.15.43:0/3979855527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 msgr2=0x7f90c019c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:46.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c6800640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 0x7f90c019c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c6800640 1 -- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 msgr2=0x7f90c019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:46.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c6800640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 0x7f90c019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c6800640 1 -- 172.21.15.43:0/3979855527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c01a1fe0 con 0x7f90c010f940 2024-07-26T08:28:46.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.433+0000 7f90c6800640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 0x7f90c01a18b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00e970 tx=0x7f90bc00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.434+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00ccc0 con 0x7f90c010f940 2024-07-26T08:28:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.434+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f90bc0035f0 con 0x7f90c010f940 2024-07-26T08:28:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.434+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c01a22d0 con 0x7f90c010f940 2024-07-26T08:28:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.434+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00ce60 con 0x7f90c010f940 2024-07-26T08:28:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.434+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c01a8a30 con 0x7f90c010f940 2024-07-26T08:28:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.435+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c00755f0 con 0x7f90c010f940 2024-07-26T08:28:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.437+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f90bc0037a0 con 0x7f90c010f940 2024-07-26T08:28:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.439+0000 7f90b6a00640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f90ac0b3c20 0x7f90ac0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.439+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f90bc0e4230 con 0x7f90c010f940 2024-07-26T08:28:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.439+0000 7f90c5e00640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f90ac0b3c20 0x7f90ac0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:46.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.440+0000 7f90c5e00640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f90ac0b3c20 0x7f90ac0b6130 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009fd0 tx=0x7f90b8009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:46.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.443+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f90bc0ab3f0 con 0x7f90c010f940 2024-07-26T08:28:46.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.646+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90c01a8c90 con 0x7f90c010f940 2024-07-26T08:28:46.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.648+0000 7f90b6a00640 1 -- 172.21.15.43:0/3979855527 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24855 (secure 0 0 0) 0x7f90bc0aacf0 con 0x7f90c010f940 2024-07-26T08:28:46.650 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:46.651 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":88,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:28:35.776184+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:28:46.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f90ac0b3c20 msgr2=0x7f90ac0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:46.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f90ac0b3c20 0x7f90ac0b6130 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009fd0 tx=0x7f90b8009500 comp rx=0 tx=0).stop 2024-07-26T08:28:46.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 msgr2=0x7f90c01a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:46.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 0x7f90c01a18b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00e970 tx=0x7f90bc00ee30 comp rx=0 tx=0).stop 2024-07-26T08:28:46.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 shutdown_connections 2024-07-26T08:28:46.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f90ac0b3c20 0x7f90ac0b6130 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90c010f940 0x7f90c01a18b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90c0075b30 0x7f90c019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 --2- 172.21.15.43:0/3979855527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c00751e0 0x7f90c019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:46.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 >> 172.21.15.43:0/3979855527 conn(0x7f90c00fee70 msgr2=0x7f90c0109470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:46.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.651+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 shutdown_connections 2024-07-26T08:28:46.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:46.652+0000 7f90c7200640 1 -- 172.21.15.43:0/3979855527 wait complete. 2024-07-26T08:28:46.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:46 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3979855527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:47.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:46 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3979855527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:47.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:46 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3979855527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:47.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:28:48.096 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:48.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:47 smithi043 ceph-mon[32384]: pgmap v352: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 93 B/s wr, 0 op/s; 53 B/s, 0 objects/s recovering 2024-07-26T08:28:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:47 smithi133 ceph-mon[37053]: pgmap v352: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 93 B/s wr, 0 op/s; 53 B/s, 0 objects/s recovering 2024-07-26T08:28:48.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:47 smithi063 ceph-mon[36747]: pgmap v352: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 93 B/s wr, 0 op/s; 53 B/s, 0 objects/s recovering 2024-07-26T08:28:49.939 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:49 smithi043 ceph-mon[32384]: pgmap v353: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-07-26T08:28:50.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:49 smithi133 ceph-mon[37053]: pgmap v353: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-07-26T08:28:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:49 smithi063 ceph-mon[36747]: pgmap v353: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-07-26T08:28:50.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 -- 172.21.15.43:0/4091907923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d810fb00 msgr2=0x7f88d8111f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:50.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 --2- 172.21.15.43:0/4091907923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d810fb00 0x7f88d8111f40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009860 tx=0x7f88d002a340 comp rx=0 tx=0).stop 2024-07-26T08:28:50.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 -- 172.21.15.43:0/4091907923 shutdown_connections 2024-07-26T08:28:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 --2- 172.21.15.43:0/4091907923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d810fb00 0x7f88d8111f40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 --2- 172.21.15.43:0/4091907923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 0x7f88d810f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 --2- 172.21.15.43:0/4091907923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d80751e0 0x7f88d80755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 -- 172.21.15.43:0/4091907923 >> 172.21.15.43:0/4091907923 conn(0x7f88d80ff010 msgr2=0x7f88d8101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.491+0000 7f88dea00640 1 -- 172.21.15.43:0/4091907923 shutdown_connections 2024-07-26T08:28:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.492+0000 7f88dea00640 1 -- 172.21.15.43:0/4091907923 wait complete. 2024-07-26T08:28:50.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.493+0000 7f88dea00640 1 Processor -- start 2024-07-26T08:28:50.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.493+0000 7f88dea00640 1 -- start start 2024-07-26T08:28:50.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 0x7f88d819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:50.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 0x7f88d819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:50.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d810fb00 0x7f88d81a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88d81157b0 con 0x7f88d8075b30 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dea00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88d8115630 con 0x7f88d810fb00 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f88d8115930 con 0x7f88d80751e0 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 0x7f88d819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 0x7f88d819c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44568/0 (socket says 172.21.15.43:44568) 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88d7e00640 1 -- 172.21.15.43:0/1365791739 learned_addr learned my addr 172.21.15.43:0/1365791739 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88cf400640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 0x7f88d819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.494+0000 7f88dca00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d810fb00 0x7f88d81a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88d7e00640 1 -- 172.21.15.43:0/1365791739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d810fb00 msgr2=0x7f88d81a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88d7e00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d810fb00 0x7f88d81a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88d7e00640 1 -- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 msgr2=0x7f88d819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:50.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88d7e00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 0x7f88d819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88d7e00640 1 -- 172.21.15.43:0/1365791739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d81a2070 con 0x7f88d80751e0 2024-07-26T08:28:50.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88cf400640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 0x7f88d819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:50.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88dca00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d810fb00 0x7f88d81a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:28:50.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.495+0000 7f88d7e00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 0x7f88d819c100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88c800ebc0 tx=0x7f88c800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:50.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.496+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8010630 con 0x7f88d80751e0 2024-07-26T08:28:50.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.496+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f88c8010ca0 con 0x7f88d80751e0 2024-07-26T08:28:50.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.496+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d81a2360 con 0x7f88d80751e0 2024-07-26T08:28:50.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.496+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8018ba0 con 0x7f88d80751e0 2024-07-26T08:28:50.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.496+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d81a8ac0 con 0x7f88d80751e0 2024-07-26T08:28:50.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.497+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d80755f0 con 0x7f88d80751e0 2024-07-26T08:28:50.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.500+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f88c80107d0 con 0x7f88d80751e0 2024-07-26T08:28:50.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.502+0000 7f88d5600640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88bc0b3ca0 0x7f88bc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:50.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.502+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f88c80e4ac0 con 0x7f88d80751e0 2024-07-26T08:28:50.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.502+0000 7f88cf400640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88bc0b3ca0 0x7f88bc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:50.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.503+0000 7f88cf400640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88bc0b3ca0 0x7f88bc0b61b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f88c00096c0 tx=0x7f88c0009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:50.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.503+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f88c8010ac0 con 0x7f88d80751e0 2024-07-26T08:28:50.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.707+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88d81a8e30 con 0x7f88d80751e0 2024-07-26T08:28:50.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.709+0000 7f88d5600640 1 -- 172.21.15.43:0/1365791739 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24855 (secure 0 0 0) 0x7f88c80ab630 con 0x7f88d80751e0 2024-07-26T08:28:50.711 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:28:50.711 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":88,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:28:35.776184+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:28:50.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.712+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88bc0b3ca0 msgr2=0x7f88bc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:50.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.712+0000 7f88dea00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88bc0b3ca0 0x7f88bc0b61b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f88c00096c0 tx=0x7f88c0009260 comp rx=0 tx=0).stop 2024-07-26T08:28:50.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.712+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 msgr2=0x7f88d819c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:50.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.712+0000 7f88dea00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 0x7f88d819c100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88c800ebc0 tx=0x7f88c800c6a0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 shutdown_connections 2024-07-26T08:28:50.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88bc0b3ca0 0x7f88bc0b61b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d810fb00 0x7f88d81a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d8075b30 0x7f88d819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 --2- 172.21.15.43:0/1365791739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d80751e0 0x7f88d819c100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:50.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 >> 172.21.15.43:0/1365791739 conn(0x7f88d80ff010 msgr2=0x7f88d81075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:50.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 shutdown_connections 2024-07-26T08:28:50.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:50.713+0000 7f88dea00640 1 -- 172.21.15.43:0/1365791739 wait complete. 2024-07-26T08:28:50.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:50 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1365791739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:51.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:50 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1365791739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:50 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1365791739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:28:51.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-07-26T08:28:52.080 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:52.229 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:51 smithi043 ceph-mon[32384]: pgmap v354: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-07-26T08:28:52.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:51 smithi133 ceph-mon[37053]: pgmap v354: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-07-26T08:28:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:51 smithi063 ceph-mon[36747]: pgmap v354: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-07-26T08:28:54.201 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:53 smithi043 ceph-mon[32384]: pgmap v355: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:54.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:53 smithi133 ceph-mon[37053]: pgmap v355: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:54.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:53 smithi063 ceph-mon[36747]: pgmap v355: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:54.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 -- 172.21.15.43:0/2998022881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077cc0 msgr2=0x7fd044113c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 --2- 172.21.15.43:0/2998022881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077cc0 0x7fd044113c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd030009860 tx=0x7fd03002a340 comp rx=0 tx=0).stop 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 -- 172.21.15.43:0/2998022881 shutdown_connections 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 --2- 172.21.15.43:0/2998022881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0441141a0 0x7fd0441165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 --2- 172.21.15.43:0/2998022881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077cc0 0x7fd044113c60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 --2- 172.21.15.43:0/2998022881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd044077370 0x7fd044077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.473+0000 7fd048a00640 1 -- 172.21.15.43:0/2998022881 >> 172.21.15.43:0/2998022881 conn(0x7fd0441011f0 msgr2=0x7fd044103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.474+0000 7fd048a00640 1 -- 172.21.15.43:0/2998022881 shutdown_connections 2024-07-26T08:28:54.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.474+0000 7fd048a00640 1 -- 172.21.15.43:0/2998022881 wait complete. 2024-07-26T08:28:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.475+0000 7fd048a00640 1 Processor -- start 2024-07-26T08:28:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.475+0000 7fd048a00640 1 -- start start 2024-07-26T08:28:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd048a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077370 0x7fd0441a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd048a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 0x7fd0441a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd048a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0441a5e90 0x7fd0441a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd048a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd044119c20 con 0x7fd044077370 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd048a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd044119aa0 con 0x7fd0441a5e90 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd048a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd044119da0 con 0x7fd0441141a0 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd041e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077370 0x7fd0441a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd041400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 0x7fd0441a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd041400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 0x7fd0441a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44580/0 (socket says 172.21.15.43:44580) 2024-07-26T08:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd041400640 1 -- 172.21.15.43:0/837590649 learned_addr learned my addr 172.21.15.43:0/837590649 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:54.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.476+0000 7fd042800640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0441a5e90 0x7fd0441a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:54.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.477+0000 7fd041400640 1 -- 172.21.15.43:0/837590649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0441a5e90 msgr2=0x7fd0441a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.477+0000 7fd041400640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0441a5e90 0x7fd0441a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.477+0000 7fd041400640 1 -- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077370 msgr2=0x7fd0441a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.477+0000 7fd041400640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077370 0x7fd0441a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.477+0000 7fd041400640 1 -- 172.21.15.43:0/837590649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0441a6a70 con 0x7fd0441141a0 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.477+0000 7fd041400640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 0x7fd0441a0cb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd030035040 tx=0x7fd03002af10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.478+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030037040 con 0x7fd0441141a0 2024-07-26T08:28:54.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.478+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0441ad010 con 0x7fd0441141a0 2024-07-26T08:28:54.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.478+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd030033e50 con 0x7fd0441141a0 2024-07-26T08:28:54.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.478+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030003850 con 0x7fd0441141a0 2024-07-26T08:28:54.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.478+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0441ad3b0 con 0x7fd0441141a0 2024-07-26T08:28:54.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.479+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd044077780 con 0x7fd0441141a0 2024-07-26T08:28:54.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.482+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fd030042060 con 0x7fd0441141a0 2024-07-26T08:28:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.483+0000 7fd03aa00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0280b3ca0 0x7fd0280b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.483+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7fd030102f00 con 0x7fd0441141a0 2024-07-26T08:28:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.484+0000 7fd041e00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0280b3ca0 0x7fd0280b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.484+0000 7fd041e00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0280b3ca0 0x7fd0280b61b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd034005fd0 tx=0x7fd034009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.485+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd0300ca0c0 con 0x7fd0441141a0 2024-07-26T08:28:54.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.729+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd04402e0c0 con 0x7fd0441141a0 2024-07-26T08:28:54.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.899+0000 7fd03aa00640 1 -- 172.21.15.43:0/837590649 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fd0300c99c0 con 0x7fd0441141a0 2024-07-26T08:28:54.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.902+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0280b3ca0 msgr2=0x7fd0280b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:54.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.902+0000 7fd048a00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0280b3ca0 0x7fd0280b61b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd034005fd0 tx=0x7fd034009260 comp rx=0 tx=0).stop 2024-07-26T08:28:54.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.902+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 msgr2=0x7fd0441a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:54.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.902+0000 7fd048a00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 0x7fd0441a0cb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd030035040 tx=0x7fd03002af10 comp rx=0 tx=0).stop 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 shutdown_connections 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0280b3ca0 0x7fd0280b61b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0441141a0 0x7fd0441a0cb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0441a5e90 0x7fd0441a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 --2- 172.21.15.43:0/837590649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd044077370 0x7fd0441a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 >> 172.21.15.43:0/837590649 conn(0x7fd0441011f0 msgr2=0x7fd044103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 shutdown_connections 2024-07-26T08:28:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:54.903+0000 7fd048a00640 1 -- 172.21.15.43:0/837590649 wait complete. 2024-07-26T08:28:54.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:54 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/837590649' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T08:28:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:54 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T08:28:55.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:54 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/837590649' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T08:28:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:54 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T08:28:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:54 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/837590649' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T08:28:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:54 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T08:28:55.730 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-07-26T08:28:55.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-07-26T08:28:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:55 smithi043 ceph-mon[32384]: pgmap v356: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:55 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-26T08:28:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:55 smithi043 ceph-mon[32384]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:28:56.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:55 smithi133 ceph-mon[37053]: pgmap v356: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:56.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:55 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-26T08:28:56.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:55 smithi133 ceph-mon[37053]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:28:56.249 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:28:56.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:55 smithi063 ceph-mon[36747]: pgmap v356: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:55 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-26T08:28:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:55 smithi063 ceph-mon[36747]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-07-26T08:28:58.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:57 smithi043 ceph-mon[32384]: pgmap v357: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:58.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:57 smithi133 ceph-mon[37053]: pgmap v357: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:58.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:57 smithi063 ceph-mon[36747]: pgmap v357: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 -- 172.21.15.43:0/952704314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810f330 msgr2=0x7fe0d810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/952704314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810f330 0x7fe0d810f740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009860 tx=0x7fe0c402a340 comp rx=0 tx=0).stop 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 -- 172.21.15.43:0/952704314 shutdown_connections 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/952704314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810f330 0x7fe0d810f740 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/952704314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d810fc80 0x7fe0d81164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/952704314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d81099f0 0x7fe0d8109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 -- 172.21.15.43:0/952704314 >> 172.21.15.43:0/952704314 conn(0x7fe0d8078ff0 msgr2=0x7fe0d8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 -- 172.21.15.43:0/952704314 shutdown_connections 2024-07-26T08:28:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.795+0000 7fe0dcc00640 1 -- 172.21.15.43:0/952704314 wait complete. 2024-07-26T08:28:58.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.797+0000 7fe0dcc00640 1 Processor -- start 2024-07-26T08:28:58.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.797+0000 7fe0dcc00640 1 -- start start 2024-07-26T08:28:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.797+0000 7fe0dcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d81099f0 0x7fe0d81a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0dcc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 0x7fe0d81a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0dcc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810fc80 0x7fe0d81a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0dcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8119a60 con 0x7fe0d81099f0 2024-07-26T08:28:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0dcc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d81198e0 con 0x7fe0d810f330 2024-07-26T08:28:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0dcc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8119be0 con 0x7fe0d810fc80 2024-07-26T08:28:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d81099f0 0x7fe0d81a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 0x7fe0d81a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d81099f0 0x7fe0d81a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59130/0 (socket says 172.21.15.43:59130) 2024-07-26T08:28:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 0x7fe0d81a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:57542/0 (socket says 172.21.15.43:57542) 2024-07-26T08:28:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d7400640 1 -- 172.21.15.43:0/3442279222 learned_addr learned my addr 172.21.15.43:0/3442279222 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d7e00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810fc80 0x7fe0d81a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 -- 172.21.15.43:0/3442279222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810fc80 msgr2=0x7fe0d81a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810fc80 0x7fe0d81a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 -- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d81099f0 msgr2=0x7fe0d81a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d81099f0 0x7fe0d81a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.798+0000 7fe0d6a00640 1 -- 172.21.15.43:0/3442279222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d81a6400 con 0x7fe0d810f330 2024-07-26T08:28:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.799+0000 7fe0d6a00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 0x7fe0d81a0a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0c402a860 tx=0x7fe0c402aeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.799+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c403f020 con 0x7fe0d810f330 2024-07-26T08:28:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.799+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe0c4033dd0 con 0x7fe0d810f330 2024-07-26T08:28:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.799+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d81a6690 con 0x7fe0d810f330 2024-07-26T08:28:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.799+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4037040 con 0x7fe0d810f330 2024-07-26T08:28:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.799+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81ace50 con 0x7fe0d810f330 2024-07-26T08:28:58.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.801+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d810ac70 con 0x7fe0d810f330 2024-07-26T08:28:58.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.803+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fe0c4042020 con 0x7fe0d810f330 2024-07-26T08:28:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.805+0000 7fe0cfe00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0bc0b3ca0 0x7fe0bc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:28:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.805+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7fe0c41041f0 con 0x7fe0d810f330 2024-07-26T08:28:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.805+0000 7fe0d7400640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0bc0b3ca0 0x7fe0bc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:28:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.806+0000 7fe0d7400640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0bc0b3ca0 0x7fe0bc0b61b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80095f0 tx=0x7fe0c8005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:28:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:58.806+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe0c4049020 con 0x7fe0d810f330 2024-07-26T08:28:59.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.049+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fe0d8111a50 con 0x7fe0d810f330 2024-07-26T08:28:59.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.603+0000 7fe0cfe00640 1 -- 172.21.15.43:0/3442279222 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fe0c40cb430 con 0x7fe0d810f330 2024-07-26T08:28:59.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.608+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0bc0b3ca0 msgr2=0x7fe0bc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:59.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.608+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0bc0b3ca0 0x7fe0bc0b61b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80095f0 tx=0x7fe0c8005f90 comp rx=0 tx=0).stop 2024-07-26T08:28:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.608+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 msgr2=0x7fe0d81a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:28:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.608+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 0x7fe0d81a0a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0c402a860 tx=0x7fe0c402aeb0 comp rx=0 tx=0).stop 2024-07-26T08:28:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.609+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 shutdown_connections 2024-07-26T08:28:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.609+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0bc0b3ca0 0x7fe0bc0b61b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.609+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0d810fc80 0x7fe0d81a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.609+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d810f330 0x7fe0d81a0a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.609+0000 7fe0dcc00640 1 --2- 172.21.15.43:0/3442279222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0d81099f0 0x7fe0d81a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:28:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.609+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 >> 172.21.15.43:0/3442279222 conn(0x7fe0d8078ff0 msgr2=0x7fe0d810b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:28:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.612+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 shutdown_connections 2024-07-26T08:28:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:28:59.612+0000 7fe0dcc00640 1 -- 172.21.15.43:0/3442279222 wait complete. 2024-07-26T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: pgmap v358: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3442279222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-07-26T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-07-26T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-07-26T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-07-26T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-07-26T08:29:00.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: fsmap cephfs:2 {0=a=up:active,1=b=up:creating} 10 up:standby 2024-07-26T08:29:00.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:28:59 smithi043 ceph-mon[32384]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:29:00.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: pgmap v358: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3442279222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: fsmap cephfs:2 {0=a=up:active,1=b=up:creating} 10 up:standby 2024-07-26T08:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:28:59 smithi133 ceph-mon[37053]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: pgmap v358: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3442279222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: fsmap cephfs:2 {0=a=up:active,1=b=up:creating} 10 up:standby 2024-07-26T08:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:28:59 smithi063 ceph-mon[36747]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:29:00.631 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-07-26T08:29:01.118 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:01.983 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:29:01.735+0000 7f9181a00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:29:01.983 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:29:01.735+0000 7f9181a00640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-07-26T08:29:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] up:active 2024-07-26T08:29:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-07-26T08:29:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-07-26T08:29:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:29:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: fsmap cephfs:2 {0=a=up:active,1=b=up:active} 10 up:standby 2024-07-26T08:29:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:creating} 9 up:standby 2024-07-26T08:29:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T08:29:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:01 smithi043 ceph-mon[32384]: pgmap v359: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-07-26T08:29:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] up:active 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: fsmap cephfs:2 {0=a=up:active,1=b=up:active} 10 up:standby 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:creating} 9 up:standby 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T08:29:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:01 smithi133 ceph-mon[37053]: pgmap v359: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-07-26T08:29:02.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] up:active 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: fsmap cephfs:2 {0=a=up:active,1=b=up:active} 10 up:standby 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:creating} 9 up:standby 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T08:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:01 smithi063 ceph-mon[36747]: pgmap v359: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-07-26T08:29:02.977 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:02 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:active 2024-07-26T08:29:02.977 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:02 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 9 up:standby 2024-07-26T08:29:03.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:02 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:active 2024-07-26T08:29:03.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:02 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 9 up:standby 2024-07-26T08:29:03.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:02 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:active 2024-07-26T08:29:03.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:02 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 9 up:standby 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 -- 172.21.15.43:0/4132335997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 msgr2=0x7f81f8077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 --2- 172.21.15.43:0/4132335997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 0x7f81f8077780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009900 tx=0x7f81e802a410 comp rx=0 tx=0).stop 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 -- 172.21.15.43:0/4132335997 shutdown_connections 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 --2- 172.21.15.43:0/4132335997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 0x7f81f8113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 --2- 172.21.15.43:0/4132335997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f8116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 --2- 172.21.15.43:0/4132335997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 0x7f81f8077780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 -- 172.21.15.43:0/4132335997 >> 172.21.15.43:0/4132335997 conn(0x7f81f8101240 msgr2=0x7f81f8103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 -- 172.21.15.43:0/4132335997 shutdown_connections 2024-07-26T08:29:03.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.546+0000 7f81fcc00640 1 -- 172.21.15.43:0/4132335997 wait complete. 2024-07-26T08:29:03.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.547+0000 7f81fcc00640 1 Processor -- start 2024-07-26T08:29:03.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 -- start start 2024-07-26T08:29:03.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 0x7f81f81a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:03.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 0x7f81f81a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:03.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f81a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:03.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8119c30 con 0x7f81f8077370 2024-07-26T08:29:03.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8119ab0 con 0x7f81f8114170 2024-07-26T08:29:03.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.548+0000 7f81fcc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8119db0 con 0x7f81f8077cc0 2024-07-26T08:29:03.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f81a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:03.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 0x7f81f81a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:03.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 0x7f81f81a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:03.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f81a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:57560/0 (socket says 172.21.15.43:57560) 2024-07-26T08:29:03.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 -- 172.21.15.43:0/305117930 learned_addr learned my addr 172.21.15.43:0/305117930 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:03.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 0x7f81f81a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:54080/0 (socket says 172.21.15.43:54080) 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 -- 172.21.15.43:0/305117930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 msgr2=0x7f81f81a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 0x7f81f81a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 -- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 msgr2=0x7f81f81a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 0x7f81f81a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 -- 172.21.15.43:0/305117930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f81a6570 con 0x7f81f8114170 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.549+0000 7f81f6800640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f81a5e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81f000e9b0 tx=0x7f81f000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.550+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000cd80 con 0x7f81f8114170 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.550+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81f00035f0 con 0x7f81f8114170 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.550+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f81a6860 con 0x7f81f8114170 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.550+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0010690 con 0x7f81f8114170 2024-07-26T08:29:03.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.550+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f81acfc0 con 0x7f81f8114170 2024-07-26T08:29:03.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.551+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f8077780 con 0x7f81f8114170 2024-07-26T08:29:03.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.554+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f81f00037a0 con 0x7f81f8114170 2024-07-26T08:29:03.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.555+0000 7f81eea00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81dc0b3c20 0x7f81dc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:03.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.555+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f81f00e44a0 con 0x7f81f8114170 2024-07-26T08:29:03.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.556+0000 7f81f5e00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81dc0b3c20 0x7f81dc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:03.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.557+0000 7f81f5e00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81dc0b3c20 0x7f81dc0b6130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009230 tx=0x7f81e80058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:03.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.557+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f81f00ab6c0 con 0x7f81f8114170 2024-07-26T08:29:03.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:03.809+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f81f81a1730 con 0x7f81f8114170 2024-07-26T08:29:03.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:03 smithi043 ceph-mon[32384]: pgmap v360: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 596 B/s wr, 3 op/s 2024-07-26T08:29:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:03 smithi133 ceph-mon[37053]: pgmap v360: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 596 B/s wr, 3 op/s 2024-07-26T08:29:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:03 smithi063 ceph-mon[36747]: pgmap v360: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 596 B/s wr, 3 op/s 2024-07-26T08:29:04.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.610+0000 7f81eea00640 1 -- 172.21.15.43:0/305117930 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f81f81a1730 con 0x7f81f8114170 2024-07-26T08:29:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.614+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81dc0b3c20 msgr2=0x7f81dc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.614+0000 7f81fcc00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81dc0b3c20 0x7f81dc0b6130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009230 tx=0x7f81e80058d0 comp rx=0 tx=0).stop 2024-07-26T08:29:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.614+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 msgr2=0x7f81f81a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.614+0000 7f81fcc00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f81a5e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81f000e9b0 tx=0x7f81f000ee70 comp rx=0 tx=0).stop 2024-07-26T08:29:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 shutdown_connections 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81dc0b3c20 0x7f81dc0b6130 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81f8077cc0 0x7f81f81a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81f8114170 0x7f81f81a5e40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 --2- 172.21.15.43:0/305117930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f8077370 0x7f81f81a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 >> 172.21.15.43:0/305117930 conn(0x7f81f8101240 msgr2=0x7f81f8116230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 shutdown_connections 2024-07-26T08:29:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:04.615+0000 7f81fcc00640 1 -- 172.21.15.43:0/305117930 wait complete. 2024-07-26T08:29:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:04 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/305117930' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T08:29:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:04 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T08:29:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:04 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-26T08:29:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:04 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:29:05.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/305117930' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T08:29:05.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:04 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T08:29:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:04 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-26T08:29:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:04 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:29:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:04 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/305117930' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T08:29:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:04 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T08:29:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:04 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-26T08:29:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:04 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:29:05.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-07-26T08:29:05.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:05 smithi043 ceph-mon[32384]: pgmap v361: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-07-26T08:29:05.981 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:05 smithi133 ceph-mon[37053]: pgmap v361: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-07-26T08:29:06.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:05 smithi063 ceph-mon[36747]: pgmap v361: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-07-26T08:29:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:07 smithi063 ceph-mon[36747]: pgmap v362: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-07-26T08:29:08.125 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:07 smithi043 ceph-mon[32384]: pgmap v362: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-07-26T08:29:08.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:07 smithi133 ceph-mon[37053]: pgmap v362: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-07-26T08:29:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 -- 172.21.15.43:0/686915347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 msgr2=0x7f43dc077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 --2- 172.21.15.43:0/686915347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc077780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009900 tx=0x7f43cc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 -- 172.21.15.43:0/686915347 shutdown_connections 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 --2- 172.21.15.43:0/686915347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc114170 0x7f43dc116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 --2- 172.21.15.43:0/686915347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc077cc0 0x7f43dc113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 --2- 172.21.15.43:0/686915347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc077780 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.340+0000 7f43e2600640 1 -- 172.21.15.43:0/686915347 >> 172.21.15.43:0/686915347 conn(0x7f43dc101240 msgr2=0x7f43dc103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.341+0000 7f43e2600640 1 -- 172.21.15.43:0/686915347 shutdown_connections 2024-07-26T08:29:08.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.341+0000 7f43e2600640 1 -- 172.21.15.43:0/686915347 wait complete. 2024-07-26T08:29:08.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.342+0000 7f43e2600640 1 Processor -- start 2024-07-26T08:29:08.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.342+0000 7f43e2600640 1 -- start start 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43e2600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43e2600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc077cc0 0x7f43dc1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43e2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc114170 0x7f43dc1a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43e2600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc119c30 con 0x7f43dc077cc0 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43e2600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc119ab0 con 0x7f43dc114170 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43e2600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc119db0 con 0x7f43dc077370 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43db400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.343+0000 7f43d2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc077cc0 0x7f43dc1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc1a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35012/0 (socket says 172.21.15.43:35012) 2024-07-26T08:29:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 -- 172.21.15.43:0/3391816017 learned_addr learned my addr 172.21.15.43:0/3391816017 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43dbe00640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc114170 0x7f43dc1a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 -- 172.21.15.43:0/3391816017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc114170 msgr2=0x7f43dc1a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc114170 0x7f43dc1a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 -- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc077cc0 msgr2=0x7f43dc1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc077cc0 0x7f43dc1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 -- 172.21.15.43:0/3391816017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1a6590 con 0x7f43dc077370 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43dbe00640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc114170 0x7f43dc1a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:29:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.344+0000 7f43db400640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc1a0620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f43cc005ab0 tx=0x7f43cc0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.345+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc03f030 con 0x7f43dc077370 2024-07-26T08:29:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.345+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f43cc003ac0 con 0x7f43dc077370 2024-07-26T08:29:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.345+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc035070 con 0x7f43dc077370 2024-07-26T08:29:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.345+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1a6820 con 0x7f43dc077370 2024-07-26T08:29:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.345+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1acfe0 con 0x7f43dc077370 2024-07-26T08:29:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.346+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc078880 con 0x7f43dc077370 2024-07-26T08:29:08.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.349+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f43cc042030 con 0x7f43dc077370 2024-07-26T08:29:08.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.350+0000 7f43d8c00640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f43c00b3c20 0x7f43c00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:08.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.351+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f43cc104ab0 con 0x7f43dc077370 2024-07-26T08:29:08.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.351+0000 7f43d2a00640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f43c00b3c20 0x7f43c00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:08.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.352+0000 7f43d2a00640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f43c00b3c20 0x7f43c00b6130 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f43dc079c80 tx=0x7f43c4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:08.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.352+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f43cc0cbc70 con 0x7f43dc077370 2024-07-26T08:29:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.610+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f43dc10f360 con 0x7f43dc077370 2024-07-26T08:29:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.785+0000 7f43d8c00640 1 -- 172.21.15.43:0/3391816017 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f43cc0cb570 con 0x7f43dc077370 2024-07-26T08:29:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f43c00b3c20 msgr2=0x7f43c00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f43c00b3c20 0x7f43c00b6130 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f43dc079c80 tx=0x7f43c4005f90 comp rx=0 tx=0).stop 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 msgr2=0x7f43dc1a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc1a0620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f43cc005ab0 tx=0x7f43cc0040c0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 shutdown_connections 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f43c00b3c20 0x7f43c00b6130 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43dc114170 0x7f43dc1a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc077cc0 0x7f43dc1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 --2- 172.21.15.43:0/3391816017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43dc077370 0x7f43dc1a0620 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.789+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 >> 172.21.15.43:0/3391816017 conn(0x7f43dc101240 msgr2=0x7f43dc1161c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.790+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 shutdown_connections 2024-07-26T08:29:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:08.790+0000 7f43e2600640 1 -- 172.21.15.43:0/3391816017 wait complete. 2024-07-26T08:29:08.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:08 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3391816017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T08:29:08.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:08 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T08:29:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:08 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3391816017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T08:29:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:08 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T08:29:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:08 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3391816017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T08:29:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:08 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T08:29:09.755 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-07-26T08:29:09.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-07-26T08:29:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:09 smithi043 ceph-mon[32384]: pgmap v363: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-07-26T08:29:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:09 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-26T08:29:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:09 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:29:10.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:09 smithi063 ceph-mon[36747]: pgmap v363: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-07-26T08:29:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:09 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-26T08:29:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:09 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:29:10.232 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:10.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:09 smithi133 ceph-mon[37053]: pgmap v363: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-07-26T08:29:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:09 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-26T08:29:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:09 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:29:11.904 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:11 smithi043 ceph-mon[32384]: pgmap v364: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-07-26T08:29:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:11 smithi063 ceph-mon[36747]: pgmap v364: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-07-26T08:29:12.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:11 smithi133 ceph-mon[37053]: pgmap v364: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-07-26T08:29:12.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 -- 172.21.15.43:0/1617829158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d0075b30 msgr2=0x7f39d010f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 --2- 172.21.15.43:0/1617829158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d0075b30 0x7f39d010f5b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009900 tx=0x7f39bc02a400 comp rx=0 tx=0).stop 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 -- 172.21.15.43:0/1617829158 shutdown_connections 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 --2- 172.21.15.43:0/1617829158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d010faf0 0x7f39d0111f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 --2- 172.21.15.43:0/1617829158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d0075b30 0x7f39d010f5b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 --2- 172.21.15.43:0/1617829158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d00751e0 0x7f39d00755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 -- 172.21.15.43:0/1617829158 >> 172.21.15.43:0/1617829158 conn(0x7f39d007b280 msgr2=0x7f39d007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.501+0000 7f39d5200640 1 -- 172.21.15.43:0/1617829158 shutdown_connections 2024-07-26T08:29:12.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.502+0000 7f39d5200640 1 -- 172.21.15.43:0/1617829158 wait complete. 2024-07-26T08:29:12.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 Processor -- start 2024-07-26T08:29:12.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 -- start start 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 0x7f39d019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d0075b30 0x7f39d019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d010faf0 0x7f39d01a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01157a0 con 0x7f39d00751e0 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0115620 con 0x7f39d0075b30 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.503+0000 7f39d5200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0115920 con 0x7f39d010faf0 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 0x7f39d019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 0x7f39d019c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43184/0 (socket says 172.21.15.43:43184) 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 -- 172.21.15.43:0/2970281631 learned_addr learned my addr 172.21.15.43:0/2970281631 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:12.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cd400640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d0075b30 0x7f39d019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39ce800640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d010faf0 0x7f39d01a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 -- 172.21.15.43:0/2970281631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d010faf0 msgr2=0x7f39d01a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d010faf0 0x7f39d01a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 -- 172.21.15.43:0/2970281631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d0075b30 msgr2=0x7f39d019c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d0075b30 0x7f39d019c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cde00640 1 -- 172.21.15.43:0/2970281631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d01a2100 con 0x7f39d00751e0 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.504+0000 7f39cd400640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d0075b30 0x7f39d019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.505+0000 7f39cde00640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 0x7f39d019c190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39c000ea60 tx=0x7f39c000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.505+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c000cd20 con 0x7f39d00751e0 2024-07-26T08:29:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.505+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f39c00035f0 con 0x7f39d00751e0 2024-07-26T08:29:12.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.505+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d01a23f0 con 0x7f39d00751e0 2024-07-26T08:29:12.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.505+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0010690 con 0x7f39d00751e0 2024-07-26T08:29:12.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.505+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d01a8b50 con 0x7f39d00751e0 2024-07-26T08:29:12.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.506+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d00755f0 con 0x7f39d00751e0 2024-07-26T08:29:12.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.509+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f39c00037a0 con 0x7f39d00751e0 2024-07-26T08:29:12.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.511+0000 7f39c6a00640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f39b40b3c20 0x7f39b40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:12.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.511+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f39c00e4470 con 0x7f39d00751e0 2024-07-26T08:29:12.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.511+0000 7f39cd400640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f39b40b3c20 0x7f39b40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:12.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.512+0000 7f39cd400640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f39b40b3c20 0x7f39b40b6130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0314b0 tx=0x7f39bc0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:12.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.513+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f39c00ab6c0 con 0x7f39d00751e0 2024-07-26T08:29:12.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.745+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f39d0102860 con 0x7f39b40b3c20 2024-07-26T08:29:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.782+0000 7f39c6a00640 1 -- 172.21.15.43:0/2970281631 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39d0102860 con 0x7f39b40b3c20 2024-07-26T08:29:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.784+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f39b40b3c20 msgr2=0x7f39b40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.784+0000 7f39d5200640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f39b40b3c20 0x7f39b40b6130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0314b0 tx=0x7f39bc0058d0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.784+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 msgr2=0x7f39d019c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.784+0000 7f39d5200640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 0x7f39d019c190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39c000ea60 tx=0x7f39c000ee60 comp rx=0 tx=0).stop 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 shutdown_connections 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f39b40b3c20 0x7f39b40b6130 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d010faf0 0x7f39d01a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39d0075b30 0x7f39d019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 --2- 172.21.15.43:0/2970281631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39d00751e0 0x7f39d019c190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 >> 172.21.15.43:0/2970281631 conn(0x7f39d007b280 msgr2=0x7f39d0101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 shutdown_connections 2024-07-26T08:29:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:12.785+0000 7f39d5200640 1 -- 172.21.15.43:0/2970281631 wait complete. 2024-07-26T08:29:13.193 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:29:12 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:29:12.757+0000 7fb4df800640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:29:13.193 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:29:12 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:29:12.757+0000 7fb4df800640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:29:13.193 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:29:12 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:29:12.757+0000 7fb4df800640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:29:13.193 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:29:12 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:29:12.757+0000 7fb4df800640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:29:13.193 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:29:12 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:29:12.757+0000 7fb4df800640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:29:13.825 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-07-26T08:29:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:13 smithi043 ceph-mon[32384]: pgmap v365: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-07-26T08:29:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:13 smithi043 ceph-mon[32384]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:14.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:13 smithi133 ceph-mon[37053]: pgmap v365: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-07-26T08:29:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:13 smithi133 ceph-mon[37053]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:14.314 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:14.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:13 smithi063 ceph-mon[36747]: pgmap v365: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-07-26T08:29:14.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:13 smithi063 ceph-mon[36747]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:14.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:14 smithi043 ceph-mon[32384]: mgrmap e21: x(active, since 9m), standbys: z, y 2024-07-26T08:29:15.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:14 smithi063 ceph-mon[36747]: mgrmap e21: x(active, since 9m), standbys: z, y 2024-07-26T08:29:15.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:14 smithi133 ceph-mon[37053]: mgrmap e21: x(active, since 9m), standbys: z, y 2024-07-26T08:29:15.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:15 smithi043 ceph-mon[32384]: pgmap v366: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-07-26T08:29:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:15 smithi133 ceph-mon[37053]: pgmap v366: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-07-26T08:29:16.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:15 smithi063 ceph-mon[36747]: pgmap v366: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-07-26T08:29:16.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.701+0000 7fb39f200640 1 -- 172.21.15.43:0/709546265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 msgr2=0x7fb3a01164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:16.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.701+0000 7fb39f200640 1 --2- 172.21.15.43:0/709546265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01164b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb398009ca0 tx=0x7fb39802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:29:16.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.701+0000 7fb39f200640 1 -- 172.21.15.43:0/709546265 shutdown_connections 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.702+0000 7fb39f200640 1 --2- 172.21.15.43:0/709546265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01164b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.702+0000 7fb39f200640 1 --2- 172.21.15.43:0/709546265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a010f330 0x7fb3a010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.702+0000 7fb39f200640 1 --2- 172.21.15.43:0/709546265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a01099f0 0x7fb3a0109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.702+0000 7fb39f200640 1 -- 172.21.15.43:0/709546265 >> 172.21.15.43:0/709546265 conn(0x7fb3a0078ff0 msgr2=0x7fb3a0107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.702+0000 7fb39f200640 1 -- 172.21.15.43:0/709546265 shutdown_connections 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.702+0000 7fb39f200640 1 -- 172.21.15.43:0/709546265 wait complete. 2024-07-26T08:29:16.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.703+0000 7fb39f200640 1 Processor -- start 2024-07-26T08:29:16.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.703+0000 7fb39f200640 1 -- start start 2024-07-26T08:29:16.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 0x7fb3a01a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:16.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a010f330 0x7fb3a01a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:16.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:16.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0119a60 con 0x7fb3a01099f0 2024-07-26T08:29:16.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01198e0 con 0x7fb3a010fc80 2024-07-26T08:29:16.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0119be0 con 0x7fb3a010f330 2024-07-26T08:29:16.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 0x7fb3a01a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:16.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 0x7fb3a01a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39040/0 (socket says 172.21.15.43:39040) 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.704+0000 7fb39de00640 1 -- 172.21.15.43:0/480111880 learned_addr learned my addr 172.21.15.43:0/480111880 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39d400640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a010f330 0x7fb3a01a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39e800640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39de00640 1 -- 172.21.15.43:0/480111880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a010f330 msgr2=0x7fb3a01a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39de00640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a010f330 0x7fb3a01a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39de00640 1 -- 172.21.15.43:0/480111880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 msgr2=0x7fb3a01a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39de00640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39de00640 1 -- 172.21.15.43:0/480111880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01a6380 con 0x7fb3a01099f0 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39d400640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a010f330 0x7fb3a01a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.705+0000 7fb39e800640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.706+0000 7fb39de00640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 0x7fb3a01a0410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb39000e9f0 tx=0x7fb39000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:16.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.706+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39000cd80 con 0x7fb3a01099f0 2024-07-26T08:29:16.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.706+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a01a6670 con 0x7fb3a01099f0 2024-07-26T08:29:16.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.706+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb390010900 con 0x7fb3a01099f0 2024-07-26T08:29:16.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.706+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3900188d0 con 0x7fb3a01099f0 2024-07-26T08:29:16.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.706+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01acdd0 con 0x7fb3a01099f0 2024-07-26T08:29:16.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.707+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a0109e00 con 0x7fb3a01099f0 2024-07-26T08:29:16.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.710+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fb390010ab0 con 0x7fb3a01099f0 2024-07-26T08:29:16.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.713+0000 7fb396a00640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3840b3cb0 0x7fb3840b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:16.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.713+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7fb3900e4a50 con 0x7fb3a01099f0 2024-07-26T08:29:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.713+0000 7fb39d400640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3840b3cb0 0x7fb3840b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.714+0000 7fb39d400640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3840b3cb0 0x7fb3840b61c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3a010fab0 tx=0x7fb38c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:16.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.716+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb3900ab460 con 0x7fb3a01099f0 2024-07-26T08:29:16.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:16.953+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb3a0063230 con 0x7fb3840b3cb0 2024-07-26T08:29:17.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.009+0000 7fb396a00640 1 -- 172.21.15.43:0/480111880 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3a0063230 con 0x7fb3840b3cb0 2024-07-26T08:29:17.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3840b3cb0 msgr2=0x7fb3840b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3840b3cb0 0x7fb3840b61c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3a010fab0 tx=0x7fb38c005f90 comp rx=0 tx=0).stop 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 msgr2=0x7fb3a01a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 0x7fb3a01a0410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb39000e9f0 tx=0x7fb39000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 shutdown_connections 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3840b3cb0 0x7fb3840b61c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a010f330 0x7fb3a01a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a010fc80 0x7fb3a01a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 --2- 172.21.15.43:0/480111880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a01099f0 0x7fb3a01a0410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:17.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.013+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 >> 172.21.15.43:0/480111880 conn(0x7fb3a0078ff0 msgr2=0x7fb3a0079650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:17.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.014+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 shutdown_connections 2024-07-26T08:29:17.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:17.014+0000 7fb39f200640 1 -- 172.21.15.43:0/480111880 wait complete. 2024-07-26T08:29:17.936 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-07-26T08:29:18.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:17 smithi043 ceph-mon[32384]: pgmap v367: 129 pgs: 129 active+clean; 590 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 852 B/s wr, 7 op/s 2024-07-26T08:29:18.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:17 smithi043 ceph-mon[32384]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:17 smithi133 ceph-mon[37053]: pgmap v367: 129 pgs: 129 active+clean; 590 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 852 B/s wr, 7 op/s 2024-07-26T08:29:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:17 smithi133 ceph-mon[37053]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:17 smithi063 ceph-mon[36747]: pgmap v367: 129 pgs: 129 active+clean; 590 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 852 B/s wr, 7 op/s 2024-07-26T08:29:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:17 smithi063 ceph-mon[36747]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:18.421 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:20.145 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:19 smithi043 ceph-mon[32384]: pgmap v368: 129 pgs: 129 active+clean; 590 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-07-26T08:29:20.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:19 smithi133 ceph-mon[37053]: pgmap v368: 129 pgs: 129 active+clean; 590 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-07-26T08:29:20.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:19 smithi063 ceph-mon[36747]: pgmap v368: 129 pgs: 129 active+clean; 590 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-07-26T08:29:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 -- 172.21.15.43:0/1226424950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410fc80 msgr2=0x7f4aa41164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 --2- 172.21.15.43:0/1226424950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410fc80 0x7f4aa41164b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009be0 tx=0x7f4a9c02a6d0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 -- 172.21.15.43:0/1226424950 shutdown_connections 2024-07-26T08:29:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 --2- 172.21.15.43:0/1226424950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa410f330 0x7f4aa410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 --2- 172.21.15.43:0/1226424950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410fc80 0x7f4aa41164b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 --2- 172.21.15.43:0/1226424950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa41099f0 0x7f4aa4109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 -- 172.21.15.43:0/1226424950 >> 172.21.15.43:0/1226424950 conn(0x7f4aa4078ff0 msgr2=0x7f4aa4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 -- 172.21.15.43:0/1226424950 shutdown_connections 2024-07-26T08:29:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.697+0000 7f4aa3200640 1 -- 172.21.15.43:0/1226424950 wait complete. 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 Processor -- start 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 -- start start 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa41099f0 0x7f4aa41a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 0x7f4aa41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa410fc80 0x7f4aa41a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4119a60 con 0x7f4aa410fc80 2024-07-26T08:29:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41198e0 con 0x7f4aa410f330 2024-07-26T08:29:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.699+0000 7f4aa3200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4119be0 con 0x7f4aa41099f0 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 0x7f4aa41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa41099f0 0x7f4aa41a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 0x7f4aa41a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:54762/0 (socket says 172.21.15.43:54762) 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 -- 172.21.15.43:0/3634250179 learned_addr learned my addr 172.21.15.43:0/3634250179 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa2800640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa410fc80 0x7f4aa41a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 -- 172.21.15.43:0/3634250179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa41099f0 msgr2=0x7f4aa41a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa41099f0 0x7f4aa41a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 -- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa410fc80 msgr2=0x7f4aa41a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa410fc80 0x7f4aa41a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1400640 1 -- 172.21.15.43:0/3634250179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa41a62e0 con 0x7f4aa410f330 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.700+0000 7f4aa1e00640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa41099f0 0x7f4aa41a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.701+0000 7f4aa1400640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 0x7f4aa41a0910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000e970 tx=0x7f4a9000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.701+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9000cd80 con 0x7f4aa410f330 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.701+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a900035f0 con 0x7f4aa410f330 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.701+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa41a65d0 con 0x7f4aa410f330 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.701+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90010690 con 0x7f4aa410f330 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.701+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa41acd30 con 0x7f4aa410f330 2024-07-26T08:29:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.702+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa4109e00 con 0x7f4aa410f330 2024-07-26T08:29:20.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.706+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f4a900037a0 con 0x7f4aa410f330 2024-07-26T08:29:20.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.707+0000 7f4a9aa00640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4a880b3cb0 0x7f4a880b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:20.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.707+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f4a900e4490 con 0x7f4aa410f330 2024-07-26T08:29:20.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.708+0000 7f4aa1e00640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4a880b3cb0 0x7f4a880b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:20.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.708+0000 7f4aa1e00640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4a880b3cb0 0x7f4a880b61c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a940096c0 tx=0x7f4a94009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:20.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.712+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f4a900ab550 con 0x7f4aa410f330 2024-07-26T08:29:20.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.944+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f4aa4063230 con 0x7f4a880b3cb0 2024-07-26T08:29:20.956 INFO:teuthology.orchestra.run.smithi043.stdout:/volumes/qa/sv_0/bbb129d3-c77d-4dcf-b188-6417d5f7f715 2024-07-26T08:29:20.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.955+0000 7f4a9aa00640 1 -- 172.21.15.43:0/3634250179 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4aa4063230 con 0x7f4a880b3cb0 2024-07-26T08:29:20.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4a880b3cb0 msgr2=0x7f4a880b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4a880b3cb0 0x7f4a880b61c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a940096c0 tx=0x7f4a94009260 comp rx=0 tx=0).stop 2024-07-26T08:29:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 msgr2=0x7f4aa41a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 0x7f4aa41a0910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000e970 tx=0x7f4a9000ee30 comp rx=0 tx=0).stop 2024-07-26T08:29:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 shutdown_connections 2024-07-26T08:29:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4a880b3cb0 0x7f4a880b61c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa410fc80 0x7f4aa41a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4aa410f330 0x7f4aa41a0910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 --2- 172.21.15.43:0/3634250179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa41099f0 0x7f4aa41a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.957+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 >> 172.21.15.43:0/3634250179 conn(0x7f4aa4078ff0 msgr2=0x7f4aa410c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.958+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 shutdown_connections 2024-07-26T08:29:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:20.958+0000 7f4aa3200640 1 -- 172.21.15.43:0/3634250179 wait complete. 2024-07-26T08:29:21.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-07-26T08:29:22.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:21 smithi043 ceph-mon[32384]: pgmap v369: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-07-26T08:29:22.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:21 smithi043 ceph-mon[32384]: from='client.24896 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:21 smithi133 ceph-mon[37053]: pgmap v369: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-07-26T08:29:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:21 smithi133 ceph-mon[37053]: from='client.24896 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:22.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:21 smithi063 ceph-mon[36747]: pgmap v369: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-07-26T08:29:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:21 smithi063 ceph-mon[36747]: from='client.24896 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:22.329 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:24.222 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:23 smithi043 ceph-mon[32384]: pgmap v370: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-07-26T08:29:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:23 smithi133 ceph-mon[37053]: pgmap v370: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-07-26T08:29:24.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:23 smithi063 ceph-mon[36747]: pgmap v370: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-07-26T08:29:24.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 -- 172.21.15.43:0/4119968498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c10d630 msgr2=0x7f107c10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:24.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 --2- 172.21.15.43:0/4119968498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c10d630 0x7f107c10fb40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1074009900 tx=0x7f107402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 -- 172.21.15.43:0/4119968498 shutdown_connections 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 --2- 172.21.15.43:0/4119968498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c104ab0 0x7f107c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 --2- 172.21.15.43:0/4119968498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c10d630 0x7f107c10fb40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 --2- 172.21.15.43:0/4119968498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 -- 172.21.15.43:0/4119968498 >> 172.21.15.43:0/4119968498 conn(0x7f107c0fdcf0 msgr2=0x7f107c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 -- 172.21.15.43:0/4119968498 shutdown_connections 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.762+0000 7f1082200640 1 -- 172.21.15.43:0/4119968498 wait complete. 2024-07-26T08:29:24.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.764+0000 7f1082200640 1 Processor -- start 2024-07-26T08:29:24.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.764+0000 7f1082200640 1 -- start start 2024-07-26T08:29:24.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.765+0000 7f1082200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:24.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.765+0000 7f1082200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c104ab0 0x7f107c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:24.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.765+0000 7f1082200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c10d630 0x7f107c1a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:24.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.765+0000 7f1082200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f107c1133f0 con 0x7f107c104ab0 2024-07-26T08:29:24.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.765+0000 7f1082200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f107c113270 con 0x7f107c104080 2024-07-26T08:29:24.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.765+0000 7f1082200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f107c113570 con 0x7f107c10d630 2024-07-26T08:29:24.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f107be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c104ab0 0x7f107c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:54776/0 (socket says 172.21.15.43:54776) 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 -- 172.21.15.43:0/615666539 learned_addr learned my addr 172.21.15.43:0/615666539 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1081800640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c10d630 0x7f107c1a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 -- 172.21.15.43:0/615666539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c10d630 msgr2=0x7f107c1a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c10d630 0x7f107c1a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 -- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c104ab0 msgr2=0x7f107c19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c104ab0 0x7f107c19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 -- 172.21.15.43:0/615666539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c1a1ed0 con 0x7f107c104080 2024-07-26T08:29:24.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.766+0000 7f1080e00640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c19bf60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f106400ea60 tx=0x7f106400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:24.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.767+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106400cde0 con 0x7f107c104080 2024-07-26T08:29:24.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.767+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c1a21c0 con 0x7f107c104080 2024-07-26T08:29:24.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.767+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10640035f0 con 0x7f107c104080 2024-07-26T08:29:24.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.767+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1064010690 con 0x7f107c104080 2024-07-26T08:29:24.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.767+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c1a8920 con 0x7f107c104080 2024-07-26T08:29:24.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.768+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c104490 con 0x7f107c104080 2024-07-26T08:29:24.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.771+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f10640037a0 con 0x7f107c104080 2024-07-26T08:29:24.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.773+0000 7f1079600640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10600b3d30 0x7f10600b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:24.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.774+0000 7f107be00640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10600b3d30 0x7f10600b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:24.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.774+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f10640e4580 con 0x7f107c104080 2024-07-26T08:29:24.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.774+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f10640ab5e0 con 0x7f107c104080 2024-07-26T08:29:24.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:24.775+0000 7f107be00640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10600b3d30 0x7f10600b6240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f106c0099a0 tx=0x7f106c009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:25.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.010+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f107c10cc70 con 0x7f10600b3d30 2024-07-26T08:29:25.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.057+0000 7f1079600640 1 -- 172.21.15.43:0/615666539 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f107c10cc70 con 0x7f10600b3d30 2024-07-26T08:29:25.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10600b3d30 msgr2=0x7f10600b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:25.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10600b3d30 0x7f10600b6240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f106c0099a0 tx=0x7f106c009500 comp rx=0 tx=0).stop 2024-07-26T08:29:25.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 msgr2=0x7f107c19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:25.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c19bf60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f106400ea60 tx=0x7f106400ef20 comp rx=0 tx=0).stop 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 shutdown_connections 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10600b3d30 0x7f10600b6240 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c10d630 0x7f107c1a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107c104ab0 0x7f107c19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 --2- 172.21.15.43:0/615666539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107c104080 0x7f107c19bf60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 >> 172.21.15.43:0/615666539 conn(0x7f107c0fdcf0 msgr2=0x7f107c10b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 shutdown_connections 2024-07-26T08:29:25.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:25.060+0000 7f1082200640 1 -- 172.21.15.43:0/615666539 wait complete. 2024-07-26T08:29:25.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-07-26T08:29:26.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:25 smithi043 ceph-mon[32384]: pgmap v371: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-07-26T08:29:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:25 smithi043 ceph-mon[32384]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:25 smithi133 ceph-mon[37053]: pgmap v371: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-07-26T08:29:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:25 smithi133 ceph-mon[37053]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:25 smithi063 ceph-mon[36747]: pgmap v371: 129 pgs: 129 active+clean; 604 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-07-26T08:29:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:25 smithi063 ceph-mon[36747]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:26.435 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:28.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:27 smithi043 ceph-mon[32384]: pgmap v372: 129 pgs: 129 active+clean; 624 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-07-26T08:29:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:27 smithi133 ceph-mon[37053]: pgmap v372: 129 pgs: 129 active+clean; 624 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-07-26T08:29:28.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:27 smithi063 ceph-mon[36747]: pgmap v372: 129 pgs: 129 active+clean; 624 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-07-26T08:29:28.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 -- 172.21.15.43:0/3853289380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c06b780 msgr2=0x7f5e8c06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:28.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 --2- 172.21.15.43:0/3853289380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c06b780 0x7f5e8c06bb90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009900 tx=0x7f5e8002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 -- 172.21.15.43:0/3853289380 shutdown_connections 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 --2- 172.21.15.43:0/3853289380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c106650 0x7f5e8c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 --2- 172.21.15.43:0/3853289380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e8c105d00 0x7f5e8c106110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 --2- 172.21.15.43:0/3853289380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c06b780 0x7f5e8c06bb90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.819+0000 7f5e94800640 1 -- 172.21.15.43:0/3853289380 >> 172.21.15.43:0/3853289380 conn(0x7f5e8c0793d0 msgr2=0x7f5e8c0797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.820+0000 7f5e94800640 1 -- 172.21.15.43:0/3853289380 shutdown_connections 2024-07-26T08:29:28.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.820+0000 7f5e94800640 1 -- 172.21.15.43:0/3853289380 wait complete. 2024-07-26T08:29:28.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.821+0000 7f5e94800640 1 Processor -- start 2024-07-26T08:29:28.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.821+0000 7f5e94800640 1 -- start start 2024-07-26T08:29:28.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e94800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 0x7f5e8c19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:28.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e94800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c105d00 0x7f5e8c19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e94800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e8c106650 0x7f5e8c1a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e94800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c113610 con 0x7f5e8c105d00 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e94800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c113490 con 0x7f5e8c106650 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e94800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c113790 con 0x7f5e8c06b780 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e91e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 0x7f5e8c19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e91e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 0x7f5e8c19c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:59188/0 (socket says 172.21.15.43:59188) 2024-07-26T08:29:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e91e00640 1 -- 172.21.15.43:0/1942015306 learned_addr learned my addr 172.21.15.43:0/1942015306 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e92800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e8c106650 0x7f5e8c1a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.822+0000 7f5e91400640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c105d00 0x7f5e8c19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e91e00640 1 -- 172.21.15.43:0/1942015306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e8c106650 msgr2=0x7f5e8c1a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e91e00640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e8c106650 0x7f5e8c1a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e91e00640 1 -- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c105d00 msgr2=0x7f5e8c19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e91e00640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c105d00 0x7f5e8c19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e91e00640 1 -- 172.21.15.43:0/1942015306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8c1a20f0 con 0x7f5e8c06b780 2024-07-26T08:29:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e91e00640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 0x7f5e8c19c180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e80005ab0 tx=0x7f5e800042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:28.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.823+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8003f030 con 0x7f5e8c06b780 2024-07-26T08:29:28.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.824+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8c1a2380 con 0x7f5e8c06b780 2024-07-26T08:29:28.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.824+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5e80003cd0 con 0x7f5e8c06b780 2024-07-26T08:29:28.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.824+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80035070 con 0x7f5e8c06b780 2024-07-26T08:29:28.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.825+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8c1a8b40 con 0x7f5e8c06b780 2024-07-26T08:29:28.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.826+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8c06bb90 con 0x7f5e8c06b780 2024-07-26T08:29:28.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.828+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f5e80042030 con 0x7f5e8c06b780 2024-07-26T08:29:28.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.829+0000 7f5e86a00640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5e740b3cb0 0x7f5e740b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:28.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.829+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f5e80104350 con 0x7f5e8c06b780 2024-07-26T08:29:28.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.830+0000 7f5e91400640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5e740b3cb0 0x7f5e740b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:28.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.831+0000 7f5e91400640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5e740b3cb0 0x7f5e740b61c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c005d00 tx=0x7f5e7c005c50 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:28.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:28.833+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5e800cb3b0 con 0x7f5e8c06b780 2024-07-26T08:29:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.112+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5e8c107e20 con 0x7f5e740b3cb0 2024-07-26T08:29:29.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.120+0000 7f5e86a00640 1 -- 172.21.15.43:0/1942015306 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5e8c107e20 con 0x7f5e740b3cb0 2024-07-26T08:29:29.123 INFO:teuthology.orchestra.run.smithi043.stdout:/volumes/qa/sv_1/ecaa3e14-b303-439b-a131-8be6ab5f3a6e 2024-07-26T08:29:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5e740b3cb0 msgr2=0x7f5e740b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5e740b3cb0 0x7f5e740b61c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c005d00 tx=0x7f5e7c005c50 comp rx=0 tx=0).stop 2024-07-26T08:29:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 msgr2=0x7f5e8c19c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 0x7f5e8c19c180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e80005ab0 tx=0x7f5e800042f0 comp rx=0 tx=0).stop 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 shutdown_connections 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5e740b3cb0 0x7f5e740b61c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e8c106650 0x7f5e8c1a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e8c105d00 0x7f5e8c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 --2- 172.21.15.43:0/1942015306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e8c06b780 0x7f5e8c19c180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 >> 172.21.15.43:0/1942015306 conn(0x7f5e8c0793d0 msgr2=0x7f5e8c107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 shutdown_connections 2024-07-26T08:29:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:29.123+0000 7f5e94800640 1 -- 172.21.15.43:0/1942015306 wait complete. 2024-07-26T08:29:29.146 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:29:29.146 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.146 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.146 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.146 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.190 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:29:29.190 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.190 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.190 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.190 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:29:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:30 smithi043 ceph-mon[32384]: pgmap v373: 129 pgs: 129 active+clean; 624 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-07-26T08:29:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:30 smithi043 ceph-mon[32384]: from='client.24940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:30 smithi063 ceph-mon[36747]: pgmap v373: 129 pgs: 129 active+clean; 624 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-07-26T08:29:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:30 smithi063 ceph-mon[36747]: from='client.24940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:29:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:30 smithi133 ceph-mon[37053]: pgmap v373: 129 pgs: 129 active+clean; 624 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-07-26T08:29:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:30 smithi133 ceph-mon[37053]: from='client.24940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:29:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:31.178 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:32 smithi063 ceph-mon[36747]: pgmap v374: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-07-26T08:29:32.601 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:32 smithi043 ceph-mon[32384]: pgmap v374: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-07-26T08:29:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:32 smithi133 ceph-mon[37053]: pgmap v374: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-07-26T08:29:33.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 -- 172.21.15.43:0/2289323736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 msgr2=0x7f512c10f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:33.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 --2- 172.21.15.43:0/2289323736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c10f400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5114009900 tx=0x7f511402a410 comp rx=0 tx=0).stop 2024-07-26T08:29:33.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 -- 172.21.15.43:0/2289323736 shutdown_connections 2024-07-26T08:29:33.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 --2- 172.21.15.43:0/2289323736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c10f940 0x7f512c111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 --2- 172.21.15.43:0/2289323736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c10f400 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 --2- 172.21.15.43:0/2289323736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f512c0751e0 0x7f512c0755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 -- 172.21.15.43:0/2289323736 >> 172.21.15.43:0/2289323736 conn(0x7f512c0fee70 msgr2=0x7f512c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:33.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.484+0000 7f512be00640 1 -- 172.21.15.43:0/2289323736 shutdown_connections 2024-07-26T08:29:33.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.485+0000 7f512be00640 1 -- 172.21.15.43:0/2289323736 wait complete. 2024-07-26T08:29:33.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.486+0000 7f512be00640 1 Processor -- start 2024-07-26T08:29:33.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.486+0000 7f512be00640 1 -- start start 2024-07-26T08:29:33.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f512c0751e0 0x7f512c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:33.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:33.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c10f940 0x7f512c1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:33.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f512c115610 con 0x7f512c075b30 2024-07-26T08:29:33.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f512c115490 con 0x7f512c0751e0 2024-07-26T08:29:33.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f512c115790 con 0x7f512c10f940 2024-07-26T08:29:33.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f5123e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f512aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f512c0751e0 0x7f512c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f5123e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c19c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48752/0 (socket says 172.21.15.43:48752) 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.487+0000 7f5123e00640 1 -- 172.21.15.43:0/1846363357 learned_addr learned my addr 172.21.15.43:0/1846363357 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.488+0000 7f512b400640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c10f940 0x7f512c1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.488+0000 7f5123e00640 1 -- 172.21.15.43:0/1846363357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c10f940 msgr2=0x7f512c1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.488+0000 7f5123e00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c10f940 0x7f512c1a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.488+0000 7f5123e00640 1 -- 172.21.15.43:0/1846363357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f512c0751e0 msgr2=0x7f512c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.488+0000 7f5123e00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f512c0751e0 0x7f512c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.488+0000 7f5123e00640 1 -- 172.21.15.43:0/1846363357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c1a1f10 con 0x7f512c075b30 2024-07-26T08:29:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.489+0000 7f5123e00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c19c540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5114005940 tx=0x7f51140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:33.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.489+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511403f030 con 0x7f512c075b30 2024-07-26T08:29:33.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.489+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51140318f0 con 0x7f512c075b30 2024-07-26T08:29:33.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.489+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c1a21a0 con 0x7f512c075b30 2024-07-26T08:29:33.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.489+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114035070 con 0x7f512c075b30 2024-07-26T08:29:33.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.489+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c1a8960 con 0x7f512c075b30 2024-07-26T08:29:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.491+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512c0755f0 con 0x7f512c075b30 2024-07-26T08:29:33.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.493+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f5114042030 con 0x7f512c075b30 2024-07-26T08:29:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.495+0000 7f5123400640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51100b3cb0 0x7f51100b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.495+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9307+0+0 (secure 0 0 0) 0x7f51141049d0 con 0x7f512c075b30 2024-07-26T08:29:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.495+0000 7f512aa00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51100b3cb0 0x7f51100b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:33.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.496+0000 7f512aa00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51100b3cb0 0x7f51100b61c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f511c00bbe0 tx=0x7f511c00b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.497+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f51140cb3e0 con 0x7f512c075b30 2024-07-26T08:29:33.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:33.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:33.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.742+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f512c1a8b90 con 0x7f512c075b30 2024-07-26T08:29:33.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.743+0000 7f5123400640 1 -- 172.21.15.43:0/1846363357 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11895 (secure 0 0 0) 0x7f51140cf930 con 0x7f512c075b30 2024-07-26T08:29:33.744 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:29:33.745 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"btime":"2024-07-26T08:29:08:768082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:29:08.612953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24709,24710,24733]},"id":1}]} 2024-07-26T08:29:33.745 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:29:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.745+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51100b3cb0 msgr2=0x7f51100b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:33.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.745+0000 7f512be00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51100b3cb0 0x7f51100b61c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f511c00bbe0 tx=0x7f511c00b390 comp rx=0 tx=0).stop 2024-07-26T08:29:33.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.745+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 msgr2=0x7f512c19c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:33.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.745+0000 7f512be00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c19c540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5114005940 tx=0x7f51140042f0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 shutdown_connections 2024-07-26T08:29:33.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51100b3cb0 0x7f51100b61c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c10f940 0x7f512c1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c075b30 0x7f512c19c540 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 --2- 172.21.15.43:0/1846363357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f512c0751e0 0x7f512c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:33.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 >> 172.21.15.43:0/1846363357 conn(0x7f512c0fee70 msgr2=0x7f512c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:33.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 shutdown_connections 2024-07-26T08:29:33.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:33.746+0000 7f512be00640 1 -- 172.21.15.43:0/1846363357 wait complete. 2024-07-26T08:29:33.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:33.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:33.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:34.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:34 smithi043 ceph-mon[32384]: pgmap v375: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-07-26T08:29:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:29:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:29:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:34 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1846363357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:29:34.639 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:29:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:34 smithi133 ceph-mon[37053]: pgmap v375: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-07-26T08:29:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:29:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:29:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:34 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1846363357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:29:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:34 smithi063 ceph-mon[36747]: pgmap v375: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-07-26T08:29:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:29:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:29:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:29:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:34 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1846363357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:29:35.135 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:35.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T08:29:35.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-07-26T08:29:35.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-26T08:29:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-07-26T08:29:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-26T08:29:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T08:29:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2024-07-26T08:29:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-07-26T08:29:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-07-26T08:29:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-26T08:29:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T08:29:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2024-07-26T08:29:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-07-26T08:29:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-07-26T08:29:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: pgmap v376: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]': finished 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-07-26T08:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:36 smithi043 ceph-mon[32384]: osdmap e89: 12 total, 12 up, 12 in 2024-07-26T08:29:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: pgmap v376: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-07-26T08:29:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-07-26T08:29:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]': finished 2024-07-26T08:29:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-07-26T08:29:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-07-26T08:29:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-07-26T08:29:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:36 smithi133 ceph-mon[37053]: osdmap e89: 12 total, 12 up, 12 in 2024-07-26T08:29:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: pgmap v376: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-07-26T08:29:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-07-26T08:29:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]': finished 2024-07-26T08:29:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-07-26T08:29:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-07-26T08:29:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-07-26T08:29:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:36 smithi063 ceph-mon[36747]: osdmap e89: 12 total, 12 up, 12 in 2024-07-26T08:29:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 -- 172.21.15.43:0/4165929981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba70 msgr2=0x7f23041122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 --2- 172.21.15.43:0/4165929981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba70 0x7f23041122a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009ca0 tx=0x7f22fc02a8b0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 -- 172.21.15.43:0/4165929981 shutdown_connections 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 --2- 172.21.15.43:0/4165929981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230410ba70 0x7f23041122a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 --2- 172.21.15.43:0/4165929981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410b120 0x7f230410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 --2- 172.21.15.43:0/4165929981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23041057e0 0x7f2304105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 -- 172.21.15.43:0/4165929981 >> 172.21.15.43:0/4165929981 conn(0x7f23041011f0 msgr2=0x7f2304103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 -- 172.21.15.43:0/4165929981 shutdown_connections 2024-07-26T08:29:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.524+0000 7f230b000640 1 -- 172.21.15.43:0/4165929981 wait complete. 2024-07-26T08:29:37.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.525+0000 7f230b000640 1 Processor -- start 2024-07-26T08:29:37.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.525+0000 7f230b000640 1 -- start start 2024-07-26T08:29:37.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f230b000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 0x7f230419c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f230b000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f230410b120 0x7f230419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f230b000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410ba70 0x7f23041a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f230b000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2304115860 con 0x7f23041057e0 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f230b000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f23041156e0 con 0x7f230410ba70 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f230b000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23041159e0 con 0x7f230410b120 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f2303e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 0x7f230419c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f2309000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410ba70 0x7f23041a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f2303e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 0x7f230419c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49510/0 (socket says 172.21.15.43:49510) 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f2303e00640 1 -- 172.21.15.43:0/3503831964 learned_addr learned my addr 172.21.15.43:0/3503831964 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:37.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.526+0000 7f2303400640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f230410b120 0x7f230419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:37.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2303e00640 1 -- 172.21.15.43:0/3503831964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f230410b120 msgr2=0x7f230419c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:37.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2303e00640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f230410b120 0x7f230419c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2303e00640 1 -- 172.21.15.43:0/3503831964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410ba70 msgr2=0x7f23041a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:37.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2303e00640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410ba70 0x7f23041a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2303e00640 1 -- 172.21.15.43:0/3503831964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23041a2140 con 0x7f23041057e0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2303e00640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 0x7f230419c1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22f400d950 tx=0x7f22f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4017070 con 0x7f23041057e0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23041a2430 con 0x7f23041057e0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.527+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22f4009c30 con 0x7f23041057e0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.528+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f400f6b0 con 0x7f23041057e0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.528+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041a8b90 con 0x7f23041057e0 2024-07-26T08:29:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.529+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2304105bf0 con 0x7f23041057e0 2024-07-26T08:29:37.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.531+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f22f40109c0 con 0x7f23041057e0 2024-07-26T08:29:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.533+0000 7f2300c00640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22e80b3cb0 0x7f22e80b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.533+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f22f40e3de0 con 0x7f23041057e0 2024-07-26T08:29:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.533+0000 7f2303400640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22e80b3cb0 0x7f22e80b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.534+0000 7f2303400640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22e80b3cb0 0x7f22e80b61c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23041038e0 tx=0x7f22f000b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.535+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f22f4009de0 con 0x7f23041057e0 2024-07-26T08:29:37.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:37 smithi043 ceph-mon[32384]: osdmap e90: 12 total, 12 up, 12 in 2024-07-26T08:29:37.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.740+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f230402e0c0 con 0x7f23041057e0 2024-07-26T08:29:37.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.744+0000 7f2300c00640 1 -- 172.21.15.43:0/3503831964 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7f22f40b30e0 con 0x7f23041057e0 2024-07-26T08:29:37.746 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:29:37.747 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:29:37.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.747+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22e80b3cb0 msgr2=0x7f22e80b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:37.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.747+0000 7f230b000640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22e80b3cb0 0x7f22e80b61c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23041038e0 tx=0x7f22f000b390 comp rx=0 tx=0).stop 2024-07-26T08:29:37.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.747+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 msgr2=0x7f230419c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:37.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.747+0000 7f230b000640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 0x7f230419c1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22f400d950 tx=0x7f22f400de10 comp rx=0 tx=0).stop 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 shutdown_connections 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f22e80b3cb0 0x7f22e80b61c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f230410b120 0x7f230419c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f230410ba70 0x7f23041a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 --2- 172.21.15.43:0/3503831964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23041057e0 0x7f230419c1d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 >> 172.21.15.43:0/3503831964 conn(0x7f23041011f0 msgr2=0x7f230410a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 shutdown_connections 2024-07-26T08:29:37.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:37.748+0000 7f230b000640 1 -- 172.21.15.43:0/3503831964 wait complete. 2024-07-26T08:29:37.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:37 smithi133 ceph-mon[37053]: osdmap e90: 12 total, 12 up, 12 in 2024-07-26T08:29:37.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:37 smithi063 ceph-mon[36747]: osdmap e90: 12 total, 12 up, 12 in 2024-07-26T08:29:38.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:38 smithi043 ceph-mon[32384]: pgmap v379: 129 pgs: 3 peering, 126 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-07-26T08:29:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:38 smithi043 ceph-mon[32384]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-07-26T08:29:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:38 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3503831964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:29:38.627 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-26T08:29:38.627 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph pg dump --format=json 2024-07-26T08:29:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:38 smithi133 ceph-mon[37053]: pgmap v379: 129 pgs: 3 peering, 126 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-07-26T08:29:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:38 smithi133 ceph-mon[37053]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-07-26T08:29:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:38 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3503831964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:29:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:38 smithi063 ceph-mon[36747]: pgmap v379: 129 pgs: 3 peering, 126 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-07-26T08:29:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:38 smithi063 ceph-mon[36747]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-07-26T08:29:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:38 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3503831964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:29:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:40.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:40 smithi043 ceph-mon[32384]: pgmap v380: 129 pgs: 3 peering, 126 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 895 B/s wr, 5 op/s 2024-07-26T08:29:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:40 smithi133 ceph-mon[37053]: pgmap v380: 129 pgs: 3 peering, 126 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 895 B/s wr, 5 op/s 2024-07-26T08:29:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:40 smithi063 ceph-mon[36747]: pgmap v380: 129 pgs: 3 peering, 126 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 895 B/s wr, 5 op/s 2024-07-26T08:29:41.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 -- 172.21.15.43:0/81048240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858113c90 msgr2=0x7fb858116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 --2- 172.21.15.43:0/81048240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858113c90 0x7fb858116160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb850009ca0 tx=0x7fb85002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 -- 172.21.15.43:0/81048240 shutdown_connections 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 --2- 172.21.15.43:0/81048240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb858075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 --2- 172.21.15.43:0/81048240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858113c90 0x7fb858116160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 --2- 172.21.15.43:0/81048240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858076db0 0x7fb8580751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.522+0000 7fb85e400640 1 -- 172.21.15.43:0/81048240 >> 172.21.15.43:0/81048240 conn(0x7fb8580fee10 msgr2=0x7fb858101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.523+0000 7fb85e400640 1 -- 172.21.15.43:0/81048240 shutdown_connections 2024-07-26T08:29:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.523+0000 7fb85e400640 1 -- 172.21.15.43:0/81048240 wait complete. 2024-07-26T08:29:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 Processor -- start 2024-07-26T08:29:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 -- start start 2024-07-26T08:29:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb8581a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858076db0 0x7fb8581a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858113c90 0x7fb8581a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb858119a10 con 0x7fb858113c90 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb858119890 con 0x7fb858076db0 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.524+0000 7fb85e400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb858119b90 con 0x7fb858075800 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb8581a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb857e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858076db0 0x7fb8581a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb8581a03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:43424/0 (socket says 172.21.15.43:43424) 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 -- 172.21.15.43:0/4123310063 learned_addr learned my addr 172.21.15.43:0/4123310063 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858113c90 0x7fb8581a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 -- 172.21.15.43:0/4123310063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858076db0 msgr2=0x7fb8581a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858076db0 0x7fb8581a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 -- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858113c90 msgr2=0x7fb8581a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858113c90 0x7fb8581a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85d000640 1 -- 172.21.15.43:0/4123310063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8581a6310 con 0x7fb858075800 2024-07-26T08:29:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb857e00640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858076db0 0x7fb8581a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.525+0000 7fb85da00640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858113c90 0x7fb8581a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.526+0000 7fb85d000640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb8581a03a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e9f0 tx=0x7fb84c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.526+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00cd80 con 0x7fb858075800 2024-07-26T08:29:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.526+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb84c010900 con 0x7fb858075800 2024-07-26T08:29:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.526+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8581a6600 con 0x7fb858075800 2024-07-26T08:29:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.526+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c018920 con 0x7fb858075800 2024-07-26T08:29:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.526+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8581acd60 con 0x7fb858075800 2024-07-26T08:29:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.527+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858075c10 con 0x7fb858075800 2024-07-26T08:29:41.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.530+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fb84c010ab0 con 0x7fb858075800 2024-07-26T08:29:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.531+0000 7fb855600640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb8400b3d30 0x7fb8400b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.532+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fb84c0e45f0 con 0x7fb858075800 2024-07-26T08:29:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.532+0000 7fb857e00640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb8400b3d30 0x7fb8400b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:41.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.533+0000 7fb857e00640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb8400b3d30 0x7fb8400b6240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb858115b40 tx=0x7fb844005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.535+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb84c0aaf70 con 0x7fb858075800 2024-07-26T08:29:41.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.736+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb858063230 con 0x7fb8400b3d30 2024-07-26T08:29:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.747+0000 7fb855600640 1 -- 172.21.15.43:0/4123310063 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340376 (secure 0 0 0) 0x7fb858063230 con 0x7fb8400b3d30 2024-07-26T08:29:41.750 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:29:41.757 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:29:41.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.755+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb8400b3d30 msgr2=0x7fb8400b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.755+0000 7fb85e400640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb8400b3d30 0x7fb8400b6240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb858115b40 tx=0x7fb844005f90 comp rx=0 tx=0).stop 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.755+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 msgr2=0x7fb8581a03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.755+0000 7fb85e400640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb8581a03a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e9f0 tx=0x7fb84c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.755+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 shutdown_connections 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb8400b3d30 0x7fb8400b6240 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb858113c90 0x7fb8581a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb858076db0 0x7fb8581a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 --2- 172.21.15.43:0/4123310063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb858075800 0x7fb8581a03a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:41.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 >> 172.21.15.43:0/4123310063 conn(0x7fb8580fee10 msgr2=0x7fb85810fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:41.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 shutdown_connections 2024-07-26T08:29:41.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:41.756+0000 7fb85e400640 1 -- 172.21.15.43:0/4123310063 wait complete. 2024-07-26T08:29:42.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:42 smithi043 ceph-mon[32384]: pgmap v381: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-07-26T08:29:42.657 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2024-07-26T08:29:40.726929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656284,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":317,"num_read_kb":257,"num_write":293,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384276,"kb_used_data":14244,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557548,"statfs":{"total":1151940427776,"available":1151546929152,"internally_reserved":0,"allocated":14585856,"data_stored":8349626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9083,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003862"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372355+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372355+0000","last_peered":"2024-07-26T08:29:36.372355+0000","last_clean":"2024-07-26T08:29:36.372355+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372355+0000","last_undegraded":"2024-07-26T08:29:36.372355+0000","last_fullsized":"2024-07-26T08:29:36.372355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953206+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:29:36.953206+0000","last_peered":"2024-07-26T08:29:36.953206+0000","last_clean":"2024-07-26T08:29:36.953206+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:29:36.953206+0000","last_undegraded":"2024-07-26T08:29:36.953206+0000","last_fullsized":"2024-07-26T08:29:36.953206+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362122+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:29:36.362122+0000","last_peered":"2024-07-26T08:29:36.362122+0000","last_clean":"2024-07-26T08:29:36.362122+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:29:36.362122+0000","last_undegraded":"2024-07-26T08:29:36.362122+0000","last_fullsized":"2024-07-26T08:29:36.362122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954121+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954121+0000","last_peered":"2024-07-26T08:29:36.954121+0000","last_clean":"2024-07-26T08:29:36.954121+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954121+0000","last_undegraded":"2024-07-26T08:29:36.954121+0000","last_fullsized":"2024-07-26T08:29:36.954121+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.002057+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:29:37.002057+0000","last_peered":"2024-07-26T08:29:37.002057+0000","last_clean":"2024-07-26T08:29:37.002057+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:29:37.002057+0000","last_undegraded":"2024-07-26T08:29:37.002057+0000","last_fullsized":"2024-07-26T08:29:37.002057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683203+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:29:36.683203+0000","last_peered":"2024-07-26T08:29:36.683203+0000","last_clean":"2024-07-26T08:29:36.683203+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:29:36.683203+0000","last_undegraded":"2024-07-26T08:29:36.683203+0000","last_fullsized":"2024-07-26T08:29:36.683203+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916027+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:36.916027+0000","last_peered":"2024-07-26T08:29:36.916027+0000","last_clean":"2024-07-26T08:29:36.916027+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:36.916027+0000","last_undegraded":"2024-07-26T08:29:36.916027+0000","last_fullsized":"2024-07-26T08:29:36.916027+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949842+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:29:36.949842+0000","last_peered":"2024-07-26T08:29:36.949842+0000","last_clean":"2024-07-26T08:29:36.949842+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:29:36.949842+0000","last_undegraded":"2024-07-26T08:29:36.949842+0000","last_fullsized":"2024-07-26T08:29:36.949842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683663+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:29:36.683663+0000","last_peered":"2024-07-26T08:29:36.683663+0000","last_clean":"2024-07-26T08:29:36.683663+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:29:36.683663+0000","last_undegraded":"2024-07-26T08:29:36.683663+0000","last_fullsized":"2024-07-26T08:29:36.683663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916198+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:36.916198+0000","last_peered":"2024-07-26T08:29:36.916198+0000","last_clean":"2024-07-26T08:29:36.916198+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:36.916198+0000","last_undegraded":"2024-07-26T08:29:36.916198+0000","last_fullsized":"2024-07-26T08:29:36.916198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373254+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:29:36.373254+0000","last_peered":"2024-07-26T08:29:36.373254+0000","last_clean":"2024-07-26T08:29:36.373254+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:29:36.373254+0000","last_undegraded":"2024-07-26T08:29:36.373254+0000","last_fullsized":"2024-07-26T08:29:36.373254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683318+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:29:36.683318+0000","last_peered":"2024-07-26T08:29:36.683318+0000","last_clean":"2024-07-26T08:29:36.683318+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:29:36.683318+0000","last_undegraded":"2024-07-26T08:29:36.683318+0000","last_fullsized":"2024-07-26T08:29:36.683318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362478+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:29:36.362478+0000","last_peered":"2024-07-26T08:29:36.362478+0000","last_clean":"2024-07-26T08:29:36.362478+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:29:36.362478+0000","last_undegraded":"2024-07-26T08:29:36.362478+0000","last_fullsized":"2024-07-26T08:29:36.362478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915202+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:36.915202+0000","last_peered":"2024-07-26T08:29:36.915202+0000","last_clean":"2024-07-26T08:29:36.915202+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:36.915202+0000","last_undegraded":"2024-07-26T08:29:36.915202+0000","last_fullsized":"2024-07-26T08:29:36.915202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683586+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:29:36.683586+0000","last_peered":"2024-07-26T08:29:36.683586+0000","last_clean":"2024-07-26T08:29:36.683586+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:29:36.683586+0000","last_undegraded":"2024-07-26T08:29:36.683586+0000","last_fullsized":"2024-07-26T08:29:36.683586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952542+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:29:36.952542+0000","last_peered":"2024-07-26T08:29:36.952542+0000","last_clean":"2024-07-26T08:29:36.952542+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:29:36.952542+0000","last_undegraded":"2024-07-26T08:29:36.952542+0000","last_fullsized":"2024-07-26T08:29:36.952542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362208+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:36.362208+0000","last_peered":"2024-07-26T08:29:36.362208+0000","last_clean":"2024-07-26T08:29:36.362208+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:36.362208+0000","last_undegraded":"2024-07-26T08:29:36.362208+0000","last_fullsized":"2024-07-26T08:29:36.362208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683747+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:29:36.683747+0000","last_peered":"2024-07-26T08:29:36.683747+0000","last_clean":"2024-07-26T08:29:36.683747+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:29:36.683747+0000","last_undegraded":"2024-07-26T08:29:36.683747+0000","last_fullsized":"2024-07-26T08:29:36.683747+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364199+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:29:35.364199+0000","last_peered":"2024-07-26T08:29:35.364199+0000","last_clean":"2024-07-26T08:29:35.364199+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:29:35.364199+0000","last_undegraded":"2024-07-26T08:29:35.364199+0000","last_fullsized":"2024-07-26T08:29:35.364199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952808+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:36.952808+0000","last_peered":"2024-07-26T08:29:36.952808+0000","last_clean":"2024-07-26T08:29:36.952808+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:36.952808+0000","last_undegraded":"2024-07-26T08:29:36.952808+0000","last_fullsized":"2024-07-26T08:29:36.952808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371234+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:29:36.371234+0000","last_peered":"2024-07-26T08:29:36.371234+0000","last_clean":"2024-07-26T08:29:36.371234+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:29:36.371234+0000","last_undegraded":"2024-07-26T08:29:36.371234+0000","last_fullsized":"2024-07-26T08:29:36.371234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915100+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:29:36.915100+0000","last_peered":"2024-07-26T08:29:36.915100+0000","last_clean":"2024-07-26T08:29:36.915100+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:29:36.915100+0000","last_undegraded":"2024-07-26T08:29:36.915100+0000","last_fullsized":"2024-07-26T08:29:36.915100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949808+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:36.949808+0000","last_peered":"2024-07-26T08:29:36.949808+0000","last_clean":"2024-07-26T08:29:36.949808+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:36.949808+0000","last_undegraded":"2024-07-26T08:29:36.949808+0000","last_fullsized":"2024-07-26T08:29:36.949808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684005+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:29:36.684005+0000","last_peered":"2024-07-26T08:29:36.684005+0000","last_clean":"2024-07-26T08:29:36.684005+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:29:36.684005+0000","last_undegraded":"2024-07-26T08:29:36.684005+0000","last_fullsized":"2024-07-26T08:29:36.684005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001556+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:29:37.001556+0000","last_peered":"2024-07-26T08:29:37.001556+0000","last_clean":"2024-07-26T08:29:37.001556+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:29:37.001556+0000","last_undegraded":"2024-07-26T08:29:37.001556+0000","last_fullsized":"2024-07-26T08:29:37.001556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684523+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:36.684523+0000","last_peered":"2024-07-26T08:29:36.684523+0000","last_clean":"2024-07-26T08:29:36.684523+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:36.684523+0000","last_undegraded":"2024-07-26T08:29:36.684523+0000","last_fullsized":"2024-07-26T08:29:36.684523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362239+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:36.362239+0000","last_peered":"2024-07-26T08:29:36.362239+0000","last_clean":"2024-07-26T08:29:36.362239+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:36.362239+0000","last_undegraded":"2024-07-26T08:29:36.362239+0000","last_fullsized":"2024-07-26T08:29:36.362239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954206+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:29:36.954206+0000","last_peered":"2024-07-26T08:29:36.954206+0000","last_clean":"2024-07-26T08:29:36.954206+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:29:36.954206+0000","last_undegraded":"2024-07-26T08:29:36.954206+0000","last_fullsized":"2024-07-26T08:29:36.954206+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372875+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:29:36.372875+0000","last_peered":"2024-07-26T08:29:36.372875+0000","last_clean":"2024-07-26T08:29:36.372875+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:29:36.372875+0000","last_undegraded":"2024-07-26T08:29:36.372875+0000","last_fullsized":"2024-07-26T08:29:36.372875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.951769+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:36.951769+0000","last_peered":"2024-07-26T08:29:36.951769+0000","last_clean":"2024-07-26T08:29:36.951769+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:36.951769+0000","last_undegraded":"2024-07-26T08:29:36.951769+0000","last_fullsized":"2024-07-26T08:29:36.951769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366844+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:29:36.366844+0000","last_peered":"2024-07-26T08:29:36.366844+0000","last_clean":"2024-07-26T08:29:36.366844+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:29:36.366844+0000","last_undegraded":"2024-07-26T08:29:36.366844+0000","last_fullsized":"2024-07-26T08:29:36.366844+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916186+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916186+0000","last_peered":"2024-07-26T08:29:36.916186+0000","last_clean":"2024-07-26T08:29:36.916186+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916186+0000","last_undegraded":"2024-07-26T08:29:36.916186+0000","last_fullsized":"2024-07-26T08:29:36.916186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.363994+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:35.363994+0000","last_peered":"2024-07-26T08:29:35.363994+0000","last_clean":"2024-07-26T08:29:35.363994+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:35.363994+0000","last_undegraded":"2024-07-26T08:29:35.363994+0000","last_fullsized":"2024-07-26T08:29:35.363994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371728+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:29:36.371728+0000","last_peered":"2024-07-26T08:29:36.371728+0000","last_clean":"2024-07-26T08:29:36.371728+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:29:36.371728+0000","last_undegraded":"2024-07-26T08:29:36.371728+0000","last_fullsized":"2024-07-26T08:29:36.371728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370566+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370566+0000","last_peered":"2024-07-26T08:29:36.370566+0000","last_clean":"2024-07-26T08:29:36.370566+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370566+0000","last_undegraded":"2024-07-26T08:29:36.370566+0000","last_fullsized":"2024-07-26T08:29:36.370566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915219+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:36.915219+0000","last_peered":"2024-07-26T08:29:36.915219+0000","last_clean":"2024-07-26T08:29:36.915219+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:36.915219+0000","last_undegraded":"2024-07-26T08:29:36.915219+0000","last_fullsized":"2024-07-26T08:29:36.915219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.003210+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:29:37.003210+0000","last_peered":"2024-07-26T08:29:37.003210+0000","last_clean":"2024-07-26T08:29:37.003210+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:29:37.003210+0000","last_undegraded":"2024-07-26T08:29:37.003210+0000","last_fullsized":"2024-07-26T08:29:37.003210+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362690+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:36.362690+0000","last_peered":"2024-07-26T08:29:36.362690+0000","last_clean":"2024-07-26T08:29:36.362690+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:36.362690+0000","last_undegraded":"2024-07-26T08:29:36.362690+0000","last_fullsized":"2024-07-26T08:29:36.362690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366497+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:36.366497+0000","last_peered":"2024-07-26T08:29:36.366497+0000","last_clean":"2024-07-26T08:29:36.366497+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:36.366497+0000","last_undegraded":"2024-07-26T08:29:36.366497+0000","last_fullsized":"2024-07-26T08:29:36.366497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371812+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:29:36.371812+0000","last_peered":"2024-07-26T08:29:36.371812+0000","last_clean":"2024-07-26T08:29:36.371812+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:29:36.371812+0000","last_undegraded":"2024-07-26T08:29:36.371812+0000","last_fullsized":"2024-07-26T08:29:36.371812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.680852+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:29:36.680852+0000","last_peered":"2024-07-26T08:29:36.680852+0000","last_clean":"2024-07-26T08:29:36.680852+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:29:36.680852+0000","last_undegraded":"2024-07-26T08:29:36.680852+0000","last_fullsized":"2024-07-26T08:29:36.680852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367334+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:36.367334+0000","last_peered":"2024-07-26T08:29:36.367334+0000","last_clean":"2024-07-26T08:29:36.367334+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:36.367334+0000","last_undegraded":"2024-07-26T08:29:36.367334+0000","last_fullsized":"2024-07-26T08:29:36.367334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365320+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:29:36.365320+0000","last_peered":"2024-07-26T08:29:36.365320+0000","last_clean":"2024-07-26T08:29:36.365320+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:29:36.365320+0000","last_undegraded":"2024-07-26T08:29:36.365320+0000","last_fullsized":"2024-07-26T08:29:36.365320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362439+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362439+0000","last_peered":"2024-07-26T08:29:36.362439+0000","last_clean":"2024-07-26T08:29:36.362439+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362439+0000","last_undegraded":"2024-07-26T08:29:36.362439+0000","last_fullsized":"2024-07-26T08:29:36.362439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372384+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:29:36.372384+0000","last_peered":"2024-07-26T08:29:36.372384+0000","last_clean":"2024-07-26T08:29:36.372384+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:29:36.372384+0000","last_undegraded":"2024-07-26T08:29:36.372384+0000","last_fullsized":"2024-07-26T08:29:36.372384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952975+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:29:36.952975+0000","last_peered":"2024-07-26T08:29:36.952975+0000","last_clean":"2024-07-26T08:29:36.952975+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:29:36.952975+0000","last_undegraded":"2024-07-26T08:29:36.952975+0000","last_fullsized":"2024-07-26T08:29:36.952975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683931+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.683931+0000","last_peered":"2024-07-26T08:29:36.683931+0000","last_clean":"2024-07-26T08:29:36.683931+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.683931+0000","last_undegraded":"2024-07-26T08:29:36.683931+0000","last_fullsized":"2024-07-26T08:29:36.683931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362580+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:29:36.362580+0000","last_peered":"2024-07-26T08:29:36.362580+0000","last_clean":"2024-07-26T08:29:36.362580+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:29:36.362580+0000","last_undegraded":"2024-07-26T08:29:36.362580+0000","last_fullsized":"2024-07-26T08:29:36.362580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363010+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:36.363010+0000","last_peered":"2024-07-26T08:29:36.363010+0000","last_clean":"2024-07-26T08:29:36.363010+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:36.363010+0000","last_undegraded":"2024-07-26T08:29:36.363010+0000","last_fullsized":"2024-07-26T08:29:36.363010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363208+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:29:36.363208+0000","last_peered":"2024-07-26T08:29:36.363208+0000","last_clean":"2024-07-26T08:29:36.363208+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:29:36.363208+0000","last_undegraded":"2024-07-26T08:29:36.363208+0000","last_fullsized":"2024-07-26T08:29:36.363208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362745+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:36.362745+0000","last_peered":"2024-07-26T08:29:36.362745+0000","last_clean":"2024-07-26T08:29:36.362745+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:36.362745+0000","last_undegraded":"2024-07-26T08:29:36.362745+0000","last_fullsized":"2024-07-26T08:29:36.362745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949558+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:29:36.949558+0000","last_peered":"2024-07-26T08:29:36.949558+0000","last_clean":"2024-07-26T08:29:36.949558+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:29:36.949558+0000","last_undegraded":"2024-07-26T08:29:36.949558+0000","last_fullsized":"2024-07-26T08:29:36.949558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362919+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:29:36.362919+0000","last_peered":"2024-07-26T08:29:36.362919+0000","last_clean":"2024-07-26T08:29:36.362919+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:29:36.362919+0000","last_undegraded":"2024-07-26T08:29:36.362919+0000","last_fullsized":"2024-07-26T08:29:36.362919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373139+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:36.373139+0000","last_peered":"2024-07-26T08:29:36.373139+0000","last_clean":"2024-07-26T08:29:36.373139+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:36.373139+0000","last_undegraded":"2024-07-26T08:29:36.373139+0000","last_fullsized":"2024-07-26T08:29:36.373139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000692+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:29:37.000692+0000","last_peered":"2024-07-26T08:29:37.000692+0000","last_clean":"2024-07-26T08:29:37.000692+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:29:37.000692+0000","last_undegraded":"2024-07-26T08:29:37.000692+0000","last_fullsized":"2024-07-26T08:29:37.000692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363159+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:29:36.363159+0000","last_peered":"2024-07-26T08:29:36.363159+0000","last_clean":"2024-07-26T08:29:36.363159+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:29:36.363159+0000","last_undegraded":"2024-07-26T08:29:36.363159+0000","last_fullsized":"2024-07-26T08:29:36.363159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367344+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:36.367344+0000","last_peered":"2024-07-26T08:29:36.367344+0000","last_clean":"2024-07-26T08:29:36.367344+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:36.367344+0000","last_undegraded":"2024-07-26T08:29:36.367344+0000","last_fullsized":"2024-07-26T08:29:36.367344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371602+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:29:36.371602+0000","last_peered":"2024-07-26T08:29:36.371602+0000","last_clean":"2024-07-26T08:29:36.371602+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:29:36.371602+0000","last_undegraded":"2024-07-26T08:29:36.371602+0000","last_fullsized":"2024-07-26T08:29:36.371602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364641+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:29:35.364641+0000","last_peered":"2024-07-26T08:29:35.364641+0000","last_clean":"2024-07-26T08:29:35.364641+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:29:35.364641+0000","last_undegraded":"2024-07-26T08:29:35.364641+0000","last_fullsized":"2024-07-26T08:29:35.364641+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916081+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:36.916081+0000","last_peered":"2024-07-26T08:29:36.916081+0000","last_clean":"2024-07-26T08:29:36.916081+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:36.916081+0000","last_undegraded":"2024-07-26T08:29:36.916081+0000","last_fullsized":"2024-07-26T08:29:36.916081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372231+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:29:36.372231+0000","last_peered":"2024-07-26T08:29:36.372231+0000","last_clean":"2024-07-26T08:29:36.372231+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:29:36.372231+0000","last_undegraded":"2024-07-26T08:29:36.372231+0000","last_fullsized":"2024-07-26T08:29:36.372231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372393+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:29:36.372393+0000","last_peered":"2024-07-26T08:29:36.372393+0000","last_clean":"2024-07-26T08:29:36.372393+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:29:36.372393+0000","last_undegraded":"2024-07-26T08:29:36.372393+0000","last_fullsized":"2024-07-26T08:29:36.372393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915149+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:36.915149+0000","last_peered":"2024-07-26T08:29:36.915149+0000","last_clean":"2024-07-26T08:29:36.915149+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:36.915149+0000","last_undegraded":"2024-07-26T08:29:36.915149+0000","last_fullsized":"2024-07-26T08:29:36.915149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367253+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:29:36.367253+0000","last_peered":"2024-07-26T08:29:36.367253+0000","last_clean":"2024-07-26T08:29:36.367253+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:29:36.367253+0000","last_undegraded":"2024-07-26T08:29:36.367253+0000","last_fullsized":"2024-07-26T08:29:36.367253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362329+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:29:36.362329+0000","last_peered":"2024-07-26T08:29:36.362329+0000","last_clean":"2024-07-26T08:29:36.362329+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:29:36.362329+0000","last_undegraded":"2024-07-26T08:29:36.362329+0000","last_fullsized":"2024-07-26T08:29:36.362329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.686120+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:29:37.686120+0000","last_peered":"2024-07-26T08:29:37.686120+0000","last_clean":"2024-07-26T08:29:37.686120+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:29:37.686120+0000","last_undegraded":"2024-07-26T08:29:37.686120+0000","last_fullsized":"2024-07-26T08:29:37.686120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371581+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:29:36.371581+0000","last_peered":"2024-07-26T08:29:36.371581+0000","last_clean":"2024-07-26T08:29:36.371581+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:29:36.371581+0000","last_undegraded":"2024-07-26T08:29:36.371581+0000","last_fullsized":"2024-07-26T08:29:36.371581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362756+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:29:36.362756+0000","last_peered":"2024-07-26T08:29:36.362756+0000","last_clean":"2024-07-26T08:29:36.362756+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:29:36.362756+0000","last_undegraded":"2024-07-26T08:29:36.362756+0000","last_fullsized":"2024-07-26T08:29:36.362756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373068+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:36.373068+0000","last_peered":"2024-07-26T08:29:36.373068+0000","last_clean":"2024-07-26T08:29:36.373068+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:36.373068+0000","last_undegraded":"2024-07-26T08:29:36.373068+0000","last_fullsized":"2024-07-26T08:29:36.373068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364127+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:29:35.364127+0000","last_peered":"2024-07-26T08:29:35.364127+0000","last_clean":"2024-07-26T08:29:35.364127+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:29:35.364127+0000","last_undegraded":"2024-07-26T08:29:35.364127+0000","last_fullsized":"2024-07-26T08:29:35.364127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365659+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:29:36.365659+0000","last_peered":"2024-07-26T08:29:36.365659+0000","last_clean":"2024-07-26T08:29:36.365659+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:29:36.365659+0000","last_undegraded":"2024-07-26T08:29:36.365659+0000","last_fullsized":"2024-07-26T08:29:36.365659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362433+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:36.362433+0000","last_peered":"2024-07-26T08:29:36.362433+0000","last_clean":"2024-07-26T08:29:36.362433+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:36.362433+0000","last_undegraded":"2024-07-26T08:29:36.362433+0000","last_fullsized":"2024-07-26T08:29:36.362433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372833+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:29:36.372833+0000","last_peered":"2024-07-26T08:29:36.372833+0000","last_clean":"2024-07-26T08:29:36.372833+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:29:36.372833+0000","last_undegraded":"2024-07-26T08:29:36.372833+0000","last_fullsized":"2024-07-26T08:29:36.372833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915707+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:29:36.915707+0000","last_peered":"2024-07-26T08:29:36.915707+0000","last_clean":"2024-07-26T08:29:36.915707+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:29:36.915707+0000","last_undegraded":"2024-07-26T08:29:36.915707+0000","last_fullsized":"2024-07-26T08:29:36.915707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:39.686893+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:29:39.686893+0000","last_peered":"2024-07-26T08:29:39.686893+0000","last_clean":"2024-07-26T08:29:39.686893+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:29:39.686893+0000","last_undegraded":"2024-07-26T08:29:39.686893+0000","last_fullsized":"2024-07-26T08:29:39.686893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62072,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":101,"num_write":34,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370536+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:29:36.370536+0000","last_peered":"2024-07-26T08:29:36.370536+0000","last_clean":"2024-07-26T08:29:36.370536+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:29:36.370536+0000","last_undegraded":"2024-07-26T08:29:36.370536+0000","last_fullsized":"2024-07-26T08:29:36.370536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949847+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:29:36.949847+0000","last_peered":"2024-07-26T08:29:36.949847+0000","last_clean":"2024-07-26T08:29:36.949847+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:29:36.949847+0000","last_undegraded":"2024-07-26T08:29:36.949847+0000","last_fullsized":"2024-07-26T08:29:36.949847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372987+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:36.372987+0000","last_peered":"2024-07-26T08:29:36.372987+0000","last_clean":"2024-07-26T08:29:36.372987+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:36.372987+0000","last_undegraded":"2024-07-26T08:29:36.372987+0000","last_fullsized":"2024-07-26T08:29:36.372987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683768+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:29:36.683768+0000","last_peered":"2024-07-26T08:29:36.683768+0000","last_clean":"2024-07-26T08:29:36.683768+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:29:36.683768+0000","last_undegraded":"2024-07-26T08:29:36.683768+0000","last_fullsized":"2024-07-26T08:29:36.683768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.002068+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:29:37.002068+0000","last_peered":"2024-07-26T08:29:37.002068+0000","last_clean":"2024-07-26T08:29:37.002068+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:29:37.002068+0000","last_undegraded":"2024-07-26T08:29:37.002068+0000","last_fullsized":"2024-07-26T08:29:37.002068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363036+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:36.363036+0000","last_peered":"2024-07-26T08:29:36.363036+0000","last_clean":"2024-07-26T08:29:36.363036+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:36.363036+0000","last_undegraded":"2024-07-26T08:29:36.363036+0000","last_fullsized":"2024-07-26T08:29:36.363036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.368872+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:29:36.368872+0000","last_peered":"2024-07-26T08:29:36.368872+0000","last_clean":"2024-07-26T08:29:36.368872+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:29:36.368872+0000","last_undegraded":"2024-07-26T08:29:36.368872+0000","last_fullsized":"2024-07-26T08:29:36.368872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.950166+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:29:36.950166+0000","last_peered":"2024-07-26T08:29:36.950166+0000","last_clean":"2024-07-26T08:29:36.950166+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:29:36.950166+0000","last_undegraded":"2024-07-26T08:29:36.950166+0000","last_fullsized":"2024-07-26T08:29:36.950166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:38.697082+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:29:38.697082+0000","last_peered":"2024-07-26T08:29:38.697082+0000","last_clean":"2024-07-26T08:29:38.697082+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:29:38.697082+0000","last_undegraded":"2024-07-26T08:29:38.697082+0000","last_fullsized":"2024-07-26T08:29:38.697082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952178+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:29:36.952178+0000","last_peered":"2024-07-26T08:29:36.952178+0000","last_clean":"2024-07-26T08:29:36.952178+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:29:36.952178+0000","last_undegraded":"2024-07-26T08:29:36.952178+0000","last_fullsized":"2024-07-26T08:29:36.952178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001028+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:37.001028+0000","last_peered":"2024-07-26T08:29:37.001028+0000","last_clean":"2024-07-26T08:29:37.001028+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:37.001028+0000","last_undegraded":"2024-07-26T08:29:37.001028+0000","last_fullsized":"2024-07-26T08:29:37.001028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.369102+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:29:36.369102+0000","last_peered":"2024-07-26T08:29:36.369102+0000","last_clean":"2024-07-26T08:29:36.369102+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:29:36.369102+0000","last_undegraded":"2024-07-26T08:29:36.369102+0000","last_fullsized":"2024-07-26T08:29:36.369102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372001+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:36.372001+0000","last_peered":"2024-07-26T08:29:36.372001+0000","last_clean":"2024-07-26T08:29:36.372001+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:36.372001+0000","last_undegraded":"2024-07-26T08:29:36.372001+0000","last_fullsized":"2024-07-26T08:29:36.372001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364673+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:35.364673+0000","last_peered":"2024-07-26T08:29:35.364673+0000","last_clean":"2024-07-26T08:29:35.364673+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:35.364673+0000","last_undegraded":"2024-07-26T08:29:35.364673+0000","last_fullsized":"2024-07-26T08:29:35.364673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953835+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:29:36.953835+0000","last_peered":"2024-07-26T08:29:36.953835+0000","last_clean":"2024-07-26T08:29:36.953835+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:29:36.953835+0000","last_undegraded":"2024-07-26T08:29:36.953835+0000","last_fullsized":"2024-07-26T08:29:36.953835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365551+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:36.365551+0000","last_peered":"2024-07-26T08:29:36.365551+0000","last_clean":"2024-07-26T08:29:36.365551+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:36.365551+0000","last_undegraded":"2024-07-26T08:29:36.365551+0000","last_fullsized":"2024-07-26T08:29:36.365551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371506+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:29:36.371506+0000","last_peered":"2024-07-26T08:29:36.371506+0000","last_clean":"2024-07-26T08:29:36.371506+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:29:36.371506+0000","last_undegraded":"2024-07-26T08:29:36.371506+0000","last_fullsized":"2024-07-26T08:29:36.371506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.685358+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:29:36.685358+0000","last_peered":"2024-07-26T08:29:36.685358+0000","last_clean":"2024-07-26T08:29:36.685358+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:29:36.685358+0000","last_undegraded":"2024-07-26T08:29:36.685358+0000","last_fullsized":"2024-07-26T08:29:36.685358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362465+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:29:36.362465+0000","last_peered":"2024-07-26T08:29:36.362465+0000","last_clean":"2024-07-26T08:29:36.362465+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:29:36.362465+0000","last_undegraded":"2024-07-26T08:29:36.362465+0000","last_fullsized":"2024-07-26T08:29:36.362465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372688+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:29:36.372688+0000","last_peered":"2024-07-26T08:29:36.372688+0000","last_clean":"2024-07-26T08:29:36.372688+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:29:36.372688+0000","last_undegraded":"2024-07-26T08:29:36.372688+0000","last_fullsized":"2024-07-26T08:29:36.372688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915361+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:29:36.915361+0000","last_peered":"2024-07-26T08:29:36.915361+0000","last_clean":"2024-07-26T08:29:36.915361+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:29:36.915361+0000","last_undegraded":"2024-07-26T08:29:36.915361+0000","last_fullsized":"2024-07-26T08:29:36.915361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362561+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:29:36.362561+0000","last_peered":"2024-07-26T08:29:36.362561+0000","last_clean":"2024-07-26T08:29:36.362561+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:29:36.362561+0000","last_undegraded":"2024-07-26T08:29:36.362561+0000","last_fullsized":"2024-07-26T08:29:36.362561+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364059+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:29:35.364059+0000","last_peered":"2024-07-26T08:29:35.364059+0000","last_clean":"2024-07-26T08:29:35.364059+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:29:35.364059+0000","last_undegraded":"2024-07-26T08:29:35.364059+0000","last_fullsized":"2024-07-26T08:29:35.364059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362451+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:29:36.362451+0000","last_peered":"2024-07-26T08:29:36.362451+0000","last_clean":"2024-07-26T08:29:36.362451+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:29:36.362451+0000","last_undegraded":"2024-07-26T08:29:36.362451+0000","last_fullsized":"2024-07-26T08:29:36.362451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362197+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:29:36.362197+0000","last_peered":"2024-07-26T08:29:36.362197+0000","last_clean":"2024-07-26T08:29:36.362197+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:29:36.362197+0000","last_undegraded":"2024-07-26T08:29:36.362197+0000","last_fullsized":"2024-07-26T08:29:36.362197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000879+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:29:37.000879+0000","last_peered":"2024-07-26T08:29:37.000879+0000","last_clean":"2024-07-26T08:29:37.000879+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:29:37.000879+0000","last_undegraded":"2024-07-26T08:29:37.000879+0000","last_fullsized":"2024-07-26T08:29:37.000879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366755+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:29:36.366755+0000","last_peered":"2024-07-26T08:29:36.366755+0000","last_clean":"2024-07-26T08:29:36.366755+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:29:36.366755+0000","last_undegraded":"2024-07-26T08:29:36.366755+0000","last_fullsized":"2024-07-26T08:29:36.366755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"peering","last_fresh":"2024-07-26T08:28:35.786017+0000","last_change":"2024-07-26T08:29:35.365067+0000","last_active":"2024-07-26T08:29:35.365067+0000","last_peered":"2024-07-26T08:28:35.786017+0000","last_clean":"2024-07-26T08:28:35.786017+0000","last_became_active":"2024-07-26T08:27:34.302795+0000","last_became_peered":"2024-07-26T08:27:34.302795+0000","last_unstale":"2024-07-26T08:28:35.786017+0000","last_undegraded":"2024-07-26T08:28:35.786017+0000","last_fullsized":"2024-07-26T08:28:35.786017+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,8,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362827+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:29:36.362827+0000","last_peered":"2024-07-26T08:29:36.362827+0000","last_clean":"2024-07-26T08:29:36.362827+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:29:36.362827+0000","last_undegraded":"2024-07-26T08:29:36.362827+0000","last_fullsized":"2024-07-26T08:29:36.362827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.688765+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:29:36.688765+0000","last_peered":"2024-07-26T08:29:36.688765+0000","last_clean":"2024-07-26T08:29:36.688765+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:29:36.688765+0000","last_undegraded":"2024-07-26T08:29:36.688765+0000","last_fullsized":"2024-07-26T08:29:36.688765+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372166+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:29:36.372166+0000","last_peered":"2024-07-26T08:29:36.372166+0000","last_clean":"2024-07-26T08:29:36.372166+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:29:36.372166+0000","last_undegraded":"2024-07-26T08:29:36.372166+0000","last_fullsized":"2024-07-26T08:29:36.372166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952461+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:29:36.952461+0000","last_peered":"2024-07-26T08:29:36.952461+0000","last_clean":"2024-07-26T08:29:36.952461+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:29:36.952461+0000","last_undegraded":"2024-07-26T08:29:36.952461+0000","last_fullsized":"2024-07-26T08:29:36.952461+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949784+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:29:36.949784+0000","last_peered":"2024-07-26T08:29:36.949784+0000","last_clean":"2024-07-26T08:29:36.949784+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:29:36.949784+0000","last_undegraded":"2024-07-26T08:29:36.949784+0000","last_fullsized":"2024-07-26T08:29:36.949784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366227+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:29:36.366227+0000","last_peered":"2024-07-26T08:29:36.366227+0000","last_clean":"2024-07-26T08:29:36.366227+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:29:36.366227+0000","last_undegraded":"2024-07-26T08:29:36.366227+0000","last_fullsized":"2024-07-26T08:29:36.366227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364273+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:29:35.364273+0000","last_peered":"2024-07-26T08:29:35.364273+0000","last_clean":"2024-07-26T08:29:35.364273+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:29:35.364273+0000","last_undegraded":"2024-07-26T08:29:35.364273+0000","last_fullsized":"2024-07-26T08:29:35.364273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362708+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:29:36.362708+0000","last_peered":"2024-07-26T08:29:36.362708+0000","last_clean":"2024-07-26T08:29:36.362708+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:29:36.362708+0000","last_undegraded":"2024-07-26T08:29:36.362708+0000","last_fullsized":"2024-07-26T08:29:36.362708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372534+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:29:36.372534+0000","last_peered":"2024-07-26T08:29:36.372534+0000","last_clean":"2024-07-26T08:29:36.372534+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:29:36.372534+0000","last_undegraded":"2024-07-26T08:29:36.372534+0000","last_fullsized":"2024-07-26T08:29:36.372534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364988+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:29:35.364988+0000","last_peered":"2024-07-26T08:29:35.364988+0000","last_clean":"2024-07-26T08:29:35.364988+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:29:35.364988+0000","last_undegraded":"2024-07-26T08:29:35.364988+0000","last_fullsized":"2024-07-26T08:29:35.364988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949482+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:29:36.949482+0000","last_peered":"2024-07-26T08:29:36.949482+0000","last_clean":"2024-07-26T08:29:36.949482+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:29:36.949482+0000","last_undegraded":"2024-07-26T08:29:36.949482+0000","last_fullsized":"2024-07-26T08:29:36.949482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000062+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:29:37.000062+0000","last_peered":"2024-07-26T08:29:37.000062+0000","last_clean":"2024-07-26T08:29:37.000062+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:29:37.000062+0000","last_undegraded":"2024-07-26T08:29:37.000062+0000","last_fullsized":"2024-07-26T08:29:37.000062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000077+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:29:37.000077+0000","last_peered":"2024-07-26T08:29:37.000077+0000","last_clean":"2024-07-26T08:29:37.000077+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:29:37.000077+0000","last_undegraded":"2024-07-26T08:29:37.000077+0000","last_fullsized":"2024-07-26T08:29:37.000077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366110+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:29:36.366110+0000","last_peered":"2024-07-26T08:29:36.366110+0000","last_clean":"2024-07-26T08:29:36.366110+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:29:36.366110+0000","last_undegraded":"2024-07-26T08:29:36.366110+0000","last_fullsized":"2024-07-26T08:29:36.366110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684114+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:29:36.684114+0000","last_peered":"2024-07-26T08:29:36.684114+0000","last_clean":"2024-07-26T08:29:36.684114+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:29:36.684114+0000","last_undegraded":"2024-07-26T08:29:36.684114+0000","last_fullsized":"2024-07-26T08:29:36.684114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363178+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:29:36.363178+0000","last_peered":"2024-07-26T08:29:36.363178+0000","last_clean":"2024-07-26T08:29:36.363178+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:29:36.363178+0000","last_undegraded":"2024-07-26T08:29:36.363178+0000","last_fullsized":"2024-07-26T08:29:36.363178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372054+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:29:36.372054+0000","last_peered":"2024-07-26T08:29:36.372054+0000","last_clean":"2024-07-26T08:29:36.372054+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:29:36.372054+0000","last_undegraded":"2024-07-26T08:29:36.372054+0000","last_fullsized":"2024-07-26T08:29:36.372054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.950230+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:29:36.950230+0000","last_peered":"2024-07-26T08:29:36.950230+0000","last_clean":"2024-07-26T08:29:36.950230+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:29:36.950230+0000","last_undegraded":"2024-07-26T08:29:36.950230+0000","last_fullsized":"2024-07-26T08:29:36.950230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952188+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:29:36.952188+0000","last_peered":"2024-07-26T08:29:36.952188+0000","last_clean":"2024-07-26T08:29:36.952188+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:29:36.952188+0000","last_undegraded":"2024-07-26T08:29:36.952188+0000","last_fullsized":"2024-07-26T08:29:36.952188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362476+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:29:36.362476+0000","last_peered":"2024-07-26T08:29:36.362476+0000","last_clean":"2024-07-26T08:29:36.362476+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:29:36.362476+0000","last_undegraded":"2024-07-26T08:29:36.362476+0000","last_fullsized":"2024-07-26T08:29:36.362476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.917533+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:29:36.917533+0000","last_peered":"2024-07-26T08:29:36.917533+0000","last_clean":"2024-07-26T08:29:36.917533+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:29:36.917533+0000","last_undegraded":"2024-07-26T08:29:36.917533+0000","last_fullsized":"2024-07-26T08:29:36.917533+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915152+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:29:36.915152+0000","last_peered":"2024-07-26T08:29:36.915152+0000","last_clean":"2024-07-26T08:29:36.915152+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:29:36.915152+0000","last_undegraded":"2024-07-26T08:29:36.915152+0000","last_fullsized":"2024-07-26T08:29:36.915152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683926+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:29:36.683926+0000","last_peered":"2024-07-26T08:29:36.683926+0000","last_clean":"2024-07-26T08:29:36.683926+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:29:36.683926+0000","last_undegraded":"2024-07-26T08:29:36.683926+0000","last_fullsized":"2024-07-26T08:29:36.683926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000358+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:29:37.000358+0000","last_peered":"2024-07-26T08:29:37.000358+0000","last_clean":"2024-07-26T08:29:37.000358+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:29:37.000358+0000","last_undegraded":"2024-07-26T08:29:37.000358+0000","last_fullsized":"2024-07-26T08:29:37.000358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001367+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:29:37.001367+0000","last_peered":"2024-07-26T08:29:37.001367+0000","last_clean":"2024-07-26T08:29:37.001367+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:29:37.001367+0000","last_undegraded":"2024-07-26T08:29:37.001367+0000","last_fullsized":"2024-07-26T08:29:37.001367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-07-26T08:29:35.364966+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:29:35.364966+0000","last_peered":"2024-07-26T08:29:35.364966+0000","last_clean":"2024-07-26T08:29:35.364966+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:29:35.364966+0000","last_undegraded":"2024-07-26T08:29:35.364966+0000","last_fullsized":"2024-07-26T08:29:35.364966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65682,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":236,"num_read_kb":188,"num_write":168,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678057,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":525667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874286,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1732608,"data_stored":1188787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037813,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430272,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593796,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790027,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953554,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1032192,"data_stored":521273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378717,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1126400,"data_stored":594095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542243,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1101824,"data_stored":592745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:29:42.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph pg dump --format=json 2024-07-26T08:29:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:42 smithi133 ceph-mon[37053]: pgmap v381: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-07-26T08:29:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:42 smithi063 ceph-mon[36747]: pgmap v381: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-07-26T08:29:43.192 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:43.606 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:43 smithi043 ceph-mon[32384]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:29:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:43 smithi133 ceph-mon[37053]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:29:43.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:43 smithi063 ceph-mon[36747]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:29:44.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:44 smithi043 ceph-mon[32384]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-07-26T08:29:44.629 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:44 smithi043 ceph-mon[32384]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-07-26T08:29:44.629 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:44 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:29:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:44 smithi133 ceph-mon[37053]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-07-26T08:29:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:44 smithi133 ceph-mon[37053]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-07-26T08:29:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:44 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:29:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:44 smithi063 ceph-mon[36747]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-07-26T08:29:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:44 smithi063 ceph-mon[36747]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-07-26T08:29:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:44 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:29:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 -- 172.21.15.43:0/3449831718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 msgr2=0x7f18ac1122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 --2- 172.21.15.43:0/3449831718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1122a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009ca0 tx=0x7f18a402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 -- 172.21.15.43:0/3449831718 shutdown_connections 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 --2- 172.21.15.43:0/3449831718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 0x7f18ac10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 --2- 172.21.15.43:0/3449831718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1122a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 --2- 172.21.15.43:0/3449831718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ac1057e0 0x7f18ac105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 -- 172.21.15.43:0/3449831718 >> 172.21.15.43:0/3449831718 conn(0x7f18ac1011f0 msgr2=0x7f18ac103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.600+0000 7f18b4600640 1 -- 172.21.15.43:0/3449831718 shutdown_connections 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.601+0000 7f18b4600640 1 -- 172.21.15.43:0/3449831718 wait complete. 2024-07-26T08:29:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.602+0000 7f18b4600640 1 Processor -- start 2024-07-26T08:29:45.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.602+0000 7f18b4600640 1 -- start start 2024-07-26T08:29:45.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b4600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ac1057e0 0x7f18ac19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:45.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b4600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 0x7f18ac19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:45.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b4600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:45.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b4600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac115850 con 0x7f18ac10ba70 2024-07-26T08:29:45.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b4600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac1156d0 con 0x7f18ac1057e0 2024-07-26T08:29:45.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b4600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac1159d0 con 0x7f18ac10b120 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b2600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 0x7f18ac19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b2600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37166/0 (socket says 172.21.15.43:37166) 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ac1057e0 0x7f18ac19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.603+0000 7f18b2600640 1 -- 172.21.15.43:0/996336159 learned_addr learned my addr 172.21.15.43:0/996336159 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.604+0000 7f18b1200640 1 -- 172.21.15.43:0/996336159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ac1057e0 msgr2=0x7f18ac19c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.604+0000 7f18b1200640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ac1057e0 0x7f18ac19c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.604+0000 7f18b1200640 1 -- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 msgr2=0x7f18ac1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.604+0000 7f18b1200640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.604+0000 7f18b1200640 1 -- 172.21.15.43:0/996336159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac1a2170 con 0x7f18ac10b120 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.604+0000 7f18b1200640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 0x7f18ac19c7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f18ac06c3a0 tx=0x7f189800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.605+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189800cc40 con 0x7f18ac10b120 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.605+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f189800cde0 con 0x7f18ac10b120 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.605+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898018810 con 0x7f18ac10b120 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.605+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ac1a2460 con 0x7f18ac10b120 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.605+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ac1a8bc0 con 0x7f18ac10b120 2024-07-26T08:29:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.606+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ac105bf0 con 0x7f18ac10b120 2024-07-26T08:29:45.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.608+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f1898010b40 con 0x7f18ac10b120 2024-07-26T08:29:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.610+0000 7f18aa000640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18940b3cb0 0x7f18940b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.610+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f18980e4a70 con 0x7f18ac10b120 2024-07-26T08:29:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.610+0000 7f18b1c00640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18940b3cb0 0x7f18940b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:45.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.611+0000 7f18b1c00640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18940b3cb0 0x7f18940b61c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009bd0 tx=0x7f18a0005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:45.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.612+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f18980ab3f0 con 0x7f18ac10b120 2024-07-26T08:29:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.812+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18ac063230 con 0x7f18940b3cb0 2024-07-26T08:29:45.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.831+0000 7f18aa000640 1 -- 172.21.15.43:0/996336159 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340377 (secure 0 0 0) 0x7f18ac063230 con 0x7f18940b3cb0 2024-07-26T08:29:45.836 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:29:45.839 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:29:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18940b3cb0 msgr2=0x7f18940b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18940b3cb0 0x7f18940b61c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009bd0 tx=0x7f18a0005f90 comp rx=0 tx=0).stop 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 msgr2=0x7f18ac19c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 0x7f18ac19c7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f18ac06c3a0 tx=0x7f189800ee50 comp rx=0 tx=0).stop 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 shutdown_connections 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f18940b3cb0 0x7f18940b61c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18ac10b120 0x7f18ac19c7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18ac10ba70 0x7f18ac1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 --2- 172.21.15.43:0/996336159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ac1057e0 0x7f18ac19c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 >> 172.21.15.43:0/996336159 conn(0x7f18ac1011f0 msgr2=0x7f18ac108620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 shutdown_connections 2024-07-26T08:29:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:45.840+0000 7f18b4600640 1 -- 172.21.15.43:0/996336159 wait complete. 2024-07-26T08:29:46.622 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:46 smithi043 ceph-mon[32384]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-07-26T08:29:46.705 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-07-26T08:29:44.728743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656284,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":332,"num_read_kb":262,"num_write":293,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384304,"kb_used_data":14276,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557520,"statfs":{"total":1151940427776,"available":1151546900480,"internally_reserved":0,"allocated":14618624,"data_stored":8368994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9083,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":40,"num_write":6,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.371380"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372355+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372355+0000","last_peered":"2024-07-26T08:29:36.372355+0000","last_clean":"2024-07-26T08:29:36.372355+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372355+0000","last_undegraded":"2024-07-26T08:29:36.372355+0000","last_fullsized":"2024-07-26T08:29:36.372355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953206+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:29:36.953206+0000","last_peered":"2024-07-26T08:29:36.953206+0000","last_clean":"2024-07-26T08:29:36.953206+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:29:36.953206+0000","last_undegraded":"2024-07-26T08:29:36.953206+0000","last_fullsized":"2024-07-26T08:29:36.953206+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362122+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:29:36.362122+0000","last_peered":"2024-07-26T08:29:36.362122+0000","last_clean":"2024-07-26T08:29:36.362122+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:29:36.362122+0000","last_undegraded":"2024-07-26T08:29:36.362122+0000","last_fullsized":"2024-07-26T08:29:36.362122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954121+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954121+0000","last_peered":"2024-07-26T08:29:36.954121+0000","last_clean":"2024-07-26T08:29:36.954121+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954121+0000","last_undegraded":"2024-07-26T08:29:36.954121+0000","last_fullsized":"2024-07-26T08:29:36.954121+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.002057+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:29:37.002057+0000","last_peered":"2024-07-26T08:29:37.002057+0000","last_clean":"2024-07-26T08:29:37.002057+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:29:37.002057+0000","last_undegraded":"2024-07-26T08:29:37.002057+0000","last_fullsized":"2024-07-26T08:29:37.002057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683203+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:29:36.683203+0000","last_peered":"2024-07-26T08:29:36.683203+0000","last_clean":"2024-07-26T08:29:36.683203+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:29:36.683203+0000","last_undegraded":"2024-07-26T08:29:36.683203+0000","last_fullsized":"2024-07-26T08:29:36.683203+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916027+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:36.916027+0000","last_peered":"2024-07-26T08:29:36.916027+0000","last_clean":"2024-07-26T08:29:36.916027+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:36.916027+0000","last_undegraded":"2024-07-26T08:29:36.916027+0000","last_fullsized":"2024-07-26T08:29:36.916027+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949842+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:29:36.949842+0000","last_peered":"2024-07-26T08:29:36.949842+0000","last_clean":"2024-07-26T08:29:36.949842+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:29:36.949842+0000","last_undegraded":"2024-07-26T08:29:36.949842+0000","last_fullsized":"2024-07-26T08:29:36.949842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683663+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:29:36.683663+0000","last_peered":"2024-07-26T08:29:36.683663+0000","last_clean":"2024-07-26T08:29:36.683663+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:29:36.683663+0000","last_undegraded":"2024-07-26T08:29:36.683663+0000","last_fullsized":"2024-07-26T08:29:36.683663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916198+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:36.916198+0000","last_peered":"2024-07-26T08:29:36.916198+0000","last_clean":"2024-07-26T08:29:36.916198+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:36.916198+0000","last_undegraded":"2024-07-26T08:29:36.916198+0000","last_fullsized":"2024-07-26T08:29:36.916198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373254+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:29:36.373254+0000","last_peered":"2024-07-26T08:29:36.373254+0000","last_clean":"2024-07-26T08:29:36.373254+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:29:36.373254+0000","last_undegraded":"2024-07-26T08:29:36.373254+0000","last_fullsized":"2024-07-26T08:29:36.373254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683318+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:29:36.683318+0000","last_peered":"2024-07-26T08:29:36.683318+0000","last_clean":"2024-07-26T08:29:36.683318+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:29:36.683318+0000","last_undegraded":"2024-07-26T08:29:36.683318+0000","last_fullsized":"2024-07-26T08:29:36.683318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362478+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:29:36.362478+0000","last_peered":"2024-07-26T08:29:36.362478+0000","last_clean":"2024-07-26T08:29:36.362478+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:29:36.362478+0000","last_undegraded":"2024-07-26T08:29:36.362478+0000","last_fullsized":"2024-07-26T08:29:36.362478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915264+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:36.915264+0000","last_peered":"2024-07-26T08:29:36.915264+0000","last_clean":"2024-07-26T08:29:36.915264+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:36.915264+0000","last_undegraded":"2024-07-26T08:29:36.915264+0000","last_fullsized":"2024-07-26T08:29:36.915264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683586+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:29:36.683586+0000","last_peered":"2024-07-26T08:29:36.683586+0000","last_clean":"2024-07-26T08:29:36.683586+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:29:36.683586+0000","last_undegraded":"2024-07-26T08:29:36.683586+0000","last_fullsized":"2024-07-26T08:29:36.683586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952542+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:29:36.952542+0000","last_peered":"2024-07-26T08:29:36.952542+0000","last_clean":"2024-07-26T08:29:36.952542+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:29:36.952542+0000","last_undegraded":"2024-07-26T08:29:36.952542+0000","last_fullsized":"2024-07-26T08:29:36.952542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362324+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:36.362324+0000","last_peered":"2024-07-26T08:29:36.362324+0000","last_clean":"2024-07-26T08:29:36.362324+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:36.362324+0000","last_undegraded":"2024-07-26T08:29:36.362324+0000","last_fullsized":"2024-07-26T08:29:36.362324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683747+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:29:36.683747+0000","last_peered":"2024-07-26T08:29:36.683747+0000","last_clean":"2024-07-26T08:29:36.683747+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:29:36.683747+0000","last_undegraded":"2024-07-26T08:29:36.683747+0000","last_fullsized":"2024-07-26T08:29:36.683747+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371806+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:29:36.371806+0000","last_peered":"2024-07-26T08:29:36.371806+0000","last_clean":"2024-07-26T08:29:36.371806+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:29:36.371806+0000","last_undegraded":"2024-07-26T08:29:36.371806+0000","last_fullsized":"2024-07-26T08:29:36.371806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953022+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:36.953022+0000","last_peered":"2024-07-26T08:29:36.953022+0000","last_clean":"2024-07-26T08:29:36.953022+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:36.953022+0000","last_undegraded":"2024-07-26T08:29:36.953022+0000","last_fullsized":"2024-07-26T08:29:36.953022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371234+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:29:36.371234+0000","last_peered":"2024-07-26T08:29:36.371234+0000","last_clean":"2024-07-26T08:29:36.371234+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:29:36.371234+0000","last_undegraded":"2024-07-26T08:29:36.371234+0000","last_fullsized":"2024-07-26T08:29:36.371234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915167+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:29:36.915167+0000","last_peered":"2024-07-26T08:29:36.915167+0000","last_clean":"2024-07-26T08:29:36.915167+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:29:36.915167+0000","last_undegraded":"2024-07-26T08:29:36.915167+0000","last_fullsized":"2024-07-26T08:29:36.915167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949808+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:36.949808+0000","last_peered":"2024-07-26T08:29:36.949808+0000","last_clean":"2024-07-26T08:29:36.949808+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:36.949808+0000","last_undegraded":"2024-07-26T08:29:36.949808+0000","last_fullsized":"2024-07-26T08:29:36.949808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684005+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:29:36.684005+0000","last_peered":"2024-07-26T08:29:36.684005+0000","last_clean":"2024-07-26T08:29:36.684005+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:29:36.684005+0000","last_undegraded":"2024-07-26T08:29:36.684005+0000","last_fullsized":"2024-07-26T08:29:36.684005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001556+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:29:37.001556+0000","last_peered":"2024-07-26T08:29:37.001556+0000","last_clean":"2024-07-26T08:29:37.001556+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:29:37.001556+0000","last_undegraded":"2024-07-26T08:29:37.001556+0000","last_fullsized":"2024-07-26T08:29:37.001556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684523+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:36.684523+0000","last_peered":"2024-07-26T08:29:36.684523+0000","last_clean":"2024-07-26T08:29:36.684523+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:36.684523+0000","last_undegraded":"2024-07-26T08:29:36.684523+0000","last_fullsized":"2024-07-26T08:29:36.684523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362239+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:36.362239+0000","last_peered":"2024-07-26T08:29:36.362239+0000","last_clean":"2024-07-26T08:29:36.362239+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:36.362239+0000","last_undegraded":"2024-07-26T08:29:36.362239+0000","last_fullsized":"2024-07-26T08:29:36.362239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954206+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:29:36.954206+0000","last_peered":"2024-07-26T08:29:36.954206+0000","last_clean":"2024-07-26T08:29:36.954206+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:29:36.954206+0000","last_undegraded":"2024-07-26T08:29:36.954206+0000","last_fullsized":"2024-07-26T08:29:36.954206+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372875+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:29:36.372875+0000","last_peered":"2024-07-26T08:29:36.372875+0000","last_clean":"2024-07-26T08:29:36.372875+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:29:36.372875+0000","last_undegraded":"2024-07-26T08:29:36.372875+0000","last_fullsized":"2024-07-26T08:29:36.372875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.951769+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:36.951769+0000","last_peered":"2024-07-26T08:29:36.951769+0000","last_clean":"2024-07-26T08:29:36.951769+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:36.951769+0000","last_undegraded":"2024-07-26T08:29:36.951769+0000","last_fullsized":"2024-07-26T08:29:36.951769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367030+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:29:36.367030+0000","last_peered":"2024-07-26T08:29:36.367030+0000","last_clean":"2024-07-26T08:29:36.367030+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:29:36.367030+0000","last_undegraded":"2024-07-26T08:29:36.367030+0000","last_fullsized":"2024-07-26T08:29:36.367030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916186+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916186+0000","last_peered":"2024-07-26T08:29:36.916186+0000","last_clean":"2024-07-26T08:29:36.916186+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916186+0000","last_undegraded":"2024-07-26T08:29:36.916186+0000","last_fullsized":"2024-07-26T08:29:36.916186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371680+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:36.371680+0000","last_peered":"2024-07-26T08:29:36.371680+0000","last_clean":"2024-07-26T08:29:36.371680+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:36.371680+0000","last_undegraded":"2024-07-26T08:29:36.371680+0000","last_fullsized":"2024-07-26T08:29:36.371680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371728+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:29:36.371728+0000","last_peered":"2024-07-26T08:29:36.371728+0000","last_clean":"2024-07-26T08:29:36.371728+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:29:36.371728+0000","last_undegraded":"2024-07-26T08:29:36.371728+0000","last_fullsized":"2024-07-26T08:29:36.371728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370566+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370566+0000","last_peered":"2024-07-26T08:29:36.370566+0000","last_clean":"2024-07-26T08:29:36.370566+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370566+0000","last_undegraded":"2024-07-26T08:29:36.370566+0000","last_fullsized":"2024-07-26T08:29:36.370566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915219+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:36.915219+0000","last_peered":"2024-07-26T08:29:36.915219+0000","last_clean":"2024-07-26T08:29:36.915219+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:36.915219+0000","last_undegraded":"2024-07-26T08:29:36.915219+0000","last_fullsized":"2024-07-26T08:29:36.915219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.003210+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:29:37.003210+0000","last_peered":"2024-07-26T08:29:37.003210+0000","last_clean":"2024-07-26T08:29:37.003210+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:29:37.003210+0000","last_undegraded":"2024-07-26T08:29:37.003210+0000","last_fullsized":"2024-07-26T08:29:37.003210+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362690+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:36.362690+0000","last_peered":"2024-07-26T08:29:36.362690+0000","last_clean":"2024-07-26T08:29:36.362690+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:36.362690+0000","last_undegraded":"2024-07-26T08:29:36.362690+0000","last_fullsized":"2024-07-26T08:29:36.362690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366497+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:36.366497+0000","last_peered":"2024-07-26T08:29:36.366497+0000","last_clean":"2024-07-26T08:29:36.366497+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:36.366497+0000","last_undegraded":"2024-07-26T08:29:36.366497+0000","last_fullsized":"2024-07-26T08:29:36.366497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371812+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:29:36.371812+0000","last_peered":"2024-07-26T08:29:36.371812+0000","last_clean":"2024-07-26T08:29:36.371812+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:29:36.371812+0000","last_undegraded":"2024-07-26T08:29:36.371812+0000","last_fullsized":"2024-07-26T08:29:36.371812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:40.690592+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:29:40.690592+0000","last_peered":"2024-07-26T08:29:40.690592+0000","last_clean":"2024-07-26T08:29:40.690592+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:29:40.690592+0000","last_undegraded":"2024-07-26T08:29:40.690592+0000","last_fullsized":"2024-07-26T08:29:40.690592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367334+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:36.367334+0000","last_peered":"2024-07-26T08:29:36.367334+0000","last_clean":"2024-07-26T08:29:36.367334+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:36.367334+0000","last_undegraded":"2024-07-26T08:29:36.367334+0000","last_fullsized":"2024-07-26T08:29:36.367334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365499+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:29:36.365499+0000","last_peered":"2024-07-26T08:29:36.365499+0000","last_clean":"2024-07-26T08:29:36.365499+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:29:36.365499+0000","last_undegraded":"2024-07-26T08:29:36.365499+0000","last_fullsized":"2024-07-26T08:29:36.365499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362439+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362439+0000","last_peered":"2024-07-26T08:29:36.362439+0000","last_clean":"2024-07-26T08:29:36.362439+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362439+0000","last_undegraded":"2024-07-26T08:29:36.362439+0000","last_fullsized":"2024-07-26T08:29:36.362439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372384+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:29:36.372384+0000","last_peered":"2024-07-26T08:29:36.372384+0000","last_clean":"2024-07-26T08:29:36.372384+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:29:36.372384+0000","last_undegraded":"2024-07-26T08:29:36.372384+0000","last_fullsized":"2024-07-26T08:29:36.372384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953143+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:29:36.953143+0000","last_peered":"2024-07-26T08:29:36.953143+0000","last_clean":"2024-07-26T08:29:36.953143+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:29:36.953143+0000","last_undegraded":"2024-07-26T08:29:36.953143+0000","last_fullsized":"2024-07-26T08:29:36.953143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683931+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.683931+0000","last_peered":"2024-07-26T08:29:36.683931+0000","last_clean":"2024-07-26T08:29:36.683931+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.683931+0000","last_undegraded":"2024-07-26T08:29:36.683931+0000","last_fullsized":"2024-07-26T08:29:36.683931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":120,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362580+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:29:36.362580+0000","last_peered":"2024-07-26T08:29:36.362580+0000","last_clean":"2024-07-26T08:29:36.362580+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:29:36.362580+0000","last_undegraded":"2024-07-26T08:29:36.362580+0000","last_fullsized":"2024-07-26T08:29:36.362580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363010+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:36.363010+0000","last_peered":"2024-07-26T08:29:36.363010+0000","last_clean":"2024-07-26T08:29:36.363010+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:36.363010+0000","last_undegraded":"2024-07-26T08:29:36.363010+0000","last_fullsized":"2024-07-26T08:29:36.363010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363208+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:29:36.363208+0000","last_peered":"2024-07-26T08:29:36.363208+0000","last_clean":"2024-07-26T08:29:36.363208+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:29:36.363208+0000","last_undegraded":"2024-07-26T08:29:36.363208+0000","last_fullsized":"2024-07-26T08:29:36.363208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362745+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:36.362745+0000","last_peered":"2024-07-26T08:29:36.362745+0000","last_clean":"2024-07-26T08:29:36.362745+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:36.362745+0000","last_undegraded":"2024-07-26T08:29:36.362745+0000","last_fullsized":"2024-07-26T08:29:36.362745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949558+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:29:36.949558+0000","last_peered":"2024-07-26T08:29:36.949558+0000","last_clean":"2024-07-26T08:29:36.949558+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:29:36.949558+0000","last_undegraded":"2024-07-26T08:29:36.949558+0000","last_fullsized":"2024-07-26T08:29:36.949558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362919+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:29:36.362919+0000","last_peered":"2024-07-26T08:29:36.362919+0000","last_clean":"2024-07-26T08:29:36.362919+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:29:36.362919+0000","last_undegraded":"2024-07-26T08:29:36.362919+0000","last_fullsized":"2024-07-26T08:29:36.362919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373139+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:36.373139+0000","last_peered":"2024-07-26T08:29:36.373139+0000","last_clean":"2024-07-26T08:29:36.373139+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:36.373139+0000","last_undegraded":"2024-07-26T08:29:36.373139+0000","last_fullsized":"2024-07-26T08:29:36.373139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000692+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:29:37.000692+0000","last_peered":"2024-07-26T08:29:37.000692+0000","last_clean":"2024-07-26T08:29:37.000692+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:29:37.000692+0000","last_undegraded":"2024-07-26T08:29:37.000692+0000","last_fullsized":"2024-07-26T08:29:37.000692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363159+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:29:36.363159+0000","last_peered":"2024-07-26T08:29:36.363159+0000","last_clean":"2024-07-26T08:29:36.363159+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:29:36.363159+0000","last_undegraded":"2024-07-26T08:29:36.363159+0000","last_fullsized":"2024-07-26T08:29:36.363159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367344+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:36.367344+0000","last_peered":"2024-07-26T08:29:36.367344+0000","last_clean":"2024-07-26T08:29:36.367344+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:36.367344+0000","last_undegraded":"2024-07-26T08:29:36.367344+0000","last_fullsized":"2024-07-26T08:29:36.367344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371602+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:29:36.371602+0000","last_peered":"2024-07-26T08:29:36.371602+0000","last_clean":"2024-07-26T08:29:36.371602+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:29:36.371602+0000","last_undegraded":"2024-07-26T08:29:36.371602+0000","last_fullsized":"2024-07-26T08:29:36.371602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371949+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:29:36.371949+0000","last_peered":"2024-07-26T08:29:36.371949+0000","last_clean":"2024-07-26T08:29:36.371949+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:29:36.371949+0000","last_undegraded":"2024-07-26T08:29:36.371949+0000","last_fullsized":"2024-07-26T08:29:36.371949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916146+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:36.916146+0000","last_peered":"2024-07-26T08:29:36.916146+0000","last_clean":"2024-07-26T08:29:36.916146+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:36.916146+0000","last_undegraded":"2024-07-26T08:29:36.916146+0000","last_fullsized":"2024-07-26T08:29:36.916146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372231+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:29:36.372231+0000","last_peered":"2024-07-26T08:29:36.372231+0000","last_clean":"2024-07-26T08:29:36.372231+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:29:36.372231+0000","last_undegraded":"2024-07-26T08:29:36.372231+0000","last_fullsized":"2024-07-26T08:29:36.372231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372393+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:29:36.372393+0000","last_peered":"2024-07-26T08:29:36.372393+0000","last_clean":"2024-07-26T08:29:36.372393+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:29:36.372393+0000","last_undegraded":"2024-07-26T08:29:36.372393+0000","last_fullsized":"2024-07-26T08:29:36.372393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915149+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:36.915149+0000","last_peered":"2024-07-26T08:29:36.915149+0000","last_clean":"2024-07-26T08:29:36.915149+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:36.915149+0000","last_undegraded":"2024-07-26T08:29:36.915149+0000","last_fullsized":"2024-07-26T08:29:36.915149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367253+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:29:36.367253+0000","last_peered":"2024-07-26T08:29:36.367253+0000","last_clean":"2024-07-26T08:29:36.367253+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:29:36.367253+0000","last_undegraded":"2024-07-26T08:29:36.367253+0000","last_fullsized":"2024-07-26T08:29:36.367253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362329+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:29:36.362329+0000","last_peered":"2024-07-26T08:29:36.362329+0000","last_clean":"2024-07-26T08:29:36.362329+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:29:36.362329+0000","last_undegraded":"2024-07-26T08:29:36.362329+0000","last_fullsized":"2024-07-26T08:29:36.362329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.695678+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:29:42.695678+0000","last_peered":"2024-07-26T08:29:42.695678+0000","last_clean":"2024-07-26T08:29:42.695678+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:29:42.695678+0000","last_undegraded":"2024-07-26T08:29:42.695678+0000","last_fullsized":"2024-07-26T08:29:42.695678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371581+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:29:36.371581+0000","last_peered":"2024-07-26T08:29:36.371581+0000","last_clean":"2024-07-26T08:29:36.371581+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:29:36.371581+0000","last_undegraded":"2024-07-26T08:29:36.371581+0000","last_fullsized":"2024-07-26T08:29:36.371581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362756+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:29:36.362756+0000","last_peered":"2024-07-26T08:29:36.362756+0000","last_clean":"2024-07-26T08:29:36.362756+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:29:36.362756+0000","last_undegraded":"2024-07-26T08:29:36.362756+0000","last_fullsized":"2024-07-26T08:29:36.362756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373068+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:36.373068+0000","last_peered":"2024-07-26T08:29:36.373068+0000","last_clean":"2024-07-26T08:29:36.373068+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:36.373068+0000","last_undegraded":"2024-07-26T08:29:36.373068+0000","last_fullsized":"2024-07-26T08:29:36.373068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371979+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:29:36.371979+0000","last_peered":"2024-07-26T08:29:36.371979+0000","last_clean":"2024-07-26T08:29:36.371979+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:29:36.371979+0000","last_undegraded":"2024-07-26T08:29:36.371979+0000","last_fullsized":"2024-07-26T08:29:36.371979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365659+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:29:36.365659+0000","last_peered":"2024-07-26T08:29:36.365659+0000","last_clean":"2024-07-26T08:29:36.365659+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:29:36.365659+0000","last_undegraded":"2024-07-26T08:29:36.365659+0000","last_fullsized":"2024-07-26T08:29:36.365659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362433+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:36.362433+0000","last_peered":"2024-07-26T08:29:36.362433+0000","last_clean":"2024-07-26T08:29:36.362433+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:36.362433+0000","last_undegraded":"2024-07-26T08:29:36.362433+0000","last_fullsized":"2024-07-26T08:29:36.362433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372833+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:29:36.372833+0000","last_peered":"2024-07-26T08:29:36.372833+0000","last_clean":"2024-07-26T08:29:36.372833+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:29:36.372833+0000","last_undegraded":"2024-07-26T08:29:36.372833+0000","last_fullsized":"2024-07-26T08:29:36.372833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915707+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:29:36.915707+0000","last_peered":"2024-07-26T08:29:36.915707+0000","last_clean":"2024-07-26T08:29:36.915707+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:29:36.915707+0000","last_undegraded":"2024-07-26T08:29:36.915707+0000","last_fullsized":"2024-07-26T08:29:36.915707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:39.686893+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:29:39.686893+0000","last_peered":"2024-07-26T08:29:39.686893+0000","last_clean":"2024-07-26T08:29:39.686893+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:29:39.686893+0000","last_undegraded":"2024-07-26T08:29:39.686893+0000","last_fullsized":"2024-07-26T08:29:39.686893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62072,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":101,"num_write":34,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370536+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:29:36.370536+0000","last_peered":"2024-07-26T08:29:36.370536+0000","last_clean":"2024-07-26T08:29:36.370536+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:29:36.370536+0000","last_undegraded":"2024-07-26T08:29:36.370536+0000","last_fullsized":"2024-07-26T08:29:36.370536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949847+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:29:36.949847+0000","last_peered":"2024-07-26T08:29:36.949847+0000","last_clean":"2024-07-26T08:29:36.949847+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:29:36.949847+0000","last_undegraded":"2024-07-26T08:29:36.949847+0000","last_fullsized":"2024-07-26T08:29:36.949847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372987+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:36.372987+0000","last_peered":"2024-07-26T08:29:36.372987+0000","last_clean":"2024-07-26T08:29:36.372987+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:36.372987+0000","last_undegraded":"2024-07-26T08:29:36.372987+0000","last_fullsized":"2024-07-26T08:29:36.372987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683768+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:29:36.683768+0000","last_peered":"2024-07-26T08:29:36.683768+0000","last_clean":"2024-07-26T08:29:36.683768+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:29:36.683768+0000","last_undegraded":"2024-07-26T08:29:36.683768+0000","last_fullsized":"2024-07-26T08:29:36.683768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.002068+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:29:37.002068+0000","last_peered":"2024-07-26T08:29:37.002068+0000","last_clean":"2024-07-26T08:29:37.002068+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:29:37.002068+0000","last_undegraded":"2024-07-26T08:29:37.002068+0000","last_fullsized":"2024-07-26T08:29:37.002068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363036+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:36.363036+0000","last_peered":"2024-07-26T08:29:36.363036+0000","last_clean":"2024-07-26T08:29:36.363036+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:36.363036+0000","last_undegraded":"2024-07-26T08:29:36.363036+0000","last_fullsized":"2024-07-26T08:29:36.363036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.368872+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:29:36.368872+0000","last_peered":"2024-07-26T08:29:36.368872+0000","last_clean":"2024-07-26T08:29:36.368872+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:29:36.368872+0000","last_undegraded":"2024-07-26T08:29:36.368872+0000","last_fullsized":"2024-07-26T08:29:36.368872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.950166+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:29:36.950166+0000","last_peered":"2024-07-26T08:29:36.950166+0000","last_clean":"2024-07-26T08:29:36.950166+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:29:36.950166+0000","last_undegraded":"2024-07-26T08:29:36.950166+0000","last_fullsized":"2024-07-26T08:29:36.950166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:38.697082+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:29:38.697082+0000","last_peered":"2024-07-26T08:29:38.697082+0000","last_clean":"2024-07-26T08:29:38.697082+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:29:38.697082+0000","last_undegraded":"2024-07-26T08:29:38.697082+0000","last_fullsized":"2024-07-26T08:29:38.697082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952178+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:29:36.952178+0000","last_peered":"2024-07-26T08:29:36.952178+0000","last_clean":"2024-07-26T08:29:36.952178+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:29:36.952178+0000","last_undegraded":"2024-07-26T08:29:36.952178+0000","last_fullsized":"2024-07-26T08:29:36.952178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001028+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:37.001028+0000","last_peered":"2024-07-26T08:29:37.001028+0000","last_clean":"2024-07-26T08:29:37.001028+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:37.001028+0000","last_undegraded":"2024-07-26T08:29:37.001028+0000","last_fullsized":"2024-07-26T08:29:37.001028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.369102+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:29:36.369102+0000","last_peered":"2024-07-26T08:29:36.369102+0000","last_clean":"2024-07-26T08:29:36.369102+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:29:36.369102+0000","last_undegraded":"2024-07-26T08:29:36.369102+0000","last_fullsized":"2024-07-26T08:29:36.369102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372001+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:36.372001+0000","last_peered":"2024-07-26T08:29:36.372001+0000","last_clean":"2024-07-26T08:29:36.372001+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:36.372001+0000","last_undegraded":"2024-07-26T08:29:36.372001+0000","last_fullsized":"2024-07-26T08:29:36.372001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371899+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:36.371899+0000","last_peered":"2024-07-26T08:29:36.371899+0000","last_clean":"2024-07-26T08:29:36.371899+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:36.371899+0000","last_undegraded":"2024-07-26T08:29:36.371899+0000","last_fullsized":"2024-07-26T08:29:36.371899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953835+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:29:36.953835+0000","last_peered":"2024-07-26T08:29:36.953835+0000","last_clean":"2024-07-26T08:29:36.953835+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:29:36.953835+0000","last_undegraded":"2024-07-26T08:29:36.953835+0000","last_fullsized":"2024-07-26T08:29:36.953835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365551+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:36.365551+0000","last_peered":"2024-07-26T08:29:36.365551+0000","last_clean":"2024-07-26T08:29:36.365551+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:36.365551+0000","last_undegraded":"2024-07-26T08:29:36.365551+0000","last_fullsized":"2024-07-26T08:29:36.365551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371506+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:29:36.371506+0000","last_peered":"2024-07-26T08:29:36.371506+0000","last_clean":"2024-07-26T08:29:36.371506+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:29:36.371506+0000","last_undegraded":"2024-07-26T08:29:36.371506+0000","last_fullsized":"2024-07-26T08:29:36.371506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.685358+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:29:36.685358+0000","last_peered":"2024-07-26T08:29:36.685358+0000","last_clean":"2024-07-26T08:29:36.685358+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:29:36.685358+0000","last_undegraded":"2024-07-26T08:29:36.685358+0000","last_fullsized":"2024-07-26T08:29:36.685358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362465+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:29:36.362465+0000","last_peered":"2024-07-26T08:29:36.362465+0000","last_clean":"2024-07-26T08:29:36.362465+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:29:36.362465+0000","last_undegraded":"2024-07-26T08:29:36.362465+0000","last_fullsized":"2024-07-26T08:29:36.362465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:40.702514+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:29:40.702514+0000","last_peered":"2024-07-26T08:29:40.702514+0000","last_clean":"2024-07-26T08:29:40.702514+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:29:40.702514+0000","last_undegraded":"2024-07-26T08:29:40.702514+0000","last_fullsized":"2024-07-26T08:29:40.702514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915361+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:29:36.915361+0000","last_peered":"2024-07-26T08:29:36.915361+0000","last_clean":"2024-07-26T08:29:36.915361+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:29:36.915361+0000","last_undegraded":"2024-07-26T08:29:36.915361+0000","last_fullsized":"2024-07-26T08:29:36.915361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362561+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:29:36.362561+0000","last_peered":"2024-07-26T08:29:36.362561+0000","last_clean":"2024-07-26T08:29:36.362561+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:29:36.362561+0000","last_undegraded":"2024-07-26T08:29:36.362561+0000","last_fullsized":"2024-07-26T08:29:36.362561+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371724+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:29:36.371724+0000","last_peered":"2024-07-26T08:29:36.371724+0000","last_clean":"2024-07-26T08:29:36.371724+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:29:36.371724+0000","last_undegraded":"2024-07-26T08:29:36.371724+0000","last_fullsized":"2024-07-26T08:29:36.371724+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362510+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:29:36.362510+0000","last_peered":"2024-07-26T08:29:36.362510+0000","last_clean":"2024-07-26T08:29:36.362510+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:29:36.362510+0000","last_undegraded":"2024-07-26T08:29:36.362510+0000","last_fullsized":"2024-07-26T08:29:36.362510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362277+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:29:36.362277+0000","last_peered":"2024-07-26T08:29:36.362277+0000","last_clean":"2024-07-26T08:29:36.362277+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:29:36.362277+0000","last_undegraded":"2024-07-26T08:29:36.362277+0000","last_fullsized":"2024-07-26T08:29:36.362277+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000879+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:29:37.000879+0000","last_peered":"2024-07-26T08:29:37.000879+0000","last_clean":"2024-07-26T08:29:37.000879+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:29:37.000879+0000","last_undegraded":"2024-07-26T08:29:37.000879+0000","last_fullsized":"2024-07-26T08:29:37.000879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366755+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:29:36.366755+0000","last_peered":"2024-07-26T08:29:36.366755+0000","last_clean":"2024-07-26T08:29:36.366755+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:29:36.366755+0000","last_undegraded":"2024-07-26T08:29:36.366755+0000","last_fullsized":"2024-07-26T08:29:36.366755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916295+0000","last_change":"2024-07-26T08:29:36.916212+0000","last_active":"2024-07-26T08:29:36.916295+0000","last_peered":"2024-07-26T08:29:36.916295+0000","last_clean":"2024-07-26T08:29:36.916295+0000","last_became_active":"2024-07-26T08:29:36.915665+0000","last_became_peered":"2024-07-26T08:29:36.915665+0000","last_unstale":"2024-07-26T08:29:36.916295+0000","last_undegraded":"2024-07-26T08:29:36.916295+0000","last_fullsized":"2024-07-26T08:29:36.916295+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:54:03.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362827+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:29:36.362827+0000","last_peered":"2024-07-26T08:29:36.362827+0000","last_clean":"2024-07-26T08:29:36.362827+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:29:36.362827+0000","last_undegraded":"2024-07-26T08:29:36.362827+0000","last_fullsized":"2024-07-26T08:29:36.362827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.688765+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:29:36.688765+0000","last_peered":"2024-07-26T08:29:36.688765+0000","last_clean":"2024-07-26T08:29:36.688765+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:29:36.688765+0000","last_undegraded":"2024-07-26T08:29:36.688765+0000","last_fullsized":"2024-07-26T08:29:36.688765+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372166+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:29:36.372166+0000","last_peered":"2024-07-26T08:29:36.372166+0000","last_clean":"2024-07-26T08:29:36.372166+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:29:36.372166+0000","last_undegraded":"2024-07-26T08:29:36.372166+0000","last_fullsized":"2024-07-26T08:29:36.372166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952461+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:29:36.952461+0000","last_peered":"2024-07-26T08:29:36.952461+0000","last_clean":"2024-07-26T08:29:36.952461+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:29:36.952461+0000","last_undegraded":"2024-07-26T08:29:36.952461+0000","last_fullsized":"2024-07-26T08:29:36.952461+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949784+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:29:36.949784+0000","last_peered":"2024-07-26T08:29:36.949784+0000","last_clean":"2024-07-26T08:29:36.949784+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:29:36.949784+0000","last_undegraded":"2024-07-26T08:29:36.949784+0000","last_fullsized":"2024-07-26T08:29:36.949784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366227+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:29:36.366227+0000","last_peered":"2024-07-26T08:29:36.366227+0000","last_clean":"2024-07-26T08:29:36.366227+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:29:36.366227+0000","last_undegraded":"2024-07-26T08:29:36.366227+0000","last_fullsized":"2024-07-26T08:29:36.366227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372161+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:29:36.372161+0000","last_peered":"2024-07-26T08:29:36.372161+0000","last_clean":"2024-07-26T08:29:36.372161+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:29:36.372161+0000","last_undegraded":"2024-07-26T08:29:36.372161+0000","last_fullsized":"2024-07-26T08:29:36.372161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362708+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:29:36.362708+0000","last_peered":"2024-07-26T08:29:36.362708+0000","last_clean":"2024-07-26T08:29:36.362708+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:29:36.362708+0000","last_undegraded":"2024-07-26T08:29:36.362708+0000","last_fullsized":"2024-07-26T08:29:36.362708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372534+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:29:36.372534+0000","last_peered":"2024-07-26T08:29:36.372534+0000","last_clean":"2024-07-26T08:29:36.372534+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:29:36.372534+0000","last_undegraded":"2024-07-26T08:29:36.372534+0000","last_fullsized":"2024-07-26T08:29:36.372534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372392+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:29:36.372392+0000","last_peered":"2024-07-26T08:29:36.372392+0000","last_clean":"2024-07-26T08:29:36.372392+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:29:36.372392+0000","last_undegraded":"2024-07-26T08:29:36.372392+0000","last_fullsized":"2024-07-26T08:29:36.372392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949482+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:29:36.949482+0000","last_peered":"2024-07-26T08:29:36.949482+0000","last_clean":"2024-07-26T08:29:36.949482+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:29:36.949482+0000","last_undegraded":"2024-07-26T08:29:36.949482+0000","last_fullsized":"2024-07-26T08:29:36.949482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000062+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:29:37.000062+0000","last_peered":"2024-07-26T08:29:37.000062+0000","last_clean":"2024-07-26T08:29:37.000062+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:29:37.000062+0000","last_undegraded":"2024-07-26T08:29:37.000062+0000","last_fullsized":"2024-07-26T08:29:37.000062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000077+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:29:37.000077+0000","last_peered":"2024-07-26T08:29:37.000077+0000","last_clean":"2024-07-26T08:29:37.000077+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:29:37.000077+0000","last_undegraded":"2024-07-26T08:29:37.000077+0000","last_fullsized":"2024-07-26T08:29:37.000077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366110+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:29:36.366110+0000","last_peered":"2024-07-26T08:29:36.366110+0000","last_clean":"2024-07-26T08:29:36.366110+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:29:36.366110+0000","last_undegraded":"2024-07-26T08:29:36.366110+0000","last_fullsized":"2024-07-26T08:29:36.366110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684114+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:29:36.684114+0000","last_peered":"2024-07-26T08:29:36.684114+0000","last_clean":"2024-07-26T08:29:36.684114+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:29:36.684114+0000","last_undegraded":"2024-07-26T08:29:36.684114+0000","last_fullsized":"2024-07-26T08:29:36.684114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363178+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:29:36.363178+0000","last_peered":"2024-07-26T08:29:36.363178+0000","last_clean":"2024-07-26T08:29:36.363178+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:29:36.363178+0000","last_undegraded":"2024-07-26T08:29:36.363178+0000","last_fullsized":"2024-07-26T08:29:36.363178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372054+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:29:36.372054+0000","last_peered":"2024-07-26T08:29:36.372054+0000","last_clean":"2024-07-26T08:29:36.372054+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:29:36.372054+0000","last_undegraded":"2024-07-26T08:29:36.372054+0000","last_fullsized":"2024-07-26T08:29:36.372054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.950230+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:29:36.950230+0000","last_peered":"2024-07-26T08:29:36.950230+0000","last_clean":"2024-07-26T08:29:36.950230+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:29:36.950230+0000","last_undegraded":"2024-07-26T08:29:36.950230+0000","last_fullsized":"2024-07-26T08:29:36.950230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952188+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:29:36.952188+0000","last_peered":"2024-07-26T08:29:36.952188+0000","last_clean":"2024-07-26T08:29:36.952188+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:29:36.952188+0000","last_undegraded":"2024-07-26T08:29:36.952188+0000","last_fullsized":"2024-07-26T08:29:36.952188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362476+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:29:36.362476+0000","last_peered":"2024-07-26T08:29:36.362476+0000","last_clean":"2024-07-26T08:29:36.362476+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:29:36.362476+0000","last_undegraded":"2024-07-26T08:29:36.362476+0000","last_fullsized":"2024-07-26T08:29:36.362476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.917533+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:29:36.917533+0000","last_peered":"2024-07-26T08:29:36.917533+0000","last_clean":"2024-07-26T08:29:36.917533+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:29:36.917533+0000","last_undegraded":"2024-07-26T08:29:36.917533+0000","last_fullsized":"2024-07-26T08:29:36.917533+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915152+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:29:36.915152+0000","last_peered":"2024-07-26T08:29:36.915152+0000","last_clean":"2024-07-26T08:29:36.915152+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:29:36.915152+0000","last_undegraded":"2024-07-26T08:29:36.915152+0000","last_fullsized":"2024-07-26T08:29:36.915152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683926+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:29:36.683926+0000","last_peered":"2024-07-26T08:29:36.683926+0000","last_clean":"2024-07-26T08:29:36.683926+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:29:36.683926+0000","last_undegraded":"2024-07-26T08:29:36.683926+0000","last_fullsized":"2024-07-26T08:29:36.683926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000358+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:29:37.000358+0000","last_peered":"2024-07-26T08:29:37.000358+0000","last_clean":"2024-07-26T08:29:37.000358+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:29:37.000358+0000","last_undegraded":"2024-07-26T08:29:37.000358+0000","last_fullsized":"2024-07-26T08:29:37.000358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001367+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:29:37.001367+0000","last_peered":"2024-07-26T08:29:37.001367+0000","last_clean":"2024-07-26T08:29:37.001367+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:29:37.001367+0000","last_undegraded":"2024-07-26T08:29:37.001367+0000","last_fullsized":"2024-07-26T08:29:37.001367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372321+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:29:36.372321+0000","last_peered":"2024-07-26T08:29:36.372321+0000","last_clean":"2024-07-26T08:29:36.372321+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:29:36.372321+0000","last_undegraded":"2024-07-26T08:29:36.372321+0000","last_fullsized":"2024-07-26T08:29:36.372321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65682,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":251,"num_read_kb":193,"num_write":168,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":535351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874286,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1732608,"data_stored":1188787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037814,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430273,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790028,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32796,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712356,"statfs":{"total":95995035648,"available":95961452544,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953555,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149782,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":530957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378718,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1126400,"data_stored":594095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542243,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1101824,"data_stored":592745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:29:46.710 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-26T08:29:46.711 INFO:tasks.cephadm:Setting up client nodes... 2024-07-26T08:29:46.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-07-26T08:29:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:46 smithi133 ceph-mon[37053]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-07-26T08:29:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:46 smithi063 ceph-mon[36747]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-07-26T08:29:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:47.631 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:47 smithi043 ceph-mon[32384]: from='client.24964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:29:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:47 smithi133 ceph-mon[37053]: from='client.24964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:29:47.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:47 smithi063 ceph-mon[36747]: from='client.24964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:29:48.672 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:48 smithi043 ceph-mon[32384]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 493 B/s wr, 6 op/s 2024-07-26T08:29:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:48 smithi133 ceph-mon[37053]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 493 B/s wr, 6 op/s 2024-07-26T08:29:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:48 smithi063 ceph-mon[36747]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 493 B/s wr, 6 op/s 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 -- 172.21.15.43:0/2124427454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8109650 msgr2=0x7fe9a810fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 --2- 172.21.15.43:0/2124427454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8109650 0x7fe9a810fe80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009be0 tx=0x7fe9a002a6c0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 -- 172.21.15.43:0/2124427454 shutdown_connections 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 --2- 172.21.15.43:0/2124427454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a8108d00 0x7fe9a8109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 --2- 172.21.15.43:0/2124427454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8109650 0x7fe9a810fe80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 --2- 172.21.15.43:0/2124427454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a81037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 -- 172.21.15.43:0/2124427454 >> 172.21.15.43:0/2124427454 conn(0x7fe9a80fee10 msgr2=0x7fe9a8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:49.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 -- 172.21.15.43:0/2124427454 shutdown_connections 2024-07-26T08:29:49.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.589+0000 7fe9ae200640 1 -- 172.21.15.43:0/2124427454 wait complete. 2024-07-26T08:29:49.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.590+0000 7fe9ae200640 1 Processor -- start 2024-07-26T08:29:49.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 -- start start 2024-07-26T08:29:49.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:49.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8108d00 0x7fe9a819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:49.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a8109650 0x7fe9a81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:49.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8113430 con 0x7fe9a81033c0 2024-07-26T08:29:49.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a81132b0 con 0x7fe9a8108d00 2024-07-26T08:29:49.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ae200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a81135b0 con 0x7fe9a8109650 2024-07-26T08:29:49.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ace00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9a7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8108d00 0x7fe9a819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ace00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a819bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37178/0 (socket says 172.21.15.43:37178) 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.591+0000 7fe9ace00640 1 -- 172.21.15.43:0/4058118311 learned_addr learned my addr 172.21.15.43:0/4058118311 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ad800640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a8109650 0x7fe9a81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ace00640 1 -- 172.21.15.43:0/4058118311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a8109650 msgr2=0x7fe9a81a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ace00640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a8109650 0x7fe9a81a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ace00640 1 -- 172.21.15.43:0/4058118311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8108d00 msgr2=0x7fe9a819c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ace00640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8108d00 0x7fe9a819c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ace00640 1 -- 172.21.15.43:0/4058118311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a81a1f10 con 0x7fe9a81033c0 2024-07-26T08:29:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9a7e00640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8108d00 0x7fe9a819c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.592+0000 7fe9ace00640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a819bfa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e9c0 tx=0x7fe99c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.593+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00cde0 con 0x7fe9a81033c0 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.593+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a81a2200 con 0x7fe9a81033c0 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.593+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe99c0035f0 con 0x7fe9a81033c0 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.593+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c010670 con 0x7fe9a81033c0 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.593+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a81a8960 con 0x7fe9a81033c0 2024-07-26T08:29:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.594+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a81037d0 con 0x7fe9a81033c0 2024-07-26T08:29:49.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.597+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fe99c0037a0 con 0x7fe9a81033c0 2024-07-26T08:29:49.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.599+0000 7fe9a5600640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe9900b3ca0 0x7fe9900b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:49.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.599+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe99c0e46a0 con 0x7fe9a81033c0 2024-07-26T08:29:49.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.599+0000 7fe9a7e00640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe9900b3ca0 0x7fe9900b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:49.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.600+0000 7fe9a7e00640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe9900b3ca0 0x7fe9900b61b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe9980095f0 tx=0x7fe998005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:49.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.601+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe99c0ab700 con 0x7fe9a81033c0 2024-07-26T08:29:49.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.878+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe9a819d0d0 con 0x7fe9a81033c0 2024-07-26T08:29:49.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.882+0000 7fe9a5600640 1 -- 172.21.15.43:0/4058118311 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) ==== 170+0+59 (secure 0 0 0) 0x7fe99c0ab000 con 0x7fe9a81033c0 2024-07-26T08:29:49.884 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-07-26T08:29:49.884 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQB9XqNmEmlzNBAAbz4Y12DDN4zJS62U0xhqog== 2024-07-26T08:29:49.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe9900b3ca0 msgr2=0x7fe9900b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:49.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe9900b3ca0 0x7fe9900b61b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe9980095f0 tx=0x7fe998005f90 comp rx=0 tx=0).stop 2024-07-26T08:29:49.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 msgr2=0x7fe9a819bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:49.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a819bfa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e9c0 tx=0x7fe99c00ee80 comp rx=0 tx=0).stop 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 shutdown_connections 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe9900b3ca0 0x7fe9900b61b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a8109650 0x7fe9a81a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a8108d00 0x7fe9a819c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.886+0000 7fe9ae200640 1 --2- 172.21.15.43:0/4058118311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a81033c0 0x7fe9a819bfa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.887+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 >> 172.21.15.43:0/4058118311 conn(0x7fe9a80fee10 msgr2=0x7fe9a81072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.887+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 shutdown_connections 2024-07-26T08:29:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:49.887+0000 7fe9ae200640 1 -- 172.21.15.43:0/4058118311 wait complete. 2024-07-26T08:29:50.626 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:50 smithi043 ceph-mon[32384]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-07-26T08:29:50.627 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:50 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/4058118311' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-26T08:29:50.627 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:50 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/4058118311' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-26T08:29:50.706 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:29:50.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-07-26T08:29:50.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-07-26T08:29:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:50 smithi133 ceph-mon[37053]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-07-26T08:29:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:50 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/4058118311' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-26T08:29:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:50 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/4058118311' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-26T08:29:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:50 smithi063 ceph-mon[36747]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-07-26T08:29:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:50 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/4058118311' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-26T08:29:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:50 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/4058118311' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-26T08:29:50.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph config log 1 --format=json 2024-07-26T08:29:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:52 smithi043 ceph-mon[32384]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-07-26T08:29:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:52 smithi133 ceph-mon[37053]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-07-26T08:29:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:52 smithi063 ceph-mon[36747]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-07-26T08:29:53.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 -- 172.21.15.43:0/2934802007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20241057e0 msgr2=0x7f2024105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:53.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 --2- 172.21.15.43:0/2934802007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20241057e0 0x7f2024105bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2018009900 tx=0x7f201802a410 comp rx=0 tx=0).stop 2024-07-26T08:29:53.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 -- 172.21.15.43:0/2934802007 shutdown_connections 2024-07-26T08:29:53.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 --2- 172.21.15.43:0/2934802007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f202410b120 0x7f202410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:53.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 --2- 172.21.15.43:0/2934802007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f202410ba70 0x7f20241122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:53.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 --2- 172.21.15.43:0/2934802007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20241057e0 0x7f2024105bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:53.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 -- 172.21.15.43:0/2934802007 >> 172.21.15.43:0/2934802007 conn(0x7f20241011f0 msgr2=0x7f2024103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:53.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 -- 172.21.15.43:0/2934802007 shutdown_connections 2024-07-26T08:29:53.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.906+0000 7f202c800640 1 -- 172.21.15.43:0/2934802007 wait complete. 2024-07-26T08:29:53.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.907+0000 7f202c800640 1 Processor -- start 2024-07-26T08:29:53.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.907+0000 7f202c800640 1 -- start start 2024-07-26T08:29:53.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f202c800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 0x7f202419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:53.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f202c800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f202410b120 0x7f202419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:53.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f202c800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f202410ba70 0x7f20241a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:53.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f202c800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2024115850 con 0x7f202410b120 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f202c800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f20241156d0 con 0x7f20241057e0 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f202c800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f20241159d0 con 0x7f202410ba70 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f2029e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 0x7f202419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f2029e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 0x7f202419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49266/0 (socket says 172.21.15.43:49266) 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f2029400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f202410b120 0x7f202419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.908+0000 7f2029e00640 1 -- 172.21.15.43:0/3316215610 learned_addr learned my addr 172.21.15.43:0/3316215610 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f202a800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f202410ba70 0x7f20241a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f2029e00640 1 -- 172.21.15.43:0/3316215610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f202410ba70 msgr2=0x7f20241a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f2029e00640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f202410ba70 0x7f20241a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f2029e00640 1 -- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f202410b120 msgr2=0x7f202419c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f2029e00640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f202410b120 0x7f202419c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:53.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f2029e00640 1 -- 172.21.15.43:0/3316215610 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20241a2170 con 0x7f20241057e0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.909+0000 7f2029e00640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 0x7f202419c200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2018005ab0 tx=0x7f20180040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.910+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201803f030 con 0x7f20241057e0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.910+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20241a2400 con 0x7f20241057e0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.910+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2018003ac0 con 0x7f20241057e0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.910+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018035070 con 0x7f20241057e0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.910+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20241a8bc0 con 0x7f20241057e0 2024-07-26T08:29:53.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.911+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2024105bf0 con 0x7f20241057e0 2024-07-26T08:29:53.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.914+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f2018042030 con 0x7f20241057e0 2024-07-26T08:29:53.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.915+0000 7f201ea00640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f200c0b3d30 0x7f200c0b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:53.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.915+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f2018104bb0 con 0x7f20241057e0 2024-07-26T08:29:53.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.916+0000 7f2029400640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f200c0b3d30 0x7f200c0b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:53.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.916+0000 7f2029400640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f200c0b3d30 0x7f200c0b6240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2024103aa0 tx=0x7f2014005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:53.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:53.917+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f20180cb530 con 0x7f20241057e0 2024-07-26T08:29:54.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.120+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f202410d850 con 0x7f20241057e0 2024-07-26T08:29:54.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.121+0000 7f201ea00640 1 -- 172.21.15.43:0/3316215610 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7f20180cfa80 con 0x7f20241057e0 2024-07-26T08:29:54.123 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f200c0b3d30 msgr2=0x7f200c0b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f200c0b3d30 0x7f200c0b6240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2024103aa0 tx=0x7f2014005f90 comp rx=0 tx=0).stop 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 msgr2=0x7f202419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 0x7f202419c200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2018005ab0 tx=0x7f20180040c0 comp rx=0 tx=0).stop 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 shutdown_connections 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f200c0b3d30 0x7f200c0b6240 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:54.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f202410ba70 0x7f20241a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:54.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f202410b120 0x7f202419c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:54.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 --2- 172.21.15.43:0/3316215610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20241057e0 0x7f202419c200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:54.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.124+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 >> 172.21.15.43:0/3316215610 conn(0x7f20241011f0 msgr2=0x7f2024104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:54.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.125+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 shutdown_connections 2024-07-26T08:29:54.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:54.125+0000 7f202c800640 1 -- 172.21.15.43:0/3316215610 wait complete. 2024-07-26T08:29:54.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:54 smithi043 ceph-mon[32384]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:29:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:54 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3316215610' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-26T08:29:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:54 smithi133 ceph-mon[37053]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:29:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:54 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3316215610' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-26T08:29:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:54 smithi063 ceph-mon[36747]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:29:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:54 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3316215610' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-26T08:29:55.037 INFO:teuthology.orchestra.run.smithi043.stdout:[{"version":54,"timestamp":"2024-07-26T08:27:13.954517+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-07-26T08:29:55.038 INFO:tasks.ceph_manager:config epoch is 54 2024-07-26T08:29:55.038 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-07-26T08:29:55.038 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-07-26T08:29:55.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph mgr dump --format=json 2024-07-26T08:29:55.542 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:29:55.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:55 smithi133 ceph-mon[37053]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:29:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:55 smithi063 ceph-mon[36747]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:29:55.904 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:55 smithi043 ceph-mon[32384]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:29:57.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.976+0000 7efed6400640 1 -- 172.21.15.43:0/3270561293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed01055d0 msgr2=0x7efed01059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:57.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.976+0000 7efed6400640 1 --2- 172.21.15.43:0/3270561293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed01055d0 0x7efed01059e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efec0009900 tx=0x7efec002a410 comp rx=0 tx=0).stop 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.976+0000 7efed6400640 1 -- 172.21.15.43:0/3270561293 shutdown_connections 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.976+0000 7efed6400640 1 --2- 172.21.15.43:0/3270561293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed010af10 0x7efed010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.976+0000 7efed6400640 1 --2- 172.21.15.43:0/3270561293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efed010b860 0x7efed0112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.976+0000 7efed6400640 1 --2- 172.21.15.43:0/3270561293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed01055d0 0x7efed01059e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.977+0000 7efed6400640 1 -- 172.21.15.43:0/3270561293 >> 172.21.15.43:0/3270561293 conn(0x7efed0101040 msgr2=0x7efed0103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.977+0000 7efed6400640 1 -- 172.21.15.43:0/3270561293 shutdown_connections 2024-07-26T08:29:57.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.977+0000 7efed6400640 1 -- 172.21.15.43:0/3270561293 wait complete. 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.978+0000 7efed6400640 1 Processor -- start 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.978+0000 7efed6400640 1 -- start start 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed6400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed01055d0 0x7efed019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed6400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efed010af10 0x7efed019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed6400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 0x7efed01a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed6400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efed0115660 con 0x7efed010b860 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed6400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efed01154e0 con 0x7efed010af10 2024-07-26T08:29:57.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed6400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efed01157e0 con 0x7efed01055d0 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 0x7efed01a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed01055d0 0x7efed019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 0x7efed01a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57824/0 (socket says 172.21.15.43:57824) 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed01055d0 0x7efed019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:33436/0 (socket says 172.21.15.43:33436) 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5a00640 1 -- 172.21.15.43:0/3428767407 learned_addr learned my addr 172.21.15.43:0/3428767407 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efecfe00640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efed010af10 0x7efed019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5a00640 1 -- 172.21.15.43:0/3428767407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed01055d0 msgr2=0x7efed019c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.979+0000 7efed5a00640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed01055d0 0x7efed019c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efed5a00640 1 -- 172.21.15.43:0/3428767407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efed010af10 msgr2=0x7efed019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:57.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efed5a00640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efed010af10 0x7efed019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efed5a00640 1 -- 172.21.15.43:0/3428767407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed01a1fe0 con 0x7efed010b860 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efed5a00640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 0x7efed01a18b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efec800eb10 tx=0x7efec800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8004b20 con 0x7efed010b860 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efec8004cc0 con 0x7efed010b860 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed01a22d0 con 0x7efed010b860 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8010720 con 0x7efed010b860 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.980+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed01a8a30 con 0x7efed010b860 2024-07-26T08:29:57.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.982+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed01059e0 con 0x7efed010b860 2024-07-26T08:29:57.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.984+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7efec80108c0 con 0x7efed010b860 2024-07-26T08:29:57.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.986+0000 7efecd600640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efeb40b3cb0 0x7efeb40b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:29:57.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.986+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7efec80e4a10 con 0x7efed010b860 2024-07-26T08:29:57.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.986+0000 7efed5000640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efeb40b3cb0 0x7efeb40b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:29:57.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.987+0000 7efed5000640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efeb40b3cb0 0x7efeb40b61c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efec0009230 tx=0x7efec00058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:29:57.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:57.988+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7efec8055600 con 0x7efed010b860 2024-07-26T08:29:58.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:57 smithi063 ceph-mon[36747]: pgmap v389: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:29:58.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:57 smithi043 ceph-mon[32384]: pgmap v389: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:29:58.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.241+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7efed019d1a0 con 0x7efed010b860 2024-07-26T08:29:58.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.255+0000 7efecd600640 1 -- 172.21.15.43:0/3428767407 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+291034 (secure 0 0 0) 0x7efed019d1a0 con 0x7efed010b860 2024-07-26T08:29:58.261 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efeb40b3cb0 msgr2=0x7efeb40b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efeb40b3cb0 0x7efeb40b61c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efec0009230 tx=0x7efec00058d0 comp rx=0 tx=0).stop 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 msgr2=0x7efed01a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 0x7efed01a18b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efec800eb10 tx=0x7efec800c2d0 comp rx=0 tx=0).stop 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 shutdown_connections 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efeb40b3cb0 0x7efeb40b61c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed010b860 0x7efed01a18b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efed010af10 0x7efed019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 --2- 172.21.15.43:0/3428767407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed01055d0 0x7efed019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 >> 172.21.15.43:0/3428767407 conn(0x7efed0101040 msgr2=0x7efed0103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 shutdown_connections 2024-07-26T08:29:58.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:29:58.261+0000 7efed6400640 1 -- 172.21.15.43:0/3428767407 wait complete. 2024-07-26T08:29:58.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:57 smithi133 ceph-mon[37053]: pgmap v389: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:29:58.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:58 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3428767407' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-26T08:29:59.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:58 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3428767407' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-26T08:29:59.092 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"flags":0,"active_gid":24110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3495158800},{"type":"v1","addr":"172.21.15.43:6801","nonce":3495158800}]},"active_addr":"172.21.15.43:6801/3495158800","active_change":"2024-07-26T08:19:34.498245+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24152,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.43:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2218302798}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":598261277}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":298793317}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3165740017}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2480873355}]}]} 2024-07-26T08:29:59.099 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-07-26T08:29:59.099 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-07-26T08:29:59.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:29:59.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:58 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3428767407' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-26T08:29:59.608 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:00.025 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:29:59 smithi043 ceph-mon[32384]: pgmap v390: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:00.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:29:59 smithi063 ceph-mon[36747]: pgmap v390: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:00.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:29:59 smithi133 ceph-mon[37053]: pgmap v390: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:00 smithi043 ceph-mon[32384]: overall HEALTH_OK 2024-07-26T08:30:01.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:00 smithi133 ceph-mon[37053]: overall HEALTH_OK 2024-07-26T08:30:01.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:00 smithi063 ceph-mon[36747]: overall HEALTH_OK 2024-07-26T08:30:02.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 -- 172.21.15.43:0/1643679648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810b870 msgr2=0x7f76881120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:02.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 --2- 172.21.15.43:0/1643679648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810b870 0x7f76881120a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7680009ca0 tx=0x7f768002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 -- 172.21.15.43:0/1643679648 shutdown_connections 2024-07-26T08:30:02.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 --2- 172.21.15.43:0/1643679648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f768810af20 0x7f768810b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 --2- 172.21.15.43:0/1643679648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810b870 0x7f76881120a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 --2- 172.21.15.43:0/1643679648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f7688105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 -- 172.21.15.43:0/1643679648 >> 172.21.15.43:0/1643679648 conn(0x7f76881010c0 msgr2=0x7f7688103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:02.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 -- 172.21.15.43:0/1643679648 shutdown_connections 2024-07-26T08:30:02.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.998+0000 7f7687200640 1 -- 172.21.15.43:0/1643679648 wait complete. 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:01.999+0000 7f7687200640 1 Processor -- start 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 -- start start 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f768819bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810af20 0x7f768819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f768810b870 0x7f76881a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76881156c0 con 0x7f768810af20 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7688115540 con 0x7f7688105670 2024-07-26T08:30:02.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.000+0000 7f7687200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7688115840 con 0x7f768810b870 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f768819bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f768819bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:48978/0 (socket says 172.21.15.43:48978) 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 -- 172.21.15.43:0/455289960 learned_addr learned my addr 172.21.15.43:0/455289960 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f767d400640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810af20 0x7f768819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7686800640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f768810b870 0x7f76881a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 -- 172.21.15.43:0/455289960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f768810b870 msgr2=0x7f76881a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f768810b870 0x7f76881a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 -- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810af20 msgr2=0x7f768819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810af20 0x7f768819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.001+0000 7f7685e00640 1 -- 172.21.15.43:0/455289960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76881a1f20 con 0x7f7688105670 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.002+0000 7f7685e00640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f768819bfb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f767800d950 tx=0x7f767800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.002+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678017030 con 0x7f7688105670 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.002+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7678004020 con 0x7f7688105670 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.002+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76881a2210 con 0x7f7688105670 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.002+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76780047a0 con 0x7f7688105670 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.002+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76881a8970 con 0x7f7688105670 2024-07-26T08:30:02.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.003+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7688105a80 con 0x7f7688105670 2024-07-26T08:30:02.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.006+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f76780041d0 con 0x7f7688105670 2024-07-26T08:30:02.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.008+0000 7f767f400640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f766c0b3d30 0x7f766c0b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:02.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.008+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f76780e4320 con 0x7f7688105670 2024-07-26T08:30:02.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.008+0000 7f767d400640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f766c0b3d30 0x7f766c0b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:02.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.009+0000 7f767d400640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f766c0b3d30 0x7f766c0b6240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7688104970 tx=0x7f7670005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:02.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.009+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f76780ab370 con 0x7f7688105670 2024-07-26T08:30:02.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.214+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f768819d0e0 con 0x7f7688105670 2024-07-26T08:30:02.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:01 smithi043 ceph-mon[32384]: pgmap v391: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:02.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.216+0000 7f767f400640 1 -- 172.21.15.43:0/455289960 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7f76780aac70 con 0x7f7688105670 2024-07-26T08:30:02.219 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:30:02.219 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:30:02.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.220+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f766c0b3d30 msgr2=0x7f766c0b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:02.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.220+0000 7f7687200640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f766c0b3d30 0x7f766c0b6240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7688104970 tx=0x7f7670005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:02.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 msgr2=0x7f768819bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:02.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f768819bfb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f767800d950 tx=0x7f767800de10 comp rx=0 tx=0).stop 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 shutdown_connections 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f766c0b3d30 0x7f766c0b6240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f768810b870 0x7f76881a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f768810af20 0x7f768819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 --2- 172.21.15.43:0/455289960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7688105670 0x7f768819bfb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 >> 172.21.15.43:0/455289960 conn(0x7f76881010c0 msgr2=0x7f768810a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 shutdown_connections 2024-07-26T08:30:02.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:02.221+0000 7f7687200640 1 -- 172.21.15.43:0/455289960 wait complete. 2024-07-26T08:30:02.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:01 smithi133 ceph-mon[37053]: pgmap v391: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:02.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:01 smithi063 ceph-mon[36747]: pgmap v391: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:02.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:02 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/455289960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:30:03.043 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-07-26T08:30:03.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:30:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:02 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/455289960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:30:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:02 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/455289960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:30:03.541 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:03.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:03 smithi043 ceph-mon[32384]: pgmap v392: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:04.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:03 smithi133 ceph-mon[37053]: pgmap v392: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:03 smithi063 ceph-mon[36747]: pgmap v392: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:05.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 -- 172.21.15.43:0/2379751343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075180 msgr2=0x7fe690075590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:05.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 --2- 172.21.15.43:0/2379751343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075180 0x7fe690075590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe680009900 tx=0x7fe68002a410 comp rx=0 tx=0).stop 2024-07-26T08:30:05.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 -- 172.21.15.43:0/2379751343 shutdown_connections 2024-07-26T08:30:05.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 --2- 172.21.15.43:0/2379751343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 0x7fe690111dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 --2- 172.21.15.43:0/2379751343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075ad0 0x7fe69010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 --2- 172.21.15.43:0/2379751343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075180 0x7fe690075590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 -- 172.21.15.43:0/2379751343 >> 172.21.15.43:0/2379751343 conn(0x7fe6900fee30 msgr2=0x7fe690101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 -- 172.21.15.43:0/2379751343 shutdown_connections 2024-07-26T08:30:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.870+0000 7fe696400640 1 -- 172.21.15.43:0/2379751343 wait complete. 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 Processor -- start 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 -- start start 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075180 0x7fe69019bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 0x7fe69019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 0x7fe6901a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901156a0 con 0x7fe690075ad0 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe690115520 con 0x7fe690075180 2024-07-26T08:30:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.872+0000 7fe696400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe690115820 con 0x7fe69010f9a0 2024-07-26T08:30:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe687e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 0x7fe69019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 0x7fe6901a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe687e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 0x7fe69019c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49140/0 (socket says 172.21.15.43:49140) 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075180 0x7fe69019bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe687e00640 1 -- 172.21.15.43:0/1632876541 learned_addr learned my addr 172.21.15.43:0/1632876541 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695000640 1 -- 172.21.15.43:0/1632876541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 msgr2=0x7fe6901a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695000640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 0x7fe6901a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695000640 1 -- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 msgr2=0x7fe69019c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695000640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 0x7fe69019c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695000640 1 -- 172.21.15.43:0/1632876541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a1f30 con 0x7fe690075180 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe695a00640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 0x7fe6901a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.873+0000 7fe687e00640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 0x7fe69019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.874+0000 7fe695000640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075180 0x7fe69019bfc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe68002aa00 tx=0x7fe680003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.874+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68003f070 con 0x7fe690075180 2024-07-26T08:30:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.874+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe680031be0 con 0x7fe690075180 2024-07-26T08:30:05.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.874+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680035030 con 0x7fe690075180 2024-07-26T08:30:05.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.874+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a21c0 con 0x7fe690075180 2024-07-26T08:30:05.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.875+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a8980 con 0x7fe690075180 2024-07-26T08:30:05.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.876+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe690075590 con 0x7fe690075180 2024-07-26T08:30:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.878+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fe680042070 con 0x7fe690075180 2024-07-26T08:30:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.880+0000 7fe68e000640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6740b3d30 0x7fe6740b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.880+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe680104fe0 con 0x7fe690075180 2024-07-26T08:30:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.880+0000 7fe687e00640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6740b3d30 0x7fe6740b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.881+0000 7fe687e00640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6740b3d30 0x7fe6740b6240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe690111f70 tx=0x7fe67800b440 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:05.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:05.882+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe6800cb9c0 con 0x7fe690075180 2024-07-26T08:30:05.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:05 smithi043 ceph-mon[32384]: pgmap v393: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:06.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.088+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6901a8bb0 con 0x7fe690075180 2024-07-26T08:30:06.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.090+0000 7fe68e000640 1 -- 172.21.15.43:0/1632876541 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7fe6800cff10 con 0x7fe690075180 2024-07-26T08:30:06.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:30:06.092 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:30:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6740b3d30 msgr2=0x7fe6740b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6740b3d30 0x7fe6740b6240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe690111f70 tx=0x7fe67800b440 comp rx=0 tx=0).stop 2024-07-26T08:30:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075180 msgr2=0x7fe69019bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075180 0x7fe69019bfc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe68002aa00 tx=0x7fe680003bb0 comp rx=0 tx=0).stop 2024-07-26T08:30:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 shutdown_connections 2024-07-26T08:30:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6740b3d30 0x7fe6740b6240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69010f9a0 0x7fe6901a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe690075ad0 0x7fe69019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 --2- 172.21.15.43:0/1632876541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe690075180 0x7fe69019bfc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.093+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 >> 172.21.15.43:0/1632876541 conn(0x7fe6900fee30 msgr2=0x7fe6901018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.094+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 shutdown_connections 2024-07-26T08:30:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:06.094+0000 7fe696400640 1 -- 172.21.15.43:0/1632876541 wait complete. 2024-07-26T08:30:06.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:05 smithi133 ceph-mon[37053]: pgmap v393: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:06.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:05 smithi063 ceph-mon[36747]: pgmap v393: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:06.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-07-26T08:30:06.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-07-26T08:30:06.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-07-26T08:30:06.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-07-26T08:30:06.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-07-26T08:30:06.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-07-26T08:30:06.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-07-26T08:30:06.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-07-26T08:30:06.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-07-26T08:30:06.980 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-07-26T08:30:06.980 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-07-26T08:30:06.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-07-26T08:30:07.120 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:06 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1632876541' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:30:07.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:06 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1632876541' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:30:07.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:06 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1632876541' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:30:08.189 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.192 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.200 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.213 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.219 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.219 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.224 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.224 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:07 smithi043 ceph-mon[32384]: pgmap v394: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:08.241 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:08.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:07 smithi133 ceph-mon[37053]: pgmap v394: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:07 smithi063 ceph-mon[36747]: pgmap v394: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:09 smithi043 ceph-mon[32384]: pgmap v395: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:10.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:09 smithi133 ceph-mon[37053]: pgmap v395: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:10.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:09 smithi063 ceph-mon[36747]: pgmap v395: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:11.931 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:11 smithi043 ceph-mon[32384]: pgmap v396: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:12.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:11 smithi133 ceph-mon[37053]: pgmap v396: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:12.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:11 smithi063 ceph-mon[36747]: pgmap v396: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:13 smithi043 ceph-mon[32384]: pgmap v397: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:14.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:13 smithi133 ceph-mon[37053]: pgmap v397: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:14.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:13 smithi063 ceph-mon[36747]: pgmap v397: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:16.140 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:15 smithi043 ceph-mon[32384]: pgmap v398: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:15 smithi133 ceph-mon[37053]: pgmap v398: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:16.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:15 smithi063 ceph-mon[36747]: pgmap v398: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:18.066 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:17 smithi043 ceph-mon[32384]: pgmap v399: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:17 smithi133 ceph-mon[37053]: pgmap v399: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:17 smithi063 ceph-mon[36747]: pgmap v399: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:19.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 -- 172.21.15.43:0/3577007533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c109840 msgr2=0x7f469c110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 --2- 172.21.15.43:0/3577007533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c109840 0x7f469c110070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4698009ca0 tx=0x7f469802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 -- 172.21.15.43:0/3577007533 shutdown_connections 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 --2- 172.21.15.43:0/3577007533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c108ef0 0x7f469c109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 --2- 172.21.15.43:0/3577007533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c109840 0x7f469c110070 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 --2- 172.21.15.43:0/3577007533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f469c1035b0 0x7f469c1039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.635+0000 7f46a4800640 1 -- 172.21.15.43:0/3577007533 >> 172.21.15.43:0/3577007533 conn(0x7f469c0ff000 msgr2=0x7f469c101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.636+0000 7f46a4800640 1 -- 172.21.15.43:0/3577007533 shutdown_connections 2024-07-26T08:30:19.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.636+0000 7f46a4800640 1 -- 172.21.15.43:0/3577007533 wait complete. 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.637+0000 7f46a4800640 1 Processor -- start 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.637+0000 7f46a4800640 1 -- start start 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a4800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c1035b0 0x7f469c19c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a4800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c108ef0 0x7f469c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a4800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f469c109840 0x7f469c1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a4800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f469c113670 con 0x7f469c109840 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a4800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1134f0 con 0x7f469c108ef0 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a4800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1137f0 con 0x7f469c1035b0 2024-07-26T08:30:19.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c1035b0 0x7f469c19c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c108ef0 0x7f469c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c1035b0 0x7f469c19c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:38586/0 (socket says 172.21.15.43:38586) 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a1e00640 1 -- 172.21.15.43:0/332575229 learned_addr learned my addr 172.21.15.43:0/332575229 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.638+0000 7f46a2800640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f469c109840 0x7f469c1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1e00640 1 -- 172.21.15.43:0/332575229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c108ef0 msgr2=0x7f469c19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1e00640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c108ef0 0x7f469c19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1e00640 1 -- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f469c109840 msgr2=0x7f469c1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1e00640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f469c109840 0x7f469c1a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1e00640 1 -- 172.21.15.43:0/332575229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c1a2110 con 0x7f469c1035b0 2024-07-26T08:30:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1400640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f469c108ef0 0x7f469c19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a1e00640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c1035b0 0x7f469c19c1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f469000d950 tx=0x7f469000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690017030 con 0x7f469c1035b0 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c1a2400 con 0x7f469c1035b0 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4690004020 con 0x7f469c1035b0 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.639+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900047a0 con 0x7f469c1035b0 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.640+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c1a8b60 con 0x7f469c1035b0 2024-07-26T08:30:19.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.640+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f469c10f690 con 0x7f469c1035b0 2024-07-26T08:30:19.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.643+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f46900041d0 con 0x7f469c1035b0 2024-07-26T08:30:19.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.645+0000 7f4696a00640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f46840b3cb0 0x7f46840b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:19.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.645+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f46900e4380 con 0x7f469c1035b0 2024-07-26T08:30:19.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.645+0000 7f46a1400640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f46840b3cb0 0x7f46840b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:19.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.645+0000 7f4696a00640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] conn(0x7f46840bf3d0 0x7f46840c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:19.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.645+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 --> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46840c1f90 con 0x7f46840bf3d0 2024-07-26T08:30:19.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.645+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f46900e4730 con 0x7f469c1035b0 2024-07-26T08:30:19.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.646+0000 7f46a2800640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] conn(0x7f46840bf3d0 0x7f46840c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:19.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.646+0000 7f46a1400640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f46840b3cb0 0x7f46840b61c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f469c1054b0 tx=0x7f468c00b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:19.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.646+0000 7f46a2800640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] conn(0x7f46840bf3d0 0x7f46840c18c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:19.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.647+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== osd.9 v2:172.21.15.43:6826/2141095989 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46840c1f90 con 0x7f46840bf3d0 2024-07-26T08:30:19.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.665+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 --> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f469c104830 con 0x7f46840bf3d0 2024-07-26T08:30:19.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f4696a00640 1 -- 172.21.15.43:0/332575229 <== osd.9 v2:172.21.15.43:6826/2141095989 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f469c104830 con 0x7f46840bf3d0 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] conn(0x7f46840bf3d0 msgr2=0x7f46840c18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a4800640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] conn(0x7f46840bf3d0 0x7f46840c18c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f46840b3cb0 msgr2=0x7f46840b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a4800640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f46840b3cb0 0x7f46840b61c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f469c1054b0 tx=0x7f468c00b390 comp rx=0 tx=0).stop 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c1035b0 msgr2=0x7f469c19c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a4800640 1 --2- 172.21.15.43:0/332575229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c1035b0 0x7f469c19c1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f469000d950 tx=0x7f469000de10 comp rx=0 tx=0).stop 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.666+0000 7f46a2800640 1 -- 172.21.15.43:0/332575229 reap_dead start 2024-07-26T08:30:19.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.667+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 shutdown_connections 2024-07-26T08:30:19.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.667+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 >> 172.21.15.43:0/332575229 conn(0x7f469c0ff000 msgr2=0x7f469c107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:19.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.667+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 shutdown_connections 2024-07-26T08:30:19.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:19.667+0000 7f46a4800640 1 -- 172.21.15.43:0/332575229 wait complete. 2024-07-26T08:30:20.204 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:19 smithi043 ceph-mon[32384]: pgmap v400: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:20.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:19 smithi133 ceph-mon[37053]: pgmap v400: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:20.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:19 smithi063 ceph-mon[36747]: pgmap v400: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 -- 172.21.15.43:0/2816315622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c102490 msgr2=0x7f851c1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 --2- 172.21.15.43:0/2816315622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c102490 0x7f851c1028a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8510009900 tx=0x7f851002a410 comp rx=0 tx=0).stop 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 -- 172.21.15.43:0/2816315622 shutdown_connections 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 --2- 172.21.15.43:0/2816315622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c108720 0x7f851c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 --2- 172.21.15.43:0/2816315622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f851c107dd0 0x7f851c1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 --2- 172.21.15.43:0/2816315622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c102490 0x7f851c1028a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.978+0000 7f8523400640 1 -- 172.21.15.43:0/2816315622 >> 172.21.15.43:0/2816315622 conn(0x7f851c079160 msgr2=0x7f851c079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.979+0000 7f8523400640 1 -- 172.21.15.43:0/2816315622 shutdown_connections 2024-07-26T08:30:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.979+0000 7f8523400640 1 -- 172.21.15.43:0/2816315622 wait complete. 2024-07-26T08:30:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.980+0000 7f8523400640 1 Processor -- start 2024-07-26T08:30:20.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.980+0000 7f8523400640 1 -- start start 2024-07-26T08:30:20.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.981+0000 7f8523400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c102490 0x7f851c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:20.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.981+0000 7f8523400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f851c107dd0 0x7f851c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:20.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.981+0000 7f8523400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c108720 0x7f851c19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:20.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.981+0000 7f8523400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1124d0 con 0x7f851c108720 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.981+0000 7f8523400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f851c112350 con 0x7f851c107dd0 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.981+0000 7f8523400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f851c112650 con 0x7f851c102490 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c102490 0x7f851c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c102490 0x7f851c19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:38628/0 (socket says 172.21.15.43:38628) 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 -- 172.21.15.43:0/972820333 learned_addr learned my addr 172.21.15.43:0/972820333 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8521400640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c108720 0x7f851c19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f851be00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f851c107dd0 0x7f851c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 -- 172.21.15.43:0/972820333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f851c107dd0 msgr2=0x7f851c19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:20.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f851c107dd0 0x7f851c19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:20.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 -- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c108720 msgr2=0x7f851c19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:20.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f851c108720 0x7f851c19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:20.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f8520a00640 1 -- 172.21.15.43:0/972820333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c1a5fe0 con 0x7f851c102490 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.982+0000 7f851be00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f851c107dd0 0x7f851c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.983+0000 7f8520a00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c102490 0x7f851c19ad20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8510005ab0 tx=0x7f85100040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.983+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851003f030 con 0x7f851c102490 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.983+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8510003ac0 con 0x7f851c102490 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.983+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510035070 con 0x7f851c102490 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.983+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c198b10 con 0x7f851c102490 2024-07-26T08:30:20.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.984+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c198fa0 con 0x7f851c102490 2024-07-26T08:30:20.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.985+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f851c063580 con 0x7f851c102490 2024-07-26T08:30:20.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.987+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f8510042030 con 0x7f851c102490 2024-07-26T08:30:20.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.989+0000 7f8519600640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f85040b3d30 0x7f85040b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:20.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.989+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f8510104d50 con 0x7f851c102490 2024-07-26T08:30:20.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.989+0000 7f851be00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f85040b3d30 0x7f85040b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:20.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.990+0000 7f8519600640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] conn(0x7f85040bf450 0x7f85040c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:20.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.990+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 --> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f851003ce50 con 0x7f85040bf450 2024-07-26T08:30:20.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.990+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8510105100 con 0x7f851c102490 2024-07-26T08:30:20.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.990+0000 7f8521400640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] conn(0x7f85040bf450 0x7f85040c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:20.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.990+0000 7f851be00640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f85040b3d30 0x7f85040b6240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f851c0795f0 tx=0x7f8508012040 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:20.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.991+0000 7f8521400640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] conn(0x7f85040bf450 0x7f85040c1940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:20.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.992+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== osd.6 v2:172.21.15.43:6818/4290651023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f851003ce50 con 0x7f85040bf450 2024-07-26T08:30:21.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.007+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 --> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f851c0639d0 con 0x7f85040bf450 2024-07-26T08:30:21.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.007+0000 7f8519600640 1 -- 172.21.15.43:0/972820333 <== osd.6 v2:172.21.15.43:6818/4290651023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f851c0639d0 con 0x7f85040bf450 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] conn(0x7f85040bf450 msgr2=0x7f85040c1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] conn(0x7f85040bf450 0x7f85040c1940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f85040b3d30 msgr2=0x7f85040b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f85040b3d30 0x7f85040b6240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f851c0795f0 tx=0x7f8508012040 comp rx=0 tx=0).stop 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c102490 msgr2=0x7f851c19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 --2- 172.21.15.43:0/972820333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851c102490 0x7f851c19ad20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8510005ab0 tx=0x7f85100040c0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8521400640 1 -- 172.21.15.43:0/972820333 reap_dead start 2024-07-26T08:30:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 shutdown_connections 2024-07-26T08:30:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.008+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 >> 172.21.15.43:0/972820333 conn(0x7f851c079160 msgr2=0x7f851c100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.009+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 shutdown_connections 2024-07-26T08:30:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:21.009+0000 7f8523400640 1 -- 172.21.15.43:0/972820333 wait complete. 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 -- 172.21.15.43:0/1680188629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1640751e0 msgr2=0x7fa1640755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 --2- 172.21.15.43:0/1680188629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1640751e0 0x7fa1640755f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa154009860 tx=0x7fa15402a340 comp rx=0 tx=0).stop 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 -- 172.21.15.43:0/1680188629 shutdown_connections 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 --2- 172.21.15.43:0/1680188629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa16410f940 0x7fa164111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 --2- 172.21.15.43:0/1680188629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa164075b30 0x7fa16410f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 --2- 172.21.15.43:0/1680188629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa1640751e0 0x7fa1640755f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 -- 172.21.15.43:0/1680188629 >> 172.21.15.43:0/1680188629 conn(0x7fa1640fee70 msgr2=0x7fa1641012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 -- 172.21.15.43:0/1680188629 shutdown_connections 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.886+0000 7fa169a00640 1 -- 172.21.15.43:0/1680188629 wait complete. 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.887+0000 7fa169a00640 1 Processor -- start 2024-07-26T08:30:21.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.887+0000 7fa169a00640 1 -- start start 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1640751e0 0x7fa16419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa164075b30 0x7fa16419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa16410f940 0x7fa1641a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa164115610 con 0x7fa1640751e0 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa164115490 con 0x7fa164075b30 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa164115790 con 0x7fa16410f940 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa163e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1640751e0 0x7fa16419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa163400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa164075b30 0x7fa16419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa163e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1640751e0 0x7fa16419bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45410/0 (socket says 172.21.15.43:45410) 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa163400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa164075b30 0x7fa16419c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:44378/0 (socket says 172.21.15.43:44378) 2024-07-26T08:30:21.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa163e00640 1 -- 172.21.15.43:0/3834335576 learned_addr learned my addr 172.21.15.43:0/3834335576 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.888+0000 7fa169000640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa16410f940 0x7fa1641a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.889+0000 7fa163400640 1 -- 172.21.15.43:0/3834335576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa16410f940 msgr2=0x7fa1641a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.889+0000 7fa163400640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa16410f940 0x7fa1641a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.889+0000 7fa163400640 1 -- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1640751e0 msgr2=0x7fa16419bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.889+0000 7fa163400640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1640751e0 0x7fa16419bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.889+0000 7fa163400640 1 -- 172.21.15.43:0/3834335576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1641a1ef0 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.889+0000 7fa163400640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa164075b30 0x7fa16419c520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa16406b130 tx=0x7fa15000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.890+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150004440 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.890+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1641a21e0 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.890+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa15000cd90 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.890+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1500196e0 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.890+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1641a8940 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.891+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa164109e40 con 0x7fa164075b30 2024-07-26T08:30:21.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.894+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fa1500037a0 con 0x7fa164075b30 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa160c00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa1480b3cb0 0x7fa1480b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fa1500e48c0 con 0x7fa164075b30 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa163e00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa1480b3cb0 0x7fa1480b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa160c00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] conn(0x7fa1480bf350 0x7fa1480c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 --> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1480c1f10 con 0x7fa1480bf350 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa1500a70e0 con 0x7fa164075b30 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.896+0000 7fa169000640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] conn(0x7fa1480bf350 0x7fa1480c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.897+0000 7fa163e00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa1480b3cb0 0x7fa1480b61c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1540057c0 tx=0x7fa1540056d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.897+0000 7fa169000640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] conn(0x7fa1480bf350 0x7fa1480c1840 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.898+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== osd.0 v2:172.21.15.43:6802/4198258089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1480c1f10 con 0x7fa1480bf350 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.914+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 --> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1640766f0 con 0x7fa1480bf350 2024-07-26T08:30:21.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.915+0000 7fa160c00640 1 -- 172.21.15.43:0/3834335576 <== osd.0 v2:172.21.15.43:6802/4198258089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1640766f0 con 0x7fa1480bf350 2024-07-26T08:30:21.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.915+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] conn(0x7fa1480bf350 msgr2=0x7fa1480c1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.915+0000 7fa169a00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] conn(0x7fa1480bf350 0x7fa1480c1840 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa1480b3cb0 msgr2=0x7fa1480b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa1480b3cb0 0x7fa1480b61c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1540057c0 tx=0x7fa1540056d0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa164075b30 msgr2=0x7fa16419c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 --2- 172.21.15.43:0/3834335576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa164075b30 0x7fa16419c520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa16406b130 tx=0x7fa15000ee50 comp rx=0 tx=0).stop 2024-07-26T08:30:21.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169000640 1 -- 172.21.15.43:0/3834335576 reap_dead start 2024-07-26T08:30:21.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 shutdown_connections 2024-07-26T08:30:21.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 >> 172.21.15.43:0/3834335576 conn(0x7fa1640fee70 msgr2=0x7fa1641093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:21.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 shutdown_connections 2024-07-26T08:30:21.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:20.916+0000 7fa169a00640 1 -- 172.21.15.43:0/3834335576 wait complete. 2024-07-26T08:30:21.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 -- 172.21.15.43:0/3285217040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010af10 msgr2=0x7f8e0010b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 --2- 172.21.15.43:0/3285217040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010af10 0x7f8e0010b320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009900 tx=0x7f8dec02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 -- 172.21.15.43:0/3285217040 shutdown_connections 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 --2- 172.21.15.43:0/3285217040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e0010b860 0x7f8e00112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 --2- 172.21.15.43:0/3285217040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010af10 0x7f8e0010b320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 --2- 172.21.15.43:0/3285217040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e001055d0 0x7f8e001059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 -- 172.21.15.43:0/3285217040 >> 172.21.15.43:0/3285217040 conn(0x7f8e00101040 msgr2=0x7f8e00103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 -- 172.21.15.43:0/3285217040 shutdown_connections 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.063+0000 7f8e07000640 1 -- 172.21.15.43:0/3285217040 wait complete. 2024-07-26T08:30:21.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.065+0000 7f8e07000640 1 Processor -- start 2024-07-26T08:30:21.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 -- start start 2024-07-26T08:30:21.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e001055d0 0x7f8e0007b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e0010af10 0x7f8e00077350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010b860 0x7f8e00077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00115640 con 0x7f8e0010af10 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001154c0 con 0x7f8e0010b860 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.066+0000 7f8e07000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001157c0 con 0x7f8e001055d0 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.067+0000 7f8e06600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010b860 0x7f8e00077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.067+0000 7f8e05c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e001055d0 0x7f8e0007b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.067+0000 7f8e06600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010b860 0x7f8e00077a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:44352/0 (socket says 172.21.15.43:44352) 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.067+0000 7f8e06600640 1 -- 172.21.15.43:0/3555660687 learned_addr learned my addr 172.21.15.43:0/3555660687 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.067+0000 7f8e05200640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e0010af10 0x7f8e00077350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.068+0000 7f8e05200640 1 -- 172.21.15.43:0/3555660687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e001055d0 msgr2=0x7f8e0007b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.068+0000 7f8e05200640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e001055d0 0x7f8e0007b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.068+0000 7f8e05200640 1 -- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010b860 msgr2=0x7f8e00077a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.068+0000 7f8e05200640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0010b860 0x7f8e00077a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.068+0000 7f8e05200640 1 -- 172.21.15.43:0/3555660687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e00073a80 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.068+0000 7f8e05200640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e0010af10 0x7f8e00077350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8dec02a910 tx=0x7f8dec004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.069+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec03f030 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.069+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8dec004440 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.069+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec035070 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.071+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e00073d10 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.071+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e00074170 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.072+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e000747b0 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.076+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f8dec042030 con 0x7f8e0010af10 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.078+0000 7f8dfe000640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8de80b3cb0 0x7f8de80b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.079+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f8dec105100 con 0x7f8e0010af10 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.079+0000 7f8e05c00640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8de80b3cb0 0x7f8de80b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.079+0000 7f8dfe000640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] conn(0x7f8de80bf3d0 0x7f8de80c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.079+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 --> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8dec040e70 con 0x7f8de80bf3d0 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.079+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8dec1054b0 con 0x7f8e0010af10 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.079+0000 7f8e06600640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] conn(0x7f8de80bf3d0 0x7f8de80c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.080+0000 7f8e05c00640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8de80b3cb0 0x7f8de80b61c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e0007adc0 tx=0x7f8df4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.080+0000 7f8e06600640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] conn(0x7f8de80bf3d0 0x7f8de80c18c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.081+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== osd.7 v2:172.21.15.63:6816/2487519 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8dec040e70 con 0x7f8de80bf3d0 2024-07-26T08:30:21.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.103+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 --> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e00074bb0 con 0x7f8de80bf3d0 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8dfe000640 1 -- 172.21.15.43:0/3555660687 <== osd.7 v2:172.21.15.63:6816/2487519 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8e00074bb0 con 0x7f8de80bf3d0 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] conn(0x7f8de80bf3d0 msgr2=0x7f8de80c18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e07000640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] conn(0x7f8de80bf3d0 0x7f8de80c18c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8de80b3cb0 msgr2=0x7f8de80b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e07000640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8de80b3cb0 0x7f8de80b61c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e0007adc0 tx=0x7f8df4005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e0010af10 msgr2=0x7f8e00077350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e07000640 1 --2- 172.21.15.43:0/3555660687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e0010af10 0x7f8e00077350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8dec02a910 tx=0x7f8dec004040 comp rx=0 tx=0).stop 2024-07-26T08:30:21.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.104+0000 7f8e06600640 1 -- 172.21.15.43:0/3555660687 reap_dead start 2024-07-26T08:30:21.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.105+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 shutdown_connections 2024-07-26T08:30:21.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.105+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 >> 172.21.15.43:0/3555660687 conn(0x7f8e00101040 msgr2=0x7f8e00103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:21.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.105+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 shutdown_connections 2024-07-26T08:30:21.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:18.105+0000 7f8e07000640 1 -- 172.21.15.43:0/3555660687 wait complete. 2024-07-26T08:30:22.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:21 smithi043 ceph-mon[32384]: pgmap v401: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:21 smithi133 ceph-mon[37053]: pgmap v401: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:22.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:21 smithi063 ceph-mon[36747]: pgmap v401: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:23 smithi043 ceph-mon[32384]: pgmap v402: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:23 smithi133 ceph-mon[37053]: pgmap v402: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:24.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:23 smithi063 ceph-mon[36747]: pgmap v402: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:24.872 INFO:teuthology.orchestra.run.smithi043.stdout:184683593805 2024-07-26T08:30:24.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-07-26T08:30:25.786 INFO:teuthology.orchestra.run.smithi043.stdout:206158430281 2024-07-26T08:30:25.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-07-26T08:30:25.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:25 smithi043 ceph-mon[32384]: pgmap v403: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:26.124 INFO:teuthology.orchestra.run.smithi043.stdout:38654705776 2024-07-26T08:30:26.124 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-07-26T08:30:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:25 smithi133 ceph-mon[37053]: pgmap v403: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:25 smithi063 ceph-mon[36747]: pgmap v403: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:26.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 -- 172.21.15.43:0/28718985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 msgr2=0x7fdedc10b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:26.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 --2- 172.21.15.43:0/28718985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 0x7fdedc10b320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009900 tx=0x7fdec802a400 comp rx=0 tx=0).stop 2024-07-26T08:30:26.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 -- 172.21.15.43:0/28718985 shutdown_connections 2024-07-26T08:30:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 --2- 172.21.15.43:0/28718985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc10b860 0x7fdedc112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 --2- 172.21.15.43:0/28718985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 0x7fdedc10b320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 --2- 172.21.15.43:0/28718985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdedc1055d0 0x7fdedc1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 -- 172.21.15.43:0/28718985 >> 172.21.15.43:0/28718985 conn(0x7fdedc101040 msgr2=0x7fdedc103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 -- 172.21.15.43:0/28718985 shutdown_connections 2024-07-26T08:30:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.981+0000 7fdee1600640 1 -- 172.21.15.43:0/28718985 wait complete. 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 Processor -- start 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 -- start start 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc1055d0 0x7fdedc19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 0x7fdedc19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdedc10b860 0x7fdedc1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc115640 con 0x7fdedc10af10 2024-07-26T08:30:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1154c0 con 0x7fdedc10b860 2024-07-26T08:30:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.983+0000 7fdee1600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1157c0 con 0x7fdedc1055d0 2024-07-26T08:30:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc1055d0 0x7fdedc19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 0x7fdedc19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc1055d0 0x7fdedc19c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:56776/0 (socket says 172.21.15.43:56776) 2024-07-26T08:30:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 -- 172.21.15.43:0/195786386 learned_addr learned my addr 172.21.15.43:0/195786386 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdee0c00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdedc10b860 0x7fdedc1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 -- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdedc10b860 msgr2=0x7fdedc1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdedc10b860 0x7fdedc1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 -- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 msgr2=0x7fdedc19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdedc10af10 0x7fdedc19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdedbe00640 1 -- 172.21.15.43:0/195786386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc1a2020 con 0x7fdedc1055d0 2024-07-26T08:30:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.984+0000 7fdee0c00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdedc10b860 0x7fdedc1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.985+0000 7fdedbe00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc1055d0 0x7fdedc19c0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00ea60 tx=0x7fdecc00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.985+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00cd20 con 0x7fdedc1055d0 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.985+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdecc0035f0 con 0x7fdedc1055d0 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.985+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc1a2310 con 0x7fdedc1055d0 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.985+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc010690 con 0x7fdedc1055d0 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.985+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc1a8a70 con 0x7fdedc1055d0 2024-07-26T08:30:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.987+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdedc063580 con 0x7fdedc1055d0 2024-07-26T08:30:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.989+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fdecc0037a0 con 0x7fdedc1055d0 2024-07-26T08:30:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.991+0000 7fded8c00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdec00b3d30 0x7fdec00b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.991+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fdecc0e4800 con 0x7fdedc1055d0 2024-07-26T08:30:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.991+0000 7fdedb400640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdec00b3d30 0x7fdec00b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.991+0000 7fded8c00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] conn(0x7fdec00bf450 0x7fdec00c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.991+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 --> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdecc013ec0 con 0x7fdec00bf450 2024-07-26T08:30:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.991+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fdecc0e4bb0 con 0x7fdedc1055d0 2024-07-26T08:30:26.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.992+0000 7fdee0c00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] conn(0x7fdec00bf450 0x7fdec00c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:26.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.992+0000 7fdedb400640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdec00b3d30 0x7fdec00b6240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdec8005940 tx=0x7fdec80058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:26.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.992+0000 7fdee0c00640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] conn(0x7fdec00bf450 0x7fdec00c1940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.994+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== osd.4 v2:172.21.15.63:6808/4195824513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdecc013ec0 con 0x7fdec00bf450 2024-07-26T08:30:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.009+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 --> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdedc063a00 con 0x7fdec00bf450 2024-07-26T08:30:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fded8c00640 1 -- 172.21.15.43:0/195786386 <== osd.4 v2:172.21.15.63:6808/4195824513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdedc063a00 con 0x7fdec00bf450 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] conn(0x7fdec00bf450 msgr2=0x7fdec00c1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee1600640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] conn(0x7fdec00bf450 0x7fdec00c1940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdec00b3d30 msgr2=0x7fdec00b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee1600640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdec00b3d30 0x7fdec00b6240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdec8005940 tx=0x7fdec80058d0 comp rx=0 tx=0).stop 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc1055d0 msgr2=0x7fdedc19c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee1600640 1 --2- 172.21.15.43:0/195786386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdedc1055d0 0x7fdedc19c0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00ea60 tx=0x7fdecc00ee60 comp rx=0 tx=0).stop 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.010+0000 7fdee0c00640 1 -- 172.21.15.43:0/195786386 reap_dead start 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.011+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 shutdown_connections 2024-07-26T08:30:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.011+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 >> 172.21.15.43:0/195786386 conn(0x7fdedc101040 msgr2=0x7fdedc103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.011+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 shutdown_connections 2024-07-26T08:30:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:27.011+0000 7fdee1600640 1 -- 172.21.15.43:0/195786386 wait complete. 2024-07-26T08:30:28.123 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:27 smithi043 ceph-mon[32384]: pgmap v404: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 -- 172.21.15.43:0/4067641490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51201033e0 msgr2=0x7f51201037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 --2- 172.21.15.43:0/4067641490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51201033e0 0x7f51201037f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5110009ca0 tx=0x7f511002a8d0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 -- 172.21.15.43:0/4067641490 shutdown_connections 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 --2- 172.21.15.43:0/4067641490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 0x7f5120109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 --2- 172.21.15.43:0/4067641490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5120109670 0x7f512010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 --2- 172.21.15.43:0/4067641490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51201033e0 0x7f51201037f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 -- 172.21.15.43:0/4067641490 >> 172.21.15.43:0/4067641490 conn(0x7f51200fee70 msgr2=0x7f51201012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 -- 172.21.15.43:0/4067641490 shutdown_connections 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.065+0000 7f511f200640 1 -- 172.21.15.43:0/4067641490 wait complete. 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 Processor -- start 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 -- start start 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51201033e0 0x7f512019c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 0x7f512019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5120109670 0x7f51201a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51201134b0 con 0x7f51201033e0 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5120113330 con 0x7f5120109670 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.067+0000 7f511f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5120113630 con 0x7f5120108d20 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51201033e0 0x7f512019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 0x7f512019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51201033e0 0x7f512019c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52304/0 (socket says 172.21.15.43:52304) 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511de00640 1 -- 172.21.15.43:0/899604947 learned_addr learned my addr 172.21.15.43:0/899604947 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 0x7f512019c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:56802/0 (socket says 172.21.15.43:56802) 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511e800640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5120109670 0x7f51201a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 -- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5120109670 msgr2=0x7f51201a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5120109670 0x7f51201a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 -- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51201033e0 msgr2=0x7f512019c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51201033e0 0x7f512019c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511d400640 1 -- 172.21.15.43:0/899604947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51201a1ff0 con 0x7f5120108d20 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.068+0000 7f511de00640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51201033e0 0x7f512019c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.069+0000 7f511d400640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 0x7f512019c620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f512006b3c0 tx=0x7f510c00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.069+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c015020 con 0x7f5120108d20 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.069+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51201a22e0 con 0x7f5120108d20 2024-07-26T08:30:28.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.069+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f510c011d00 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.069+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c010e50 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.069+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51201a8a40 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.070+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f512010f420 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.073+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f510c018020 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.074+0000 7f5116a00640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51040b3e50 0x7f51040b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.074+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f510c0e4050 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.074+0000 7f511de00640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51040b3e50 0x7f51040b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.075+0000 7f5116a00640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] conn(0x7f51040bf560 0x7f51040c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.075+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 --> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f510c01be50 con 0x7f51040bf560 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.075+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f510c0e4490 con 0x7f5120108d20 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.075+0000 7f511de00640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51040b3e50 0x7f51040b6360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5110005e30 tx=0x7f51100093a0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.080+0000 7f511e800640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] conn(0x7f51040bf560 0x7f51040c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:28.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.080+0000 7f511e800640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] conn(0x7f51040bf560 0x7f51040c1a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.081+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== osd.10 v2:172.21.15.63:6824/2504233154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f510c01be50 con 0x7f51040bf560 2024-07-26T08:30:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.097+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 --> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5120104660 con 0x7f51040bf560 2024-07-26T08:30:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.098+0000 7f5116a00640 1 -- 172.21.15.43:0/899604947 <== osd.10 v2:172.21.15.63:6824/2504233154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5120104660 con 0x7f51040bf560 2024-07-26T08:30:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.098+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] conn(0x7f51040bf560 msgr2=0x7f51040c1a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.098+0000 7f511f200640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] conn(0x7f51040bf560 0x7f51040c1a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51040b3e50 msgr2=0x7f51040b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f51040b3e50 0x7f51040b6360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5110005e30 tx=0x7f51100093a0 comp rx=0 tx=0).stop 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 msgr2=0x7f512019c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 --2- 172.21.15.43:0/899604947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5120108d20 0x7f512019c620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f512006b3c0 tx=0x7f510c00b790 comp rx=0 tx=0).stop 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511e800640 1 -- 172.21.15.43:0/899604947 reap_dead start 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 shutdown_connections 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 >> 172.21.15.43:0/899604947 conn(0x7f51200fee70 msgr2=0x7f5120108380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 shutdown_connections 2024-07-26T08:30:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:28.099+0000 7f511f200640 1 -- 172.21.15.43:0/899604947 wait complete. 2024-07-26T08:30:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:27 smithi133 ceph-mon[37053]: pgmap v404: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:28.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:27 smithi063 ceph-mon[36747]: pgmap v404: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:29.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 -- 172.21.15.43:0/718972699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e81040c0 msgr2=0x7fa3e81044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:29.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 --2- 172.21.15.43:0/718972699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e81040c0 0x7fa3e81044d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009900 tx=0x7fa3dc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 -- 172.21.15.43:0/718972699 shutdown_connections 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 --2- 172.21.15.43:0/718972699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3e8104af0 0x7fa3e810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 --2- 172.21.15.43:0/718972699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e810d670 0x7fa3e810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 --2- 172.21.15.43:0/718972699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e81040c0 0x7fa3e81044d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 -- 172.21.15.43:0/718972699 >> 172.21.15.43:0/718972699 conn(0x7fa3e80fdcf0 msgr2=0x7fa3e8100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 -- 172.21.15.43:0/718972699 shutdown_connections 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.795+0000 7fa3ee400640 1 -- 172.21.15.43:0/718972699 wait complete. 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.796+0000 7fa3ee400640 1 Processor -- start 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.796+0000 7fa3ee400640 1 -- start start 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ee400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e81040c0 0x7fa3e8199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:29.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ee400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e8104af0 0x7fa3e819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ee400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3e810d670 0x7fa3e819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ee400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e81133d0 con 0x7fa3e81040c0 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ee400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8113250 con 0x7fa3e8104af0 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ee400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8113550 con 0x7fa3e810d670 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ed000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e81040c0 0x7fa3e8199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ed000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e81040c0 0x7fa3e8199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52272/0 (socket says 172.21.15.43:52272) 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3ed000640 1 -- 172.21.15.43:0/1166615792 learned_addr learned my addr 172.21.15.43:0/1166615792 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.797+0000 7fa3e7e00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e8104af0 0x7fa3e819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3eda00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3e810d670 0x7fa3e819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3ed000640 1 -- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3e810d670 msgr2=0x7fa3e819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3ed000640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3e810d670 0x7fa3e819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3ed000640 1 -- 172.21.15.43:0/1166615792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e8104af0 msgr2=0x7fa3e819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3ed000640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e8104af0 0x7fa3e819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3ed000640 1 -- 172.21.15.43:0/1166615792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e819fcf0 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.798+0000 7fa3e7e00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e8104af0 0x7fa3e819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.799+0000 7fa3ed000640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e81040c0 0x7fa3e8199d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc005ab0 tx=0x7fa3dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.799+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc03f030 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.799+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e819ff80 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.799+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3dc003cd0 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.799+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc035070 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.799+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e81a6740 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.800+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3e8107c00 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.803+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fa3dc042030 con 0x7fa3e81040c0 2024-07-26T08:30:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.805+0000 7fa3e5600640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa3d00b3cb0 0x7fa3d00b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.805+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fa3dc104e10 con 0x7fa3e81040c0 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.805+0000 7fa3e7e00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa3d00b3cb0 0x7fa3d00b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.805+0000 7fa3e5600640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] conn(0x7fa3d00bf350 0x7fa3d00c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.805+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 --> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3dc03ce50 con 0x7fa3d00bf350 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.805+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa3dc1051c0 con 0x7fa3e81040c0 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.806+0000 7fa3eda00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] conn(0x7fa3d00bf350 0x7fa3d00c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.806+0000 7fa3e7e00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa3d00b3cb0 0x7fa3d00b61c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3e810fa50 tx=0x7fa3d400b410 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.806+0000 7fa3eda00640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] conn(0x7fa3d00bf350 0x7fa3d00c1840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.807+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== osd.2 v2:172.21.15.133:6800/2705571289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa3dc03ce50 con 0x7fa3d00bf350 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.823+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 --> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa3e806aef0 con 0x7fa3d00bf350 2024-07-26T08:30:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.824+0000 7fa3e5600640 1 -- 172.21.15.43:0/1166615792 <== osd.2 v2:172.21.15.133:6800/2705571289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa3e806aef0 con 0x7fa3d00bf350 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.824+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] conn(0x7fa3d00bf350 msgr2=0x7fa3d00c1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.824+0000 7fa3ee400640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] conn(0x7fa3d00bf350 0x7fa3d00c1840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa3d00b3cb0 msgr2=0x7fa3d00b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa3d00b3cb0 0x7fa3d00b61c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3e810fa50 tx=0x7fa3d400b410 comp rx=0 tx=0).stop 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e81040c0 msgr2=0x7fa3e8199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 --2- 172.21.15.43:0/1166615792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3e81040c0 0x7fa3e8199d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc005ab0 tx=0x7fa3dc0042f0 comp rx=0 tx=0).stop 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3eda00640 1 -- 172.21.15.43:0/1166615792 reap_dead start 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 shutdown_connections 2024-07-26T08:30:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 >> 172.21.15.43:0/1166615792 conn(0x7fa3e80fdcf0 msgr2=0x7fa3e81071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 shutdown_connections 2024-07-26T08:30:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:26.825+0000 7fa3ee400640 1 -- 172.21.15.43:0/1166615792 wait complete. 2024-07-26T08:30:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:29 smithi043 ceph-mon[32384]: pgmap v405: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-07-26T08:30:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:29 smithi133 ceph-mon[37053]: pgmap v405: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-07-26T08:30:30.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:29 smithi063 ceph-mon[36747]: pgmap v405: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-07-26T08:30:30.349 INFO:teuthology.orchestra.run.smithi043.stdout:137438953564 2024-07-26T08:30:30.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-07-26T08:30:31.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.898+0000 7f1466200640 1 -- 172.21.15.43:0/2907580424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 msgr2=0x7f1460117df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.898+0000 7f1466200640 1 --2- 172.21.15.43:0/2907580424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 0x7f1460117df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f144c009900 tx=0x7f144c02a400 comp rx=0 tx=0).stop 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 -- 172.21.15.43:0/2907580424 shutdown_connections 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 --2- 172.21.15.43:0/2907580424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460118330 0x7f146011a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 --2- 172.21.15.43:0/2907580424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 0x7f1460117df0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 --2- 172.21.15.43:0/2907580424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1460109df0 0x7f146010a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 -- 172.21.15.43:0/2907580424 >> 172.21.15.43:0/2907580424 conn(0x7f1460070d20 msgr2=0x7f1460073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 -- 172.21.15.43:0/2907580424 shutdown_connections 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.899+0000 7f1466200640 1 -- 172.21.15.43:0/2907580424 wait complete. 2024-07-26T08:30:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.900+0000 7f1466200640 1 Processor -- start 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.900+0000 7f1466200640 1 -- start start 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f1466200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460109df0 0x7f14601a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f1466200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 0x7f14601a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f1466200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1460118330 0x7f14601aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f1466200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f146011e000 con 0x7f146010a740 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f1466200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f146011de80 con 0x7f1460109df0 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f1466200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f146011e180 con 0x7f1460118330 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460109df0 0x7f14601a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460109df0 0x7f14601a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39196/0 (socket says 172.21.15.43:39196) 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 -- 172.21.15.43:0/497856381 learned_addr learned my addr 172.21.15.43:0/497856381 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 0x7f14601a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:31.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145fe00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1460118330 0x7f14601aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 -- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1460118330 msgr2=0x7f14601aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1460118330 0x7f14601aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 -- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 msgr2=0x7f14601a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f146010a740 0x7f14601a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.901+0000 7f145f400640 1 -- 172.21.15.43:0/497856381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14601aa980 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.902+0000 7f145f400640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460109df0 0x7f14601a4a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f145000ea60 tx=0x7f145000ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.902+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145000cd20 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.902+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14601aac70 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.902+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14500035f0 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.902+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450010690 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.902+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14601b13d0 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.903+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1460063580 con 0x7f1460109df0 2024-07-26T08:30:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.906+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f14500037a0 con 0x7f1460109df0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.908+0000 7f1457e00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14440b3cb0 0x7f14440b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.908+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f14500e4860 con 0x7f1460109df0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.908+0000 7f145ea00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14440b3cb0 0x7f14440b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.908+0000 7f1457e00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] conn(0x7f14440bf3c0 0x7f14440c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.908+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 --> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1450023e50 con 0x7f14440bf3c0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.908+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f14500e4c10 con 0x7f1460109df0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.909+0000 7f145fe00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] conn(0x7f14440bf3c0 0x7f14440c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.909+0000 7f145ea00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14440b3cb0 0x7f14440b61c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f144c005940 tx=0x7f144c0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.909+0000 7f145fe00640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] conn(0x7f14440bf3c0 0x7f14440c18b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.910+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== osd.11 v2:172.21.15.133:6824/1325192368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1450023e50 con 0x7f14440bf3c0 2024-07-26T08:30:31.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.930+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 --> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1460063a00 con 0x7f14440bf3c0 2024-07-26T08:30:31.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.931+0000 7f1457e00640 1 -- 172.21.15.43:0/497856381 <== osd.11 v2:172.21.15.133:6824/1325192368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1460063a00 con 0x7f14440bf3c0 2024-07-26T08:30:31.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.931+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] conn(0x7f14440bf3c0 msgr2=0x7f14440c18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:31.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.931+0000 7f1466200640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] conn(0x7f14440bf3c0 0x7f14440c18b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14440b3cb0 msgr2=0x7f14440b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:31.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f14440b3cb0 0x7f14440b61c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f144c005940 tx=0x7f144c0058d0 comp rx=0 tx=0).stop 2024-07-26T08:30:31.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460109df0 msgr2=0x7f14601a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:31.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 --2- 172.21.15.43:0/497856381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1460109df0 0x7f14601a4a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f145000ea60 tx=0x7f145000ee60 comp rx=0 tx=0).stop 2024-07-26T08:30:31.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f145fe00640 1 -- 172.21.15.43:0/497856381 reap_dead start 2024-07-26T08:30:31.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 shutdown_connections 2024-07-26T08:30:31.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 >> 172.21.15.43:0/497856381 conn(0x7f1460070d20 msgr2=0x7f146011a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:31.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 shutdown_connections 2024-07-26T08:30:31.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.932+0000 7f1466200640 1 -- 172.21.15.43:0/497856381 wait complete. 2024-07-26T08:30:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 -- 172.21.15.43:0/4198075724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca8104d00 msgr2=0x7f9ca810d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 --2- 172.21.15.43:0/4198075724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca8104d00 0x7f9ca810d340 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009900 tx=0x7f9c9402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 -- 172.21.15.43:0/4198075724 shutdown_connections 2024-07-26T08:30:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 --2- 172.21.15.43:0/4198075724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ca810d880 0x7f9ca810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 --2- 172.21.15.43:0/4198075724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca8104d00 0x7f9ca810d340 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 --2- 172.21.15.43:0/4198075724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca81042d0 0x7f9ca81046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 -- 172.21.15.43:0/4198075724 >> 172.21.15.43:0/4198075724 conn(0x7f9ca8079160 msgr2=0x7f9ca8079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 -- 172.21.15.43:0/4198075724 shutdown_connections 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.706+0000 7f9caee00640 1 -- 172.21.15.43:0/4198075724 wait complete. 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.708+0000 7f9caee00640 1 Processor -- start 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.708+0000 7f9caee00640 1 -- start start 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9caee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ca81042d0 0x7f9ca8199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9caee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca8104d00 0x7f9ca819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9caee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca810d880 0x7f9ca819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9caee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8113600 con 0x7f9ca810d880 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9caee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8113480 con 0x7f9ca81042d0 2024-07-26T08:30:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9caee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8113780 con 0x7f9ca8104d00 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9ca7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca8104d00 0x7f9ca819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9cace00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca810d880 0x7f9ca819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9ca7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca8104d00 0x7f9ca819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:56822/0 (socket says 172.21.15.43:56822) 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9ca7400640 1 -- 172.21.15.43:0/3694764613 learned_addr learned my addr 172.21.15.43:0/3694764613 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.709+0000 7f9ca7e00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ca81042d0 0x7f9ca8199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.710+0000 7f9ca7400640 1 -- 172.21.15.43:0/3694764613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ca81042d0 msgr2=0x7f9ca8199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.710+0000 7f9ca7400640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ca81042d0 0x7f9ca8199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.710+0000 7f9ca7400640 1 -- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca810d880 msgr2=0x7f9ca819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.710+0000 7f9ca7400640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca810d880 0x7f9ca819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.710+0000 7f9ca7400640 1 -- 172.21.15.43:0/3694764613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca819ff60 con 0x7f9ca8104d00 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.710+0000 7f9ca7400640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca8104d00 0x7f9ca819a590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402a9e0 tx=0x7f9c94003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.711+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9403f070 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.711+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9c94031be0 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.711+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca81a01f0 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.711+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94035030 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.711+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca81a69b0 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.712+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ca8107dc0 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.715+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f9c94042070 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.716+0000 7f9ca4c00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9c8c0b3cb0 0x7f9c8c0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.716+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f9c941050a0 con 0x7f9ca8104d00 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.717+0000 7f9ca7e00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9c8c0b3cb0 0x7f9c8c0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.717+0000 7f9ca4c00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] conn(0x7f9c8c0bf3d0 0x7f9c8c0c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.717+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 --> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c94041ec0 con 0x7f9c8c0bf3d0 2024-07-26T08:30:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.717+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f9c94105450 con 0x7f9ca8104d00 2024-07-26T08:30:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.717+0000 7f9cace00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] conn(0x7f9c8c0bf3d0 0x7f9c8c0c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.718+0000 7f9ca7e00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9c8c0b3cb0 0x7f9c8c0b61c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c980095f0 tx=0x7f9c98005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.718+0000 7f9cace00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] conn(0x7f9c8c0bf3d0 0x7f9c8c0c18c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.719+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== osd.3 v2:172.21.15.43:6810/1603187116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c94041ec0 con 0x7f9c8c0bf3d0 2024-07-26T08:30:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.735+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 --> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ca806aed0 con 0x7f9c8c0bf3d0 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.735+0000 7f9ca4c00640 1 -- 172.21.15.43:0/3694764613 <== osd.3 v2:172.21.15.43:6810/1603187116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9ca806aed0 con 0x7f9c8c0bf3d0 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] conn(0x7f9c8c0bf3d0 msgr2=0x7f9c8c0c18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9caee00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] conn(0x7f9c8c0bf3d0 0x7f9c8c0c18c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9c8c0b3cb0 msgr2=0x7f9c8c0b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9caee00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9c8c0b3cb0 0x7f9c8c0b61c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c980095f0 tx=0x7f9c98005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca8104d00 msgr2=0x7f9ca819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9caee00640 1 --2- 172.21.15.43:0/3694764613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca8104d00 0x7f9ca819a590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402a9e0 tx=0x7f9c94003b90 comp rx=0 tx=0).stop 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.736+0000 7f9cace00640 1 -- 172.21.15.43:0/3694764613 reap_dead start 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.737+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 shutdown_connections 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.737+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 >> 172.21.15.43:0/3694764613 conn(0x7f9ca8079160 msgr2=0x7f9ca8107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.737+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 shutdown_connections 2024-07-26T08:30:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:31.737+0000 7f9caee00640 1 -- 172.21.15.43:0/3694764613 wait complete. 2024-07-26T08:30:32.029 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:31 smithi043 ceph-mon[32384]: pgmap v406: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:32.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:31 smithi133 ceph-mon[37053]: pgmap v406: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:32.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:31 smithi063 ceph-mon[36747]: pgmap v406: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:33.047 INFO:teuthology.orchestra.run.smithi043.stdout:81604378727 2024-07-26T08:30:33.048 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-07-26T08:30:33.405 INFO:teuthology.orchestra.run.smithi043.stdout:279172874296 2024-07-26T08:30:33.406 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-07-26T08:30:33.973 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:33 smithi043 ceph-mon[32384]: pgmap v407: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:33.974 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:30:34.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.174+0000 7f83a3e00640 1 -- 172.21.15.43:0/2535701594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c113e60 msgr2=0x7f839c116350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.174+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2535701594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c113e60 0x7f839c116350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8394009ca0 tx=0x7f839402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 -- 172.21.15.43:0/2535701594 shutdown_connections 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2535701594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c113e60 0x7f839c116350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2535701594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839c075720 0x7f839c075b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2535701594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c076d60 0x7f839c0751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 -- 172.21.15.43:0/2535701594 >> 172.21.15.43:0/2535701594 conn(0x7f839c07b340 msgr2=0x7f839c07b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 -- 172.21.15.43:0/2535701594 shutdown_connections 2024-07-26T08:30:34.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.175+0000 7f83a3e00640 1 -- 172.21.15.43:0/2535701594 wait complete. 2024-07-26T08:30:34.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.176+0000 7f83a3e00640 1 Processor -- start 2024-07-26T08:30:34.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.176+0000 7f83a3e00640 1 -- start start 2024-07-26T08:30:34.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.176+0000 7f83a3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c075720 0x7f839c1a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.176+0000 7f83a3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839c076d60 0x7f839c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c113e60 0x7f839c1a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f839c119c00 con 0x7f839c076d60 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f839c119a80 con 0x7f839c113e60 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f839c119d80 con 0x7f839c075720 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c113e60 0x7f839c1a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c113e60 0x7f839c1a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39214/0 (socket says 172.21.15.43:39214) 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c075720 0x7f839c1a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 -- 172.21.15.43:0/2891274967 learned_addr learned my addr 172.21.15.43:0/2891274967 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:34.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a0a00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839c076d60 0x7f839c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 -- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c075720 msgr2=0x7f839c1a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f839c075720 0x7f839c1a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 -- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839c076d60 msgr2=0x7f839c1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839c076d60 0x7f839c1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.177+0000 7f83a1e00640 1 -- 172.21.15.43:0/2891274967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c1a6460 con 0x7f839c113e60 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.178+0000 7f83a1e00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c113e60 0x7f839c1a5d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8394033040 tx=0x7f8394003c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.178+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394031650 con 0x7f839c113e60 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.178+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f83940317f0 con 0x7f839c113e60 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.178+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839402fa80 con 0x7f839c113e60 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.178+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c1a66f0 con 0x7f839c113e60 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.178+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1aceb0 con 0x7f839c113e60 2024-07-26T08:30:34.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.179+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f839c1134a0 con 0x7f839c113e60 2024-07-26T08:30:34.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.182+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f839402fc20 con 0x7f839c113e60 2024-07-26T08:30:34.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.183+0000 7f839a000640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f83840b3d30 0x7f83840b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.183+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f83941058e0 con 0x7f839c113e60 2024-07-26T08:30:34.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.184+0000 7f83a1400640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f83840b3d30 0x7f83840b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.184+0000 7f839a000640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] conn(0x7f83840bf450 0x7f83840c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.184+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 --> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83940020b0 con 0x7f83840bf450 2024-07-26T08:30:34.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.184+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8394105c90 con 0x7f839c113e60 2024-07-26T08:30:34.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.184+0000 7f83a0a00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] conn(0x7f83840bf450 0x7f83840c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.185+0000 7f83a1400640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f83840b3d30 0x7f83840b6240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f83900095f0 tx=0x7f8390005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:34.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.185+0000 7f83a0a00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] conn(0x7f83840bf450 0x7f83840c1940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:34.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.186+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== osd.8 v2:172.21.15.133:6816/868830377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83940020b0 con 0x7f83840bf450 2024-07-26T08:30:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.202+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 --> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f839c0766a0 con 0x7f83840bf450 2024-07-26T08:30:34.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.203+0000 7f839a000640 1 -- 172.21.15.43:0/2891274967 <== osd.8 v2:172.21.15.133:6816/868830377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f839c0766a0 con 0x7f83840bf450 2024-07-26T08:30:34.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.203+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] conn(0x7f83840bf450 msgr2=0x7f83840c1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.203+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] conn(0x7f83840bf450 0x7f83840c1940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f83840b3d30 msgr2=0x7f83840b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f83840b3d30 0x7f83840b6240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f83900095f0 tx=0x7f8390005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c113e60 msgr2=0x7f839c1a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 --2- 172.21.15.43:0/2891274967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c113e60 0x7f839c1a5d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8394033040 tx=0x7f8394003c90 comp rx=0 tx=0).stop 2024-07-26T08:30:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a1e00640 1 -- 172.21.15.43:0/2891274967 reap_dead start 2024-07-26T08:30:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 shutdown_connections 2024-07-26T08:30:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 >> 172.21.15.43:0/2891274967 conn(0x7f839c07b340 msgr2=0x7f839c112ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 shutdown_connections 2024-07-26T08:30:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.204+0000 7f83a3e00640 1 -- 172.21.15.43:0/2891274967 wait complete. 2024-07-26T08:30:34.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:33 smithi133 ceph-mon[37053]: pgmap v407: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:34.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:30:34.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:33 smithi063 ceph-mon[36747]: pgmap v407: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.762+0000 7effd3e00640 1 -- 172.21.15.43:0/2008650324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 msgr2=0x7effd4109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.762+0000 7effd3e00640 1 --2- 172.21.15.43:0/2008650324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 0x7effd4109130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7effc0009860 tx=0x7effc002a340 comp rx=0 tx=0).stop 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 -- 172.21.15.43:0/2008650324 shutdown_connections 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 --2- 172.21.15.43:0/2008650324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 0x7effd4109130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 --2- 172.21.15.43:0/2008650324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109670 0x7effd410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 --2- 172.21.15.43:0/2008650324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 0x7effd41037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 -- 172.21.15.43:0/2008650324 >> 172.21.15.43:0/2008650324 conn(0x7effd40fee70 msgr2=0x7effd41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:34.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 -- 172.21.15.43:0/2008650324 shutdown_connections 2024-07-26T08:30:34.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.763+0000 7effd3e00640 1 -- 172.21.15.43:0/2008650324 wait complete. 2024-07-26T08:30:34.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.764+0000 7effd3e00640 1 Processor -- start 2024-07-26T08:30:34.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.764+0000 7effd3e00640 1 -- start start 2024-07-26T08:30:34.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 0x7effd419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 0x7effd419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109670 0x7effd41a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7effd4113450 con 0x7effd4109670 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7effd41132d0 con 0x7effd41033e0 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7effd41135d0 con 0x7effd4108d20 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 0x7effd419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 0x7effd419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39234/0 (socket says 172.21.15.43:39234) 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd2a00640 1 -- 172.21.15.43:0/3623072636 learned_addr learned my addr 172.21.15.43:0/3623072636 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd2000640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 0x7effd419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd3400640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109670 0x7effd41a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd2000640 1 -- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 msgr2=0x7effd419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.765+0000 7effd2000640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 0x7effd419bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd2000640 1 -- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109670 msgr2=0x7effd41a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd2000640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109670 0x7effd41a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd2000640 1 -- 172.21.15.43:0/3623072636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd41a1f10 con 0x7effd4108d20 2024-07-26T08:30:34.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd2a00640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd41033e0 0x7effd419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:34.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd3400640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109670 0x7effd41a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:34.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd2000640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 0x7effd419c540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7effc002a860 tx=0x7effc002aeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:34.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc003f020 con 0x7effd4108d20 2024-07-26T08:30:34.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effc0033dd0 con 0x7effd4108d20 2024-07-26T08:30:34.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0037040 con 0x7effd4108d20 2024-07-26T08:30:34.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.766+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd41a21a0 con 0x7effd4108d20 2024-07-26T08:30:34.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.767+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd41a2600 con 0x7effd4108d20 2024-07-26T08:30:34.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.768+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effd410f4a0 con 0x7effd4108d20 2024-07-26T08:30:34.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.770+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7effc0042020 con 0x7effd4108d20 2024-07-26T08:30:34.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effcb400640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7effb80b3d30 0x7effb80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7effc01042d0 con 0x7effd4108d20 2024-07-26T08:30:34.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effd2a00640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7effb80b3d30 0x7effb80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effcb400640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] conn(0x7effb80bf450 0x7effb80c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:34.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 --> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effc003ce80 con 0x7effb80bf450 2024-07-26T08:30:34.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7effc0104680 con 0x7effd4108d20 2024-07-26T08:30:34.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.772+0000 7effd3400640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] conn(0x7effb80bf450 0x7effb80c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:34.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.773+0000 7effd2a00640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7effb80b3d30 0x7effb80b6240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7effc4011550 tx=0x7effc4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:34.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.773+0000 7effd3400640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] conn(0x7effb80bf450 0x7effb80c1940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:34.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.774+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== osd.1 v2:172.21.15.63:6800/2190025564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effc003ce80 con 0x7effb80bf450 2024-07-26T08:30:34.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.789+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 --> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effd4104660 con 0x7effb80bf450 2024-07-26T08:30:34.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effcb400640 1 -- 172.21.15.43:0/3623072636 <== osd.1 v2:172.21.15.63:6800/2190025564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7effd4104660 con 0x7effb80bf450 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] conn(0x7effb80bf450 msgr2=0x7effb80c1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3e00640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] conn(0x7effb80bf450 0x7effb80c1940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7effb80b3d30 msgr2=0x7effb80b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3e00640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7effb80b3d30 0x7effb80b6240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7effc4011550 tx=0x7effc4005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 msgr2=0x7effd419c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3e00640 1 --2- 172.21.15.43:0/3623072636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effd4108d20 0x7effd419c540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7effc002a860 tx=0x7effc002aeb0 comp rx=0 tx=0).stop 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.790+0000 7effd3400640 1 -- 172.21.15.43:0/3623072636 reap_dead start 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.791+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 shutdown_connections 2024-07-26T08:30:34.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.791+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 >> 172.21.15.43:0/3623072636 conn(0x7effd40fee70 msgr2=0x7effd4108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:34.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.791+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 shutdown_connections 2024-07-26T08:30:34.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:34.791+0000 7effd3e00640 1 -- 172.21.15.43:0/3623072636 wait complete. 2024-07-26T08:30:35.258 INFO:teuthology.orchestra.run.smithi043.stdout:304942678069 2024-07-26T08:30:35.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-07-26T08:30:35.867 INFO:teuthology.orchestra.run.smithi043.stdout:257698037822 2024-07-26T08:30:35.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-07-26T08:30:36.080 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:35 smithi043 ceph-mon[32384]: pgmap v408: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.193+0000 7f6e42400640 1 -- 172.21.15.43:0/2676118787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 msgr2=0x7f6e3c1039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.193+0000 7f6e42400640 1 --2- 172.21.15.43:0/2676118787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 0x7f6e3c1039c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.193+0000 7f6e42400640 1 -- 172.21.15.43:0/2676118787 shutdown_connections 2024-07-26T08:30:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.194+0000 7f6e42400640 1 --2- 172.21.15.43:0/2676118787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c109840 0x7f6e3c110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.194+0000 7f6e42400640 1 --2- 172.21.15.43:0/2676118787 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c108ef0 0x7f6e3c109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.194+0000 7f6e42400640 1 --2- 172.21.15.43:0/2676118787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 0x7f6e3c1039c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.194+0000 7f6e42400640 1 -- 172.21.15.43:0/2676118787 >> 172.21.15.43:0/2676118787 conn(0x7f6e3c0fefc0 msgr2=0x7f6e3c101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.194+0000 7f6e42400640 1 -- 172.21.15.43:0/2676118787 shutdown_connections 2024-07-26T08:30:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.194+0000 7f6e42400640 1 -- 172.21.15.43:0/2676118787 wait complete. 2024-07-26T08:30:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.195+0000 7f6e42400640 1 Processor -- start 2024-07-26T08:30:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.195+0000 7f6e42400640 1 -- start start 2024-07-26T08:30:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.195+0000 7f6e42400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 0x7f6e3c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.195+0000 7f6e42400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c108ef0 0x7f6e3c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.195+0000 7f6e42400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c109840 0x7f6e3c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e42400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c113690 con 0x7f6e3c1035b0 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e42400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c113510 con 0x7f6e3c108ef0 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e42400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c113810 con 0x7f6e3c109840 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 0x7f6e3c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c109840 0x7f6e3c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 0x7f6e3c199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40230/0 (socket says 172.21.15.43:40230) 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3b400640 1 -- 172.21.15.43:0/4185953869 learned_addr learned my addr 172.21.15.43:0/4185953869 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3aa00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c108ef0 0x7f6e3c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3aa00640 1 -- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c109840 msgr2=0x7f6e3c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3aa00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c109840 0x7f6e3c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3aa00640 1 -- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 msgr2=0x7f6e3c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3aa00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e3c1035b0 0x7f6e3c199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.196+0000 7f6e3aa00640 1 -- 172.21.15.43:0/4185953869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c19ff50 con 0x7f6e3c108ef0 2024-07-26T08:30:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.197+0000 7f6e3aa00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c108ef0 0x7f6e3c19a580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c06a4c0 tx=0x7f6e2800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.197+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800cd00 con 0x7f6e3c108ef0 2024-07-26T08:30:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.197+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6e280035f0 con 0x7f6e3c108ef0 2024-07-26T08:30:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.197+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28010690 con 0x7f6e3c108ef0 2024-07-26T08:30:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.197+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c1a0240 con 0x7f6e3c108ef0 2024-07-26T08:30:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.198+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c1a69a0 con 0x7f6e3c108ef0 2024-07-26T08:30:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.199+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e3c063540 con 0x7f6e3c108ef0 2024-07-26T08:30:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.201+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f6e280037a0 con 0x7f6e3c108ef0 2024-07-26T08:30:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.203+0000 7f6e33e00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e200b3ca0 0x7f6e200b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.203+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f6e280e4680 con 0x7f6e3c108ef0 2024-07-26T08:30:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.203+0000 7f6e3b400640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e200b3ca0 0x7f6e200b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.203+0000 7f6e33e00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] conn(0x7f6e200bf3c0 0x7f6e200c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.203+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 --> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e28023e50 con 0x7f6e200bf3c0 2024-07-26T08:30:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.203+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f6e280e4a30 con 0x7f6e3c108ef0 2024-07-26T08:30:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.204+0000 7f6e3be00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] conn(0x7f6e200bf3c0 0x7f6e200c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.204+0000 7f6e3b400640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e200b3ca0 0x7f6e200b61b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005f70 tx=0x7f6e2c031400 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.204+0000 7f6e3be00640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] conn(0x7f6e200bf3c0 0x7f6e200c18b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:36.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.205+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== osd.5 v2:172.21.15.133:6808/3668705015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e28023e50 con 0x7f6e200bf3c0 2024-07-26T08:30:36.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.220+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 --> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e3c063a10 con 0x7f6e200bf3c0 2024-07-26T08:30:36.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.221+0000 7f6e33e00640 1 -- 172.21.15.43:0/4185953869 <== osd.5 v2:172.21.15.133:6808/3668705015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6e3c063a10 con 0x7f6e200bf3c0 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.221+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] conn(0x7f6e200bf3c0 msgr2=0x7f6e200c18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.221+0000 7f6e42400640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] conn(0x7f6e200bf3c0 0x7f6e200c18b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e200b3ca0 msgr2=0x7f6e200b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e200b3ca0 0x7f6e200b61b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005f70 tx=0x7f6e2c031400 comp rx=0 tx=0).stop 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c108ef0 msgr2=0x7f6e3c19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 --2- 172.21.15.43:0/4185953869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c108ef0 0x7f6e3c19a580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c06a4c0 tx=0x7f6e2800ee50 comp rx=0 tx=0).stop 2024-07-26T08:30:36.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e3be00640 1 -- 172.21.15.43:0/4185953869 reap_dead start 2024-07-26T08:30:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 shutdown_connections 2024-07-26T08:30:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 >> 172.21.15.43:0/4185953869 conn(0x7f6e3c0fefc0 msgr2=0x7f6e3c108490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 shutdown_connections 2024-07-26T08:30:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:36.222+0000 7f6e42400640 1 -- 172.21.15.43:0/4185953869 wait complete. 2024-07-26T08:30:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:35 smithi133 ceph-mon[37053]: pgmap v408: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:35 smithi063 ceph-mon[36747]: pgmap v408: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:37.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:36 smithi043 ceph-mon[32384]: mgrmap e22: x(active, since 11m), standbys: z, y 2024-07-26T08:30:37.241 INFO:teuthology.orchestra.run.smithi043.stdout:60129542254 2024-07-26T08:30:37.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-07-26T08:30:37.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:36 smithi133 ceph-mon[37053]: mgrmap e22: x(active, since 11m), standbys: z, y 2024-07-26T08:30:37.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:36 smithi063 ceph-mon[36747]: mgrmap e22: x(active, since 11m), standbys: z, y 2024-07-26T08:30:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:37 smithi043 ceph-mon[32384]: pgmap v409: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:37 smithi133 ceph-mon[37053]: pgmap v409: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:38.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:37 smithi063 ceph-mon[36747]: pgmap v409: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:38.328 INFO:teuthology.orchestra.run.smithi043.stdout:231928234055 2024-07-26T08:30:38.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-07-26T08:30:38.754 INFO:teuthology.orchestra.run.smithi043.stdout:158913790039 2024-07-26T08:30:38.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-07-26T08:30:38.937 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:38.961 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:39.025 INFO:teuthology.orchestra.run.smithi043.stdout:111669149792 2024-07-26T08:30:39.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-07-26T08:30:39.123 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:30:39.124 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:30:39.124 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:30:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:30:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:30:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:30:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:30:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:30:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:30:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:39.880 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:40.282 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:40 smithi043 ceph-mon[32384]: pgmap v410: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:40.340 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:40 smithi133 ceph-mon[37053]: pgmap v410: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:40.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:40 smithi063 ceph-mon[36747]: pgmap v410: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:42 smithi043 ceph-mon[32384]: pgmap v411: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:42 smithi133 ceph-mon[37053]: pgmap v411: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:42 smithi063 ceph-mon[36747]: pgmap v411: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:42.680 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:44.346 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:44 smithi043 ceph-mon[32384]: pgmap v412: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:44 smithi133 ceph-mon[37053]: pgmap v412: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:44.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:44 smithi063 ceph-mon[36747]: pgmap v412: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:46.369 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:46 smithi063 ceph-mon[36747]: pgmap v413: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-26T08:30:46.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:46 smithi043 ceph-mon[32384]: pgmap v413: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-26T08:30:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:46 smithi133 ceph-mon[37053]: pgmap v413: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-26T08:30:48.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 -- 172.21.15.43:0/1802877047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c109df0 msgr2=0x7f701c10a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 --2- 172.21.15.43:0/1802877047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c109df0 0x7f701c10a200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7004009900 tx=0x7f700402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 -- 172.21.15.43:0/1802877047 shutdown_connections 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 --2- 172.21.15.43:0/1802877047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f701c10a740 0x7f701c1169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 --2- 172.21.15.43:0/1802877047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c109df0 0x7f701c10a200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 --2- 172.21.15.43:0/1802877047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c10eb80 0x7f701c10ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 -- 172.21.15.43:0/1802877047 >> 172.21.15.43:0/1802877047 conn(0x7f701c070d20 msgr2=0x7f701c073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 -- 172.21.15.43:0/1802877047 shutdown_connections 2024-07-26T08:30:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.039+0000 7f7022000640 1 -- 172.21.15.43:0/1802877047 wait complete. 2024-07-26T08:30:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.041+0000 7f7022000640 1 Processor -- start 2024-07-26T08:30:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.041+0000 7f7022000640 1 -- start start 2024-07-26T08:30:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f7022000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c109df0 0x7f701c1a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f7022000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c10a740 0x7f701c1a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f7022000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f701c10eb80 0x7f701c1aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f7022000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f701c11be20 con 0x7f701c10eb80 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f7022000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f701c11bca0 con 0x7f701c10a740 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f7022000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f701c11bfa0 con 0x7f701c109df0 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c10a740 0x7f701c1a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c109df0 0x7f701c1a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c10a740 0x7f701c1a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46496/0 (socket says 172.21.15.43:46496) 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701aa00640 1 -- 172.21.15.43:0/1523959840 learned_addr learned my addr 172.21.15.43:0/1523959840 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701be00640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f701c10eb80 0x7f701c1aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701b400640 1 -- 172.21.15.43:0/1523959840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c10a740 msgr2=0x7f701c1a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701b400640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c10a740 0x7f701c1a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701b400640 1 -- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f701c10eb80 msgr2=0x7f701c1aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701b400640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f701c10eb80 0x7f701c1aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.042+0000 7f701b400640 1 -- 172.21.15.43:0/1523959840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701c1aa940 con 0x7f701c109df0 2024-07-26T08:30:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.043+0000 7f701b400640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c109df0 0x7f701c1a49d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f700c00e9f0 tx=0x7f700c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.043+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c00ccc0 con 0x7f701c109df0 2024-07-26T08:30:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.043+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701c1aac30 con 0x7f701c109df0 2024-07-26T08:30:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.043+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f700c005020 con 0x7f701c109df0 2024-07-26T08:30:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.043+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0049c0 con 0x7f701c109df0 2024-07-26T08:30:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.043+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701c1b1390 con 0x7f701c109df0 2024-07-26T08:30:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.045+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701c10a200 con 0x7f701c109df0 2024-07-26T08:30:48.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.047+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f700c0051d0 con 0x7f701c109df0 2024-07-26T08:30:48.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.049+0000 7f7013e00640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70000b3c20 0x7f70000b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:48.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.049+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f700c0e41d0 con 0x7f701c109df0 2024-07-26T08:30:48.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.049+0000 7f701aa00640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70000b3c20 0x7f70000b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:48.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.050+0000 7f701aa00640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70000b3c20 0x7f70000b6130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f701c110340 tx=0x7f70040058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:48.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.050+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f700c0ab390 con 0x7f701c109df0 2024-07-26T08:30:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:48.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.283+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f701c1a5b00 con 0x7f701c109df0 2024-07-26T08:30:48.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.284+0000 7f7013e00640 1 -- 172.21.15.43:0/1523959840 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f700c0aac90 con 0x7f701c109df0 2024-07-26T08:30:48.286 INFO:teuthology.orchestra.run.smithi043.stdout:206158430286 2024-07-26T08:30:48.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.286+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70000b3c20 msgr2=0x7f70000b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:48.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.286+0000 7f7022000640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70000b3c20 0x7f70000b6130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f701c110340 tx=0x7f70040058d0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.286+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c109df0 msgr2=0x7f701c1a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.286+0000 7f7022000640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c109df0 0x7f701c1a49d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f700c00e9f0 tx=0x7f700c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 shutdown_connections 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70000b3c20 0x7f70000b6130 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f701c10eb80 0x7f701c1aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f701c10a740 0x7f701c1a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 --2- 172.21.15.43:0/1523959840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f701c109df0 0x7f701c1a49d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 >> 172.21.15.43:0/1523959840 conn(0x7f701c070d20 msgr2=0x7f701c10df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 shutdown_connections 2024-07-26T08:30:48.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:48.287+0000 7f7022000640 1 -- 172.21.15.43:0/1523959840 wait complete. 2024-07-26T08:30:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:48 smithi043 ceph-mon[32384]: pgmap v414: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:48 smithi133 ceph-mon[37053]: pgmap v414: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:48 smithi063 ceph-mon[36747]: pgmap v414: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:30:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:49 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1523959840' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-26T08:30:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:49 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1523959840' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-26T08:30:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:49 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1523959840' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-26T08:30:49.796 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:50.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.998+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3614644629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 msgr2=0x7f1a281047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:50.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.998+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3614644629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a281047f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009900 tx=0x7f1a1802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3614644629 shutdown_connections 2024-07-26T08:30:50.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3614644629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2810d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3614644629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2810d840 0x7f1a2810fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3614644629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a281047f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3614644629 >> 172.21.15.43:0/3614644629 conn(0x7f1a28079160 msgr2=0x7f1a28079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3614644629 shutdown_connections 2024-07-26T08:30:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.999+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3614644629 wait complete. 2024-07-26T08:30:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.001+0000 7f1a2ec00640 1 Processor -- start 2024-07-26T08:30:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.001+0000 7f1a2ec00640 1 -- start start 2024-07-26T08:30:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a2819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2810d840 0x7f1a2819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28113600 con 0x7f1a2810d840 2024-07-26T08:30:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28113480 con 0x7f1a281043e0 2024-07-26T08:30:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28113780 con 0x7f1a28104d30 2024-07-26T08:30:50.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a27400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a27e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a2819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a2cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2810d840 0x7f1a2819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a27400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:40968/0 (socket says 172.21.15.43:40968) 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.002+0000 7f1a27400640 1 -- 172.21.15.43:0/3159482679 learned_addr learned my addr 172.21.15.43:0/3159482679 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27e00640 1 -- 172.21.15.43:0/3159482679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 msgr2=0x7f1a2819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27e00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27e00640 1 -- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2810d840 msgr2=0x7f1a2819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27e00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2810d840 0x7f1a2819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27e00640 1 -- 172.21.15.43:0/3159482679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2819ffe0 con 0x7f1a281043e0 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27400640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:50.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.003+0000 7f1a27e00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a2819a070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006010 tx=0x7f1a18004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.004+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803f030 con 0x7f1a281043e0 2024-07-26T08:30:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.004+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a281a0270 con 0x7f1a281043e0 2024-07-26T08:30:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.004+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a18004440 con 0x7f1a281043e0 2024-07-26T08:30:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.004+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18035070 con 0x7f1a281043e0 2024-07-26T08:30:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.004+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a281a6a30 con 0x7f1a281043e0 2024-07-26T08:30:50.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.005+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a281047f0 con 0x7f1a281043e0 2024-07-26T08:30:50.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.010+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f1a18042030 con 0x7f1a281043e0 2024-07-26T08:30:50.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.011+0000 7f1a24c00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a0c0b3c20 0x7f1a0c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:50.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.012+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f1a181046b0 con 0x7f1a281043e0 2024-07-26T08:30:50.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.012+0000 7f1a27400640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a0c0b3c20 0x7f1a0c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:50.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.012+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1a18104b30 con 0x7f1a281043e0 2024-07-26T08:30:50.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.013+0000 7f1a27400640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a0c0b3c20 0x7f1a0c0b6130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a2810f6d0 tx=0x7f1a14005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:50.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.218+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1a281a6c60 con 0x7f1a281043e0 2024-07-26T08:30:50.221 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:50 smithi043 ceph-mon[32384]: pgmap v415: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-07-26T08:30:50.221 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:50 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3973997569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-26T08:30:50.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.219+0000 7f1a24c00640 1 -- 172.21.15.43:0/3159482679 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1a180cb190 con 0x7f1a281043e0 2024-07-26T08:30:50.222 INFO:teuthology.orchestra.run.smithi043.stdout:184683593811 2024-07-26T08:30:50.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a0c0b3c20 msgr2=0x7f1a0c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a0c0b3c20 0x7f1a0c0b6130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a2810f6d0 tx=0x7f1a14005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 msgr2=0x7f1a2819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a2819a070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006010 tx=0x7f1a18004040 comp rx=0 tx=0).stop 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 shutdown_connections 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1a0c0b3c20 0x7f1a0c0b6130 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a28104d30 0x7f1a2819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2810d840 0x7f1a2819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 --2- 172.21.15.43:0/3159482679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a281043e0 0x7f1a2819a070 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:50.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.222+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 >> 172.21.15.43:0/3159482679 conn(0x7f1a28079160 msgr2=0x7f1a280fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:50.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.223+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 shutdown_connections 2024-07-26T08:30:50.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:50.223+0000 7f1a2ec00640 1 -- 172.21.15.43:0/3159482679 wait complete. 2024-07-26T08:30:50.403 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430281 got 206158430286 for osd.7 2024-07-26T08:30:50.403 DEBUG:teuthology.parallel:result is None 2024-07-26T08:30:50.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:50 smithi133 ceph-mon[37053]: pgmap v415: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-07-26T08:30:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:50 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3973997569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-26T08:30:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:50 smithi063 ceph-mon[36747]: pgmap v415: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-07-26T08:30:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:50 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3973997569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-26T08:30:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:51 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3159482679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-26T08:30:51.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:51 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3159482679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-26T08:30:51.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:51 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3159482679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-26T08:30:52.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.753+0000 7fe0eac00640 1 -- 172.21.15.43:0/3862537624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4103590 msgr2=0x7fe0e41039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.753+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3862537624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4103590 0x7fe0e41039a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009900 tx=0x7fe0d402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 -- 172.21.15.43:0/3862537624 shutdown_connections 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3862537624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4109820 0x7fe0e4110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3862537624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4108ed0 0x7fe0e41092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3862537624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4103590 0x7fe0e41039a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 -- 172.21.15.43:0/3862537624 >> 172.21.15.43:0/3862537624 conn(0x7fe0e407b280 msgr2=0x7fe0e407b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 -- 172.21.15.43:0/3862537624 shutdown_connections 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.754+0000 7fe0eac00640 1 -- 172.21.15.43:0/3862537624 wait complete. 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.755+0000 7fe0eac00640 1 Processor -- start 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.755+0000 7fe0eac00640 1 -- start start 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.755+0000 7fe0eac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 0x7fe0e4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:52.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.755+0000 7fe0eac00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4108ed0 0x7fe0e419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.755+0000 7fe0eac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4109820 0x7fe0e419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.755+0000 7fe0eac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4113650 con 0x7fe0e4109820 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0eac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e41134d0 con 0x7fe0e4103590 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0eac00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e41137d0 con 0x7fe0e4108ed0 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 0x7fe0e4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 0x7fe0e4199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46516/0 (socket says 172.21.15.43:46516) 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0dbe00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4108ed0 0x7fe0e419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 -- 172.21.15.43:0/3973997569 learned_addr learned my addr 172.21.15.43:0/3973997569 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e8c00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4109820 0x7fe0e419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 -- 172.21.15.43:0/3973997569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4108ed0 msgr2=0x7fe0e419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4108ed0 0x7fe0e419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 -- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4109820 msgr2=0x7fe0e419f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4109820 0x7fe0e419f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.756+0000 7fe0e3e00640 1 -- 172.21.15.43:0/3973997569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e419ff30 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.757+0000 7fe0e3e00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 0x7fe0e4199fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40314b0 tx=0x7fe0d4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.757+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d403f070 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.757+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e41a01c0 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.757+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e41a6980 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.757+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe0d4031bf0 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.757+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4049060 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.759+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e41039a0 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.761+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fe0d4042070 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.762+0000 7fe0e1600640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0c80b3c20 0x7fe0c80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.763+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe0d4104be0 con 0x7fe0e4103590 2024-07-26T08:30:52.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.763+0000 7fe0dbe00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0c80b3c20 0x7fe0c80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.764+0000 7fe0dbe00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0c80b3c20 0x7fe0c80b6130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4108bc0 tx=0x7fe0cc005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stdout:38654705781 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.764+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe0d40cbd10 con 0x7fe0e4103590 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.987+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe0e419b0f0 con 0x7fe0e4103590 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.988+0000 7fe0e1600640 1 -- 172.21.15.43:0/3973997569 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0d40cb610 con 0x7fe0e4103590 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.990+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0c80b3c20 msgr2=0x7fe0c80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:52.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.990+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0c80b3c20 0x7fe0c80b6130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4108bc0 tx=0x7fe0cc005f90 comp rx=0 tx=0).stop 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.990+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 msgr2=0x7fe0e4199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.990+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 0x7fe0e4199fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40314b0 tx=0x7fe0d4003c10 comp rx=0 tx=0).stop 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 shutdown_connections 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0c80b3c20 0x7fe0c80b6130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4108ed0 0x7fe0e419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e4109820 0x7fe0e419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 --2- 172.21.15.43:0/3973997569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0e4103590 0x7fe0e4199fc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 >> 172.21.15.43:0/3973997569 conn(0x7fe0e407b280 msgr2=0x7fe0e4106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 shutdown_connections 2024-07-26T08:30:52.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:49.991+0000 7fe0eac00640 1 -- 172.21.15.43:0/3973997569 wait complete. 2024-07-26T08:30:52.433 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:52 smithi043 ceph-mon[32384]: pgmap v416: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-07-26T08:30:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:52 smithi133 ceph-mon[37053]: pgmap v416: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-07-26T08:30:52.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:52 smithi063 ceph-mon[36747]: pgmap v416: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-07-26T08:30:52.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593805 got 184683593811 for osd.6 2024-07-26T08:30:52.662 DEBUG:teuthology.parallel:result is None 2024-07-26T08:30:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 -- 172.21.15.43:0/3314576671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8076db0 msgr2=0x7f28d80751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 --2- 172.21.15.43:0/3314576671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8076db0 0x7f28d80751e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009900 tx=0x7f28c802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 -- 172.21.15.43:0/3314576671 shutdown_connections 2024-07-26T08:30:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 --2- 172.21.15.43:0/3314576671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8113e60 0x7f28d8116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 --2- 172.21.15.43:0/3314576671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8075800 0x7f28d8075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 --2- 172.21.15.43:0/3314576671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8076db0 0x7f28d80751e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.607+0000 7f28dd200640 1 -- 172.21.15.43:0/3314576671 >> 172.21.15.43:0/3314576671 conn(0x7f28d807b280 msgr2=0x7f28d807b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.608+0000 7f28dd200640 1 -- 172.21.15.43:0/3314576671 shutdown_connections 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.608+0000 7f28dd200640 1 -- 172.21.15.43:0/3314576671 wait complete. 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 Processor -- start 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 -- start start 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 0x7f28d81a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8076db0 0x7f28d81a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8113e60 0x7f28d81a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8119bc0 con 0x7f28d8113e60 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8119a40 con 0x7f28d8076db0 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.609+0000 7f28dd200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8119d40 con 0x7f28d8075800 2024-07-26T08:30:53.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8113e60 0x7f28d81a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 0x7f28d81a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 0x7f28d81a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:40982/0 (socket says 172.21.15.43:40982) 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d5e00640 1 -- 172.21.15.43:0/2928806449 learned_addr learned my addr 172.21.15.43:0/2928806449 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d5400640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8076db0 0x7f28d81a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d6800640 1 -- 172.21.15.43:0/2928806449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 msgr2=0x7f28d81a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d6800640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 0x7f28d81a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d6800640 1 -- 172.21.15.43:0/2928806449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8076db0 msgr2=0x7f28d81a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d6800640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8076db0 0x7f28d81a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d6800640 1 -- 172.21.15.43:0/2928806449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d81a64a0 con 0x7f28d8113e60 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d5400640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8076db0 0x7f28d81a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.610+0000 7f28d5e00640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 0x7f28d81a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:30:53.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.611+0000 7f28d6800640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8113e60 0x7f28d81a5d70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009fd0 tx=0x7f28d000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.611+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d000ce20 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.611+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28d0005020 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.611+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0010720 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.611+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d81a6790 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.611+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d81acef0 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.613+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d8075c10 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.617+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f28d0005560 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.619+0000 7f28cea00640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f28bc0b3c20 0x7f28bc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.620+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f28d00e4850 con 0x7f28d8113e60 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.620+0000 7f28d5e00640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f28bc0b3c20 0x7f28bc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.621+0000 7f28d5e00640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f28bc0b3c20 0x7f28bc0b6130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28c80096c0 tx=0x7f28c8005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:53.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.624+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f28d00ab980 con 0x7f28d8113e60 2024-07-26T08:30:53.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.852+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f28d81a1660 con 0x7f28d8113e60 2024-07-26T08:30:53.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.853+0000 7f28cea00640 1 -- 172.21.15.43:0/2928806449 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f28d00ab280 con 0x7f28d8113e60 2024-07-26T08:30:53.854 INFO:teuthology.orchestra.run.smithi043.stdout:81604378733 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f28bc0b3c20 msgr2=0x7f28bc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f28bc0b3c20 0x7f28bc0b6130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28c80096c0 tx=0x7f28c8005a20 comp rx=0 tx=0).stop 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8113e60 msgr2=0x7f28d81a5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8113e60 0x7f28d81a5d70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009fd0 tx=0x7f28d000ef10 comp rx=0 tx=0).stop 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 shutdown_connections 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f28bc0b3c20 0x7f28bc0b6130 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d8113e60 0x7f28d81a5d70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28d8076db0 0x7f28d81a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 --2- 172.21.15.43:0/2928806449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d8075800 0x7f28d81a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.855+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 >> 172.21.15.43:0/2928806449 conn(0x7f28d807b280 msgr2=0x7f28d8112a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.856+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 shutdown_connections 2024-07-26T08:30:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:53.856+0000 7f28dd200640 1 -- 172.21.15.43:0/2928806449 wait complete. 2024-07-26T08:30:54.439 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:54 smithi043 ceph-mon[32384]: pgmap v417: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:54.439 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:54 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2928806449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-26T08:30:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:54 smithi133 ceph-mon[37053]: pgmap v417: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:54 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2928806449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-26T08:30:54.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:54 smithi063 ceph-mon[36747]: pgmap v417: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:30:54.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:54 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2928806449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-26T08:30:55.471 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:55 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3238705595' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-26T08:30:55.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:55 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3238705595' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-26T08:30:55.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:55 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3238705595' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-26T08:30:56.334 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:30:56.434 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:56 smithi043 ceph-mon[32384]: pgmap v418: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:56.435 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:56 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2696535390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-26T08:30:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:56 smithi133 ceph-mon[37053]: pgmap v418: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:56 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2696535390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-26T08:30:56.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:56 smithi063 ceph-mon[36747]: pgmap v418: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:30:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:56 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2696535390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-26T08:30:56.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 -- 172.21.15.43:0/549787542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4076db0 msgr2=0x7f6df40751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:56.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 --2- 172.21.15.43:0/549787542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4076db0 0x7f6df40751e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009900 tx=0x7f6de402a410 comp rx=0 tx=0).stop 2024-07-26T08:30:56.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 -- 172.21.15.43:0/549787542 shutdown_connections 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 --2- 172.21.15.43:0/549787542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6df4075800 0x7f6df4075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 --2- 172.21.15.43:0/549787542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df4116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 --2- 172.21.15.43:0/549787542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4076db0 0x7f6df40751e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.468+0000 7f6dfa800640 1 -- 172.21.15.43:0/549787542 >> 172.21.15.43:0/549787542 conn(0x7f6df40fee70 msgr2=0x7f6df41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.469+0000 7f6dfa800640 1 -- 172.21.15.43:0/549787542 shutdown_connections 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.469+0000 7f6dfa800640 1 -- 172.21.15.43:0/549787542 wait complete. 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.471+0000 7f6dfa800640 1 Processor -- start 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.471+0000 7f6dfa800640 1 -- start start 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.471+0000 7f6dfa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4075800 0x7f6df41a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6dfa800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6df4076db0 0x7f6df41a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6dfa800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df41a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:56.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6dfa800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4119a10 con 0x7f6df4075800 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6dfa800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4119890 con 0x7f6df4113cb0 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6dfa800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4119b90 con 0x7f6df4076db0 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4075800 0x7f6df41a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df41a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df41a5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55090/0 (socket says 172.21.15.43:55090) 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4075800 0x7f6df41a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48424/0 (socket says 172.21.15.43:48424) 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df9e00640 1 -- 172.21.15.43:0/2696535390 learned_addr learned my addr 172.21.15.43:0/2696535390 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df8a00640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6df4076db0 0x7f6df41a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.472+0000 7f6df9e00640 1 -- 172.21.15.43:0/2696535390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6df4076db0 msgr2=0x7f6df41a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df9e00640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6df4076db0 0x7f6df41a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df9e00640 1 -- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4075800 msgr2=0x7f6df41a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df9e00640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4075800 0x7f6df41a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df9e00640 1 -- 172.21.15.43:0/2696535390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df41a6370 con 0x7f6df4113cb0 2024-07-26T08:30:56.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df9e00640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df41a5c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00eb10 tx=0x7f6dec00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:56.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec004b20 con 0x7f6df4113cb0 2024-07-26T08:30:56.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df41a6660 con 0x7f6df4113cb0 2024-07-26T08:30:56.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6dec004cc0 con 0x7f6df4113cb0 2024-07-26T08:30:56.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec010720 con 0x7f6df4113cb0 2024-07-26T08:30:56.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.473+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df41acdc0 con 0x7f6df4113cb0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.475+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4075c10 con 0x7f6df4113cb0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.477+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f6dec0108e0 con 0x7f6df4113cb0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.479+0000 7f6df2000640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6dd80b3ca0 0x7f6dd80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.479+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f6dec0e46f0 con 0x7f6df4113cb0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.479+0000 7f6df9400640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6dd80b3ca0 0x7f6dd80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.480+0000 7f6df9400640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6dd80b3ca0 0x7f6dd80b61b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009230 tx=0x7f6de40058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.480+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6dec0ab820 con 0x7f6df4113cb0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.687+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f6df41a1530 con 0x7f6df4113cb0 2024-07-26T08:30:56.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.688+0000 7f6df2000640 1 -- 172.21.15.43:0/2696535390 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6dec0ab120 con 0x7f6df4113cb0 2024-07-26T08:30:56.848 INFO:teuthology.orchestra.run.smithi043.stdout:231928234059 2024-07-26T08:30:56.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.691+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6dd80b3ca0 msgr2=0x7f6dd80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:56.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.691+0000 7f6dfa800640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6dd80b3ca0 0x7f6dd80b61b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009230 tx=0x7f6de40058d0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.691+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 msgr2=0x7f6df41a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:56.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.691+0000 7f6dfa800640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df41a5c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00eb10 tx=0x7f6dec00c2d0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 shutdown_connections 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6dd80b3ca0 0x7f6dd80b61b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6df4076db0 0x7f6df41a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6df4113cb0 0x7f6df41a5c40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 --2- 172.21.15.43:0/2696535390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6df4075800 0x7f6df41a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 >> 172.21.15.43:0/2696535390 conn(0x7f6df40fee70 msgr2=0x7f6df410fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 shutdown_connections 2024-07-26T08:30:56.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:55.692+0000 7f6dfa800640 1 -- 172.21.15.43:0/2696535390 wait complete. 2024-07-26T08:30:57.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:57 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3516015932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-26T08:30:57.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 -- 172.21.15.43:0/544803846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b14108d20 msgr2=0x7f3b14109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 --2- 172.21.15.43:0/544803846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b14108d20 0x7f3b14109130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009900 tx=0x7f3afc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 -- 172.21.15.43:0/544803846 shutdown_connections 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 --2- 172.21.15.43:0/544803846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 0x7f3b1410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 --2- 172.21.15.43:0/544803846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b14108d20 0x7f3b14109130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 --2- 172.21.15.43:0/544803846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b141033e0 0x7f3b141037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 -- 172.21.15.43:0/544803846 >> 172.21.15.43:0/544803846 conn(0x7f3b140fee70 msgr2=0x7f3b141012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 -- 172.21.15.43:0/544803846 shutdown_connections 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.433+0000 7f3b19600640 1 -- 172.21.15.43:0/544803846 wait complete. 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.434+0000 7f3b19600640 1 Processor -- start 2024-07-26T08:30:57.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 -- start start 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 0x7f3b1419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b14108d20 0x7f3b1419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 0x7f3b141a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141134a0 con 0x7f3b14109670 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3b14113320 con 0x7f3b141033e0 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.435+0000 7f3b19600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3b14113620 con 0x7f3b14108d20 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 0x7f3b1419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 0x7f3b1419c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55102/0 (socket says 172.21.15.43:55102) 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 -- 172.21.15.43:0/3516015932 learned_addr learned my addr 172.21.15.43:0/3516015932 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b18c00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 0x7f3b141a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b0be00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b14108d20 0x7f3b1419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 -- 172.21.15.43:0/3516015932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b14108d20 msgr2=0x7f3b1419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b14108d20 0x7f3b1419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 -- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 msgr2=0x7f3b141a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 0x7f3b141a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.492 INFO:teuthology.orchestra.run.smithi043.stdout:304942678073 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 -- 172.21.15.43:0/3516015932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b141a2020 con 0x7f3b141033e0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b18c00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 0x7f3b141a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.436+0000 7f3b13e00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 0x7f3b1419c0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400e9f0 tx=0x7f3b0400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.437+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400cd80 con 0x7f3b141033e0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.437+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b040054f0 con 0x7f3b141033e0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.437+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04010690 con 0x7f3b141033e0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.437+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b141a2310 con 0x7f3b141033e0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.437+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b141a8a70 con 0x7f3b141033e0 2024-07-26T08:30:57.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.438+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b141037f0 con 0x7f3b141033e0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.441+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f3b040046c0 con 0x7f3b141033e0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.443+0000 7f3b11600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3af80b3ca0 0x7f3af80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.443+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3b040e4520 con 0x7f3b141033e0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.443+0000 7f3b0be00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3af80b3ca0 0x7f3af80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.444+0000 7f3b0be00640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3af80b3ca0 0x7f3af80b61b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3afc02a9e0 tx=0x7f3afc000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.447+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3b040ab650 con 0x7f3b141033e0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.650+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3b141a8da0 con 0x7f3b141033e0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.652+0000 7f3b11600640 1 -- 172.21.15.43:0/3516015932 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3b040aaf50 con 0x7f3b141033e0 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3af80b3ca0 msgr2=0x7f3af80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3af80b3ca0 0x7f3af80b61b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3afc02a9e0 tx=0x7f3afc000bc0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 msgr2=0x7f3b1419c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:57.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 0x7f3b1419c0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400e9f0 tx=0x7f3b0400edf0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 shutdown_connections 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3af80b3ca0 0x7f3af80b61b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b14108d20 0x7f3b1419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b14109670 0x7f3b141a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 --2- 172.21.15.43:0/3516015932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b141033e0 0x7f3b1419c0b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 >> 172.21.15.43:0/3516015932 conn(0x7f3b140fee70 msgr2=0x7f3b141083a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.655+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 shutdown_connections 2024-07-26T08:30:57.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:56.656+0000 7f3b19600640 1 -- 172.21.15.43:0/3516015932 wait complete. 2024-07-26T08:30:57.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:57 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3516015932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-26T08:30:57.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:57 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3516015932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-26T08:30:57.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705776 got 38654705781 for osd.0 2024-07-26T08:30:57.770 DEBUG:teuthology.parallel:result is None 2024-07-26T08:30:58.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 -- 172.21.15.43:0/2767663884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c1055d0 msgr2=0x7fd10c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:58.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 --2- 172.21.15.43:0/2767663884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c1055d0 0x7fd10c1059e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009860 tx=0x7fd0fc02a340 comp rx=0 tx=0).stop 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 -- 172.21.15.43:0/2767663884 shutdown_connections 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 --2- 172.21.15.43:0/2767663884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 --2- 172.21.15.43:0/2767663884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10c10af10 0x7fd10c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 --2- 172.21.15.43:0/2767663884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c1055d0 0x7fd10c1059e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 -- 172.21.15.43:0/2767663884 >> 172.21.15.43:0/2767663884 conn(0x7fd10c101040 msgr2=0x7fd10c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 -- 172.21.15.43:0/2767663884 shutdown_connections 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.437+0000 7fd10b200640 1 -- 172.21.15.43:0/2767663884 wait complete. 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.438+0000 7fd10b200640 1 Processor -- start 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 -- start start 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10c1055d0 0x7fd10c19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c10af10 0x7fd10c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c115660 con 0x7fd10c1055d0 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c1154e0 con 0x7fd10c10af10 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.439+0000 7fd10b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c1157e0 con 0x7fd10c10b860 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c1a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:40994/0 (socket says 172.21.15.43:40994) 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 -- 172.21.15.43:0/3238705595 learned_addr learned my addr 172.21.15.43:0/3238705595 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd109e00640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10c1055d0 0x7fd10c19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd109400640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c10af10 0x7fd10c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 -- 172.21.15.43:0/3238705595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c10af10 msgr2=0x7fd10c19c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c10af10 0x7fd10c19c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 -- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10c1055d0 msgr2=0x7fd10c19bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:58.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10c1055d0 0x7fd10c19bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 -- 172.21.15.43:0/3238705595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c1a1f40 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.440+0000 7fd10a800640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c1a1810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd10400eb10 tx=0x7fd10400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.441+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104004b20 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.441+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd104004cc0 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.441+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10c1a2230 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.441+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104010720 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.441+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10c1a8990 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.442+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10c1059e0 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.445+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fd1040108c0 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.446+0000 7fd102a00640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0f00b3ca0 0x7fd0f00b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.446+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fd1040e4810 con 0x7fd10c10b860 2024-07-26T08:30:58.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.447+0000 7fd109e00640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0f00b3ca0 0x7fd0f00b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:30:58.189 INFO:teuthology.orchestra.run.smithi043.stdout:137438953569 2024-07-26T08:30:58.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.447+0000 7fd109e00640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0f00b3ca0 0x7fd0f00b61b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc02a930 tx=0x7fd0fc0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:30:58.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.448+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd104055600 con 0x7fd10c10b860 2024-07-26T08:30:58.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.654+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd10c19d100 con 0x7fd10c10b860 2024-07-26T08:30:58.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.655+0000 7fd102a00640 1 -- 172.21.15.43:0/3238705595 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd10c19d100 con 0x7fd10c10b860 2024-07-26T08:30:58.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0f00b3ca0 msgr2=0x7fd0f00b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0f00b3ca0 0x7fd0f00b61b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc02a930 tx=0x7fd0fc0058d0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 msgr2=0x7fd10c1a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c1a1810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd10400eb10 tx=0x7fd10400c2d0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 shutdown_connections 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd0f00b3ca0 0x7fd0f00b61b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd10c10b860 0x7fd10c1a1810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10c10af10 0x7fd10c19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 --2- 172.21.15.43:0/3238705595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10c1055d0 0x7fd10c19bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 >> 172.21.15.43:0/3238705595 conn(0x7fd10c101040 msgr2=0x7fd10c10a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 shutdown_connections 2024-07-26T08:30:58.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:30:54.658+0000 7fd10b200640 1 -- 172.21.15.43:0/3238705595 wait complete. 2024-07-26T08:30:58.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:30:58 smithi133 ceph-mon[37053]: pgmap v419: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:30:58 smithi043 ceph-mon[32384]: pgmap v419: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:30:58 smithi063 ceph-mon[36747]: pgmap v419: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:30:58.693 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378727 got 81604378733 for osd.2 2024-07-26T08:30:58.693 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:00.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234055 got 231928234059 for osd.8 2024-07-26T08:31:00.199 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:00.260 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:00 smithi043 ceph-mon[32384]: pgmap v420: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:00.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:00 smithi133 ceph-mon[37053]: pgmap v420: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:00.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:00 smithi063 ceph-mon[36747]: pgmap v420: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:00.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953564 got 137438953569 for osd.4 2024-07-26T08:31:00.771 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:02.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 -- 172.21.15.43:0/2479861768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 msgr2=0x7f44e8101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:02.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 --2- 172.21.15.43:0/2479861768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8101db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009860 tx=0x7f44d802a340 comp rx=0 tx=0).stop 2024-07-26T08:31:02.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 -- 172.21.15.43:0/2479861768 shutdown_connections 2024-07-26T08:31:02.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 --2- 172.21.15.43:0/2479861768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8109830 0x7f44e8110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 --2- 172.21.15.43:0/2479861768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e8108ee0 0x7f44e81092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 --2- 172.21.15.43:0/2479861768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8101db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.070+0000 7f44ef200640 1 -- 172.21.15.43:0/2479861768 >> 172.21.15.43:0/2479861768 conn(0x7f44e8077690 msgr2=0x7f44e8077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:02.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.071+0000 7f44ef200640 1 -- 172.21.15.43:0/2479861768 shutdown_connections 2024-07-26T08:31:02.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.071+0000 7f44ef200640 1 -- 172.21.15.43:0/2479861768 wait complete. 2024-07-26T08:31:02.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 Processor -- start 2024-07-26T08:31:02.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 -- start start 2024-07-26T08:31:02.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8102940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:02.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8108ee0 0x7f44e8102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e8109830 0x7f44e81033c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8113630 con 0x7f44e8109830 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81134b0 con 0x7f44e81019a0 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.072+0000 7f44ef200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81137b0 con 0x7f44e8108ee0 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8102940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44ed200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e8109830 0x7f44e81033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8102940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55130/0 (socket says 172.21.15.43:55130) 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 -- 172.21.15.43:0/1878414494 learned_addr learned my addr 172.21.15.43:0/1878414494 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:02.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7400640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8108ee0 0x7f44e8102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:02.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 -- 172.21.15.43:0/1878414494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8108ee0 msgr2=0x7f44e8102e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:02.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8108ee0 0x7f44e8102e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 -- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e8109830 msgr2=0x7f44e81033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:02.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e8109830 0x7f44e81033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.073+0000 7f44e7e00640 1 -- 172.21.15.43:0/1878414494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e81a8200 con 0x7f44e81019a0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.074+0000 7f44e7e00640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8102940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f44d80057c0 tx=0x7f44d802aef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.074+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8037040 con 0x7f44e81019a0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.074+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44d8040070 con 0x7f44e81019a0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.074+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8003850 con 0x7f44e81019a0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.074+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e81a8490 con 0x7f44e81019a0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.074+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81a8920 con 0x7f44e81019a0 2024-07-26T08:31:02.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.075+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e8101db0 con 0x7f44e81019a0 2024-07-26T08:31:02.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.078+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f44d8004050 con 0x7f44e81019a0 2024-07-26T08:31:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.080+0000 7f44e4c00640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44cc0b3c20 0x7f44cc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.080+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f44d8103e10 con 0x7f44e81019a0 2024-07-26T08:31:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.080+0000 7f44e7400640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44cc0b3c20 0x7f44cc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.081+0000 7f44e7400640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44cc0b3c20 0x7f44cc0b6130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f44e8101570 tx=0x7f44d4009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.081+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f44d8049020 con 0x7f44e81019a0 2024-07-26T08:31:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.298+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f44e8103c40 con 0x7f44e81019a0 2024-07-26T08:31:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.298+0000 7f44e4c00640 1 -- 172.21.15.43:0/1878414494 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f44d80caf40 con 0x7f44e81019a0 2024-07-26T08:31:02.300 INFO:teuthology.orchestra.run.smithi043.stdout:279172874303 2024-07-26T08:31:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44cc0b3c20 msgr2=0x7f44cc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44cc0b3c20 0x7f44cc0b6130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f44e8101570 tx=0x7f44d4009260 comp rx=0 tx=0).stop 2024-07-26T08:31:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 msgr2=0x7f44e8102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8102940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f44d80057c0 tx=0x7f44d802aef0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 shutdown_connections 2024-07-26T08:31:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44cc0b3c20 0x7f44cc0b6130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44e8108ee0 0x7f44e8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e8109830 0x7f44e81033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.301+0000 7f44ef200640 1 --2- 172.21.15.43:0/1878414494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e81019a0 0x7f44e8102940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.302+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 >> 172.21.15.43:0/1878414494 conn(0x7f44e8077690 msgr2=0x7f44e8106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.302+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 shutdown_connections 2024-07-26T08:31:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.302+0000 7f44ef200640 1 -- 172.21.15.43:0/1878414494 wait complete. 2024-07-26T08:31:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:02 smithi043 ceph-mon[32384]: pgmap v421: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:02.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:02 smithi133 ceph-mon[37053]: pgmap v421: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:02.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:02 smithi063 ceph-mon[36747]: pgmap v421: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:03.109 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678069 got 304942678073 for osd.11 2024-07-26T08:31:03.109 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:03.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/4016287779' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-26T08:31:03.300 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1878414494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-26T08:31:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:03 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/4016287779' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-26T08:31:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:03 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1878414494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-26T08:31:03.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:03 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/4016287779' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-26T08:31:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:03 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1878414494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 -- 172.21.15.43:0/1124414185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964075800 msgr2=0x7f9964075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 --2- 172.21.15.43:0/1124414185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964075800 0x7f9964075c10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9954009ca0 tx=0x7f995402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 -- 172.21.15.43:0/1124414185 shutdown_connections 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 --2- 172.21.15.43:0/1124414185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964075800 0x7f9964075c10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 --2- 172.21.15.43:0/1124414185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9964113c90 0x7f9964116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 --2- 172.21.15.43:0/1124414185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99640751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 -- 172.21.15.43:0/1124414185 >> 172.21.15.43:0/1124414185 conn(0x7f99640fee10 msgr2=0x7f9964101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 -- 172.21.15.43:0/1124414185 shutdown_connections 2024-07-26T08:31:03.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.756+0000 7f9968e00640 1 -- 172.21.15.43:0/1124414185 wait complete. 2024-07-26T08:31:03.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.757+0000 7f9968e00640 1 Processor -- start 2024-07-26T08:31:03.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 -- start start 2024-07-26T08:31:03.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9964075800 0x7f99641a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:03.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99641a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964113c90 0x7f99641a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f99641199d0 con 0x7f9964075800 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9964119850 con 0x7f9964076db0 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.758+0000 7f9968e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9964119b50 con 0x7f9964113c90 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9963400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9964075800 0x7f99641a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99641a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99641a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55150/0 (socket says 172.21.15.43:55150) 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 -- 172.21.15.43:0/56650745 learned_addr learned my addr 172.21.15.43:0/56650745 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9963e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964113c90 0x7f99641a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 -- 172.21.15.43:0/56650745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964113c90 msgr2=0x7f99641a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:03.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964113c90 0x7f99641a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 -- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9964075800 msgr2=0x7f99641a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:03.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9964075800 0x7f99641a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.759+0000 7f9962a00640 1 -- 172.21.15.43:0/56650745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99641a63f0 con 0x7f9964076db0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.760+0000 7f9962a00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99641a0a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f995402ade0 tx=0x7f9954003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.760+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954031650 con 0x7f9964076db0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.760+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99641a6680 con 0x7f9964076db0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.760+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f99540317f0 con 0x7f9964076db0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.760+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995402fa80 con 0x7f9964076db0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.760+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99641ace40 con 0x7f9964076db0 2024-07-26T08:31:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.761+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99640766f0 con 0x7f9964076db0 2024-07-26T08:31:03.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.764+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f995402fc20 con 0x7f9964076db0 2024-07-26T08:31:03.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.765+0000 7f995be00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f99480b3c20 0x7f99480b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:03.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.766+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f9954105680 con 0x7f9964076db0 2024-07-26T08:31:03.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.766+0000 7f9963400640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f99480b3c20 0x7f99480b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:03.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.766+0000 7f9963400640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f99480b3c20 0x7f99480b6130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f994c009bd0 tx=0x7f994c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:03.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.767+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f99540cc7b0 con 0x7f9964076db0 2024-07-26T08:31:03.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.979+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f99641129c0 con 0x7f9964076db0 2024-07-26T08:31:03.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.980+0000 7f995be00640 1 -- 172.21.15.43:0/56650745 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99540cc0b0 con 0x7f9964076db0 2024-07-26T08:31:03.981 INFO:teuthology.orchestra.run.smithi043.stdout:60129542260 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.982+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f99480b3c20 msgr2=0x7f99480b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f99480b3c20 0x7f99480b6130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f994c009bd0 tx=0x7f994c005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 msgr2=0x7f99641a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99641a0a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f995402ade0 tx=0x7f9954003c10 comp rx=0 tx=0).stop 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 shutdown_connections 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f99480b3c20 0x7f99480b6130 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9964113c90 0x7f99641a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9964076db0 0x7f99641a0a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 --2- 172.21.15.43:0/56650745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9964075800 0x7f99641a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 >> 172.21.15.43:0/56650745 conn(0x7f99640fee10 msgr2=0x7f996410fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:03.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 shutdown_connections 2024-07-26T08:31:03.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:03.983+0000 7f9968e00640 1 -- 172.21.15.43:0/56650745 wait complete. 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 -- 172.21.15.43:0/519252877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 msgr2=0x7fcbe0105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/519252877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe0105bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009ca0 tx=0x7fcbd002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 -- 172.21.15.43:0/519252877 shutdown_connections 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/519252877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010b120 0x7fcbe010b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/519252877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010ba70 0x7fcbe01122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/519252877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe0105bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 -- 172.21.15.43:0/519252877 >> 172.21.15.43:0/519252877 conn(0x7fcbe01011f0 msgr2=0x7fcbe0103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 -- 172.21.15.43:0/519252877 shutdown_connections 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.972+0000 7fcbe4a00640 1 -- 172.21.15.43:0/519252877 wait complete. 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.974+0000 7fcbe4a00640 1 Processor -- start 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.974+0000 7fcbe4a00640 1 -- start start 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 0x7fcbe019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010ba70 0x7fcbe01a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0115850 con 0x7fcbe010b120 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01156d0 con 0x7fcbe01057e0 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01159d0 con 0x7fcbe010ba70 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbdd400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 0x7fcbe019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbdde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:04.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbdd400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 0x7fcbe019c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48450/0 (socket says 172.21.15.43:48450) 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbdd400640 1 -- 172.21.15.43:0/4016287779 learned_addr learned my addr 172.21.15.43:0/4016287779 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.975+0000 7fcbde800640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010ba70 0x7fcbe01a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdde00640 1 -- 172.21.15.43:0/4016287779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010ba70 msgr2=0x7fcbe01a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdde00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010ba70 0x7fcbe01a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdde00640 1 -- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 msgr2=0x7fcbe019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdde00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 0x7fcbe019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdde00640 1 -- 172.21.15.43:0/4016287779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe01a2270 con 0x7fcbe01057e0 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdd400640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 0x7fcbe019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbde800640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010ba70 0x7fcbe01a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.976+0000 7fcbdde00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe019c300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009ca0 tx=0x7fcbd0003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.977+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0031650 con 0x7fcbe01057e0 2024-07-26T08:31:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.977+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe01a2500 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.977+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01a8cc0 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.977+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcbd0003e50 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.977+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd002f8c0 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.978+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbbc0052c0 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.983+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fcbd00317f0 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.984+0000 7fcbd6a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbc40b3c20 0x7fcbc40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.985+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fcbd01053d0 con 0x7fcbe01057e0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.985+0000 7fcbdd400640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbc40b3c20 0x7fcbc40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:04.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.985+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcbd0105850 con 0x7fcbe01057e0 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stdout:257698037830 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:01.986+0000 7fcbdd400640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbc40b3c20 0x7fcbc40b6130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0103b00 tx=0x7fcbc8005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.200+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fcbbc005880 con 0x7fcbe01057e0 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.200+0000 7fcbd6a00640 1 -- 172.21.15.43:0/4016287779 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcbd00cc500 con 0x7fcbe01057e0 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbc40b3c20 msgr2=0x7fcbc40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbc40b3c20 0x7fcbc40b6130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0103b00 tx=0x7fcbc8005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:04.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 msgr2=0x7fcbe019c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe019c300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009ca0 tx=0x7fcbd0003ba0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 shutdown_connections 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcbc40b3c20 0x7fcbc40b6130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe010ba70 0x7fcbe01a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbe010b120 0x7fcbe019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 --2- 172.21.15.43:0/4016287779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe01057e0 0x7fcbe019c300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.203+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 >> 172.21.15.43:0/4016287779 conn(0x7fcbe01011f0 msgr2=0x7fcbe0104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.204+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 shutdown_connections 2024-07-26T08:31:04.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:02.204+0000 7fcbe4a00640 1 -- 172.21.15.43:0/4016287779 wait complete. 2024-07-26T08:31:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:04 smithi043 ceph-mon[32384]: pgmap v422: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:04 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/56650745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-26T08:31:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:04 smithi133 ceph-mon[37053]: pgmap v422: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/56650745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-26T08:31:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:04 smithi063 ceph-mon[36747]: pgmap v422: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:04 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/56650745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-26T08:31:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:05.610 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542254 got 60129542260 for osd.1 2024-07-26T08:31:05.610 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:05.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 -- 172.21.15.43:0/288658927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 msgr2=0x7f25c01037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:05.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 --2- 172.21.15.43:0/288658927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c01037f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009900 tx=0x7f25b002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 -- 172.21.15.43:0/288658927 shutdown_connections 2024-07-26T08:31:05.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 --2- 172.21.15.43:0/288658927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25c0109670 0x7f25c010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 --2- 172.21.15.43:0/288658927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c0108d20 0x7f25c0109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 --2- 172.21.15.43:0/288658927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c01037f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 -- 172.21.15.43:0/288658927 >> 172.21.15.43:0/288658927 conn(0x7f25c00fee30 msgr2=0x7f25c0101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 -- 172.21.15.43:0/288658927 shutdown_connections 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.178+0000 7f25bfe00640 1 -- 172.21.15.43:0/288658927 wait complete. 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 Processor -- start 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 -- start start 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c019bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c0108d20 0x7f25c019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25c0109670 0x7f25c01a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01134c0 con 0x7f25c0108d20 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0113340 con 0x7f25c0109670 2024-07-26T08:31:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.180+0000 7f25bfe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0113640 con 0x7f25c01033e0 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c019bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25be000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c0108d20 0x7f25c019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c019bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:46390/0 (socket says 172.21.15.43:46390) 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 -- 172.21.15.43:0/57158613 learned_addr learned my addr 172.21.15.43:0/57158613 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bf400640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25c0109670 0x7f25c01a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 -- 172.21.15.43:0/57158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25c0109670 msgr2=0x7f25c01a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25c0109670 0x7f25c01a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 -- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c0108d20 msgr2=0x7f25c019c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c0108d20 0x7f25c019c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.181+0000 7f25bea00640 1 -- 172.21.15.43:0/57158613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c01a1f60 con 0x7f25c01033e0 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.182+0000 7f25bea00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c019bff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25b002a960 tx=0x7f25b0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:05.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.182+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b003f070 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.182+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f25b0031be0 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.182+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c01a21f0 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.182+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0035030 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.182+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c01a89b0 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.184+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c01037f0 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.186+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f25b0042070 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.188+0000 7f25c4a00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25a40b3ce0 0x7f25a40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.188+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f25b0104ac0 con 0x7f25c01033e0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.188+0000 7f25be000640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25a40b3ce0 0x7f25a40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:05.801 INFO:teuthology.orchestra.run.smithi043.stdout:111669149799 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.189+0000 7f25be000640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25a40b3ce0 0x7f25a40b61f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25c0105330 tx=0x7f25ac005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.189+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f25b00cb5a0 con 0x7f25c01033e0 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.402+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f25c01a8c70 con 0x7f25c01033e0 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.403+0000 7f25c4a00640 1 -- 172.21.15.43:0/57158613 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f25b00cfaf0 con 0x7f25c01033e0 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.406+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25a40b3ce0 msgr2=0x7f25a40b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.406+0000 7f25bfe00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25a40b3ce0 0x7f25a40b61f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25c0105330 tx=0x7f25ac005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.406+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 msgr2=0x7f25c019bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:05.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.406+0000 7f25bfe00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c019bff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25b002a960 tx=0x7f25b0003b90 comp rx=0 tx=0).stop 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 shutdown_connections 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25a40b3ce0 0x7f25a40b61f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25c0109670 0x7f25c01a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c0108d20 0x7f25c019c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 --2- 172.21.15.43:0/57158613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c01033e0 0x7f25c019bff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 >> 172.21.15.43:0/57158613 conn(0x7f25c00fee30 msgr2=0x7f25c0108310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 shutdown_connections 2024-07-26T08:31:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:05.407+0000 7f25bfe00640 1 -- 172.21.15.43:0/57158613 wait complete. 2024-07-26T08:31:06.466 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:06 smithi043 ceph-mon[32384]: pgmap v423: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:06.467 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:06 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/57158613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-26T08:31:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:06 smithi133 ceph-mon[37053]: pgmap v423: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:06 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/57158613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-26T08:31:06.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:06 smithi063 ceph-mon[36747]: pgmap v423: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:06 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/57158613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-26T08:31:06.965 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149792 got 111669149799 for osd.3 2024-07-26T08:31:06.965 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:07.927 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037822 got 257698037830 for osd.9 2024-07-26T08:31:07.927 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:07.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874296 got 279172874303 for osd.10 2024-07-26T08:31:07.960 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:08.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:08 smithi043 ceph-mon[32384]: pgmap v424: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:08.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:08 smithi133 ceph-mon[37053]: pgmap v424: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:08.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:08 smithi063 ceph-mon[36747]: pgmap v424: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:09.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 -- 172.21.15.43:0/3614131050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c1022a0 msgr2=0x7f427c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:09.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 --2- 172.21.15.43:0/3614131050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c1022a0 0x7f427c1026b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4270009900 tx=0x7f427002a410 comp rx=0 tx=0).stop 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 -- 172.21.15.43:0/3614131050 shutdown_connections 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 --2- 172.21.15.43:0/3614131050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 0x7f427c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 --2- 172.21.15.43:0/3614131050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c108530 0x7f427c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 --2- 172.21.15.43:0/3614131050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c1022a0 0x7f427c1026b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.466+0000 7f4283200640 1 -- 172.21.15.43:0/3614131050 >> 172.21.15.43:0/3614131050 conn(0x7f427c0fdcf0 msgr2=0x7f427c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.467+0000 7f4283200640 1 -- 172.21.15.43:0/3614131050 shutdown_connections 2024-07-26T08:31:09.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.467+0000 7f4283200640 1 -- 172.21.15.43:0/3614131050 wait complete. 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.468+0000 7f4283200640 1 Processor -- start 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.468+0000 7f4283200640 1 -- start start 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4283200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 0x7f427c19c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4283200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 0x7f427c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4283200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c108530 0x7f427c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4283200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f427c112330 con 0x7f427c108530 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4283200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1121b0 con 0x7f427c1022a0 2024-07-26T08:31:09.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4283200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f427c1124b0 con 0x7f427c107be0 2024-07-26T08:31:09.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4281e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 0x7f427c19c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:09.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4281400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 0x7f427c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:09.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4281e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 0x7f427c19c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59650/0 (socket says 172.21.15.43:59650) 2024-07-26T08:31:09.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4282800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c108530 0x7f427c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:09.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4281e00640 1 -- 172.21.15.43:0/2483014893 learned_addr learned my addr 172.21.15.43:0/2483014893 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.469+0000 7f4281400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 0x7f427c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:46420/0 (socket says 172.21.15.43:46420) 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4281e00640 1 -- 172.21.15.43:0/2483014893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 msgr2=0x7f427c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4281e00640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 0x7f427c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4281e00640 1 -- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c108530 msgr2=0x7f427c1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4281e00640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c108530 0x7f427c1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4281e00640 1 -- 172.21.15.43:0/2483014893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c1a1fa0 con 0x7f427c1022a0 2024-07-26T08:31:09.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4281e00640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 0x7f427c19c030 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4270005ab0 tx=0x7f42700042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:09.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427003f030 con 0x7f427c1022a0 2024-07-26T08:31:09.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.470+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c1a2230 con 0x7f427c1022a0 2024-07-26T08:31:09.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.471+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4270003cd0 con 0x7f427c1022a0 2024-07-26T08:31:09.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.471+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270035070 con 0x7f427c1022a0 2024-07-26T08:31:09.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.471+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c1a89f0 con 0x7f427c1022a0 2024-07-26T08:31:09.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.472+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c1026b0 con 0x7f427c1022a0 2024-07-26T08:31:09.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.474+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f4270042030 con 0x7f427c1022a0 2024-07-26T08:31:09.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.476+0000 7f4276a00640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f42640b3c20 0x7f42640b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:09.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.476+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f42701048e0 con 0x7f427c1022a0 2024-07-26T08:31:09.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.476+0000 7f4281400640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f42640b3c20 0x7f42640b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:09.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.477+0000 7f4281400640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f42640b3c20 0x7f42640b6130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f427c104480 tx=0x7f426c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:09.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.480+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f42700cb3c0 con 0x7f427c1022a0 2024-07-26T08:31:09.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.683+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f427c0ff840 con 0x7f427c1022a0 2024-07-26T08:31:09.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.684+0000 7f4276a00640 1 -- 172.21.15.43:0/2483014893 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f42700cf910 con 0x7f427c1022a0 2024-07-26T08:31:09.685 INFO:teuthology.orchestra.run.smithi043.stdout:158913790046 2024-07-26T08:31:09.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f42640b3c20 msgr2=0x7f42640b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:09.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f42640b3c20 0x7f42640b6130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f427c104480 tx=0x7f426c005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:09.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 msgr2=0x7f427c19c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:09.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 0x7f427c19c030 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4270005ab0 tx=0x7f42700042f0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 shutdown_connections 2024-07-26T08:31:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f42640b3c20 0x7f42640b6130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f427c107be0 0x7f427c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f427c108530 0x7f427c1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 --2- 172.21.15.43:0/2483014893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f427c1022a0 0x7f427c19c030 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 >> 172.21.15.43:0/2483014893 conn(0x7f427c0fdcf0 msgr2=0x7f427c107200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 shutdown_connections 2024-07-26T08:31:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:09.687+0000 7f4283200640 1 -- 172.21.15.43:0/2483014893 wait complete. 2024-07-26T08:31:10.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:10 smithi043 ceph-mon[32384]: pgmap v425: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:10.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:10 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2483014893' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-26T08:31:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:10 smithi133 ceph-mon[37053]: pgmap v425: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:10 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2483014893' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-26T08:31:10.563 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790039 got 158913790046 for osd.5 2024-07-26T08:31:10.563 DEBUG:teuthology.parallel:result is None 2024-07-26T08:31:10.563 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-26T08:31:10.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph pg dump --format=json 2024-07-26T08:31:10.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:10 smithi063 ceph-mon[36747]: pgmap v425: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:10.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:10 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2483014893' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-26T08:31:11.071 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:12 smithi043 ceph-mon[32384]: pgmap v426: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:12 smithi133 ceph-mon[37053]: pgmap v426: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:12 smithi063 ceph-mon[36747]: pgmap v426: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 -- 172.21.15.43:0/2536599872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c1033c0 msgr2=0x7ff10c1037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 --2- 172.21.15.43:0/2536599872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c1033c0 0x7ff10c1037d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009900 tx=0x7ff0fc02a410 comp rx=0 tx=0).stop 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 -- 172.21.15.43:0/2536599872 shutdown_connections 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 --2- 172.21.15.43:0/2536599872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c109650 0x7ff10c10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 --2- 172.21.15.43:0/2536599872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff10c108d00 0x7ff10c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 --2- 172.21.15.43:0/2536599872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c1033c0 0x7ff10c1037d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.570+0000 7ff10b200640 1 -- 172.21.15.43:0/2536599872 >> 172.21.15.43:0/2536599872 conn(0x7ff10c0fee10 msgr2=0x7ff10c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.571+0000 7ff10b200640 1 -- 172.21.15.43:0/2536599872 shutdown_connections 2024-07-26T08:31:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.571+0000 7ff10b200640 1 -- 172.21.15.43:0/2536599872 wait complete. 2024-07-26T08:31:13.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.572+0000 7ff10b200640 1 Processor -- start 2024-07-26T08:31:13.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.572+0000 7ff10b200640 1 -- start start 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.573+0000 7ff10b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 0x7ff10c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.573+0000 7ff10b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 0x7ff10c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.573+0000 7ff10b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff10c109650 0x7ff10c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.573+0000 7ff10b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c1134a0 con 0x7ff10c109650 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.573+0000 7ff10b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c113320 con 0x7ff10c108d00 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.573+0000 7ff10b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c113620 con 0x7ff10c1033c0 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff10a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff10c109650 0x7ff10c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 0x7ff10c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff103e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 0x7ff10c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 0x7ff10c075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:46444/0 (socket says 172.21.15.43:46444) 2024-07-26T08:31:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 -- 172.21.15.43:0/586698524 learned_addr learned my addr 172.21.15.43:0/586698524 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff103e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 0x7ff10c075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59678/0 (socket says 172.21.15.43:59678) 2024-07-26T08:31:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 -- 172.21.15.43:0/586698524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 msgr2=0x7ff10c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 0x7ff10c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 -- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff10c109650 msgr2=0x7ff10c075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff10c109650 0x7ff10c075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff109e00640 1 -- 172.21.15.43:0/586698524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c1a8150 con 0x7ff10c1033c0 2024-07-26T08:31:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.574+0000 7ff103e00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 0x7ff10c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.575+0000 7ff109e00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 0x7ff10c075140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0314b0 tx=0x7ff0fc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.575+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc03f070 con 0x7ff10c1033c0 2024-07-26T08:31:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.575+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c1a83e0 con 0x7ff10c1033c0 2024-07-26T08:31:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.575+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff0fc031bf0 con 0x7ff10c1033c0 2024-07-26T08:31:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.575+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc035030 con 0x7ff10c1033c0 2024-07-26T08:31:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.575+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c1a88c0 con 0x7ff10c1033c0 2024-07-26T08:31:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.576+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10c1037d0 con 0x7ff10c1033c0 2024-07-26T08:31:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.579+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7ff0fc03bd10 con 0x7ff10c1033c0 2024-07-26T08:31:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.580+0000 7ff102a00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0f00b3c20 0x7ff0f00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.581+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff0fc104d20 con 0x7ff10c1033c0 2024-07-26T08:31:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.581+0000 7ff103e00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0f00b3c20 0x7ff0f00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.582+0000 7ff103e00640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0f00b3c20 0x7ff0f00b6130 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff10c108670 tx=0x7ff0f4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:13.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.582+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff0fc031da0 con 0x7ff10c1033c0 2024-07-26T08:31:13.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.784+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff10c063230 con 0x7ff0f00b3c20 2024-07-26T08:31:13.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.801+0000 7ff102a00640 1 -- 172.21.15.43:0/586698524 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340468 (secure 0 0 0) 0x7ff10c063230 con 0x7ff0f00b3c20 2024-07-26T08:31:13.811 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:13.814 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:31:13.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.809+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0f00b3c20 msgr2=0x7ff0f00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:13.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.809+0000 7ff10b200640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0f00b3c20 0x7ff0f00b6130 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff10c108670 tx=0x7ff0f4005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:13.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.809+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 msgr2=0x7ff10c075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:13.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.809+0000 7ff10b200640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 0x7ff10c075140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0314b0 tx=0x7ff0fc003c10 comp rx=0 tx=0).stop 2024-07-26T08:31:13.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 shutdown_connections 2024-07-26T08:31:13.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0f00b3c20 0x7ff0f00b6130 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff10c109650 0x7ff10c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c108d00 0x7ff10c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 --2- 172.21.15.43:0/586698524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff10c1033c0 0x7ff10c075140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 >> 172.21.15.43:0/586698524 conn(0x7ff10c0fee10 msgr2=0x7ff10c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 shutdown_connections 2024-07-26T08:31:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:13.810+0000 7ff10b200640 1 -- 172.21.15.43:0/586698524 wait complete. 2024-07-26T08:31:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:14 smithi043 ceph-mon[32384]: pgmap v427: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:14 smithi133 ceph-mon[37053]: pgmap v427: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:14 smithi063 ceph-mon[36747]: pgmap v427: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:14.816 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-07-26T08:31:12.777441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656533,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":868,"num_read_kb":533,"num_write":298,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388400,"kb_used_data":14288,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553424,"statfs":{"total":1151940427776,"available":1151542706176,"internally_reserved":0,"allocated":14630912,"data_stored":8369741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006452"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372355+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372355+0000","last_peered":"2024-07-26T08:29:36.372355+0000","last_clean":"2024-07-26T08:29:36.372355+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372355+0000","last_undegraded":"2024-07-26T08:29:36.372355+0000","last_fullsized":"2024-07-26T08:29:36.372355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705645+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:30:34.705645+0000","last_peered":"2024-07-26T08:30:34.705645+0000","last_clean":"2024-07-26T08:30:34.705645+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:30:34.705645+0000","last_undegraded":"2024-07-26T08:30:34.705645+0000","last_fullsized":"2024-07-26T08:30:34.705645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362199+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:29:36.362199+0000","last_peered":"2024-07-26T08:29:36.362199+0000","last_clean":"2024-07-26T08:29:36.362199+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:29:36.362199+0000","last_undegraded":"2024-07-26T08:29:36.362199+0000","last_fullsized":"2024-07-26T08:29:36.362199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954121+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954121+0000","last_peered":"2024-07-26T08:29:36.954121+0000","last_clean":"2024-07-26T08:29:36.954121+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954121+0000","last_undegraded":"2024-07-26T08:29:36.954121+0000","last_fullsized":"2024-07-26T08:29:36.954121+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700102+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:30:34.700102+0000","last_peered":"2024-07-26T08:30:34.700102+0000","last_clean":"2024-07-26T08:30:34.700102+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:30:34.700102+0000","last_undegraded":"2024-07-26T08:30:34.700102+0000","last_fullsized":"2024-07-26T08:30:34.700102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683288+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:29:36.683288+0000","last_peered":"2024-07-26T08:29:36.683288+0000","last_clean":"2024-07-26T08:29:36.683288+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:29:36.683288+0000","last_undegraded":"2024-07-26T08:29:36.683288+0000","last_fullsized":"2024-07-26T08:29:36.683288+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916111+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:36.916111+0000","last_peered":"2024-07-26T08:29:36.916111+0000","last_clean":"2024-07-26T08:29:36.916111+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:36.916111+0000","last_undegraded":"2024-07-26T08:29:36.916111+0000","last_fullsized":"2024-07-26T08:29:36.916111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703517+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:30:34.703517+0000","last_peered":"2024-07-26T08:30:34.703517+0000","last_clean":"2024-07-26T08:30:34.703517+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:30:34.703517+0000","last_undegraded":"2024-07-26T08:30:34.703517+0000","last_fullsized":"2024-07-26T08:30:34.703517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683797+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:29:36.683797+0000","last_peered":"2024-07-26T08:29:36.683797+0000","last_clean":"2024-07-26T08:29:36.683797+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:29:36.683797+0000","last_undegraded":"2024-07-26T08:29:36.683797+0000","last_fullsized":"2024-07-26T08:29:36.683797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916256+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:36.916256+0000","last_peered":"2024-07-26T08:29:36.916256+0000","last_clean":"2024-07-26T08:29:36.916256+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:36.916256+0000","last_undegraded":"2024-07-26T08:29:36.916256+0000","last_fullsized":"2024-07-26T08:29:36.916256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.676205+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:30:34.676205+0000","last_peered":"2024-07-26T08:30:34.676205+0000","last_clean":"2024-07-26T08:30:34.676205+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:30:34.676205+0000","last_undegraded":"2024-07-26T08:30:34.676205+0000","last_fullsized":"2024-07-26T08:30:34.676205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683388+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:29:36.683388+0000","last_peered":"2024-07-26T08:29:36.683388+0000","last_clean":"2024-07-26T08:29:36.683388+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:29:36.683388+0000","last_undegraded":"2024-07-26T08:29:36.683388+0000","last_fullsized":"2024-07-26T08:29:36.683388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708542+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:30:34.708542+0000","last_peered":"2024-07-26T08:30:34.708542+0000","last_clean":"2024-07-26T08:30:34.708542+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:30:34.708542+0000","last_undegraded":"2024-07-26T08:30:34.708542+0000","last_fullsized":"2024-07-26T08:30:34.708542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915264+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:36.915264+0000","last_peered":"2024-07-26T08:29:36.915264+0000","last_clean":"2024-07-26T08:29:36.915264+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:36.915264+0000","last_undegraded":"2024-07-26T08:29:36.915264+0000","last_fullsized":"2024-07-26T08:29:36.915264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683663+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:29:36.683663+0000","last_peered":"2024-07-26T08:29:36.683663+0000","last_clean":"2024-07-26T08:29:36.683663+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:29:36.683663+0000","last_undegraded":"2024-07-26T08:29:36.683663+0000","last_fullsized":"2024-07-26T08:29:36.683663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711642+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:30:34.711642+0000","last_peered":"2024-07-26T08:30:34.711642+0000","last_clean":"2024-07-26T08:30:34.711642+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:30:34.711642+0000","last_undegraded":"2024-07-26T08:30:34.711642+0000","last_fullsized":"2024-07-26T08:30:34.711642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362324+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:36.362324+0000","last_peered":"2024-07-26T08:29:36.362324+0000","last_clean":"2024-07-26T08:29:36.362324+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:36.362324+0000","last_undegraded":"2024-07-26T08:29:36.362324+0000","last_fullsized":"2024-07-26T08:29:36.362324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683824+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:29:36.683824+0000","last_peered":"2024-07-26T08:29:36.683824+0000","last_clean":"2024-07-26T08:29:36.683824+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:29:36.683824+0000","last_undegraded":"2024-07-26T08:29:36.683824+0000","last_fullsized":"2024-07-26T08:29:36.683824+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.693853+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:30:34.693853+0000","last_peered":"2024-07-26T08:30:34.693853+0000","last_clean":"2024-07-26T08:30:34.693853+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:30:34.693853+0000","last_undegraded":"2024-07-26T08:30:34.693853+0000","last_fullsized":"2024-07-26T08:30:34.693853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953022+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:36.953022+0000","last_peered":"2024-07-26T08:29:36.953022+0000","last_clean":"2024-07-26T08:29:36.953022+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:36.953022+0000","last_undegraded":"2024-07-26T08:29:36.953022+0000","last_fullsized":"2024-07-26T08:29:36.953022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371394+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:29:36.371394+0000","last_peered":"2024-07-26T08:29:36.371394+0000","last_clean":"2024-07-26T08:29:36.371394+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:29:36.371394+0000","last_undegraded":"2024-07-26T08:29:36.371394+0000","last_fullsized":"2024-07-26T08:29:36.371394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.625635+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:30:34.625635+0000","last_peered":"2024-07-26T08:30:34.625635+0000","last_clean":"2024-07-26T08:30:34.625635+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:30:34.625635+0000","last_undegraded":"2024-07-26T08:30:34.625635+0000","last_fullsized":"2024-07-26T08:30:34.625635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949808+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:36.949808+0000","last_peered":"2024-07-26T08:29:36.949808+0000","last_clean":"2024-07-26T08:29:36.949808+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:36.949808+0000","last_undegraded":"2024-07-26T08:29:36.949808+0000","last_fullsized":"2024-07-26T08:29:36.949808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684075+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:29:36.684075+0000","last_peered":"2024-07-26T08:29:36.684075+0000","last_clean":"2024-07-26T08:29:36.684075+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:29:36.684075+0000","last_undegraded":"2024-07-26T08:29:36.684075+0000","last_fullsized":"2024-07-26T08:29:36.684075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709924+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:30:34.709924+0000","last_peered":"2024-07-26T08:30:34.709924+0000","last_clean":"2024-07-26T08:30:34.709924+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:30:34.709924+0000","last_undegraded":"2024-07-26T08:30:34.709924+0000","last_fullsized":"2024-07-26T08:30:34.709924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684523+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:36.684523+0000","last_peered":"2024-07-26T08:29:36.684523+0000","last_clean":"2024-07-26T08:29:36.684523+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:36.684523+0000","last_undegraded":"2024-07-26T08:29:36.684523+0000","last_fullsized":"2024-07-26T08:29:36.684523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362328+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:36.362328+0000","last_peered":"2024-07-26T08:29:36.362328+0000","last_clean":"2024-07-26T08:29:36.362328+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:36.362328+0000","last_undegraded":"2024-07-26T08:29:36.362328+0000","last_fullsized":"2024-07-26T08:29:36.362328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.704444+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:30:34.704444+0000","last_peered":"2024-07-26T08:30:34.704444+0000","last_clean":"2024-07-26T08:30:34.704444+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:30:34.704444+0000","last_undegraded":"2024-07-26T08:30:34.704444+0000","last_fullsized":"2024-07-26T08:30:34.704444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'13","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:38.934374+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:29:38.934374+0000","last_peered":"2024-07-26T08:29:38.934374+0000","last_clean":"2024-07-26T08:29:38.934374+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:29:38.934374+0000","last_undegraded":"2024-07-26T08:29:38.934374+0000","last_fullsized":"2024-07-26T08:29:38.934374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.951987+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:36.951987+0000","last_peered":"2024-07-26T08:29:36.951987+0000","last_clean":"2024-07-26T08:29:36.951987+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:36.951987+0000","last_undegraded":"2024-07-26T08:29:36.951987+0000","last_fullsized":"2024-07-26T08:29:36.951987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703343+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:30:34.703343+0000","last_peered":"2024-07-26T08:30:34.703343+0000","last_clean":"2024-07-26T08:30:34.703343+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:30:34.703343+0000","last_undegraded":"2024-07-26T08:30:34.703343+0000","last_fullsized":"2024-07-26T08:30:34.703343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916186+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916186+0000","last_peered":"2024-07-26T08:29:36.916186+0000","last_clean":"2024-07-26T08:29:36.916186+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916186+0000","last_undegraded":"2024-07-26T08:29:36.916186+0000","last_fullsized":"2024-07-26T08:29:36.916186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371750+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:36.371750+0000","last_peered":"2024-07-26T08:29:36.371750+0000","last_clean":"2024-07-26T08:29:36.371750+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:36.371750+0000","last_undegraded":"2024-07-26T08:29:36.371750+0000","last_fullsized":"2024-07-26T08:29:36.371750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687589+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:30:34.687589+0000","last_peered":"2024-07-26T08:30:34.687589+0000","last_clean":"2024-07-26T08:30:34.687589+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:30:34.687589+0000","last_undegraded":"2024-07-26T08:30:34.687589+0000","last_fullsized":"2024-07-26T08:30:34.687589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370566+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370566+0000","last_peered":"2024-07-26T08:29:36.370566+0000","last_clean":"2024-07-26T08:29:36.370566+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370566+0000","last_undegraded":"2024-07-26T08:29:36.370566+0000","last_fullsized":"2024-07-26T08:29:36.370566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915287+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:36.915287+0000","last_peered":"2024-07-26T08:29:36.915287+0000","last_clean":"2024-07-26T08:29:36.915287+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:36.915287+0000","last_undegraded":"2024-07-26T08:29:36.915287+0000","last_fullsized":"2024-07-26T08:29:36.915287+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694022+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:30:34.694022+0000","last_peered":"2024-07-26T08:30:34.694022+0000","last_clean":"2024-07-26T08:30:34.694022+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:30:34.694022+0000","last_undegraded":"2024-07-26T08:30:34.694022+0000","last_fullsized":"2024-07-26T08:30:34.694022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362690+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:36.362690+0000","last_peered":"2024-07-26T08:29:36.362690+0000","last_clean":"2024-07-26T08:29:36.362690+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:36.362690+0000","last_undegraded":"2024-07-26T08:29:36.362690+0000","last_fullsized":"2024-07-26T08:29:36.362690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366656+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:36.366656+0000","last_peered":"2024-07-26T08:29:36.366656+0000","last_clean":"2024-07-26T08:29:36.366656+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:36.366656+0000","last_undegraded":"2024-07-26T08:29:36.366656+0000","last_fullsized":"2024-07-26T08:29:36.366656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702973+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:30:34.702973+0000","last_peered":"2024-07-26T08:30:34.702973+0000","last_clean":"2024-07-26T08:30:34.702973+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:30:34.702973+0000","last_undegraded":"2024-07-26T08:30:34.702973+0000","last_fullsized":"2024-07-26T08:30:34.702973+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:10.902675+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:31:10.902675+0000","last_peered":"2024-07-26T08:31:10.902675+0000","last_clean":"2024-07-26T08:31:10.902675+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:31:10.902675+0000","last_undegraded":"2024-07-26T08:31:10.902675+0000","last_fullsized":"2024-07-26T08:31:10.902675+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367484+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:36.367484+0000","last_peered":"2024-07-26T08:29:36.367484+0000","last_clean":"2024-07-26T08:29:36.367484+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:36.367484+0000","last_undegraded":"2024-07-26T08:29:36.367484+0000","last_fullsized":"2024-07-26T08:29:36.367484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.701488+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:30:34.701488+0000","last_peered":"2024-07-26T08:30:34.701488+0000","last_clean":"2024-07-26T08:30:34.701488+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:30:34.701488+0000","last_undegraded":"2024-07-26T08:30:34.701488+0000","last_fullsized":"2024-07-26T08:30:34.701488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362439+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362439+0000","last_peered":"2024-07-26T08:29:36.362439+0000","last_clean":"2024-07-26T08:29:36.362439+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362439+0000","last_undegraded":"2024-07-26T08:29:36.362439+0000","last_fullsized":"2024-07-26T08:29:36.362439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372449+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:29:36.372449+0000","last_peered":"2024-07-26T08:29:36.372449+0000","last_clean":"2024-07-26T08:29:36.372449+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:29:36.372449+0000","last_undegraded":"2024-07-26T08:29:36.372449+0000","last_fullsized":"2024-07-26T08:29:36.372449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706994+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:30:34.706994+0000","last_peered":"2024-07-26T08:30:34.706994+0000","last_clean":"2024-07-26T08:30:34.706994+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:30:34.706994+0000","last_undegraded":"2024-07-26T08:30:34.706994+0000","last_fullsized":"2024-07-26T08:30:34.706994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683931+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.683931+0000","last_peered":"2024-07-26T08:29:36.683931+0000","last_clean":"2024-07-26T08:29:36.683931+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.683931+0000","last_undegraded":"2024-07-26T08:29:36.683931+0000","last_fullsized":"2024-07-26T08:29:36.683931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362638+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:29:36.362638+0000","last_peered":"2024-07-26T08:29:36.362638+0000","last_clean":"2024-07-26T08:29:36.362638+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:29:36.362638+0000","last_undegraded":"2024-07-26T08:29:36.362638+0000","last_fullsized":"2024-07-26T08:29:36.362638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363080+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:36.363080+0000","last_peered":"2024-07-26T08:29:36.363080+0000","last_clean":"2024-07-26T08:29:36.363080+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:36.363080+0000","last_undegraded":"2024-07-26T08:29:36.363080+0000","last_fullsized":"2024-07-26T08:29:36.363080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685563+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:30:34.685563+0000","last_peered":"2024-07-26T08:30:34.685563+0000","last_clean":"2024-07-26T08:30:34.685563+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:30:34.685563+0000","last_undegraded":"2024-07-26T08:30:34.685563+0000","last_fullsized":"2024-07-26T08:30:34.685563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362813+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:36.362813+0000","last_peered":"2024-07-26T08:29:36.362813+0000","last_clean":"2024-07-26T08:29:36.362813+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:36.362813+0000","last_undegraded":"2024-07-26T08:29:36.362813+0000","last_fullsized":"2024-07-26T08:29:36.362813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949804+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:29:36.949804+0000","last_peered":"2024-07-26T08:29:36.949804+0000","last_clean":"2024-07-26T08:29:36.949804+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:29:36.949804+0000","last_undegraded":"2024-07-26T08:29:36.949804+0000","last_fullsized":"2024-07-26T08:29:36.949804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706552+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:30:34.706552+0000","last_peered":"2024-07-26T08:30:34.706552+0000","last_clean":"2024-07-26T08:30:34.706552+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:30:34.706552+0000","last_undegraded":"2024-07-26T08:30:34.706552+0000","last_fullsized":"2024-07-26T08:30:34.706552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373195+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:36.373195+0000","last_peered":"2024-07-26T08:29:36.373195+0000","last_clean":"2024-07-26T08:29:36.373195+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:36.373195+0000","last_undegraded":"2024-07-26T08:29:36.373195+0000","last_fullsized":"2024-07-26T08:29:36.373195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000867+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:29:37.000867+0000","last_peered":"2024-07-26T08:29:37.000867+0000","last_clean":"2024-07-26T08:29:37.000867+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:29:37.000867+0000","last_undegraded":"2024-07-26T08:29:37.000867+0000","last_fullsized":"2024-07-26T08:29:37.000867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675138+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:30:34.675138+0000","last_peered":"2024-07-26T08:30:34.675138+0000","last_clean":"2024-07-26T08:30:34.675138+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:30:34.675138+0000","last_undegraded":"2024-07-26T08:30:34.675138+0000","last_fullsized":"2024-07-26T08:30:34.675138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367524+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:36.367524+0000","last_peered":"2024-07-26T08:29:36.367524+0000","last_clean":"2024-07-26T08:29:36.367524+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:36.367524+0000","last_undegraded":"2024-07-26T08:29:36.367524+0000","last_fullsized":"2024-07-26T08:29:36.367524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371670+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:29:36.371670+0000","last_peered":"2024-07-26T08:29:36.371670+0000","last_clean":"2024-07-26T08:29:36.371670+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:29:36.371670+0000","last_undegraded":"2024-07-26T08:29:36.371670+0000","last_fullsized":"2024-07-26T08:29:36.371670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670546+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:30:34.670546+0000","last_peered":"2024-07-26T08:30:34.670546+0000","last_clean":"2024-07-26T08:30:34.670546+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:30:34.670546+0000","last_undegraded":"2024-07-26T08:30:34.670546+0000","last_fullsized":"2024-07-26T08:30:34.670546+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916146+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:36.916146+0000","last_peered":"2024-07-26T08:29:36.916146+0000","last_clean":"2024-07-26T08:29:36.916146+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:36.916146+0000","last_undegraded":"2024-07-26T08:29:36.916146+0000","last_fullsized":"2024-07-26T08:29:36.916146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372291+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:29:36.372291+0000","last_peered":"2024-07-26T08:29:36.372291+0000","last_clean":"2024-07-26T08:29:36.372291+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:29:36.372291+0000","last_undegraded":"2024-07-26T08:29:36.372291+0000","last_fullsized":"2024-07-26T08:29:36.372291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675745+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:30:34.675745+0000","last_peered":"2024-07-26T08:30:34.675745+0000","last_clean":"2024-07-26T08:30:34.675745+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:30:34.675745+0000","last_undegraded":"2024-07-26T08:30:34.675745+0000","last_fullsized":"2024-07-26T08:30:34.675745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915217+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:36.915217+0000","last_peered":"2024-07-26T08:29:36.915217+0000","last_clean":"2024-07-26T08:29:36.915217+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:36.915217+0000","last_undegraded":"2024-07-26T08:29:36.915217+0000","last_fullsized":"2024-07-26T08:29:36.915217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367406+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:29:36.367406+0000","last_peered":"2024-07-26T08:29:36.367406+0000","last_clean":"2024-07-26T08:29:36.367406+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:29:36.367406+0000","last_undegraded":"2024-07-26T08:29:36.367406+0000","last_fullsized":"2024-07-26T08:29:36.367406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.681821+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:30:34.681821+0000","last_peered":"2024-07-26T08:30:34.681821+0000","last_clean":"2024-07-26T08:30:34.681821+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:30:34.681821+0000","last_undegraded":"2024-07-26T08:30:34.681821+0000","last_fullsized":"2024-07-26T08:30:34.681821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":176,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:07.896432+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:31:07.896432+0000","last_peered":"2024-07-26T08:31:07.896432+0000","last_clean":"2024-07-26T08:31:07.896432+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:31:07.896432+0000","last_undegraded":"2024-07-26T08:31:07.896432+0000","last_fullsized":"2024-07-26T08:31:07.896432+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371745+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:29:36.371745+0000","last_peered":"2024-07-26T08:29:36.371745+0000","last_clean":"2024-07-26T08:29:36.371745+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:29:36.371745+0000","last_undegraded":"2024-07-26T08:29:36.371745+0000","last_fullsized":"2024-07-26T08:29:36.371745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711829+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:30:34.711829+0000","last_peered":"2024-07-26T08:30:34.711829+0000","last_clean":"2024-07-26T08:30:34.711829+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:30:34.711829+0000","last_undegraded":"2024-07-26T08:30:34.711829+0000","last_fullsized":"2024-07-26T08:30:34.711829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373127+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:36.373127+0000","last_peered":"2024-07-26T08:29:36.373127+0000","last_clean":"2024-07-26T08:29:36.373127+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:36.373127+0000","last_undegraded":"2024-07-26T08:29:36.373127+0000","last_fullsized":"2024-07-26T08:29:36.373127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372173+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:29:36.372173+0000","last_peered":"2024-07-26T08:29:36.372173+0000","last_clean":"2024-07-26T08:29:36.372173+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:29:36.372173+0000","last_undegraded":"2024-07-26T08:29:36.372173+0000","last_fullsized":"2024-07-26T08:29:36.372173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.712550+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:30:34.712550+0000","last_peered":"2024-07-26T08:30:34.712550+0000","last_clean":"2024-07-26T08:30:34.712550+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:30:34.712550+0000","last_undegraded":"2024-07-26T08:30:34.712550+0000","last_fullsized":"2024-07-26T08:30:34.712550+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362498+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:36.362498+0000","last_peered":"2024-07-26T08:29:36.362498+0000","last_clean":"2024-07-26T08:29:36.362498+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:36.362498+0000","last_undegraded":"2024-07-26T08:29:36.362498+0000","last_fullsized":"2024-07-26T08:29:36.362498+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372897+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:29:36.372897+0000","last_peered":"2024-07-26T08:29:36.372897+0000","last_clean":"2024-07-26T08:29:36.372897+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:29:36.372897+0000","last_undegraded":"2024-07-26T08:29:36.372897+0000","last_fullsized":"2024-07-26T08:29:36.372897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670795+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:30:34.670795+0000","last_peered":"2024-07-26T08:30:34.670795+0000","last_clean":"2024-07-26T08:30:34.670795+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:30:34.670795+0000","last_undegraded":"2024-07-26T08:30:34.670795+0000","last_fullsized":"2024-07-26T08:30:34.670795+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":344,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:09.840208+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:31:09.840208+0000","last_peered":"2024-07-26T08:31:09.840208+0000","last_clean":"2024-07-26T08:31:09.840208+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:31:09.840208+0000","last_undegraded":"2024-07-26T08:31:09.840208+0000","last_fullsized":"2024-07-26T08:31:09.840208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62321,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":192,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370687+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:29:36.370687+0000","last_peered":"2024-07-26T08:29:36.370687+0000","last_clean":"2024-07-26T08:29:36.370687+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:29:36.370687+0000","last_undegraded":"2024-07-26T08:29:36.370687+0000","last_fullsized":"2024-07-26T08:29:36.370687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685530+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:30:34.685530+0000","last_peered":"2024-07-26T08:30:34.685530+0000","last_clean":"2024-07-26T08:30:34.685530+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:30:34.685530+0000","last_undegraded":"2024-07-26T08:30:34.685530+0000","last_fullsized":"2024-07-26T08:30:34.685530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373072+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:36.373072+0000","last_peered":"2024-07-26T08:29:36.373072+0000","last_clean":"2024-07-26T08:29:36.373072+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:36.373072+0000","last_undegraded":"2024-07-26T08:29:36.373072+0000","last_fullsized":"2024-07-26T08:29:36.373072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683845+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:29:36.683845+0000","last_peered":"2024-07-26T08:29:36.683845+0000","last_clean":"2024-07-26T08:29:36.683845+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:29:36.683845+0000","last_undegraded":"2024-07-26T08:29:36.683845+0000","last_fullsized":"2024-07-26T08:29:36.683845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697618+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:30:34.697618+0000","last_peered":"2024-07-26T08:30:34.697618+0000","last_clean":"2024-07-26T08:30:34.697618+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:30:34.697618+0000","last_undegraded":"2024-07-26T08:30:34.697618+0000","last_fullsized":"2024-07-26T08:30:34.697618+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363107+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:36.363107+0000","last_peered":"2024-07-26T08:29:36.363107+0000","last_clean":"2024-07-26T08:29:36.363107+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:36.363107+0000","last_undegraded":"2024-07-26T08:29:36.363107+0000","last_fullsized":"2024-07-26T08:29:36.363107+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.369063+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:29:36.369063+0000","last_peered":"2024-07-26T08:29:36.369063+0000","last_clean":"2024-07-26T08:29:36.369063+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:29:36.369063+0000","last_undegraded":"2024-07-26T08:29:36.369063+0000","last_fullsized":"2024-07-26T08:29:36.369063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687707+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:30:34.687707+0000","last_peered":"2024-07-26T08:30:34.687707+0000","last_clean":"2024-07-26T08:30:34.687707+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:30:34.687707+0000","last_undegraded":"2024-07-26T08:30:34.687707+0000","last_fullsized":"2024-07-26T08:30:34.687707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:08.906501+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:31:08.906501+0000","last_peered":"2024-07-26T08:31:08.906501+0000","last_clean":"2024-07-26T08:31:08.906501+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:31:08.906501+0000","last_undegraded":"2024-07-26T08:31:08.906501+0000","last_fullsized":"2024-07-26T08:31:08.906501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952413+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:29:36.952413+0000","last_peered":"2024-07-26T08:29:36.952413+0000","last_clean":"2024-07-26T08:29:36.952413+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:29:36.952413+0000","last_undegraded":"2024-07-26T08:29:36.952413+0000","last_fullsized":"2024-07-26T08:29:36.952413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001330+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:37.001330+0000","last_peered":"2024-07-26T08:29:37.001330+0000","last_clean":"2024-07-26T08:29:37.001330+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:37.001330+0000","last_undegraded":"2024-07-26T08:29:37.001330+0000","last_fullsized":"2024-07-26T08:29:37.001330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709552+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:30:34.709552+0000","last_peered":"2024-07-26T08:30:34.709552+0000","last_clean":"2024-07-26T08:30:34.709552+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:30:34.709552+0000","last_undegraded":"2024-07-26T08:30:34.709552+0000","last_fullsized":"2024-07-26T08:30:34.709552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372059+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:36.372059+0000","last_peered":"2024-07-26T08:29:36.372059+0000","last_clean":"2024-07-26T08:29:36.372059+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:36.372059+0000","last_undegraded":"2024-07-26T08:29:36.372059+0000","last_fullsized":"2024-07-26T08:29:36.372059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372015+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:36.372015+0000","last_peered":"2024-07-26T08:29:36.372015+0000","last_clean":"2024-07-26T08:29:36.372015+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:36.372015+0000","last_undegraded":"2024-07-26T08:29:36.372015+0000","last_fullsized":"2024-07-26T08:29:36.372015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713293+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:30:34.713293+0000","last_peered":"2024-07-26T08:30:34.713293+0000","last_clean":"2024-07-26T08:30:34.713293+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:30:34.713293+0000","last_undegraded":"2024-07-26T08:30:34.713293+0000","last_fullsized":"2024-07-26T08:30:34.713293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365740+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:36.365740+0000","last_peered":"2024-07-26T08:29:36.365740+0000","last_clean":"2024-07-26T08:29:36.365740+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:36.365740+0000","last_undegraded":"2024-07-26T08:29:36.365740+0000","last_fullsized":"2024-07-26T08:29:36.365740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371617+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:29:36.371617+0000","last_peered":"2024-07-26T08:29:36.371617+0000","last_clean":"2024-07-26T08:29:36.371617+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:29:36.371617+0000","last_undegraded":"2024-07-26T08:29:36.371617+0000","last_fullsized":"2024-07-26T08:29:36.371617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703855+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:30:34.703855+0000","last_peered":"2024-07-26T08:30:34.703855+0000","last_clean":"2024-07-26T08:30:34.703855+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:30:34.703855+0000","last_undegraded":"2024-07-26T08:30:34.703855+0000","last_fullsized":"2024-07-26T08:30:34.703855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362536+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:29:36.362536+0000","last_peered":"2024-07-26T08:29:36.362536+0000","last_clean":"2024-07-26T08:29:36.362536+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:29:36.362536+0000","last_undegraded":"2024-07-26T08:29:36.362536+0000","last_fullsized":"2024-07-26T08:29:36.362536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":181,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:10.911928+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:31:10.911928+0000","last_peered":"2024-07-26T08:31:10.911928+0000","last_clean":"2024-07-26T08:31:10.911928+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:31:10.911928+0000","last_undegraded":"2024-07-26T08:31:10.911928+0000","last_fullsized":"2024-07-26T08:31:10.911928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674729+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:30:34.674729+0000","last_peered":"2024-07-26T08:30:34.674729+0000","last_clean":"2024-07-26T08:30:34.674729+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:30:34.674729+0000","last_undegraded":"2024-07-26T08:30:34.674729+0000","last_fullsized":"2024-07-26T08:30:34.674729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362623+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:29:36.362623+0000","last_peered":"2024-07-26T08:29:36.362623+0000","last_clean":"2024-07-26T08:29:36.362623+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:29:36.362623+0000","last_undegraded":"2024-07-26T08:29:36.362623+0000","last_fullsized":"2024-07-26T08:29:36.362623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671528+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:30:34.671528+0000","last_peered":"2024-07-26T08:30:34.671528+0000","last_clean":"2024-07-26T08:30:34.671528+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:30:34.671528+0000","last_undegraded":"2024-07-26T08:30:34.671528+0000","last_fullsized":"2024-07-26T08:30:34.671528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674769+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:30:34.674769+0000","last_peered":"2024-07-26T08:30:34.674769+0000","last_clean":"2024-07-26T08:30:34.674769+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:30:34.674769+0000","last_undegraded":"2024-07-26T08:30:34.674769+0000","last_fullsized":"2024-07-26T08:30:34.674769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700015+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:30:34.700015+0000","last_peered":"2024-07-26T08:30:34.700015+0000","last_clean":"2024-07-26T08:30:34.700015+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:30:34.700015+0000","last_undegraded":"2024-07-26T08:30:34.700015+0000","last_fullsized":"2024-07-26T08:30:34.700015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713811+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:30:34.713811+0000","last_peered":"2024-07-26T08:30:34.713811+0000","last_clean":"2024-07-26T08:30:34.713811+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:30:34.713811+0000","last_undegraded":"2024-07-26T08:30:34.713811+0000","last_fullsized":"2024-07-26T08:30:34.713811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711339+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:30:34.711339+0000","last_peered":"2024-07-26T08:30:34.711339+0000","last_clean":"2024-07-26T08:30:34.711339+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:30:34.711339+0000","last_undegraded":"2024-07-26T08:30:34.711339+0000","last_fullsized":"2024-07-26T08:30:34.711339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673119+0000","last_change":"2024-07-26T08:29:36.916212+0000","last_active":"2024-07-26T08:30:34.673119+0000","last_peered":"2024-07-26T08:30:34.673119+0000","last_clean":"2024-07-26T08:30:34.673119+0000","last_became_active":"2024-07-26T08:29:36.915665+0000","last_became_peered":"2024-07-26T08:29:36.915665+0000","last_unstale":"2024-07-26T08:30:34.673119+0000","last_undegraded":"2024-07-26T08:30:34.673119+0000","last_fullsized":"2024-07-26T08:30:34.673119+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:54:03.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672755+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:30:34.672755+0000","last_peered":"2024-07-26T08:30:34.672755+0000","last_clean":"2024-07-26T08:30:34.672755+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:30:34.672755+0000","last_undegraded":"2024-07-26T08:30:34.672755+0000","last_fullsized":"2024-07-26T08:30:34.672755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671789+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:30:34.671789+0000","last_peered":"2024-07-26T08:30:34.671789+0000","last_clean":"2024-07-26T08:30:34.671789+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:30:34.671789+0000","last_undegraded":"2024-07-26T08:30:34.671789+0000","last_fullsized":"2024-07-26T08:30:34.671789+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707906+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:30:34.707906+0000","last_peered":"2024-07-26T08:30:34.707906+0000","last_clean":"2024-07-26T08:30:34.707906+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:30:34.707906+0000","last_undegraded":"2024-07-26T08:30:34.707906+0000","last_fullsized":"2024-07-26T08:30:34.707906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705043+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:30:34.705043+0000","last_peered":"2024-07-26T08:30:34.705043+0000","last_clean":"2024-07-26T08:30:34.705043+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:30:34.705043+0000","last_undegraded":"2024-07-26T08:30:34.705043+0000","last_fullsized":"2024-07-26T08:30:34.705043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706676+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:30:34.706676+0000","last_peered":"2024-07-26T08:30:34.706676+0000","last_clean":"2024-07-26T08:30:34.706676+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:30:34.706676+0000","last_undegraded":"2024-07-26T08:30:34.706676+0000","last_fullsized":"2024-07-26T08:30:34.706676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713836+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:30:34.713836+0000","last_peered":"2024-07-26T08:30:34.713836+0000","last_clean":"2024-07-26T08:30:34.713836+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:30:34.713836+0000","last_undegraded":"2024-07-26T08:30:34.713836+0000","last_fullsized":"2024-07-26T08:30:34.713836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674640+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:30:34.674640+0000","last_peered":"2024-07-26T08:30:34.674640+0000","last_clean":"2024-07-26T08:30:34.674640+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:30:34.674640+0000","last_undegraded":"2024-07-26T08:30:34.674640+0000","last_fullsized":"2024-07-26T08:30:34.674640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707019+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:30:34.707019+0000","last_peered":"2024-07-26T08:30:34.707019+0000","last_clean":"2024-07-26T08:30:34.707019+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:30:34.707019+0000","last_undegraded":"2024-07-26T08:30:34.707019+0000","last_fullsized":"2024-07-26T08:30:34.707019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687311+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:30:34.687311+0000","last_peered":"2024-07-26T08:30:34.687311+0000","last_clean":"2024-07-26T08:30:34.687311+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:30:34.687311+0000","last_undegraded":"2024-07-26T08:30:34.687311+0000","last_fullsized":"2024-07-26T08:30:34.687311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702811+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:30:34.702811+0000","last_peered":"2024-07-26T08:30:34.702811+0000","last_clean":"2024-07-26T08:30:34.702811+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:30:34.702811+0000","last_undegraded":"2024-07-26T08:30:34.702811+0000","last_fullsized":"2024-07-26T08:30:34.702811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694229+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:30:34.694229+0000","last_peered":"2024-07-26T08:30:34.694229+0000","last_clean":"2024-07-26T08:30:34.694229+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:30:34.694229+0000","last_undegraded":"2024-07-26T08:30:34.694229+0000","last_fullsized":"2024-07-26T08:30:34.694229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694733+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:30:34.694733+0000","last_peered":"2024-07-26T08:30:34.694733+0000","last_clean":"2024-07-26T08:30:34.694733+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:30:34.694733+0000","last_undegraded":"2024-07-26T08:30:34.694733+0000","last_fullsized":"2024-07-26T08:30:34.694733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702348+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:30:34.702348+0000","last_peered":"2024-07-26T08:30:34.702348+0000","last_clean":"2024-07-26T08:30:34.702348+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:30:34.702348+0000","last_undegraded":"2024-07-26T08:30:34.702348+0000","last_fullsized":"2024-07-26T08:30:34.702348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713690+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:30:34.713690+0000","last_peered":"2024-07-26T08:30:34.713690+0000","last_clean":"2024-07-26T08:30:34.713690+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:30:34.713690+0000","last_undegraded":"2024-07-26T08:30:34.713690+0000","last_fullsized":"2024-07-26T08:30:34.713690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672432+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:30:34.672432+0000","last_peered":"2024-07-26T08:30:34.672432+0000","last_clean":"2024-07-26T08:30:34.672432+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:30:34.672432+0000","last_undegraded":"2024-07-26T08:30:34.672432+0000","last_fullsized":"2024-07-26T08:30:34.672432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685567+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:30:34.685567+0000","last_peered":"2024-07-26T08:30:34.685567+0000","last_clean":"2024-07-26T08:30:34.685567+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:30:34.685567+0000","last_undegraded":"2024-07-26T08:30:34.685567+0000","last_fullsized":"2024-07-26T08:30:34.685567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670957+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:30:34.670957+0000","last_peered":"2024-07-26T08:30:34.670957+0000","last_clean":"2024-07-26T08:30:34.670957+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:30:34.670957+0000","last_undegraded":"2024-07-26T08:30:34.670957+0000","last_fullsized":"2024-07-26T08:30:34.670957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685147+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:30:34.685147+0000","last_peered":"2024-07-26T08:30:34.685147+0000","last_clean":"2024-07-26T08:30:34.685147+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:30:34.685147+0000","last_undegraded":"2024-07-26T08:30:34.685147+0000","last_fullsized":"2024-07-26T08:30:34.685147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706313+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:30:34.706313+0000","last_peered":"2024-07-26T08:30:34.706313+0000","last_clean":"2024-07-26T08:30:34.706313+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:30:34.706313+0000","last_undegraded":"2024-07-26T08:30:34.706313+0000","last_fullsized":"2024-07-26T08:30:34.706313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688447+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:30:34.688447+0000","last_peered":"2024-07-26T08:30:34.688447+0000","last_clean":"2024-07-26T08:30:34.688447+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:30:34.688447+0000","last_undegraded":"2024-07-26T08:30:34.688447+0000","last_fullsized":"2024-07-26T08:30:34.688447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674230+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:30:34.674230+0000","last_peered":"2024-07-26T08:30:34.674230+0000","last_clean":"2024-07-26T08:30:34.674230+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:30:34.674230+0000","last_undegraded":"2024-07-26T08:30:34.674230+0000","last_fullsized":"2024-07-26T08:30:34.674230+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700105+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:30:34.700105+0000","last_peered":"2024-07-26T08:30:34.700105+0000","last_clean":"2024-07-26T08:30:34.700105+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:30:34.700105+0000","last_undegraded":"2024-07-26T08:30:34.700105+0000","last_fullsized":"2024-07-26T08:30:34.700105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674380+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:30:34.674380+0000","last_peered":"2024-07-26T08:30:34.674380+0000","last_clean":"2024-07-26T08:30:34.674380+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:30:34.674380+0000","last_undegraded":"2024-07-26T08:30:34.674380+0000","last_fullsized":"2024-07-26T08:30:34.674380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.699632+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:30:34.699632+0000","last_peered":"2024-07-26T08:30:34.699632+0000","last_clean":"2024-07-26T08:30:34.699632+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:30:34.699632+0000","last_undegraded":"2024-07-26T08:30:34.699632+0000","last_fullsized":"2024-07-26T08:30:34.699632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.695827+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:30:34.695827+0000","last_peered":"2024-07-26T08:30:34.695827+0000","last_clean":"2024-07-26T08:30:34.695827+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:30:34.695827+0000","last_undegraded":"2024-07-26T08:30:34.695827+0000","last_fullsized":"2024-07-26T08:30:34.695827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702642+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:30:34.702642+0000","last_peered":"2024-07-26T08:30:34.702642+0000","last_clean":"2024-07-26T08:30:34.702642+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:30:34.702642+0000","last_undegraded":"2024-07-26T08:30:34.702642+0000","last_fullsized":"2024-07-26T08:30:34.702642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65931,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":787,"num_read_kb":464,"num_write":173,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":197793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678077,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":535351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874305,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1736704,"data_stored":1189036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234062,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430292,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593816,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790047,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953573,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149801,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":530957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378737,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":594344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542262,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":592994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705786,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:31:14.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph pg dump --format=json 2024-07-26T08:31:15.305 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:15.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:15 smithi043 ceph-mon[32384]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:31:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:15 smithi133 ceph-mon[37053]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:31:15.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:15 smithi063 ceph-mon[36747]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:31:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:16 smithi133 ceph-mon[37053]: pgmap v428: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:16.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:16 smithi043 ceph-mon[32384]: pgmap v428: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:16.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:16 smithi063 ceph-mon[36747]: pgmap v428: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:17.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 -- 172.21.15.43:0/363315569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac077cc0 msgr2=0x7f30ac113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 --2- 172.21.15.43:0/363315569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac077cc0 0x7f30ac113a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3098009860 tx=0x7f309802a340 comp rx=0 tx=0).stop 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 -- 172.21.15.43:0/363315569 shutdown_connections 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 --2- 172.21.15.43:0/363315569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac077cc0 0x7f30ac113a60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 --2- 172.21.15.43:0/363315569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30ac113fa0 0x7f30ac1163c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 --2- 172.21.15.43:0/363315569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 -- 172.21.15.43:0/363315569 >> 172.21.15.43:0/363315569 conn(0x7f30ac1010b0 msgr2=0x7f30ac103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 -- 172.21.15.43:0/363315569 shutdown_connections 2024-07-26T08:31:17.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.886+0000 7f30abe00640 1 -- 172.21.15.43:0/363315569 wait complete. 2024-07-26T08:31:17.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.887+0000 7f30abe00640 1 Processor -- start 2024-07-26T08:31:17.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 -- start start 2024-07-26T08:31:17.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:17.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30ac077cc0 0x7f30ac1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:17.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac113fa0 0x7f30ac1a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:17.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac119a20 con 0x7f30ac077cc0 2024-07-26T08:31:17.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1198a0 con 0x7f30ac077370 2024-07-26T08:31:17.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.888+0000 7f30abe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac119ba0 con 0x7f30ac113fa0 2024-07-26T08:31:17.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:17.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aa000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30ac077cc0 0x7f30ac1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:17.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac1a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39216/0 (socket says 172.21.15.43:39216) 2024-07-26T08:31:17.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 -- 172.21.15.43:0/1658434897 learned_addr learned my addr 172.21.15.43:0/1658434897 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:17.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30ab400640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac113fa0 0x7f30ac1a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 -- 172.21.15.43:0/1658434897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac113fa0 msgr2=0x7f30ac1a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac113fa0 0x7f30ac1a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 -- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30ac077cc0 msgr2=0x7f30ac1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30ac077cc0 0x7f30ac1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.889+0000 7f30aaa00640 1 -- 172.21.15.43:0/1658434897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac1a63a0 con 0x7f30ac077370 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.890+0000 7f30aaa00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac1a0430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f309c00e9f0 tx=0x7f309c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.890+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c00cd80 con 0x7f30ac077370 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.890+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f309c010900 con 0x7f30ac077370 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.890+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac1a6690 con 0x7f30ac077370 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.890+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c018920 con 0x7f30ac077370 2024-07-26T08:31:17.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.890+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac1acdf0 con 0x7f30ac077370 2024-07-26T08:31:17.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.891+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac077780 con 0x7f30ac077370 2024-07-26T08:31:17.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.894+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f309c010ab0 con 0x7f30ac077370 2024-07-26T08:31:17.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.896+0000 7f30a3400640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30900b3c20 0x7f30900b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:17.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.896+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f309c0e4980 con 0x7f30ac077370 2024-07-26T08:31:17.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.896+0000 7f30aa000640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30900b3c20 0x7f30900b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:17.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.897+0000 7f30aa000640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30900b3c20 0x7f30900b6130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3098005940 tx=0x7f30980058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:17.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:17.897+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f309c0ab460 con 0x7f30ac077370 2024-07-26T08:31:18.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.096+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30ac063230 con 0x7f30900b3c20 2024-07-26T08:31:18.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.114+0000 7f30a3400640 1 -- 172.21.15.43:0/1658434897 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340468 (secure 0 0 0) 0x7f30ac063230 con 0x7f30900b3c20 2024-07-26T08:31:18.120 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:18.124 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:31:18.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30900b3c20 msgr2=0x7f30900b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:18.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30900b3c20 0x7f30900b6130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3098005940 tx=0x7f30980058d0 comp rx=0 tx=0).stop 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 msgr2=0x7f30ac1a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac1a0430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f309c00e9f0 tx=0x7f309c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 shutdown_connections 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30900b3c20 0x7f30900b6130 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ac113fa0 0x7f30ac1a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30ac077cc0 0x7f30ac1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 --2- 172.21.15.43:0/1658434897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30ac077370 0x7f30ac1a0430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.123+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 >> 172.21.15.43:0/1658434897 conn(0x7f30ac1010b0 msgr2=0x7f30ac116060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.124+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 shutdown_connections 2024-07-26T08:31:18.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:18.124+0000 7f30abe00640 1 -- 172.21.15.43:0/1658434897 wait complete. 2024-07-26T08:31:18.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:18 smithi043 ceph-mon[32384]: pgmap v429: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:18 smithi133 ceph-mon[37053]: pgmap v429: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:18 smithi063 ceph-mon[36747]: pgmap v429: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:19.105 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-07-26T08:31:16.779423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656533,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":888,"num_read_kb":543,"num_write":298,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388400,"kb_used_data":14288,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553424,"statfs":{"total":1151940427776,"available":1151542706176,"internally_reserved":0,"allocated":14630912,"data_stored":8369741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005828"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372355+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372355+0000","last_peered":"2024-07-26T08:29:36.372355+0000","last_clean":"2024-07-26T08:29:36.372355+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372355+0000","last_undegraded":"2024-07-26T08:29:36.372355+0000","last_fullsized":"2024-07-26T08:29:36.372355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705645+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:30:34.705645+0000","last_peered":"2024-07-26T08:30:34.705645+0000","last_clean":"2024-07-26T08:30:34.705645+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:30:34.705645+0000","last_undegraded":"2024-07-26T08:30:34.705645+0000","last_fullsized":"2024-07-26T08:30:34.705645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362199+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:29:36.362199+0000","last_peered":"2024-07-26T08:29:36.362199+0000","last_clean":"2024-07-26T08:29:36.362199+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:29:36.362199+0000","last_undegraded":"2024-07-26T08:29:36.362199+0000","last_fullsized":"2024-07-26T08:29:36.362199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954121+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954121+0000","last_peered":"2024-07-26T08:29:36.954121+0000","last_clean":"2024-07-26T08:29:36.954121+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954121+0000","last_undegraded":"2024-07-26T08:29:36.954121+0000","last_fullsized":"2024-07-26T08:29:36.954121+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700102+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:30:34.700102+0000","last_peered":"2024-07-26T08:30:34.700102+0000","last_clean":"2024-07-26T08:30:34.700102+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:30:34.700102+0000","last_undegraded":"2024-07-26T08:30:34.700102+0000","last_fullsized":"2024-07-26T08:30:34.700102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683288+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:29:36.683288+0000","last_peered":"2024-07-26T08:29:36.683288+0000","last_clean":"2024-07-26T08:29:36.683288+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:29:36.683288+0000","last_undegraded":"2024-07-26T08:29:36.683288+0000","last_fullsized":"2024-07-26T08:29:36.683288+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916111+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:36.916111+0000","last_peered":"2024-07-26T08:29:36.916111+0000","last_clean":"2024-07-26T08:29:36.916111+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:36.916111+0000","last_undegraded":"2024-07-26T08:29:36.916111+0000","last_fullsized":"2024-07-26T08:29:36.916111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703517+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:30:34.703517+0000","last_peered":"2024-07-26T08:30:34.703517+0000","last_clean":"2024-07-26T08:30:34.703517+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:30:34.703517+0000","last_undegraded":"2024-07-26T08:30:34.703517+0000","last_fullsized":"2024-07-26T08:30:34.703517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683797+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:29:36.683797+0000","last_peered":"2024-07-26T08:29:36.683797+0000","last_clean":"2024-07-26T08:29:36.683797+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:29:36.683797+0000","last_undegraded":"2024-07-26T08:29:36.683797+0000","last_fullsized":"2024-07-26T08:29:36.683797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916256+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:36.916256+0000","last_peered":"2024-07-26T08:29:36.916256+0000","last_clean":"2024-07-26T08:29:36.916256+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:36.916256+0000","last_undegraded":"2024-07-26T08:29:36.916256+0000","last_fullsized":"2024-07-26T08:29:36.916256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.676205+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:30:34.676205+0000","last_peered":"2024-07-26T08:30:34.676205+0000","last_clean":"2024-07-26T08:30:34.676205+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:30:34.676205+0000","last_undegraded":"2024-07-26T08:30:34.676205+0000","last_fullsized":"2024-07-26T08:30:34.676205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683388+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:29:36.683388+0000","last_peered":"2024-07-26T08:29:36.683388+0000","last_clean":"2024-07-26T08:29:36.683388+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:29:36.683388+0000","last_undegraded":"2024-07-26T08:29:36.683388+0000","last_fullsized":"2024-07-26T08:29:36.683388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708542+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:30:34.708542+0000","last_peered":"2024-07-26T08:30:34.708542+0000","last_clean":"2024-07-26T08:30:34.708542+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:30:34.708542+0000","last_undegraded":"2024-07-26T08:30:34.708542+0000","last_fullsized":"2024-07-26T08:30:34.708542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915264+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:36.915264+0000","last_peered":"2024-07-26T08:29:36.915264+0000","last_clean":"2024-07-26T08:29:36.915264+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:36.915264+0000","last_undegraded":"2024-07-26T08:29:36.915264+0000","last_fullsized":"2024-07-26T08:29:36.915264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683663+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:29:36.683663+0000","last_peered":"2024-07-26T08:29:36.683663+0000","last_clean":"2024-07-26T08:29:36.683663+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:29:36.683663+0000","last_undegraded":"2024-07-26T08:29:36.683663+0000","last_fullsized":"2024-07-26T08:29:36.683663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711642+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:30:34.711642+0000","last_peered":"2024-07-26T08:30:34.711642+0000","last_clean":"2024-07-26T08:30:34.711642+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:30:34.711642+0000","last_undegraded":"2024-07-26T08:30:34.711642+0000","last_fullsized":"2024-07-26T08:30:34.711642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362324+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:36.362324+0000","last_peered":"2024-07-26T08:29:36.362324+0000","last_clean":"2024-07-26T08:29:36.362324+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:36.362324+0000","last_undegraded":"2024-07-26T08:29:36.362324+0000","last_fullsized":"2024-07-26T08:29:36.362324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683824+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:29:36.683824+0000","last_peered":"2024-07-26T08:29:36.683824+0000","last_clean":"2024-07-26T08:29:36.683824+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:29:36.683824+0000","last_undegraded":"2024-07-26T08:29:36.683824+0000","last_fullsized":"2024-07-26T08:29:36.683824+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.693853+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:30:34.693853+0000","last_peered":"2024-07-26T08:30:34.693853+0000","last_clean":"2024-07-26T08:30:34.693853+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:30:34.693853+0000","last_undegraded":"2024-07-26T08:30:34.693853+0000","last_fullsized":"2024-07-26T08:30:34.693853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.953022+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:36.953022+0000","last_peered":"2024-07-26T08:29:36.953022+0000","last_clean":"2024-07-26T08:29:36.953022+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:36.953022+0000","last_undegraded":"2024-07-26T08:29:36.953022+0000","last_fullsized":"2024-07-26T08:29:36.953022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371394+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:29:36.371394+0000","last_peered":"2024-07-26T08:29:36.371394+0000","last_clean":"2024-07-26T08:29:36.371394+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:29:36.371394+0000","last_undegraded":"2024-07-26T08:29:36.371394+0000","last_fullsized":"2024-07-26T08:29:36.371394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.625635+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:30:34.625635+0000","last_peered":"2024-07-26T08:30:34.625635+0000","last_clean":"2024-07-26T08:30:34.625635+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:30:34.625635+0000","last_undegraded":"2024-07-26T08:30:34.625635+0000","last_fullsized":"2024-07-26T08:30:34.625635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949808+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:36.949808+0000","last_peered":"2024-07-26T08:29:36.949808+0000","last_clean":"2024-07-26T08:29:36.949808+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:36.949808+0000","last_undegraded":"2024-07-26T08:29:36.949808+0000","last_fullsized":"2024-07-26T08:29:36.949808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684075+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:29:36.684075+0000","last_peered":"2024-07-26T08:29:36.684075+0000","last_clean":"2024-07-26T08:29:36.684075+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:29:36.684075+0000","last_undegraded":"2024-07-26T08:29:36.684075+0000","last_fullsized":"2024-07-26T08:29:36.684075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709924+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:30:34.709924+0000","last_peered":"2024-07-26T08:30:34.709924+0000","last_clean":"2024-07-26T08:30:34.709924+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:30:34.709924+0000","last_undegraded":"2024-07-26T08:30:34.709924+0000","last_fullsized":"2024-07-26T08:30:34.709924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684523+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:36.684523+0000","last_peered":"2024-07-26T08:29:36.684523+0000","last_clean":"2024-07-26T08:29:36.684523+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:36.684523+0000","last_undegraded":"2024-07-26T08:29:36.684523+0000","last_fullsized":"2024-07-26T08:29:36.684523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362328+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:36.362328+0000","last_peered":"2024-07-26T08:29:36.362328+0000","last_clean":"2024-07-26T08:29:36.362328+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:36.362328+0000","last_undegraded":"2024-07-26T08:29:36.362328+0000","last_fullsized":"2024-07-26T08:29:36.362328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.704444+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:30:34.704444+0000","last_peered":"2024-07-26T08:30:34.704444+0000","last_clean":"2024-07-26T08:30:34.704444+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:30:34.704444+0000","last_undegraded":"2024-07-26T08:30:34.704444+0000","last_fullsized":"2024-07-26T08:30:34.704444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'13","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:38.934374+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:29:38.934374+0000","last_peered":"2024-07-26T08:29:38.934374+0000","last_clean":"2024-07-26T08:29:38.934374+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:29:38.934374+0000","last_undegraded":"2024-07-26T08:29:38.934374+0000","last_fullsized":"2024-07-26T08:29:38.934374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.951987+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:36.951987+0000","last_peered":"2024-07-26T08:29:36.951987+0000","last_clean":"2024-07-26T08:29:36.951987+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:36.951987+0000","last_undegraded":"2024-07-26T08:29:36.951987+0000","last_fullsized":"2024-07-26T08:29:36.951987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703343+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:30:34.703343+0000","last_peered":"2024-07-26T08:30:34.703343+0000","last_clean":"2024-07-26T08:30:34.703343+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:30:34.703343+0000","last_undegraded":"2024-07-26T08:30:34.703343+0000","last_fullsized":"2024-07-26T08:30:34.703343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916186+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916186+0000","last_peered":"2024-07-26T08:29:36.916186+0000","last_clean":"2024-07-26T08:29:36.916186+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916186+0000","last_undegraded":"2024-07-26T08:29:36.916186+0000","last_fullsized":"2024-07-26T08:29:36.916186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371750+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:36.371750+0000","last_peered":"2024-07-26T08:29:36.371750+0000","last_clean":"2024-07-26T08:29:36.371750+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:36.371750+0000","last_undegraded":"2024-07-26T08:29:36.371750+0000","last_fullsized":"2024-07-26T08:29:36.371750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687589+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:30:34.687589+0000","last_peered":"2024-07-26T08:30:34.687589+0000","last_clean":"2024-07-26T08:30:34.687589+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:30:34.687589+0000","last_undegraded":"2024-07-26T08:30:34.687589+0000","last_fullsized":"2024-07-26T08:30:34.687589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370566+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370566+0000","last_peered":"2024-07-26T08:29:36.370566+0000","last_clean":"2024-07-26T08:29:36.370566+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370566+0000","last_undegraded":"2024-07-26T08:29:36.370566+0000","last_fullsized":"2024-07-26T08:29:36.370566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915287+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:36.915287+0000","last_peered":"2024-07-26T08:29:36.915287+0000","last_clean":"2024-07-26T08:29:36.915287+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:36.915287+0000","last_undegraded":"2024-07-26T08:29:36.915287+0000","last_fullsized":"2024-07-26T08:29:36.915287+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694022+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:30:34.694022+0000","last_peered":"2024-07-26T08:30:34.694022+0000","last_clean":"2024-07-26T08:30:34.694022+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:30:34.694022+0000","last_undegraded":"2024-07-26T08:30:34.694022+0000","last_fullsized":"2024-07-26T08:30:34.694022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362690+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:36.362690+0000","last_peered":"2024-07-26T08:29:36.362690+0000","last_clean":"2024-07-26T08:29:36.362690+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:36.362690+0000","last_undegraded":"2024-07-26T08:29:36.362690+0000","last_fullsized":"2024-07-26T08:29:36.362690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.366656+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:36.366656+0000","last_peered":"2024-07-26T08:29:36.366656+0000","last_clean":"2024-07-26T08:29:36.366656+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:36.366656+0000","last_undegraded":"2024-07-26T08:29:36.366656+0000","last_fullsized":"2024-07-26T08:29:36.366656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702973+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:30:34.702973+0000","last_peered":"2024-07-26T08:30:34.702973+0000","last_clean":"2024-07-26T08:30:34.702973+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:30:34.702973+0000","last_undegraded":"2024-07-26T08:30:34.702973+0000","last_fullsized":"2024-07-26T08:30:34.702973+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:10.902675+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:31:10.902675+0000","last_peered":"2024-07-26T08:31:10.902675+0000","last_clean":"2024-07-26T08:31:10.902675+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:31:10.902675+0000","last_undegraded":"2024-07-26T08:31:10.902675+0000","last_fullsized":"2024-07-26T08:31:10.902675+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367484+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:36.367484+0000","last_peered":"2024-07-26T08:29:36.367484+0000","last_clean":"2024-07-26T08:29:36.367484+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:36.367484+0000","last_undegraded":"2024-07-26T08:29:36.367484+0000","last_fullsized":"2024-07-26T08:29:36.367484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.701488+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:30:34.701488+0000","last_peered":"2024-07-26T08:30:34.701488+0000","last_clean":"2024-07-26T08:30:34.701488+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:30:34.701488+0000","last_undegraded":"2024-07-26T08:30:34.701488+0000","last_fullsized":"2024-07-26T08:30:34.701488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362439+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362439+0000","last_peered":"2024-07-26T08:29:36.362439+0000","last_clean":"2024-07-26T08:29:36.362439+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362439+0000","last_undegraded":"2024-07-26T08:29:36.362439+0000","last_fullsized":"2024-07-26T08:29:36.362439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372449+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:29:36.372449+0000","last_peered":"2024-07-26T08:29:36.372449+0000","last_clean":"2024-07-26T08:29:36.372449+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:29:36.372449+0000","last_undegraded":"2024-07-26T08:29:36.372449+0000","last_fullsized":"2024-07-26T08:29:36.372449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706994+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:30:34.706994+0000","last_peered":"2024-07-26T08:30:34.706994+0000","last_clean":"2024-07-26T08:30:34.706994+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:30:34.706994+0000","last_undegraded":"2024-07-26T08:30:34.706994+0000","last_fullsized":"2024-07-26T08:30:34.706994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683931+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.683931+0000","last_peered":"2024-07-26T08:29:36.683931+0000","last_clean":"2024-07-26T08:29:36.683931+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.683931+0000","last_undegraded":"2024-07-26T08:29:36.683931+0000","last_fullsized":"2024-07-26T08:29:36.683931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362638+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:29:36.362638+0000","last_peered":"2024-07-26T08:29:36.362638+0000","last_clean":"2024-07-26T08:29:36.362638+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:29:36.362638+0000","last_undegraded":"2024-07-26T08:29:36.362638+0000","last_fullsized":"2024-07-26T08:29:36.362638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363080+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:36.363080+0000","last_peered":"2024-07-26T08:29:36.363080+0000","last_clean":"2024-07-26T08:29:36.363080+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:36.363080+0000","last_undegraded":"2024-07-26T08:29:36.363080+0000","last_fullsized":"2024-07-26T08:29:36.363080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685563+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:30:34.685563+0000","last_peered":"2024-07-26T08:30:34.685563+0000","last_clean":"2024-07-26T08:30:34.685563+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:30:34.685563+0000","last_undegraded":"2024-07-26T08:30:34.685563+0000","last_fullsized":"2024-07-26T08:30:34.685563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362813+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:36.362813+0000","last_peered":"2024-07-26T08:29:36.362813+0000","last_clean":"2024-07-26T08:29:36.362813+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:36.362813+0000","last_undegraded":"2024-07-26T08:29:36.362813+0000","last_fullsized":"2024-07-26T08:29:36.362813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.949804+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:29:36.949804+0000","last_peered":"2024-07-26T08:29:36.949804+0000","last_clean":"2024-07-26T08:29:36.949804+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:29:36.949804+0000","last_undegraded":"2024-07-26T08:29:36.949804+0000","last_fullsized":"2024-07-26T08:29:36.949804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706552+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:30:34.706552+0000","last_peered":"2024-07-26T08:30:34.706552+0000","last_clean":"2024-07-26T08:30:34.706552+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:30:34.706552+0000","last_undegraded":"2024-07-26T08:30:34.706552+0000","last_fullsized":"2024-07-26T08:30:34.706552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373195+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:36.373195+0000","last_peered":"2024-07-26T08:29:36.373195+0000","last_clean":"2024-07-26T08:29:36.373195+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:36.373195+0000","last_undegraded":"2024-07-26T08:29:36.373195+0000","last_fullsized":"2024-07-26T08:29:36.373195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.000867+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:29:37.000867+0000","last_peered":"2024-07-26T08:29:37.000867+0000","last_clean":"2024-07-26T08:29:37.000867+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:29:37.000867+0000","last_undegraded":"2024-07-26T08:29:37.000867+0000","last_fullsized":"2024-07-26T08:29:37.000867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675138+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:30:34.675138+0000","last_peered":"2024-07-26T08:30:34.675138+0000","last_clean":"2024-07-26T08:30:34.675138+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:30:34.675138+0000","last_undegraded":"2024-07-26T08:30:34.675138+0000","last_fullsized":"2024-07-26T08:30:34.675138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367524+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:36.367524+0000","last_peered":"2024-07-26T08:29:36.367524+0000","last_clean":"2024-07-26T08:29:36.367524+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:36.367524+0000","last_undegraded":"2024-07-26T08:29:36.367524+0000","last_fullsized":"2024-07-26T08:29:36.367524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371670+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:29:36.371670+0000","last_peered":"2024-07-26T08:29:36.371670+0000","last_clean":"2024-07-26T08:29:36.371670+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:29:36.371670+0000","last_undegraded":"2024-07-26T08:29:36.371670+0000","last_fullsized":"2024-07-26T08:29:36.371670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670546+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:30:34.670546+0000","last_peered":"2024-07-26T08:30:34.670546+0000","last_clean":"2024-07-26T08:30:34.670546+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:30:34.670546+0000","last_undegraded":"2024-07-26T08:30:34.670546+0000","last_fullsized":"2024-07-26T08:30:34.670546+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916146+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:36.916146+0000","last_peered":"2024-07-26T08:29:36.916146+0000","last_clean":"2024-07-26T08:29:36.916146+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:36.916146+0000","last_undegraded":"2024-07-26T08:29:36.916146+0000","last_fullsized":"2024-07-26T08:29:36.916146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372291+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:29:36.372291+0000","last_peered":"2024-07-26T08:29:36.372291+0000","last_clean":"2024-07-26T08:29:36.372291+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:29:36.372291+0000","last_undegraded":"2024-07-26T08:29:36.372291+0000","last_fullsized":"2024-07-26T08:29:36.372291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675745+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:30:34.675745+0000","last_peered":"2024-07-26T08:30:34.675745+0000","last_clean":"2024-07-26T08:30:34.675745+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:30:34.675745+0000","last_undegraded":"2024-07-26T08:30:34.675745+0000","last_fullsized":"2024-07-26T08:30:34.675745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.915217+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:36.915217+0000","last_peered":"2024-07-26T08:29:36.915217+0000","last_clean":"2024-07-26T08:29:36.915217+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:36.915217+0000","last_undegraded":"2024-07-26T08:29:36.915217+0000","last_fullsized":"2024-07-26T08:29:36.915217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.367406+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:29:36.367406+0000","last_peered":"2024-07-26T08:29:36.367406+0000","last_clean":"2024-07-26T08:29:36.367406+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:29:36.367406+0000","last_undegraded":"2024-07-26T08:29:36.367406+0000","last_fullsized":"2024-07-26T08:29:36.367406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.681821+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:30:34.681821+0000","last_peered":"2024-07-26T08:30:34.681821+0000","last_clean":"2024-07-26T08:30:34.681821+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:30:34.681821+0000","last_undegraded":"2024-07-26T08:30:34.681821+0000","last_fullsized":"2024-07-26T08:30:34.681821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":181,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:12.908547+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:31:12.908547+0000","last_peered":"2024-07-26T08:31:12.908547+0000","last_clean":"2024-07-26T08:31:12.908547+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:31:12.908547+0000","last_undegraded":"2024-07-26T08:31:12.908547+0000","last_fullsized":"2024-07-26T08:31:12.908547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371745+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:29:36.371745+0000","last_peered":"2024-07-26T08:29:36.371745+0000","last_clean":"2024-07-26T08:29:36.371745+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:29:36.371745+0000","last_undegraded":"2024-07-26T08:29:36.371745+0000","last_fullsized":"2024-07-26T08:29:36.371745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711829+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:30:34.711829+0000","last_peered":"2024-07-26T08:30:34.711829+0000","last_clean":"2024-07-26T08:30:34.711829+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:30:34.711829+0000","last_undegraded":"2024-07-26T08:30:34.711829+0000","last_fullsized":"2024-07-26T08:30:34.711829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373127+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:36.373127+0000","last_peered":"2024-07-26T08:29:36.373127+0000","last_clean":"2024-07-26T08:29:36.373127+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:36.373127+0000","last_undegraded":"2024-07-26T08:29:36.373127+0000","last_fullsized":"2024-07-26T08:29:36.373127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372173+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:29:36.372173+0000","last_peered":"2024-07-26T08:29:36.372173+0000","last_clean":"2024-07-26T08:29:36.372173+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:29:36.372173+0000","last_undegraded":"2024-07-26T08:29:36.372173+0000","last_fullsized":"2024-07-26T08:29:36.372173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.712550+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:30:34.712550+0000","last_peered":"2024-07-26T08:30:34.712550+0000","last_clean":"2024-07-26T08:30:34.712550+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:30:34.712550+0000","last_undegraded":"2024-07-26T08:30:34.712550+0000","last_fullsized":"2024-07-26T08:30:34.712550+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362498+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:36.362498+0000","last_peered":"2024-07-26T08:29:36.362498+0000","last_clean":"2024-07-26T08:29:36.362498+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:36.362498+0000","last_undegraded":"2024-07-26T08:29:36.362498+0000","last_fullsized":"2024-07-26T08:29:36.362498+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372897+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:29:36.372897+0000","last_peered":"2024-07-26T08:29:36.372897+0000","last_clean":"2024-07-26T08:29:36.372897+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:29:36.372897+0000","last_undegraded":"2024-07-26T08:29:36.372897+0000","last_fullsized":"2024-07-26T08:29:36.372897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670795+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:30:34.670795+0000","last_peered":"2024-07-26T08:30:34.670795+0000","last_clean":"2024-07-26T08:30:34.670795+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:30:34.670795+0000","last_undegraded":"2024-07-26T08:30:34.670795+0000","last_fullsized":"2024-07-26T08:30:34.670795+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":354,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:14.849120+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:31:14.849120+0000","last_peered":"2024-07-26T08:31:14.849120+0000","last_clean":"2024-07-26T08:31:14.849120+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:31:14.849120+0000","last_undegraded":"2024-07-26T08:31:14.849120+0000","last_fullsized":"2024-07-26T08:31:14.849120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62321,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":197,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370687+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:29:36.370687+0000","last_peered":"2024-07-26T08:29:36.370687+0000","last_clean":"2024-07-26T08:29:36.370687+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:29:36.370687+0000","last_undegraded":"2024-07-26T08:29:36.370687+0000","last_fullsized":"2024-07-26T08:29:36.370687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685530+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:30:34.685530+0000","last_peered":"2024-07-26T08:30:34.685530+0000","last_clean":"2024-07-26T08:30:34.685530+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:30:34.685530+0000","last_undegraded":"2024-07-26T08:30:34.685530+0000","last_fullsized":"2024-07-26T08:30:34.685530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.373072+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:36.373072+0000","last_peered":"2024-07-26T08:29:36.373072+0000","last_clean":"2024-07-26T08:29:36.373072+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:36.373072+0000","last_undegraded":"2024-07-26T08:29:36.373072+0000","last_fullsized":"2024-07-26T08:29:36.373072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.683845+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:29:36.683845+0000","last_peered":"2024-07-26T08:29:36.683845+0000","last_clean":"2024-07-26T08:29:36.683845+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:29:36.683845+0000","last_undegraded":"2024-07-26T08:29:36.683845+0000","last_fullsized":"2024-07-26T08:29:36.683845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697618+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:30:34.697618+0000","last_peered":"2024-07-26T08:30:34.697618+0000","last_clean":"2024-07-26T08:30:34.697618+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:30:34.697618+0000","last_undegraded":"2024-07-26T08:30:34.697618+0000","last_fullsized":"2024-07-26T08:30:34.697618+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.363107+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:36.363107+0000","last_peered":"2024-07-26T08:29:36.363107+0000","last_clean":"2024-07-26T08:29:36.363107+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:36.363107+0000","last_undegraded":"2024-07-26T08:29:36.363107+0000","last_fullsized":"2024-07-26T08:29:36.363107+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.369063+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:29:36.369063+0000","last_peered":"2024-07-26T08:29:36.369063+0000","last_clean":"2024-07-26T08:29:36.369063+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:29:36.369063+0000","last_undegraded":"2024-07-26T08:29:36.369063+0000","last_fullsized":"2024-07-26T08:29:36.369063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687707+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:30:34.687707+0000","last_peered":"2024-07-26T08:30:34.687707+0000","last_clean":"2024-07-26T08:30:34.687707+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:30:34.687707+0000","last_undegraded":"2024-07-26T08:30:34.687707+0000","last_fullsized":"2024-07-26T08:30:34.687707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:13.918221+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:31:13.918221+0000","last_peered":"2024-07-26T08:31:13.918221+0000","last_clean":"2024-07-26T08:31:13.918221+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:31:13.918221+0000","last_undegraded":"2024-07-26T08:31:13.918221+0000","last_fullsized":"2024-07-26T08:31:13.918221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.952413+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:29:36.952413+0000","last_peered":"2024-07-26T08:29:36.952413+0000","last_clean":"2024-07-26T08:29:36.952413+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:29:36.952413+0000","last_undegraded":"2024-07-26T08:29:36.952413+0000","last_fullsized":"2024-07-26T08:29:36.952413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.001330+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:37.001330+0000","last_peered":"2024-07-26T08:29:37.001330+0000","last_clean":"2024-07-26T08:29:37.001330+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:37.001330+0000","last_undegraded":"2024-07-26T08:29:37.001330+0000","last_fullsized":"2024-07-26T08:29:37.001330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709552+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:30:34.709552+0000","last_peered":"2024-07-26T08:30:34.709552+0000","last_clean":"2024-07-26T08:30:34.709552+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:30:34.709552+0000","last_undegraded":"2024-07-26T08:30:34.709552+0000","last_fullsized":"2024-07-26T08:30:34.709552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372059+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:36.372059+0000","last_peered":"2024-07-26T08:29:36.372059+0000","last_clean":"2024-07-26T08:29:36.372059+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:36.372059+0000","last_undegraded":"2024-07-26T08:29:36.372059+0000","last_fullsized":"2024-07-26T08:29:36.372059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372015+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:36.372015+0000","last_peered":"2024-07-26T08:29:36.372015+0000","last_clean":"2024-07-26T08:29:36.372015+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:36.372015+0000","last_undegraded":"2024-07-26T08:29:36.372015+0000","last_fullsized":"2024-07-26T08:29:36.372015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713293+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:30:34.713293+0000","last_peered":"2024-07-26T08:30:34.713293+0000","last_clean":"2024-07-26T08:30:34.713293+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:30:34.713293+0000","last_undegraded":"2024-07-26T08:30:34.713293+0000","last_fullsized":"2024-07-26T08:30:34.713293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.365740+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:36.365740+0000","last_peered":"2024-07-26T08:29:36.365740+0000","last_clean":"2024-07-26T08:29:36.365740+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:36.365740+0000","last_undegraded":"2024-07-26T08:29:36.365740+0000","last_fullsized":"2024-07-26T08:29:36.365740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.371617+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:29:36.371617+0000","last_peered":"2024-07-26T08:29:36.371617+0000","last_clean":"2024-07-26T08:29:36.371617+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:29:36.371617+0000","last_undegraded":"2024-07-26T08:29:36.371617+0000","last_fullsized":"2024-07-26T08:29:36.371617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703855+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:30:34.703855+0000","last_peered":"2024-07-26T08:30:34.703855+0000","last_clean":"2024-07-26T08:30:34.703855+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:30:34.703855+0000","last_undegraded":"2024-07-26T08:30:34.703855+0000","last_fullsized":"2024-07-26T08:30:34.703855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362536+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:29:36.362536+0000","last_peered":"2024-07-26T08:29:36.362536+0000","last_clean":"2024-07-26T08:29:36.362536+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:29:36.362536+0000","last_undegraded":"2024-07-26T08:29:36.362536+0000","last_fullsized":"2024-07-26T08:29:36.362536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":181,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:10.911928+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:31:10.911928+0000","last_peered":"2024-07-26T08:31:10.911928+0000","last_clean":"2024-07-26T08:31:10.911928+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:31:10.911928+0000","last_undegraded":"2024-07-26T08:31:10.911928+0000","last_fullsized":"2024-07-26T08:31:10.911928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674729+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:30:34.674729+0000","last_peered":"2024-07-26T08:30:34.674729+0000","last_clean":"2024-07-26T08:30:34.674729+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:30:34.674729+0000","last_undegraded":"2024-07-26T08:30:34.674729+0000","last_fullsized":"2024-07-26T08:30:34.674729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362623+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:29:36.362623+0000","last_peered":"2024-07-26T08:29:36.362623+0000","last_clean":"2024-07-26T08:29:36.362623+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:29:36.362623+0000","last_undegraded":"2024-07-26T08:29:36.362623+0000","last_fullsized":"2024-07-26T08:29:36.362623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671528+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:30:34.671528+0000","last_peered":"2024-07-26T08:30:34.671528+0000","last_clean":"2024-07-26T08:30:34.671528+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:30:34.671528+0000","last_undegraded":"2024-07-26T08:30:34.671528+0000","last_fullsized":"2024-07-26T08:30:34.671528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674769+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:30:34.674769+0000","last_peered":"2024-07-26T08:30:34.674769+0000","last_clean":"2024-07-26T08:30:34.674769+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:30:34.674769+0000","last_undegraded":"2024-07-26T08:30:34.674769+0000","last_fullsized":"2024-07-26T08:30:34.674769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700015+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:30:34.700015+0000","last_peered":"2024-07-26T08:30:34.700015+0000","last_clean":"2024-07-26T08:30:34.700015+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:30:34.700015+0000","last_undegraded":"2024-07-26T08:30:34.700015+0000","last_fullsized":"2024-07-26T08:30:34.700015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713811+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:30:34.713811+0000","last_peered":"2024-07-26T08:30:34.713811+0000","last_clean":"2024-07-26T08:30:34.713811+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:30:34.713811+0000","last_undegraded":"2024-07-26T08:30:34.713811+0000","last_fullsized":"2024-07-26T08:30:34.713811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711339+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:30:34.711339+0000","last_peered":"2024-07-26T08:30:34.711339+0000","last_clean":"2024-07-26T08:30:34.711339+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:30:34.711339+0000","last_undegraded":"2024-07-26T08:30:34.711339+0000","last_fullsized":"2024-07-26T08:30:34.711339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673119+0000","last_change":"2024-07-26T08:29:36.916212+0000","last_active":"2024-07-26T08:30:34.673119+0000","last_peered":"2024-07-26T08:30:34.673119+0000","last_clean":"2024-07-26T08:30:34.673119+0000","last_became_active":"2024-07-26T08:29:36.915665+0000","last_became_peered":"2024-07-26T08:29:36.915665+0000","last_unstale":"2024-07-26T08:30:34.673119+0000","last_undegraded":"2024-07-26T08:30:34.673119+0000","last_fullsized":"2024-07-26T08:30:34.673119+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:54:03.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672755+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:30:34.672755+0000","last_peered":"2024-07-26T08:30:34.672755+0000","last_clean":"2024-07-26T08:30:34.672755+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:30:34.672755+0000","last_undegraded":"2024-07-26T08:30:34.672755+0000","last_fullsized":"2024-07-26T08:30:34.672755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671789+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:30:34.671789+0000","last_peered":"2024-07-26T08:30:34.671789+0000","last_clean":"2024-07-26T08:30:34.671789+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:30:34.671789+0000","last_undegraded":"2024-07-26T08:30:34.671789+0000","last_fullsized":"2024-07-26T08:30:34.671789+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707906+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:30:34.707906+0000","last_peered":"2024-07-26T08:30:34.707906+0000","last_clean":"2024-07-26T08:30:34.707906+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:30:34.707906+0000","last_undegraded":"2024-07-26T08:30:34.707906+0000","last_fullsized":"2024-07-26T08:30:34.707906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705043+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:30:34.705043+0000","last_peered":"2024-07-26T08:30:34.705043+0000","last_clean":"2024-07-26T08:30:34.705043+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:30:34.705043+0000","last_undegraded":"2024-07-26T08:30:34.705043+0000","last_fullsized":"2024-07-26T08:30:34.705043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706676+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:30:34.706676+0000","last_peered":"2024-07-26T08:30:34.706676+0000","last_clean":"2024-07-26T08:30:34.706676+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:30:34.706676+0000","last_undegraded":"2024-07-26T08:30:34.706676+0000","last_fullsized":"2024-07-26T08:30:34.706676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713836+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:30:34.713836+0000","last_peered":"2024-07-26T08:30:34.713836+0000","last_clean":"2024-07-26T08:30:34.713836+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:30:34.713836+0000","last_undegraded":"2024-07-26T08:30:34.713836+0000","last_fullsized":"2024-07-26T08:30:34.713836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674640+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:30:34.674640+0000","last_peered":"2024-07-26T08:30:34.674640+0000","last_clean":"2024-07-26T08:30:34.674640+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:30:34.674640+0000","last_undegraded":"2024-07-26T08:30:34.674640+0000","last_fullsized":"2024-07-26T08:30:34.674640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707019+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:30:34.707019+0000","last_peered":"2024-07-26T08:30:34.707019+0000","last_clean":"2024-07-26T08:30:34.707019+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:30:34.707019+0000","last_undegraded":"2024-07-26T08:30:34.707019+0000","last_fullsized":"2024-07-26T08:30:34.707019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687311+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:30:34.687311+0000","last_peered":"2024-07-26T08:30:34.687311+0000","last_clean":"2024-07-26T08:30:34.687311+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:30:34.687311+0000","last_undegraded":"2024-07-26T08:30:34.687311+0000","last_fullsized":"2024-07-26T08:30:34.687311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702811+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:30:34.702811+0000","last_peered":"2024-07-26T08:30:34.702811+0000","last_clean":"2024-07-26T08:30:34.702811+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:30:34.702811+0000","last_undegraded":"2024-07-26T08:30:34.702811+0000","last_fullsized":"2024-07-26T08:30:34.702811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694229+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:30:34.694229+0000","last_peered":"2024-07-26T08:30:34.694229+0000","last_clean":"2024-07-26T08:30:34.694229+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:30:34.694229+0000","last_undegraded":"2024-07-26T08:30:34.694229+0000","last_fullsized":"2024-07-26T08:30:34.694229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694733+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:30:34.694733+0000","last_peered":"2024-07-26T08:30:34.694733+0000","last_clean":"2024-07-26T08:30:34.694733+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:30:34.694733+0000","last_undegraded":"2024-07-26T08:30:34.694733+0000","last_fullsized":"2024-07-26T08:30:34.694733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702348+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:30:34.702348+0000","last_peered":"2024-07-26T08:30:34.702348+0000","last_clean":"2024-07-26T08:30:34.702348+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:30:34.702348+0000","last_undegraded":"2024-07-26T08:30:34.702348+0000","last_fullsized":"2024-07-26T08:30:34.702348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713690+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:30:34.713690+0000","last_peered":"2024-07-26T08:30:34.713690+0000","last_clean":"2024-07-26T08:30:34.713690+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:30:34.713690+0000","last_undegraded":"2024-07-26T08:30:34.713690+0000","last_fullsized":"2024-07-26T08:30:34.713690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672432+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:30:34.672432+0000","last_peered":"2024-07-26T08:30:34.672432+0000","last_clean":"2024-07-26T08:30:34.672432+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:30:34.672432+0000","last_undegraded":"2024-07-26T08:30:34.672432+0000","last_fullsized":"2024-07-26T08:30:34.672432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685567+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:30:34.685567+0000","last_peered":"2024-07-26T08:30:34.685567+0000","last_clean":"2024-07-26T08:30:34.685567+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:30:34.685567+0000","last_undegraded":"2024-07-26T08:30:34.685567+0000","last_fullsized":"2024-07-26T08:30:34.685567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670957+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:30:34.670957+0000","last_peered":"2024-07-26T08:30:34.670957+0000","last_clean":"2024-07-26T08:30:34.670957+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:30:34.670957+0000","last_undegraded":"2024-07-26T08:30:34.670957+0000","last_fullsized":"2024-07-26T08:30:34.670957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685147+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:30:34.685147+0000","last_peered":"2024-07-26T08:30:34.685147+0000","last_clean":"2024-07-26T08:30:34.685147+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:30:34.685147+0000","last_undegraded":"2024-07-26T08:30:34.685147+0000","last_fullsized":"2024-07-26T08:30:34.685147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706313+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:30:34.706313+0000","last_peered":"2024-07-26T08:30:34.706313+0000","last_clean":"2024-07-26T08:30:34.706313+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:30:34.706313+0000","last_undegraded":"2024-07-26T08:30:34.706313+0000","last_fullsized":"2024-07-26T08:30:34.706313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688447+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:30:34.688447+0000","last_peered":"2024-07-26T08:30:34.688447+0000","last_clean":"2024-07-26T08:30:34.688447+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:30:34.688447+0000","last_undegraded":"2024-07-26T08:30:34.688447+0000","last_fullsized":"2024-07-26T08:30:34.688447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674230+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:30:34.674230+0000","last_peered":"2024-07-26T08:30:34.674230+0000","last_clean":"2024-07-26T08:30:34.674230+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:30:34.674230+0000","last_undegraded":"2024-07-26T08:30:34.674230+0000","last_fullsized":"2024-07-26T08:30:34.674230+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700105+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:30:34.700105+0000","last_peered":"2024-07-26T08:30:34.700105+0000","last_clean":"2024-07-26T08:30:34.700105+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:30:34.700105+0000","last_undegraded":"2024-07-26T08:30:34.700105+0000","last_fullsized":"2024-07-26T08:30:34.700105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674380+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:30:34.674380+0000","last_peered":"2024-07-26T08:30:34.674380+0000","last_clean":"2024-07-26T08:30:34.674380+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:30:34.674380+0000","last_undegraded":"2024-07-26T08:30:34.674380+0000","last_fullsized":"2024-07-26T08:30:34.674380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.699632+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:30:34.699632+0000","last_peered":"2024-07-26T08:30:34.699632+0000","last_clean":"2024-07-26T08:30:34.699632+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:30:34.699632+0000","last_undegraded":"2024-07-26T08:30:34.699632+0000","last_fullsized":"2024-07-26T08:30:34.699632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.695827+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:30:34.695827+0000","last_peered":"2024-07-26T08:30:34.695827+0000","last_clean":"2024-07-26T08:30:34.695827+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:30:34.695827+0000","last_undegraded":"2024-07-26T08:30:34.695827+0000","last_fullsized":"2024-07-26T08:30:34.695827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702642+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:30:34.702642+0000","last_peered":"2024-07-26T08:30:34.702642+0000","last_clean":"2024-07-26T08:30:34.702642+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:30:34.702642+0000","last_undegraded":"2024-07-26T08:30:34.702642+0000","last_fullsized":"2024-07-26T08:30:34.702642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65931,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":807,"num_read_kb":474,"num_write":173,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":197793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678078,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":535351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874306,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1736704,"data_stored":1189036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037833,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234063,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430292,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593816,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790047,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953574,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149801,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":530957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378737,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":594344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542263,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":592994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705787,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:31:19.110 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-26T08:31:19.110 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-07-26T08:31:19.110 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-07-26T08:31:19.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph health --format=json 2024-07-26T08:31:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:19 smithi043 ceph-mon[32384]: from='client.25118 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:31:19.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:19 smithi133 ceph-mon[37053]: from='client.25118 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:31:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:19 smithi063 ceph-mon[36747]: from='client.25118 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:31:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:20.337 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:20 smithi043 ceph-mon[32384]: pgmap v430: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:20 smithi133 ceph-mon[37053]: pgmap v430: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:20 smithi063 ceph-mon[36747]: pgmap v430: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:22.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 -- 172.21.15.43:0/905187162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc1099f0 msgr2=0x7f94bc109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:22.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 --2- 172.21.15.43:0/905187162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc1099f0 0x7f94bc109e00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009900 tx=0x7f94ac02a410 comp rx=0 tx=0).stop 2024-07-26T08:31:22.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 -- 172.21.15.43:0/905187162 shutdown_connections 2024-07-26T08:31:22.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 --2- 172.21.15.43:0/905187162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10f330 0x7f94bc10f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 --2- 172.21.15.43:0/905187162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc10fc80 0x7f94bc1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 --2- 172.21.15.43:0/905187162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc1099f0 0x7f94bc109e00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 -- 172.21.15.43:0/905187162 >> 172.21.15.43:0/905187162 conn(0x7f94bc078ff0 msgr2=0x7f94bc107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:22.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 -- 172.21.15.43:0/905187162 shutdown_connections 2024-07-26T08:31:22.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.163+0000 7f94c0a00640 1 -- 172.21.15.43:0/905187162 wait complete. 2024-07-26T08:31:22.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.164+0000 7f94c0a00640 1 Processor -- start 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 -- start start 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 0x7f94bc1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc10f330 0x7f94bc1a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10fc80 0x7f94bc1a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc119ad0 con 0x7f94bc10f330 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc119950 con 0x7f94bc1099f0 2024-07-26T08:31:22.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.165+0000 7f94c0a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc119c50 con 0x7f94bc10fc80 2024-07-26T08:31:22.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94b1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc10f330 0x7f94bc1a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:22.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94bb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10fc80 0x7f94bc1a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:22.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 0x7f94bc1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:22.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 0x7f94bc1a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:39234/0 (socket says 172.21.15.43:39234) 2024-07-26T08:31:22.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94b1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc10f330 0x7f94bc1a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54762/0 (socket says 172.21.15.43:54762) 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94bb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10fc80 0x7f94bc1a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51904/0 (socket says 172.21.15.43:51904) 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 -- 172.21.15.43:0/884314717 learned_addr learned my addr 172.21.15.43:0/884314717 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 -- 172.21.15.43:0/884314717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10fc80 msgr2=0x7f94bc1a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10fc80 0x7f94bc1a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 -- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc10f330 msgr2=0x7f94bc1a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc10f330 0x7f94bc1a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 -- 172.21.15.43:0/884314717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc1a63d0 con 0x7f94bc1099f0 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.166+0000 7f94ba800640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 0x7f94bc1a0460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0314b0 tx=0x7f94ac003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.167+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac03f070 con 0x7f94bc1099f0 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.167+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc1a6660 con 0x7f94bc1099f0 2024-07-26T08:31:22.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.167+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94ac031bf0 con 0x7f94bc1099f0 2024-07-26T08:31:22.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.167+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac035030 con 0x7f94bc1099f0 2024-07-26T08:31:22.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.167+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc1ace20 con 0x7f94bc1099f0 2024-07-26T08:31:22.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.168+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc109e00 con 0x7f94bc1099f0 2024-07-26T08:31:22.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.171+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f94ac042070 con 0x7f94bc1099f0 2024-07-26T08:31:22.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.172+0000 7f94b3e00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a00b3c20 0x7f94a00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:22.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.172+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f94ac104f50 con 0x7f94bc1099f0 2024-07-26T08:31:22.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.173+0000 7f94b1e00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a00b3c20 0x7f94a00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:22.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.173+0000 7f94b1e00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a00b3c20 0x7f94a00b6130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f94bc10fb40 tx=0x7f94a4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:22.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.174+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f94ac0cc080 con 0x7f94bc1099f0 2024-07-26T08:31:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.418+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94bc111a50 con 0x7f94bc1099f0 2024-07-26T08:31:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.419+0000 7f94b3e00640 1 -- 172.21.15.43:0/884314717 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f94ac0cb980 con 0x7f94bc1099f0 2024-07-26T08:31:22.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:22 smithi043 ceph-mon[32384]: pgmap v431: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:22.421 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:22.421 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-07-26T08:31:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a00b3c20 msgr2=0x7f94a00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a00b3c20 0x7f94a00b6130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f94bc10fb40 tx=0x7f94a4005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 msgr2=0x7f94bc1a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 0x7f94bc1a0460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0314b0 tx=0x7f94ac003c10 comp rx=0 tx=0).stop 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 shutdown_connections 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a00b3c20 0x7f94a00b6130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94bc10fc80 0x7f94bc1a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94bc10f330 0x7f94bc1a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 --2- 172.21.15.43:0/884314717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94bc1099f0 0x7f94bc1a0460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 >> 172.21.15.43:0/884314717 conn(0x7f94bc078ff0 msgr2=0x7f94bc079670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.422+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 shutdown_connections 2024-07-26T08:31:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:22.423+0000 7f94c0a00640 1 -- 172.21.15.43:0/884314717 wait complete. 2024-07-26T08:31:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:22 smithi133 ceph-mon[37053]: pgmap v431: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:22 smithi063 ceph-mon[36747]: pgmap v431: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:23.416 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-07-26T08:31:23.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:31:23.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:23 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/884314717' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-26T08:31:23.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:23 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/884314717' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-26T08:31:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:23 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/884314717' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-26T08:31:23.881 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:24.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:24 smithi043 ceph-mon[32384]: pgmap v432: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:24 smithi063 ceph-mon[36747]: pgmap v432: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:24.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:24 smithi133 ceph-mon[37053]: pgmap v432: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.352+0000 7fc2f9200640 1 -- 172.21.15.43:0/133379351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f41055e0 msgr2=0x7fc2f41059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.352+0000 7fc2f9200640 1 --2- 172.21.15.43:0/133379351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f41055e0 0x7fc2f41059f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009900 tx=0x7fc2dc02a410 comp rx=0 tx=0).stop 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 -- 172.21.15.43:0/133379351 shutdown_connections 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 --2- 172.21.15.43:0/133379351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410b870 0x7fc2f41120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 --2- 172.21.15.43:0/133379351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f410af20 0x7fc2f410b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 --2- 172.21.15.43:0/133379351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f41055e0 0x7fc2f41059f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 -- 172.21.15.43:0/133379351 >> 172.21.15.43:0/133379351 conn(0x7fc2f41010b0 msgr2=0x7fc2f4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 -- 172.21.15.43:0/133379351 shutdown_connections 2024-07-26T08:31:26.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.353+0000 7fc2f9200640 1 -- 172.21.15.43:0/133379351 wait complete. 2024-07-26T08:31:26.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.354+0000 7fc2f9200640 1 Processor -- start 2024-07-26T08:31:26.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.354+0000 7fc2f9200640 1 -- start start 2024-07-26T08:31:26.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f41055e0 0x7fc2f419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:26.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410af20 0x7fc2f419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:26.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f410b870 0x7fc2f41a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:26.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f9200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4115670 con 0x7fc2f410b870 2024-07-26T08:31:26.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f9200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41154f0 con 0x7fc2f41055e0 2024-07-26T08:31:26.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f9200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41157f0 con 0x7fc2f410af20 2024-07-26T08:31:26.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f410b870 0x7fc2f41a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:26.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f41055e0 0x7fc2f419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:26.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410af20 0x7fc2f419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:26.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.355+0000 7fc2f3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f41055e0 0x7fc2f419c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:41556/0 (socket says 172.21.15.43:41556) 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f410b870 0x7fc2f41a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46488/0 (socket says 172.21.15.43:46488) 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f3400640 1 -- 172.21.15.43:0/3620811035 learned_addr learned my addr 172.21.15.43:0/3620811035 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f2a00640 1 -- 172.21.15.43:0/3620811035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f41055e0 msgr2=0x7fc2f419c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f2a00640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f41055e0 0x7fc2f419c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f2a00640 1 -- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f410b870 msgr2=0x7fc2f41a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f2a00640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f410b870 0x7fc2f41a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f2a00640 1 -- 172.21.15.43:0/3620811035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f41a2070 con 0x7fc2f410af20 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.356+0000 7fc2f2a00640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410af20 0x7fc2f419c6a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2f406c2f0 tx=0x7fc2e400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.357+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4010430 con 0x7fc2f410af20 2024-07-26T08:31:26.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.357+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f41a2360 con 0x7fc2f410af20 2024-07-26T08:31:26.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.357+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc2e4010aa0 con 0x7fc2f410af20 2024-07-26T08:31:26.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.357+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4017b30 con 0x7fc2f410af20 2024-07-26T08:31:26.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.357+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f41a8ac0 con 0x7fc2f410af20 2024-07-26T08:31:26.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.358+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f41059f0 con 0x7fc2f410af20 2024-07-26T08:31:26.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.361+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fc2e4017cd0 con 0x7fc2f410af20 2024-07-26T08:31:26.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.362+0000 7fc2ebe00640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc2d80b3c20 0x7fc2d80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:26.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.363+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc2e40e4ab0 con 0x7fc2f410af20 2024-07-26T08:31:26.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.363+0000 7fc2f3400640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc2d80b3c20 0x7fc2d80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:26.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.363+0000 7fc2f3400640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc2d80b3c20 0x7fc2d80b6130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005f70 tx=0x7fc2dc005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:26.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.364+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc2e40abc70 con 0x7fc2f410af20 2024-07-26T08:31:26.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:26 smithi043 ceph-mon[32384]: pgmap v433: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:26 smithi063 ceph-mon[36747]: pgmap v433: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:26.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.608+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2f410d6a0 con 0x7fc2f410af20 2024-07-26T08:31:26.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.609+0000 7fc2ebe00640 1 -- 172.21.15.43:0/3620811035 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11895 (secure 0 0 0) 0x7fc2e40ab570 con 0x7fc2f410af20 2024-07-26T08:31:26.611 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:26.611 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"btime":"2024-07-26T08:29:08:768082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:29:08.612953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24709,24710,24733]},"id":1}]} 2024-07-26T08:31:26.612 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:31:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.612+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc2d80b3c20 msgr2=0x7fc2d80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.612+0000 7fc2f9200640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc2d80b3c20 0x7fc2d80b6130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005f70 tx=0x7fc2dc005a20 comp rx=0 tx=0).stop 2024-07-26T08:31:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.612+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410af20 msgr2=0x7fc2f419c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.612+0000 7fc2f9200640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410af20 0x7fc2f419c6a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2f406c2f0 tx=0x7fc2e400ef90 comp rx=0 tx=0).stop 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 shutdown_connections 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc2d80b3c20 0x7fc2d80b6130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f410af20 0x7fc2f419c6a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2f410b870 0x7fc2f41a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 --2- 172.21.15.43:0/3620811035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f41055e0 0x7fc2f419c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 >> 172.21.15.43:0/3620811035 conn(0x7fc2f41010b0 msgr2=0x7fc2f410a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 shutdown_connections 2024-07-26T08:31:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:26.613+0000 7fc2f9200640 1 -- 172.21.15.43:0/3620811035 wait complete. 2024-07-26T08:31:26.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:26 smithi133 ceph-mon[37053]: pgmap v433: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:27.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:27 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3620811035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:27.617 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:27 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3620811035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:27.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:31:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:27 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3620811035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:28.205 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:28.543 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:28 smithi043 ceph-mon[32384]: pgmap v434: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:28.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:28 smithi063 ceph-mon[36747]: pgmap v434: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:28.666 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:28 smithi133 ceph-mon[37053]: pgmap v434: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:30.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:30 smithi043 ceph-mon[32384]: pgmap v435: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:30 smithi063 ceph-mon[36747]: pgmap v435: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:30.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.762+0000 7fa59d400640 1 -- 172.21.15.43:0/3933500781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5981141a0 msgr2=0x7fa5981165c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.762+0000 7fa59d400640 1 --2- 172.21.15.43:0/3933500781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5981141a0 0x7fa5981165c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa590009be0 tx=0x7fa59002a6c0 comp rx=0 tx=0).stop 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 -- 172.21.15.43:0/3933500781 shutdown_connections 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 --2- 172.21.15.43:0/3933500781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5981141a0 0x7fa5981165c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 --2- 172.21.15.43:0/3933500781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 0x7fa598113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 --2- 172.21.15.43:0/3933500781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa598077370 0x7fa598077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 -- 172.21.15.43:0/3933500781 >> 172.21.15.43:0/3933500781 conn(0x7fa5981011f0 msgr2=0x7fa598103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 -- 172.21.15.43:0/3933500781 shutdown_connections 2024-07-26T08:31:30.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.763+0000 7fa59d400640 1 -- 172.21.15.43:0/3933500781 wait complete. 2024-07-26T08:31:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:30 smithi133 ceph-mon[37053]: pgmap v435: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.764+0000 7fa59d400640 1 Processor -- start 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.764+0000 7fa59d400640 1 -- start start 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa59d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 0x7fa5981a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa59d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 0x7fa5981a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa59d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5981141a0 0x7fa5981a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa59d400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa598119c40 con 0x7fa598077cc0 2024-07-26T08:31:30.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa59d400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa598119ac0 con 0x7fa5981141a0 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa59d400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa598119dc0 con 0x7fa598077370 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa595e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 0x7fa5981a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa596800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 0x7fa5981a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa595e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 0x7fa5981a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46508/0 (socket says 172.21.15.43:46508) 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa595e00640 1 -- 172.21.15.43:0/3635008172 learned_addr learned my addr 172.21.15.43:0/3635008172 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa596800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 0x7fa5981a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:55066/0 (socket says 172.21.15.43:55066) 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.765+0000 7fa597200640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5981141a0 0x7fa5981a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa596800640 1 -- 172.21.15.43:0/3635008172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5981141a0 msgr2=0x7fa5981a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa596800640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5981141a0 0x7fa5981a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa596800640 1 -- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 msgr2=0x7fa5981a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa596800640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 0x7fa5981a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa596800640 1 -- 172.21.15.43:0/3635008172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5981a64e0 con 0x7fa598077370 2024-07-26T08:31:30.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa596800640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 0x7fa5981a0570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58800e9f0 tx=0x7fa58800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:30.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58800ccc0 con 0x7fa598077370 2024-07-26T08:31:30.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa588010900 con 0x7fa598077370 2024-07-26T08:31:30.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588018920 con 0x7fa598077370 2024-07-26T08:31:30.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.766+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5981a67d0 con 0x7fa598077370 2024-07-26T08:31:30.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.767+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5981acf30 con 0x7fa598077370 2024-07-26T08:31:30.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.768+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa598077780 con 0x7fa598077370 2024-07-26T08:31:30.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.771+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fa588010ab0 con 0x7fa598077370 2024-07-26T08:31:30.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.772+0000 7fa58f400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa57c0b3c20 0x7fa57c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:30.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.772+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fa5880e4470 con 0x7fa598077370 2024-07-26T08:31:30.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.772+0000 7fa595e00640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa57c0b3c20 0x7fa57c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:30.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.773+0000 7fa595e00640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa57c0b3c20 0x7fa57c0b6130 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa598079c80 tx=0x7fa584009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:30.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:30.776+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa5880aaf50 con 0x7fa598077370 2024-07-26T08:31:31.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.025+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa59802e0c0 con 0x7fa598077370 2024-07-26T08:31:31.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.026+0000 7fa58f400640 1 -- 172.21.15.43:0/3635008172 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11895 (secure 0 0 0) 0x7fa5880af4a0 con 0x7fa598077370 2024-07-26T08:31:31.028 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:31.028 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"btime":"2024-07-26T08:29:08:768082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:29:08.612953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24709,24710,24733]},"id":1}]} 2024-07-26T08:31:31.028 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.029+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa57c0b3c20 msgr2=0x7fa57c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.029+0000 7fa59d400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa57c0b3c20 0x7fa57c0b6130 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa598079c80 tx=0x7fa584009260 comp rx=0 tx=0).stop 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.029+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 msgr2=0x7fa5981a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.029+0000 7fa59d400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 0x7fa5981a0570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58800e9f0 tx=0x7fa58800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.029+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 shutdown_connections 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.029+0000 7fa59d400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa57c0b3c20 0x7fa57c0b6130 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.030+0000 7fa59d400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5981141a0 0x7fa5981a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:31.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.030+0000 7fa59d400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa598077cc0 0x7fa5981a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:31.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.030+0000 7fa59d400640 1 --2- 172.21.15.43:0/3635008172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa598077370 0x7fa5981a0570 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:31.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.030+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 >> 172.21.15.43:0/3635008172 conn(0x7fa5981011f0 msgr2=0x7fa598103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:31.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.030+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 shutdown_connections 2024-07-26T08:31:31.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:31.030+0000 7fa59d400640 1 -- 172.21.15.43:0/3635008172 wait complete. 2024-07-26T08:31:31.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:31 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3635008172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:31 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3635008172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:31 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3635008172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:31.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:31:32.406 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:32 smithi063 ceph-mon[36747]: pgmap v436: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:32.588 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:32 smithi043 ceph-mon[32384]: pgmap v436: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:32 smithi133 ceph-mon[37053]: pgmap v436: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:34.519 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:34 smithi043 ceph-mon[32384]: pgmap v437: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:34.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:34 smithi063 ceph-mon[36747]: pgmap v437: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:34 smithi133 ceph-mon[37053]: pgmap v437: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:34.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 -- 172.21.15.43:0/3898074725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30075800 msgr2=0x7f4b30075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:34.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 --2- 172.21.15.43:0/3898074725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30075800 0x7f4b30075c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009900 tx=0x7f4b1c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:31:34.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 -- 172.21.15.43:0/3898074725 shutdown_connections 2024-07-26T08:31:34.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 --2- 172.21.15.43:0/3898074725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30075800 0x7f4b30075c10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:34.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 --2- 172.21.15.43:0/3898074725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30113c90 0x7f4b30116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:34.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 --2- 172.21.15.43:0/3898074725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b30076db0 0x7f4b300751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:34.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 -- 172.21.15.43:0/3898074725 >> 172.21.15.43:0/3898074725 conn(0x7f4b300fee10 msgr2=0x7f4b30101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:34.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 -- 172.21.15.43:0/3898074725 shutdown_connections 2024-07-26T08:31:34.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.833+0000 7f4b36000640 1 -- 172.21.15.43:0/3898074725 wait complete. 2024-07-26T08:31:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 Processor -- start 2024-07-26T08:31:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 -- start start 2024-07-26T08:31:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 0x7f4b301a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30076db0 0x7f4b301a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b30113c90 0x7f4b301a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301199d0 con 0x7f4b30075800 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30119850 con 0x7f4b30113c90 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.835+0000 7f4b36000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30119b50 con 0x7f4b30076db0 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b34c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 0x7f4b301a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b2fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30076db0 0x7f4b301a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b35600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b30113c90 0x7f4b301a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b34c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 0x7f4b301a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46526/0 (socket says 172.21.15.43:46526) 2024-07-26T08:31:34.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b34c00640 1 -- 172.21.15.43:0/3176338697 learned_addr learned my addr 172.21.15.43:0/3176338697 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:34.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b2fe00640 1 -- 172.21.15.43:0/3176338697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b30113c90 msgr2=0x7f4b301a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:34.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b2fe00640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b30113c90 0x7f4b301a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:34.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b2fe00640 1 -- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 msgr2=0x7f4b301a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b2fe00640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 0x7f4b301a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b2fe00640 1 -- 172.21.15.43:0/3176338697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301a6350 con 0x7f4b30076db0 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.836+0000 7f4b34c00640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 0x7f4b301a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.837+0000 7f4b2fe00640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30076db0 0x7f4b301a0980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006010 tx=0x7f4b1c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.837+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c03f030 con 0x7f4b30076db0 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.837+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b301a65e0 con 0x7f4b30076db0 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.837+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b1c004440 con 0x7f4b30076db0 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.837+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c035070 con 0x7f4b30076db0 2024-07-26T08:31:34.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.837+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b301acda0 con 0x7f4b30076db0 2024-07-26T08:31:34.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.839+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b30075c10 con 0x7f4b30076db0 2024-07-26T08:31:34.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.841+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f4b1c042030 con 0x7f4b30076db0 2024-07-26T08:31:34.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.843+0000 7f4b2d600640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4b140b3c20 0x7f4b140b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:34.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.843+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f4b1c104660 con 0x7f4b30076db0 2024-07-26T08:31:34.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.843+0000 7f4b34c00640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4b140b3c20 0x7f4b140b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:34.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.844+0000 7f4b34c00640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4b140b3c20 0x7f4b140b6130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b20011550 tx=0x7f4b20005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:34.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:34.845+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f4b1c0cb790 con 0x7f4b30076db0 2024-07-26T08:31:35.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.049+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b301a1510 con 0x7f4b30076db0 2024-07-26T08:31:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.051+0000 7f4b2d600640 1 -- 172.21.15.43:0/3176338697 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7f4b1c0cb090 con 0x7f4b30076db0 2024-07-26T08:31:35.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:35.053 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:31:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4b140b3c20 msgr2=0x7f4b140b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4b140b3c20 0x7f4b140b6130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b20011550 tx=0x7f4b20005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30076db0 msgr2=0x7f4b301a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30076db0 0x7f4b301a0980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006010 tx=0x7f4b1c004040 comp rx=0 tx=0).stop 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 shutdown_connections 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4b140b3c20 0x7f4b140b6130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30076db0 0x7f4b301a0980 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b30113c90 0x7f4b301a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 --2- 172.21.15.43:0/3176338697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b30075800 0x7f4b301a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.054+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 >> 172.21.15.43:0/3176338697 conn(0x7f4b300fee10 msgr2=0x7f4b3010fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.055+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 shutdown_connections 2024-07-26T08:31:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:35.055+0000 7f4b36000640 1 -- 172.21.15.43:0/3176338697 wait complete. 2024-07-26T08:31:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:35 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3176338697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:31:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:35 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3176338697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:31:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:35 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3176338697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:31:36.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:31:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:36.678 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:36 smithi043 ceph-mon[32384]: pgmap v438: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:36 smithi133 ceph-mon[37053]: pgmap v438: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:36 smithi063 ceph-mon[36747]: pgmap v438: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:38.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:38 smithi043 ceph-mon[32384]: pgmap v439: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:38.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:31:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:38 smithi133 ceph-mon[37053]: pgmap v439: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:31:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:38 smithi063 ceph-mon[36747]: pgmap v439: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:31:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.990+0000 7fec7de00640 1 -- 172.21.15.43:0/559562266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78103590 msgr2=0x7fec781039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.990+0000 7fec7de00640 1 --2- 172.21.15.43:0/559562266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78103590 0x7fec781039a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec68009900 tx=0x7fec6802a410 comp rx=0 tx=0).stop 2024-07-26T08:31:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 -- 172.21.15.43:0/559562266 shutdown_connections 2024-07-26T08:31:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 --2- 172.21.15.43:0/559562266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec78109820 0x7fec78110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 --2- 172.21.15.43:0/559562266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78108ed0 0x7fec781092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 --2- 172.21.15.43:0/559562266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78103590 0x7fec781039a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 -- 172.21.15.43:0/559562266 >> 172.21.15.43:0/559562266 conn(0x7fec7807b280 msgr2=0x7fec7807b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 -- 172.21.15.43:0/559562266 shutdown_connections 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.991+0000 7fec7de00640 1 -- 172.21.15.43:0/559562266 wait complete. 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.992+0000 7fec7de00640 1 Processor -- start 2024-07-26T08:31:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.992+0000 7fec7de00640 1 -- start start 2024-07-26T08:31:38.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec7de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 0x7fec78199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:38.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec7de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec78108ed0 0x7fec7819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:38.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec7de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78109820 0x7fec7819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:38.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec7de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fec78113650 con 0x7fec78109820 2024-07-26T08:31:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec7de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fec781134d0 con 0x7fec78103590 2024-07-26T08:31:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec7de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fec781137d0 con 0x7fec78108ed0 2024-07-26T08:31:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec76a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 0x7fec78199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec76a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 0x7fec78199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56334/0 (socket says 172.21.15.43:56334) 2024-07-26T08:31:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec76a00640 1 -- 172.21.15.43:0/1765249282 learned_addr learned my addr 172.21.15.43:0/1765249282 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec6fe00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec78108ed0 0x7fec7819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.993+0000 7fec77400640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78109820 0x7fec7819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec76a00640 1 -- 172.21.15.43:0/1765249282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec78108ed0 msgr2=0x7fec7819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec76a00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec78108ed0 0x7fec7819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec76a00640 1 -- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78109820 msgr2=0x7fec7819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec76a00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78109820 0x7fec7819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec76a00640 1 -- 172.21.15.43:0/1765249282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7819ff30 con 0x7fec78103590 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec76a00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 0x7fec78199fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec680314b0 tx=0x7fec68003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6803f070 con 0x7fec78103590 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fec68031bf0 con 0x7fec78103590 2024-07-26T08:31:38.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68035030 con 0x7fec78103590 2024-07-26T08:31:38.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.994+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781a01c0 con 0x7fec78103590 2024-07-26T08:31:38.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.995+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781a6980 con 0x7fec78103590 2024-07-26T08:31:38.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.996+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec78104810 con 0x7fec78103590 2024-07-26T08:31:38.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:38.998+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fec68042070 con 0x7fec78103590 2024-07-26T08:31:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.001+0000 7fec7ca00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fec580b3ca0 0x7fec580b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.001+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fec681044c0 con 0x7fec78103590 2024-07-26T08:31:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.001+0000 7fec6fe00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fec580b3ca0 0x7fec580b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:39.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.002+0000 7fec6fe00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fec580b3ca0 0x7fec580b61b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec78108bc0 tx=0x7fec60005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.003+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fec68031da0 con 0x7fec78103590 2024-07-26T08:31:39.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.253+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec7810b5f0 con 0x7fec78103590 2024-07-26T08:31:39.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.254+0000 7fec7ca00640 1 -- 172.21.15.43:0/1765249282 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11895 (secure 0 0 0) 0x7fec680cb5f0 con 0x7fec78103590 2024-07-26T08:31:39.256 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:31:39.256 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"btime":"2024-07-26T08:29:08:768082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:29:08.612953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24709,24710,24733]},"id":1}]} 2024-07-26T08:31:39.256 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:31:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.258+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fec580b3ca0 msgr2=0x7fec580b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.258+0000 7fec7de00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fec580b3ca0 0x7fec580b61b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec78108bc0 tx=0x7fec60005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.258+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 msgr2=0x7fec78199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.258+0000 7fec7de00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 0x7fec78199fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec680314b0 tx=0x7fec68003c10 comp rx=0 tx=0).stop 2024-07-26T08:31:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 shutdown_connections 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fec580b3ca0 0x7fec580b61b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec78108ed0 0x7fec7819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec78109820 0x7fec7819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 --2- 172.21.15.43:0/1765249282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec78103590 0x7fec78199fc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 >> 172.21.15.43:0/1765249282 conn(0x7fec7807b280 msgr2=0x7fec78106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 shutdown_connections 2024-07-26T08:31:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:39.259+0000 7fec7de00640 1 -- 172.21.15.43:0/1765249282 wait complete. 2024-07-26T08:31:39.648 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:39 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1765249282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:39.649 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:31:39.649 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:31:39.649 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:31:39.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:39 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1765249282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:31:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:31:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:31:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:39 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1765249282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:31:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:31:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:31:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:31:40.191 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-26T08:27:37.509952+0000', 'modified': '2024-07-26T08:29:08.612953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24733, 'mds_1': 24710, 'mds_2': 24709}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24685': {'gid': 24685, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/1306232427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1306232427}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1306232427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'g', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/2240411764', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 2240411764}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 2240411764}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24697': {'gid': 24697, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6837/2370435591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2370435591}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2370435591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24709': {'gid': 24709, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.133:6839/475376324', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 475376324}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 475376324}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24710': {'gid': 24710, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 28, 'addr': '172.21.15.63:6839/3045590383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6838', 'nonce': 3045590383}, {'type': 'v1', 'addr': '172.21.15.63:6839', 'nonce': 3045590383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24733': {'gid': 24733, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6841/445875183', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6840', 'nonce': 445875183}, {'type': 'v1', 'addr': '172.21.15.43:6841', 'nonce': 445875183}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24733, 'qdb_cluster': [24709, 24710, 24733]} 2024-07-26T08:31:40.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-07-26T08:31:40.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.i status 2024-07-26T08:31:40.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:40 smithi043 ceph-mon[32384]: pgmap v440: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:40.708 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:40 smithi133 ceph-mon[37053]: pgmap v440: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:40.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:40 smithi063 ceph-mon[36747]: pgmap v440: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:42.729 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:42 smithi043 ceph-mon[32384]: pgmap v441: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:42 smithi133 ceph-mon[37053]: pgmap v441: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:42 smithi063 ceph-mon[36747]: pgmap v441: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:43.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 -- 172.21.15.43:0/2020244976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b410fc80 msgr2=0x7f70b41164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 --2- 172.21.15.43:0/2020244976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b410fc80 0x7f70b41164b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009ca0 tx=0x7f70ac02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 -- 172.21.15.43:0/2020244976 shutdown_connections 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 --2- 172.21.15.43:0/2020244976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b410fc80 0x7f70b41164b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 --2- 172.21.15.43:0/2020244976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b410f330 0x7f70b410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 --2- 172.21.15.43:0/2020244976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b41099f0 0x7f70b4109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.326+0000 7f70b9200640 1 -- 172.21.15.43:0/2020244976 >> 172.21.15.43:0/2020244976 conn(0x7f70b4078ff0 msgr2=0x7f70b4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.327+0000 7f70b9200640 1 -- 172.21.15.43:0/2020244976 shutdown_connections 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.327+0000 7f70b9200640 1 -- 172.21.15.43:0/2020244976 wait complete. 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 Processor -- start 2024-07-26T08:31:43.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 -- start start 2024-07-26T08:31:43.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 0x7f70b41a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b410f330 0x7f70b41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b410fc80 0x7f70b41a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f70b4119ad0 con 0x7f70b41099f0 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f70b4119950 con 0x7f70b410fc80 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.328+0000 7f70b9200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f70b4119c50 con 0x7f70b410f330 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 0x7f70b41a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b410f330 0x7f70b41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b410fc80 0x7f70b41a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 0x7f70b41a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36192/0 (socket says 172.21.15.43:36192) 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b3400640 1 -- 172.21.15.43:0/387637938 learned_addr learned my addr 172.21.15.43:0/387637938 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b2a00640 1 -- 172.21.15.43:0/387637938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b410fc80 msgr2=0x7f70b41a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b2a00640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b410fc80 0x7f70b41a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b2a00640 1 -- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 msgr2=0x7f70b41a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b2a00640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 0x7f70b41a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b2a00640 1 -- 172.21.15.43:0/387637938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b41a62f0 con 0x7f70b410f330 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.329+0000 7f70b3400640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 0x7f70b41a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.330+0000 7f70b2a00640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b410f330 0x7f70b41a0920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70b406c270 tx=0x7f70a000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.330+0000 7f70abe00640 1 -- 172.21.15.43:0/387637938 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a000cc40 con 0x7f70b410f330 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.330+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b41a65e0 con 0x7f70b410f330 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.330+0000 7f70abe00640 1 -- 172.21.15.43:0/387637938 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70a000cde0 con 0x7f70b410f330 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.330+0000 7f70abe00640 1 -- 172.21.15.43:0/387637938 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0018820 con 0x7f70b410f330 2024-07-26T08:31:43.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.330+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b41acd40 con 0x7f70b410f330 2024-07-26T08:31:43.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 Processor -- start 2024-07-26T08:31:43.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 -- start start 2024-07-26T08:31:43.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70abe00640 1 -- 172.21.15.43:0/387637938 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f70a0010b40 con 0x7f70b410f330 2024-07-26T08:31:43.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e69f60 0x559fb320f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb320fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559fb3185950 con 0x559fb2e410a0 2024-07-26T08:31:43.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559fb3174e50 con 0x559fb2e69f60 2024-07-26T08:31:43.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.334+0000 7f70c13e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559fb3178e90 con 0x559fb2e49280 2024-07-26T08:31:43.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e69f60 0x559fb320f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e69f60 0x559fb320f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56368/0 (socket says 172.21.15.43:56368) 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3e00640 1 -- 172.21.15.43:0/819987748 learned_addr learned my addr 172.21.15.43:0/819987748 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb320fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b2a00640 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3400640 1 -- 172.21.15.43:0/819987748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 msgr2=0x559fb32101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3400640 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32101e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3400640 1 -- 172.21.15.43:0/819987748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e69f60 msgr2=0x559fb320f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3400640 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e69f60 0x559fb320f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.335+0000 7f70b3400640 1 -- 172.21.15.43:0/819987748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb311c0f0 con 0x559fb2e410a0 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.336+0000 7f70b3400640 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb320fca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f70a4011510 tx=0x7f70a40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625898e5c3db4ff6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.336+0000 7f70a8c00640 1 -- 172.21.15.43:0/819987748 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a401e070 con 0x559fb2e410a0 2024-07-26T08:31:43.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.336+0000 7f70a8c00640 1 -- 172.21.15.43:0/819987748 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70a400fa90 con 0x559fb2e410a0 2024-07-26T08:31:43.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.336+0000 7f70a8c00640 1 -- 172.21.15.43:0/819987748 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4019c70 con 0x559fb2e410a0 2024-07-26T08:31:43.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.336+0000 7f70abe00640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70980b3ca0 0x7f70980b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70abe00640 1 -- 172.21.15.43:0/387637938 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f70a00e4410 con 0x7f70b410f330 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70b3e00640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70980b3ca0 0x7f70980b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 -- 172.21.15.43:0/819987748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 msgr2=0x559fb320fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb320fca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f70a4011510 tx=0x7f70a40119d0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 -- 172.21.15.43:0/819987748 shutdown_connections 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb320fca0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 --2- 172.21.15.43:0/819987748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e69f60 0x559fb320f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.337+0000 7f70c13e0740 1 -- 172.21.15.43:0/819987748 >> 172.21.15.43:0/819987748 conn(0x559fb2e5e350 msgr2=0x559fb320d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:43.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.338+0000 7f70b3e00640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70980b3ca0 0x7f70980b61b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009a60 tx=0x7f70ac005d80 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:43.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.338+0000 7f70c13e0740 1 -- 172.21.15.43:0/819987748 shutdown_connections 2024-07-26T08:31:43.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.338+0000 7f70c13e0740 1 -- 172.21.15.43:0/819987748 wait complete. 2024-07-26T08:31:43.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.338+0000 7f70c13e0740 1 -- start start 2024-07-26T08:31:43.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 Processor -- start 2024-07-26T08:31:43.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb321b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb3227230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559fb2fd85f0 con 0x559fb2e69f60 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559fb3111520 con 0x559fb2e410a0 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559fb321df40 con 0x559fb2e49280 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70c13e0740 10 client.0 _ll_register_callbacks cb 0x559fb3120ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70b3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70b3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb3227230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70b3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56370/0 (socket says 172.21.15.43:56370) 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.339+0000 7f70b3400640 1 -- 172.21.15.43:0/1600934256 learned_addr learned my addr 172.21.15.43:0/1600934256 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b2a00640 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb321b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b3400640 1 -- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 msgr2=0x559fb321b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b3400640 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb321b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b3400640 1 -- 172.21.15.43:0/1600934256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 msgr2=0x559fb3227230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b3400640 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb3227230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b3400640 1 -- 172.21.15.43:0/1600934256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb2ed5540 con 0x559fb2e410a0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f70b3400640 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321b290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70a4019850 tx=0x7f70a400fe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9265aaedd7dd9482 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.340+0000 7f709d600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.341+0000 7f709d600640 1 -- 172.21.15.43:0/1600934256 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a401e070 con 0x559fb2e410a0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.341+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a400fa90 con 0x559fb2e410a0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.341+0000 7f709d600640 1 -- 172.21.15.43:0/1600934256 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f70a400f7d0 con 0x559fb2e410a0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.341+0000 7f709d600640 1 -- 172.21.15.43:0/1600934256 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f70a4031050 con 0x559fb2e410a0 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.341+0000 7f70c13e0740 10 client.25160 fetch_fsmap learned FSMap version 24 2024-07-26T08:31:43.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.341+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559fb3229e60 con 0x559fb2e410a0 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f709d600640 1 -- 172.21.15.43:0/1600934256 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70a400fa90 con 0x559fb2e410a0 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f709d600640 1 -- 172.21.15.43:0/1600934256 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f70a4004750 con 0x559fb2e410a0 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f70c13e0740 10 client.25160 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f70c13e0740 10 client.25160 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f70c13e0740 20 client.25160 populate_metadata read hostname 'smithi043' 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f70c13e0740 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2e288e0 0x559fb322d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f70c13e0740 4 client.25160 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:31:43.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.342+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fb31878a0 con 0x559fb2e288e0 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.343+0000 7f70b2a00640 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2e288e0 0x559fb322d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.343+0000 7f70b2a00640 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2e288e0 0x559fb322d6a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e69b90f4443825d server_cookie=7c0dad0f5b84bc79 in_seq=0 out_seq=0 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.343+0000 7f709d600640 10 client.25160 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.344+0000 7f709d600640 1 -- 172.21.15.43:0/1600934256 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fb31878a0 con 0x559fb2e288e0 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.344+0000 7f709d600640 10 client.25160 handle_command_reply: tid=0 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.344+0000 7f70c13e0740 1 client.25160 shutdown 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.344+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 msgr2=0x559fb321b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.344+0000 7f70c13e0740 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321b290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70a4019850 tx=0x7f70a400fe70 comp rx=0 tx=0).stop 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 shutdown_connections 2024-07-26T08:31:43.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2e288e0 0x559fb322d6a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb321b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb3227230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 --2- 172.21.15.43:0/1600934256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321b290 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 >> 172.21.15.43:0/1600934256 conn(0x559fb2e5e350 msgr2=0x559fb3212940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f709d600640 0 client.25160 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 shutdown_connections 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 1 -- 172.21.15.43:0/1600934256 wait complete. 2024-07-26T08:31:43.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.345+0000 7f70c13e0740 20 client.25160 trim_cache size 0 max 16384 2024-07-26T08:31:43.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 Processor -- start 2024-07-26T08:31:43.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 -- start start 2024-07-26T08:31:43.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32271a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb32276e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559fb322b9e0 con 0x559fb2e69f60 2024-07-26T08:31:43.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559fb322c0b0 con 0x559fb2e410a0 2024-07-26T08:31:43.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.366+0000 7f70c13e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559fb322c780 con 0x559fb2e49280 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb32276e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb32276e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36208/0 (socket says 172.21.15.43:36208) 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 -- 172.21.15.43:0/2160985455 learned_addr learned my addr 172.21.15.43:0/2160985455 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b2a00640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3400640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 -- 172.21.15.43:0/2160985455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 msgr2=0x559fb32271a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32271a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 -- 172.21.15.43:0/2160985455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 msgr2=0x559fb321bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3e00640 1 -- 172.21.15.43:0/2160985455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb32087d0 con 0x559fb2e69f60 2024-07-26T08:31:43.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b2a00640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32271a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:43.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.367+0000 7f70b3400640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:43.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.368+0000 7f70b3e00640 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb32276e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f70ac02aeb0 tx=0x7f70ac041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0471694955489b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:43.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.368+0000 7f709fe00640 1 -- 172.21.15.43:0/2160985455 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac003cb0 con 0x559fb2e69f60 2024-07-26T08:31:43.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.368+0000 7f709fe00640 1 -- 172.21.15.43:0/2160985455 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70ac036050 con 0x559fb2e69f60 2024-07-26T08:31:43.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.368+0000 7f709fe00640 1 -- 172.21.15.43:0/2160985455 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac004710 con 0x559fb2e69f60 2024-07-26T08:31:43.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 -- 172.21.15.43:0/2160985455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 msgr2=0x559fb32276e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb32276e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f70ac02aeb0 tx=0x7f70ac041000 comp rx=0 tx=0).stop 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 -- 172.21.15.43:0/2160985455 shutdown_connections 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e49280 0x559fb32271a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e69f60 0x559fb32276e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 --2- 172.21.15.43:0/2160985455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e410a0 0x559fb321bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.369+0000 7f70c13e0740 1 -- 172.21.15.43:0/2160985455 >> 172.21.15.43:0/2160985455 conn(0x559fb2e5e350 msgr2=0x559fb322b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.370+0000 7f70c13e0740 1 -- 172.21.15.43:0/2160985455 shutdown_connections 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.370+0000 7f70c13e0740 1 -- 172.21.15.43:0/2160985455 wait complete. 2024-07-26T08:31:43.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.370+0000 7f70c13e0740 1 -- start start 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.370+0000 7f70c13e0740 1 Processor -- start 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb3236030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e49280 0x559fb32304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e69f60 0x559fb3230a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559fb322d520 con 0x559fb2e410a0 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559fb322ce50 con 0x559fb2e49280 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559fb322dbf0 con 0x559fb2e69f60 2024-07-26T08:31:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70c13e0740 10 client.0 _ll_register_callbacks cb 0x7f70a00e7d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70b3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb3236030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70b3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb3236030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36220/0 (socket says 172.21.15.43:36220) 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.371+0000 7f70b3400640 1 -- 172.21.15.43:0/4202026276 learned_addr learned my addr 172.21.15.43:0/4202026276 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e49280 0x559fb32304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b3e00640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e69f60 0x559fb3230a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 -- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e69f60 msgr2=0x559fb3230a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e69f60 0x559fb3230a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 -- 172.21.15.43:0/4202026276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 msgr2=0x559fb3236030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb3236030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 -- 172.21.15.43:0/4202026276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb32311a0 con 0x559fb2e49280 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b3400640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb3236030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f70b2a00640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e49280 0x559fb32304d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c6a0 tx=0x7f70a00e7e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a6a76fa7db73c9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f709d600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.372+0000 7f709d600640 1 -- 172.21.15.43:0/4202026276 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a00b3ef0 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ac036050 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f709d600640 1 -- 172.21.15.43:0/4202026276 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f70a00a7180 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f709d600640 1 -- 172.21.15.43:0/4202026276 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f70a00aa150 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 10 client.25166 fetch_fsmap learned FSMap version 24 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559fb3295880 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f709d600640 1 -- 172.21.15.43:0/4202026276 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70ac036050 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f709d600640 1 -- 172.21.15.43:0/4202026276 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f70a00a9df0 con 0x559fb2e49280 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 10 client.25166 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 10 client.25166 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 20 client.25166 populate_metadata read hostname 'smithi043' 2024-07-26T08:31:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2dfdc90 0x559fb32990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 4 client.25166 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:31:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.373+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "status"}) -- 0x559fb3183340 con 0x559fb2dfdc90 2024-07-26T08:31:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.374+0000 7f70b3400640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2dfdc90 0x559fb32990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.374+0000 7f70b3400640 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2dfdc90 0x559fb32990f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ad059fcfe48300 server_cookie=f0333424a27f8892 in_seq=0 out_seq=0 2024-07-26T08:31:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.374+0000 7f709d600640 10 client.25166 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:31:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f709d600640 1 -- 172.21.15.43:0/4202026276 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559fb3183340 con 0x559fb2dfdc90 2024-07-26T08:31:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f709d600640 10 client.25166 handle_command_reply: tid=0 2024-07-26T08:31:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 client.25166 shutdown 2024-07-26T08:31:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e49280 msgr2=0x559fb32304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e49280 0x559fb32304d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c6a0 tx=0x7f70a00e7e50 comp rx=0 tx=0).stop 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 shutdown_connections 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559fb2dfdc90 0x559fb32990f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559fb2e69f60 0x559fb3230a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559fb2e49280 0x559fb32304d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 --2- 172.21.15.43:0/4202026276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559fb2e410a0 0x559fb3236030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f709d600640 0 client.25166 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 >> 172.21.15.43:0/4202026276 conn(0x559fb2e5e350 msgr2=0x559fb322b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 shutdown_connections 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 1 -- 172.21.15.43:0/4202026276 wait complete. 2024-07-26T08:31:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.375+0000 7f70c13e0740 20 client.25166 trim_cache size 0 max 16384 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24709, 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 162.75733322100001, 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 90, 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 88, 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 282.946278855 2024-07-26T08:31:43.381 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:31:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70980b3ca0 msgr2=0x7f70980b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70980b3ca0 0x7f70980b61b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009a60 tx=0x7f70ac005d80 comp rx=0 tx=0).stop 2024-07-26T08:31:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b410f330 msgr2=0x7f70b41a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b410f330 0x7f70b41a0920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70b406c270 tx=0x7f70a000ee50 comp rx=0 tx=0).stop 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 shutdown_connections 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f70980b3ca0 0x7f70980b61b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70b410f330 0x7f70b41a0920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b410fc80 0x7f70b41a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 --2- 172.21.15.43:0/387637938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70b41099f0 0x7f70b41a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 >> 172.21.15.43:0/387637938 conn(0x7f70b4078ff0 msgr2=0x7f70b40795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.376+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 shutdown_connections 2024-07-26T08:31:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:43.377+0000 7f70b9200640 1 -- 172.21.15.43:0/387637938 wait complete. 2024-07-26T08:31:44.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.b status 2024-07-26T08:31:44.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:44 smithi043 ceph-mon[32384]: pgmap v442: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:44.701 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:44 smithi133 ceph-mon[37053]: pgmap v442: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:44.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:44 smithi063 ceph-mon[36747]: pgmap v442: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:46.603 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:46 smithi043 ceph-mon[32384]: pgmap v443: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:46.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:46 smithi063 ceph-mon[36747]: pgmap v443: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:46 smithi133 ceph-mon[37053]: pgmap v443: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:47.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 -- 172.21.15.43:0/3926370957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 msgr2=0x7efd641037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 --2- 172.21.15.43:0/3926370957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd641037d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd58009ca0 tx=0x7efd5802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 -- 172.21.15.43:0/3926370957 shutdown_connections 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 --2- 172.21.15.43:0/3926370957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd64109650 0x7efd6410fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 --2- 172.21.15.43:0/3926370957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 0x7efd64109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 --2- 172.21.15.43:0/3926370957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd641037d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.148+0000 7efd6a800640 1 -- 172.21.15.43:0/3926370957 >> 172.21.15.43:0/3926370957 conn(0x7efd640fee10 msgr2=0x7efd64101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.149+0000 7efd6a800640 1 -- 172.21.15.43:0/3926370957 shutdown_connections 2024-07-26T08:31:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.149+0000 7efd6a800640 1 -- 172.21.15.43:0/3926370957 wait complete. 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.150+0000 7efd6a800640 1 Processor -- start 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 -- start start 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd6419c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 0x7efd6419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd64109650 0x7efd641a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd64113450 con 0x7efd64108d00 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efd641132d0 con 0x7efd64109650 2024-07-26T08:31:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd6a800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efd641135d0 con 0x7efd641033c0 2024-07-26T08:31:47.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd69400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd6419c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd68a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 0x7efd6419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd69400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd6419c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51098/0 (socket says 172.21.15.43:51098) 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd69400640 1 -- 172.21.15.43:0/2144873739 learned_addr learned my addr 172.21.15.43:0/2144873739 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.151+0000 7efd69e00640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd64109650 0x7efd641a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd68a00640 1 -- 172.21.15.43:0/2144873739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 msgr2=0x7efd6419c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd68a00640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd6419c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd68a00640 1 -- 172.21.15.43:0/2144873739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd64109650 msgr2=0x7efd641a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd68a00640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd64109650 0x7efd641a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd68a00640 1 -- 172.21.15.43:0/2144873739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd641a1f70 con 0x7efd64108d00 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd69400640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd6419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.152+0000 7efd68a00640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 0x7efd6419c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd6406c240 tx=0x7efd5000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.153+0000 7efd62000640 1 -- 172.21.15.43:0/2144873739 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000cc40 con 0x7efd64108d00 2024-07-26T08:31:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.153+0000 7efd62000640 1 -- 172.21.15.43:0/2144873739 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd5000cde0 con 0x7efd64108d00 2024-07-26T08:31:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.153+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd641a2260 con 0x7efd64108d00 2024-07-26T08:31:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.153+0000 7efd62000640 1 -- 172.21.15.43:0/2144873739 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50018810 con 0x7efd64108d00 2024-07-26T08:31:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.153+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd641a89c0 con 0x7efd64108d00 2024-07-26T08:31:47.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 Processor -- start 2024-07-26T08:31:47.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd62000640 1 -- 172.21.15.43:0/2144873739 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7efd500189b0 con 0x7efd64108d00 2024-07-26T08:31:47.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 -- start start 2024-07-26T08:31:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca69f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca69fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d9280 0x5563ca6a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5563ca615970 con 0x5563ca2d9280 2024-07-26T08:31:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5563ca604e70 con 0x5563ca2f9f60 2024-07-26T08:31:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.157+0000 7efd72a60740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5563ca608eb0 con 0x5563ca2d10a0 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca69f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca69f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:57650/0 (socket says 172.21.15.43:57650) 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd68a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d9280 0x5563ca6a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 -- 172.21.15.43:0/2680330233 learned_addr learned my addr 172.21.15.43:0/2680330233 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69400640 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca69fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 -- 172.21.15.43:0/2680330233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 msgr2=0x5563ca69fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca69fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 -- 172.21.15.43:0/2680330233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d9280 msgr2=0x5563ca6a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d9280 0x5563ca6a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.158+0000 7efd69e00640 1 -- 172.21.15.43:0/2680330233 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ca5ac110 con 0x5563ca2f9f60 2024-07-26T08:31:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.159+0000 7efd69e00640 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca69f780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009ca0 tx=0x7efd5c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=296aa52c8b5a3225 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:47.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.159+0000 7efd56600640 1 -- 172.21.15.43:0/2680330233 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c01e070 con 0x5563ca2f9f60 2024-07-26T08:31:47.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.159+0000 7efd56600640 1 -- 172.21.15.43:0/2680330233 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd5c009e50 con 0x5563ca2f9f60 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.159+0000 7efd56600640 1 -- 172.21.15.43:0/2680330233 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00eaa0 con 0x5563ca2f9f60 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.159+0000 7efd62000640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efd4c0b3c20 0x7efd4c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd62000640 1 -- 172.21.15.43:0/2144873739 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7efd500e42c0 con 0x7efd64108d00 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd69400640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efd4c0b3c20 0x7efd4c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 -- 172.21.15.43:0/2680330233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 msgr2=0x5563ca69f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca69f780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009ca0 tx=0x7efd5c011810 comp rx=0 tx=0).stop 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 -- 172.21.15.43:0/2680330233 shutdown_connections 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca69fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d9280 0x5563ca6a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 --2- 172.21.15.43:0/2680330233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca69f780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 -- 172.21.15.43:0/2680330233 >> 172.21.15.43:0/2680330233 conn(0x5563ca2ee350 msgr2=0x5563ca69d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:47.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.160+0000 7efd72a60740 1 -- 172.21.15.43:0/2680330233 shutdown_connections 2024-07-26T08:31:47.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.161+0000 7efd72a60740 1 -- 172.21.15.43:0/2680330233 wait complete. 2024-07-26T08:31:47.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.161+0000 7efd69400640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efd4c0b3c20 0x7efd4c0b6130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd580094e0 tx=0x7efd58033000 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.161+0000 7efd72a60740 1 -- start start 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.161+0000 7efd72a60740 1 Processor -- start 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d9280 0x5563ca6ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca6b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5563ca4685f0 con 0x5563ca2d10a0 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5563ca5a1540 con 0x5563ca2f9f60 2024-07-26T08:31:47.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6adf60 con 0x5563ca2d9280 2024-07-26T08:31:47.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd72a60740 10 client.0 _ll_register_callbacks cb 0x5563ca5b0f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:31:47.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd69400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd69400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6aafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47062/0 (socket says 172.21.15.43:47062) 2024-07-26T08:31:47.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd69400640 1 -- 172.21.15.43:0/839929002 learned_addr learned my addr 172.21.15.43:0/839929002 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.162+0000 7efd68a00640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d9280 0x5563ca6ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd69e00640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca6b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd68a00640 1 -- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 msgr2=0x5563ca6b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd68a00640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca6b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd68a00640 1 -- 172.21.15.43:0/839929002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 msgr2=0x5563ca6aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd68a00640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd68a00640 1 -- 172.21.15.43:0/839929002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ca365540 con 0x5563ca2d9280 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd69e00640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca6b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd68a00640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d9280 0x5563ca6ab550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd500aad30 tx=0x7efd50018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfdf73f7eef2d367 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.163+0000 7efd4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd4aa00640 1 -- 172.21.15.43:0/839929002 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500aa510 con 0x5563ca2d9280 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd4aa00640 1 -- 172.21.15.43:0/839929002 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7efd500aa000 con 0x5563ca2d9280 2024-07-26T08:31:47.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd5c009e50 con 0x5563ca2d9280 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd4aa00640 1 -- 172.21.15.43:0/839929002 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efd500aa8b0 con 0x5563ca2d9280 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd72a60740 10 client.25207 fetch_fsmap learned FSMap version 24 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5563ca6b9e50 con 0x5563ca2d9280 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd4aa00640 1 -- 172.21.15.43:0/839929002 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd5c009e50 con 0x5563ca2d9280 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.164+0000 7efd4aa00640 1 -- 172.21.15.43:0/839929002 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7efd500a9a70 con 0x5563ca2d9280 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd72a60740 10 client.25207 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd72a60740 10 client.25207 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd72a60740 20 client.25207 populate_metadata read hostname 'smithi043' 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd72a60740 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca2b88e0 0x5563ca6bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd72a60740 4 client.25207 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ca6178c0 con 0x5563ca2b88e0 2024-07-26T08:31:47.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.165+0000 7efd69400640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca2b88e0 0x5563ca6bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.166+0000 7efd69400640 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca2b88e0 0x5563ca6bd940 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=884fec88cd269052 server_cookie=ee3b9b24dda28e33 in_seq=0 out_seq=0 2024-07-26T08:31:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.166+0000 7efd4aa00640 10 client.25207 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:31:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd4aa00640 1 -- 172.21.15.43:0/839929002 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563ca6178c0 con 0x5563ca2b88e0 2024-07-26T08:31:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd4aa00640 10 client.25207 handle_command_reply: tid=0 2024-07-26T08:31:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 client.25207 shutdown 2024-07-26T08:31:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d9280 msgr2=0x5563ca6ab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d9280 0x5563ca6ab550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd500aad30 tx=0x7efd50018420 comp rx=0 tx=0).stop 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 shutdown_connections 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d9280 0x5563ca6ab550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca2b88e0 0x5563ca6bd940 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2f9f60 0x5563ca6b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 --2- 172.21.15.43:0/839929002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd4aa00640 0 client.25207 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.167+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 >> 172.21.15.43:0/839929002 conn(0x5563ca2ee350 msgr2=0x5563ca6a2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.168+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 shutdown_connections 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.168+0000 7efd72a60740 1 -- 172.21.15.43:0/839929002 wait complete. 2024-07-26T08:31:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.168+0000 7efd72a60740 20 client.25207 trim_cache size 0 max 16384 2024-07-26T08:31:47.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 Processor -- start 2024-07-26T08:31:47.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 -- start start 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca6b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 0x5563ca6a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6bbc80 con 0x5563ca2f9f60 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6bc350 con 0x5563ca2d9280 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.188+0000 7efd72a60740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6bca20 con 0x5563ca2d10a0 2024-07-26T08:31:47.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd69e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 0x5563ca6a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd69e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 0x5563ca6a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47066/0 (socket says 172.21.15.43:47066) 2024-07-26T08:31:47.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd69e00640 1 -- 172.21.15.43:0/3577604827 learned_addr learned my addr 172.21.15.43:0/3577604827 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd68a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd69400640 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca6b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd68a00640 1 -- 172.21.15.43:0/3577604827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 msgr2=0x5563ca6b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd68a00640 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca6b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd68a00640 1 -- 172.21.15.43:0/3577604827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 msgr2=0x5563ca6a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd68a00640 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 0x5563ca6a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd68a00640 1 -- 172.21.15.43:0/3577604827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ca6987f0 con 0x5563ca2d9280 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.189+0000 7efd69e00640 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 0x5563ca6a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.190+0000 7efd68a00640 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6b7790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd500aad30 tx=0x7efd5000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ca12ca22091c0a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.190+0000 7efd55c00640 1 -- 172.21.15.43:0/3577604827 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500aa510 con 0x5563ca2d9280 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.190+0000 7efd55c00640 1 -- 172.21.15.43:0/3577604827 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd500af2f0 con 0x5563ca2d9280 2024-07-26T08:31:47.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.190+0000 7efd55c00640 1 -- 172.21.15.43:0/3577604827 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500af0f0 con 0x5563ca2d9280 2024-07-26T08:31:47.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 -- 172.21.15.43:0/3577604827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 msgr2=0x5563ca6b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6b7790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd500aad30 tx=0x7efd5000cf90 comp rx=0 tx=0).stop 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 -- 172.21.15.43:0/3577604827 shutdown_connections 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2f9f60 0x5563ca6a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6b7790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 --2- 172.21.15.43:0/3577604827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2d10a0 0x5563ca6b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 -- 172.21.15.43:0/3577604827 >> 172.21.15.43:0/3577604827 conn(0x5563ca2ee350 msgr2=0x5563ca6a6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 -- 172.21.15.43:0/3577604827 shutdown_connections 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.191+0000 7efd72a60740 1 -- 172.21.15.43:0/3577604827 wait complete. 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.192+0000 7efd72a60740 1 -- start start 2024-07-26T08:31:47.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.192+0000 7efd72a60740 1 Processor -- start 2024-07-26T08:31:47.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2f9f60 0x5563ca6c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6bd7c0 con 0x5563ca2d10a0 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6bd0f0 con 0x5563ca2d9280 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5563ca6bde90 con 0x5563ca2f9f60 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd72a60740 10 client.0 _ll_register_callbacks cb 0x7efd500a6c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd69400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd68a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd68a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6bf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:57670/0 (socket says 172.21.15.43:57670) 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd68a00640 1 -- 172.21.15.43:0/3035181664 learned_addr learned my addr 172.21.15.43:0/3035181664 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.193+0000 7efd69400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47074/0 (socket says 172.21.15.43:47074) 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd69e00640 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2f9f60 0x5563ca6c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd68a00640 1 -- 172.21.15.43:0/3035181664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2f9f60 msgr2=0x5563ca6c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd68a00640 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2f9f60 0x5563ca6c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd68a00640 1 -- 172.21.15.43:0/3035181664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 msgr2=0x5563ca6bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:47.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd68a00640 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd68a00640 1 -- 172.21.15.43:0/3035181664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ca6c4af0 con 0x5563ca2d9280 2024-07-26T08:31:47.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd68a00640 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6bf440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd500aaaa0 tx=0x7efd50018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e5c9400869b0c1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:47.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.194+0000 7efd4aa00640 1 -- 172.21.15.43:0/3035181664 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500af0f0 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd4aa00640 1 -- 172.21.15.43:0/3035181664 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7efd500aa210 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd500af2f0 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd4aa00640 1 -- 172.21.15.43:0/3035181664 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efd500aa510 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd72a60740 10 client.25184 fetch_fsmap learned FSMap version 24 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5563ca6c5eb0 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd4aa00640 1 -- 172.21.15.43:0/3035181664 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd500af2f0 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd4aa00640 1 -- 172.21.15.43:0/3035181664 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7efd500a6040 con 0x5563ca2d9280 2024-07-26T08:31:47.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd72a60740 10 client.25184 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd72a60740 10 client.25184 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.195+0000 7efd72a60740 20 client.25184 populate_metadata read hostname 'smithi043' 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.196+0000 7efd72a60740 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca28dc90 0x5563ca729310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.196+0000 7efd72a60740 4 client.25184 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.196+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "status"}) -- 0x5563ca613360 con 0x5563ca28dc90 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.196+0000 7efd69400640 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca28dc90 0x5563ca729310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.196+0000 7efd69400640 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca28dc90 0x5563ca729310 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c633b775c1da567 server_cookie=c2b2453180f4720 in_seq=0 out_seq=0 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.196+0000 7efd4aa00640 10 client.25184 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd4aa00640 1 -- 172.21.15.43:0/3035181664 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5563ca613360 con 0x5563ca28dc90 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd4aa00640 10 client.25184 handle_command_reply: tid=0 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 client.25184 shutdown 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 msgr2=0x5563ca6bf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6bf440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd500aaaa0 tx=0x7efd50018420 comp rx=0 tx=0).stop 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 shutdown_connections 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563ca2f9f60 0x5563ca6c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5563ca28dc90 0x5563ca729310 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5563ca2d9280 0x5563ca6bf440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 --2- 172.21.15.43:0/3035181664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5563ca2d10a0 0x5563ca6bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd4aa00640 0 client.25184 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.197+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 >> 172.21.15.43:0/3035181664 conn(0x5563ca2ee350 msgr2=0x5563ca6a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 shutdown_connections 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd72a60740 1 -- 172.21.15.43:0/3035181664 wait complete. 2024-07-26T08:31:47.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd72a60740 20 client.25184 trim_cache size 0 max 16384 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24710, 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 167.59594677000001, 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-07-26T08:31:47.202 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 90, 2024-07-26T08:31:47.203 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 88, 2024-07-26T08:31:47.203 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 273.40180053799997 2024-07-26T08:31:47.203 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:31:47.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efd4c0b3c20 msgr2=0x7efd4c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd6a800640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efd4c0b3c20 0x7efd4c0b6130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd580094e0 tx=0x7efd58033000 comp rx=0 tx=0).stop 2024-07-26T08:31:47.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 msgr2=0x7efd6419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.198+0000 7efd6a800640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 0x7efd6419c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd6406c240 tx=0x7efd5000ee50 comp rx=0 tx=0).stop 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 shutdown_connections 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efd4c0b3c20 0x7efd4c0b6130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd64109650 0x7efd641a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd64108d00 0x7efd6419c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 --2- 172.21.15.43:0/2144873739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd641033c0 0x7efd6419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 >> 172.21.15.43:0/2144873739 conn(0x7efd640fee10 msgr2=0x7efd64108350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 shutdown_connections 2024-07-26T08:31:47.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:47.199+0000 7efd6a800640 1 -- 172.21.15.43:0/2144873739 wait complete. 2024-07-26T08:31:48.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.a status 2024-07-26T08:31:48.689 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:48.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:48 smithi043 ceph-mon[32384]: pgmap v444: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:48 smithi133 ceph-mon[37053]: pgmap v444: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:48 smithi063 ceph-mon[36747]: pgmap v444: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:50.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:50 smithi043 ceph-mon[32384]: pgmap v445: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:50 smithi133 ceph-mon[37053]: pgmap v445: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:50 smithi063 ceph-mon[36747]: pgmap v445: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 -- 172.21.15.43:0/3903220812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694010af00 msgr2=0x7f694010b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 --2- 172.21.15.43:0/3903220812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694010af00 0x7f694010b310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6928009860 tx=0x7f692802a340 comp rx=0 tx=0).stop 2024-07-26T08:31:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 -- 172.21.15.43:0/3903220812 shutdown_connections 2024-07-26T08:31:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 --2- 172.21.15.43:0/3903220812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694010af00 0x7f694010b310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 --2- 172.21.15.43:0/3903220812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010b850 0x7f6940112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 --2- 172.21.15.43:0/3903220812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69401055c0 0x7f69401059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 -- 172.21.15.43:0/3903220812 >> 172.21.15.43:0/3903220812 conn(0x7f6940101010 msgr2=0x7f6940103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 -- 172.21.15.43:0/3903220812 shutdown_connections 2024-07-26T08:31:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.160+0000 7f6946600640 1 -- 172.21.15.43:0/3903220812 wait complete. 2024-07-26T08:31:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 Processor -- start 2024-07-26T08:31:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 -- start start 2024-07-26T08:31:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69401055c0 0x7f694019c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010af00 0x7f694019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f694010b850 0x7f69401a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6940115630 con 0x7f694010af00 2024-07-26T08:31:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f69401154b0 con 0x7f694010b850 2024-07-26T08:31:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.162+0000 7f6946600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f69401157b0 con 0x7f69401055c0 2024-07-26T08:31:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f693fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010af00 0x7f694019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f6945200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69401055c0 0x7f694019c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f6945200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69401055c0 0x7f694019c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51146/0 (socket says 172.21.15.43:51146) 2024-07-26T08:31:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f6945c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f694010b850 0x7f69401a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f6945200640 1 -- 172.21.15.43:0/2110553919 learned_addr learned my addr 172.21.15.43:0/2110553919 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f693fe00640 1 -- 172.21.15.43:0/2110553919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69401055c0 msgr2=0x7f694019c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f693fe00640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69401055c0 0x7f694019c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f693fe00640 1 -- 172.21.15.43:0/2110553919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f694010b850 msgr2=0x7f69401a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f693fe00640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f694010b850 0x7f69401a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f693fe00640 1 -- 172.21.15.43:0/2110553919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401a1fb0 con 0x7f694010af00 2024-07-26T08:31:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.163+0000 7f6945c00640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f694010b850 0x7f69401a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:31:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.164+0000 7f693fe00640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010af00 0x7f694019c5e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6928009780 tx=0x7f692802aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.164+0000 7f693d600640 1 -- 172.21.15.43:0/2110553919 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928037040 con 0x7f694010af00 2024-07-26T08:31:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.164+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69401a2240 con 0x7f694010af00 2024-07-26T08:31:51.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.164+0000 7f693d600640 1 -- 172.21.15.43:0/2110553919 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6928033bd0 con 0x7f694010af00 2024-07-26T08:31:51.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.164+0000 7f693d600640 1 -- 172.21.15.43:0/2110553919 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280035f0 con 0x7f694010af00 2024-07-26T08:31:51.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.164+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69401a8a00 con 0x7f694010af00 2024-07-26T08:31:51.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.167+0000 7f694e84b740 1 Processor -- start 2024-07-26T08:31:51.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 -- start start 2024-07-26T08:31:51.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 0x5596abb5b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb5bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab795280 0x5596abb5c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596abad1970 con 0x5596ab7b5f60 2024-07-26T08:31:51.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5596abac0e70 con 0x5596ab795280 2024-07-26T08:31:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f694e84b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5596abac4eb0 con 0x5596ab78d0a0 2024-07-26T08:31:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f6945c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 0x5596abb5b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.168+0000 7f693d600640 1 -- 172.21.15.43:0/2110553919 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f6928042020 con 0x7f694010af00 2024-07-26T08:31:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 0x5596abb5b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47110/0 (socket says 172.21.15.43:47110) 2024-07-26T08:31:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945c00640 1 -- 172.21.15.43:0/3031456081 learned_addr learned my addr 172.21.15.43:0/3031456081 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb5bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f693fe00640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab795280 0x5596abb5c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 -- 172.21.15.43:0/3031456081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab795280 msgr2=0x5596abb5c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab795280 0x5596abb5c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 -- 172.21.15.43:0/3031456081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 msgr2=0x5596abb5b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 0x5596abb5b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 -- 172.21.15.43:0/3031456081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596aba68110 con 0x5596ab78d0a0 2024-07-26T08:31:51.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945c00640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 0x5596abb5b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:51.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f693fe00640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab795280 0x5596abb5c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:31:51.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.169+0000 7f6945200640 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb5bcc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69300114f0 tx=0x7f6930009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1674eace522ac4b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:51.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.170+0000 7f6936000640 1 -- 172.21.15.43:0/3031456081 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693001e070 con 0x5596ab78d0a0 2024-07-26T08:31:51.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.170+0000 7f6936000640 1 -- 172.21.15.43:0/3031456081 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f693000fb50 con 0x5596ab78d0a0 2024-07-26T08:31:51.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.170+0000 7f6936000640 1 -- 172.21.15.43:0/3031456081 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930019c20 con 0x5596ab78d0a0 2024-07-26T08:31:51.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.170+0000 7f693d600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69240b3ca0 0x7f69240b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 -- 172.21.15.43:0/3031456081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 msgr2=0x5596abb5bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb5bcc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69300114f0 tx=0x7f6930009f90 comp rx=0 tx=0).stop 2024-07-26T08:31:51.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f693d600640 1 -- 172.21.15.43:0/2110553919 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f69281033c0 con 0x7f694010af00 2024-07-26T08:31:51.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f6945c00640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69240b3ca0 0x7f69240b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 -- 172.21.15.43:0/3031456081 shutdown_connections 2024-07-26T08:31:51.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb5bcc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab795280 0x5596abb5c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 --2- 172.21.15.43:0/3031456081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab7b5f60 0x5596abb5b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 -- 172.21.15.43:0/3031456081 >> 172.21.15.43:0/3031456081 conn(0x5596ab7aa350 msgr2=0x5596abb59670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:51.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 -- 172.21.15.43:0/3031456081 shutdown_connections 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.171+0000 7f694e84b740 1 -- 172.21.15.43:0/3031456081 wait complete. 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.172+0000 7f6945c00640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69240b3ca0 0x7f69240b61b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6938009a30 tx=0x7f6938009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.172+0000 7f694e84b740 1 -- start start 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.172+0000 7f694e84b740 1 Processor -- start 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb66f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb67450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb73250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596ab9245f0 con 0x5596ab795280 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5596aba5d540 con 0x5596ab7b5f60 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5596abb69f60 con 0x5596ab78d0a0 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f694e84b740 10 client.0 _ll_register_callbacks cb 0x5596aba6cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f693fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb67450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f6945200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb66f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f693fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb67450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47120/0 (socket says 172.21.15.43:47120) 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f693fe00640 1 -- 172.21.15.43:0/580820913 learned_addr learned my addr 172.21.15.43:0/580820913 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.173+0000 7f6945c00640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb73250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945200640 1 -- 172.21.15.43:0/580820913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 msgr2=0x5596abb73250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945200640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb73250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945200640 1 -- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 msgr2=0x5596abb67450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945200640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb67450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945200640 1 -- 172.21.15.43:0/580820913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ab821540 con 0x5596ab78d0a0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945c00640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb73250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f693fe00640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb67450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f6945200640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb66f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6930005c10 tx=0x7f6930019640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=450fd2188f169205 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.174+0000 7f692ea00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.175+0000 7f692ea00640 1 -- 172.21.15.43:0/580820913 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693001e070 con 0x5596ab78d0a0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.175+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693000fb50 con 0x5596ab78d0a0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.175+0000 7f692ea00640 1 -- 172.21.15.43:0/580820913 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f6930004a40 con 0x5596ab78d0a0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.175+0000 7f692ea00640 1 -- 172.21.15.43:0/580820913 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6930004c40 con 0x5596ab78d0a0 2024-07-26T08:31:51.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 10 client.25225 fetch_fsmap learned FSMap version 24 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5596abb75cb0 con 0x5596ab78d0a0 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f692ea00640 1 -- 172.21.15.43:0/580820913 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f693000fb50 con 0x5596ab78d0a0 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f692ea00640 1 -- 172.21.15.43:0/580820913 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f6930005310 con 0x5596ab78d0a0 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 10 client.25225 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 10 client.25225 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 20 client.25225 populate_metadata read hostname 'smithi043' 2024-07-26T08:31:51.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab7748e0 0x5596abb794b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 4 client.25225 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:31:51.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.176+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596abad38c0 con 0x5596ab7748e0 2024-07-26T08:31:51.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.177+0000 7f693fe00640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab7748e0 0x5596abb794b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.177+0000 7f693fe00640 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab7748e0 0x5596abb794b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb0aa50d039730b server_cookie=6f1fff8eff07c691 in_seq=0 out_seq=0 2024-07-26T08:31:51.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.177+0000 7f692ea00640 10 client.25225 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:31:51.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.178+0000 7f692ea00640 1 -- 172.21.15.43:0/580820913 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596abad38c0 con 0x5596ab7748e0 2024-07-26T08:31:51.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.178+0000 7f692ea00640 10 client.25225 handle_command_reply: tid=0 2024-07-26T08:31:51.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.178+0000 7f694e84b740 1 client.25225 shutdown 2024-07-26T08:31:51.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 msgr2=0x5596abb66f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb66f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6930005c10 tx=0x7f6930019640 comp rx=0 tx=0).stop 2024-07-26T08:31:51.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 shutdown_connections 2024-07-26T08:31:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab7748e0 0x5596abb794b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb73250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb67450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 --2- 172.21.15.43:0/580820913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb66f10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f692ea00640 0 client.25225 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:31:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 >> 172.21.15.43:0/580820913 conn(0x5596ab7aa350 msgr2=0x5596abb5e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 shutdown_connections 2024-07-26T08:31:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 1 -- 172.21.15.43:0/580820913 wait complete. 2024-07-26T08:31:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.179+0000 7f694e84b740 20 client.25225 trim_cache size 0 max 16384 2024-07-26T08:31:51.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.199+0000 7f694e84b740 1 Processor -- start 2024-07-26T08:31:51.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.199+0000 7f694e84b740 1 -- start start 2024-07-26T08:31:51.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f694e84b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 0x5596abb73d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f694e84b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab795280 0x5596abb620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f694e84b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f694e84b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596abb777f0 con 0x5596ab78d0a0 2024-07-26T08:31:51.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f694e84b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5596abb77ec0 con 0x5596ab7b5f60 2024-07-26T08:31:51.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f694e84b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5596abb78590 con 0x5596ab795280 2024-07-26T08:31:51.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f693fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab795280 0x5596abb620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f6945200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 0x5596abb73d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f6945c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f6945200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 0x5596abb73d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47134/0 (socket says 172.21.15.43:47134) 2024-07-26T08:31:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.200+0000 7f6945200640 1 -- 172.21.15.43:0/3374440773 learned_addr learned my addr 172.21.15.43:0/3374440773 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f693fe00640 1 -- 172.21.15.43:0/3374440773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 msgr2=0x5596abb731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f693fe00640 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb731c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f693fe00640 1 -- 172.21.15.43:0/3374440773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 msgr2=0x5596abb73d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f693fe00640 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 0x5596abb73d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f693fe00640 1 -- 172.21.15.43:0/3374440773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596abb547f0 con 0x5596ab795280 2024-07-26T08:31:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f6945200640 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 0x5596abb73d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f6945c00640 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f693fe00640 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab795280 0x5596abb620c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69280c7060 tx=0x7f69280b1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6ecf2712090b07d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f6935600640 1 -- 172.21.15.43:0/3374440773 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928100e60 con 0x5596ab795280 2024-07-26T08:31:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f6935600640 1 -- 172.21.15.43:0/3374440773 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f69280c9df0 con 0x5596ab795280 2024-07-26T08:31:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.201+0000 7f6935600640 1 -- 172.21.15.43:0/3374440773 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280c6080 con 0x5596ab795280 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 -- 172.21.15.43:0/3374440773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab795280 msgr2=0x5596abb620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab795280 0x5596abb620c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69280c7060 tx=0x7f69280b1040 comp rx=0 tx=0).stop 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 -- 172.21.15.43:0/3374440773 shutdown_connections 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab795280 0x5596abb620c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 --2- 172.21.15.43:0/3374440773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab78d0a0 0x5596abb73d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.202+0000 7f694e84b740 1 -- 172.21.15.43:0/3374440773 >> 172.21.15.43:0/3374440773 conn(0x5596ab7aa350 msgr2=0x5596abb770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.203+0000 7f694e84b740 1 -- 172.21.15.43:0/3374440773 shutdown_connections 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.203+0000 7f694e84b740 1 -- 172.21.15.43:0/3374440773 wait complete. 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.203+0000 7f694e84b740 1 -- start start 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 Processor -- start 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb81f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb806f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596abb79330 con 0x5596ab795280 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5596abb78c60 con 0x5596ab7b5f60 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5596abb79a00 con 0x5596ab78d0a0 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.204+0000 7f694e84b740 10 client.0 _ll_register_callbacks cb 0x7f6938009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:31:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb806f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f693fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb819c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51192/0 (socket says 172.21.15.43:51192) 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 -- 172.21.15.43:0/2574969122 learned_addr learned my addr 172.21.15.43:0/2574969122 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb806f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:57740/0 (socket says 172.21.15.43:57740) 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 -- 172.21.15.43:0/2574969122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 msgr2=0x5596abb806f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb806f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 -- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 msgr2=0x5596abb81f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb81f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 -- 172.21.15.43:0/2574969122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596abb80e80 con 0x5596ab78d0a0 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f6945200640 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb819c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6930002230 tx=0x7f693000ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc8311ce102db4b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.205+0000 7f692ea00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:31:51.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f692ea00640 1 -- 172.21.15.43:0/2574969122 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693001e040 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f692ea00640 1 -- 172.21.15.43:0/2574969122 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f6930003d80 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69280c9df0 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f692ea00640 1 -- 172.21.15.43:0/2574969122 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f693003c050 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f694e84b740 10 client.25231 fetch_fsmap learned FSMap version 24 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5596abbe1180 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.206+0000 7f692ea00640 1 -- 172.21.15.43:0/2574969122 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f69280c9df0 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f692ea00640 1 -- 172.21.15.43:0/2574969122 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f69300050b0 con 0x5596ab78d0a0 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f694e84b740 10 client.25231 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f694e84b740 10 client.25231 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f694e84b740 20 client.25231 populate_metadata read hostname 'smithi043' 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f694e84b740 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab749c90 0x5596abbe49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:51.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f694e84b740 4 client.25231 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:31:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "status"}) -- 0x5596abacf360 con 0x5596ab749c90 2024-07-26T08:31:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.207+0000 7f693fe00640 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab749c90 0x5596abbe49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f693fe00640 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab749c90 0x5596abbe49d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76322e9dd88f11 server_cookie=c6cf59cb92e673be in_seq=0 out_seq=0 2024-07-26T08:31:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f692ea00640 10 client.25231 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:31:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f692ea00640 1 -- 172.21.15.43:0/2574969122 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5596abacf360 con 0x5596ab749c90 2024-07-26T08:31:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f692ea00640 10 client.25231 handle_command_reply: tid=0 2024-07-26T08:31:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 client.25231 shutdown 2024-07-26T08:31:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 msgr2=0x5596abb819c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb819c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6930002230 tx=0x7f693000ff90 comp rx=0 tx=0).stop 2024-07-26T08:31:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 shutdown_connections 2024-07-26T08:31:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5596ab749c90 0x5596abbe49d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ab7b5f60 0x5596abb806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ab795280 0x5596abb81f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 --2- 172.21.15.43:0/2574969122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ab78d0a0 0x5596abb819c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f692ea00640 0 client.25231 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.208+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 >> 172.21.15.43:0/2574969122 conn(0x5596ab7aa350 msgr2=0x5596abb770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.209+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 shutdown_connections 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.209+0000 7f694e84b740 1 -- 172.21.15.43:0/2574969122 wait complete. 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.209+0000 7f694e84b740 20 client.25231 trim_cache size 0 max 16384 2024-07-26T08:31:51.217 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24733, 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 252.885700926, 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 90, 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 88, 2024-07-26T08:31:51.218 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 280.10777035199999 2024-07-26T08:31:51.219 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:31:51.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69240b3ca0 msgr2=0x7f69240b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69240b3ca0 0x7f69240b61b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6938009a30 tx=0x7f6938009260 comp rx=0 tx=0).stop 2024-07-26T08:31:51.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010af00 msgr2=0x7f694019c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:51.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010af00 0x7f694019c5e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6928009780 tx=0x7f692802aeb0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 shutdown_connections 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f69240b3ca0 0x7f69240b61b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f694010b850 0x7f69401a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694010af00 0x7f694019c5e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 --2- 172.21.15.43:0/2110553919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69401055c0 0x7f694019c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 >> 172.21.15.43:0/2110553919 conn(0x7f6940101010 msgr2=0x7f6940103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 shutdown_connections 2024-07-26T08:31:51.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:51.210+0000 7f6946600640 1 -- 172.21.15.43:0/2110553919 wait complete. 2024-07-26T08:31:52.159 INFO:tasks.cephadm:Setup complete, yielding 2024-07-26T08:31:52.160 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-07-26T08:31:52.171 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:31:52.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph orch status' 2024-07-26T08:31:52.619 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:52.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:52 smithi043 ceph-mon[32384]: pgmap v446: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:52 smithi133 ceph-mon[37053]: pgmap v446: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:52 smithi063 ceph-mon[36747]: pgmap v446: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:54.591 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:54 smithi043 ceph-mon[32384]: pgmap v447: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:54 smithi133 ceph-mon[37053]: pgmap v447: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:54 smithi063 ceph-mon[36747]: pgmap v447: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:31:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 -- 172.21.15.43:0/2329169224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac077cc0 msgr2=0x7fd7ac113c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/2329169224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac113c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd794009900 tx=0x7fd79402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 -- 172.21.15.43:0/2329169224 shutdown_connections 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/2329169224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/2329169224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac113c60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/2329169224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077370 0x7fd7ac077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.170+0000 7fd7b0e00640 1 -- 172.21.15.43:0/2329169224 >> 172.21.15.43:0/2329169224 conn(0x7fd7ac1011f0 msgr2=0x7fd7ac103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.171+0000 7fd7b0e00640 1 -- 172.21.15.43:0/2329169224 shutdown_connections 2024-07-26T08:31:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.171+0000 7fd7b0e00640 1 -- 172.21.15.43:0/2329169224 wait complete. 2024-07-26T08:31:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.172+0000 7fd7b0e00640 1 Processor -- start 2024-07-26T08:31:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.172+0000 7fd7b0e00640 1 -- start start 2024-07-26T08:31:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7b0e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac077370 0x7fd7ac1a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7b0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7b0e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7b0e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac119c20 con 0x7fd7ac077cc0 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7b0e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac119aa0 con 0x7fd7ac1141a0 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7b0e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac119da0 con 0x7fd7ac077370 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7aa800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7a1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7aa800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:58466/0 (socket says 172.21.15.43:58466) 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7aa800640 1 -- 172.21.15.43:0/3512460721 learned_addr learned my addr 172.21.15.43:0/3512460721 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.173+0000 7fd7a9e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac077370 0x7fd7ac1a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7aa800640 1 -- 172.21.15.43:0/3512460721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac077370 msgr2=0x7fd7ac1a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7aa800640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac077370 0x7fd7ac1a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7aa800640 1 -- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077cc0 msgr2=0x7fd7ac1a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7aa800640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac1a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7aa800640 1 -- 172.21.15.43:0/3512460721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac1a6540 con 0x7fd7ac1141a0 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7a1400640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac1a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.174+0000 7fd7aa800640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1a5e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400eb10 tx=0x7fd7a400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.175+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4004b20 con 0x7fd7ac1141a0 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.175+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd7a4004cc0 con 0x7fd7ac1141a0 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.175+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac1a6830 con 0x7fd7ac1141a0 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.175+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4010720 con 0x7fd7ac1141a0 2024-07-26T08:31:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.175+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac1acf90 con 0x7fd7ac1141a0 2024-07-26T08:31:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.176+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac077780 con 0x7fd7ac1141a0 2024-07-26T08:31:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.179+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fd7a40108c0 con 0x7fd7ac1141a0 2024-07-26T08:31:55.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.181+0000 7fd7a3400640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd7900b3ca0 0x7fd7900b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:55.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.181+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fd7a40e4810 con 0x7fd7ac1141a0 2024-07-26T08:31:55.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.181+0000 7fd7a9e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd7900b3ca0 0x7fd7900b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:55.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.182+0000 7fd7a9e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd7900b3ca0 0x7fd7900b61b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009bd0 tx=0x7fd79c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:55.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.182+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd7a4055600 con 0x7fd7ac1141a0 2024-07-26T08:31:55.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.405+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd7ac116310 con 0x7fd7900b3ca0 2024-07-26T08:31:55.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.407+0000 7fd7a3400640 1 -- 172.21.15.43:0/3512460721 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd7ac116310 con 0x7fd7900b3ca0 2024-07-26T08:31:55.409 INFO:teuthology.orchestra.run.smithi043.stdout:Backend: cephadm 2024-07-26T08:31:55.409 INFO:teuthology.orchestra.run.smithi043.stdout:Available: Yes 2024-07-26T08:31:55.409 INFO:teuthology.orchestra.run.smithi043.stdout:Paused: No 2024-07-26T08:31:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd7900b3ca0 msgr2=0x7fd7900b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd7900b3ca0 0x7fd7900b61b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009bd0 tx=0x7fd79c005f90 comp rx=0 tx=0).stop 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 msgr2=0x7fd7ac1a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1a5e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400eb10 tx=0x7fd7a400c2d0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 shutdown_connections 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd7900b3ca0 0x7fd7900b61b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac1141a0 0x7fd7ac1a5e10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7ac077cc0 0x7fd7ac1a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 --2- 172.21.15.43:0/3512460721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac077370 0x7fd7ac1a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.410+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 >> 172.21.15.43:0/3512460721 conn(0x7fd7ac1011f0 msgr2=0x7fd7ac103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.411+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 shutdown_connections 2024-07-26T08:31:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:55.411+0000 7fd7b0e00640 1 -- 172.21.15.43:0/3512460721 wait complete. 2024-07-26T08:31:56.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph orch ps' 2024-07-26T08:31:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:56 smithi043 ceph-mon[32384]: pgmap v448: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:56 smithi043 ceph-mon[32384]: from='client.25205 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:31:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:56 smithi133 ceph-mon[37053]: pgmap v448: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:56 smithi133 ceph-mon[37053]: from='client.25205 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:31:56.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:56 smithi063 ceph-mon[36747]: pgmap v448: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:31:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:56 smithi063 ceph-mon[36747]: from='client.25205 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:31:56.954 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:31:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:31:58 smithi043 ceph-mon[32384]: pgmap v449: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:31:58 smithi133 ceph-mon[37053]: pgmap v449: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:58.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:31:58 smithi063 ceph-mon[36747]: pgmap v449: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:31:59.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 -- 172.21.15.43:0/1856149995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f261410af10 msgr2=0x7f261410b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 --2- 172.21.15.43:0/1856149995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f261410af10 0x7f261410b320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2600009900 tx=0x7f260002a410 comp rx=0 tx=0).stop 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 -- 172.21.15.43:0/1856149995 shutdown_connections 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 --2- 172.21.15.43:0/1856149995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261410b860 0x7f2614112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 --2- 172.21.15.43:0/1856149995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f261410af10 0x7f261410b320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 --2- 172.21.15.43:0/1856149995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26141055d0 0x7f26141059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.380+0000 7f261b000640 1 -- 172.21.15.43:0/1856149995 >> 172.21.15.43:0/1856149995 conn(0x7f2614101040 msgr2=0x7f2614103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.381+0000 7f261b000640 1 -- 172.21.15.43:0/1856149995 shutdown_connections 2024-07-26T08:31:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.381+0000 7f261b000640 1 -- 172.21.15.43:0/1856149995 wait complete. 2024-07-26T08:31:59.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 Processor -- start 2024-07-26T08:31:59.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 -- start start 2024-07-26T08:31:59.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 0x7f261419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:59.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f261410af10 0x7f261419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:59.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261410b860 0x7f26141a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:59.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2614115640 con 0x7f26141055d0 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f26141154c0 con 0x7f261410af10 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.382+0000 7f261b000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f26141157c0 con 0x7f261410b860 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 0x7f261419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 0x7f261419bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39270/0 (socket says 172.21.15.43:39270) 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 -- 172.21.15.43:0/3752659707 learned_addr learned my addr 172.21.15.43:0/3752659707 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619200640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f261410af10 0x7f261419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f261a600640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261410b860 0x7f26141a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 -- 172.21.15.43:0/3752659707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261410b860 msgr2=0x7f26141a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261410b860 0x7f26141a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 -- 172.21.15.43:0/3752659707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f261410af10 msgr2=0x7f261419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f261410af10 0x7f261419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.383+0000 7f2619c00640 1 -- 172.21.15.43:0/3752659707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26141a1f60 con 0x7f26141055d0 2024-07-26T08:31:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.384+0000 7f2619c00640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 0x7f261419bff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f260800e9f0 tx=0x7f260800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.384+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260800cd80 con 0x7f26141055d0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.384+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2608010900 con 0x7f26141055d0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.384+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26141a2250 con 0x7f26141055d0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.384+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608018920 con 0x7f26141055d0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.384+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26141a89b0 con 0x7f26141055d0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.386+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26141059e0 con 0x7f26141055d0 2024-07-26T08:31:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.388+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f2608010ab0 con 0x7f26141055d0 2024-07-26T08:31:59.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.390+0000 7f2612000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25fc0b3c20 0x7f25fc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:31:59.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.390+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f26080e4980 con 0x7f26141055d0 2024-07-26T08:31:59.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.390+0000 7f2619200640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25fc0b3c20 0x7f25fc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:31:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.391+0000 7f2619200640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25fc0b3c20 0x7f25fc0b6130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2600005940 tx=0x7f26000058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:31:59.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.392+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f26080ab460 con 0x7f26141055d0 2024-07-26T08:31:59.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.606+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2614063230 con 0x7f25fc0b3c20 2024-07-26T08:31:59.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.647+0000 7f2612000640 1 -- 172.21.15.43:0/3752659707 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f2614063230 con 0x7f25fc0b3c20 2024-07-26T08:31:59.649 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-07-26T08:31:59.649 INFO:teuthology.orchestra.run.smithi043.stdout:mds.a smithi043 running (4m) 2m ago 4m 92.7M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa fc56a7adad44 2024-07-26T08:31:59.649 INFO:teuthology.orchestra.run.smithi043.stdout:mds.b smithi063 running (4m) 2m ago 4m 85.3M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 6ae92b5bc475 2024-07-26T08:31:59.649 INFO:teuthology.orchestra.run.smithi043.stdout:mds.c smithi133 running (5m) 2m ago 5m 85.0M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 4515fb61174c 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.d smithi043 running (5m) 2m ago 5m 80.9M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 705d87625700 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.e smithi063 running (5m) 2m ago 5m 84.8M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 54c1bf4eb7eb 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.f smithi133 running (5m) 2m ago 5m 84.3M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 5324255a1462 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.g smithi043 running (4m) 2m ago 4m 82.3M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa b63d4833ceb2 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.h smithi063 running (5m) 2m ago 5m 81.7M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa b1ba0b1075a8 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.i smithi133 running (4m) 2m ago 4m 85.6M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 391e1529dced 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.j smithi043 running (5m) 2m ago 5m 80.9M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 5e3c18165452 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.k smithi063 running (5m) 2m ago 5m 82.8M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa d1cc1bf13881 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mds.l smithi133 running (5m) 2m ago 5m 81.8M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa d9e83c5a9878 2024-07-26T08:31:59.650 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.x smithi043 *:9283,8765 running (14m) 2m ago 14m 583M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 875cd6275e7c 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.y smithi063 *:8443,8765 running (12m) 2m ago 12m 524M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa cd5c040c0d7b 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.z smithi133 *:8443,8765 running (12m) 2m ago 12m 524M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 26bbfd43db7c 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a smithi043 running (14m) 2m ago 14m 118M 2048M 19.0.0-5320-ge8f88bb1 ae51f432d4fa c8e48164867c 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b smithi063 running (12m) 2m ago 12m 114M 2048M 19.0.0-5320-ge8f88bb1 ae51f432d4fa a03d099b5780 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c smithi133 running (12m) 2m ago 12m 116M 2048M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 690b7b291788 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (10m) 2m ago 10m 112M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 442aa16642ef 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi063 running (10m) 2m ago 10m 112M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 5970db2ce036 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi133 running (10m) 2m ago 10m 120M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa e95db173573b 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi043 running (9m) 2m ago 9m 118M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 93d18ee03156 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi063 running (9m) 2m ago 9m 118M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa a78be144ec2a 2024-07-26T08:31:59.651 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi133 running (8m) 2m ago 8m 119M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa f6e50d31565f 2024-07-26T08:31:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:osd.6 smithi043 running (8m) 2m ago 8m 109M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 9fc94f290a76 2024-07-26T08:31:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:osd.7 smithi063 running (7m) 2m ago 7m 112M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 368ac63831dd 2024-07-26T08:31:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:osd.8 smithi133 running (7m) 2m ago 7m 118M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 34cee34cf67d 2024-07-26T08:31:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:osd.9 smithi043 running (6m) 2m ago 6m 115M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 677b1956aab0 2024-07-26T08:31:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:osd.10 smithi063 running (6m) 2m ago 6m 111M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 5fd5e8e49cc9 2024-07-26T08:31:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:osd.11 smithi133 running (5m) 2m ago 5m 116M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 2c871e17bde3 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25fc0b3c20 msgr2=0x7f25fc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25fc0b3c20 0x7f25fc0b6130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2600005940 tx=0x7f26000058d0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 msgr2=0x7f261419bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 0x7f261419bff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f260800e9f0 tx=0x7f260800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 shutdown_connections 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f25fc0b3c20 0x7f25fc0b6130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261410b860 0x7f26141a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f261410af10 0x7f261419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 --2- 172.21.15.43:0/3752659707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26141055d0 0x7f261419bff0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:31:59.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.650+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 >> 172.21.15.43:0/3752659707 conn(0x7f2614101040 msgr2=0x7f2614103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:31:59.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.651+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 shutdown_connections 2024-07-26T08:31:59.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:31:59.651+0000 7f261b000640 1 -- 172.21.15.43:0/3752659707 wait complete. 2024-07-26T08:32:00.605 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph orch ls' 2024-07-26T08:32:00.683 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:00 smithi043 ceph-mon[32384]: pgmap v450: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:00.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:00 smithi133 ceph-mon[37053]: pgmap v450: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:00 smithi063 ceph-mon[36747]: pgmap v450: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:01.082 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:01.583 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:01 smithi043 ceph-mon[32384]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:01 smithi133 ceph-mon[37053]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:01.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:01 smithi063 ceph-mon[36747]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:02.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:02 smithi043 ceph-mon[32384]: pgmap v451: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:02 smithi133 ceph-mon[37053]: pgmap v451: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:02 smithi063 ceph-mon[36747]: pgmap v451: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:03.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 -- 172.21.15.43:0/3100806749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 msgr2=0x7f3d9c10fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:03.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 --2- 172.21.15.43:0/3100806749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c10fea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009ca0 tx=0x7f3d9402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 -- 172.21.15.43:0/3100806749 shutdown_connections 2024-07-26T08:32:03.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 --2- 172.21.15.43:0/3100806749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c10fea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 --2- 172.21.15.43:0/3100806749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9c108d20 0x7f3d9c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 --2- 172.21.15.43:0/3100806749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 -- 172.21.15.43:0/3100806749 >> 172.21.15.43:0/3100806749 conn(0x7f3d9c0fee70 msgr2=0x7f3d9c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:03.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 -- 172.21.15.43:0/3100806749 shutdown_connections 2024-07-26T08:32:03.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.582+0000 7f3d9b200640 1 -- 172.21.15.43:0/3100806749 wait complete. 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.583+0000 7f3d9b200640 1 Processor -- start 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.583+0000 7f3d9b200640 1 -- start start 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9c108d20 0x7f3d9c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c1134a0 con 0x7f3d9c109670 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c113320 con 0x7f3d9c108d20 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c113620 con 0x7f3d9c1033e0 2024-07-26T08:32:03.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d9a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:03.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d99e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:03.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d93e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9c108d20 0x7f3d9c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:03.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d99e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45174/0 (socket says 172.21.15.43:45174) 2024-07-26T08:32:03.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.584+0000 7f3d99e00640 1 -- 172.21.15.43:0/710859999 learned_addr learned my addr 172.21.15.43:0/710859999 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d99e00640 1 -- 172.21.15.43:0/710859999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9c108d20 msgr2=0x7f3d9c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d99e00640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9c108d20 0x7f3d9c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d99e00640 1 -- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 msgr2=0x7f3d9c075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d99e00640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d99e00640 1 -- 172.21.15.43:0/710859999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c1a80b0 con 0x7f3d9c1033e0 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d9a800640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d99e00640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c075140 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00e9f0 tx=0x7f3d8c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.585+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00cd80 con 0x7f3d9c1033e0 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.586+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d8c010900 con 0x7f3d9c1033e0 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.586+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c018920 con 0x7f3d9c1033e0 2024-07-26T08:32:03.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.586+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9c1a83a0 con 0x7f3d9c1033e0 2024-07-26T08:32:03.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.586+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9c1a8890 con 0x7f3d9c1033e0 2024-07-26T08:32:03.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.587+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9c1037f0 con 0x7f3d9c1033e0 2024-07-26T08:32:03.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.589+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f3d8c010ab0 con 0x7f3d9c1033e0 2024-07-26T08:32:03.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.591+0000 7f3d92a00640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d7c0b3c20 0x7f3d7c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:03.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.591+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3d8c0e4510 con 0x7f3d9c1033e0 2024-07-26T08:32:03.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.591+0000 7f3d93e00640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d7c0b3c20 0x7f3d7c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:03.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.592+0000 7f3d93e00640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d7c0b3c20 0x7f3d7c0b6130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c102720 tx=0x7f3d84005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:03.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.592+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3d8c0ab0b0 con 0x7f3d9c1033e0 2024-07-26T08:32:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.804+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3d9c063230 con 0x7f3d7c0b3c20 2024-07-26T08:32:03.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.821+0000 7f3d92a00640 1 -- 172.21.15.43:0/710859999 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3d9c063230 con 0x7f3d7c0b3c20 2024-07-26T08:32:03.823 INFO:teuthology.orchestra.run.smithi043.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-07-26T08:32:03.823 INFO:teuthology.orchestra.run.smithi043.stdout:mds.all 12/12 2m ago 5m smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi063=b;smithi063=e;smithi063=h;smithi063=k;smithi133=c;smithi133=f;smithi133=i;smithi133=l;count:12 2024-07-26T08:32:03.824 INFO:teuthology.orchestra.run.smithi043.stdout:mgr 3/3 2m ago 12m smithi043=x;smithi063=y;smithi133=z;count:3 2024-07-26T08:32:03.824 INFO:teuthology.orchestra.run.smithi043.stdout:mon 3/3 2m ago 13m smithi043:172.21.15.43=a;smithi063:172.21.15.63=b;smithi133:172.21.15.133=c;count:3 2024-07-26T08:32:03.824 INFO:teuthology.orchestra.run.smithi043.stdout:osd 12 2m ago - 2024-07-26T08:32:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d7c0b3c20 msgr2=0x7f3d7c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d7c0b3c20 0x7f3d7c0b6130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c102720 tx=0x7f3d84005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 msgr2=0x7f3d9c075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c075140 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00e9f0 tx=0x7f3d8c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 shutdown_connections 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d7c0b3c20 0x7f3d7c0b6130 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d9c109670 0x7f3d9c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9c108d20 0x7f3d9c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.824+0000 7f3d9b200640 1 --2- 172.21.15.43:0/710859999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d9c1033e0 0x7f3d9c075140 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.825+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 >> 172.21.15.43:0/710859999 conn(0x7f3d9c0fee70 msgr2=0x7f3d9c106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.825+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 shutdown_connections 2024-07-26T08:32:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:03.825+0000 7f3d9b200640 1 -- 172.21.15.43:0/710859999 wait complete. 2024-07-26T08:32:04.654 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:04 smithi043 ceph-mon[32384]: pgmap v452: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:04.736 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph orch host ls' 2024-07-26T08:32:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:04 smithi133 ceph-mon[37053]: pgmap v452: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:04 smithi063 ceph-mon[36747]: pgmap v452: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:05.254 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:05.669 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:05 smithi043 ceph-mon[32384]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:05 smithi133 ceph-mon[37053]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:05.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:05 smithi063 ceph-mon[36747]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:06.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:06 smithi043 ceph-mon[32384]: pgmap v453: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:06 smithi133 ceph-mon[37053]: pgmap v453: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:06.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:06 smithi063 ceph-mon[36747]: pgmap v453: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:07.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 -- 172.21.15.43:0/3239642968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff43810af10 msgr2=0x7ff43810b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 --2- 172.21.15.43:0/3239642968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff43810af10 0x7ff43810b320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff424009900 tx=0x7ff42402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 -- 172.21.15.43:0/3239642968 shutdown_connections 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 --2- 172.21.15.43:0/3239642968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff43810b860 0x7ff438112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 --2- 172.21.15.43:0/3239642968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff43810af10 0x7ff43810b320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 --2- 172.21.15.43:0/3239642968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4381055d0 0x7ff4381059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.771+0000 7ff43ec00640 1 -- 172.21.15.43:0/3239642968 >> 172.21.15.43:0/3239642968 conn(0x7ff438101040 msgr2=0x7ff438103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.772+0000 7ff43ec00640 1 -- 172.21.15.43:0/3239642968 shutdown_connections 2024-07-26T08:32:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.772+0000 7ff43ec00640 1 -- 172.21.15.43:0/3239642968 wait complete. 2024-07-26T08:32:07.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 Processor -- start 2024-07-26T08:32:07.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 -- start start 2024-07-26T08:32:07.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 0x7ff43819c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff43810af10 0x7ff43819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff43810b860 0x7ff4381a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff438115690 con 0x7ff4381055d0 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff438115510 con 0x7ff43810af10 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.773+0000 7ff43ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff438115810 con 0x7ff43810b860 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 0x7ff43819c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 0x7ff43819c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51380/0 (socket says 172.21.15.43:51380) 2024-07-26T08:32:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43e200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff43810b860 0x7ff4381a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff43810af10 0x7ff43819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43d800640 1 -- 172.21.15.43:0/2788365540 learned_addr learned my addr 172.21.15.43:0/2788365540 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43e200640 1 -- 172.21.15.43:0/2788365540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff43810af10 msgr2=0x7ff43819c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43e200640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff43810af10 0x7ff43819c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43e200640 1 -- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 msgr2=0x7ff43819c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43e200640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 0x7ff43819c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43e200640 1 -- 172.21.15.43:0/2788365540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4381a1f90 con 0x7ff43810b860 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.774+0000 7ff43d800640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 0x7ff43819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:07.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.775+0000 7ff43e200640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff43810b860 0x7ff4381a1860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff430009fd0 tx=0x7ff43000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:07.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.775+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43000ce20 con 0x7ff43810b860 2024-07-26T08:32:07.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.775+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4381a2280 con 0x7ff43810b860 2024-07-26T08:32:07.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.775+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff430005020 con 0x7ff43810b860 2024-07-26T08:32:07.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.775+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430010720 con 0x7ff43810b860 2024-07-26T08:32:07.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.775+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4381a89e0 con 0x7ff43810b860 2024-07-26T08:32:07.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.777+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4381059e0 con 0x7ff43810b860 2024-07-26T08:32:07.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.779+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7ff430005560 con 0x7ff43810b860 2024-07-26T08:32:07.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.781+0000 7ff436000640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4200b3ca0 0x7ff4200b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:07.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.781+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff4300e4770 con 0x7ff43810b860 2024-07-26T08:32:07.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.781+0000 7ff43d800640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4200b3ca0 0x7ff4200b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:07.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.782+0000 7ff43d800640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4200b3ca0 0x7ff4200b61b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff42c011500 tx=0x7ff42c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:07.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.782+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff4300ab8a0 con 0x7ff43810b860 2024-07-26T08:32:07.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.994+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff438063230 con 0x7ff4200b3ca0 2024-07-26T08:32:07.999 INFO:teuthology.orchestra.run.smithi043.stdout:HOST ADDR LABELS STATUS 2024-07-26T08:32:08.000 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 172.21.15.43 2024-07-26T08:32:08.000 INFO:teuthology.orchestra.run.smithi043.stdout:smithi063 172.21.15.63 2024-07-26T08:32:08.000 INFO:teuthology.orchestra.run.smithi043.stdout:smithi133 172.21.15.133 2024-07-26T08:32:08.000 INFO:teuthology.orchestra.run.smithi043.stdout:3 hosts in cluster 2024-07-26T08:32:08.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:07.997+0000 7ff436000640 1 -- 172.21.15.43:0/2788365540 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ff438063230 con 0x7ff4200b3ca0 2024-07-26T08:32:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4200b3ca0 msgr2=0x7ff4200b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4200b3ca0 0x7ff4200b61b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff42c011500 tx=0x7ff42c005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff43810b860 msgr2=0x7ff4381a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff43810b860 0x7ff4381a1860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff430009fd0 tx=0x7ff43000ef10 comp rx=0 tx=0).stop 2024-07-26T08:32:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 shutdown_connections 2024-07-26T08:32:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4200b3ca0 0x7ff4200b61b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff43810b860 0x7ff4381a1860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff43810af10 0x7ff43819c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 --2- 172.21.15.43:0/2788365540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4381055d0 0x7ff43819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.000+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 >> 172.21.15.43:0/2788365540 conn(0x7ff438101040 msgr2=0x7ff43810a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.001+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 shutdown_connections 2024-07-26T08:32:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:08.001+0000 7ff43ec00640 1 -- 172.21.15.43:0/2788365540 wait complete. 2024-07-26T08:32:08.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:08 smithi043 ceph-mon[32384]: pgmap v454: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:08 smithi133 ceph-mon[37053]: pgmap v454: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:08 smithi063 ceph-mon[36747]: pgmap v454: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:08.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph orch device ls' 2024-07-26T08:32:09.493 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:09 smithi043 ceph-mon[32384]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:09 smithi133 ceph-mon[37053]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:09.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:09 smithi063 ceph-mon[36747]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:10 smithi043 ceph-mon[32384]: pgmap v455: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:10.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:10 smithi133 ceph-mon[37053]: pgmap v455: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:10 smithi063 ceph-mon[36747]: pgmap v455: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 -- 172.21.15.43:0/3195375135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f810af10 msgr2=0x7f56f810b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 --2- 172.21.15.43:0/3195375135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f810af10 0x7f56f810b320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009900 tx=0x7f56e002a410 comp rx=0 tx=0).stop 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 -- 172.21.15.43:0/3195375135 shutdown_connections 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 --2- 172.21.15.43:0/3195375135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 0x7f56f8112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 --2- 172.21.15.43:0/3195375135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f810af10 0x7f56f810b320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 --2- 172.21.15.43:0/3195375135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f81055d0 0x7f56f81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 -- 172.21.15.43:0/3195375135 >> 172.21.15.43:0/3195375135 conn(0x7f56f8101040 msgr2=0x7f56f8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 -- 172.21.15.43:0/3195375135 shutdown_connections 2024-07-26T08:32:11.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.831+0000 7f56f7200640 1 -- 172.21.15.43:0/3195375135 wait complete. 2024-07-26T08:32:11.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.833+0000 7f56f7200640 1 Processor -- start 2024-07-26T08:32:11.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.833+0000 7f56f7200640 1 -- start start 2024-07-26T08:32:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 0x7f56f819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f810af10 0x7f56f819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 0x7f56f81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8115640 con 0x7f56f81055d0 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81154c0 con 0x7f56f810b860 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81157c0 con 0x7f56f810af10 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 0x7f56f819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 0x7f56f819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51390/0 (socket says 172.21.15.43:51390) 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 0x7f56f81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56f5e00640 1 -- 172.21.15.43:0/223368904 learned_addr learned my addr 172.21.15.43:0/223368904 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.834+0000 7f56ed400640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f810af10 0x7f56f819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:11.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f5e00640 1 -- 172.21.15.43:0/223368904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f810af10 msgr2=0x7f56f819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:11.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f5e00640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f810af10 0x7f56f819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:11.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f5e00640 1 -- 172.21.15.43:0/223368904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 msgr2=0x7f56f81a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f5e00640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 0x7f56f81a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f5e00640 1 -- 172.21.15.43:0/223368904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f81a1f60 con 0x7f56f81055d0 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f6800640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 0x7f56f81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56ed400640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f810af10 0x7f56f819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f5e00640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 0x7f56f819bff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f56e800ebc0 tx=0x7f56e800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8010630 con 0x7f56f81055d0 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f56e8010ca0 con 0x7f56f81055d0 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.835+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f81a2250 con 0x7f56f81055d0 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.836+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8018ba0 con 0x7f56f81055d0 2024-07-26T08:32:11.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.836+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81a89b0 con 0x7f56f81055d0 2024-07-26T08:32:11.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.837+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f81059e0 con 0x7f56f81055d0 2024-07-26T08:32:11.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.839+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f56e80107d0 con 0x7f56f81055d0 2024-07-26T08:32:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.841+0000 7f56ef400640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56dc0b3c20 0x7f56dc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.841+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f56e80e4760 con 0x7f56f81055d0 2024-07-26T08:32:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.841+0000 7f56ed400640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56dc0b3c20 0x7f56dc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.842+0000 7f56ed400640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56dc0b3c20 0x7f56dc0b6130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56e0005940 tx=0x7f56e00058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:11.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:11.845+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f56e8010ac0 con 0x7f56f81055d0 2024-07-26T08:32:12.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.057+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f56f8063230 con 0x7f56dc0b3c20 2024-07-26T08:32:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.062+0000 7f56ef400640 1 -- 172.21.15.43:0/223368904 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f56f8063230 con 0x7f56dc0b3c20 2024-07-26T08:32:12.064 INFO:teuthology.orchestra.run.smithi043.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-07-26T08:32:12.064 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GH480DGN 447G No 6m ago Has a FileSystem, LVM detected 2024-07-26T08:32:12.064 INFO:teuthology.orchestra.run.smithi043.stdout:smithi063 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5344005B400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-07-26T08:32:12.065 INFO:teuthology.orchestra.run.smithi043.stdout:smithi133 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-07-26T08:32:12.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56dc0b3c20 msgr2=0x7f56dc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:12.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56dc0b3c20 0x7f56dc0b6130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56e0005940 tx=0x7f56e00058d0 comp rx=0 tx=0).stop 2024-07-26T08:32:12.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 msgr2=0x7f56f819bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:12.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 0x7f56f819bff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f56e800ebc0 tx=0x7f56e800c6a0 comp rx=0 tx=0).stop 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 shutdown_connections 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56dc0b3c20 0x7f56dc0b6130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56f810af10 0x7f56f819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f810b860 0x7f56f81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 --2- 172.21.15.43:0/223368904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56f81055d0 0x7f56f819bff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 >> 172.21.15.43:0/223368904 conn(0x7f56f8101040 msgr2=0x7f56f8103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.065+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 shutdown_connections 2024-07-26T08:32:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:12.066+0000 7f56f7200640 1 -- 172.21.15.43:0/223368904 wait complete. 2024-07-26T08:32:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:12 smithi043 ceph-mon[32384]: pgmap v456: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:12.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:12 smithi133 ceph-mon[37053]: pgmap v456: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:12.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:12 smithi063 ceph-mon[36747]: pgmap v456: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:13.259 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-07-26T08:32:13.268 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:32:13.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph fs dump' 2024-07-26T08:32:13.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:13 smithi043 ceph-mon[32384]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:13.764 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:13.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:13 smithi133 ceph-mon[37053]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:13.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:13 smithi063 ceph-mon[36747]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:32:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:14 smithi043 ceph-mon[32384]: pgmap v457: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:14 smithi133 ceph-mon[37053]: pgmap v457: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:14 smithi063 ceph-mon[36747]: pgmap v457: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:16.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 -- 172.21.15.43:0/3104676420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868075800 msgr2=0x7ff868075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:16.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 --2- 172.21.15.43:0/3104676420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868075800 0x7ff868075c10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff854009900 tx=0x7ff85402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 -- 172.21.15.43:0/3104676420 shutdown_connections 2024-07-26T08:32:16.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 --2- 172.21.15.43:0/3104676420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868113c90 0x7ff868116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 --2- 172.21.15.43:0/3104676420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868075800 0x7ff868075c10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 --2- 172.21.15.43:0/3104676420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868076db0 0x7ff8680751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 -- 172.21.15.43:0/3104676420 >> 172.21.15.43:0/3104676420 conn(0x7ff8680fee10 msgr2=0x7ff868101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:16.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 -- 172.21.15.43:0/3104676420 shutdown_connections 2024-07-26T08:32:16.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.315+0000 7ff867200640 1 -- 172.21.15.43:0/3104676420 wait complete. 2024-07-26T08:32:16.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 Processor -- start 2024-07-26T08:32:16.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 -- start start 2024-07-26T08:32:16.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868075800 0x7ff8681a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:16.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868076db0 0x7ff8681a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:16.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868113c90 0x7ff8681a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:16.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681199d0 con 0x7ff868113c90 2024-07-26T08:32:16.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff868119850 con 0x7ff868076db0 2024-07-26T08:32:16.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.317+0000 7ff867200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff868119b50 con 0x7ff868075800 2024-07-26T08:32:16.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868075800 0x7ff8681a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:16.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868075800 0x7ff8681a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51850/0 (socket says 172.21.15.43:51850) 2024-07-26T08:32:16.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865e00640 1 -- 172.21.15.43:0/240067990 learned_addr learned my addr 172.21.15.43:0/240067990 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:16.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865400640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868076db0 0x7ff8681a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:16.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff866800640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868113c90 0x7ff8681a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:16.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865400640 1 -- 172.21.15.43:0/240067990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868075800 msgr2=0x7ff8681a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:16.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865400640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868075800 0x7ff8681a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865400640 1 -- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868113c90 msgr2=0x7ff8681a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865400640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868113c90 0x7ff8681a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.318+0000 7ff865400640 1 -- 172.21.15.43:0/240067990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8681a6390 con 0x7ff868076db0 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.319+0000 7ff865400640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868076db0 0x7ff8681a09c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff854006010 tx=0x7ff854004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.319+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85403f030 con 0x7ff868076db0 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.319+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff854004440 con 0x7ff868076db0 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.319+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8681a6620 con 0x7ff868076db0 2024-07-26T08:32:16.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.319+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854035070 con 0x7ff868076db0 2024-07-26T08:32:16.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.319+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8681acde0 con 0x7ff868076db0 2024-07-26T08:32:16.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.321+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8680766f0 con 0x7ff868076db0 2024-07-26T08:32:16.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.323+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7ff854042030 con 0x7ff868076db0 2024-07-26T08:32:16.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.325+0000 7ff85ea00640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff84c0b3c20 0x7ff84c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:16.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.325+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff854104630 con 0x7ff868076db0 2024-07-26T08:32:16.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.325+0000 7ff865e00640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff84c0b3c20 0x7ff84c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:16.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.326+0000 7ff865e00640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff84c0b3c20 0x7ff84c0b6130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff858009c90 tx=0x7ff858005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:16.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.326+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff8540cb110 con 0x7ff868076db0 2024-07-26T08:32:16.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.569+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff8681129c0 con 0x7ff868076db0 2024-07-26T08:32:16.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.570+0000 7ff85ea00640 1 -- 172.21.15.43:0/240067990 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3078 (secure 0 0 0) 0x7ff8540cf660 con 0x7ff868076db0 2024-07-26T08:32:16.573 INFO:teuthology.orchestra.run.smithi043.stdout:e24 2024-07-26T08:32:16.573 INFO:teuthology.orchestra.run.smithi043.stdout:btime 2024-07-26T08:29:08:768082+0000 2024-07-26T08:32:16.573 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-07-26T08:32:16.573 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 24 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-07-26T08:27:37.509952+0000 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-07-26T08:29:08.612953+0000 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 300 2024-07-26T08:32:16.574 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 3 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1,2 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=24733,1=24710,2=24709} 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2024-07-26T08:32:16.575 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3,4] 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 0 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:qdb_cluster leader: 24733 members: 24709,24710,24733 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a{0:24733} state up:active seq 8 addr [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c{0:24697} state up:standby-replay seq 1 addr [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b{1:24710} state up:active seq 28 addr [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.576 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.g{1:24686} state up:standby-replay seq 1 addr [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.i{2:24709} state up:active seq 32 addr [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.f{2:24685} state up:standby-replay seq 1 addr [v2:172.21.15.133:6834/1306232427,v1:172.21.15.133:6835/1306232427] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.k{-1:24620} state up:standby seq 1 addr [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d{-1:24638} state up:standby seq 1 addr [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.l{-1:24640} state up:standby seq 1 addr [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.e{-1:24650} state up:standby seq 1 addr [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.h{-1:24668} state up:standby seq 1 addr [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T08:32:16.578 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:32:16.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff84c0b3c20 msgr2=0x7ff84c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:16.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff84c0b3c20 0x7ff84c0b6130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff858009c90 tx=0x7ff858005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:16.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868076db0 msgr2=0x7ff8681a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868076db0 0x7ff8681a09c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff854006010 tx=0x7ff854004040 comp rx=0 tx=0).stop 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 shutdown_connections 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff84c0b3c20 0x7ff84c0b6130 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff868113c90 0x7ff8681a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff868076db0 0x7ff8681a09c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 --2- 172.21.15.43:0/240067990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff868075800 0x7ff8681a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.573+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 >> 172.21.15.43:0/240067990 conn(0x7ff8680fee10 msgr2=0x7ff86810fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.574+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 shutdown_connections 2024-07-26T08:32:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:16.574+0000 7ff867200640 1 -- 172.21.15.43:0/240067990 wait complete. 2024-07-26T08:32:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:16 smithi043 ceph-mon[32384]: pgmap v458: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:16 smithi133 ceph-mon[37053]: pgmap v458: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:16 smithi063 ceph-mon[36747]: pgmap v458: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:17.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- bash -c 'ceph osd dump' 2024-07-26T08:32:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:17 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/240067990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-26T08:32:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:17 smithi043 ceph-mon[32384]: pgmap v459: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:17.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:17 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/240067990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-26T08:32:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:17 smithi133 ceph-mon[37053]: pgmap v459: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:17 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/240067990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-26T08:32:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:17 smithi063 ceph-mon[36747]: pgmap v459: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:18.029 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:20.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:19 smithi043 ceph-mon[32384]: pgmap v460: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:20.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:19 smithi133 ceph-mon[37053]: pgmap v460: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:20.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:19 smithi063 ceph-mon[36747]: pgmap v460: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 -- 172.21.15.43:0/3536494013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb410b860 msgr2=0x7f2eb4112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 --2- 172.21.15.43:0/3536494013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb410b860 0x7f2eb4112090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009ca0 tx=0x7f2eb002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 -- 172.21.15.43:0/3536494013 shutdown_connections 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 --2- 172.21.15.43:0/3536494013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb410af10 0x7f2eb410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 --2- 172.21.15.43:0/3536494013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb410b860 0x7f2eb4112090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 --2- 172.21.15.43:0/3536494013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb41055d0 0x7f2eb41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 -- 172.21.15.43:0/3536494013 >> 172.21.15.43:0/3536494013 conn(0x7f2eb4101040 msgr2=0x7f2eb4103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 -- 172.21.15.43:0/3536494013 shutdown_connections 2024-07-26T08:32:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.461+0000 7f2ebb200640 1 -- 172.21.15.43:0/3536494013 wait complete. 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.462+0000 7f2ebb200640 1 Processor -- start 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.462+0000 7f2ebb200640 1 -- start start 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2ebb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 0x7f2eb419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2ebb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb410af10 0x7f2eb419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2ebb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb410b860 0x7f2eb41a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2ebb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4115640 con 0x7f2eb41055d0 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2ebb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb41154c0 con 0x7f2eb410b860 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2ebb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb41157c0 con 0x7f2eb410af10 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2eb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 0x7f2eb419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2eb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 0x7f2eb419bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56110/0 (socket says 172.21.15.43:56110) 2024-07-26T08:32:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2eb9e00640 1 -- 172.21.15.43:0/4009040727 learned_addr learned my addr 172.21.15.43:0/4009040727 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:20.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2eba800640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb410b860 0x7f2eb41a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:20.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.463+0000 7f2eb9400640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb410af10 0x7f2eb419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:20.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eb9e00640 1 -- 172.21.15.43:0/4009040727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb410af10 msgr2=0x7f2eb419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eb9e00640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb410af10 0x7f2eb419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eb9e00640 1 -- 172.21.15.43:0/4009040727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb410b860 msgr2=0x7f2eb41a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eb9e00640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb410b860 0x7f2eb41a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eb9e00640 1 -- 172.21.15.43:0/4009040727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb41a1f00 con 0x7f2eb41055d0 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eba800640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb410b860 0x7f2eb41a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eb9e00640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 0x7f2eb419bf90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e9f0 tx=0x7f2ea800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.464+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800cd80 con 0x7f2eb41055d0 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.465+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea8010900 con 0x7f2eb41055d0 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.465+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb41a21f0 con 0x7f2eb41055d0 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.465+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb41a8950 con 0x7f2eb41055d0 2024-07-26T08:32:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.465+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8018900 con 0x7f2eb41055d0 2024-07-26T08:32:20.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.466+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb41059e0 con 0x7f2eb41055d0 2024-07-26T08:32:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.469+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f2ea8010ab0 con 0x7f2eb41055d0 2024-07-26T08:32:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.470+0000 7f2eaea00640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2e9c0b3c20 0x7f2e9c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.470+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f2ea80e46f0 con 0x7f2eb41055d0 2024-07-26T08:32:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.471+0000 7f2eb9400640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2e9c0b3c20 0x7f2e9c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:20.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.472+0000 7f2eb9400640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2e9c0b3c20 0x7f2e9c0b6130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4104890 tx=0x7f2ea4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:20.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.473+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2ea80ab1d0 con 0x7f2eb41055d0 2024-07-26T08:32:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.677+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f2eb402e0c0 con 0x7f2eb41055d0 2024-07-26T08:32:20.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.680+0000 7f2eaea00640 1 -- 172.21.15.43:0/4009040727 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+6097 (secure 0 0 0) 0x7f2ea80af720 con 0x7f2eb41055d0 2024-07-26T08:32:20.685 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 90 2024-07-26T08:32:20.685 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T08:32:20.685 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-07-26T08:17:03.796350+0000 2024-07-26T08:32:20.685 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-07-26T08:29:36.355318+0000 2024-07-26T08:32:20.685 INFO:teuthology.orchestra.run.smithi043.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-07-26T08:32:20.686 INFO:teuthology.orchestra.run.smithi043.stdout:crush_version 27 2024-07-26T08:32:20.686 INFO:teuthology.orchestra.run.smithi043.stdout:full_ratio 0.95 2024-07-26T08:32:20.686 INFO:teuthology.orchestra.run.smithi043.stdout:backfillfull_ratio 0.9 2024-07-26T08:32:20.686 INFO:teuthology.orchestra.run.smithi043.stdout:nearfull_ratio 0.85 2024-07-26T08:32:20.686 INFO:teuthology.orchestra.run.smithi043.stdout:require_min_compat_client luminous 2024-07-26T08:32:20.687 INFO:teuthology.orchestra.run.smithi043.stdout:min_compat_client luminous 2024-07-26T08:32:20.687 INFO:teuthology.orchestra.run.smithi043.stdout:require_osd_release squid 2024-07-26T08:32:20.687 INFO:teuthology.orchestra.run.smithi043.stdout:stretch_mode_enabled false 2024-07-26T08:32:20.687 INFO:teuthology.orchestra.run.smithi043.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-07-26T08:32:20.687 INFO:teuthology.orchestra.run.smithi043.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-07-26T08:32:20.688 INFO:teuthology.orchestra.run.smithi043.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-07-26T08:32:20.688 INFO:teuthology.orchestra.run.smithi043.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-07-26T08:32:20.688 INFO:teuthology.orchestra.run.smithi043.stdout:max_osd 12 2024-07-26T08:32:20.688 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 up in weight 1 up_from 9 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6802/4198258089,v1:172.21.15.43:6803/4198258089] [v2:172.21.15.43:6804/4198258089,v1:172.21.15.43:6805/4198258089] exists,up dce96d84-5cb4-44d8-8562-8b0c37d34d3e 2024-07-26T08:32:20.688 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 up in weight 1 up_from 14 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/2190025564,v1:172.21.15.63:6801/2190025564] [v2:172.21.15.63:6802/2190025564,v1:172.21.15.63:6803/2190025564] exists,up 2eae29bd-b685-4687-be6b-b9bc8014a1f1 2024-07-26T08:32:20.689 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 up in weight 1 up_from 19 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6800/2705571289,v1:172.21.15.133:6801/2705571289] [v2:172.21.15.133:6802/2705571289,v1:172.21.15.133:6803/2705571289] exists,up db61971e-05a7-4ea1-8c58-162bd956e3e4 2024-07-26T08:32:20.689 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6810/1603187116,v1:172.21.15.43:6811/1603187116] [v2:172.21.15.43:6812/1603187116,v1:172.21.15.43:6813/1603187116] exists,up b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6 2024-07-26T08:32:20.689 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 up in weight 1 up_from 32 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6808/4195824513,v1:172.21.15.63:6809/4195824513] [v2:172.21.15.63:6810/4195824513,v1:172.21.15.63:6811/4195824513] exists,up 3d643d69-23cc-46a6-9d86-2ca64b4ac93b 2024-07-26T08:32:20.689 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 up in weight 1 up_from 37 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6808/3668705015,v1:172.21.15.133:6809/3668705015] [v2:172.21.15.133:6810/3668705015,v1:172.21.15.133:6811/3668705015] exists,up bd66c187-2fc3-4e36-bf8c-6e9af071950f 2024-07-26T08:32:20.689 INFO:teuthology.orchestra.run.smithi043.stdout:osd.6 up in weight 1 up_from 43 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6818/4290651023,v1:172.21.15.43:6819/4290651023] [v2:172.21.15.43:6820/4290651023,v1:172.21.15.43:6821/4290651023] exists,up ff098a4b-47d7-4d9f-856a-dc459c4c50de 2024-07-26T08:32:20.690 INFO:teuthology.orchestra.run.smithi043.stdout:osd.7 up in weight 1 up_from 48 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/2487519,v1:172.21.15.63:6817/2487519] [v2:172.21.15.63:6818/2487519,v1:172.21.15.63:6819/2487519] exists,up d2265c2c-251d-48f2-9310-172326a91490 2024-07-26T08:32:20.690 INFO:teuthology.orchestra.run.smithi043.stdout:osd.8 up in weight 1 up_from 54 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6816/868830377,v1:172.21.15.133:6817/868830377] [v2:172.21.15.133:6818/868830377,v1:172.21.15.133:6819/868830377] exists,up 13ecadf6-6a1a-4f91-a2b2-eac06fb449d3 2024-07-26T08:32:20.690 INFO:teuthology.orchestra.run.smithi043.stdout:osd.9 up in weight 1 up_from 60 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6826/2141095989,v1:172.21.15.43:6827/2141095989] [v2:172.21.15.43:6828/2141095989,v1:172.21.15.43:6829/2141095989] exists,up 4273c6ec-9a65-4f59-8200-0aad0c554159 2024-07-26T08:32:20.690 INFO:teuthology.orchestra.run.smithi043.stdout:osd.10 up in weight 1 up_from 65 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6824/2504233154,v1:172.21.15.63:6825/2504233154] [v2:172.21.15.63:6826/2504233154,v1:172.21.15.63:6827/2504233154] exists,up 8edd2a1c-458b-4853-894d-572b92611d54 2024-07-26T08:32:20.690 INFO:teuthology.orchestra.run.smithi043.stdout:osd.11 up in weight 1 up_from 71 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6824/1325192368,v1:172.21.15.133:6825/1325192368] [v2:172.21.15.133:6826/1325192368,v1:172.21.15.133:6827/1325192368] exists,up 0b14cd08-5f61-4099-ade0-1f87dcee15d5 2024-07-26T08:32:20.691 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.4 [2,11] 2024-07-26T08:32:20.691 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.8 [2,11] 2024-07-26T08:32:20.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.1f [8,4] 2024-07-26T08:32:20.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.0 [4,6] 2024-07-26T08:32:20.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.3 [4,9] 2024-07-26T08:32:20.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.e [4,8] 2024-07-26T08:32:20.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.1b [3,6] 2024-07-26T08:32:20.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.25 [5,9] 2024-07-26T08:32:20.693 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.27 [3,9] 2024-07-26T08:32:20.693 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.37 [5,7] 2024-07-26T08:32:20.693 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.3a [4,8] 2024-07-26T08:32:20.693 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.5 [9,10] 2024-07-26T08:32:20.693 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.14 [9,8] 2024-07-26T08:32:20.693 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.18 [9,8] 2024-07-26T08:32:20.694 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.1d [5,8] 2024-07-26T08:32:20.694 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/3742875375 expires 2024-07-27T08:19:34.498126+0000 2024-07-26T08:32:20.694 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1444395529 expires 2024-07-27T08:17:40.568271+0000 2024-07-26T08:32:20.694 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/4108155415 expires 2024-07-27T08:19:34.498126+0000 2024-07-26T08:32:20.694 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/3582942481 expires 2024-07-27T08:17:40.568271+0000 2024-07-26T08:32:20.695 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1591014211 expires 2024-07-27T08:17:40.568271+0000 2024-07-26T08:32:20.695 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/1663543642 expires 2024-07-27T08:17:40.568271+0000 2024-07-26T08:32:20.695 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/3446770894 expires 2024-07-27T08:19:34.498126+0000 2024-07-26T08:32:20.695 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/1663543642 expires 2024-07-27T08:17:40.568271+0000 2024-07-26T08:32:20.695 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/3742875375 expires 2024-07-27T08:19:34.498126+0000 2024-07-26T08:32:20.695 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/2150907670 expires 2024-07-27T08:18:11.763386+0000 2024-07-26T08:32:20.696 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/1482734723 expires 2024-07-27T08:18:11.763386+0000 2024-07-26T08:32:20.696 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/1482734723 expires 2024-07-27T08:18:11.763386+0000 2024-07-26T08:32:20.696 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/2372393330 expires 2024-07-27T08:19:34.498126+0000 2024-07-26T08:32:20.696 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/711369665 expires 2024-07-27T08:18:11.763386+0000 2024-07-26T08:32:20.696 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1785866462 expires 2024-07-27T08:18:11.763386+0000 2024-07-26T08:32:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2e9c0b3c20 msgr2=0x7f2e9c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2e9c0b3c20 0x7f2e9c0b6130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4104890 tx=0x7f2ea4005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 msgr2=0x7f2eb419bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 0x7f2eb419bf90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e9f0 tx=0x7f2ea800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 shutdown_connections 2024-07-26T08:32:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2e9c0b3c20 0x7f2e9c0b6130 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb410af10 0x7f2eb419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2eb410b860 0x7f2eb41a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 --2- 172.21.15.43:0/4009040727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb41055d0 0x7f2eb419bf90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.683+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 >> 172.21.15.43:0/4009040727 conn(0x7f2eb4101040 msgr2=0x7f2eb41094f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.684+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 shutdown_connections 2024-07-26T08:32:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:20.684+0000 7f2ebb200640 1 -- 172.21.15.43:0/4009040727 wait complete. 2024-07-26T08:32:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:20 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/4009040727' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-26T08:32:21.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:20 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/4009040727' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-26T08:32:21.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:20 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/4009040727' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-26T08:32:21.674 INFO:teuthology.run_tasks:Running task fs.ready... 2024-07-26T08:32:21.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:32:22.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:21 smithi043 ceph-mon[32384]: pgmap v461: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:21 smithi133 ceph-mon[37053]: pgmap v461: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:22.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:21 smithi063 ceph-mon[36747]: pgmap v461: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:24.063 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:23 smithi043 ceph-mon[32384]: pgmap v462: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:23 smithi133 ceph-mon[37053]: pgmap v462: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:24.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:23 smithi063 ceph-mon[36747]: pgmap v462: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 -- 172.21.15.43:0/3672175205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 msgr2=0x7f1014075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 --2- 172.21.15.43:0/3672175205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f1014075c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009900 tx=0x7f0ffc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 -- 172.21.15.43:0/3672175205 shutdown_connections 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 --2- 172.21.15.43:0/3672175205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014113cb0 0x7f1014116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 --2- 172.21.15.43:0/3672175205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f1014075c10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 --2- 172.21.15.43:0/3672175205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1014076db0 0x7f10140751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 -- 172.21.15.43:0/3672175205 >> 172.21.15.43:0/3672175205 conn(0x7f10140fee70 msgr2=0x7f10141012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:24.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 -- 172.21.15.43:0/3672175205 shutdown_connections 2024-07-26T08:32:24.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.713+0000 7f1013200640 1 -- 172.21.15.43:0/3672175205 wait complete. 2024-07-26T08:32:24.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 Processor -- start 2024-07-26T08:32:24.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 -- start start 2024-07-26T08:32:24.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f10141a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014076db0 0x7f10141a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1014113cb0 0x7f10141a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1014119a60 con 0x7f1014076db0 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10141198e0 con 0x7f1014075800 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.715+0000 7f1013200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1014119be0 con 0x7f1014113cb0 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014076db0 0x7f10141a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f10141a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f10141a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:40170/0 (socket says 172.21.15.43:40170) 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 -- 172.21.15.43:0/1142344302 learned_addr learned my addr 172.21.15.43:0/1142344302 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014076db0 0x7f10141a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56130/0 (socket says 172.21.15.43:56130) 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1012800640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1014113cb0 0x7f10141a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:24.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 -- 172.21.15.43:0/1142344302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1014113cb0 msgr2=0x7f10141a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1014113cb0 0x7f10141a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 -- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014076db0 msgr2=0x7f10141a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014076db0 0x7f10141a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.716+0000 7f1011e00640 1 -- 172.21.15.43:0/1142344302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10141a6380 con 0x7f1014075800 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.717+0000 7f1011e00640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f10141a0410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f100400e9f0 tx=0x7f100400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.717+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100400cd80 con 0x7f1014075800 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.717+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10141a6670 con 0x7f1014075800 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.717+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10040054f0 con 0x7f1014075800 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.717+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004010690 con 0x7f1014075800 2024-07-26T08:32:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.717+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10141acdd0 con 0x7f1014075800 2024-07-26T08:32:24.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.718+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10140766f0 con 0x7f1014075800 2024-07-26T08:32:24.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.721+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f10040046c0 con 0x7f1014075800 2024-07-26T08:32:24.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.723+0000 7f100aa00640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ff40b3c20 0x7f0ff40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:24.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.723+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f10040e46c0 con 0x7f1014075800 2024-07-26T08:32:24.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.723+0000 7f1011400640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ff40b3c20 0x7f0ff40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:24.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.724+0000 7f1011400640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ff40b3c20 0x7f0ff40b6130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc004770 tx=0x7f0ffc000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:24.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.724+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1004055600 con 0x7f1014075800 2024-07-26T08:32:24.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.956+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1014075c10 con 0x7f1014075800 2024-07-26T08:32:24.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.957+0000 7f100aa00640 1 -- 172.21.15.43:0/1142344302 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11895 (secure 0 0 0) 0x7f1014075c10 con 0x7f1014075800 2024-07-26T08:32:24.960 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:24.960 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"btime":"2024-07-26T08:29:08:768082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:29:08.612953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24709,24710,24733]},"id":1}]} 2024-07-26T08:32:24.960 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ff40b3c20 msgr2=0x7f0ff40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ff40b3c20 0x7f0ff40b6130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc004770 tx=0x7f0ffc000bc0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 msgr2=0x7f10141a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f10141a0410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f100400e9f0 tx=0x7f100400edf0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 shutdown_connections 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0ff40b3c20 0x7f0ff40b6130 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1014113cb0 0x7f10141a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1014076db0 0x7f10141a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 --2- 172.21.15.43:0/1142344302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014075800 0x7f10141a0410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:24.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.960+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 >> 172.21.15.43:0/1142344302 conn(0x7f10140fee70 msgr2=0x7f101410fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:24.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.961+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 shutdown_connections 2024-07-26T08:32:24.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:24.961+0000 7f1013200640 1 -- 172.21.15.43:0/1142344302 wait complete. 2024-07-26T08:32:25.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:32:26.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:25 smithi043 ceph-mon[32384]: pgmap v463: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:26.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:25 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1142344302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:32:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:25 smithi133 ceph-mon[37053]: pgmap v463: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:25 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1142344302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:32:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:25 smithi063 ceph-mon[36747]: pgmap v463: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:25 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1142344302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:32:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:28.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:27 smithi043 ceph-mon[32384]: pgmap v464: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:27 smithi133 ceph-mon[37053]: pgmap v464: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:28.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:27 smithi063 ceph-mon[36747]: pgmap v464: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.772+0000 7f00e6c00640 1 -- 172.21.15.43:0/64393287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e0108f20 msgr2=0x7f00e0109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.772+0000 7f00e6c00640 1 --2- 172.21.15.43:0/64393287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e0108f20 0x7f00e0109330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009900 tx=0x7f00c802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:32:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.772+0000 7f00e6c00640 1 -- 172.21.15.43:0/64393287 shutdown_connections 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.772+0000 7f00e6c00640 1 --2- 172.21.15.43:0/64393287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 0x7f00e01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.772+0000 7f00e6c00640 1 --2- 172.21.15.43:0/64393287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e0108f20 0x7f00e0109330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.772+0000 7f00e6c00640 1 --2- 172.21.15.43:0/64393287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e01035e0 0x7f00e01039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.773+0000 7f00e6c00640 1 -- 172.21.15.43:0/64393287 >> 172.21.15.43:0/64393287 conn(0x7f00e00ff030 msgr2=0x7f00e0101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.773+0000 7f00e6c00640 1 -- 172.21.15.43:0/64393287 shutdown_connections 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.773+0000 7f00e6c00640 1 -- 172.21.15.43:0/64393287 wait complete. 2024-07-26T08:32:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.774+0000 7f00e6c00640 1 Processor -- start 2024-07-26T08:32:28.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.774+0000 7f00e6c00640 1 -- start start 2024-07-26T08:32:28.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00e6c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 0x7f00e019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:28.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00e6c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e0108f20 0x7f00e019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:28.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00e6c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 0x7f00e01a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:28.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00e6c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01136a0 con 0x7f00e0108f20 2024-07-26T08:32:28.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00e6c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0113520 con 0x7f00e01035e0 2024-07-26T08:32:28.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00e6c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0113820 con 0x7f00e0109870 2024-07-26T08:32:28.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00dfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 0x7f00e019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00dfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 0x7f00e019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36164/0 (socket says 172.21.15.43:36164) 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00dfe00640 1 -- 172.21.15.43:0/3063728255 learned_addr learned my addr 172.21.15.43:0/3063728255 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.775+0000 7f00d7e00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e0108f20 0x7f00e019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 0x7f00e01a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 -- 172.21.15.43:0/3063728255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 msgr2=0x7f00e019c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 0x7f00e019c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 -- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e0108f20 msgr2=0x7f00e019c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e0108f20 0x7f00e019c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 -- 172.21.15.43:0/3063728255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e01a2180 con 0x7f00e0109870 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00dfe00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 0x7f00e019c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00d7e00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e0108f20 0x7f00e019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.776+0000 7f00e4c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 0x7f00e01a1a50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009fd0 tx=0x7f00d800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:28.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.777+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d800ce20 con 0x7f00e0109870 2024-07-26T08:32:28.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.777+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e01a2470 con 0x7f00e0109870 2024-07-26T08:32:28.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.777+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00d8005020 con 0x7f00e0109870 2024-07-26T08:32:28.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.777+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8010720 con 0x7f00e0109870 2024-07-26T08:32:28.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.777+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01a8bd0 con 0x7f00e0109870 2024-07-26T08:32:28.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.778+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e01039f0 con 0x7f00e0109870 2024-07-26T08:32:28.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.781+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f00d8005560 con 0x7f00e0109870 2024-07-26T08:32:28.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.782+0000 7f00dd600640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f00c40b3c20 0x7f00c40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:28.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.783+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f00d80e47c0 con 0x7f00e0109870 2024-07-26T08:32:28.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.783+0000 7f00dfe00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f00c40b3c20 0x7f00c40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:28.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.783+0000 7f00dfe00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f00c40b3c20 0x7f00c40b6130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00d0011550 tx=0x7f00d0005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:28.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:28.784+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f00d80ab8f0 con 0x7f00e0109870 2024-07-26T08:32:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.024+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e019d340 con 0x7f00e0109870 2024-07-26T08:32:29.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.026+0000 7f00dd600640 1 -- 172.21.15.43:0/3063728255 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11895 (secure 0 0 0) 0x7f00e019d340 con 0x7f00e0109870 2024-07-26T08:32:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:29.028 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"btime":"2024-07-26T08:29:08:768082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:29:08.612953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24709,24710,24733]},"id":1}]} 2024-07-26T08:32:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.028+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f00c40b3c20 msgr2=0x7f00c40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.028+0000 7f00e6c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f00c40b3c20 0x7f00c40b6130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00d0011550 tx=0x7f00d0005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.028+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 msgr2=0x7f00e01a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.028+0000 7f00e6c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 0x7f00e01a1a50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009fd0 tx=0x7f00d800ef10 comp rx=0 tx=0).stop 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 shutdown_connections 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f00c40b3c20 0x7f00c40b6130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e0109870 0x7f00e01a1a50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00e0108f20 0x7f00e019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 --2- 172.21.15.43:0/3063728255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00e01035e0 0x7f00e019c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 >> 172.21.15.43:0/3063728255 conn(0x7f00e00ff030 msgr2=0x7f00e0108530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 shutdown_connections 2024-07-26T08:32:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:29.029+0000 7f00e6c00640 1 -- 172.21.15.43:0/3063728255 wait complete. 2024-07-26T08:32:30.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:32:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:29 smithi043 ceph-mon[32384]: pgmap v465: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:29 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3063728255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:32:30.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:29 smithi133 ceph-mon[37053]: pgmap v465: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:30.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:29 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3063728255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:32:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:29 smithi063 ceph-mon[36747]: pgmap v465: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:29 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3063728255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:32:30.506 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:31 smithi043 ceph-mon[32384]: pgmap v466: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:32.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:31 smithi133 ceph-mon[37053]: pgmap v466: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:32.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:31 smithi063 ceph-mon[36747]: pgmap v466: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 -- 172.21.15.43:0/2038157600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 msgr2=0x7f8d8c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 --2- 172.21.15.43:0/2038157600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c10d0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009860 tx=0x7f8d7402a340 comp rx=0 tx=0).stop 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 -- 172.21.15.43:0/2038157600 shutdown_connections 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 --2- 172.21.15.43:0/2038157600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8c10d690 0x7f8d8c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 --2- 172.21.15.43:0/2038157600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c10d0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 --2- 172.21.15.43:0/2038157600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 0x7f8d8c104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.091+0000 7f8d91c00640 1 -- 172.21.15.43:0/2038157600 >> 172.21.15.43:0/2038157600 conn(0x7f8d8c0fdd30 msgr2=0x7f8d8c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.092+0000 7f8d91c00640 1 -- 172.21.15.43:0/2038157600 shutdown_connections 2024-07-26T08:32:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.092+0000 7f8d91c00640 1 -- 172.21.15.43:0/2038157600 wait complete. 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.093+0000 7f8d91c00640 1 Processor -- start 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.093+0000 7f8d91c00640 1 -- start start 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.093+0000 7f8d91c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 0x7f8d8c19bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.093+0000 7f8d91c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d91c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8c10d690 0x7f8d8c1a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d91c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c1133f0 con 0x7f8d8c104b80 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d91c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c113270 con 0x7f8d8c10d690 2024-07-26T08:32:33.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d91c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c113570 con 0x7f8d8c104230 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 0x7f8d8c19bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c19c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59154/0 (socket says 172.21.15.43:59154) 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 -- 172.21.15.43:0/1595619872 learned_addr learned my addr 172.21.15.43:0/1595619872 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d91200640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8c10d690 0x7f8d8c1a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 -- 172.21.15.43:0/1595619872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 msgr2=0x7f8d8c19bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 0x7f8d8c19bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 -- 172.21.15.43:0/1595619872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8c10d690 msgr2=0x7f8d8c1a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8c10d690 0x7f8d8c1a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d83e00640 1 -- 172.21.15.43:0/1595619872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c1a1f50 con 0x7f8d8c104b80 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.094+0000 7f8d8be00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 0x7f8d8c19bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:33.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.095+0000 7f8d83e00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c19c580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d74035040 tx=0x7f8d7402aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:33.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.095+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7403f020 con 0x7f8d8c104b80 2024-07-26T08:32:33.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.095+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c1a21e0 con 0x7f8d8c104b80 2024-07-26T08:32:33.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.095+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d74033dd0 con 0x7f8d8c104b80 2024-07-26T08:32:33.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.095+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74037040 con 0x7f8d8c104b80 2024-07-26T08:32:33.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.095+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1a89a0 con 0x7f8d8c104b80 2024-07-26T08:32:33.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.097+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c104640 con 0x7f8d8c104b80 2024-07-26T08:32:33.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.099+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f8d74042020 con 0x7f8d8c104b80 2024-07-26T08:32:33.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.101+0000 7f8d89600640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8d700b3c20 0x7f8d700b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:33.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.101+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f8d74104320 con 0x7f8d8c104b80 2024-07-26T08:32:33.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.101+0000 7f8d8be00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8d700b3c20 0x7f8d700b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:33.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.102+0000 7f8d8be00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8d700b3c20 0x7f8d700b6130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009fc0 tx=0x7f8d7c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:33.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.103+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8d74049020 con 0x7f8d8c104b80 2024-07-26T08:32:33.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.315+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d8c1a8ba0 con 0x7f8d8c104b80 2024-07-26T08:32:33.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.320+0000 7f8d89600640 1 -- 172.21.15.43:0/1595619872 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7f8d740cb450 con 0x7f8d8c104b80 2024-07-26T08:32:33.322 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:32:33.322 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8d700b3c20 msgr2=0x7f8d700b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8d700b3c20 0x7f8d700b6130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009fc0 tx=0x7f8d7c005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 msgr2=0x7f8d8c19c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c19c580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d74035040 tx=0x7f8d7402aeb0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 shutdown_connections 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8d700b3c20 0x7f8d700b6130 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d8c10d690 0x7f8d8c1a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d8c104b80 0x7f8d8c19c580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 --2- 172.21.15.43:0/1595619872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d8c104230 0x7f8d8c19bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:33.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 >> 172.21.15.43:0/1595619872 conn(0x7f8d8c0fdd30 msgr2=0x7f8d8c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:33.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 shutdown_connections 2024-07-26T08:32:33.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:33.323+0000 7f8d91c00640 1 -- 172.21.15.43:0/1595619872 wait complete. 2024-07-26T08:32:33.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:33 smithi043 ceph-mon[32384]: pgmap v467: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:33 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1595619872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:32:34.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:33 smithi133 ceph-mon[37053]: pgmap v467: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:33 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1595619872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:32:34.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:33 smithi063 ceph-mon[36747]: pgmap v467: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:34.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:33 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1595619872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:32:34.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-26T08:27:37.509952+0000', 'modified': '2024-07-26T08:29:08.612953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24733, 'mds_1': 24710, 'mds_2': 24709}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24685': {'gid': 24685, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/1306232427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1306232427}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1306232427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'g', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/2240411764', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 2240411764}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 2240411764}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24697': {'gid': 24697, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6837/2370435591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2370435591}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2370435591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24709': {'gid': 24709, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.133:6839/475376324', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 475376324}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 475376324}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24710': {'gid': 24710, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 28, 'addr': '172.21.15.63:6839/3045590383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6838', 'nonce': 3045590383}, {'type': 'v1', 'addr': '172.21.15.63:6839', 'nonce': 3045590383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24733': {'gid': 24733, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6841/445875183', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6840', 'nonce': 445875183}, {'type': 'v1', 'addr': '172.21.15.43:6841', 'nonce': 445875183}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24733, 'qdb_cluster': [24709, 24710, 24733]} 2024-07-26T08:32:34.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-07-26T08:32:34.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.i status 2024-07-26T08:32:34.818 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:35 smithi043 ceph-mon[32384]: pgmap v468: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:35 smithi133 ceph-mon[37053]: pgmap v468: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:35 smithi063 ceph-mon[36747]: pgmap v468: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3849853698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f6010b860 msgr2=0x7f7f60112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3849853698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f6010b860 0x7f7f60112090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009be0 tx=0x7f7f5802a6c0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3849853698 shutdown_connections 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3849853698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f6010b860 0x7f7f60112090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3849853698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6010af10 0x7f7f6010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3849853698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f601055d0 0x7f7f601059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3849853698 >> 172.21.15.43:0/3849853698 conn(0x7f7f60101040 msgr2=0x7f7f60103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3849853698 shutdown_connections 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.319+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3849853698 wait complete. 2024-07-26T08:32:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.321+0000 7f7f5fe00640 1 Processor -- start 2024-07-26T08:32:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.321+0000 7f7f5fe00640 1 -- start start 2024-07-26T08:32:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f601055d0 0x7f7f6019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 0x7f7f6019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6010b860 0x7f7f601a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f60115660 con 0x7f7f6010b860 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601154e0 con 0x7f7f6010af10 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601157e0 con 0x7f7f601055d0 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f601055d0 0x7f7f6019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 0x7f7f6019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 0x7f7f6019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:58072/0 (socket says 172.21.15.43:58072) 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f57e00640 1 -- 172.21.15.43:0/3418349212 learned_addr learned my addr 172.21.15.43:0/3418349212 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f601055d0 0x7f7f6019bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:36436/0 (socket says 172.21.15.43:36436) 2024-07-26T08:32:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.322+0000 7f7f5f400640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6010b860 0x7f7f601a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.323+0000 7f7f57e00640 1 -- 172.21.15.43:0/3418349212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f601055d0 msgr2=0x7f7f6019bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.323+0000 7f7f57e00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f601055d0 0x7f7f6019bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.323+0000 7f7f57e00640 1 -- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6010b860 msgr2=0x7f7f601a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.323+0000 7f7f57e00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6010b860 0x7f7f601a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.323+0000 7f7f57e00640 1 -- 172.21.15.43:0/3418349212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f601a1ee0 con 0x7f7f6010af10 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.323+0000 7f7f57e00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 0x7f7f6019c510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f480058c0 tx=0x7f7f4800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.324+0000 7f7f57400640 1 -- 172.21.15.43:0/3418349212 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800cd30 con 0x7f7f6010af10 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.324+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f601a21d0 con 0x7f7f6010af10 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.324+0000 7f7f57400640 1 -- 172.21.15.43:0/3418349212 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f480035f0 con 0x7f7f6010af10 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.324+0000 7f7f57400640 1 -- 172.21.15.43:0/3418349212 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48010690 con 0x7f7f6010af10 2024-07-26T08:32:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.324+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f601a8930 con 0x7f7f6010af10 2024-07-26T08:32:37.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.327+0000 7f7f6c5f0740 1 Processor -- start 2024-07-26T08:32:37.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.327+0000 7f7f6c5f0740 1 -- start start 2024-07-26T08:32:37.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab12780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab12cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab13200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55726aa88970 con 0x55726a74c280 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55726aa77e70 con 0x55726a7440a0 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55726aa7beb0 con 0x55726a76cf60 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f57400640 1 -- 172.21.15.43:0/3418349212 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f7f48004000 con 0x7f7f6010af10 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f5f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab12780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab12cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f5f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab12780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:36450/0 (socket says 172.21.15.43:36450) 2024-07-26T08:32:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f5f400640 1 -- 172.21.15.43:0/333795136 learned_addr learned my addr 172.21.15.43:0/333795136 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.328+0000 7f7f57e00640 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab13200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5f400640 1 -- 172.21.15.43:0/333795136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 msgr2=0x55726ab12cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5f400640 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab12cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5f400640 1 -- 172.21.15.43:0/333795136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 msgr2=0x55726ab13200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5f400640 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab13200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5f400640 1 -- 172.21.15.43:0/333795136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726aa1f110 con 0x55726a76cf60 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab12cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.329+0000 7f7f5f400640 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab12780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f5802acb0 tx=0x7f7f58030420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842000a591973369 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.330+0000 7f7f4fe00640 1 -- 172.21.15.43:0/333795136 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58041070 con 0x55726a76cf60 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.330+0000 7f7f4fe00640 1 -- 172.21.15.43:0/333795136 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f58003e40 con 0x55726a76cf60 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.330+0000 7f7f4fe00640 1 -- 172.21.15.43:0/333795136 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58036040 con 0x55726a76cf60 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.330+0000 7f7f57400640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7f440b3c20 0x7f7f440b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.330+0000 7f7f57400640 1 -- 172.21.15.43:0/3418349212 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f7f480e4470 con 0x7f7f6010af10 2024-07-26T08:32:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.330+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7f440b3c20 0x7f7f440b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/333795136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 msgr2=0x55726ab12780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab12780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f5802acb0 tx=0x7f7f58030420 comp rx=0 tx=0).stop 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/333795136 shutdown_connections 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab13200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab12cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/333795136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab12780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/333795136 >> 172.21.15.43:0/333795136 conn(0x55726a761350 msgr2=0x55726ab10670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/333795136 shutdown_connections 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/333795136 wait complete. 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.331+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7f440b3c20 0x7f7f440b6130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55726ab11400 tx=0x7f7f50005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.332+0000 7f7f6c5f0740 1 -- start start 2024-07-26T08:32:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.332+0000 7f7f6c5f0740 1 Processor -- start 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab26a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab26f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab32960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55726a8db5f0 con 0x55726a74c280 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55726aa14540 con 0x55726a7440a0 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55726ab29630 con 0x55726a76cf60 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f6c5f0740 10 client.0 _ll_register_callbacks cb 0x55726aa23f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:32:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab26a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab26f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab26a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:58088/0 (socket says 172.21.15.43:58088) 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f5ea00640 1 -- 172.21.15.43:0/3711628521 learned_addr learned my addr 172.21.15.43:0/3711628521 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.333+0000 7f7f5f400640 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab32960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f5ea00640 1 -- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 msgr2=0x55726ab32960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab32960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f5ea00640 1 -- 172.21.15.43:0/3711628521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 msgr2=0x55726ab26f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab26f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f5ea00640 1 -- 172.21.15.43:0/3711628521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726a7d8540 con 0x55726a7440a0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab26a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f50004580 tx=0x7f7f50004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8623cff91a03145 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.334+0000 7f7f4cc00640 1 -- 172.21.15.43:0/3711628521 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50012e40 con 0x55726a7440a0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.335+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55726aa8a8c0 con 0x55726a7440a0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.335+0000 7f7f4cc00640 1 -- 172.21.15.43:0/3711628521 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f7f50005020 con 0x55726a7440a0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.335+0000 7f7f4cc00640 1 -- 172.21.15.43:0/3711628521 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f50005220 con 0x55726a7440a0 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.335+0000 7f7f6c5f0740 10 client.25271 fetch_fsmap learned FSMap version 24 2024-07-26T08:32:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.335+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55726ab35640 con 0x55726a7440a0 2024-07-26T08:32:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.335+0000 7f7f4cc00640 1 -- 172.21.15.43:0/3711628521 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55726aa8a8c0 con 0x55726a7440a0 2024-07-26T08:32:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f4cc00640 1 -- 172.21.15.43:0/3711628521 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f7f50027070 con 0x55726a7440a0 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f6c5f0740 10 client.25271 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f6c5f0740 10 client.25271 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f6c5f0740 20 client.25271 populate_metadata read hostname 'smithi043' 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a72b8e0 0x55726ab39100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f6c5f0740 4 client.25271 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55726aa86360 con 0x55726a72b8e0 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.336+0000 7f7f57e00640 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a72b8e0 0x55726ab39100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.337+0000 7f7f57e00640 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a72b8e0 0x55726ab39100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=750828c38139934d server_cookie=41f884493d88e25e in_seq=0 out_seq=0 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.337+0000 7f7f4cc00640 10 client.25271 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f4cc00640 1 -- 172.21.15.43:0/3711628521 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55726aa86360 con 0x55726a72b8e0 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f4cc00640 10 client.25271 handle_command_reply: tid=0 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f6c5f0740 1 client.25271 shutdown 2024-07-26T08:32:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 msgr2=0x55726ab26a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab26a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f50004580 tx=0x7f7f50004730 comp rx=0 tx=0).stop 2024-07-26T08:32:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 shutdown_connections 2024-07-26T08:32:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.338+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a72b8e0 0x55726ab39100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab32960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/3711628521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab26a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f4cc00640 0 client.25271 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:32:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 >> 172.21.15.43:0/3711628521 conn(0x55726a761350 msgr2=0x55726ab0ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 shutdown_connections 2024-07-26T08:32:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/3711628521 wait complete. 2024-07-26T08:32:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.339+0000 7f7f6c5f0740 20 client.25271 trim_cache size 0 max 16384 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.359+0000 7f7f6c5f0740 1 Processor -- start 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.359+0000 7f7f6c5f0740 1 -- start start 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a7440a0 0x55726ab39100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a74c280 0x55726ab328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a76cf60 0x55726ab32e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55726ab37440 con 0x55726a76cf60 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55726ab37b10 con 0x55726a74c280 2024-07-26T08:32:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55726ab381e0 con 0x55726a7440a0 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a74c280 0x55726ab328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a7440a0 0x55726ab39100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f5f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a76cf60 0x55726ab32e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a74c280 0x55726ab328d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:58100/0 (socket says 172.21.15.43:58100) 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f57e00640 1 -- 172.21.15.43:0/2553878603 learned_addr learned my addr 172.21.15.43:0/2553878603 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f5ea00640 1 -- 172.21.15.43:0/2553878603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a74c280 msgr2=0x55726ab328d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a74c280 0x55726ab328d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.360+0000 7f7f5ea00640 1 -- 172.21.15.43:0/2553878603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a76cf60 msgr2=0x55726ab32e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.361+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a76cf60 0x55726ab32e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.361+0000 7f7f5ea00640 1 -- 172.21.15.43:0/2553878603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726ab0b7f0 con 0x55726a7440a0 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.361+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a7440a0 0x55726ab39100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f5001f9d0 tx=0x7f7f500096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a536b862c22e6aa1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:37.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.361+0000 7f7f4f400640 1 -- 172.21.15.43:0/2553878603 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f500053c0 con 0x55726a7440a0 2024-07-26T08:32:37.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.361+0000 7f7f4f400640 1 -- 172.21.15.43:0/2553878603 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f50005560 con 0x55726a7440a0 2024-07-26T08:32:37.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.361+0000 7f7f4f400640 1 -- 172.21.15.43:0/2553878603 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5001d400 con 0x55726a7440a0 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/2553878603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a7440a0 msgr2=0x55726ab39100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a7440a0 0x55726ab39100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f5001f9d0 tx=0x7f7f500096a0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/2553878603 shutdown_connections 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a76cf60 0x55726ab32e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a74c280 0x55726ab328d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/2553878603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a7440a0 0x55726ab39100 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/2553878603 >> 172.21.15.43:0/2553878603 conn(0x55726a761350 msgr2=0x55726ab219c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/2553878603 shutdown_connections 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.362+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/2553878603 wait complete. 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.363+0000 7f7f6c5f0740 1 -- start start 2024-07-26T08:32:37.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.363+0000 7f7f6c5f0740 1 Processor -- start 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab41bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab3a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab3a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55726ab38f80 con 0x55726a74c280 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55726ab388b0 con 0x55726a7440a0 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55726ab39650 con 0x55726a76cf60 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f6c5f0740 10 client.0 _ll_register_callbacks cb 0x7f7f50004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab41bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab3a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab41bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:58116/0 (socket says 172.21.15.43:58116) 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f5ea00640 1 -- 172.21.15.43:0/810844948 learned_addr learned my addr 172.21.15.43:0/810844948 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.364+0000 7f7f5f400640 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab3a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f5ea00640 1 -- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 msgr2=0x55726ab3a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab3a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f5ea00640 1 -- 172.21.15.43:0/810844948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 msgr2=0x55726ab3a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab3a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f5ea00640 1 -- 172.21.15.43:0/810844948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726ab3b0c0 con 0x55726a7440a0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f5ea00640 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab41bb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f500092e0 tx=0x7f7f5001f870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985b2a59b108b3d7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f4cc00640 1 -- 172.21.15.43:0/810844948 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5003d070 con 0x55726a7440a0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f50005560 con 0x55726a7440a0 2024-07-26T08:32:37.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.365+0000 7f7f4cc00640 1 -- 172.21.15.43:0/810844948 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f7f50004930 con 0x55726a7440a0 2024-07-26T08:32:37.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f4cc00640 1 -- 172.21.15.43:0/810844948 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f50004b30 con 0x55726a7440a0 2024-07-26T08:32:37.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 10 client.25277 fetch_fsmap learned FSMap version 24 2024-07-26T08:32:37.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55726aba13a0 con 0x55726a7440a0 2024-07-26T08:32:37.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f4cc00640 1 -- 172.21.15.43:0/810844948 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f50005560 con 0x55726a7440a0 2024-07-26T08:32:37.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f4cc00640 1 -- 172.21.15.43:0/810844948 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f7f50040020 con 0x55726a7440a0 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 10 client.25277 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 10 client.25277 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 20 client.25277 populate_metadata read hostname 'smithi043' 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a700c90 0x55726aba4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 4 client.25277 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.366+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "status"}) -- 0x55726aa83aa0 con 0x55726a700c90 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.367+0000 7f7f57e00640 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a700c90 0x55726aba4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.367+0000 7f7f57e00640 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a700c90 0x55726aba4690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8f38e10781d435b server_cookie=884571106cf07798 in_seq=0 out_seq=0 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.367+0000 7f7f4cc00640 10 client.25277 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.367+0000 7f7f4cc00640 1 -- 172.21.15.43:0/810844948 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55726aa83aa0 con 0x55726a700c90 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.367+0000 7f7f4cc00640 10 client.25277 handle_command_reply: tid=0 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 client.25277 shutdown 2024-07-26T08:32:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 msgr2=0x55726ab41bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab41bb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f500092e0 tx=0x7f7f5001f870 comp rx=0 tx=0).stop 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 shutdown_connections 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55726a700c90 0x55726aba4690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55726a76cf60 0x55726ab3a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55726a74c280 0x55726ab3a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 --2- 172.21.15.43:0/810844948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726a7440a0 0x55726ab41bb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f4cc00640 0 client.25277 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 >> 172.21.15.43:0/810844948 conn(0x55726a761350 msgr2=0x55726ab219c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 shutdown_connections 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 1 -- 172.21.15.43:0/810844948 wait complete. 2024-07-26T08:32:37.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.368+0000 7f7f6c5f0740 20 client.25277 trim_cache size 0 max 16384 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24709, 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 216.75009910599999, 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-07-26T08:32:37.373 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 90, 2024-07-26T08:32:37.374 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 88, 2024-07-26T08:32:37.374 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 336.93904268599999 2024-07-26T08:32:37.374 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:32:37.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7f440b3c20 msgr2=0x7f7f440b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7f440b3c20 0x7f7f440b6130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55726ab11400 tx=0x7f7f50005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 msgr2=0x7f7f6019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 0x7f7f6019c510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f480058c0 tx=0x7f7f4800ee50 comp rx=0 tx=0).stop 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 shutdown_connections 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7f440b3c20 0x7f7f440b6130 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6010b860 0x7f7f601a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f6010af10 0x7f7f6019c510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 --2- 172.21.15.43:0/3418349212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f601055d0 0x7f7f6019bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.369+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 >> 172.21.15.43:0/3418349212 conn(0x7f7f60101040 msgr2=0x7f7f60108480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.370+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 shutdown_connections 2024-07-26T08:32:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:37.370+0000 7f7f5fe00640 1 -- 172.21.15.43:0/3418349212 wait complete. 2024-07-26T08:32:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:37 smithi043 ceph-mon[32384]: pgmap v469: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:37 smithi133 ceph-mon[37053]: pgmap v469: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:38.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:37 smithi063 ceph-mon[36747]: pgmap v469: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:38.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.b status 2024-07-26T08:32:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:39 smithi043 ceph-mon[32384]: pgmap v470: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:32:40.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:39 smithi133 ceph-mon[37053]: pgmap v470: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:32:40.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:39 smithi063 ceph-mon[36747]: pgmap v470: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:32:41.085 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:32:41.085 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:32:41.085 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:32:41.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:32:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:32:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:32:41.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:32:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:32:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 -- 172.21.15.43:0/3450417420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26481033e0 msgr2=0x7f26481037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 --2- 172.21.15.43:0/3450417420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26481033e0 0x7f26481037f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2638009900 tx=0x7f263802a400 comp rx=0 tx=0).stop 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 -- 172.21.15.43:0/3450417420 shutdown_connections 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 --2- 172.21.15.43:0/3450417420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2648109670 0x7f264810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 --2- 172.21.15.43:0/3450417420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648108d20 0x7f2648109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 --2- 172.21.15.43:0/3450417420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26481033e0 0x7f26481037f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 -- 172.21.15.43:0/3450417420 >> 172.21.15.43:0/3450417420 conn(0x7f26480fee70 msgr2=0x7f26481012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 -- 172.21.15.43:0/3450417420 shutdown_connections 2024-07-26T08:32:41.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.485+0000 7f264e200640 1 -- 172.21.15.43:0/3450417420 wait complete. 2024-07-26T08:32:41.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.486+0000 7f264e200640 1 Processor -- start 2024-07-26T08:32:41.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 -- start start 2024-07-26T08:32:41.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26481033e0 0x7f264819c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2648108d20 0x7f264819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648109670 0x7f26481a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2648113450 con 0x7f2648109670 2024-07-26T08:32:41.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f26481132d0 con 0x7f2648108d20 2024-07-26T08:32:41.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264e200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f26481135d0 con 0x7f26481033e0 2024-07-26T08:32:41.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26481033e0 0x7f264819c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648109670 0x7f26481a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f2647e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2648108d20 0x7f264819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26481033e0 0x7f264819c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:36476/0 (socket says 172.21.15.43:36476) 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.487+0000 7f264ce00640 1 -- 172.21.15.43:0/122874795 learned_addr learned my addr 172.21.15.43:0/122874795 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.488+0000 7f2647e00640 1 -- 172.21.15.43:0/122874795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26481033e0 msgr2=0x7f264819c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.488+0000 7f2647e00640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26481033e0 0x7f264819c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.488+0000 7f2647e00640 1 -- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648109670 msgr2=0x7f26481a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.488+0000 7f2647e00640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648109670 0x7f26481a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.488+0000 7f2647e00640 1 -- 172.21.15.43:0/122874795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26481a1f90 con 0x7f2648108d20 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.488+0000 7f264d800640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648109670 0x7f26481a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.489+0000 7f2647e00640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2648108d20 0x7f264819c5c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f264806b3c0 tx=0x7f263000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.489+0000 7f2645600640 1 -- 172.21.15.43:0/122874795 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263000cc40 con 0x7f2648108d20 2024-07-26T08:32:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.489+0000 7f2645600640 1 -- 172.21.15.43:0/122874795 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f263000cde0 con 0x7f2648108d20 2024-07-26T08:32:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.489+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26481a2280 con 0x7f2648108d20 2024-07-26T08:32:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.489+0000 7f2645600640 1 -- 172.21.15.43:0/122874795 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630018810 con 0x7f2648108d20 2024-07-26T08:32:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.489+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26481a89e0 con 0x7f2648108d20 2024-07-26T08:32:41.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.492+0000 7f265641f740 1 Processor -- start 2024-07-26T08:32:41.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 -- start start 2024-07-26T08:32:41.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bdc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bdccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2bdd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2b52970 con 0x55c0d2816280 2024-07-26T08:32:41.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f2645600640 1 -- 172.21.15.43:0/122874795 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f2630010b40 con 0x7f2648108d20 2024-07-26T08:32:41.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2b41e70 con 0x55c0d2836f60 2024-07-26T08:32:41.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f265641f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2b45eb0 con 0x55c0d280e0a0 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f264ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bdccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.493+0000 7f2647e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2bdd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bdccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:36492/0 (socket says 172.21.15.43:36492) 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 -- 172.21.15.43:0/323140673 learned_addr learned my addr 172.21.15.43:0/323140673 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264d800640 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bdc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 -- 172.21.15.43:0/323140673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 msgr2=0x55c0d2bdc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bdc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 -- 172.21.15.43:0/323140673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 msgr2=0x55c0d2bdd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2bdd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 -- 172.21.15.43:0/323140673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d2ae9110 con 0x55c0d280e0a0 2024-07-26T08:32:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.494+0000 7f264ce00640 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bdccc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2638009a20 tx=0x7f2638005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e18d260c70019c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.495+0000 7f263e000640 1 -- 172.21.15.43:0/323140673 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638040070 con 0x55c0d280e0a0 2024-07-26T08:32:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.495+0000 7f263e000640 1 -- 172.21.15.43:0/323140673 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2638004030 con 0x55c0d280e0a0 2024-07-26T08:32:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.495+0000 7f263e000640 1 -- 172.21.15.43:0/323140673 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638035040 con 0x55c0d280e0a0 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.495+0000 7f2645600640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f262c0b3c20 0x7f262c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f2645600640 1 -- 172.21.15.43:0/122874795 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f26300e44c0 con 0x7f2648108d20 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f264d800640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f262c0b3c20 0x7f262c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 -- 172.21.15.43:0/323140673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 msgr2=0x55c0d2bdccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bdccc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2638009a20 tx=0x7f2638005ee0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 -- 172.21.15.43:0/323140673 shutdown_connections 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bdccc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2bdd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 --2- 172.21.15.43:0/323140673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bdc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.496+0000 7f265641f740 1 -- 172.21.15.43:0/323140673 >> 172.21.15.43:0/323140673 conn(0x55c0d282b350 msgr2=0x55c0d2bda670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.497+0000 7f265641f740 1 -- 172.21.15.43:0/323140673 shutdown_connections 2024-07-26T08:32:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.497+0000 7f265641f740 1 -- 172.21.15.43:0/323140673 wait complete. 2024-07-26T08:32:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.497+0000 7f264d800640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f262c0b3c20 0x7f262c0b6130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2640009fd0 tx=0x7f2640009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.497+0000 7f265641f740 1 -- start start 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 Processor -- start 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d280e0a0 0x55c0d2be7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bf41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c0d29a55f0 con 0x55c0d2816280 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2ade540 con 0x55c0d280e0a0 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2beaf00 con 0x55c0d2836f60 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f265641f740 10 client.0 _ll_register_callbacks cb 0x55c0d2aedf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:32:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.498+0000 7f2647e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54226/0 (socket says 172.21.15.43:54226) 2024-07-26T08:32:41.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 -- 172.21.15.43:0/1724113568 learned_addr learned my addr 172.21.15.43:0/1724113568 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:41.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f264ce00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d280e0a0 0x55c0d2be7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f264d800640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bf41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 -- 172.21.15.43:0/1724113568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 msgr2=0x55c0d2bf41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bf41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 -- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d280e0a0 msgr2=0x55c0d2be7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d280e0a0 0x55c0d2be7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 -- 172.21.15.43:0/1724113568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d28a2540 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f264ce00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d280e0a0 0x55c0d2be7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2647e00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be85c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f26300e4760 tx=0x7f26300e1dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8475f7a8a7d7239f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.499+0000 7f2636a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f2636a00640 1 -- 172.21.15.43:0/1724113568 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26300aa8f0 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f2636a00640 1 -- 172.21.15.43:0/1724113568 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f26300a6b20 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2638004030 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f2636a00640 1 -- 172.21.15.43:0/1724113568 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26300aa710 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f265641f740 10 client.15180 fetch_fsmap learned FSMap version 24 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c0d2bf6e20 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.500+0000 7f2636a00640 1 -- 172.21.15.43:0/1724113568 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2638004030 con 0x55c0d2816280 2024-07-26T08:32:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f2636a00640 1 -- 172.21.15.43:0/1724113568 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f26300e4120 con 0x55c0d2816280 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f265641f740 10 client.15180 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f265641f740 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f265641f740 20 client.15180 populate_metadata read hostname 'smithi043' 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f265641f740 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27f58e0 0x55c0d2bfa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f265641f740 4 client.15180 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0d2b548c0 con 0x55c0d27f58e0 2024-07-26T08:32:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.501+0000 7f264ce00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27f58e0 0x55c0d2bfa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.502+0000 7f264ce00640 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27f58e0 0x55c0d2bfa890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9022dc9400f5de2c server_cookie=5ddc361fd15b6c20 in_seq=0 out_seq=0 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.502+0000 7f2636a00640 10 client.15180 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f2636a00640 1 -- 172.21.15.43:0/1724113568 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0d2b548c0 con 0x55c0d27f58e0 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f2636a00640 10 client.15180 handle_command_reply: tid=0 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 client.15180 shutdown 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 msgr2=0x55c0d2be85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be85c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f26300e4760 tx=0x7f26300e1dc0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 shutdown_connections 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bf41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27f58e0 0x55c0d2bfa890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be85c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 --2- 172.21.15.43:0/1724113568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d280e0a0 0x55c0d2be7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 >> 172.21.15.43:0/1724113568 conn(0x55c0d282b350 msgr2=0x55c0d2bdf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f2636a00640 0 client.15180 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 shutdown_connections 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.503+0000 7f265641f740 1 -- 172.21.15.43:0/1724113568 wait complete. 2024-07-26T08:32:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.504+0000 7f265641f740 20 client.15180 trim_cache size 0 max 16384 2024-07-26T08:32:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 Processor -- start 2024-07-26T08:32:41.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 -- start start 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bfa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bf4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2bf8bd0 con 0x55c0d2816280 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2bf92a0 con 0x55c0d2836f60 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.524+0000 7f265641f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2bf9970 con 0x55c0d280e0a0 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bfa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bfa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:36504/0 (socket says 172.21.15.43:36504) 2024-07-26T08:32:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bf4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 -- 172.21.15.43:0/1107750240 learned_addr learned my addr 172.21.15.43:0/1107750240 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f2647e00640 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 -- 172.21.15.43:0/1107750240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 msgr2=0x55c0d2bf4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bf4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 -- 172.21.15.43:0/1107750240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 msgr2=0x55c0d2be28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 -- 172.21.15.43:0/1107750240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d2bdf010 con 0x55c0d280e0a0 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f2647e00640 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.525+0000 7f264ce00640 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bfa890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2638005f70 tx=0x7f263802a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a831b1970c40545d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.526+0000 7f263d600640 1 -- 172.21.15.43:0/1107750240 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638040070 con 0x55c0d280e0a0 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.526+0000 7f263d600640 1 -- 172.21.15.43:0/1107750240 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2638004050 con 0x55c0d280e0a0 2024-07-26T08:32:41.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.526+0000 7f263d600640 1 -- 172.21.15.43:0/1107750240 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638035040 con 0x55c0d280e0a0 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 -- 172.21.15.43:0/1107750240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 msgr2=0x55c0d2bfa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bfa890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2638005f70 tx=0x7f263802a400 comp rx=0 tx=0).stop 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 -- 172.21.15.43:0/1107750240 shutdown_connections 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2836f60 0x55c0d2bf4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d2816280 0x55c0d2be28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 --2- 172.21.15.43:0/1107750240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d280e0a0 0x55c0d2bfa890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 -- 172.21.15.43:0/1107750240 >> 172.21.15.43:0/1107750240 conn(0x55c0d282b350 msgr2=0x55c0d2be7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 -- 172.21.15.43:0/1107750240 shutdown_connections 2024-07-26T08:32:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.527+0000 7f265641f740 1 -- 172.21.15.43:0/1107750240 wait complete. 2024-07-26T08:32:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 -- start start 2024-07-26T08:32:41.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 Processor -- start 2024-07-26T08:32:41.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 0x55c0d2c032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2816280 0x55c0d2bfed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2bfa710 con 0x55c0d280e0a0 2024-07-26T08:32:41.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2bfa040 con 0x55c0d2816280 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.528+0000 7f265641f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c0d2bfade0 con 0x55c0d2836f60 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f265641f740 10 client.0 _ll_register_callbacks cb 0x7f26300a6f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 0x55c0d2c032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 0x55c0d2c032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54252/0 (socket says 172.21.15.43:54252) 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 -- 172.21.15.43:0/1444710077 learned_addr learned my addr 172.21.15.43:0/1444710077 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f2647e00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2816280 0x55c0d2bfed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264d800640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 -- 172.21.15.43:0/1444710077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 msgr2=0x55c0d2bff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 -- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2816280 msgr2=0x55c0d2bfed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2816280 0x55c0d2bfed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264ce00640 1 -- 172.21.15.43:0/1444710077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d2bffa80 con 0x55c0d280e0a0 2024-07-26T08:32:41.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f264d800640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.529+0000 7f2647e00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2816280 0x55c0d2bfed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f264ce00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 0x55c0d2c032c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2638031eb0 tx=0x7f2638031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84620423ec75b018 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f2636a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:32:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f2636a00640 1 -- 172.21.15.43:0/1444710077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263805d060 con 0x55c0d280e0a0 2024-07-26T08:32:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f2636a00640 1 -- 172.21.15.43:0/1444710077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f2638031730 con 0x55c0d280e0a0 2024-07-26T08:32:41.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2638004050 con 0x55c0d280e0a0 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f2636a00640 1 -- 172.21.15.43:0/1444710077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2638064050 con 0x55c0d280e0a0 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f265641f740 10 client.15183 fetch_fsmap learned FSMap version 24 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.530+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c0d2c62a50 con 0x55c0d280e0a0 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f2636a00640 1 -- 172.21.15.43:0/1444710077 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2638004050 con 0x55c0d280e0a0 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f2636a00640 1 -- 172.21.15.43:0/1444710077 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f2638003680 con 0x55c0d280e0a0 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f265641f740 10 client.15183 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:32:41.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f265641f740 10 client.15183 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f265641f740 20 client.15183 populate_metadata read hostname 'smithi043' 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f265641f740 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27cac90 0x55c0d2c65c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f265641f740 4 client.15183 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.531+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "status"}) -- 0x55c0d2b50360 con 0x55c0d27cac90 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.532+0000 7f2647e00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27cac90 0x55c0d2c65c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.532+0000 7f2647e00640 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27cac90 0x55c0d2c65c80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41891072150a60c6 server_cookie=fd4292f8c677bce5 in_seq=0 out_seq=0 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.532+0000 7f2636a00640 10 client.15183 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.532+0000 7f2636a00640 1 -- 172.21.15.43:0/1444710077 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c0d2b50360 con 0x55c0d27cac90 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.532+0000 7f2636a00640 10 client.15183 handle_command_reply: tid=0 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.532+0000 7f265641f740 1 client.15183 shutdown 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 msgr2=0x55c0d2c032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 0x55c0d2c032c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2638031eb0 tx=0x7f2638031ee0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 shutdown_connections 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c0d2836f60 0x55c0d2bff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55c0d27cac90 0x55c0d2c65c80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c0d2816280 0x55c0d2bfed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 --2- 172.21.15.43:0/1444710077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0d280e0a0 0x55c0d2c032c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 >> 172.21.15.43:0/1444710077 conn(0x55c0d282b350 msgr2=0x55c0d2bd8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f2636a00640 0 client.15183 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 shutdown_connections 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 1 -- 172.21.15.43:0/1444710077 wait complete. 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.533+0000 7f265641f740 20 client.15183 trim_cache size 0 max 16384 2024-07-26T08:32:41.538 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24710, 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 221.931544586, 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 90, 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 88, 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 327.73739983899998 2024-07-26T08:32:41.539 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:32:41.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f262c0b3c20 msgr2=0x7f262c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f262c0b3c20 0x7f262c0b6130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2640009fd0 tx=0x7f2640009500 comp rx=0 tx=0).stop 2024-07-26T08:32:41.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2648108d20 msgr2=0x7f264819c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:41.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2648108d20 0x7f264819c5c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f264806b3c0 tx=0x7f263000ee50 comp rx=0 tx=0).stop 2024-07-26T08:32:41.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 shutdown_connections 2024-07-26T08:32:41.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f262c0b3c20 0x7f262c0b6130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2648109670 0x7f26481a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2648108d20 0x7f264819c5c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 --2- 172.21.15.43:0/122874795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26481033e0 0x7f264819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:41.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 >> 172.21.15.43:0/122874795 conn(0x7f26480fee70 msgr2=0x7f2648108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:41.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 shutdown_connections 2024-07-26T08:32:41.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:41.534+0000 7f264e200640 1 -- 172.21.15.43:0/122874795 wait complete. 2024-07-26T08:32:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:41 smithi043 ceph-mon[32384]: pgmap v471: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:42.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:41 smithi133 ceph-mon[37053]: pgmap v471: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:42.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:41 smithi063 ceph-mon[36747]: pgmap v471: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:42.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.a status 2024-07-26T08:32:43.062 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:43 smithi043 ceph-mon[32384]: pgmap v472: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:44.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:43 smithi133 ceph-mon[37053]: pgmap v472: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:44.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:43 smithi063 ceph-mon[36747]: pgmap v472: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 -- 172.21.15.43:0/666240474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0102490 msgr2=0x7f94c01028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 --2- 172.21.15.43:0/666240474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0102490 0x7f94c01028a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009900 tx=0x7f94b002a400 comp rx=0 tx=0).stop 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 -- 172.21.15.43:0/666240474 shutdown_connections 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 --2- 172.21.15.43:0/666240474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c0108720 0x7f94c010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 --2- 172.21.15.43:0/666240474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0107dd0 0x7f94c01081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 --2- 172.21.15.43:0/666240474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0102490 0x7f94c01028a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 -- 172.21.15.43:0/666240474 >> 172.21.15.43:0/666240474 conn(0x7f94c0079160 msgr2=0x7f94c0079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:45.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 -- 172.21.15.43:0/666240474 shutdown_connections 2024-07-26T08:32:45.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.793+0000 7f94c7400640 1 -- 172.21.15.43:0/666240474 wait complete. 2024-07-26T08:32:45.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.794+0000 7f94c7400640 1 Processor -- start 2024-07-26T08:32:45.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.794+0000 7f94c7400640 1 -- start start 2024-07-26T08:32:45.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 0x7f94c019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c0107dd0 0x7f94c019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0108720 0x7f94c01a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c7400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94c01124b0 con 0x7f94c0102490 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c7400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f94c0112330 con 0x7f94c0108720 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c7400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f94c0112630 con 0x7f94c0107dd0 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 0x7f94c019c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94b7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c0107dd0 0x7f94c019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 0x7f94c019c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32870/0 (socket says 172.21.15.43:32870) 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c4a00640 1 -- 172.21.15.43:0/939883046 learned_addr learned my addr 172.21.15.43:0/939883046 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.795+0000 7f94c5400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0108720 0x7f94c01a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c4a00640 1 -- 172.21.15.43:0/939883046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c0107dd0 msgr2=0x7f94c019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c4a00640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c0107dd0 0x7f94c019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c4a00640 1 -- 172.21.15.43:0/939883046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0108720 msgr2=0x7f94c01a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c4a00640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0108720 0x7f94c01a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c4a00640 1 -- 172.21.15.43:0/939883046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c01a20c0 con 0x7f94c0102490 2024-07-26T08:32:45.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c5400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0108720 0x7f94c01a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:45.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.796+0000 7f94c4a00640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 0x7f94c019c150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f94b0005ab0 tx=0x7f94b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:45.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.797+0000 7f94be000640 1 -- 172.21.15.43:0/939883046 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b003f030 con 0x7f94c0102490 2024-07-26T08:32:45.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.797+0000 7f94be000640 1 -- 172.21.15.43:0/939883046 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94b0003cd0 con 0x7f94c0102490 2024-07-26T08:32:45.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.797+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c01a2350 con 0x7f94c0102490 2024-07-26T08:32:45.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.797+0000 7f94be000640 1 -- 172.21.15.43:0/939883046 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0035070 con 0x7f94c0102490 2024-07-26T08:32:45.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.797+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c01a8b10 con 0x7f94c0102490 2024-07-26T08:32:45.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.800+0000 7f94ce214740 1 Processor -- start 2024-07-26T08:32:45.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 -- start start 2024-07-26T08:32:45.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bcd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a677ff0a0 0x559a67bcdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a67807280 0x559a67bcdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559a67b43970 con 0x559a67827f60 2024-07-26T08:32:45.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a67b32e70 con 0x559a67807280 2024-07-26T08:32:45.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.801+0000 7f94ce214740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a67b36eb0 con 0x559a677ff0a0 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bcd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bcd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32882/0 (socket says 172.21.15.43:32882) 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 -- 172.21.15.43:0/428309029 learned_addr learned my addr 172.21.15.43:0/428309029 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94b7e00640 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a67807280 0x559a67bcdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94be000640 1 -- 172.21.15.43:0/939883046 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f94b0042030 con 0x7f94c0102490 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 -- 172.21.15.43:0/428309029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a677ff0a0 msgr2=0x559a67bcdab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a677ff0a0 0x559a67bcdab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 -- 172.21.15.43:0/428309029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a67807280 msgr2=0x559a67bcdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a67807280 0x559a67bcdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94c5400640 1 -- 172.21.15.43:0/428309029 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a67ada110 con 0x559a67827f60 2024-07-26T08:32:45.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.802+0000 7f94b7e00640 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a67807280 0x559a67bcdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:45.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.803+0000 7f94c5400640 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bcd570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f94b8010750 tx=0x7f94b8010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2671b7c54ec729 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:45.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.803+0000 7f94b5c00640 1 -- 172.21.15.43:0/428309029 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b800ead0 con 0x559a67827f60 2024-07-26T08:32:45.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.803+0000 7f94b5c00640 1 -- 172.21.15.43:0/428309029 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94b8010e60 con 0x559a67827f60 2024-07-26T08:32:45.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.803+0000 7f94b5c00640 1 -- 172.21.15.43:0/428309029 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8011640 con 0x559a67827f60 2024-07-26T08:32:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94be000640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a40b3c20 0x7f94a40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 -- 172.21.15.43:0/428309029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 msgr2=0x559a67bcd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bcd570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f94b8010750 tx=0x7f94b8010c10 comp rx=0 tx=0).stop 2024-07-26T08:32:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 -- 172.21.15.43:0/428309029 shutdown_connections 2024-07-26T08:32:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a677ff0a0 0x559a67bcdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a67807280 0x559a67bcdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 --2- 172.21.15.43:0/428309029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bcd570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94ce214740 1 -- 172.21.15.43:0/428309029 >> 172.21.15.43:0/428309029 conn(0x559a6781c350 msgr2=0x559a67bcb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94be000640 1 -- 172.21.15.43:0/939883046 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f94b0104610 con 0x7f94c0102490 2024-07-26T08:32:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.804+0000 7f94c4a00640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a40b3c20 0x7f94a40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.805+0000 7f94ce214740 1 -- 172.21.15.43:0/428309029 shutdown_connections 2024-07-26T08:32:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.805+0000 7f94ce214740 1 -- 172.21.15.43:0/428309029 wait complete. 2024-07-26T08:32:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.805+0000 7f94ce214740 1 -- start start 2024-07-26T08:32:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.805+0000 7f94c4a00640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a40b3c20 0x7f94a40b6130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94b00cb080 tx=0x7f94b003b720 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 Processor -- start 2024-07-26T08:32:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bd9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bd95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67be5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559a679965f0 con 0x559a67827f60 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a67acf540 con 0x559a677ff0a0 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a67bdbd50 con 0x559a67807280 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.806+0000 7f94ce214740 10 client.0 _ll_register_callbacks cb 0x559a67adef10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94c5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bd9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94c5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bd9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:51968/0 (socket says 172.21.15.43:51968) 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94c5400640 1 -- 172.21.15.43:0/2364339799 learned_addr learned my addr 172.21.15.43:0/2364339799 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94b7e00640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bd95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94c5400640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67be5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94b7e00640 1 -- 172.21.15.43:0/2364339799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 msgr2=0x559a67bd9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94b7e00640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bd9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94b7e00640 1 -- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 msgr2=0x559a67be5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94b7e00640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67be5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.807+0000 7f94b7e00640 1 -- 172.21.15.43:0/2364339799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a67893540 con 0x559a67807280 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94b7e00640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bd95c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94c006a4d0 tx=0x7f94a800bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecad0173f1c48c70 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ae000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ae000640 1 -- 172.21.15.43:0/2364339799 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8003dc0 con 0x559a67807280 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ae000640 1 -- 172.21.15.43:0/2364339799 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f94a8011440 con 0x559a67807280 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b8010e60 con 0x559a67807280 2024-07-26T08:32:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ae000640 1 -- 172.21.15.43:0/2364339799 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94a8020650 con 0x559a67807280 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ce214740 10 client.25336 fetch_fsmap learned FSMap version 24 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.808+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559a67be7ce0 con 0x559a67807280 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ae000640 1 -- 172.21.15.43:0/2364339799 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94b8010e60 con 0x559a67807280 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ae000640 1 -- 172.21.15.43:0/2364339799 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f94a80116d0 con 0x559a67807280 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ce214740 10 client.25336 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ce214740 10 client.25336 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ce214740 20 client.25336 populate_metadata read hostname 'smithi043' 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ce214740 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677e68e0 0x559a67beb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ce214740 4 client.25336 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.809+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a67b458c0 con 0x559a677e68e0 2024-07-26T08:32:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.810+0000 7f94c5400640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677e68e0 0x559a67beb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.810+0000 7f94c5400640 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677e68e0 0x559a67beb7e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab9efa43f6184a7 server_cookie=905f83ff9c2a45fd in_seq=0 out_seq=0 2024-07-26T08:32:45.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.810+0000 7f94ae000640 10 client.25336 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.811+0000 7f94ae000640 1 -- 172.21.15.43:0/2364339799 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a67b458c0 con 0x559a677e68e0 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.811+0000 7f94ae000640 10 client.25336 handle_command_reply: tid=0 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.811+0000 7f94ce214740 1 client.25336 shutdown 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.811+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 msgr2=0x559a67bd95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bd95c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94c006a4d0 tx=0x7f94a800bf30 comp rx=0 tx=0).stop 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 shutdown_connections 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677e68e0 0x559a67beb7e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bd95c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67be5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 --2- 172.21.15.43:0/2364339799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bd9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ae000640 0 client.25336 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:32:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 >> 172.21.15.43:0/2364339799 conn(0x559a6781c350 msgr2=0x559a67bd0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 shutdown_connections 2024-07-26T08:32:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 1 -- 172.21.15.43:0/2364339799 wait complete. 2024-07-26T08:32:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.812+0000 7f94ce214740 20 client.25336 trim_cache size 0 max 16384 2024-07-26T08:32:45.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 Processor -- start 2024-07-26T08:32:45.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 -- start start 2024-07-26T08:32:45.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 0x559a67be4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67827f60 0x559a67be5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559a67be9b20 con 0x559a67807280 2024-07-26T08:32:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a67bea1f0 con 0x559a677ff0a0 2024-07-26T08:32:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.832+0000 7f94ce214740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a67bea8c0 con 0x559a67827f60 2024-07-26T08:32:45.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94b7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 0x559a67be4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94b7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 0x559a67be4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32898/0 (socket says 172.21.15.43:32898) 2024-07-26T08:32:45.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94b7e00640 1 -- 172.21.15.43:0/575214814 learned_addr learned my addr 172.21.15.43:0/575214814 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:45.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67827f60 0x559a67be5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 -- 172.21.15.43:0/575214814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 msgr2=0x559a67bea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bea370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 -- 172.21.15.43:0/575214814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 msgr2=0x559a67be4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 0x559a67be4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 -- 172.21.15.43:0/575214814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a67bcbdd0 con 0x559a67827f60 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94b7e00640 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 0x559a67be4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.833+0000 7f94c5400640 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67827f60 0x559a67be5520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559a67bec580 tx=0x7f94b8000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f9d3954d7cadcb7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.834+0000 7f94b5200640 1 -- 172.21.15.43:0/575214814 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8025040 con 0x559a67827f60 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.834+0000 7f94b5200640 1 -- 172.21.15.43:0/575214814 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94b8012e50 con 0x559a67827f60 2024-07-26T08:32:45.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.834+0000 7f94b5200640 1 -- 172.21.15.43:0/575214814 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b802e870 con 0x559a67827f60 2024-07-26T08:32:45.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 -- 172.21.15.43:0/575214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67827f60 msgr2=0x559a67be5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67827f60 0x559a67be5520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559a67bec580 tx=0x7f94b8000f40 comp rx=0 tx=0).stop 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 -- 172.21.15.43:0/575214814 shutdown_connections 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67827f60 0x559a67be5520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67807280 0x559a67be4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 --2- 172.21.15.43:0/575214814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 -- 172.21.15.43:0/575214814 >> 172.21.15.43:0/575214814 conn(0x559a6781c350 msgr2=0x559a67bd4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 -- 172.21.15.43:0/575214814 shutdown_connections 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 -- 172.21.15.43:0/575214814 wait complete. 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.835+0000 7f94ce214740 1 -- start start 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 Processor -- start 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bed010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bf25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559a67beb660 con 0x559a67827f60 2024-07-26T08:32:45.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a67beaf90 con 0x559a677ff0a0 2024-07-26T08:32:45.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a67bebd30 con 0x559a67807280 2024-07-26T08:32:45.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.836+0000 7f94ce214740 10 client.0 _ll_register_callbacks cb 0x7f94a8004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:32:45.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94c5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94c5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bed010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:51984/0 (socket says 172.21.15.43:51984) 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94c5400640 1 -- 172.21.15.43:0/1492653306 learned_addr learned my addr 172.21.15.43:0/1492653306 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94c5400640 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bf25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 -- 172.21.15.43:0/1492653306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 msgr2=0x559a67bed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 -- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 msgr2=0x559a67bf25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bf25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 -- 172.21.15.43:0/1492653306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a67bf2c20 con 0x559a67807280 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94b7e00640 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bed5d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x559a67b0ff20 tx=0x7f94a801b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4e06905bedac35 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.837+0000 7f94ae000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.838+0000 7f94ae000640 1 -- 172.21.15.43:0/1492653306 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a802d020 con 0x559a67807280 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.838+0000 7f94ae000640 1 -- 172.21.15.43:0/1492653306 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f94a8011650 con 0x559a67807280 2024-07-26T08:32:45.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.838+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b8012e50 con 0x559a67807280 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.838+0000 7f94ae000640 1 -- 172.21.15.43:0/1492653306 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94a8011850 con 0x559a67807280 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.838+0000 7f94ce214740 10 client.25342 fetch_fsmap learned FSMap version 24 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.838+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559a67bf3fe0 con 0x559a67807280 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ae000640 1 -- 172.21.15.43:0/1492653306 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94b8012e50 con 0x559a67807280 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ae000640 1 -- 172.21.15.43:0/1492653306 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f94a8005500 con 0x559a67807280 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ce214740 10 client.25342 fetch_fsmap finished waiting for FSMap version 24 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ce214740 10 client.25342 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ce214740 20 client.25342 populate_metadata read hostname 'smithi043' 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ce214740 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677bbc90 0x559a67c57a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ce214740 4 client.25342 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "status"}) -- 0x559a67b41360 con 0x559a677bbc90 2024-07-26T08:32:45.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.839+0000 7f94c5400640 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677bbc90 0x559a67c57a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:45.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94c5400640 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677bbc90 0x559a67c57a50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d8010e30fbd298 server_cookie=f8e4b90a7cd1adf9 in_seq=0 out_seq=0 2024-07-26T08:32:45.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94ae000640 10 client.25342 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94ae000640 1 -- 172.21.15.43:0/1492653306 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559a67b41360 con 0x559a677bbc90 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94ae000640 10 client.25342 handle_command_reply: tid=0 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94ce214740 1 client.25342 shutdown 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 msgr2=0x559a67bed5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.840+0000 7f94ce214740 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bed5d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x559a67b0ff20 tx=0x7f94a801b4a0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 shutdown_connections 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x559a677bbc90 0x559a67c57a50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a67807280 0x559a67bed5d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a67827f60 0x559a67bf25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 --2- 172.21.15.43:0/1492653306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a677ff0a0 0x559a67bed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ae000640 0 client.25342 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 >> 172.21.15.43:0/1492653306 conn(0x559a6781c350 msgr2=0x559a67bcac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:45.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 shutdown_connections 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 1 -- 172.21.15.43:0/1492653306 wait complete. 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.841+0000 7f94ce214740 20 client.25342 trim_cache size 0 max 16384 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "4bbb8ba0-4b27-11ef-bcb6-c7b262605968", 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24733, 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-07-26T08:32:45.845 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 307.51780591900001, 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 90, 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 88, 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 334.73987730900001 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a40b3c20 msgr2=0x7f94a40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a40b3c20 0x7f94a40b6130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94b00cb080 tx=0x7f94b003b720 comp rx=0 tx=0).stop 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 msgr2=0x7f94c019c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 0x7f94c019c150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f94b0005ab0 tx=0x7f94b00042f0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 shutdown_connections 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f94a40b3c20 0x7f94a40b6130 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c0107dd0 0x7f94c019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94c0108720 0x7f94c01a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 --2- 172.21.15.43:0/939883046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c0102490 0x7f94c019c150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 >> 172.21.15.43:0/939883046 conn(0x7f94c0079160 msgr2=0x7f94c006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 shutdown_connections 2024-07-26T08:32:45.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:45.842+0000 7f94c7400640 1 -- 172.21.15.43:0/939883046 wait complete. 2024-07-26T08:32:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:45 smithi043 ceph-mon[32384]: pgmap v473: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:46.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:45 smithi133 ceph-mon[37053]: pgmap v473: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:46.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:45 smithi063 ceph-mon[36747]: pgmap v473: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:46.778 INFO:teuthology.run_tasks:Running task sequential... 2024-07-26T08:32:46.788 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-07-26T08:32:46.788 INFO:teuthology.task.sequential:In sequential, running task print... 2024-07-26T08:32:46.789 INFO:teuthology.task.print:Enabling mgr modules 2024-07-26T08:32:46.789 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-07-26T08:32:46.865 INFO:teuthology.task.exec:Executing custom commands... 2024-07-26T08:32:46.865 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:32:46.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-07-26T08:32:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 -- 172.21.15.43:0/466807628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a4105550 msgr2=0x7f41a4105960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 --2- 172.21.15.43:0/466807628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a4105550 0x7f41a4105960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4194009900 tx=0x7f419402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:32:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 -- 172.21.15.43:0/466807628 shutdown_connections 2024-07-26T08:32:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 --2- 172.21.15.43:0/466807628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a410b7d0 0x7f41a4112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 --2- 172.21.15.43:0/466807628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 0x7f41a410b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:47.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 --2- 172.21.15.43:0/466807628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a4105550 0x7f41a4105960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 -- 172.21.15.43:0/466807628 >> 172.21.15.43:0/466807628 conn(0x7f41a4100f90 msgr2=0x7f41a41033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 -- 172.21.15.43:0/466807628 shutdown_connections 2024-07-26T08:32:47.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.149+0000 7f41a9400640 1 -- 172.21.15.43:0/466807628 wait complete. 2024-07-26T08:32:47.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 Processor -- start 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 -- start start 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 0x7f41a419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 0x7f41a419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a410b7d0 0x7f41a41a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f41a41155d0 con 0x7f41a410b7d0 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f41a4115450 con 0x7f41a410ae80 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.151+0000 7f41a9400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f41a4115750 con 0x7f41a4105550 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 0x7f41a419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 0x7f41a419bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:51662/0 (socket says 172.21.15.43:51662) 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 -- 172.21.15.43:0/3536537427 learned_addr learned my addr 172.21.15.43:0/3536537427 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:47.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f419be00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 0x7f41a419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a8a00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a410b7d0 0x7f41a41a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 -- 172.21.15.43:0/3536537427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 msgr2=0x7f41a419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 0x7f41a419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 -- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a410b7d0 msgr2=0x7f41a41a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a410b7d0 0x7f41a41a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 -- 172.21.15.43:0/3536537427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a41a1ec0 con 0x7f41a4105550 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f419be00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 0x7f41a419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a8a00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a410b7d0 0x7f41a41a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:47.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.152+0000 7f41a3e00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 0x7f41a419bf90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4194005ab0 tx=0x7f41940042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:47.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.153+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419403f030 con 0x7f41a4105550 2024-07-26T08:32:47.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.153+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4194003cd0 con 0x7f41a4105550 2024-07-26T08:32:47.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.153+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a41a2150 con 0x7f41a4105550 2024-07-26T08:32:47.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.153+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194035070 con 0x7f41a4105550 2024-07-26T08:32:47.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.153+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a41a8940 con 0x7f41a4105550 2024-07-26T08:32:47.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.154+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a4105960 con 0x7f41a4105550 2024-07-26T08:32:47.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.157+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f4194042030 con 0x7f41a4105550 2024-07-26T08:32:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.158+0000 7f41a1600640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f41880b3c20 0x7f41880b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.158+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f4194104bb0 con 0x7f41a4105550 2024-07-26T08:32:47.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.158+0000 7f419be00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f41880b3c20 0x7f41880b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:47.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.159+0000 7f419be00640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f41880b3c20 0x7f41880b6130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41a410b740 tx=0x7f418c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:47.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.160+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f41940cb690 con 0x7f41a4105550 2024-07-26T08:32:47.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.433+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f41a402e0c0 con 0x7f41a4105550 2024-07-26T08:32:47.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.991+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f41940c7920 con 0x7f41a4105550 2024-07-26T08:32:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.994+0000 7f41a1600640 1 -- 172.21.15.43:0/3536537427 <== mon.1 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 module 'snap_schedule' is already enabled v23) ==== 133+0+0 (secure 0 0 0) 0x7f4194105d30 con 0x7f41a4105550 2024-07-26T08:32:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:module 'snap_schedule' is already enabled 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.998+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f41880b3c20 msgr2=0x7f41880b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.998+0000 7f41a9400640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f41880b3c20 0x7f41880b6130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41a410b740 tx=0x7f418c005f90 comp rx=0 tx=0).stop 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.998+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 msgr2=0x7f41a419bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.998+0000 7f41a9400640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 0x7f41a419bf90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4194005ab0 tx=0x7f41940042f0 comp rx=0 tx=0).stop 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 shutdown_connections 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f41880b3c20 0x7f41880b6130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:48.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a410b7d0 0x7f41a41a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:48.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a410ae80 0x7f41a419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:48.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 --2- 172.21.15.43:0/3536537427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41a4105550 0x7f41a419bf90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:48.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 >> 172.21.15.43:0/3536537427 conn(0x7f41a4100f90 msgr2=0x7f41a410a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:48.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 shutdown_connections 2024-07-26T08:32:48.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:47.999+0000 7f41a9400640 1 -- 172.21.15.43:0/3536537427 wait complete. 2024-07-26T08:32:48.030 INFO:teuthology.run_tasks:Running task kclient... 2024-07-26T08:32:48.050 INFO:tasks.kclient:Mounting kernel clients... 2024-07-26T08:32:48.050 INFO:tasks.kclient:config is {'client.0': {}} 2024-07-26T08:32:48.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:48.051 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-07-26T08:32:48.106 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-07-26T08:32:48.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:48.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-26T08:32:48.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:48.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-07-26T08:32:48.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:47 smithi043 ceph-mon[32384]: pgmap v474: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:48.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:47 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3536537427' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:32:48.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:47 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:32:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:47 smithi133 ceph-mon[37053]: pgmap v474: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:47 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3536537427' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:32:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:47 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:32:48.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:47 smithi063 ceph-mon[36747]: pgmap v474: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:47 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3536537427' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:32:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:47 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-26T08:32:48.623 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-07-26T08:32:48.623 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-26T08:32:48.623 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-26T08:32:48.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs ls 2024-07-26T08:32:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:32:49.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:48 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-26T08:32:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:48 smithi043 ceph-mon[32384]: mgrmap e23: x(active, since 13m), standbys: z, y 2024-07-26T08:32:49.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:48 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-26T08:32:49.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:48 smithi133 ceph-mon[37053]: mgrmap e23: x(active, since 13m), standbys: z, y 2024-07-26T08:32:49.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:48 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-26T08:32:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:48 smithi063 ceph-mon[36747]: mgrmap e23: x(active, since 13m), standbys: z, y 2024-07-26T08:32:50.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:49 smithi043 ceph-mon[32384]: pgmap v475: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:50.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:49 smithi133 ceph-mon[37053]: pgmap v475: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:50.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:49 smithi063 ceph-mon[36747]: pgmap v475: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:51.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 -- 172.21.15.43:0/2431279042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c109650 msgr2=0x7f6e5c10fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 --2- 172.21.15.43:0/2431279042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c109650 0x7f6e5c10fe80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009be0 tx=0x7f6e5402a6d0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 -- 172.21.15.43:0/2431279042 shutdown_connections 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 --2- 172.21.15.43:0/2431279042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 0x7f6e5c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 --2- 172.21.15.43:0/2431279042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c109650 0x7f6e5c10fe80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 --2- 172.21.15.43:0/2431279042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c1033c0 0x7f6e5c1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 -- 172.21.15.43:0/2431279042 >> 172.21.15.43:0/2431279042 conn(0x7f6e5c0fee10 msgr2=0x7f6e5c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.638+0000 7f6e61c00640 1 -- 172.21.15.43:0/2431279042 shutdown_connections 2024-07-26T08:32:51.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.639+0000 7f6e61c00640 1 -- 172.21.15.43:0/2431279042 wait complete. 2024-07-26T08:32:51.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.640+0000 7f6e61c00640 1 Processor -- start 2024-07-26T08:32:51.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.640+0000 7f6e61c00640 1 -- start start 2024-07-26T08:32:51.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c1033c0 0x7f6e5c19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:51.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 0x7f6e5c19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:51.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c109650 0x7f6e5c1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:51.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c113430 con 0x7f6e5c109650 2024-07-26T08:32:51.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c1132b0 con 0x7f6e5c1033c0 2024-07-26T08:32:51.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c1135b0 con 0x7f6e5c108d00 2024-07-26T08:32:51.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c109650 0x7f6e5c1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c109650 0x7f6e5c1a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32948/0 (socket says 172.21.15.43:32948) 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e53400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 0x7f6e5c19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c1033c0 0x7f6e5c19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.641+0000 7f6e61200640 1 -- 172.21.15.43:0/1261011992 learned_addr learned my addr 172.21.15.43:0/1261011992 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e53400640 1 -- 172.21.15.43:0/1261011992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c1033c0 msgr2=0x7f6e5c19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e53400640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c1033c0 0x7f6e5c19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e53400640 1 -- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c109650 msgr2=0x7f6e5c1a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e53400640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c109650 0x7f6e5c1a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e53400640 1 -- 172.21.15.43:0/1261011992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c1a1f30 con 0x7f6e5c108d00 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e5be00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c1033c0 0x7f6e5c19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.642+0000 7f6e53400640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 0x7f6e5c19c560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c06c260 tx=0x7f6e4400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.643+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400cc40 con 0x7f6e5c108d00 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.643+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c1a2220 con 0x7f6e5c108d00 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.643+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6e4400cde0 con 0x7f6e5c108d00 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.643+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44018820 con 0x7f6e5c108d00 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.643+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c1a8980 con 0x7f6e5c108d00 2024-07-26T08:32:51.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.644+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c1037d0 con 0x7f6e5c108d00 2024-07-26T08:32:51.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.647+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f6e44010b40 con 0x7f6e5c108d00 2024-07-26T08:32:51.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.648+0000 7f6e59600640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e400b3c20 0x7f6e400b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:32:51.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.649+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f6e440e4930 con 0x7f6e5c108d00 2024-07-26T08:32:51.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.649+0000 7f6e5be00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e400b3c20 0x7f6e400b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:32:51.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.650+0000 7f6e5be00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e400b3c20 0x7f6e400b6130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0096c0 tx=0x7f6e4c009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:32:51.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.650+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6e440ab410 con 0x7f6e5c108d00 2024-07-26T08:32:51.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.897+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6e5c1a8bb0 con 0x7f6e5c108d00 2024-07-26T08:32:51.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.898+0000 7f6e59600640 1 -- 172.21.15.43:0/1261011992 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+88 (secure 0 0 0) 0x7f6e440af960 con 0x7f6e5c108d00 2024-07-26T08:32:51.900 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-26T08:32:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.902+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e400b3c20 msgr2=0x7f6e400b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.902+0000 7f6e61c00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e400b3c20 0x7f6e400b6130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0096c0 tx=0x7f6e4c009260 comp rx=0 tx=0).stop 2024-07-26T08:32:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.902+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 msgr2=0x7f6e5c19c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:32:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.902+0000 7f6e61c00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 0x7f6e5c19c560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c06c260 tx=0x7f6e4400ee50 comp rx=0 tx=0).stop 2024-07-26T08:32:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 shutdown_connections 2024-07-26T08:32:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f6e400b3c20 0x7f6e400b6130 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e5c108d00 0x7f6e5c19c560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:57.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e5c109650 0x7f6e5c1a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:57.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 --2- 172.21.15.43:0/1261011992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e5c1033c0 0x7f6e5c19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:32:57.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 >> 172.21.15.43:0/1261011992 conn(0x7f6e5c0fee10 msgr2=0x7f6e5c106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:32:57.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.903+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 shutdown_connections 2024-07-26T08:32:57.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:51.904+0000 7f6e61c00640 1 -- 172.21.15.43:0/1261011992 wait complete. 2024-07-26T08:32:57.273 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:51 smithi043 ceph-mon[32384]: pgmap v476: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:57.273 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:51 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1261011992' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:51 smithi063 ceph-mon[36747]: pgmap v476: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:51 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1261011992' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:53 smithi063 ceph-mon[36747]: pgmap v477: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:55 smithi063 ceph-mon[36747]: pgmap v478: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:57.283 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:51 smithi133 ceph-mon[37053]: pgmap v476: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:57.283 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:51 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1261011992' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T08:32:57.283 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:53 smithi133 ceph-mon[37053]: pgmap v477: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:57.283 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:55 smithi133 ceph-mon[37053]: pgmap v478: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:57.284 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-26T08:32:57.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-26T08:32:57.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-26T08:32:57.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:57.286 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-07-26T08:32:57.287 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:53 smithi043 ceph-mon[32384]: pgmap v477: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:32:57.287 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:55 smithi043 ceph-mon[32384]: pgmap v478: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:32:57.352 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-26T08:32:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-26T08:32:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-07-26T08:32:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-07-26T08:32:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-07-26T08:32:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-26T08:32:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 41666sec preferred_lft 41666sec 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-07-26T08:32:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-07-26T08:32:57.355 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-26T08:32:57.356 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:32:57.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:32:57.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:32:57.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:57.620 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-26T08:32:57.684 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-07-26T08:32:57.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:57.688 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-07-26T08:32:57.737 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-07-26T08:32:57.737 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-26T08:32:57.737 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-07-26T08:32:57.737 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-07-26T08:32:57.737 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-26T08:32:57.738 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:32:57.738 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:32:57.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-07-26T08:32:57.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-07-26T08:32:57.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-07-26T08:32:57.738 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:32:57.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:32:57.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:32:57.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:57.956 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-07-26T08:32:58.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:58.010 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-07-26T08:32:58.060 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:32:58.060 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:32:58.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T08:32:58.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-07-26T08:32:58.060 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:32:58.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:32:58.191 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:32:58 smithi043 ceph-mon[32384]: pgmap v479: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:58.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:32:58.247 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-07-26T08:32:58.248 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:32:58.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:32:58 smithi133 ceph-mon[37053]: pgmap v479: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:32:58 smithi063 ceph-mon[36747]: pgmap v479: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:32:58.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:32:58.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:32:58.529 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T08:32:58.529 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-07-26T08:32:58.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-07-26T08:32:58.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-07-26T08:32:58.530 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-07-26T08:32:58.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:32:58.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:32:58.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-26T08:32:58.744 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-26T08:32:58.789 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-26T08:32:58.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-26T08:32:58.790 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-26T08:32:58.885 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-07-26T08:32:58.885 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-07-26T08:32:58.885 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/ecaa3e14-b303-439b-a131-8be6ab5f3a6e 2024-07-26T08:32:58.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:58.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/ecaa3e14-b303-439b-a131-8be6ab5f3a6e /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-07-26T08:32:59.092 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-07-26T08:32:59.092 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-07-26T08:32:59.974 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-07-26T08:32:59.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-07-26T08:32:59.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.63:3300,172.21.15.133:3300" 2024-07-26T08:32:59.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@4bbb8ba0-4b27-11ef-bcb6-c7b262605968.cephfs=/volumes/qa/sv_1/ecaa3e14-b303-439b-a131-8be6ab5f3a6e 2024-07-26T08:32:59.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.43:3300/172.21.15.63:3300/172.21.15.133:3300" will pass to kernel 2024-07-26T08:32:59.977 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-26T08:32:59.977 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-07-26T08:32:59.977 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-26T08:32:59.977 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-07-26T08:32:59.977 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-26T08:32:59.982 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-26T08:32:59.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T08:32:59.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-26T08:33:00.069 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-26T08:33:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-26T08:33:00.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:33:00.201 INFO:teuthology.orchestra.run.smithi043.stdout:client15216 2024-07-26T08:33:00.201 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:33:00.201 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T08:33:00.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:00 smithi043 ceph-mon[32384]: pgmap v480: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:00.255 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-26T08:33:00.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:00 smithi133 ceph-mon[37053]: pgmap v480: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:00 smithi063 ceph-mon[36747]: pgmap v480: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:00.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-26T08:33:00.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:33:00.432 INFO:teuthology.orchestra.run.smithi043.stdout:client15216 2024-07-26T08:33:00.432 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-26T08:33:00.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-26T08:33:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:33:00.547 INFO:teuthology.orchestra.run.smithi043.stdout:client15216 2024-07-26T08:33:00.547 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968.client15216/status') 2024-07-26T08:33:00.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T08:33:00.687 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.15216 (3)192.168.0.1:0/1938065427 2024-07-26T08:33:00.687 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-07-26T08:33:00.687 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-07-26T08:33:00.687 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-07-26T08:33:00.687 INFO:teuthology.orchestra.run.smithi043.stderr:70 bytes copied, 8.8422e-05 s, 792 kB/s 2024-07-26T08:33:00.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T08:33:00.701 INFO:teuthology.run_tasks:Running task exec... 2024-07-26T08:33:00.709 INFO:teuthology.task.exec:Executing custom commands... 2024-07-26T08:33:00.709 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:33:00.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-07-26T08:33:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.985+0000 7f0ebd000640 1 -- 172.21.15.43:0/1620794543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 msgr2=0x7f0eb8109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.985+0000 7f0ebd000640 1 --2- 172.21.15.43:0/1620794543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb8109da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009900 tx=0x7f0ea802a410 comp rx=0 tx=0).stop 2024-07-26T08:33:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 -- 172.21.15.43:0/1620794543 shutdown_connections 2024-07-26T08:33:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 --2- 172.21.15.43:0/1620794543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb810f290 0x7f0eb810f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 --2- 172.21.15.43:0/1620794543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 0x7f0eb8116410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 --2- 172.21.15.43:0/1620794543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb8109da0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 -- 172.21.15.43:0/1620794543 >> 172.21.15.43:0/1620794543 conn(0x7f0eb80790b0 msgr2=0x7f0eb8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 -- 172.21.15.43:0/1620794543 shutdown_connections 2024-07-26T08:33:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.986+0000 7f0ebd000640 1 -- 172.21.15.43:0/1620794543 wait complete. 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 Processor -- start 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 -- start start 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb81a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb810f290 0x7f0eb81a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 0x7f0eb81a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8119a10 con 0x7f0eb8109990 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8119890 con 0x7f0eb810fbe0 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.987+0000 7f0ebd000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8119b90 con 0x7f0eb810f290 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb81a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb81a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36184/0 (socket says 172.21.15.43:36184) 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 -- 172.21.15.43:0/637785738 learned_addr learned my addr 172.21.15.43:0/637785738 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7e00640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 0x7f0eb81a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb6a00640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb810f290 0x7f0eb81a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 -- 172.21.15.43:0/637785738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb810f290 msgr2=0x7f0eb81a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb810f290 0x7f0eb81a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 -- 172.21.15.43:0/637785738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 msgr2=0x7f0eb81a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 0x7f0eb81a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7400640 1 -- 172.21.15.43:0/637785738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb81a6260 con 0x7f0eb8109990 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.988+0000 7f0eb7e00640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 0x7f0eb81a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.989+0000 7f0eb7400640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb81a0330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80314b0 tx=0x7f0ea8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:00.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.989+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea803f070 con 0x7f0eb8109990 2024-07-26T08:33:00.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.989+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ea8031bf0 con 0x7f0eb8109990 2024-07-26T08:33:00.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.989+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8035030 con 0x7f0eb8109990 2024-07-26T08:33:00.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.989+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb81a64f0 con 0x7f0eb8109990 2024-07-26T08:33:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.989+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb81acce0 con 0x7f0eb8109990 2024-07-26T08:33:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.990+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb8109da0 con 0x7f0eb8109990 2024-07-26T08:33:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.993+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f0ea8042070 con 0x7f0eb8109990 2024-07-26T08:33:00.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.995+0000 7f0eafe00640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e9c0b3c20 0x7f0e9c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:00.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.996+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f0ea8104b80 con 0x7f0eb8109990 2024-07-26T08:33:00.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.996+0000 7f0eb6a00640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e9c0b3c20 0x7f0e9c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:00.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.997+0000 7f0eb6a00640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e9c0b3c20 0x7f0e9c0b6130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0eb810ee10 tx=0x7f0ea4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:01.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:00.998+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0ea80cbcb0 con 0x7f0eb8109990 2024-07-26T08:33:01.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:01.261+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f0eb81a1450 con 0x7f0eb8109990 2024-07-26T08:33:02.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.022+0000 7f0eafe00640 1 -- 172.21.15.43:0/637785738 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f0eb81a1450 con 0x7f0eb8109990 2024-07-26T08:33:02.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.026+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e9c0b3c20 msgr2=0x7f0e9c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.026+0000 7f0ebd000640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e9c0b3c20 0x7f0e9c0b6130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0eb810ee10 tx=0x7f0ea4005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.026+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 msgr2=0x7f0eb81a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.026+0000 7f0ebd000640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb81a0330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80314b0 tx=0x7f0ea8003c10 comp rx=0 tx=0).stop 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 shutdown_connections 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e9c0b3c20 0x7f0e9c0b6130 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb810f290 0x7f0eb81a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb810fbe0 0x7f0eb81a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 --2- 172.21.15.43:0/637785738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0eb8109990 0x7f0eb81a0330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 >> 172.21.15.43:0/637785738 conn(0x7f0eb80790b0 msgr2=0x7f0eb807a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 shutdown_connections 2024-07-26T08:33:02.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.027+0000 7f0ebd000640 1 -- 172.21.15.43:0/637785738 wait complete. 2024-07-26T08:33:02.059 INFO:teuthology.run_tasks:Running task check-counter... 2024-07-26T08:33:02.080 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-07-26T08:33:02.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-26T08:33:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:02 smithi133 ceph-mon[37053]: pgmap v481: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:33:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:02 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/637785738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-07-26T08:33:02.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:02 smithi063 ceph-mon[36747]: pgmap v481: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:33:02.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:02 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/637785738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-07-26T08:33:02.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 -- 172.21.15.43:0/3854548238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac410c030 msgr2=0x7f5ac410c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/3854548238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac410c030 0x7f5ac410c440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009900 tx=0x7f5aac02a410 comp rx=0 tx=0).stop 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 -- 172.21.15.43:0/3854548238 shutdown_connections 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/3854548238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ac410c980 0x7f5ac41163f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/3854548238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac410c030 0x7f5ac410c440 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/3854548238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ac4109990 0x7f5ac4109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 -- 172.21.15.43:0/3854548238 >> 172.21.15.43:0/3854548238 conn(0x7f5ac40790b0 msgr2=0x7f5ac4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 -- 172.21.15.43:0/3854548238 shutdown_connections 2024-07-26T08:33:02.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.387+0000 7f5ac9e00640 1 -- 172.21.15.43:0/3854548238 wait complete. 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.388+0000 7f5ac9e00640 1 Processor -- start 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.388+0000 7f5ac9e00640 1 -- start start 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 0x7f5ac41a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ac410c030 0x7f5ac41a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ac410c980 0x7f5ac41a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41199a0 con 0x7f5ac4109990 2024-07-26T08:33:02.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4119820 con 0x7f5ac410c030 2024-07-26T08:33:02.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4119b20 con 0x7f5ac410c980 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 0x7f5ac41a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 0x7f5ac41a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36196/0 (socket says 172.21.15.43:36196) 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac8a00640 1 -- 172.21.15.43:0/2674572869 learned_addr learned my addr 172.21.15.43:0/2674572869 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac3e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ac410c030 0x7f5ac41a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.389+0000 7f5ac9400640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ac410c980 0x7f5ac41a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac8a00640 1 -- 172.21.15.43:0/2674572869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ac410c980 msgr2=0x7f5ac41a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac8a00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ac410c980 0x7f5ac41a5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac8a00640 1 -- 172.21.15.43:0/2674572869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ac410c030 msgr2=0x7f5ac41a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac8a00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ac410c030 0x7f5ac41a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac8a00640 1 -- 172.21.15.43:0/2674572869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac41a6230 con 0x7f5ac4109990 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac8a00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 0x7f5ac41a0300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400ebc0 tx=0x7f5ab400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4010630 con 0x7f5ac4109990 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ab4010ca0 con 0x7f5ac4109990 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.390+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac41a6520 con 0x7f5ac4109990 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.391+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4018ba0 con 0x7f5ac4109990 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.391+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41accb0 con 0x7f5ac4109990 2024-07-26T08:33:02.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.392+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4109da0 con 0x7f5ac4109990 2024-07-26T08:33:02.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.395+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f5ab40107d0 con 0x7f5ac4109990 2024-07-26T08:33:02.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.397+0000 7f5ac1600640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5aa80b3c20 0x7f5aa80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.398+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f5ab40e4bf0 con 0x7f5ac4109990 2024-07-26T08:33:02.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.398+0000 7f5ac3e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5aa80b3c20 0x7f5aa80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.399+0000 7f5ac3e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5aa80b3c20 0x7f5aa80b6130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0314b0 tx=0x7f5aac0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:02.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.400+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5ab4010ac0 con 0x7f5ac4109990 2024-07-26T08:33:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:02 smithi043 ceph-mon[32384]: pgmap v481: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:33:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:02 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/637785738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-07-26T08:33:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.618+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ac41112e0 con 0x7f5ac4109990 2024-07-26T08:33:02.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.621+0000 7f5ac1600640 1 -- 172.21.15.43:0/2674572869 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7f5ab40ab6d0 con 0x7f5ac4109990 2024-07-26T08:33:02.623 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:02.623 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:33:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.623+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5aa80b3c20 msgr2=0x7f5aa80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.623+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5aa80b3c20 0x7f5aa80b6130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0314b0 tx=0x7f5aac0058d0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.623+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 msgr2=0x7f5ac41a0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.623+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 0x7f5ac41a0300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400ebc0 tx=0x7f5ab400c6a0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 shutdown_connections 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5aa80b3c20 0x7f5aa80b6130 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ac410c980 0x7f5ac41a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ac410c030 0x7f5ac41a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 --2- 172.21.15.43:0/2674572869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac4109990 0x7f5ac41a0300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 >> 172.21.15.43:0/2674572869 conn(0x7f5ac40790b0 msgr2=0x7f5ac410d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 shutdown_connections 2024-07-26T08:33:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.624+0000 7f5ac9e00640 1 -- 172.21.15.43:0/2674572869 wait complete. 2024-07-26T08:33:02.652 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-26T08:22:02.663853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-26T08:27:28.061294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-26T08:27:32.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-07-26T08:27:46.378868+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-07-26T08:33:02.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-26T08:33:02.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 -- 172.21.15.43:0/1196619126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70410b7b0 msgr2=0x7fc704111fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 --2- 172.21.15.43:0/1196619126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70410b7b0 0x7fc704111fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009be0 tx=0x7fc6fc02a6d0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 -- 172.21.15.43:0/1196619126 shutdown_connections 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 --2- 172.21.15.43:0/1196619126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70410b7b0 0x7fc704111fe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 --2- 172.21.15.43:0/1196619126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70410ae60 0x7fc70410b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 --2- 172.21.15.43:0/1196619126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc704105530 0x7fc704105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 -- 172.21.15.43:0/1196619126 >> 172.21.15.43:0/1196619126 conn(0x7fc704100f90 msgr2=0x7fc7041033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 -- 172.21.15.43:0/1196619126 shutdown_connections 2024-07-26T08:33:02.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.939+0000 7fc70ac00640 1 -- 172.21.15.43:0/1196619126 wait complete. 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.940+0000 7fc70ac00640 1 Processor -- start 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.940+0000 7fc70ac00640 1 -- start start 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70ac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 0x7fc70419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70ac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70410ae60 0x7fc70419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70ac00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc70410b7b0 0x7fc7041a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70ac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc704115590 con 0x7fc704105530 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70ac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc704115410 con 0x7fc70410ae60 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70ac00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc704115710 con 0x7fc70410b7b0 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 0x7fc70419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc708e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70410ae60 0x7fc70419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 0x7fc70419bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36214/0 (socket says 172.21.15.43:36214) 2024-07-26T08:33:02.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 -- 172.21.15.43:0/2006416569 learned_addr learned my addr 172.21.15.43:0/2006416569 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc70a200640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc70410b7b0 0x7fc7041a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 -- 172.21.15.43:0/2006416569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc70410b7b0 msgr2=0x7fc7041a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc70410b7b0 0x7fc7041a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 -- 172.21.15.43:0/2006416569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70410ae60 msgr2=0x7fc70419c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70410ae60 0x7fc70419c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.941+0000 7fc709800640 1 -- 172.21.15.43:0/2006416569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7041a1e20 con 0x7fc704105530 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.942+0000 7fc709800640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 0x7fc70419bef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800e9c0 tx=0x7fc6f800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.942+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800cde0 con 0x7fc704105530 2024-07-26T08:33:02.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.942+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6f80035f0 con 0x7fc704105530 2024-07-26T08:33:02.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.942+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8010690 con 0x7fc704105530 2024-07-26T08:33:02.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.942+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7041a2110 con 0x7fc704105530 2024-07-26T08:33:02.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.942+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7041a88a0 con 0x7fc704105530 2024-07-26T08:33:02.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.943+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc704105940 con 0x7fc704105530 2024-07-26T08:33:02.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.946+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fc6f80037a0 con 0x7fc704105530 2024-07-26T08:33:02.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.948+0000 7fc702000640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6ec0b3c20 0x7fc6ec0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:02.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.948+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc6f80e4520 con 0x7fc704105530 2024-07-26T08:33:02.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.948+0000 7fc708e00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6ec0b3c20 0x7fc6ec0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:02.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.949+0000 7fc708e00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6ec0b3c20 0x7fc6ec0b6130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00095f0 tx=0x7fc6f0005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:02.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:02.950+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc6f80ab6e0 con 0x7fc704105530 2024-07-26T08:33:03.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.170+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc70402e0c0 con 0x7fc704105530 2024-07-26T08:33:03.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.171+0000 7fc702000640 1 -- 172.21.15.43:0/2006416569 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7fc6f80aafe0 con 0x7fc704105530 2024-07-26T08:33:03.173 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6ec0b3c20 msgr2=0x7fc6ec0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6ec0b3c20 0x7fc6ec0b6130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00095f0 tx=0x7fc6f0005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 msgr2=0x7fc70419bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 0x7fc70419bef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800e9c0 tx=0x7fc6f800ee80 comp rx=0 tx=0).stop 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 shutdown_connections 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc6ec0b3c20 0x7fc6ec0b6130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc70410b7b0 0x7fc7041a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc70410ae60 0x7fc70419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 --2- 172.21.15.43:0/2006416569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704105530 0x7fc70419bef0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.174+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 >> 172.21.15.43:0/2006416569 conn(0x7fc704100f90 msgr2=0x7fc7041033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:03.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.175+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 shutdown_connections 2024-07-26T08:33:03.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.175+0000 7fc70ac00640 1 -- 172.21.15.43:0/2006416569 wait complete. 2024-07-26T08:33:03.203 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-26T08:33:03.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:03 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/637785738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-07-26T08:33:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:03 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:33:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:03 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2674572869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:33:03.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/637785738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-07-26T08:33:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:03 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:33:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:03 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2674572869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:33:03.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 -- 172.21.15.43:0/1024311330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104a80 msgr2=0x7f73ac10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 --2- 172.21.15.43:0/1024311330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104a80 0x7f73ac10d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7394009860 tx=0x7f739402a340 comp rx=0 tx=0).stop 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 -- 172.21.15.43:0/1024311330 shutdown_connections 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 --2- 172.21.15.43:0/1024311330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac10d600 0x7f73ac10faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 --2- 172.21.15.43:0/1024311330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104a80 0x7f73ac10d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 --2- 172.21.15.43:0/1024311330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73ac104050 0x7f73ac104460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 -- 172.21.15.43:0/1024311330 >> 172.21.15.43:0/1024311330 conn(0x7f73ac079f10 msgr2=0x7f73ac07a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 -- 172.21.15.43:0/1024311330 shutdown_connections 2024-07-26T08:33:03.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.488+0000 7f73b1200640 1 -- 172.21.15.43:0/1024311330 wait complete. 2024-07-26T08:33:03.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 Processor -- start 2024-07-26T08:33:03.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 -- start start 2024-07-26T08:33:03.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104050 0x7f73ac19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:03.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 0x7f73ac19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:03.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73ac10d600 0x7f73ac1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:03.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac113330 con 0x7f73ac10d600 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac1131b0 con 0x7f73ac104050 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.490+0000 7f73b1200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac1134b0 con 0x7f73ac104a80 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 0x7f73ac19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 0x7f73ac19c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:48744/0 (socket says 172.21.15.43:48744) 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 -- 172.21.15.43:0/3153687851 learned_addr learned my addr 172.21.15.43:0/3153687851 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73abe00640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73ac10d600 0x7f73ac1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73ab400640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104050 0x7f73ac19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 -- 172.21.15.43:0/3153687851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104050 msgr2=0x7f73ac19bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104050 0x7f73ac19bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 -- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73ac10d600 msgr2=0x7f73ac1a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73ac10d600 0x7f73ac1a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 -- 172.21.15.43:0/3153687851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac1a1e40 con 0x7f73ac104a80 2024-07-26T08:33:03.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.491+0000 7f73a2a00640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 0x7f73ac19c4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f739402a860 tx=0x7f739402aeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:03.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.492+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394037040 con 0x7f73ac104a80 2024-07-26T08:33:03.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.492+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7394040070 con 0x7f73ac104a80 2024-07-26T08:33:03.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.492+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac1a20d0 con 0x7f73ac104a80 2024-07-26T08:33:03.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.492+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394003850 con 0x7f73ac104a80 2024-07-26T08:33:03.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.492+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac1a88c0 con 0x7f73ac104a80 2024-07-26T08:33:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.493+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac06a770 con 0x7f73ac104a80 2024-07-26T08:33:03.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.496+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f7394030340 con 0x7f73ac104a80 2024-07-26T08:33:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.498+0000 7f73a8c00640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73900b3c20 0x7f73900b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.498+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f7394104960 con 0x7f73ac104a80 2024-07-26T08:33:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.498+0000 7f73ab400640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73900b3c20 0x7f73900b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:03.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.499+0000 7f73ab400640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73900b3c20 0x7f73900b6130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f739c009530 tx=0x7f739c009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:03.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.499+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f73940cba90 con 0x7f73ac104a80 2024-07-26T08:33:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:03 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/637785738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-07-26T08:33:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:03 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:33:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:03 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2674572869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:33:03.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.711+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f73ac1a8a90 con 0x7f73ac104a80 2024-07-26T08:33:03.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.712+0000 7f73a8c00640 1 -- 172.21.15.43:0/3153687851 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f73940cb390 con 0x7f73ac104a80 2024-07-26T08:33:03.717 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-07-26T08:33:03.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73900b3c20 msgr2=0x7f73900b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73900b3c20 0x7f73900b6130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f739c009530 tx=0x7f739c009260 comp rx=0 tx=0).stop 2024-07-26T08:33:03.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 msgr2=0x7f73ac19c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:03.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 0x7f73ac19c4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f739402a860 tx=0x7f739402aeb0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 shutdown_connections 2024-07-26T08:33:03.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73900b3c20 0x7f73900b6130 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac104a80 0x7f73ac19c4b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73ac10d600 0x7f73ac1a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 --2- 172.21.15.43:0/3153687851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73ac104050 0x7f73ac19bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:03.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 >> 172.21.15.43:0/3153687851 conn(0x7f73ac079f10 msgr2=0x7f73ac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:03.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 shutdown_connections 2024-07-26T08:33:03.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:03.715+0000 7f73b1200640 1 -- 172.21.15.43:0/3153687851 wait complete. 2024-07-26T08:33:03.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-26T08:33:04.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 -- 172.21.15.43:0/1282856421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 msgr2=0x7f56bc10fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 --2- 172.21.15.43:0/1282856421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc10fab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009be0 tx=0x7f56b402a6d0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 -- 172.21.15.43:0/1282856421 shutdown_connections 2024-07-26T08:33:04.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 --2- 172.21.15.43:0/1282856421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc10fab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 --2- 172.21.15.43:0/1282856421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104ab0 0x7f56bc10cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 --2- 172.21.15.43:0/1282856421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56bc104160 0x7f56bc104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.031+0000 7f56bb200640 1 -- 172.21.15.43:0/1282856421 >> 172.21.15.43:0/1282856421 conn(0x7f56bc0fdc10 msgr2=0x7f56bc100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.032+0000 7f56bb200640 1 -- 172.21.15.43:0/1282856421 shutdown_connections 2024-07-26T08:33:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.032+0000 7f56bb200640 1 -- 172.21.15.43:0/1282856421 wait complete. 2024-07-26T08:33:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.033+0000 7f56bb200640 1 Processor -- start 2024-07-26T08:33:04.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.034+0000 7f56bb200640 1 -- start start 2024-07-26T08:33:04.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.034+0000 7f56bb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 0x7f56bc19bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.034+0000 7f56bb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56bc104ab0 0x7f56bc19c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.034+0000 7f56bb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.034+0000 7f56bb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc113380 con 0x7f56bc104ab0 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56bb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc113200 con 0x7f56bc104160 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56bb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc113500 con 0x7f56bc10d5c0 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 0x7f56bc19bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 0x7f56bc19bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:42306/0 (socket says 172.21.15.43:42306) 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 -- 172.21.15.43:0/1406434142 learned_addr learned my addr 172.21.15.43:0/1406434142 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b3e00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56bc104ab0 0x7f56bc19c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56ba800640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 -- 172.21.15.43:0/1406434142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 msgr2=0x7f56bc1a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc1a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 -- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56bc104ab0 msgr2=0x7f56bc19c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56bc104ab0 0x7f56bc19c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56b9e00640 1 -- 172.21.15.43:0/1406434142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc1a1e50 con 0x7f56bc104160 2024-07-26T08:33:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.035+0000 7f56ba800640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:33:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.036+0000 7f56b9e00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 0x7f56bc19bf20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00e9c0 tx=0x7f56ac00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.038+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac00ccc0 con 0x7f56bc104160 2024-07-26T08:33:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.038+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f56ac0054f0 con 0x7f56bc104160 2024-07-26T08:33:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.038+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac010430 con 0x7f56bc104160 2024-07-26T08:33:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.039+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc1a2140 con 0x7f56bc104160 2024-07-26T08:33:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.039+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc1a88d0 con 0x7f56bc104160 2024-07-26T08:33:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.040+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc104570 con 0x7f56bc104160 2024-07-26T08:33:04.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.042+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f56ac005020 con 0x7f56bc104160 2024-07-26T08:33:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.044+0000 7f56b2a00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56a00b3d70 0x7f56a00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.044+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f56ac0e4530 con 0x7f56bc104160 2024-07-26T08:33:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.044+0000 7f56b3e00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56a00b3d70 0x7f56a00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.045+0000 7f56b3e00640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56a00b3d70 0x7f56a00b6280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f56bc10f430 tx=0x7f56a4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.048+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f56ac005310 con 0x7f56bc104160 2024-07-26T08:33:04.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.259+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56bc1a8bb0 con 0x7f56bc104160 2024-07-26T08:33:04.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.260+0000 7f56b2a00640 1 -- 172.21.15.43:0/1406434142 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f56ac0ab660 con 0x7f56bc104160 2024-07-26T08:33:04.261 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-07-26T08:33:04.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56a00b3d70 msgr2=0x7f56a00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56a00b3d70 0x7f56a00b6280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f56bc10f430 tx=0x7f56a4005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:04.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 msgr2=0x7f56bc19bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 0x7f56bc19bf20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00e9c0 tx=0x7f56ac00ee80 comp rx=0 tx=0).stop 2024-07-26T08:33:04.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 shutdown_connections 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f56a00b3d70 0x7f56a00b6280 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56bc10d5c0 0x7f56bc1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56bc104ab0 0x7f56bc19c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 --2- 172.21.15.43:0/1406434142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56bc104160 0x7f56bc19bf20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 >> 172.21.15.43:0/1406434142 conn(0x7f56bc0fdc10 msgr2=0x7f56bc101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 shutdown_connections 2024-07-26T08:33:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.263+0000 7f56bb200640 1 -- 172.21.15.43:0/1406434142 wait complete. 2024-07-26T08:33:04.291 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:04 smithi043 ceph-mon[32384]: pgmap v482: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:33:04.291 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:04 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2006416569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T08:33:04.291 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:04 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3153687851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T08:33:04.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-07-26T08:33:04.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:04 smithi063 ceph-mon[36747]: pgmap v482: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:33:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:04 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2006416569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T08:33:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:04 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3153687851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T08:33:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:04 smithi133 ceph-mon[37053]: pgmap v482: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:33:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2006416569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T08:33:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3153687851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T08:33:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 -- 172.21.15.43:0/722037497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244101f30 msgr2=0x7f6244102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 --2- 172.21.15.43:0/722037497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244101f30 0x7f6244102340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6234009ca0 tx=0x7f623402a940 comp rx=0 tx=0).stop 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 -- 172.21.15.43:0/722037497 shutdown_connections 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 --2- 172.21.15.43:0/722037497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624410fae0 0x7f6244111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 --2- 172.21.15.43:0/722037497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6244102880 0x7f624410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 --2- 172.21.15.43:0/722037497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244101f30 0x7f6244102340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 -- 172.21.15.43:0/722037497 >> 172.21.15.43:0/722037497 conn(0x7f62440fddf0 msgr2=0x7f6244100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 -- 172.21.15.43:0/722037497 shutdown_connections 2024-07-26T08:33:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.581+0000 7f624a200640 1 -- 172.21.15.43:0/722037497 wait complete. 2024-07-26T08:33:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.582+0000 7f624a200640 1 Processor -- start 2024-07-26T08:33:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.582+0000 7f624a200640 1 -- start start 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.582+0000 7f624a200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6244101f30 0x7f624419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.582+0000 7f624a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 0x7f624419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.582+0000 7f624a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624410fae0 0x7f62441a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f624a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62441156f0 con 0x7f6244102880 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f624a200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6244115570 con 0x7f624410fae0 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f624a200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6244115870 con 0x7f6244101f30 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 0x7f624419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 0x7f624419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36254/0 (socket says 172.21.15.43:36254) 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 -- 172.21.15.43:0/3869711893 learned_addr learned my addr 172.21.15.43:0/3869711893 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6243e00640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624410fae0 0x7f62441a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6243400640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6244101f30 0x7f624419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 -- 172.21.15.43:0/3869711893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6244101f30 msgr2=0x7f624419c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6244101f30 0x7f624419c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 -- 172.21.15.43:0/3869711893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624410fae0 msgr2=0x7f62441a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624410fae0 0x7f62441a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.583+0000 7f6242a00640 1 -- 172.21.15.43:0/3869711893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62441a1fe0 con 0x7f6244102880 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.584+0000 7f6242a00640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 0x7f624419c650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f623000ea60 tx=0x7f623000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.584+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623000cd20 con 0x7f6244102880 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.584+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62300035f0 con 0x7f6244102880 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.584+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62441a22d0 con 0x7f6244102880 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.584+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230010690 con 0x7f6244102880 2024-07-26T08:33:04.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.584+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62441a8a60 con 0x7f6244102880 2024-07-26T08:33:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.585+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624406b9d0 con 0x7f6244102880 2024-07-26T08:33:04.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.589+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f62300037a0 con 0x7f6244102880 2024-07-26T08:33:04.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.592+0000 7f623be00640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f62280b3ca0 0x7f62280b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:04.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.592+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f62300e44b0 con 0x7f6244102880 2024-07-26T08:33:04.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.592+0000 7f6243400640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f62280b3ca0 0x7f62280b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.593+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f62300ab670 con 0x7f6244102880 2024-07-26T08:33:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.593+0000 7f6243400640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f62280b3ca0 0x7f62280b61b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6234004af0 tx=0x7f623402ffc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:04.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.816+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f624419d1d0 con 0x7f6244102880 2024-07-26T08:33:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.817+0000 7f623be00640 1 -- 172.21.15.43:0/3869711893 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f62300aaf70 con 0x7f6244102880 2024-07-26T08:33:04.819 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f62280b3ca0 msgr2=0x7f62280b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f62280b3ca0 0x7f62280b61b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6234004af0 tx=0x7f623402ffc0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 msgr2=0x7f624419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 0x7f624419c650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f623000ea60 tx=0x7f623000ee60 comp rx=0 tx=0).stop 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 shutdown_connections 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f62280b3ca0 0x7f62280b61b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624410fae0 0x7f62441a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6244102880 0x7f624419c650 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 --2- 172.21.15.43:0/3869711893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6244101f30 0x7f624419c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:04.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.820+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 >> 172.21.15.43:0/3869711893 conn(0x7f62440fddf0 msgr2=0x7f6244111c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.821+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 shutdown_connections 2024-07-26T08:33:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:04.821+0000 7f624a200640 1 -- 172.21.15.43:0/3869711893 wait complete. 2024-07-26T08:33:04.848 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-07-26T08:33:04.848 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:33:05.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:05 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1406434142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T08:33:05.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:05 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3869711893' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-07-26T08:33:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:05 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1406434142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T08:33:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:05 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3869711893' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-07-26T08:33:05.339 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:33:05.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:05 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1406434142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T08:33:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:05 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3869711893' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-07-26T08:33:06.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:06 smithi063 ceph-mon[36747]: pgmap v483: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-26T08:33:06.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:06 smithi043 ceph-mon[32384]: pgmap v483: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-26T08:33:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:06 smithi133 ceph-mon[37053]: pgmap v483: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-26T08:33:07.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 -- 172.21.15.43:0/1461894791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810f330 msgr2=0x7f272810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:07.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 --2- 172.21.15.43:0/1461894791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810f330 0x7f272810f740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2714009900 tx=0x7f271402a400 comp rx=0 tx=0).stop 2024-07-26T08:33:07.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 -- 172.21.15.43:0/1461894791 shutdown_connections 2024-07-26T08:33:07.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 --2- 172.21.15.43:0/1461894791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272810fc80 0x7f27281164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:07.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 --2- 172.21.15.43:0/1461894791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810f330 0x7f272810f740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:07.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 --2- 172.21.15.43:0/1461894791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27281099f0 0x7f2728109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:07.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 -- 172.21.15.43:0/1461894791 >> 172.21.15.43:0/1461894791 conn(0x7f2728078ff0 msgr2=0x7f2728107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:07.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 -- 172.21.15.43:0/1461894791 shutdown_connections 2024-07-26T08:33:07.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.836+0000 7f272de00640 1 -- 172.21.15.43:0/1461894791 wait complete. 2024-07-26T08:33:07.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.837+0000 7f272de00640 1 Processor -- start 2024-07-26T08:33:07.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 -- start start 2024-07-26T08:33:07.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27281099f0 0x7f27281a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:07.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f272810f330 0x7f27281a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:07.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810fc80 0x7f27281a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:07.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2728119a60 con 0x7f272810fc80 2024-07-26T08:33:07.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f27281198e0 con 0x7f272810f330 2024-07-26T08:33:07.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272de00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2728119be0 con 0x7f27281099f0 2024-07-26T08:33:07.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810fc80 0x7f27281a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:07.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810fc80 0x7f27281a5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44414/0 (socket says 172.21.15.43:44414) 2024-07-26T08:33:07.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272d400640 1 -- 172.21.15.43:0/600347321 learned_addr learned my addr 172.21.15.43:0/600347321 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:07.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.838+0000 7f272ca00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27281099f0 0x7f27281a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:07.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f2727e00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f272810f330 0x7f27281a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:07.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f272ca00640 1 -- 172.21.15.43:0/600347321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f272810f330 msgr2=0x7f27281a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:07.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f272ca00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f272810f330 0x7f27281a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:07.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f272ca00640 1 -- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810fc80 msgr2=0x7f27281a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:07.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f272ca00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810fc80 0x7f27281a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:07.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f272ca00640 1 -- 172.21.15.43:0/600347321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27281a63c0 con 0x7f27281099f0 2024-07-26T08:33:07.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.839+0000 7f272ca00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27281099f0 0x7f27281a0450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f271c005fd0 tx=0x7f271c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:07.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.840+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c009c30 con 0x7f27281099f0 2024-07-26T08:33:07.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.840+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f271c009dd0 con 0x7f27281099f0 2024-07-26T08:33:07.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.840+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c010460 con 0x7f27281099f0 2024-07-26T08:33:07.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.840+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27281a66b0 con 0x7f27281099f0 2024-07-26T08:33:07.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.840+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27281ace10 con 0x7f27281099f0 2024-07-26T08:33:07.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.841+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2728109e00 con 0x7f27281099f0 2024-07-26T08:33:07.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.844+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f271c0035f0 con 0x7f27281099f0 2024-07-26T08:33:07.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.845+0000 7f2725600640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f27100b3ca0 0x7f27100b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:07.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.845+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f271c0e3c20 con 0x7f27281099f0 2024-07-26T08:33:07.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.845+0000 7f2727e00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f27100b3ca0 0x7f27100b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:07.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.846+0000 7f2727e00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f27100b3ca0 0x7f27100b61b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2714005940 tx=0x7f27140058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:07.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:07.847+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f271c017020 con 0x7f27281099f0 2024-07-26T08:33:08.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.090+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f272802e0c0 con 0x7f27281099f0 2024-07-26T08:33:08.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.092+0000 7f2725600640 1 -- 172.21.15.43:0/600347321 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11895 (secure 0 0 0) 0x7f271c0aa780 con 0x7f27281099f0 2024-07-26T08:33:08.094 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:08.094 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"btime":"2024-07-26T08:33:02:007771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:33:01.263024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24733,24710,24709]},"id":1}]} 2024-07-26T08:33:08.094 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 25 2024-07-26T08:33:08.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f27100b3ca0 msgr2=0x7f27100b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:08.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f27100b3ca0 0x7f27100b61b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2714005940 tx=0x7f27140058d0 comp rx=0 tx=0).stop 2024-07-26T08:33:08.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27281099f0 msgr2=0x7f27281a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:08.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27281099f0 0x7f27281a0450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f271c005fd0 tx=0x7f271c00dde0 comp rx=0 tx=0).stop 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 shutdown_connections 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f27100b3ca0 0x7f27100b61b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272810fc80 0x7f27281a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f272810f330 0x7f27281a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 --2- 172.21.15.43:0/600347321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27281099f0 0x7f27281a0450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 >> 172.21.15.43:0/600347321 conn(0x7f2728078ff0 msgr2=0x7f2728079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.095+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 shutdown_connections 2024-07-26T08:33:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:08.096+0000 7f272de00640 1 -- 172.21.15.43:0/600347321 wait complete. 2024-07-26T08:33:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:08 smithi063 ceph-mon[36747]: pgmap v484: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-07-26T08:33:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:08 smithi043 ceph-mon[32384]: pgmap v484: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-07-26T08:33:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:08 smithi133 ceph-mon[37053]: pgmap v484: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-07-26T08:33:09.067 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:09 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/600347321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:33:09.145 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-07-26T08:33:09.146 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-07-26T08:33:09.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-26T08:33:09.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:09 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/600347321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:33:09.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.437+0000 7f1803e00640 1 -- 172.21.15.43:0/3591166271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18041095a0 msgr2=0x7f180410fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.437+0000 7f1803e00640 1 --2- 172.21.15.43:0/3591166271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18041095a0 0x7f180410fdd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009ca0 tx=0x7f17fc02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.437+0000 7f1803e00640 1 -- 172.21.15.43:0/3591166271 shutdown_connections 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.437+0000 7f1803e00640 1 --2- 172.21.15.43:0/3591166271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18041095a0 0x7f180410fdd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.437+0000 7f1803e00640 1 --2- 172.21.15.43:0/3591166271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1804108c50 0x7f1804109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.438+0000 7f1803e00640 1 --2- 172.21.15.43:0/3591166271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1804103320 0x7f1804103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.438+0000 7f1803e00640 1 -- 172.21.15.43:0/3591166271 >> 172.21.15.43:0/3591166271 conn(0x7f18040fed60 msgr2=0x7f18041011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.438+0000 7f1803e00640 1 -- 172.21.15.43:0/3591166271 shutdown_connections 2024-07-26T08:33:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.438+0000 7f1803e00640 1 -- 172.21.15.43:0/3591166271 wait complete. 2024-07-26T08:33:09.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.439+0000 7f1803e00640 1 Processor -- start 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.439+0000 7f1803e00640 1 -- start start 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1804103320 0x7f1804199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1804108c50 0x7f180419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18041095a0 0x7f180419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18041133f0 con 0x7f1804103320 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1804113270 con 0x7f1804108c50 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1804113570 con 0x7f18041095a0 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18041095a0 0x7f180419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:09.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18041095a0 0x7f180419f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49356/0 (socket says 172.21.15.43:49356) 2024-07-26T08:33:09.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1803400640 1 -- 172.21.15.43:0/2025576305 learned_addr learned my addr 172.21.15.43:0/2025576305 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:09.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f17fbe00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1804108c50 0x7f180419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:09.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.440+0000 7f1802a00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1804103320 0x7f1804199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fbe00640 1 -- 172.21.15.43:0/2025576305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18041095a0 msgr2=0x7f180419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fbe00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18041095a0 0x7f180419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fbe00640 1 -- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1804103320 msgr2=0x7f1804199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fbe00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1804103320 0x7f1804199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fbe00640 1 -- 172.21.15.43:0/2025576305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180419fcc0 con 0x7f1804108c50 2024-07-26T08:33:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fbe00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1804108c50 0x7f180419a330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f180406c230 tx=0x7f17ec00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:09.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.441+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00cc40 con 0x7f1804108c50 2024-07-26T08:33:09.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.442+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17ec00cde0 con 0x7f1804108c50 2024-07-26T08:33:09.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.442+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec018810 con 0x7f1804108c50 2024-07-26T08:33:09.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.442+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180419ffb0 con 0x7f1804108c50 2024-07-26T08:33:09.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.442+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18041a6740 con 0x7f1804108c50 2024-07-26T08:33:09.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.443+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1804104590 con 0x7f1804108c50 2024-07-26T08:33:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.446+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f17ec010b40 con 0x7f1804108c50 2024-07-26T08:33:09.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.447+0000 7f17fb400640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17e80b3ca0 0x7f17e80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:09.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.447+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f17ec0e4350 con 0x7f1804108c50 2024-07-26T08:33:09.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.448+0000 7f1802a00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17e80b3ca0 0x7f17e80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:09.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.449+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f17ec0aae30 con 0x7f1804108c50 2024-07-26T08:33:09.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.449+0000 7f1802a00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17e80b3ca0 0x7f17e80b61b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009bd0 tx=0x7f17f4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:09.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:09 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/600347321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:33:09.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.659+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f180410b3f0 con 0x7f17e80b3ca0 2024-07-26T08:33:09.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.679+0000 7f17fb400640 1 -- 172.21.15.43:0/2025576305 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340498 (secure 0 0 0) 0x7f180410b3f0 con 0x7f17e80b3ca0 2024-07-26T08:33:09.687 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17e80b3ca0 msgr2=0x7f17e80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17e80b3ca0 0x7f17e80b61b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009bd0 tx=0x7f17f4005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1804108c50 msgr2=0x7f180419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1804108c50 0x7f180419a330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f180406c230 tx=0x7f17ec00ee50 comp rx=0 tx=0).stop 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 shutdown_connections 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17e80b3ca0 0x7f17e80b61b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18041095a0 0x7f180419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1804108c50 0x7f180419a330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 --2- 172.21.15.43:0/2025576305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1804103320 0x7f1804199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:09.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 >> 172.21.15.43:0/2025576305 conn(0x7f18040fed60 msgr2=0x7f1804106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:09.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 shutdown_connections 2024-07-26T08:33:09.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:09.688+0000 7f1803e00640 1 -- 172.21.15.43:0/2025576305 wait complete. 2024-07-26T08:33:09.719 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":485,"stamp":"2024-07-26T08:33:08.839570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662213,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1560,"num_read_kb":885,"num_write":303,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388412,"kb_used_data":14300,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553412,"statfs":{"total":1151940427776,"available":1151542693888,"internally_reserved":0,"allocated":14643200,"data_stored":8386781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5680,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006313"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372531+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372531+0000","last_peered":"2024-07-26T08:29:36.372531+0000","last_clean":"2024-07-26T08:29:36.372531+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372531+0000","last_undegraded":"2024-07-26T08:29:36.372531+0000","last_fullsized":"2024-07-26T08:29:36.372531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705761+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:30:34.705761+0000","last_peered":"2024-07-26T08:30:34.705761+0000","last_clean":"2024-07-26T08:30:34.705761+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:30:34.705761+0000","last_undegraded":"2024-07-26T08:30:34.705761+0000","last_fullsized":"2024-07-26T08:30:34.705761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.478470+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:30:12.478470+0000","last_peered":"2024-07-26T08:30:12.478470+0000","last_clean":"2024-07-26T08:30:12.478470+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:30:12.478470+0000","last_undegraded":"2024-07-26T08:30:12.478470+0000","last_fullsized":"2024-07-26T08:30:12.478470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954303+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954303+0000","last_peered":"2024-07-26T08:29:36.954303+0000","last_clean":"2024-07-26T08:29:36.954303+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954303+0000","last_undegraded":"2024-07-26T08:29:36.954303+0000","last_fullsized":"2024-07-26T08:29:36.954303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703445+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:30:34.703445+0000","last_peered":"2024-07-26T08:30:34.703445+0000","last_clean":"2024-07-26T08:30:34.703445+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:30:34.703445+0000","last_undegraded":"2024-07-26T08:30:34.703445+0000","last_fullsized":"2024-07-26T08:30:34.703445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:14.452705+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:30:14.452705+0000","last_peered":"2024-07-26T08:30:14.452705+0000","last_clean":"2024-07-26T08:30:14.452705+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:30:14.452705+0000","last_undegraded":"2024-07-26T08:30:14.452705+0000","last_fullsized":"2024-07-26T08:30:14.452705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:58.347717+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:58.347717+0000","last_peered":"2024-07-26T08:29:58.347717+0000","last_clean":"2024-07-26T08:29:58.347717+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:58.347717+0000","last_undegraded":"2024-07-26T08:29:58.347717+0000","last_fullsized":"2024-07-26T08:29:58.347717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703627+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:30:34.703627+0000","last_peered":"2024-07-26T08:30:34.703627+0000","last_clean":"2024-07-26T08:30:34.703627+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:30:34.703627+0000","last_undegraded":"2024-07-26T08:30:34.703627+0000","last_fullsized":"2024-07-26T08:30:34.703627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:19.453302+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:30:19.453302+0000","last_peered":"2024-07-26T08:30:19.453302+0000","last_clean":"2024-07-26T08:30:19.453302+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:30:19.453302+0000","last_undegraded":"2024-07-26T08:30:19.453302+0000","last_fullsized":"2024-07-26T08:30:19.453302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:58.347685+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:58.347685+0000","last_peered":"2024-07-26T08:29:58.347685+0000","last_clean":"2024-07-26T08:29:58.347685+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:58.347685+0000","last_undegraded":"2024-07-26T08:29:58.347685+0000","last_fullsized":"2024-07-26T08:29:58.347685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.676344+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:30:34.676344+0000","last_peered":"2024-07-26T08:30:34.676344+0000","last_clean":"2024-07-26T08:30:34.676344+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:30:34.676344+0000","last_undegraded":"2024-07-26T08:30:34.676344+0000","last_fullsized":"2024-07-26T08:30:34.676344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:19.453274+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:30:19.453274+0000","last_peered":"2024-07-26T08:30:19.453274+0000","last_clean":"2024-07-26T08:30:19.453274+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:30:19.453274+0000","last_undegraded":"2024-07-26T08:30:19.453274+0000","last_fullsized":"2024-07-26T08:30:19.453274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708624+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:30:34.708624+0000","last_peered":"2024-07-26T08:30:34.708624+0000","last_clean":"2024-07-26T08:30:34.708624+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:30:34.708624+0000","last_undegraded":"2024-07-26T08:30:34.708624+0000","last_fullsized":"2024-07-26T08:30:34.708624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:43.345747+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:43.345747+0000","last_peered":"2024-07-26T08:29:43.345747+0000","last_clean":"2024-07-26T08:29:43.345747+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:43.345747+0000","last_undegraded":"2024-07-26T08:29:43.345747+0000","last_fullsized":"2024-07-26T08:29:43.345747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451339+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:30:04.451339+0000","last_peered":"2024-07-26T08:30:04.451339+0000","last_clean":"2024-07-26T08:30:04.451339+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:30:04.451339+0000","last_undegraded":"2024-07-26T08:30:04.451339+0000","last_fullsized":"2024-07-26T08:30:04.451339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711771+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:30:34.711771+0000","last_peered":"2024-07-26T08:30:34.711771+0000","last_clean":"2024-07-26T08:30:34.711771+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:30:34.711771+0000","last_undegraded":"2024-07-26T08:30:34.711771+0000","last_fullsized":"2024-07-26T08:30:34.711771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.474960+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:42.474960+0000","last_peered":"2024-07-26T08:29:42.474960+0000","last_clean":"2024-07-26T08:29:42.474960+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:42.474960+0000","last_undegraded":"2024-07-26T08:29:42.474960+0000","last_fullsized":"2024-07-26T08:29:42.474960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451300+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:30:04.451300+0000","last_peered":"2024-07-26T08:30:04.451300+0000","last_clean":"2024-07-26T08:30:04.451300+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:30:04.451300+0000","last_undegraded":"2024-07-26T08:30:04.451300+0000","last_fullsized":"2024-07-26T08:30:04.451300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.693989+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:30:34.693989+0000","last_peered":"2024-07-26T08:30:34.693989+0000","last_clean":"2024-07-26T08:30:34.693989+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:30:34.693989+0000","last_undegraded":"2024-07-26T08:30:34.693989+0000","last_fullsized":"2024-07-26T08:30:34.693989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.193270+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:42.193270+0000","last_peered":"2024-07-26T08:29:42.193270+0000","last_clean":"2024-07-26T08:29:42.193270+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:42.193270+0000","last_undegraded":"2024-07-26T08:29:42.193270+0000","last_fullsized":"2024-07-26T08:29:42.193270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:03.939556+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:30:03.939556+0000","last_peered":"2024-07-26T08:30:03.939556+0000","last_clean":"2024-07-26T08:30:03.939556+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:30:03.939556+0000","last_undegraded":"2024-07-26T08:30:03.939556+0000","last_fullsized":"2024-07-26T08:30:03.939556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.664801+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:30:34.664801+0000","last_peered":"2024-07-26T08:30:34.664801+0000","last_clean":"2024-07-26T08:30:34.664801+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:30:34.664801+0000","last_undegraded":"2024-07-26T08:30:34.664801+0000","last_fullsized":"2024-07-26T08:30:34.664801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:40.055440+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:40.055440+0000","last_peered":"2024-07-26T08:29:40.055440+0000","last_clean":"2024-07-26T08:29:40.055440+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:40.055440+0000","last_undegraded":"2024-07-26T08:29:40.055440+0000","last_fullsized":"2024-07-26T08:29:40.055440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451352+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:30:04.451352+0000","last_peered":"2024-07-26T08:30:04.451352+0000","last_clean":"2024-07-26T08:30:04.451352+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:30:04.451352+0000","last_undegraded":"2024-07-26T08:30:04.451352+0000","last_fullsized":"2024-07-26T08:30:04.451352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.710072+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:30:34.710072+0000","last_peered":"2024-07-26T08:30:34.710072+0000","last_clean":"2024-07-26T08:30:34.710072+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:30:34.710072+0000","last_undegraded":"2024-07-26T08:30:34.710072+0000","last_fullsized":"2024-07-26T08:30:34.710072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:39.447878+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:39.447878+0000","last_peered":"2024-07-26T08:29:39.447878+0000","last_clean":"2024-07-26T08:29:39.447878+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:39.447878+0000","last_undegraded":"2024-07-26T08:29:39.447878+0000","last_fullsized":"2024-07-26T08:29:39.447878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.476303+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:52.476303+0000","last_peered":"2024-07-26T08:29:52.476303+0000","last_clean":"2024-07-26T08:29:52.476303+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:52.476303+0000","last_undegraded":"2024-07-26T08:29:52.476303+0000","last_fullsized":"2024-07-26T08:29:52.476303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.704571+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:30:34.704571+0000","last_peered":"2024-07-26T08:30:34.704571+0000","last_clean":"2024-07-26T08:30:34.704571+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:30:34.704571+0000","last_undegraded":"2024-07-26T08:30:34.704571+0000","last_fullsized":"2024-07-26T08:30:34.704571+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'14","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:48.958299+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:31:48.958299+0000","last_peered":"2024-07-26T08:31:48.958299+0000","last_clean":"2024-07-26T08:31:48.958299+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:31:48.958299+0000","last_undegraded":"2024-07-26T08:31:48.958299+0000","last_fullsized":"2024-07-26T08:31:48.958299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.194671+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:52.194671+0000","last_peered":"2024-07-26T08:29:52.194671+0000","last_clean":"2024-07-26T08:29:52.194671+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:52.194671+0000","last_undegraded":"2024-07-26T08:29:52.194671+0000","last_fullsized":"2024-07-26T08:29:52.194671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708597+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:30:34.708597+0000","last_peered":"2024-07-26T08:30:34.708597+0000","last_clean":"2024-07-26T08:30:34.708597+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:30:34.708597+0000","last_undegraded":"2024-07-26T08:30:34.708597+0000","last_fullsized":"2024-07-26T08:30:34.708597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916248+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916248+0000","last_peered":"2024-07-26T08:29:36.916248+0000","last_clean":"2024-07-26T08:29:36.916248+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916248+0000","last_undegraded":"2024-07-26T08:29:36.916248+0000","last_fullsized":"2024-07-26T08:29:36.916248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:56.050676+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:56.050676+0000","last_peered":"2024-07-26T08:29:56.050676+0000","last_clean":"2024-07-26T08:29:56.050676+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:56.050676+0000","last_undegraded":"2024-07-26T08:29:56.050676+0000","last_fullsized":"2024-07-26T08:29:56.050676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687723+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:30:34.687723+0000","last_peered":"2024-07-26T08:30:34.687723+0000","last_clean":"2024-07-26T08:30:34.687723+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:30:34.687723+0000","last_undegraded":"2024-07-26T08:30:34.687723+0000","last_fullsized":"2024-07-26T08:30:34.687723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370716+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370716+0000","last_peered":"2024-07-26T08:29:36.370716+0000","last_clean":"2024-07-26T08:29:36.370716+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370716+0000","last_undegraded":"2024-07-26T08:29:36.370716+0000","last_fullsized":"2024-07-26T08:29:36.370716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:53.347098+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:53.347098+0000","last_peered":"2024-07-26T08:29:53.347098+0000","last_clean":"2024-07-26T08:29:53.347098+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:53.347098+0000","last_undegraded":"2024-07-26T08:29:53.347098+0000","last_fullsized":"2024-07-26T08:29:53.347098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694251+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:30:34.694251+0000","last_peered":"2024-07-26T08:30:34.694251+0000","last_clean":"2024-07-26T08:30:34.694251+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:30:34.694251+0000","last_undegraded":"2024-07-26T08:30:34.694251+0000","last_fullsized":"2024-07-26T08:30:34.694251+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.697898+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:37.697898+0000","last_peered":"2024-07-26T08:29:37.697898+0000","last_clean":"2024-07-26T08:29:37.697898+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:37.697898+0000","last_undegraded":"2024-07-26T08:29:37.697898+0000","last_fullsized":"2024-07-26T08:29:37.697898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.435078+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:52.435078+0000","last_peered":"2024-07-26T08:29:52.435078+0000","last_clean":"2024-07-26T08:29:52.435078+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:52.435078+0000","last_undegraded":"2024-07-26T08:29:52.435078+0000","last_fullsized":"2024-07-26T08:29:52.435078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703085+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:30:34.703085+0000","last_peered":"2024-07-26T08:30:34.703085+0000","last_clean":"2024-07-26T08:30:34.703085+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:30:34.703085+0000","last_undegraded":"2024-07-26T08:30:34.703085+0000","last_fullsized":"2024-07-26T08:30:34.703085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:06.175112+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:33:06.175112+0000","last_peered":"2024-07-26T08:33:06.175112+0000","last_clean":"2024-07-26T08:33:06.175112+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:33:06.175112+0000","last_undegraded":"2024-07-26T08:33:06.175112+0000","last_fullsized":"2024-07-26T08:33:06.175112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":243,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.436230+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:57.436230+0000","last_peered":"2024-07-26T08:29:57.436230+0000","last_clean":"2024-07-26T08:29:57.436230+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:57.436230+0000","last_undegraded":"2024-07-26T08:29:57.436230+0000","last_fullsized":"2024-07-26T08:29:57.436230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.710492+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:30:34.710492+0000","last_peered":"2024-07-26T08:30:34.710492+0000","last_clean":"2024-07-26T08:30:34.710492+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:30:34.710492+0000","last_undegraded":"2024-07-26T08:30:34.710492+0000","last_fullsized":"2024-07-26T08:30:34.710492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362509+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362509+0000","last_peered":"2024-07-26T08:29:36.362509+0000","last_clean":"2024-07-26T08:29:36.362509+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362509+0000","last_undegraded":"2024-07-26T08:29:36.362509+0000","last_fullsized":"2024-07-26T08:29:36.362509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312159+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:30:02.312159+0000","last_peered":"2024-07-26T08:30:02.312159+0000","last_clean":"2024-07-26T08:30:02.312159+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:30:02.312159+0000","last_undegraded":"2024-07-26T08:30:02.312159+0000","last_fullsized":"2024-07-26T08:30:02.312159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707121+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:30:34.707121+0000","last_peered":"2024-07-26T08:30:34.707121+0000","last_clean":"2024-07-26T08:30:34.707121+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:30:34.707121+0000","last_undegraded":"2024-07-26T08:30:34.707121+0000","last_fullsized":"2024-07-26T08:30:34.707121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684102+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.684102+0000","last_peered":"2024-07-26T08:29:36.684102+0000","last_clean":"2024-07-26T08:29:36.684102+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.684102+0000","last_undegraded":"2024-07-26T08:29:36.684102+0000","last_fullsized":"2024-07-26T08:29:36.684102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:32.704792+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:30:32.704792+0000","last_peered":"2024-07-26T08:30:32.704792+0000","last_clean":"2024-07-26T08:30:32.704792+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:30:32.704792+0000","last_undegraded":"2024-07-26T08:30:32.704792+0000","last_fullsized":"2024-07-26T08:30:32.704792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.699740+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:52.699740+0000","last_peered":"2024-07-26T08:29:52.699740+0000","last_clean":"2024-07-26T08:29:52.699740+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:52.699740+0000","last_undegraded":"2024-07-26T08:29:52.699740+0000","last_fullsized":"2024-07-26T08:29:52.699740+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685722+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:30:34.685722+0000","last_peered":"2024-07-26T08:30:34.685722+0000","last_clean":"2024-07-26T08:30:34.685722+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:30:34.685722+0000","last_undegraded":"2024-07-26T08:30:34.685722+0000","last_fullsized":"2024-07-26T08:30:34.685722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.475514+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:47.475514+0000","last_peered":"2024-07-26T08:29:47.475514+0000","last_clean":"2024-07-26T08:29:47.475514+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:47.475514+0000","last_undegraded":"2024-07-26T08:29:47.475514+0000","last_fullsized":"2024-07-26T08:29:47.475514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:00.057697+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:30:00.057697+0000","last_peered":"2024-07-26T08:30:00.057697+0000","last_clean":"2024-07-26T08:30:00.057697+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:30:00.057697+0000","last_undegraded":"2024-07-26T08:30:00.057697+0000","last_fullsized":"2024-07-26T08:30:00.057697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708021+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:30:34.708021+0000","last_peered":"2024-07-26T08:30:34.708021+0000","last_clean":"2024-07-26T08:30:34.708021+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:30:34.708021+0000","last_undegraded":"2024-07-26T08:30:34.708021+0000","last_fullsized":"2024-07-26T08:30:34.708021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.310284+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:47.310284+0000","last_peered":"2024-07-26T08:29:47.310284+0000","last_clean":"2024-07-26T08:29:47.310284+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:47.310284+0000","last_undegraded":"2024-07-26T08:29:47.310284+0000","last_fullsized":"2024-07-26T08:29:47.310284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:05.322023+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:30:05.322023+0000","last_peered":"2024-07-26T08:30:05.322023+0000","last_clean":"2024-07-26T08:30:05.322023+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:30:05.322023+0000","last_undegraded":"2024-07-26T08:30:05.322023+0000","last_fullsized":"2024-07-26T08:30:05.322023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.680032+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:30:34.680032+0000","last_peered":"2024-07-26T08:30:34.680032+0000","last_clean":"2024-07-26T08:30:34.680032+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:30:34.680032+0000","last_undegraded":"2024-07-26T08:30:34.680032+0000","last_fullsized":"2024-07-26T08:30:34.680032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.427620+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:47.427620+0000","last_peered":"2024-07-26T08:29:47.427620+0000","last_clean":"2024-07-26T08:29:47.427620+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:47.427620+0000","last_undegraded":"2024-07-26T08:29:47.427620+0000","last_fullsized":"2024-07-26T08:29:47.427620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312070+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:30:02.312070+0000","last_peered":"2024-07-26T08:30:02.312070+0000","last_clean":"2024-07-26T08:30:02.312070+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:30:02.312070+0000","last_undegraded":"2024-07-26T08:30:02.312070+0000","last_fullsized":"2024-07-26T08:30:02.312070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673736+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:30:34.673736+0000","last_peered":"2024-07-26T08:30:34.673736+0000","last_clean":"2024-07-26T08:30:34.673736+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:30:34.673736+0000","last_undegraded":"2024-07-26T08:30:34.673736+0000","last_fullsized":"2024-07-26T08:30:34.673736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:43.345781+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:43.345781+0000","last_peered":"2024-07-26T08:29:43.345781+0000","last_clean":"2024-07-26T08:29:43.345781+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:43.345781+0000","last_undegraded":"2024-07-26T08:29:43.345781+0000","last_fullsized":"2024-07-26T08:29:43.345781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312108+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:30:02.312108+0000","last_peered":"2024-07-26T08:30:02.312108+0000","last_clean":"2024-07-26T08:30:02.312108+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:30:02.312108+0000","last_undegraded":"2024-07-26T08:30:02.312108+0000","last_fullsized":"2024-07-26T08:30:02.312108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675937+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:30:34.675937+0000","last_peered":"2024-07-26T08:30:34.675937+0000","last_clean":"2024-07-26T08:30:34.675937+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:30:34.675937+0000","last_undegraded":"2024-07-26T08:30:34.675937+0000","last_fullsized":"2024-07-26T08:30:34.675937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:48.346463+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:48.346463+0000","last_peered":"2024-07-26T08:29:48.346463+0000","last_clean":"2024-07-26T08:29:48.346463+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:48.346463+0000","last_undegraded":"2024-07-26T08:29:48.346463+0000","last_fullsized":"2024-07-26T08:29:48.346463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.438875+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:30:12.438875+0000","last_peered":"2024-07-26T08:30:12.438875+0000","last_clean":"2024-07-26T08:30:12.438875+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:30:12.438875+0000","last_undegraded":"2024-07-26T08:30:12.438875+0000","last_fullsized":"2024-07-26T08:30:12.438875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.682145+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:30:34.682145+0000","last_peered":"2024-07-26T08:30:34.682145+0000","last_clean":"2024-07-26T08:30:34.682145+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:30:34.682145+0000","last_undegraded":"2024-07-26T08:30:34.682145+0000","last_fullsized":"2024-07-26T08:30:34.682145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":292,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:03.169067+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:33:03.169067+0000","last_peered":"2024-07-26T08:33:03.169067+0000","last_clean":"2024-07-26T08:33:03.169067+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:33:03.169067+0000","last_undegraded":"2024-07-26T08:33:03.169067+0000","last_fullsized":"2024-07-26T08:33:03.169067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:13.941433+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:30:13.941433+0000","last_peered":"2024-07-26T08:30:13.941433+0000","last_clean":"2024-07-26T08:30:13.941433+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:30:13.941433+0000","last_undegraded":"2024-07-26T08:30:13.941433+0000","last_fullsized":"2024-07-26T08:30:13.941433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713432+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:30:34.713432+0000","last_peered":"2024-07-26T08:30:34.713432+0000","last_clean":"2024-07-26T08:30:34.713432+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:30:34.713432+0000","last_undegraded":"2024-07-26T08:30:34.713432+0000","last_fullsized":"2024-07-26T08:30:34.713432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.310789+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:52.310789+0000","last_peered":"2024-07-26T08:29:52.310789+0000","last_clean":"2024-07-26T08:29:52.310789+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:52.310789+0000","last_undegraded":"2024-07-26T08:29:52.310789+0000","last_fullsized":"2024-07-26T08:29:52.310789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:11.052776+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:30:11.052776+0000","last_peered":"2024-07-26T08:30:11.052776+0000","last_clean":"2024-07-26T08:30:11.052776+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:30:11.052776+0000","last_undegraded":"2024-07-26T08:30:11.052776+0000","last_fullsized":"2024-07-26T08:30:11.052776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.712667+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:30:34.712667+0000","last_peered":"2024-07-26T08:30:34.712667+0000","last_clean":"2024-07-26T08:30:34.712667+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:30:34.712667+0000","last_undegraded":"2024-07-26T08:30:34.712667+0000","last_fullsized":"2024-07-26T08:30:34.712667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.476333+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:52.476333+0000","last_peered":"2024-07-26T08:29:52.476333+0000","last_clean":"2024-07-26T08:29:52.476333+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:52.476333+0000","last_undegraded":"2024-07-26T08:29:52.476333+0000","last_fullsized":"2024-07-26T08:29:52.476333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.314280+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:30:17.314280+0000","last_peered":"2024-07-26T08:30:17.314280+0000","last_clean":"2024-07-26T08:30:17.314280+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:30:17.314280+0000","last_undegraded":"2024-07-26T08:30:17.314280+0000","last_fullsized":"2024-07-26T08:30:17.314280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670994+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:30:34.670994+0000","last_peered":"2024-07-26T08:30:34.670994+0000","last_clean":"2024-07-26T08:30:34.670994+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:30:34.670994+0000","last_undegraded":"2024-07-26T08:30:34.670994+0000","last_fullsized":"2024-07-26T08:30:34.670994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":580,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:05.042528+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:33:05.042528+0000","last_peered":"2024-07-26T08:33:05.042528+0000","last_clean":"2024-07-26T08:33:05.042528+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:33:05.042528+0000","last_undegraded":"2024-07-26T08:33:05.042528+0000","last_fullsized":"2024-07-26T08:33:05.042528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":314,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:08.940321+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:30:08.940321+0000","last_peered":"2024-07-26T08:30:08.940321+0000","last_clean":"2024-07-26T08:30:08.940321+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:30:08.940321+0000","last_undegraded":"2024-07-26T08:30:08.940321+0000","last_fullsized":"2024-07-26T08:30:08.940321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685649+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:30:34.685649+0000","last_peered":"2024-07-26T08:30:34.685649+0000","last_clean":"2024-07-26T08:30:34.685649+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:30:34.685649+0000","last_undegraded":"2024-07-26T08:30:34.685649+0000","last_fullsized":"2024-07-26T08:30:34.685649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.311525+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:57.311525+0000","last_peered":"2024-07-26T08:29:57.311525+0000","last_clean":"2024-07-26T08:29:57.311525+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:57.311525+0000","last_undegraded":"2024-07-26T08:29:57.311525+0000","last_fullsized":"2024-07-26T08:29:57.311525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:09.452130+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:30:09.452130+0000","last_peered":"2024-07-26T08:30:09.452130+0000","last_clean":"2024-07-26T08:30:09.452130+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:30:09.452130+0000","last_undegraded":"2024-07-26T08:30:09.452130+0000","last_fullsized":"2024-07-26T08:30:09.452130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697862+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:30:34.697862+0000","last_peered":"2024-07-26T08:30:34.697862+0000","last_clean":"2024-07-26T08:30:34.697862+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:30:34.697862+0000","last_undegraded":"2024-07-26T08:30:34.697862+0000","last_fullsized":"2024-07-26T08:30:34.697862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.700486+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:57.700486+0000","last_peered":"2024-07-26T08:29:57.700486+0000","last_clean":"2024-07-26T08:29:57.700486+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:57.700486+0000","last_undegraded":"2024-07-26T08:29:57.700486+0000","last_fullsized":"2024-07-26T08:29:57.700486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:08.940267+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:30:08.940267+0000","last_peered":"2024-07-26T08:30:08.940267+0000","last_clean":"2024-07-26T08:30:08.940267+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:30:08.940267+0000","last_undegraded":"2024-07-26T08:30:08.940267+0000","last_fullsized":"2024-07-26T08:30:08.940267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687862+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:30:34.687862+0000","last_peered":"2024-07-26T08:30:34.687862+0000","last_clean":"2024-07-26T08:30:34.687862+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:30:34.687862+0000","last_undegraded":"2024-07-26T08:30:34.687862+0000","last_fullsized":"2024-07-26T08:30:34.687862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:04.171114+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:33:04.171114+0000","last_peered":"2024-07-26T08:33:04.171114+0000","last_clean":"2024-07-26T08:33:04.171114+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:33:04.171114+0000","last_undegraded":"2024-07-26T08:33:04.171114+0000","last_fullsized":"2024-07-26T08:33:04.171114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.198247+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:30:12.198247+0000","last_peered":"2024-07-26T08:30:12.198247+0000","last_clean":"2024-07-26T08:30:12.198247+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:30:12.198247+0000","last_undegraded":"2024-07-26T08:30:12.198247+0000","last_fullsized":"2024-07-26T08:30:12.198247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:50.319075+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:50.319075+0000","last_peered":"2024-07-26T08:29:50.319075+0000","last_clean":"2024-07-26T08:29:50.319075+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:50.319075+0000","last_undegraded":"2024-07-26T08:29:50.319075+0000","last_fullsized":"2024-07-26T08:29:50.319075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709671+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:30:34.709671+0000","last_peered":"2024-07-26T08:30:34.709671+0000","last_clean":"2024-07-26T08:30:34.709671+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:30:34.709671+0000","last_undegraded":"2024-07-26T08:30:34.709671+0000","last_fullsized":"2024-07-26T08:30:34.709671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.311463+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:57.311463+0000","last_peered":"2024-07-26T08:29:57.311463+0000","last_clean":"2024-07-26T08:29:57.311463+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:57.311463+0000","last_undegraded":"2024-07-26T08:29:57.311463+0000","last_fullsized":"2024-07-26T08:29:57.311463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:56.050710+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:56.050710+0000","last_peered":"2024-07-26T08:29:56.050710+0000","last_clean":"2024-07-26T08:29:56.050710+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:56.050710+0000","last_undegraded":"2024-07-26T08:29:56.050710+0000","last_fullsized":"2024-07-26T08:29:56.050710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713505+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:30:34.713505+0000","last_peered":"2024-07-26T08:30:34.713505+0000","last_clean":"2024-07-26T08:30:34.713505+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:30:34.713505+0000","last_undegraded":"2024-07-26T08:30:34.713505+0000","last_fullsized":"2024-07-26T08:30:34.713505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.435973+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:57.435973+0000","last_peered":"2024-07-26T08:29:57.435973+0000","last_clean":"2024-07-26T08:29:57.435973+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:57.435973+0000","last_undegraded":"2024-07-26T08:29:57.435973+0000","last_fullsized":"2024-07-26T08:29:57.435973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:00.397718+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:30:00.397718+0000","last_peered":"2024-07-26T08:30:00.397718+0000","last_clean":"2024-07-26T08:30:00.397718+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:30:00.397718+0000","last_undegraded":"2024-07-26T08:30:00.397718+0000","last_fullsized":"2024-07-26T08:30:00.397718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703945+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:30:34.703945+0000","last_peered":"2024-07-26T08:30:34.703945+0000","last_clean":"2024-07-26T08:30:34.703945+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:30:34.703945+0000","last_undegraded":"2024-07-26T08:30:34.703945+0000","last_fullsized":"2024-07-26T08:30:34.703945+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.479043+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:30:17.479043+0000","last_peered":"2024-07-26T08:30:17.479043+0000","last_clean":"2024-07-26T08:30:17.479043+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:30:17.479043+0000","last_undegraded":"2024-07-26T08:30:17.479043+0000","last_fullsized":"2024-07-26T08:30:17.479043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:06.176201+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:33:06.176201+0000","last_peered":"2024-07-26T08:33:06.176201+0000","last_clean":"2024-07-26T08:33:06.176201+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:33:06.176201+0000","last_undegraded":"2024-07-26T08:33:06.176201+0000","last_fullsized":"2024-07-26T08:33:06.176201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675755+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:30:34.675755+0000","last_peered":"2024-07-26T08:30:34.675755+0000","last_clean":"2024-07-26T08:30:34.675755+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:30:34.675755+0000","last_undegraded":"2024-07-26T08:30:34.675755+0000","last_fullsized":"2024-07-26T08:30:34.675755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.479066+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:30:17.479066+0000","last_peered":"2024-07-26T08:30:17.479066+0000","last_clean":"2024-07-26T08:30:17.479066+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:30:17.479066+0000","last_undegraded":"2024-07-26T08:30:17.479066+0000","last_fullsized":"2024-07-26T08:30:17.479066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671670+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:30:34.671670+0000","last_peered":"2024-07-26T08:30:34.671670+0000","last_clean":"2024-07-26T08:30:34.671670+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:30:34.671670+0000","last_undegraded":"2024-07-26T08:30:34.671670+0000","last_fullsized":"2024-07-26T08:30:34.671670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674878+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:30:34.674878+0000","last_peered":"2024-07-26T08:30:34.674878+0000","last_clean":"2024-07-26T08:30:34.674878+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:30:34.674878+0000","last_undegraded":"2024-07-26T08:30:34.674878+0000","last_fullsized":"2024-07-26T08:30:34.674878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700140+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:30:34.700140+0000","last_peered":"2024-07-26T08:30:34.700140+0000","last_clean":"2024-07-26T08:30:34.700140+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:30:34.700140+0000","last_undegraded":"2024-07-26T08:30:34.700140+0000","last_fullsized":"2024-07-26T08:30:34.700140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713954+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:30:34.713954+0000","last_peered":"2024-07-26T08:30:34.713954+0000","last_clean":"2024-07-26T08:30:34.713954+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:30:34.713954+0000","last_undegraded":"2024-07-26T08:30:34.713954+0000","last_fullsized":"2024-07-26T08:30:34.713954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711478+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:30:34.711478+0000","last_peered":"2024-07-26T08:30:34.711478+0000","last_clean":"2024-07-26T08:30:34.711478+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:30:34.711478+0000","last_undegraded":"2024-07-26T08:30:34.711478+0000","last_fullsized":"2024-07-26T08:30:34.711478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673719+0000","last_change":"2024-07-26T08:29:36.916212+0000","last_active":"2024-07-26T08:30:34.673719+0000","last_peered":"2024-07-26T08:30:34.673719+0000","last_clean":"2024-07-26T08:30:34.673719+0000","last_became_active":"2024-07-26T08:29:36.915665+0000","last_became_peered":"2024-07-26T08:29:36.915665+0000","last_unstale":"2024-07-26T08:30:34.673719+0000","last_undegraded":"2024-07-26T08:30:34.673719+0000","last_fullsized":"2024-07-26T08:30:34.673719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:54:03.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673854+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:30:34.673854+0000","last_peered":"2024-07-26T08:30:34.673854+0000","last_clean":"2024-07-26T08:30:34.673854+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:30:34.673854+0000","last_undegraded":"2024-07-26T08:30:34.673854+0000","last_fullsized":"2024-07-26T08:30:34.673854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671940+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:30:34.671940+0000","last_peered":"2024-07-26T08:30:34.671940+0000","last_clean":"2024-07-26T08:30:34.671940+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:30:34.671940+0000","last_undegraded":"2024-07-26T08:30:34.671940+0000","last_fullsized":"2024-07-26T08:30:34.671940+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708002+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:30:34.708002+0000","last_peered":"2024-07-26T08:30:34.708002+0000","last_clean":"2024-07-26T08:30:34.708002+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:30:34.708002+0000","last_undegraded":"2024-07-26T08:30:34.708002+0000","last_fullsized":"2024-07-26T08:30:34.708002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705173+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:30:34.705173+0000","last_peered":"2024-07-26T08:30:34.705173+0000","last_clean":"2024-07-26T08:30:34.705173+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:30:34.705173+0000","last_undegraded":"2024-07-26T08:30:34.705173+0000","last_fullsized":"2024-07-26T08:30:34.705173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706758+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:30:34.706758+0000","last_peered":"2024-07-26T08:30:34.706758+0000","last_clean":"2024-07-26T08:30:34.706758+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:30:34.706758+0000","last_undegraded":"2024-07-26T08:30:34.706758+0000","last_fullsized":"2024-07-26T08:30:34.706758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.714091+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:30:34.714091+0000","last_peered":"2024-07-26T08:30:34.714091+0000","last_clean":"2024-07-26T08:30:34.714091+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:30:34.714091+0000","last_undegraded":"2024-07-26T08:30:34.714091+0000","last_fullsized":"2024-07-26T08:30:34.714091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674941+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:30:34.674941+0000","last_peered":"2024-07-26T08:30:34.674941+0000","last_clean":"2024-07-26T08:30:34.674941+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:30:34.674941+0000","last_undegraded":"2024-07-26T08:30:34.674941+0000","last_fullsized":"2024-07-26T08:30:34.674941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707129+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:30:34.707129+0000","last_peered":"2024-07-26T08:30:34.707129+0000","last_clean":"2024-07-26T08:30:34.707129+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:30:34.707129+0000","last_undegraded":"2024-07-26T08:30:34.707129+0000","last_fullsized":"2024-07-26T08:30:34.707129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688253+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:30:34.688253+0000","last_peered":"2024-07-26T08:30:34.688253+0000","last_clean":"2024-07-26T08:30:34.688253+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:30:34.688253+0000","last_undegraded":"2024-07-26T08:30:34.688253+0000","last_fullsized":"2024-07-26T08:30:34.688253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702903+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:30:34.702903+0000","last_peered":"2024-07-26T08:30:34.702903+0000","last_clean":"2024-07-26T08:30:34.702903+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:30:34.702903+0000","last_undegraded":"2024-07-26T08:30:34.702903+0000","last_fullsized":"2024-07-26T08:30:34.702903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703845+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:30:34.703845+0000","last_peered":"2024-07-26T08:30:34.703845+0000","last_clean":"2024-07-26T08:30:34.703845+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:30:34.703845+0000","last_undegraded":"2024-07-26T08:30:34.703845+0000","last_fullsized":"2024-07-26T08:30:34.703845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697407+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:30:34.697407+0000","last_peered":"2024-07-26T08:30:34.697407+0000","last_clean":"2024-07-26T08:30:34.697407+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:30:34.697407+0000","last_undegraded":"2024-07-26T08:30:34.697407+0000","last_fullsized":"2024-07-26T08:30:34.697407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702516+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:30:34.702516+0000","last_peered":"2024-07-26T08:30:34.702516+0000","last_clean":"2024-07-26T08:30:34.702516+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:30:34.702516+0000","last_undegraded":"2024-07-26T08:30:34.702516+0000","last_fullsized":"2024-07-26T08:30:34.702516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.714165+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:30:34.714165+0000","last_peered":"2024-07-26T08:30:34.714165+0000","last_clean":"2024-07-26T08:30:34.714165+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:30:34.714165+0000","last_undegraded":"2024-07-26T08:30:34.714165+0000","last_fullsized":"2024-07-26T08:30:34.714165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672641+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:30:34.672641+0000","last_peered":"2024-07-26T08:30:34.672641+0000","last_clean":"2024-07-26T08:30:34.672641+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:30:34.672641+0000","last_undegraded":"2024-07-26T08:30:34.672641+0000","last_fullsized":"2024-07-26T08:30:34.672641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685731+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:30:34.685731+0000","last_peered":"2024-07-26T08:30:34.685731+0000","last_clean":"2024-07-26T08:30:34.685731+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:30:34.685731+0000","last_undegraded":"2024-07-26T08:30:34.685731+0000","last_fullsized":"2024-07-26T08:30:34.685731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671159+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:30:34.671159+0000","last_peered":"2024-07-26T08:30:34.671159+0000","last_clean":"2024-07-26T08:30:34.671159+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:30:34.671159+0000","last_undegraded":"2024-07-26T08:30:34.671159+0000","last_fullsized":"2024-07-26T08:30:34.671159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685314+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:30:34.685314+0000","last_peered":"2024-07-26T08:30:34.685314+0000","last_clean":"2024-07-26T08:30:34.685314+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:30:34.685314+0000","last_undegraded":"2024-07-26T08:30:34.685314+0000","last_fullsized":"2024-07-26T08:30:34.685314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706435+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:30:34.706435+0000","last_peered":"2024-07-26T08:30:34.706435+0000","last_clean":"2024-07-26T08:30:34.706435+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:30:34.706435+0000","last_undegraded":"2024-07-26T08:30:34.706435+0000","last_fullsized":"2024-07-26T08:30:34.706435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688595+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:30:34.688595+0000","last_peered":"2024-07-26T08:30:34.688595+0000","last_clean":"2024-07-26T08:30:34.688595+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:30:34.688595+0000","last_undegraded":"2024-07-26T08:30:34.688595+0000","last_fullsized":"2024-07-26T08:30:34.688595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674363+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:30:34.674363+0000","last_peered":"2024-07-26T08:30:34.674363+0000","last_clean":"2024-07-26T08:30:34.674363+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:30:34.674363+0000","last_undegraded":"2024-07-26T08:30:34.674363+0000","last_fullsized":"2024-07-26T08:30:34.674363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706281+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:30:34.706281+0000","last_peered":"2024-07-26T08:30:34.706281+0000","last_clean":"2024-07-26T08:30:34.706281+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:30:34.706281+0000","last_undegraded":"2024-07-26T08:30:34.706281+0000","last_fullsized":"2024-07-26T08:30:34.706281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.677278+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:30:34.677278+0000","last_peered":"2024-07-26T08:30:34.677278+0000","last_clean":"2024-07-26T08:30:34.677278+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:30:34.677278+0000","last_undegraded":"2024-07-26T08:30:34.677278+0000","last_fullsized":"2024-07-26T08:30:34.677278+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.699740+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:30:34.699740+0000","last_peered":"2024-07-26T08:30:34.699740+0000","last_clean":"2024-07-26T08:30:34.699740+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:30:34.699740+0000","last_undegraded":"2024-07-26T08:30:34.699740+0000","last_fullsized":"2024-07-26T08:30:34.699740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703025+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:30:34.703025+0000","last_peered":"2024-07-26T08:30:34.703025+0000","last_clean":"2024-07-26T08:30:34.703025+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:30:34.703025+0000","last_undegraded":"2024-07-26T08:30:34.703025+0000","last_fullsized":"2024-07-26T08:30:34.703025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702814+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:30:34.702814+0000","last_peered":"2024-07-26T08:30:34.702814+0000","last_clean":"2024-07-26T08:30:34.702814+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:30:34.702814+0000","last_undegraded":"2024-07-26T08:30:34.702814+0000","last_fullsized":"2024-07-26T08:30:34.702814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71611,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1479,"num_read_kb":816,"num_write":178,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678100,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":535351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874328,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1194716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234086,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430315,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593839,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790070,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953596,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149824,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":530957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378760,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":600024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":598674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705809,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:33:09.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-26T08:33:10.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 -- 172.21.15.43:0/2782725656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce0105530 msgr2=0x7f9ce0105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 --2- 172.21.15.43:0/2782725656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce0105530 0x7f9ce0105940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009900 tx=0x7f9cd002a410 comp rx=0 tx=0).stop 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 -- 172.21.15.43:0/2782725656 shutdown_connections 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 --2- 172.21.15.43:0/2782725656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce010b7b0 0x7f9ce0111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 --2- 172.21.15.43:0/2782725656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010ae60 0x7f9ce010b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 --2- 172.21.15.43:0/2782725656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce0105530 0x7f9ce0105940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 -- 172.21.15.43:0/2782725656 >> 172.21.15.43:0/2782725656 conn(0x7f9ce0100f90 msgr2=0x7f9ce01033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 -- 172.21.15.43:0/2782725656 shutdown_connections 2024-07-26T08:33:10.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.047+0000 7f9ce5600640 1 -- 172.21.15.43:0/2782725656 wait complete. 2024-07-26T08:33:10.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.048+0000 7f9ce5600640 1 Processor -- start 2024-07-26T08:33:10.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.048+0000 7f9ce5600640 1 -- start start 2024-07-26T08:33:10.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9ce5600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 0x7f9ce019bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9ce5600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce010ae60 0x7f9ce019c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9ce5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010b7b0 0x7f9ce01a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9ce5600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0115590 con 0x7f9ce010b7b0 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9ce5600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0115410 con 0x7f9ce0105530 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9ce5600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0115710 con 0x7f9ce010ae60 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9cdfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 0x7f9ce019bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9cdfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 0x7f9ce019bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37150/0 (socket says 172.21.15.43:37150) 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9cdfe00640 1 -- 172.21.15.43:0/3207730000 learned_addr learned my addr 172.21.15.43:0/3207730000 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.049+0000 7f9cd7e00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce010ae60 0x7f9ce019c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9ce4c00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010b7b0 0x7f9ce01a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9cdfe00640 1 -- 172.21.15.43:0/3207730000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce010ae60 msgr2=0x7f9ce019c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9cdfe00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce010ae60 0x7f9ce019c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9cdfe00640 1 -- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010b7b0 msgr2=0x7f9ce01a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9cdfe00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010b7b0 0x7f9ce01a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9cdfe00640 1 -- 172.21.15.43:0/3207730000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce01a1e60 con 0x7f9ce0105530 2024-07-26T08:33:10.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9ce4c00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010b7b0 0x7f9ce01a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:33:10.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.050+0000 7f9cdfe00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 0x7f9ce019bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0005ab0 tx=0x7f9cd00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.051+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd003f030 con 0x7f9ce0105530 2024-07-26T08:33:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.051+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9cd0003ac0 con 0x7f9ce0105530 2024-07-26T08:33:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.051+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce01a20f0 con 0x7f9ce0105530 2024-07-26T08:33:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.051+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0035070 con 0x7f9ce0105530 2024-07-26T08:33:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.051+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce01a88e0 con 0x7f9ce0105530 2024-07-26T08:33:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.052+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce0105940 con 0x7f9ce0105530 2024-07-26T08:33:10.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.054+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f9cd0042030 con 0x7f9ce0105530 2024-07-26T08:33:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.057+0000 7f9cdd600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9cc40b3d20 0x7f9cc40b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.057+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f9cd0104b30 con 0x7f9ce0105530 2024-07-26T08:33:10.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.058+0000 7f9cd7e00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9cc40b3d20 0x7f9cc40b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.058+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9cd00cbc60 con 0x7f9ce0105530 2024-07-26T08:33:10.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.059+0000 7f9cd7e00640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9cc40b3d20 0x7f9cc40b6230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ce010a860 tx=0x7f9cc8005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:10.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.272+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ce010d5e0 con 0x7f9cc40b3d20 2024-07-26T08:33:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.289+0000 7f9cdd600640 1 -- 172.21.15.43:0/3207730000 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340498 (secure 0 0 0) 0x7f9ce010d5e0 con 0x7f9cc40b3d20 2024-07-26T08:33:10.295 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:10.297 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:33:10.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9cc40b3d20 msgr2=0x7f9cc40b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9cc40b3d20 0x7f9cc40b6230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ce010a860 tx=0x7f9cc8005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 msgr2=0x7f9ce019bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 0x7f9ce019bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0005ab0 tx=0x7f9cd00040c0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 shutdown_connections 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9cc40b3d20 0x7f9cc40b6230 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ce010ae60 0x7f9ce019c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ce010b7b0 0x7f9ce01a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 --2- 172.21.15.43:0/3207730000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce0105530 0x7f9ce019bf30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 >> 172.21.15.43:0/3207730000 conn(0x7f9ce0100f90 msgr2=0x7f9ce01033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 shutdown_connections 2024-07-26T08:33:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.295+0000 7f9ce5600640 1 -- 172.21.15.43:0/3207730000 wait complete. 2024-07-26T08:33:10.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:10 smithi063 ceph-mon[36747]: pgmap v485: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-07-26T08:33:10.325 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:10 smithi043 ceph-mon[32384]: pgmap v485: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-07-26T08:33:10.329 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":485,"stamp":"2024-07-26T08:33:08.839570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662213,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1560,"num_read_kb":885,"num_write":303,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388412,"kb_used_data":14300,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553412,"statfs":{"total":1151940427776,"available":1151542693888,"internally_reserved":0,"allocated":14643200,"data_stored":8386781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5680,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006313"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372531+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372531+0000","last_peered":"2024-07-26T08:29:36.372531+0000","last_clean":"2024-07-26T08:29:36.372531+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372531+0000","last_undegraded":"2024-07-26T08:29:36.372531+0000","last_fullsized":"2024-07-26T08:29:36.372531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705761+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:30:34.705761+0000","last_peered":"2024-07-26T08:30:34.705761+0000","last_clean":"2024-07-26T08:30:34.705761+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:30:34.705761+0000","last_undegraded":"2024-07-26T08:30:34.705761+0000","last_fullsized":"2024-07-26T08:30:34.705761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.478470+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:30:12.478470+0000","last_peered":"2024-07-26T08:30:12.478470+0000","last_clean":"2024-07-26T08:30:12.478470+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:30:12.478470+0000","last_undegraded":"2024-07-26T08:30:12.478470+0000","last_fullsized":"2024-07-26T08:30:12.478470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954303+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954303+0000","last_peered":"2024-07-26T08:29:36.954303+0000","last_clean":"2024-07-26T08:29:36.954303+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954303+0000","last_undegraded":"2024-07-26T08:29:36.954303+0000","last_fullsized":"2024-07-26T08:29:36.954303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703445+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:30:34.703445+0000","last_peered":"2024-07-26T08:30:34.703445+0000","last_clean":"2024-07-26T08:30:34.703445+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:30:34.703445+0000","last_undegraded":"2024-07-26T08:30:34.703445+0000","last_fullsized":"2024-07-26T08:30:34.703445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:14.452705+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:30:14.452705+0000","last_peered":"2024-07-26T08:30:14.452705+0000","last_clean":"2024-07-26T08:30:14.452705+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:30:14.452705+0000","last_undegraded":"2024-07-26T08:30:14.452705+0000","last_fullsized":"2024-07-26T08:30:14.452705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:58.347717+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:58.347717+0000","last_peered":"2024-07-26T08:29:58.347717+0000","last_clean":"2024-07-26T08:29:58.347717+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:58.347717+0000","last_undegraded":"2024-07-26T08:29:58.347717+0000","last_fullsized":"2024-07-26T08:29:58.347717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703627+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:30:34.703627+0000","last_peered":"2024-07-26T08:30:34.703627+0000","last_clean":"2024-07-26T08:30:34.703627+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:30:34.703627+0000","last_undegraded":"2024-07-26T08:30:34.703627+0000","last_fullsized":"2024-07-26T08:30:34.703627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:19.453302+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:30:19.453302+0000","last_peered":"2024-07-26T08:30:19.453302+0000","last_clean":"2024-07-26T08:30:19.453302+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:30:19.453302+0000","last_undegraded":"2024-07-26T08:30:19.453302+0000","last_fullsized":"2024-07-26T08:30:19.453302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:58.347685+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:58.347685+0000","last_peered":"2024-07-26T08:29:58.347685+0000","last_clean":"2024-07-26T08:29:58.347685+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:58.347685+0000","last_undegraded":"2024-07-26T08:29:58.347685+0000","last_fullsized":"2024-07-26T08:29:58.347685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.676344+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:30:34.676344+0000","last_peered":"2024-07-26T08:30:34.676344+0000","last_clean":"2024-07-26T08:30:34.676344+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:30:34.676344+0000","last_undegraded":"2024-07-26T08:30:34.676344+0000","last_fullsized":"2024-07-26T08:30:34.676344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:19.453274+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:30:19.453274+0000","last_peered":"2024-07-26T08:30:19.453274+0000","last_clean":"2024-07-26T08:30:19.453274+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:30:19.453274+0000","last_undegraded":"2024-07-26T08:30:19.453274+0000","last_fullsized":"2024-07-26T08:30:19.453274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708624+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:30:34.708624+0000","last_peered":"2024-07-26T08:30:34.708624+0000","last_clean":"2024-07-26T08:30:34.708624+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:30:34.708624+0000","last_undegraded":"2024-07-26T08:30:34.708624+0000","last_fullsized":"2024-07-26T08:30:34.708624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:43.345747+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:43.345747+0000","last_peered":"2024-07-26T08:29:43.345747+0000","last_clean":"2024-07-26T08:29:43.345747+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:43.345747+0000","last_undegraded":"2024-07-26T08:29:43.345747+0000","last_fullsized":"2024-07-26T08:29:43.345747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451339+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:30:04.451339+0000","last_peered":"2024-07-26T08:30:04.451339+0000","last_clean":"2024-07-26T08:30:04.451339+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:30:04.451339+0000","last_undegraded":"2024-07-26T08:30:04.451339+0000","last_fullsized":"2024-07-26T08:30:04.451339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711771+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:30:34.711771+0000","last_peered":"2024-07-26T08:30:34.711771+0000","last_clean":"2024-07-26T08:30:34.711771+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:30:34.711771+0000","last_undegraded":"2024-07-26T08:30:34.711771+0000","last_fullsized":"2024-07-26T08:30:34.711771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.474960+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:42.474960+0000","last_peered":"2024-07-26T08:29:42.474960+0000","last_clean":"2024-07-26T08:29:42.474960+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:42.474960+0000","last_undegraded":"2024-07-26T08:29:42.474960+0000","last_fullsized":"2024-07-26T08:29:42.474960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451300+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:30:04.451300+0000","last_peered":"2024-07-26T08:30:04.451300+0000","last_clean":"2024-07-26T08:30:04.451300+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:30:04.451300+0000","last_undegraded":"2024-07-26T08:30:04.451300+0000","last_fullsized":"2024-07-26T08:30:04.451300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.693989+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:30:34.693989+0000","last_peered":"2024-07-26T08:30:34.693989+0000","last_clean":"2024-07-26T08:30:34.693989+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:30:34.693989+0000","last_undegraded":"2024-07-26T08:30:34.693989+0000","last_fullsized":"2024-07-26T08:30:34.693989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.193270+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:42.193270+0000","last_peered":"2024-07-26T08:29:42.193270+0000","last_clean":"2024-07-26T08:29:42.193270+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:42.193270+0000","last_undegraded":"2024-07-26T08:29:42.193270+0000","last_fullsized":"2024-07-26T08:29:42.193270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:03.939556+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:30:03.939556+0000","last_peered":"2024-07-26T08:30:03.939556+0000","last_clean":"2024-07-26T08:30:03.939556+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:30:03.939556+0000","last_undegraded":"2024-07-26T08:30:03.939556+0000","last_fullsized":"2024-07-26T08:30:03.939556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.664801+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:30:34.664801+0000","last_peered":"2024-07-26T08:30:34.664801+0000","last_clean":"2024-07-26T08:30:34.664801+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:30:34.664801+0000","last_undegraded":"2024-07-26T08:30:34.664801+0000","last_fullsized":"2024-07-26T08:30:34.664801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:40.055440+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:40.055440+0000","last_peered":"2024-07-26T08:29:40.055440+0000","last_clean":"2024-07-26T08:29:40.055440+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:40.055440+0000","last_undegraded":"2024-07-26T08:29:40.055440+0000","last_fullsized":"2024-07-26T08:29:40.055440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451352+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:30:04.451352+0000","last_peered":"2024-07-26T08:30:04.451352+0000","last_clean":"2024-07-26T08:30:04.451352+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:30:04.451352+0000","last_undegraded":"2024-07-26T08:30:04.451352+0000","last_fullsized":"2024-07-26T08:30:04.451352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.710072+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:30:34.710072+0000","last_peered":"2024-07-26T08:30:34.710072+0000","last_clean":"2024-07-26T08:30:34.710072+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:30:34.710072+0000","last_undegraded":"2024-07-26T08:30:34.710072+0000","last_fullsized":"2024-07-26T08:30:34.710072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:39.447878+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:39.447878+0000","last_peered":"2024-07-26T08:29:39.447878+0000","last_clean":"2024-07-26T08:29:39.447878+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:39.447878+0000","last_undegraded":"2024-07-26T08:29:39.447878+0000","last_fullsized":"2024-07-26T08:29:39.447878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.476303+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:52.476303+0000","last_peered":"2024-07-26T08:29:52.476303+0000","last_clean":"2024-07-26T08:29:52.476303+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:52.476303+0000","last_undegraded":"2024-07-26T08:29:52.476303+0000","last_fullsized":"2024-07-26T08:29:52.476303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.704571+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:30:34.704571+0000","last_peered":"2024-07-26T08:30:34.704571+0000","last_clean":"2024-07-26T08:30:34.704571+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:30:34.704571+0000","last_undegraded":"2024-07-26T08:30:34.704571+0000","last_fullsized":"2024-07-26T08:30:34.704571+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'14","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:48.958299+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:31:48.958299+0000","last_peered":"2024-07-26T08:31:48.958299+0000","last_clean":"2024-07-26T08:31:48.958299+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:31:48.958299+0000","last_undegraded":"2024-07-26T08:31:48.958299+0000","last_fullsized":"2024-07-26T08:31:48.958299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.194671+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:52.194671+0000","last_peered":"2024-07-26T08:29:52.194671+0000","last_clean":"2024-07-26T08:29:52.194671+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:52.194671+0000","last_undegraded":"2024-07-26T08:29:52.194671+0000","last_fullsized":"2024-07-26T08:29:52.194671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708597+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:30:34.708597+0000","last_peered":"2024-07-26T08:30:34.708597+0000","last_clean":"2024-07-26T08:30:34.708597+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:30:34.708597+0000","last_undegraded":"2024-07-26T08:30:34.708597+0000","last_fullsized":"2024-07-26T08:30:34.708597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916248+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916248+0000","last_peered":"2024-07-26T08:29:36.916248+0000","last_clean":"2024-07-26T08:29:36.916248+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916248+0000","last_undegraded":"2024-07-26T08:29:36.916248+0000","last_fullsized":"2024-07-26T08:29:36.916248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:56.050676+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:56.050676+0000","last_peered":"2024-07-26T08:29:56.050676+0000","last_clean":"2024-07-26T08:29:56.050676+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:56.050676+0000","last_undegraded":"2024-07-26T08:29:56.050676+0000","last_fullsized":"2024-07-26T08:29:56.050676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687723+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:30:34.687723+0000","last_peered":"2024-07-26T08:30:34.687723+0000","last_clean":"2024-07-26T08:30:34.687723+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:30:34.687723+0000","last_undegraded":"2024-07-26T08:30:34.687723+0000","last_fullsized":"2024-07-26T08:30:34.687723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370716+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370716+0000","last_peered":"2024-07-26T08:29:36.370716+0000","last_clean":"2024-07-26T08:29:36.370716+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370716+0000","last_undegraded":"2024-07-26T08:29:36.370716+0000","last_fullsized":"2024-07-26T08:29:36.370716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:53.347098+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:53.347098+0000","last_peered":"2024-07-26T08:29:53.347098+0000","last_clean":"2024-07-26T08:29:53.347098+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:53.347098+0000","last_undegraded":"2024-07-26T08:29:53.347098+0000","last_fullsized":"2024-07-26T08:29:53.347098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694251+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:30:34.694251+0000","last_peered":"2024-07-26T08:30:34.694251+0000","last_clean":"2024-07-26T08:30:34.694251+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:30:34.694251+0000","last_undegraded":"2024-07-26T08:30:34.694251+0000","last_fullsized":"2024-07-26T08:30:34.694251+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.697898+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:37.697898+0000","last_peered":"2024-07-26T08:29:37.697898+0000","last_clean":"2024-07-26T08:29:37.697898+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:37.697898+0000","last_undegraded":"2024-07-26T08:29:37.697898+0000","last_fullsized":"2024-07-26T08:29:37.697898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.435078+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:52.435078+0000","last_peered":"2024-07-26T08:29:52.435078+0000","last_clean":"2024-07-26T08:29:52.435078+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:52.435078+0000","last_undegraded":"2024-07-26T08:29:52.435078+0000","last_fullsized":"2024-07-26T08:29:52.435078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703085+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:30:34.703085+0000","last_peered":"2024-07-26T08:30:34.703085+0000","last_clean":"2024-07-26T08:30:34.703085+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:30:34.703085+0000","last_undegraded":"2024-07-26T08:30:34.703085+0000","last_fullsized":"2024-07-26T08:30:34.703085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:06.175112+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:33:06.175112+0000","last_peered":"2024-07-26T08:33:06.175112+0000","last_clean":"2024-07-26T08:33:06.175112+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:33:06.175112+0000","last_undegraded":"2024-07-26T08:33:06.175112+0000","last_fullsized":"2024-07-26T08:33:06.175112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":243,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.436230+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:57.436230+0000","last_peered":"2024-07-26T08:29:57.436230+0000","last_clean":"2024-07-26T08:29:57.436230+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:57.436230+0000","last_undegraded":"2024-07-26T08:29:57.436230+0000","last_fullsized":"2024-07-26T08:29:57.436230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.710492+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:30:34.710492+0000","last_peered":"2024-07-26T08:30:34.710492+0000","last_clean":"2024-07-26T08:30:34.710492+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:30:34.710492+0000","last_undegraded":"2024-07-26T08:30:34.710492+0000","last_fullsized":"2024-07-26T08:30:34.710492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362509+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362509+0000","last_peered":"2024-07-26T08:29:36.362509+0000","last_clean":"2024-07-26T08:29:36.362509+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362509+0000","last_undegraded":"2024-07-26T08:29:36.362509+0000","last_fullsized":"2024-07-26T08:29:36.362509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312159+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:30:02.312159+0000","last_peered":"2024-07-26T08:30:02.312159+0000","last_clean":"2024-07-26T08:30:02.312159+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:30:02.312159+0000","last_undegraded":"2024-07-26T08:30:02.312159+0000","last_fullsized":"2024-07-26T08:30:02.312159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707121+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:30:34.707121+0000","last_peered":"2024-07-26T08:30:34.707121+0000","last_clean":"2024-07-26T08:30:34.707121+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:30:34.707121+0000","last_undegraded":"2024-07-26T08:30:34.707121+0000","last_fullsized":"2024-07-26T08:30:34.707121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684102+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.684102+0000","last_peered":"2024-07-26T08:29:36.684102+0000","last_clean":"2024-07-26T08:29:36.684102+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.684102+0000","last_undegraded":"2024-07-26T08:29:36.684102+0000","last_fullsized":"2024-07-26T08:29:36.684102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:32.704792+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:30:32.704792+0000","last_peered":"2024-07-26T08:30:32.704792+0000","last_clean":"2024-07-26T08:30:32.704792+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:30:32.704792+0000","last_undegraded":"2024-07-26T08:30:32.704792+0000","last_fullsized":"2024-07-26T08:30:32.704792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.699740+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:52.699740+0000","last_peered":"2024-07-26T08:29:52.699740+0000","last_clean":"2024-07-26T08:29:52.699740+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:52.699740+0000","last_undegraded":"2024-07-26T08:29:52.699740+0000","last_fullsized":"2024-07-26T08:29:52.699740+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685722+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:30:34.685722+0000","last_peered":"2024-07-26T08:30:34.685722+0000","last_clean":"2024-07-26T08:30:34.685722+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:30:34.685722+0000","last_undegraded":"2024-07-26T08:30:34.685722+0000","last_fullsized":"2024-07-26T08:30:34.685722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.475514+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:47.475514+0000","last_peered":"2024-07-26T08:29:47.475514+0000","last_clean":"2024-07-26T08:29:47.475514+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:47.475514+0000","last_undegraded":"2024-07-26T08:29:47.475514+0000","last_fullsized":"2024-07-26T08:29:47.475514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:00.057697+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:30:00.057697+0000","last_peered":"2024-07-26T08:30:00.057697+0000","last_clean":"2024-07-26T08:30:00.057697+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:30:00.057697+0000","last_undegraded":"2024-07-26T08:30:00.057697+0000","last_fullsized":"2024-07-26T08:30:00.057697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708021+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:30:34.708021+0000","last_peered":"2024-07-26T08:30:34.708021+0000","last_clean":"2024-07-26T08:30:34.708021+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:30:34.708021+0000","last_undegraded":"2024-07-26T08:30:34.708021+0000","last_fullsized":"2024-07-26T08:30:34.708021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.310284+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:47.310284+0000","last_peered":"2024-07-26T08:29:47.310284+0000","last_clean":"2024-07-26T08:29:47.310284+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:47.310284+0000","last_undegraded":"2024-07-26T08:29:47.310284+0000","last_fullsized":"2024-07-26T08:29:47.310284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:05.322023+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:30:05.322023+0000","last_peered":"2024-07-26T08:30:05.322023+0000","last_clean":"2024-07-26T08:30:05.322023+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:30:05.322023+0000","last_undegraded":"2024-07-26T08:30:05.322023+0000","last_fullsized":"2024-07-26T08:30:05.322023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.680032+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:30:34.680032+0000","last_peered":"2024-07-26T08:30:34.680032+0000","last_clean":"2024-07-26T08:30:34.680032+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:30:34.680032+0000","last_undegraded":"2024-07-26T08:30:34.680032+0000","last_fullsized":"2024-07-26T08:30:34.680032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.427620+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:47.427620+0000","last_peered":"2024-07-26T08:29:47.427620+0000","last_clean":"2024-07-26T08:29:47.427620+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:47.427620+0000","last_undegraded":"2024-07-26T08:29:47.427620+0000","last_fullsized":"2024-07-26T08:29:47.427620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312070+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:30:02.312070+0000","last_peered":"2024-07-26T08:30:02.312070+0000","last_clean":"2024-07-26T08:30:02.312070+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:30:02.312070+0000","last_undegraded":"2024-07-26T08:30:02.312070+0000","last_fullsized":"2024-07-26T08:30:02.312070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673736+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:30:34.673736+0000","last_peered":"2024-07-26T08:30:34.673736+0000","last_clean":"2024-07-26T08:30:34.673736+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:30:34.673736+0000","last_undegraded":"2024-07-26T08:30:34.673736+0000","last_fullsized":"2024-07-26T08:30:34.673736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:43.345781+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:43.345781+0000","last_peered":"2024-07-26T08:29:43.345781+0000","last_clean":"2024-07-26T08:29:43.345781+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:43.345781+0000","last_undegraded":"2024-07-26T08:29:43.345781+0000","last_fullsized":"2024-07-26T08:29:43.345781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312108+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:30:02.312108+0000","last_peered":"2024-07-26T08:30:02.312108+0000","last_clean":"2024-07-26T08:30:02.312108+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:30:02.312108+0000","last_undegraded":"2024-07-26T08:30:02.312108+0000","last_fullsized":"2024-07-26T08:30:02.312108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675937+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:30:34.675937+0000","last_peered":"2024-07-26T08:30:34.675937+0000","last_clean":"2024-07-26T08:30:34.675937+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:30:34.675937+0000","last_undegraded":"2024-07-26T08:30:34.675937+0000","last_fullsized":"2024-07-26T08:30:34.675937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:48.346463+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:48.346463+0000","last_peered":"2024-07-26T08:29:48.346463+0000","last_clean":"2024-07-26T08:29:48.346463+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:48.346463+0000","last_undegraded":"2024-07-26T08:29:48.346463+0000","last_fullsized":"2024-07-26T08:29:48.346463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.438875+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:30:12.438875+0000","last_peered":"2024-07-26T08:30:12.438875+0000","last_clean":"2024-07-26T08:30:12.438875+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:30:12.438875+0000","last_undegraded":"2024-07-26T08:30:12.438875+0000","last_fullsized":"2024-07-26T08:30:12.438875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.682145+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:30:34.682145+0000","last_peered":"2024-07-26T08:30:34.682145+0000","last_clean":"2024-07-26T08:30:34.682145+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:30:34.682145+0000","last_undegraded":"2024-07-26T08:30:34.682145+0000","last_fullsized":"2024-07-26T08:30:34.682145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":292,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:03.169067+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:33:03.169067+0000","last_peered":"2024-07-26T08:33:03.169067+0000","last_clean":"2024-07-26T08:33:03.169067+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:33:03.169067+0000","last_undegraded":"2024-07-26T08:33:03.169067+0000","last_fullsized":"2024-07-26T08:33:03.169067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:13.941433+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:30:13.941433+0000","last_peered":"2024-07-26T08:30:13.941433+0000","last_clean":"2024-07-26T08:30:13.941433+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:30:13.941433+0000","last_undegraded":"2024-07-26T08:30:13.941433+0000","last_fullsized":"2024-07-26T08:30:13.941433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713432+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:30:34.713432+0000","last_peered":"2024-07-26T08:30:34.713432+0000","last_clean":"2024-07-26T08:30:34.713432+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:30:34.713432+0000","last_undegraded":"2024-07-26T08:30:34.713432+0000","last_fullsized":"2024-07-26T08:30:34.713432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.310789+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:52.310789+0000","last_peered":"2024-07-26T08:29:52.310789+0000","last_clean":"2024-07-26T08:29:52.310789+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:52.310789+0000","last_undegraded":"2024-07-26T08:29:52.310789+0000","last_fullsized":"2024-07-26T08:29:52.310789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:11.052776+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:30:11.052776+0000","last_peered":"2024-07-26T08:30:11.052776+0000","last_clean":"2024-07-26T08:30:11.052776+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:30:11.052776+0000","last_undegraded":"2024-07-26T08:30:11.052776+0000","last_fullsized":"2024-07-26T08:30:11.052776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.712667+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:30:34.712667+0000","last_peered":"2024-07-26T08:30:34.712667+0000","last_clean":"2024-07-26T08:30:34.712667+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:30:34.712667+0000","last_undegraded":"2024-07-26T08:30:34.712667+0000","last_fullsized":"2024-07-26T08:30:34.712667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.476333+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:52.476333+0000","last_peered":"2024-07-26T08:29:52.476333+0000","last_clean":"2024-07-26T08:29:52.476333+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:52.476333+0000","last_undegraded":"2024-07-26T08:29:52.476333+0000","last_fullsized":"2024-07-26T08:29:52.476333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.314280+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:30:17.314280+0000","last_peered":"2024-07-26T08:30:17.314280+0000","last_clean":"2024-07-26T08:30:17.314280+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:30:17.314280+0000","last_undegraded":"2024-07-26T08:30:17.314280+0000","last_fullsized":"2024-07-26T08:30:17.314280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670994+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:30:34.670994+0000","last_peered":"2024-07-26T08:30:34.670994+0000","last_clean":"2024-07-26T08:30:34.670994+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:30:34.670994+0000","last_undegraded":"2024-07-26T08:30:34.670994+0000","last_fullsized":"2024-07-26T08:30:34.670994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":580,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:05.042528+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:33:05.042528+0000","last_peered":"2024-07-26T08:33:05.042528+0000","last_clean":"2024-07-26T08:33:05.042528+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:33:05.042528+0000","last_undegraded":"2024-07-26T08:33:05.042528+0000","last_fullsized":"2024-07-26T08:33:05.042528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":314,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:08.940321+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:30:08.940321+0000","last_peered":"2024-07-26T08:30:08.940321+0000","last_clean":"2024-07-26T08:30:08.940321+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:30:08.940321+0000","last_undegraded":"2024-07-26T08:30:08.940321+0000","last_fullsized":"2024-07-26T08:30:08.940321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685649+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:30:34.685649+0000","last_peered":"2024-07-26T08:30:34.685649+0000","last_clean":"2024-07-26T08:30:34.685649+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:30:34.685649+0000","last_undegraded":"2024-07-26T08:30:34.685649+0000","last_fullsized":"2024-07-26T08:30:34.685649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.311525+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:57.311525+0000","last_peered":"2024-07-26T08:29:57.311525+0000","last_clean":"2024-07-26T08:29:57.311525+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:57.311525+0000","last_undegraded":"2024-07-26T08:29:57.311525+0000","last_fullsized":"2024-07-26T08:29:57.311525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:09.452130+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:30:09.452130+0000","last_peered":"2024-07-26T08:30:09.452130+0000","last_clean":"2024-07-26T08:30:09.452130+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:30:09.452130+0000","last_undegraded":"2024-07-26T08:30:09.452130+0000","last_fullsized":"2024-07-26T08:30:09.452130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697862+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:30:34.697862+0000","last_peered":"2024-07-26T08:30:34.697862+0000","last_clean":"2024-07-26T08:30:34.697862+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:30:34.697862+0000","last_undegraded":"2024-07-26T08:30:34.697862+0000","last_fullsized":"2024-07-26T08:30:34.697862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.700486+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:57.700486+0000","last_peered":"2024-07-26T08:29:57.700486+0000","last_clean":"2024-07-26T08:29:57.700486+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:57.700486+0000","last_undegraded":"2024-07-26T08:29:57.700486+0000","last_fullsized":"2024-07-26T08:29:57.700486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:08.940267+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:30:08.940267+0000","last_peered":"2024-07-26T08:30:08.940267+0000","last_clean":"2024-07-26T08:30:08.940267+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:30:08.940267+0000","last_undegraded":"2024-07-26T08:30:08.940267+0000","last_fullsized":"2024-07-26T08:30:08.940267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687862+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:30:34.687862+0000","last_peered":"2024-07-26T08:30:34.687862+0000","last_clean":"2024-07-26T08:30:34.687862+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:30:34.687862+0000","last_undegraded":"2024-07-26T08:30:34.687862+0000","last_fullsized":"2024-07-26T08:30:34.687862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:04.171114+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:33:04.171114+0000","last_peered":"2024-07-26T08:33:04.171114+0000","last_clean":"2024-07-26T08:33:04.171114+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:33:04.171114+0000","last_undegraded":"2024-07-26T08:33:04.171114+0000","last_fullsized":"2024-07-26T08:33:04.171114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.198247+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:30:12.198247+0000","last_peered":"2024-07-26T08:30:12.198247+0000","last_clean":"2024-07-26T08:30:12.198247+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:30:12.198247+0000","last_undegraded":"2024-07-26T08:30:12.198247+0000","last_fullsized":"2024-07-26T08:30:12.198247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:50.319075+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:50.319075+0000","last_peered":"2024-07-26T08:29:50.319075+0000","last_clean":"2024-07-26T08:29:50.319075+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:50.319075+0000","last_undegraded":"2024-07-26T08:29:50.319075+0000","last_fullsized":"2024-07-26T08:29:50.319075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709671+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:30:34.709671+0000","last_peered":"2024-07-26T08:30:34.709671+0000","last_clean":"2024-07-26T08:30:34.709671+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:30:34.709671+0000","last_undegraded":"2024-07-26T08:30:34.709671+0000","last_fullsized":"2024-07-26T08:30:34.709671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.311463+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:57.311463+0000","last_peered":"2024-07-26T08:29:57.311463+0000","last_clean":"2024-07-26T08:29:57.311463+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:57.311463+0000","last_undegraded":"2024-07-26T08:29:57.311463+0000","last_fullsized":"2024-07-26T08:29:57.311463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:56.050710+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:56.050710+0000","last_peered":"2024-07-26T08:29:56.050710+0000","last_clean":"2024-07-26T08:29:56.050710+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:56.050710+0000","last_undegraded":"2024-07-26T08:29:56.050710+0000","last_fullsized":"2024-07-26T08:29:56.050710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713505+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:30:34.713505+0000","last_peered":"2024-07-26T08:30:34.713505+0000","last_clean":"2024-07-26T08:30:34.713505+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:30:34.713505+0000","last_undegraded":"2024-07-26T08:30:34.713505+0000","last_fullsized":"2024-07-26T08:30:34.713505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.435973+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:57.435973+0000","last_peered":"2024-07-26T08:29:57.435973+0000","last_clean":"2024-07-26T08:29:57.435973+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:57.435973+0000","last_undegraded":"2024-07-26T08:29:57.435973+0000","last_fullsized":"2024-07-26T08:29:57.435973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:00.397718+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:30:00.397718+0000","last_peered":"2024-07-26T08:30:00.397718+0000","last_clean":"2024-07-26T08:30:00.397718+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:30:00.397718+0000","last_undegraded":"2024-07-26T08:30:00.397718+0000","last_fullsized":"2024-07-26T08:30:00.397718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703945+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:30:34.703945+0000","last_peered":"2024-07-26T08:30:34.703945+0000","last_clean":"2024-07-26T08:30:34.703945+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:30:34.703945+0000","last_undegraded":"2024-07-26T08:30:34.703945+0000","last_fullsized":"2024-07-26T08:30:34.703945+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.479043+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:30:17.479043+0000","last_peered":"2024-07-26T08:30:17.479043+0000","last_clean":"2024-07-26T08:30:17.479043+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:30:17.479043+0000","last_undegraded":"2024-07-26T08:30:17.479043+0000","last_fullsized":"2024-07-26T08:30:17.479043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:06.176201+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:33:06.176201+0000","last_peered":"2024-07-26T08:33:06.176201+0000","last_clean":"2024-07-26T08:33:06.176201+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:33:06.176201+0000","last_undegraded":"2024-07-26T08:33:06.176201+0000","last_fullsized":"2024-07-26T08:33:06.176201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675755+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:30:34.675755+0000","last_peered":"2024-07-26T08:30:34.675755+0000","last_clean":"2024-07-26T08:30:34.675755+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:30:34.675755+0000","last_undegraded":"2024-07-26T08:30:34.675755+0000","last_fullsized":"2024-07-26T08:30:34.675755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.479066+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:30:17.479066+0000","last_peered":"2024-07-26T08:30:17.479066+0000","last_clean":"2024-07-26T08:30:17.479066+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:30:17.479066+0000","last_undegraded":"2024-07-26T08:30:17.479066+0000","last_fullsized":"2024-07-26T08:30:17.479066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671670+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:30:34.671670+0000","last_peered":"2024-07-26T08:30:34.671670+0000","last_clean":"2024-07-26T08:30:34.671670+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:30:34.671670+0000","last_undegraded":"2024-07-26T08:30:34.671670+0000","last_fullsized":"2024-07-26T08:30:34.671670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674878+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:30:34.674878+0000","last_peered":"2024-07-26T08:30:34.674878+0000","last_clean":"2024-07-26T08:30:34.674878+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:30:34.674878+0000","last_undegraded":"2024-07-26T08:30:34.674878+0000","last_fullsized":"2024-07-26T08:30:34.674878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700140+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:30:34.700140+0000","last_peered":"2024-07-26T08:30:34.700140+0000","last_clean":"2024-07-26T08:30:34.700140+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:30:34.700140+0000","last_undegraded":"2024-07-26T08:30:34.700140+0000","last_fullsized":"2024-07-26T08:30:34.700140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713954+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:30:34.713954+0000","last_peered":"2024-07-26T08:30:34.713954+0000","last_clean":"2024-07-26T08:30:34.713954+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:30:34.713954+0000","last_undegraded":"2024-07-26T08:30:34.713954+0000","last_fullsized":"2024-07-26T08:30:34.713954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711478+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:30:34.711478+0000","last_peered":"2024-07-26T08:30:34.711478+0000","last_clean":"2024-07-26T08:30:34.711478+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:30:34.711478+0000","last_undegraded":"2024-07-26T08:30:34.711478+0000","last_fullsized":"2024-07-26T08:30:34.711478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673719+0000","last_change":"2024-07-26T08:29:36.916212+0000","last_active":"2024-07-26T08:30:34.673719+0000","last_peered":"2024-07-26T08:30:34.673719+0000","last_clean":"2024-07-26T08:30:34.673719+0000","last_became_active":"2024-07-26T08:29:36.915665+0000","last_became_peered":"2024-07-26T08:29:36.915665+0000","last_unstale":"2024-07-26T08:30:34.673719+0000","last_undegraded":"2024-07-26T08:30:34.673719+0000","last_fullsized":"2024-07-26T08:30:34.673719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:54:03.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673854+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:30:34.673854+0000","last_peered":"2024-07-26T08:30:34.673854+0000","last_clean":"2024-07-26T08:30:34.673854+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:30:34.673854+0000","last_undegraded":"2024-07-26T08:30:34.673854+0000","last_fullsized":"2024-07-26T08:30:34.673854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671940+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:30:34.671940+0000","last_peered":"2024-07-26T08:30:34.671940+0000","last_clean":"2024-07-26T08:30:34.671940+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:30:34.671940+0000","last_undegraded":"2024-07-26T08:30:34.671940+0000","last_fullsized":"2024-07-26T08:30:34.671940+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708002+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:30:34.708002+0000","last_peered":"2024-07-26T08:30:34.708002+0000","last_clean":"2024-07-26T08:30:34.708002+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:30:34.708002+0000","last_undegraded":"2024-07-26T08:30:34.708002+0000","last_fullsized":"2024-07-26T08:30:34.708002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705173+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:30:34.705173+0000","last_peered":"2024-07-26T08:30:34.705173+0000","last_clean":"2024-07-26T08:30:34.705173+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:30:34.705173+0000","last_undegraded":"2024-07-26T08:30:34.705173+0000","last_fullsized":"2024-07-26T08:30:34.705173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706758+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:30:34.706758+0000","last_peered":"2024-07-26T08:30:34.706758+0000","last_clean":"2024-07-26T08:30:34.706758+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:30:34.706758+0000","last_undegraded":"2024-07-26T08:30:34.706758+0000","last_fullsized":"2024-07-26T08:30:34.706758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.714091+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:30:34.714091+0000","last_peered":"2024-07-26T08:30:34.714091+0000","last_clean":"2024-07-26T08:30:34.714091+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:30:34.714091+0000","last_undegraded":"2024-07-26T08:30:34.714091+0000","last_fullsized":"2024-07-26T08:30:34.714091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674941+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:30:34.674941+0000","last_peered":"2024-07-26T08:30:34.674941+0000","last_clean":"2024-07-26T08:30:34.674941+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:30:34.674941+0000","last_undegraded":"2024-07-26T08:30:34.674941+0000","last_fullsized":"2024-07-26T08:30:34.674941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707129+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:30:34.707129+0000","last_peered":"2024-07-26T08:30:34.707129+0000","last_clean":"2024-07-26T08:30:34.707129+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:30:34.707129+0000","last_undegraded":"2024-07-26T08:30:34.707129+0000","last_fullsized":"2024-07-26T08:30:34.707129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688253+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:30:34.688253+0000","last_peered":"2024-07-26T08:30:34.688253+0000","last_clean":"2024-07-26T08:30:34.688253+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:30:34.688253+0000","last_undegraded":"2024-07-26T08:30:34.688253+0000","last_fullsized":"2024-07-26T08:30:34.688253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702903+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:30:34.702903+0000","last_peered":"2024-07-26T08:30:34.702903+0000","last_clean":"2024-07-26T08:30:34.702903+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:30:34.702903+0000","last_undegraded":"2024-07-26T08:30:34.702903+0000","last_fullsized":"2024-07-26T08:30:34.702903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703845+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:30:34.703845+0000","last_peered":"2024-07-26T08:30:34.703845+0000","last_clean":"2024-07-26T08:30:34.703845+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:30:34.703845+0000","last_undegraded":"2024-07-26T08:30:34.703845+0000","last_fullsized":"2024-07-26T08:30:34.703845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697407+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:30:34.697407+0000","last_peered":"2024-07-26T08:30:34.697407+0000","last_clean":"2024-07-26T08:30:34.697407+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:30:34.697407+0000","last_undegraded":"2024-07-26T08:30:34.697407+0000","last_fullsized":"2024-07-26T08:30:34.697407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702516+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:30:34.702516+0000","last_peered":"2024-07-26T08:30:34.702516+0000","last_clean":"2024-07-26T08:30:34.702516+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:30:34.702516+0000","last_undegraded":"2024-07-26T08:30:34.702516+0000","last_fullsized":"2024-07-26T08:30:34.702516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.714165+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:30:34.714165+0000","last_peered":"2024-07-26T08:30:34.714165+0000","last_clean":"2024-07-26T08:30:34.714165+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:30:34.714165+0000","last_undegraded":"2024-07-26T08:30:34.714165+0000","last_fullsized":"2024-07-26T08:30:34.714165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672641+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:30:34.672641+0000","last_peered":"2024-07-26T08:30:34.672641+0000","last_clean":"2024-07-26T08:30:34.672641+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:30:34.672641+0000","last_undegraded":"2024-07-26T08:30:34.672641+0000","last_fullsized":"2024-07-26T08:30:34.672641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685731+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:30:34.685731+0000","last_peered":"2024-07-26T08:30:34.685731+0000","last_clean":"2024-07-26T08:30:34.685731+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:30:34.685731+0000","last_undegraded":"2024-07-26T08:30:34.685731+0000","last_fullsized":"2024-07-26T08:30:34.685731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671159+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:30:34.671159+0000","last_peered":"2024-07-26T08:30:34.671159+0000","last_clean":"2024-07-26T08:30:34.671159+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:30:34.671159+0000","last_undegraded":"2024-07-26T08:30:34.671159+0000","last_fullsized":"2024-07-26T08:30:34.671159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685314+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:30:34.685314+0000","last_peered":"2024-07-26T08:30:34.685314+0000","last_clean":"2024-07-26T08:30:34.685314+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:30:34.685314+0000","last_undegraded":"2024-07-26T08:30:34.685314+0000","last_fullsized":"2024-07-26T08:30:34.685314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706435+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:30:34.706435+0000","last_peered":"2024-07-26T08:30:34.706435+0000","last_clean":"2024-07-26T08:30:34.706435+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:30:34.706435+0000","last_undegraded":"2024-07-26T08:30:34.706435+0000","last_fullsized":"2024-07-26T08:30:34.706435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688595+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:30:34.688595+0000","last_peered":"2024-07-26T08:30:34.688595+0000","last_clean":"2024-07-26T08:30:34.688595+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:30:34.688595+0000","last_undegraded":"2024-07-26T08:30:34.688595+0000","last_fullsized":"2024-07-26T08:30:34.688595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674363+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:30:34.674363+0000","last_peered":"2024-07-26T08:30:34.674363+0000","last_clean":"2024-07-26T08:30:34.674363+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:30:34.674363+0000","last_undegraded":"2024-07-26T08:30:34.674363+0000","last_fullsized":"2024-07-26T08:30:34.674363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706281+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:30:34.706281+0000","last_peered":"2024-07-26T08:30:34.706281+0000","last_clean":"2024-07-26T08:30:34.706281+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:30:34.706281+0000","last_undegraded":"2024-07-26T08:30:34.706281+0000","last_fullsized":"2024-07-26T08:30:34.706281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.677278+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:30:34.677278+0000","last_peered":"2024-07-26T08:30:34.677278+0000","last_clean":"2024-07-26T08:30:34.677278+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:30:34.677278+0000","last_undegraded":"2024-07-26T08:30:34.677278+0000","last_fullsized":"2024-07-26T08:30:34.677278+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.699740+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:30:34.699740+0000","last_peered":"2024-07-26T08:30:34.699740+0000","last_clean":"2024-07-26T08:30:34.699740+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:30:34.699740+0000","last_undegraded":"2024-07-26T08:30:34.699740+0000","last_fullsized":"2024-07-26T08:30:34.699740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703025+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:30:34.703025+0000","last_peered":"2024-07-26T08:30:34.703025+0000","last_clean":"2024-07-26T08:30:34.703025+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:30:34.703025+0000","last_undegraded":"2024-07-26T08:30:34.703025+0000","last_fullsized":"2024-07-26T08:30:34.703025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702814+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:30:34.702814+0000","last_peered":"2024-07-26T08:30:34.702814+0000","last_clean":"2024-07-26T08:30:34.702814+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:30:34.702814+0000","last_undegraded":"2024-07-26T08:30:34.702814+0000","last_fullsized":"2024-07-26T08:30:34.702814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71611,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1479,"num_read_kb":816,"num_write":178,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678100,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":535351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874328,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1194716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234086,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430315,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593839,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790070,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953596,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149824,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":530957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378760,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":600024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":598674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705809,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:33:10.335 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-07-26T08:33:10.335 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-26T08:33:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:10 smithi133 ceph-mon[37053]: pgmap v485: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-07-26T08:33:10.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 -- 172.21.15.43:0/3324858118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c030 msgr2=0x7fb15c10c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 --2- 172.21.15.43:0/3324858118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c030 0x7fb15c10c440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb148009860 tx=0x7fb14802a340 comp rx=0 tx=0).stop 2024-07-26T08:33:10.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 -- 172.21.15.43:0/3324858118 shutdown_connections 2024-07-26T08:33:10.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 --2- 172.21.15.43:0/3324858118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c030 0x7fb15c10c440 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 --2- 172.21.15.43:0/3324858118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c10c980 0x7fb15c1163f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 --2- 172.21.15.43:0/3324858118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c109990 0x7fb15c109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.654+0000 7fb161c00640 1 -- 172.21.15.43:0/3324858118 >> 172.21.15.43:0/3324858118 conn(0x7fb15c0790b0 msgr2=0x7fb15c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:10.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.655+0000 7fb161c00640 1 -- 172.21.15.43:0/3324858118 shutdown_connections 2024-07-26T08:33:10.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.655+0000 7fb161c00640 1 -- 172.21.15.43:0/3324858118 wait complete. 2024-07-26T08:33:10.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.656+0000 7fb161c00640 1 Processor -- start 2024-07-26T08:33:10.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.656+0000 7fb161c00640 1 -- start start 2024-07-26T08:33:10.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb161c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c109990 0x7fb15c1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb161c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 0x7fb15c1a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb161c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c980 0x7fb15c1a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb161c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1199a0 con 0x7fb15c10c030 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb161c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c119820 con 0x7fb15c109990 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb161c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c119b20 con 0x7fb15c10c980 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb15b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 0x7fb15c1a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb15b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 0x7fb15c1a08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44482/0 (socket says 172.21.15.43:44482) 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb15b400640 1 -- 172.21.15.43:0/986380532 learned_addr learned my addr 172.21.15.43:0/986380532 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.657+0000 7fb15be00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c109990 0x7fb15c1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb161200640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c980 0x7fb15c1a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15b400640 1 -- 172.21.15.43:0/986380532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c980 msgr2=0x7fb15c1a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15b400640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c980 0x7fb15c1a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15b400640 1 -- 172.21.15.43:0/986380532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c109990 msgr2=0x7fb15c1a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15b400640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c109990 0x7fb15c1a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15b400640 1 -- 172.21.15.43:0/986380532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c1a6250 con 0x7fb15c10c030 2024-07-26T08:33:10.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15be00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c109990 0x7fb15c1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:10.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.658+0000 7fb15b400640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 0x7fb15c1a08c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb148000c00 tx=0x7fb14802aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:10.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.659+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14803f020 con 0x7fb15c10c030 2024-07-26T08:33:10.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.659+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c1a64e0 con 0x7fb15c10c030 2024-07-26T08:33:10.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.659+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb148033dd0 con 0x7fb15c10c030 2024-07-26T08:33:10.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.659+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c1accd0 con 0x7fb15c10c030 2024-07-26T08:33:10.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.659+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148037040 con 0x7fb15c10c030 2024-07-26T08:33:10.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.660+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb15c109da0 con 0x7fb15c10c030 2024-07-26T08:33:10.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.663+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fb148042020 con 0x7fb15c10c030 2024-07-26T08:33:10.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.664+0000 7fb158c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1400b3c20 0x7fb1400b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:10.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.665+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fb148104340 con 0x7fb15c10c030 2024-07-26T08:33:10.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.665+0000 7fb15be00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1400b3c20 0x7fb1400b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:10.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.666+0000 7fb15be00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1400b3c20 0x7fb1400b6130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0099a0 tx=0x7fb14c009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.669+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb148049020 con 0x7fb15c10c030 2024-07-26T08:33:10.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.880+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb15c111a10 con 0x7fb1400b3c20 2024-07-26T08:33:10.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.898+0000 7fb158c00640 1 -- 172.21.15.43:0/986380532 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340474 (secure 0 0 0) 0x7fb15c111a10 con 0x7fb1400b3c20 2024-07-26T08:33:10.906 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:10.908 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-07-26T08:33:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1400b3c20 msgr2=0x7fb1400b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1400b3c20 0x7fb1400b6130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0099a0 tx=0x7fb14c009500 comp rx=0 tx=0).stop 2024-07-26T08:33:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 msgr2=0x7fb15c1a08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 0x7fb15c1a08c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb148000c00 tx=0x7fb14802aea0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 shutdown_connections 2024-07-26T08:33:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb1400b3c20 0x7fb1400b6130 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb15c10c980 0x7fb15c1a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb15c10c030 0x7fb15c1a08c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.907+0000 7fb161c00640 1 --2- 172.21.15.43:0/986380532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb15c109990 0x7fb15c1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.908+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 >> 172.21.15.43:0/986380532 conn(0x7fb15c0790b0 msgr2=0x7fb15c10d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.908+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 shutdown_connections 2024-07-26T08:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:10.908+0000 7fb161c00640 1 -- 172.21.15.43:0/986380532 wait complete. 2024-07-26T08:33:10.939 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":486,"stamp":"2024-07-26T08:33:10.840304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662213,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1580,"num_read_kb":895,"num_write":303,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388412,"kb_used_data":14300,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553412,"statfs":{"total":1151940427776,"available":1151542693888,"internally_reserved":0,"allocated":14643200,"data_stored":8386781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5680,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":47,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005986"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.372531+0000","last_change":"2024-07-26T08:28:35.809284+0000","last_active":"2024-07-26T08:29:36.372531+0000","last_peered":"2024-07-26T08:29:36.372531+0000","last_clean":"2024-07-26T08:29:36.372531+0000","last_became_active":"2024-07-26T08:28:35.798299+0000","last_became_peered":"2024-07-26T08:28:35.798299+0000","last_unstale":"2024-07-26T08:29:36.372531+0000","last_undegraded":"2024-07-26T08:29:36.372531+0000","last_fullsized":"2024-07-26T08:29:36.372531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:13.692600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705761+0000","last_change":"2024-07-26T08:27:34.314852+0000","last_active":"2024-07-26T08:30:34.705761+0000","last_peered":"2024-07-26T08:30:34.705761+0000","last_clean":"2024-07-26T08:30:34.705761+0000","last_became_active":"2024-07-26T08:27:34.314417+0000","last_became_peered":"2024-07-26T08:27:34.314417+0000","last_unstale":"2024-07-26T08:30:34.705761+0000","last_undegraded":"2024-07-26T08:30:34.705761+0000","last_fullsized":"2024-07-26T08:30:34.705761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:28:38.696333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.478470+0000","last_change":"2024-07-26T08:27:48.399928+0000","last_active":"2024-07-26T08:30:12.478470+0000","last_peered":"2024-07-26T08:30:12.478470+0000","last_clean":"2024-07-26T08:30:12.478470+0000","last_became_active":"2024-07-26T08:27:48.399373+0000","last_became_peered":"2024-07-26T08:27:48.399373+0000","last_unstale":"2024-07-26T08:30:12.478470+0000","last_undegraded":"2024-07-26T08:30:12.478470+0000","last_fullsized":"2024-07-26T08:30:12.478470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:46:42.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.954303+0000","last_change":"2024-07-26T08:27:29.359190+0000","last_active":"2024-07-26T08:29:36.954303+0000","last_peered":"2024-07-26T08:29:36.954303+0000","last_clean":"2024-07-26T08:29:36.954303+0000","last_became_active":"2024-07-26T08:27:29.358148+0000","last_became_peered":"2024-07-26T08:27:29.358148+0000","last_unstale":"2024-07-26T08:29:36.954303+0000","last_undegraded":"2024-07-26T08:29:36.954303+0000","last_fullsized":"2024-07-26T08:29:36.954303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:23:56.203251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703445+0000","last_change":"2024-07-26T08:27:34.328069+0000","last_active":"2024-07-26T08:30:34.703445+0000","last_peered":"2024-07-26T08:30:34.703445+0000","last_clean":"2024-07-26T08:30:34.703445+0000","last_became_active":"2024-07-26T08:27:34.327677+0000","last_became_peered":"2024-07-26T08:27:34.327677+0000","last_unstale":"2024-07-26T08:30:34.703445+0000","last_undegraded":"2024-07-26T08:30:34.703445+0000","last_fullsized":"2024-07-26T08:30:34.703445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:10:03.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:14.452705+0000","last_change":"2024-07-26T08:28:36.073022+0000","last_active":"2024-07-26T08:30:14.452705+0000","last_peered":"2024-07-26T08:30:14.452705+0000","last_clean":"2024-07-26T08:30:14.452705+0000","last_became_active":"2024-07-26T08:28:36.072456+0000","last_became_peered":"2024-07-26T08:28:36.072456+0000","last_unstale":"2024-07-26T08:30:14.452705+0000","last_undegraded":"2024-07-26T08:30:14.452705+0000","last_fullsized":"2024-07-26T08:30:14.452705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:50.030391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:58.347717+0000","last_change":"2024-07-26T08:27:29.237184+0000","last_active":"2024-07-26T08:29:58.347717+0000","last_peered":"2024-07-26T08:29:58.347717+0000","last_clean":"2024-07-26T08:29:58.347717+0000","last_became_active":"2024-07-26T08:27:29.236799+0000","last_became_peered":"2024-07-26T08:27:29.236799+0000","last_unstale":"2024-07-26T08:29:58.347717+0000","last_undegraded":"2024-07-26T08:29:58.347717+0000","last_fullsized":"2024-07-26T08:29:58.347717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:59:12.907703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703627+0000","last_change":"2024-07-26T08:27:34.305384+0000","last_active":"2024-07-26T08:30:34.703627+0000","last_peered":"2024-07-26T08:30:34.703627+0000","last_clean":"2024-07-26T08:30:34.703627+0000","last_became_active":"2024-07-26T08:27:34.304904+0000","last_became_peered":"2024-07-26T08:27:34.304904+0000","last_unstale":"2024-07-26T08:30:34.703627+0000","last_undegraded":"2024-07-26T08:30:34.703627+0000","last_fullsized":"2024-07-26T08:30:34.703627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:07:51.176897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:19.453302+0000","last_change":"2024-07-26T08:27:48.397586+0000","last_active":"2024-07-26T08:30:19.453302+0000","last_peered":"2024-07-26T08:30:19.453302+0000","last_clean":"2024-07-26T08:30:19.453302+0000","last_became_active":"2024-07-26T08:27:48.396954+0000","last_became_peered":"2024-07-26T08:27:48.396954+0000","last_unstale":"2024-07-26T08:30:19.453302+0000","last_undegraded":"2024-07-26T08:30:19.453302+0000","last_fullsized":"2024-07-26T08:30:19.453302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:20:03.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:58.347685+0000","last_change":"2024-07-26T08:27:29.240314+0000","last_active":"2024-07-26T08:29:58.347685+0000","last_peered":"2024-07-26T08:29:58.347685+0000","last_clean":"2024-07-26T08:29:58.347685+0000","last_became_active":"2024-07-26T08:27:29.239907+0000","last_became_peered":"2024-07-26T08:27:29.239907+0000","last_unstale":"2024-07-26T08:29:58.347685+0000","last_undegraded":"2024-07-26T08:29:58.347685+0000","last_fullsized":"2024-07-26T08:29:58.347685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:16:53.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.676344+0000","last_change":"2024-07-26T08:27:34.301350+0000","last_active":"2024-07-26T08:30:34.676344+0000","last_peered":"2024-07-26T08:30:34.676344+0000","last_clean":"2024-07-26T08:30:34.676344+0000","last_became_active":"2024-07-26T08:27:34.300671+0000","last_became_peered":"2024-07-26T08:27:34.300671+0000","last_unstale":"2024-07-26T08:30:34.676344+0000","last_undegraded":"2024-07-26T08:30:34.676344+0000","last_fullsized":"2024-07-26T08:30:34.676344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:34:13.808726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:19.453274+0000","last_change":"2024-07-26T08:27:48.397064+0000","last_active":"2024-07-26T08:30:19.453274+0000","last_peered":"2024-07-26T08:30:19.453274+0000","last_clean":"2024-07-26T08:30:19.453274+0000","last_became_active":"2024-07-26T08:27:48.396554+0000","last_became_peered":"2024-07-26T08:27:48.396554+0000","last_unstale":"2024-07-26T08:30:19.453274+0000","last_undegraded":"2024-07-26T08:30:19.453274+0000","last_fullsized":"2024-07-26T08:30:19.453274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:30:01.629371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708624+0000","last_change":"2024-07-26T08:27:34.309655+0000","last_active":"2024-07-26T08:30:34.708624+0000","last_peered":"2024-07-26T08:30:34.708624+0000","last_clean":"2024-07-26T08:30:34.708624+0000","last_became_active":"2024-07-26T08:27:34.309007+0000","last_became_peered":"2024-07-26T08:27:34.309007+0000","last_unstale":"2024-07-26T08:30:34.708624+0000","last_undegraded":"2024-07-26T08:30:34.708624+0000","last_fullsized":"2024-07-26T08:30:34.708624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:50:20.479083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:43.345747+0000","last_change":"2024-07-26T08:27:29.236190+0000","last_active":"2024-07-26T08:29:43.345747+0000","last_peered":"2024-07-26T08:29:43.345747+0000","last_clean":"2024-07-26T08:29:43.345747+0000","last_became_active":"2024-07-26T08:27:29.235740+0000","last_became_peered":"2024-07-26T08:27:29.235740+0000","last_unstale":"2024-07-26T08:29:43.345747+0000","last_undegraded":"2024-07-26T08:29:43.345747+0000","last_fullsized":"2024-07-26T08:29:43.345747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:55:48.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451339+0000","last_change":"2024-07-26T08:27:48.559983+0000","last_active":"2024-07-26T08:30:04.451339+0000","last_peered":"2024-07-26T08:30:04.451339+0000","last_clean":"2024-07-26T08:30:04.451339+0000","last_became_active":"2024-07-26T08:27:48.559411+0000","last_became_peered":"2024-07-26T08:27:48.559411+0000","last_unstale":"2024-07-26T08:30:04.451339+0000","last_undegraded":"2024-07-26T08:30:04.451339+0000","last_fullsized":"2024-07-26T08:30:04.451339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:22:00.752904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711771+0000","last_change":"2024-07-26T08:27:34.324071+0000","last_active":"2024-07-26T08:30:34.711771+0000","last_peered":"2024-07-26T08:30:34.711771+0000","last_clean":"2024-07-26T08:30:34.711771+0000","last_became_active":"2024-07-26T08:27:34.323685+0000","last_became_peered":"2024-07-26T08:27:34.323685+0000","last_unstale":"2024-07-26T08:30:34.711771+0000","last_undegraded":"2024-07-26T08:30:34.711771+0000","last_fullsized":"2024-07-26T08:30:34.711771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:59:14.479632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.474960+0000","last_change":"2024-07-26T08:27:29.240671+0000","last_active":"2024-07-26T08:29:42.474960+0000","last_peered":"2024-07-26T08:29:42.474960+0000","last_clean":"2024-07-26T08:29:42.474960+0000","last_became_active":"2024-07-26T08:27:29.240211+0000","last_became_peered":"2024-07-26T08:27:29.240211+0000","last_unstale":"2024-07-26T08:29:42.474960+0000","last_undegraded":"2024-07-26T08:29:42.474960+0000","last_fullsized":"2024-07-26T08:29:42.474960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:02:20.093002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451300+0000","last_change":"2024-07-26T08:27:48.378198+0000","last_active":"2024-07-26T08:30:04.451300+0000","last_peered":"2024-07-26T08:30:04.451300+0000","last_clean":"2024-07-26T08:30:04.451300+0000","last_became_active":"2024-07-26T08:27:48.377694+0000","last_became_peered":"2024-07-26T08:27:48.377694+0000","last_unstale":"2024-07-26T08:30:04.451300+0000","last_undegraded":"2024-07-26T08:30:04.451300+0000","last_fullsized":"2024-07-26T08:30:04.451300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:04:08.674083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.693989+0000","last_change":"2024-07-26T08:27:34.320768+0000","last_active":"2024-07-26T08:30:34.693989+0000","last_peered":"2024-07-26T08:30:34.693989+0000","last_clean":"2024-07-26T08:30:34.693989+0000","last_became_active":"2024-07-26T08:27:34.320377+0000","last_became_peered":"2024-07-26T08:27:34.320377+0000","last_unstale":"2024-07-26T08:30:34.693989+0000","last_undegraded":"2024-07-26T08:30:34.693989+0000","last_fullsized":"2024-07-26T08:30:34.693989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:35:16.688436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:42.193270+0000","last_change":"2024-07-26T08:27:29.241614+0000","last_active":"2024-07-26T08:29:42.193270+0000","last_peered":"2024-07-26T08:29:42.193270+0000","last_clean":"2024-07-26T08:29:42.193270+0000","last_became_active":"2024-07-26T08:27:29.240861+0000","last_became_peered":"2024-07-26T08:27:29.240861+0000","last_unstale":"2024-07-26T08:29:42.193270+0000","last_undegraded":"2024-07-26T08:29:42.193270+0000","last_fullsized":"2024-07-26T08:29:42.193270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:04:51.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:03.939556+0000","last_change":"2024-07-26T08:27:48.400276+0000","last_active":"2024-07-26T08:30:03.939556+0000","last_peered":"2024-07-26T08:30:03.939556+0000","last_clean":"2024-07-26T08:30:03.939556+0000","last_became_active":"2024-07-26T08:27:48.399710+0000","last_became_peered":"2024-07-26T08:27:48.399710+0000","last_unstale":"2024-07-26T08:30:03.939556+0000","last_undegraded":"2024-07-26T08:30:03.939556+0000","last_fullsized":"2024-07-26T08:30:03.939556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:04:24.786372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.664801+0000","last_change":"2024-07-26T08:27:34.298055+0000","last_active":"2024-07-26T08:30:34.664801+0000","last_peered":"2024-07-26T08:30:34.664801+0000","last_clean":"2024-07-26T08:30:34.664801+0000","last_became_active":"2024-07-26T08:27:34.296282+0000","last_became_peered":"2024-07-26T08:27:34.296282+0000","last_unstale":"2024-07-26T08:30:34.664801+0000","last_undegraded":"2024-07-26T08:30:34.664801+0000","last_fullsized":"2024-07-26T08:30:34.664801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:51:47.168193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:40.055440+0000","last_change":"2024-07-26T08:28:35.792716+0000","last_active":"2024-07-26T08:29:40.055440+0000","last_peered":"2024-07-26T08:29:40.055440+0000","last_clean":"2024-07-26T08:29:40.055440+0000","last_became_active":"2024-07-26T08:28:35.792163+0000","last_became_peered":"2024-07-26T08:28:35.792163+0000","last_unstale":"2024-07-26T08:29:40.055440+0000","last_undegraded":"2024-07-26T08:29:40.055440+0000","last_fullsized":"2024-07-26T08:29:40.055440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:42:43.629130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:04.451352+0000","last_change":"2024-07-26T08:27:48.559971+0000","last_active":"2024-07-26T08:30:04.451352+0000","last_peered":"2024-07-26T08:30:04.451352+0000","last_clean":"2024-07-26T08:30:04.451352+0000","last_became_active":"2024-07-26T08:27:48.559372+0000","last_became_peered":"2024-07-26T08:27:48.559372+0000","last_unstale":"2024-07-26T08:30:04.451352+0000","last_undegraded":"2024-07-26T08:30:04.451352+0000","last_fullsized":"2024-07-26T08:30:04.451352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:55:29.379146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.710072+0000","last_change":"2024-07-26T08:27:34.319647+0000","last_active":"2024-07-26T08:30:34.710072+0000","last_peered":"2024-07-26T08:30:34.710072+0000","last_clean":"2024-07-26T08:30:34.710072+0000","last_became_active":"2024-07-26T08:27:34.318831+0000","last_became_peered":"2024-07-26T08:27:34.318831+0000","last_unstale":"2024-07-26T08:30:34.710072+0000","last_undegraded":"2024-07-26T08:30:34.710072+0000","last_fullsized":"2024-07-26T08:30:34.710072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:18.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:39.447878+0000","last_change":"2024-07-26T08:27:29.413531+0000","last_active":"2024-07-26T08:29:39.447878+0000","last_peered":"2024-07-26T08:29:39.447878+0000","last_clean":"2024-07-26T08:29:39.447878+0000","last_became_active":"2024-07-26T08:27:29.413105+0000","last_became_peered":"2024-07-26T08:27:29.413105+0000","last_unstale":"2024-07-26T08:29:39.447878+0000","last_undegraded":"2024-07-26T08:29:39.447878+0000","last_fullsized":"2024-07-26T08:29:39.447878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:56:42.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.476303+0000","last_change":"2024-07-26T08:27:48.380699+0000","last_active":"2024-07-26T08:29:52.476303+0000","last_peered":"2024-07-26T08:29:52.476303+0000","last_clean":"2024-07-26T08:29:52.476303+0000","last_became_active":"2024-07-26T08:27:48.380212+0000","last_became_peered":"2024-07-26T08:27:48.380212+0000","last_unstale":"2024-07-26T08:29:52.476303+0000","last_undegraded":"2024-07-26T08:29:52.476303+0000","last_fullsized":"2024-07-26T08:29:52.476303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:39:32.380071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.704571+0000","last_change":"2024-07-26T08:27:34.304783+0000","last_active":"2024-07-26T08:30:34.704571+0000","last_peered":"2024-07-26T08:30:34.704571+0000","last_clean":"2024-07-26T08:30:34.704571+0000","last_became_active":"2024-07-26T08:27:34.304330+0000","last_became_peered":"2024-07-26T08:27:34.304330+0000","last_unstale":"2024-07-26T08:30:34.704571+0000","last_undegraded":"2024-07-26T08:30:34.704571+0000","last_fullsized":"2024-07-26T08:30:34.704571+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:38:23.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'14","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:31:48.958299+0000","last_change":"2024-07-26T08:27:29.245643+0000","last_active":"2024-07-26T08:31:48.958299+0000","last_peered":"2024-07-26T08:31:48.958299+0000","last_clean":"2024-07-26T08:31:48.958299+0000","last_became_active":"2024-07-26T08:27:29.245099+0000","last_became_peered":"2024-07-26T08:27:29.245099+0000","last_unstale":"2024-07-26T08:31:48.958299+0000","last_undegraded":"2024-07-26T08:31:48.958299+0000","last_fullsized":"2024-07-26T08:31:48.958299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:12:07.166353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.194671+0000","last_change":"2024-07-26T08:27:48.559963+0000","last_active":"2024-07-26T08:29:52.194671+0000","last_peered":"2024-07-26T08:29:52.194671+0000","last_clean":"2024-07-26T08:29:52.194671+0000","last_became_active":"2024-07-26T08:27:48.559287+0000","last_became_peered":"2024-07-26T08:27:48.559287+0000","last_unstale":"2024-07-26T08:29:52.194671+0000","last_undegraded":"2024-07-26T08:29:52.194671+0000","last_fullsized":"2024-07-26T08:29:52.194671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:36:03.042519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708597+0000","last_change":"2024-07-26T08:27:34.306910+0000","last_active":"2024-07-26T08:30:34.708597+0000","last_peered":"2024-07-26T08:30:34.708597+0000","last_clean":"2024-07-26T08:30:34.708597+0000","last_became_active":"2024-07-26T08:27:34.303002+0000","last_became_peered":"2024-07-26T08:27:34.303002+0000","last_unstale":"2024-07-26T08:30:34.708597+0000","last_undegraded":"2024-07-26T08:30:34.708597+0000","last_fullsized":"2024-07-26T08:30:34.708597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:14.918812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.916248+0000","last_change":"2024-07-26T08:27:29.357238+0000","last_active":"2024-07-26T08:29:36.916248+0000","last_peered":"2024-07-26T08:29:36.916248+0000","last_clean":"2024-07-26T08:29:36.916248+0000","last_became_active":"2024-07-26T08:27:29.356801+0000","last_became_peered":"2024-07-26T08:27:29.356801+0000","last_unstale":"2024-07-26T08:29:36.916248+0000","last_undegraded":"2024-07-26T08:29:36.916248+0000","last_fullsized":"2024-07-26T08:29:36.916248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:02:12.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:56.050676+0000","last_change":"2024-07-26T08:27:48.389395+0000","last_active":"2024-07-26T08:29:56.050676+0000","last_peered":"2024-07-26T08:29:56.050676+0000","last_clean":"2024-07-26T08:29:56.050676+0000","last_became_active":"2024-07-26T08:27:48.388797+0000","last_became_peered":"2024-07-26T08:27:48.388797+0000","last_unstale":"2024-07-26T08:29:56.050676+0000","last_undegraded":"2024-07-26T08:29:56.050676+0000","last_fullsized":"2024-07-26T08:29:56.050676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:07:53.915383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687723+0000","last_change":"2024-07-26T08:27:34.323925+0000","last_active":"2024-07-26T08:30:34.687723+0000","last_peered":"2024-07-26T08:30:34.687723+0000","last_clean":"2024-07-26T08:30:34.687723+0000","last_became_active":"2024-07-26T08:27:34.323483+0000","last_became_peered":"2024-07-26T08:27:34.323483+0000","last_unstale":"2024-07-26T08:30:34.687723+0000","last_undegraded":"2024-07-26T08:30:34.687723+0000","last_fullsized":"2024-07-26T08:30:34.687723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:42:20.198403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.370716+0000","last_change":"2024-07-26T08:28:35.798488+0000","last_active":"2024-07-26T08:29:36.370716+0000","last_peered":"2024-07-26T08:29:36.370716+0000","last_clean":"2024-07-26T08:29:36.370716+0000","last_became_active":"2024-07-26T08:28:35.797053+0000","last_became_peered":"2024-07-26T08:28:35.797053+0000","last_unstale":"2024-07-26T08:29:36.370716+0000","last_undegraded":"2024-07-26T08:29:36.370716+0000","last_fullsized":"2024-07-26T08:29:36.370716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:36:58.271550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:53.347098+0000","last_change":"2024-07-26T08:27:48.559470+0000","last_active":"2024-07-26T08:29:53.347098+0000","last_peered":"2024-07-26T08:29:53.347098+0000","last_clean":"2024-07-26T08:29:53.347098+0000","last_became_active":"2024-07-26T08:27:48.558807+0000","last_became_peered":"2024-07-26T08:27:48.558807+0000","last_unstale":"2024-07-26T08:29:53.347098+0000","last_undegraded":"2024-07-26T08:29:53.347098+0000","last_fullsized":"2024-07-26T08:29:53.347098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:01:42.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.694251+0000","last_change":"2024-07-26T08:29:37.002679+0000","last_active":"2024-07-26T08:30:34.694251+0000","last_peered":"2024-07-26T08:30:34.694251+0000","last_clean":"2024-07-26T08:30:34.694251+0000","last_became_active":"2024-07-26T08:29:37.002298+0000","last_became_peered":"2024-07-26T08:29:37.002298+0000","last_unstale":"2024-07-26T08:30:34.694251+0000","last_undegraded":"2024-07-26T08:30:34.694251+0000","last_fullsized":"2024-07-26T08:30:34.694251+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:11:55.142192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:37.697898+0000","last_change":"2024-07-26T08:27:29.240552+0000","last_active":"2024-07-26T08:29:37.697898+0000","last_peered":"2024-07-26T08:29:37.697898+0000","last_clean":"2024-07-26T08:29:37.697898+0000","last_became_active":"2024-07-26T08:27:29.237578+0000","last_became_peered":"2024-07-26T08:27:29.237578+0000","last_unstale":"2024-07-26T08:29:37.697898+0000","last_undegraded":"2024-07-26T08:29:37.697898+0000","last_fullsized":"2024-07-26T08:29:37.697898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:20:52.002299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.435078+0000","last_change":"2024-07-26T08:27:48.392552+0000","last_active":"2024-07-26T08:29:52.435078+0000","last_peered":"2024-07-26T08:29:52.435078+0000","last_clean":"2024-07-26T08:29:52.435078+0000","last_became_active":"2024-07-26T08:27:48.392059+0000","last_became_peered":"2024-07-26T08:27:48.392059+0000","last_unstale":"2024-07-26T08:29:52.435078+0000","last_undegraded":"2024-07-26T08:29:52.435078+0000","last_fullsized":"2024-07-26T08:29:52.435078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:43:58.079747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703085+0000","last_change":"2024-07-26T08:28:36.072970+0000","last_active":"2024-07-26T08:30:34.703085+0000","last_peered":"2024-07-26T08:30:34.703085+0000","last_clean":"2024-07-26T08:30:34.703085+0000","last_became_active":"2024-07-26T08:28:36.072500+0000","last_became_peered":"2024-07-26T08:28:36.072500+0000","last_unstale":"2024-07-26T08:30:34.703085+0000","last_undegraded":"2024-07-26T08:30:34.703085+0000","last_fullsized":"2024-07-26T08:30:34.703085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:17:58.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:06.175112+0000","last_change":"2024-07-26T08:27:29.362089+0000","last_active":"2024-07-26T08:33:06.175112+0000","last_peered":"2024-07-26T08:33:06.175112+0000","last_clean":"2024-07-26T08:33:06.175112+0000","last_became_active":"2024-07-26T08:27:29.360730+0000","last_became_peered":"2024-07-26T08:27:29.360730+0000","last_unstale":"2024-07-26T08:33:06.175112+0000","last_undegraded":"2024-07-26T08:33:06.175112+0000","last_fullsized":"2024-07-26T08:33:06.175112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.246645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":243,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.436230+0000","last_change":"2024-07-26T08:27:48.560119+0000","last_active":"2024-07-26T08:29:57.436230+0000","last_peered":"2024-07-26T08:29:57.436230+0000","last_clean":"2024-07-26T08:29:57.436230+0000","last_became_active":"2024-07-26T08:27:48.559366+0000","last_became_peered":"2024-07-26T08:27:48.559366+0000","last_unstale":"2024-07-26T08:29:57.436230+0000","last_undegraded":"2024-07-26T08:29:57.436230+0000","last_fullsized":"2024-07-26T08:29:57.436230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:08.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.710492+0000","last_change":"2024-07-26T08:27:34.302495+0000","last_active":"2024-07-26T08:30:34.710492+0000","last_peered":"2024-07-26T08:30:34.710492+0000","last_clean":"2024-07-26T08:30:34.710492+0000","last_became_active":"2024-07-26T08:27:34.301666+0000","last_became_peered":"2024-07-26T08:27:34.301666+0000","last_unstale":"2024-07-26T08:30:34.710492+0000","last_undegraded":"2024-07-26T08:30:34.710492+0000","last_fullsized":"2024-07-26T08:30:34.710492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:36:27.912257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.362509+0000","last_change":"2024-07-26T08:27:29.237276+0000","last_active":"2024-07-26T08:29:36.362509+0000","last_peered":"2024-07-26T08:29:36.362509+0000","last_clean":"2024-07-26T08:29:36.362509+0000","last_became_active":"2024-07-26T08:27:29.236795+0000","last_became_peered":"2024-07-26T08:27:29.236795+0000","last_unstale":"2024-07-26T08:29:36.362509+0000","last_undegraded":"2024-07-26T08:29:36.362509+0000","last_fullsized":"2024-07-26T08:29:36.362509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:43:55.707375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312159+0000","last_change":"2024-07-26T08:27:48.560179+0000","last_active":"2024-07-26T08:30:02.312159+0000","last_peered":"2024-07-26T08:30:02.312159+0000","last_clean":"2024-07-26T08:30:02.312159+0000","last_became_active":"2024-07-26T08:27:48.559245+0000","last_became_peered":"2024-07-26T08:27:48.559245+0000","last_unstale":"2024-07-26T08:30:02.312159+0000","last_undegraded":"2024-07-26T08:30:02.312159+0000","last_fullsized":"2024-07-26T08:30:02.312159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:03:04.590019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707121+0000","last_change":"2024-07-26T08:27:34.312479+0000","last_active":"2024-07-26T08:30:34.707121+0000","last_peered":"2024-07-26T08:30:34.707121+0000","last_clean":"2024-07-26T08:30:34.707121+0000","last_became_active":"2024-07-26T08:27:34.309576+0000","last_became_peered":"2024-07-26T08:27:34.309576+0000","last_unstale":"2024-07-26T08:30:34.707121+0000","last_undegraded":"2024-07-26T08:30:34.707121+0000","last_fullsized":"2024-07-26T08:30:34.707121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:18:56.847373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:36.684102+0000","last_change":"2024-07-26T08:27:29.240786+0000","last_active":"2024-07-26T08:29:36.684102+0000","last_peered":"2024-07-26T08:29:36.684102+0000","last_clean":"2024-07-26T08:29:36.684102+0000","last_became_active":"2024-07-26T08:27:29.240318+0000","last_became_peered":"2024-07-26T08:27:29.240318+0000","last_unstale":"2024-07-26T08:29:36.684102+0000","last_undegraded":"2024-07-26T08:29:36.684102+0000","last_fullsized":"2024-07-26T08:29:36.684102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:01:50.910326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:32.704792+0000","last_change":"2024-07-26T08:25:56.638807+0000","last_active":"2024-07-26T08:30:32.704792+0000","last_peered":"2024-07-26T08:30:32.704792+0000","last_clean":"2024-07-26T08:30:32.704792+0000","last_became_active":"2024-07-26T08:25:56.631901+0000","last_became_peered":"2024-07-26T08:25:56.631901+0000","last_unstale":"2024-07-26T08:30:32.704792+0000","last_undegraded":"2024-07-26T08:30:32.704792+0000","last_fullsized":"2024-07-26T08:30:32.704792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:22:03.428974+0000","last_clean_scrub_stamp":"2024-07-26T08:22:03.428974+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:33:28.086163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.699740+0000","last_change":"2024-07-26T08:28:35.880749+0000","last_active":"2024-07-26T08:29:52.699740+0000","last_peered":"2024-07-26T08:29:52.699740+0000","last_clean":"2024-07-26T08:29:52.699740+0000","last_became_active":"2024-07-26T08:28:35.880206+0000","last_became_peered":"2024-07-26T08:28:35.880206+0000","last_unstale":"2024-07-26T08:29:52.699740+0000","last_undegraded":"2024-07-26T08:29:52.699740+0000","last_fullsized":"2024-07-26T08:29:52.699740+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:29.714167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685722+0000","last_change":"2024-07-26T08:27:34.307557+0000","last_active":"2024-07-26T08:30:34.685722+0000","last_peered":"2024-07-26T08:30:34.685722+0000","last_clean":"2024-07-26T08:30:34.685722+0000","last_became_active":"2024-07-26T08:27:34.307031+0000","last_became_peered":"2024-07-26T08:27:34.307031+0000","last_unstale":"2024-07-26T08:30:34.685722+0000","last_undegraded":"2024-07-26T08:30:34.685722+0000","last_fullsized":"2024-07-26T08:30:34.685722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:04.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.475514+0000","last_change":"2024-07-26T08:27:29.413381+0000","last_active":"2024-07-26T08:29:47.475514+0000","last_peered":"2024-07-26T08:29:47.475514+0000","last_clean":"2024-07-26T08:29:47.475514+0000","last_became_active":"2024-07-26T08:27:29.412995+0000","last_became_peered":"2024-07-26T08:27:29.412995+0000","last_unstale":"2024-07-26T08:29:47.475514+0000","last_undegraded":"2024-07-26T08:29:47.475514+0000","last_fullsized":"2024-07-26T08:29:47.475514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:32:49.984028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:00.057697+0000","last_change":"2024-07-26T08:27:48.390264+0000","last_active":"2024-07-26T08:30:00.057697+0000","last_peered":"2024-07-26T08:30:00.057697+0000","last_clean":"2024-07-26T08:30:00.057697+0000","last_became_active":"2024-07-26T08:27:48.389714+0000","last_became_peered":"2024-07-26T08:27:48.389714+0000","last_unstale":"2024-07-26T08:30:00.057697+0000","last_undegraded":"2024-07-26T08:30:00.057697+0000","last_fullsized":"2024-07-26T08:30:00.057697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:22:30.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708021+0000","last_change":"2024-07-26T08:27:34.323940+0000","last_active":"2024-07-26T08:30:34.708021+0000","last_peered":"2024-07-26T08:30:34.708021+0000","last_clean":"2024-07-26T08:30:34.708021+0000","last_became_active":"2024-07-26T08:27:34.323473+0000","last_became_peered":"2024-07-26T08:27:34.323473+0000","last_unstale":"2024-07-26T08:30:34.708021+0000","last_undegraded":"2024-07-26T08:30:34.708021+0000","last_fullsized":"2024-07-26T08:30:34.708021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:03:01.425120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.310284+0000","last_change":"2024-07-26T08:27:29.242053+0000","last_active":"2024-07-26T08:29:47.310284+0000","last_peered":"2024-07-26T08:29:47.310284+0000","last_clean":"2024-07-26T08:29:47.310284+0000","last_became_active":"2024-07-26T08:27:29.241603+0000","last_became_peered":"2024-07-26T08:27:29.241603+0000","last_unstale":"2024-07-26T08:29:47.310284+0000","last_undegraded":"2024-07-26T08:29:47.310284+0000","last_fullsized":"2024-07-26T08:29:47.310284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:26:45.975414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:05.322023+0000","last_change":"2024-07-26T08:27:48.387146+0000","last_active":"2024-07-26T08:30:05.322023+0000","last_peered":"2024-07-26T08:30:05.322023+0000","last_clean":"2024-07-26T08:30:05.322023+0000","last_became_active":"2024-07-26T08:27:48.386580+0000","last_became_peered":"2024-07-26T08:27:48.386580+0000","last_unstale":"2024-07-26T08:30:05.322023+0000","last_undegraded":"2024-07-26T08:30:05.322023+0000","last_fullsized":"2024-07-26T08:30:05.322023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:01:37.058574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.680032+0000","last_change":"2024-07-26T08:27:34.310198+0000","last_active":"2024-07-26T08:30:34.680032+0000","last_peered":"2024-07-26T08:30:34.680032+0000","last_clean":"2024-07-26T08:30:34.680032+0000","last_became_active":"2024-07-26T08:27:34.309782+0000","last_became_peered":"2024-07-26T08:27:34.309782+0000","last_unstale":"2024-07-26T08:30:34.680032+0000","last_undegraded":"2024-07-26T08:30:34.680032+0000","last_fullsized":"2024-07-26T08:30:34.680032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:03:46.032394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:47.427620+0000","last_change":"2024-07-26T08:27:29.244555+0000","last_active":"2024-07-26T08:29:47.427620+0000","last_peered":"2024-07-26T08:29:47.427620+0000","last_clean":"2024-07-26T08:29:47.427620+0000","last_became_active":"2024-07-26T08:27:29.244001+0000","last_became_peered":"2024-07-26T08:27:29.244001+0000","last_unstale":"2024-07-26T08:29:47.427620+0000","last_undegraded":"2024-07-26T08:29:47.427620+0000","last_fullsized":"2024-07-26T08:29:47.427620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:40:32.565630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312070+0000","last_change":"2024-07-26T08:27:48.383863+0000","last_active":"2024-07-26T08:30:02.312070+0000","last_peered":"2024-07-26T08:30:02.312070+0000","last_clean":"2024-07-26T08:30:02.312070+0000","last_became_active":"2024-07-26T08:27:48.383391+0000","last_became_peered":"2024-07-26T08:27:48.383391+0000","last_unstale":"2024-07-26T08:30:02.312070+0000","last_undegraded":"2024-07-26T08:30:02.312070+0000","last_fullsized":"2024-07-26T08:30:02.312070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:08:36.524018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673736+0000","last_change":"2024-07-26T08:28:35.791867+0000","last_active":"2024-07-26T08:30:34.673736+0000","last_peered":"2024-07-26T08:30:34.673736+0000","last_clean":"2024-07-26T08:30:34.673736+0000","last_became_active":"2024-07-26T08:28:35.791458+0000","last_became_peered":"2024-07-26T08:28:35.791458+0000","last_unstale":"2024-07-26T08:30:34.673736+0000","last_undegraded":"2024-07-26T08:30:34.673736+0000","last_fullsized":"2024-07-26T08:30:34.673736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:56:43.329580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:43.345781+0000","last_change":"2024-07-26T08:27:29.237979+0000","last_active":"2024-07-26T08:29:43.345781+0000","last_peered":"2024-07-26T08:29:43.345781+0000","last_clean":"2024-07-26T08:29:43.345781+0000","last_became_active":"2024-07-26T08:27:29.237337+0000","last_became_peered":"2024-07-26T08:27:29.237337+0000","last_unstale":"2024-07-26T08:29:43.345781+0000","last_undegraded":"2024-07-26T08:29:43.345781+0000","last_fullsized":"2024-07-26T08:29:43.345781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:20.152505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:02.312108+0000","last_change":"2024-07-26T08:27:48.401483+0000","last_active":"2024-07-26T08:30:02.312108+0000","last_peered":"2024-07-26T08:30:02.312108+0000","last_clean":"2024-07-26T08:30:02.312108+0000","last_became_active":"2024-07-26T08:27:48.400911+0000","last_became_peered":"2024-07-26T08:27:48.400911+0000","last_unstale":"2024-07-26T08:30:02.312108+0000","last_undegraded":"2024-07-26T08:30:02.312108+0000","last_fullsized":"2024-07-26T08:30:02.312108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:17:24.754976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675937+0000","last_change":"2024-07-26T08:27:34.300124+0000","last_active":"2024-07-26T08:30:34.675937+0000","last_peered":"2024-07-26T08:30:34.675937+0000","last_clean":"2024-07-26T08:30:34.675937+0000","last_became_active":"2024-07-26T08:27:34.299664+0000","last_became_peered":"2024-07-26T08:27:34.299664+0000","last_unstale":"2024-07-26T08:30:34.675937+0000","last_undegraded":"2024-07-26T08:30:34.675937+0000","last_fullsized":"2024-07-26T08:30:34.675937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:35:47.468026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:48.346463+0000","last_change":"2024-07-26T08:27:29.354376+0000","last_active":"2024-07-26T08:29:48.346463+0000","last_peered":"2024-07-26T08:29:48.346463+0000","last_clean":"2024-07-26T08:29:48.346463+0000","last_became_active":"2024-07-26T08:27:29.353896+0000","last_became_peered":"2024-07-26T08:27:29.353896+0000","last_unstale":"2024-07-26T08:29:48.346463+0000","last_undegraded":"2024-07-26T08:29:48.346463+0000","last_fullsized":"2024-07-26T08:29:48.346463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:08:46.065178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.438875+0000","last_change":"2024-07-26T08:27:48.399903+0000","last_active":"2024-07-26T08:30:12.438875+0000","last_peered":"2024-07-26T08:30:12.438875+0000","last_clean":"2024-07-26T08:30:12.438875+0000","last_became_active":"2024-07-26T08:27:48.399452+0000","last_became_peered":"2024-07-26T08:27:48.399452+0000","last_unstale":"2024-07-26T08:30:12.438875+0000","last_undegraded":"2024-07-26T08:30:12.438875+0000","last_fullsized":"2024-07-26T08:30:12.438875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:25:13.106707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.682145+0000","last_change":"2024-07-26T08:27:34.309795+0000","last_active":"2024-07-26T08:30:34.682145+0000","last_peered":"2024-07-26T08:30:34.682145+0000","last_clean":"2024-07-26T08:30:34.682145+0000","last_became_active":"2024-07-26T08:27:34.309212+0000","last_became_peered":"2024-07-26T08:27:34.309212+0000","last_unstale":"2024-07-26T08:30:34.682145+0000","last_undegraded":"2024-07-26T08:30:34.682145+0000","last_fullsized":"2024-07-26T08:30:34.682145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:11:17.716194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:08.179913+0000","last_change":"2024-07-26T08:27:29.237416+0000","last_active":"2024-07-26T08:33:08.179913+0000","last_peered":"2024-07-26T08:33:08.179913+0000","last_clean":"2024-07-26T08:33:08.179913+0000","last_became_active":"2024-07-26T08:27:29.236849+0000","last_became_peered":"2024-07-26T08:27:29.236849+0000","last_unstale":"2024-07-26T08:33:08.179913+0000","last_undegraded":"2024-07-26T08:33:08.179913+0000","last_fullsized":"2024-07-26T08:33:08.179913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:33:04.735279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:13.941433+0000","last_change":"2024-07-26T08:27:48.397131+0000","last_active":"2024-07-26T08:30:13.941433+0000","last_peered":"2024-07-26T08:30:13.941433+0000","last_clean":"2024-07-26T08:30:13.941433+0000","last_became_active":"2024-07-26T08:27:48.396655+0000","last_became_peered":"2024-07-26T08:27:48.396655+0000","last_unstale":"2024-07-26T08:30:13.941433+0000","last_undegraded":"2024-07-26T08:30:13.941433+0000","last_fullsized":"2024-07-26T08:30:13.941433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:28:00.325986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713432+0000","last_change":"2024-07-26T08:27:34.317254+0000","last_active":"2024-07-26T08:30:34.713432+0000","last_peered":"2024-07-26T08:30:34.713432+0000","last_clean":"2024-07-26T08:30:34.713432+0000","last_became_active":"2024-07-26T08:27:34.316876+0000","last_became_peered":"2024-07-26T08:27:34.316876+0000","last_unstale":"2024-07-26T08:30:34.713432+0000","last_undegraded":"2024-07-26T08:30:34.713432+0000","last_fullsized":"2024-07-26T08:30:34.713432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:53:50.347827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.310789+0000","last_change":"2024-07-26T08:27:29.238959+0000","last_active":"2024-07-26T08:29:52.310789+0000","last_peered":"2024-07-26T08:29:52.310789+0000","last_clean":"2024-07-26T08:29:52.310789+0000","last_became_active":"2024-07-26T08:27:29.238482+0000","last_became_peered":"2024-07-26T08:27:29.238482+0000","last_unstale":"2024-07-26T08:29:52.310789+0000","last_undegraded":"2024-07-26T08:29:52.310789+0000","last_fullsized":"2024-07-26T08:29:52.310789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:50:11.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:11.052776+0000","last_change":"2024-07-26T08:28:36.073773+0000","last_active":"2024-07-26T08:30:11.052776+0000","last_peered":"2024-07-26T08:30:11.052776+0000","last_clean":"2024-07-26T08:30:11.052776+0000","last_became_active":"2024-07-26T08:28:36.072713+0000","last_became_peered":"2024-07-26T08:28:36.072713+0000","last_unstale":"2024-07-26T08:30:11.052776+0000","last_undegraded":"2024-07-26T08:30:11.052776+0000","last_fullsized":"2024-07-26T08:30:11.052776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:58:37.853764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.712667+0000","last_change":"2024-07-26T08:27:34.315232+0000","last_active":"2024-07-26T08:30:34.712667+0000","last_peered":"2024-07-26T08:30:34.712667+0000","last_clean":"2024-07-26T08:30:34.712667+0000","last_became_active":"2024-07-26T08:27:34.310099+0000","last_became_peered":"2024-07-26T08:27:34.310099+0000","last_unstale":"2024-07-26T08:30:34.712667+0000","last_undegraded":"2024-07-26T08:30:34.712667+0000","last_fullsized":"2024-07-26T08:30:34.712667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:23:41.291195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:52.476333+0000","last_change":"2024-07-26T08:27:29.241931+0000","last_active":"2024-07-26T08:29:52.476333+0000","last_peered":"2024-07-26T08:29:52.476333+0000","last_clean":"2024-07-26T08:29:52.476333+0000","last_became_active":"2024-07-26T08:27:29.240789+0000","last_became_peered":"2024-07-26T08:27:29.240789+0000","last_unstale":"2024-07-26T08:29:52.476333+0000","last_undegraded":"2024-07-26T08:29:52.476333+0000","last_fullsized":"2024-07-26T08:29:52.476333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:19:33.162501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.314280+0000","last_change":"2024-07-26T08:27:48.399643+0000","last_active":"2024-07-26T08:30:17.314280+0000","last_peered":"2024-07-26T08:30:17.314280+0000","last_clean":"2024-07-26T08:30:17.314280+0000","last_became_active":"2024-07-26T08:27:48.399175+0000","last_became_peered":"2024-07-26T08:27:48.399175+0000","last_unstale":"2024-07-26T08:30:17.314280+0000","last_undegraded":"2024-07-26T08:30:17.314280+0000","last_fullsized":"2024-07-26T08:30:17.314280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:50:17.772350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.670994+0000","last_change":"2024-07-26T08:27:34.306513+0000","last_active":"2024-07-26T08:30:34.670994+0000","last_peered":"2024-07-26T08:30:34.670994+0000","last_clean":"2024-07-26T08:30:34.670994+0000","last_became_active":"2024-07-26T08:27:34.306158+0000","last_became_peered":"2024-07-26T08:27:34.306158+0000","last_unstale":"2024-07-26T08:30:34.670994+0000","last_undegraded":"2024-07-26T08:30:34.670994+0000","last_fullsized":"2024-07-26T08:30:34.670994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:22:23.464513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":590,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:10.050111+0000","last_change":"2024-07-26T08:27:29.237536+0000","last_active":"2024-07-26T08:33:10.050111+0000","last_peered":"2024-07-26T08:33:10.050111+0000","last_clean":"2024-07-26T08:33:10.050111+0000","last_became_active":"2024-07-26T08:27:29.237127+0000","last_became_peered":"2024-07-26T08:27:29.237127+0000","last_unstale":"2024-07-26T08:33:10.050111+0000","last_undegraded":"2024-07-26T08:33:10.050111+0000","last_fullsized":"2024-07-26T08:33:10.050111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:20:27.933642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":319,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:08.940321+0000","last_change":"2024-07-26T08:27:48.385668+0000","last_active":"2024-07-26T08:30:08.940321+0000","last_peered":"2024-07-26T08:30:08.940321+0000","last_clean":"2024-07-26T08:30:08.940321+0000","last_became_active":"2024-07-26T08:27:48.385027+0000","last_became_peered":"2024-07-26T08:27:48.385027+0000","last_unstale":"2024-07-26T08:30:08.940321+0000","last_undegraded":"2024-07-26T08:30:08.940321+0000","last_fullsized":"2024-07-26T08:30:08.940321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:53:58.668047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685649+0000","last_change":"2024-07-26T08:27:34.302657+0000","last_active":"2024-07-26T08:30:34.685649+0000","last_peered":"2024-07-26T08:30:34.685649+0000","last_clean":"2024-07-26T08:30:34.685649+0000","last_became_active":"2024-07-26T08:27:34.302274+0000","last_became_peered":"2024-07-26T08:27:34.302274+0000","last_unstale":"2024-07-26T08:30:34.685649+0000","last_undegraded":"2024-07-26T08:30:34.685649+0000","last_fullsized":"2024-07-26T08:30:34.685649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:32:33.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.311525+0000","last_change":"2024-07-26T08:27:29.359984+0000","last_active":"2024-07-26T08:29:57.311525+0000","last_peered":"2024-07-26T08:29:57.311525+0000","last_clean":"2024-07-26T08:29:57.311525+0000","last_became_active":"2024-07-26T08:27:29.359506+0000","last_became_peered":"2024-07-26T08:27:29.359506+0000","last_unstale":"2024-07-26T08:29:57.311525+0000","last_undegraded":"2024-07-26T08:29:57.311525+0000","last_fullsized":"2024-07-26T08:29:57.311525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:19:23.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:09.452130+0000","last_change":"2024-07-26T08:27:48.382655+0000","last_active":"2024-07-26T08:30:09.452130+0000","last_peered":"2024-07-26T08:30:09.452130+0000","last_clean":"2024-07-26T08:30:09.452130+0000","last_became_active":"2024-07-26T08:27:48.382201+0000","last_became_peered":"2024-07-26T08:27:48.382201+0000","last_unstale":"2024-07-26T08:30:09.452130+0000","last_undegraded":"2024-07-26T08:30:09.452130+0000","last_fullsized":"2024-07-26T08:30:09.452130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:07:38.036132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697862+0000","last_change":"2024-07-26T08:27:34.326664+0000","last_active":"2024-07-26T08:30:34.697862+0000","last_peered":"2024-07-26T08:30:34.697862+0000","last_clean":"2024-07-26T08:30:34.697862+0000","last_became_active":"2024-07-26T08:27:34.325536+0000","last_became_peered":"2024-07-26T08:27:34.325536+0000","last_unstale":"2024-07-26T08:30:34.697862+0000","last_undegraded":"2024-07-26T08:30:34.697862+0000","last_fullsized":"2024-07-26T08:30:34.697862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:13:13.969718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.700486+0000","last_change":"2024-07-26T08:27:29.238395+0000","last_active":"2024-07-26T08:29:57.700486+0000","last_peered":"2024-07-26T08:29:57.700486+0000","last_clean":"2024-07-26T08:29:57.700486+0000","last_became_active":"2024-07-26T08:27:29.237652+0000","last_became_peered":"2024-07-26T08:27:29.237652+0000","last_unstale":"2024-07-26T08:29:57.700486+0000","last_undegraded":"2024-07-26T08:29:57.700486+0000","last_fullsized":"2024-07-26T08:29:57.700486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:56.013851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:08.940267+0000","last_change":"2024-07-26T08:27:48.393462+0000","last_active":"2024-07-26T08:30:08.940267+0000","last_peered":"2024-07-26T08:30:08.940267+0000","last_clean":"2024-07-26T08:30:08.940267+0000","last_became_active":"2024-07-26T08:27:48.392937+0000","last_became_peered":"2024-07-26T08:27:48.392937+0000","last_unstale":"2024-07-26T08:30:08.940267+0000","last_undegraded":"2024-07-26T08:30:08.940267+0000","last_fullsized":"2024-07-26T08:30:08.940267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:12:45.049127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.687862+0000","last_change":"2024-07-26T08:27:34.316074+0000","last_active":"2024-07-26T08:30:34.687862+0000","last_peered":"2024-07-26T08:30:34.687862+0000","last_clean":"2024-07-26T08:30:34.687862+0000","last_became_active":"2024-07-26T08:27:34.315582+0000","last_became_peered":"2024-07-26T08:27:34.315582+0000","last_unstale":"2024-07-26T08:30:34.687862+0000","last_undegraded":"2024-07-26T08:30:34.687862+0000","last_fullsized":"2024-07-26T08:30:34.687862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:45:07.724837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:09.182018+0000","last_change":"2024-07-26T08:27:29.240888+0000","last_active":"2024-07-26T08:33:09.182018+0000","last_peered":"2024-07-26T08:33:09.182018+0000","last_clean":"2024-07-26T08:33:09.182018+0000","last_became_active":"2024-07-26T08:27:29.240462+0000","last_became_peered":"2024-07-26T08:27:29.240462+0000","last_unstale":"2024-07-26T08:33:09.182018+0000","last_undegraded":"2024-07-26T08:33:09.182018+0000","last_fullsized":"2024-07-26T08:33:09.182018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:46:11.619747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":246,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:12.198247+0000","last_change":"2024-07-26T08:27:48.397856+0000","last_active":"2024-07-26T08:30:12.198247+0000","last_peered":"2024-07-26T08:30:12.198247+0000","last_clean":"2024-07-26T08:30:12.198247+0000","last_became_active":"2024-07-26T08:27:48.396303+0000","last_became_peered":"2024-07-26T08:27:48.396303+0000","last_unstale":"2024-07-26T08:30:12.198247+0000","last_undegraded":"2024-07-26T08:30:12.198247+0000","last_fullsized":"2024-07-26T08:30:12.198247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:45:29.355610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:50.319075+0000","last_change":"2024-07-26T08:27:48.390507+0000","last_active":"2024-07-26T08:29:50.319075+0000","last_peered":"2024-07-26T08:29:50.319075+0000","last_clean":"2024-07-26T08:29:50.319075+0000","last_became_active":"2024-07-26T08:27:48.389061+0000","last_became_peered":"2024-07-26T08:27:48.389061+0000","last_unstale":"2024-07-26T08:29:50.319075+0000","last_undegraded":"2024-07-26T08:29:50.319075+0000","last_fullsized":"2024-07-26T08:29:50.319075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:34:21.125679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.709671+0000","last_change":"2024-07-26T08:27:34.307222+0000","last_active":"2024-07-26T08:30:34.709671+0000","last_peered":"2024-07-26T08:30:34.709671+0000","last_clean":"2024-07-26T08:30:34.709671+0000","last_became_active":"2024-07-26T08:27:34.306843+0000","last_became_peered":"2024-07-26T08:27:34.306843+0000","last_unstale":"2024-07-26T08:30:34.709671+0000","last_undegraded":"2024-07-26T08:30:34.709671+0000","last_fullsized":"2024-07-26T08:30:34.709671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:36:29.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.311463+0000","last_change":"2024-07-26T08:27:29.236205+0000","last_active":"2024-07-26T08:29:57.311463+0000","last_peered":"2024-07-26T08:29:57.311463+0000","last_clean":"2024-07-26T08:29:57.311463+0000","last_became_active":"2024-07-26T08:27:29.235731+0000","last_became_peered":"2024-07-26T08:27:29.235731+0000","last_unstale":"2024-07-26T08:29:57.311463+0000","last_undegraded":"2024-07-26T08:29:57.311463+0000","last_fullsized":"2024-07-26T08:29:57.311463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:49:54.897337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:56.050710+0000","last_change":"2024-07-26T08:27:48.389740+0000","last_active":"2024-07-26T08:29:56.050710+0000","last_peered":"2024-07-26T08:29:56.050710+0000","last_clean":"2024-07-26T08:29:56.050710+0000","last_became_active":"2024-07-26T08:27:48.389219+0000","last_became_peered":"2024-07-26T08:27:48.389219+0000","last_unstale":"2024-07-26T08:29:56.050710+0000","last_undegraded":"2024-07-26T08:29:56.050710+0000","last_fullsized":"2024-07-26T08:29:56.050710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:57:02.623276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713505+0000","last_change":"2024-07-26T08:27:34.327716+0000","last_active":"2024-07-26T08:30:34.713505+0000","last_peered":"2024-07-26T08:30:34.713505+0000","last_clean":"2024-07-26T08:30:34.713505+0000","last_became_active":"2024-07-26T08:27:34.327205+0000","last_became_peered":"2024-07-26T08:27:34.327205+0000","last_unstale":"2024-07-26T08:30:34.713505+0000","last_undegraded":"2024-07-26T08:30:34.713505+0000","last_fullsized":"2024-07-26T08:30:34.713505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:30:32.552903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:29:57.435973+0000","last_change":"2024-07-26T08:27:29.240955+0000","last_active":"2024-07-26T08:29:57.435973+0000","last_peered":"2024-07-26T08:29:57.435973+0000","last_clean":"2024-07-26T08:29:57.435973+0000","last_became_active":"2024-07-26T08:27:29.240500+0000","last_became_peered":"2024-07-26T08:27:29.240500+0000","last_unstale":"2024-07-26T08:29:57.435973+0000","last_undegraded":"2024-07-26T08:29:57.435973+0000","last_fullsized":"2024-07-26T08:29:57.435973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:36:22.022503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:00.397718+0000","last_change":"2024-07-26T08:27:29.239798+0000","last_active":"2024-07-26T08:30:00.397718+0000","last_peered":"2024-07-26T08:30:00.397718+0000","last_clean":"2024-07-26T08:30:00.397718+0000","last_became_active":"2024-07-26T08:27:29.239358+0000","last_became_peered":"2024-07-26T08:27:29.239358+0000","last_unstale":"2024-07-26T08:30:00.397718+0000","last_undegraded":"2024-07-26T08:30:00.397718+0000","last_fullsized":"2024-07-26T08:30:00.397718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:21:29.127042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703945+0000","last_change":"2024-07-26T08:29:36.685281+0000","last_active":"2024-07-26T08:30:34.703945+0000","last_peered":"2024-07-26T08:30:34.703945+0000","last_clean":"2024-07-26T08:30:34.703945+0000","last_became_active":"2024-07-26T08:29:36.684894+0000","last_became_peered":"2024-07-26T08:29:36.684894+0000","last_unstale":"2024-07-26T08:30:34.703945+0000","last_undegraded":"2024-07-26T08:30:34.703945+0000","last_fullsized":"2024-07-26T08:30:34.703945+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:54:41.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.479043+0000","last_change":"2024-07-26T08:27:48.388724+0000","last_active":"2024-07-26T08:30:17.479043+0000","last_peered":"2024-07-26T08:30:17.479043+0000","last_clean":"2024-07-26T08:30:17.479043+0000","last_became_active":"2024-07-26T08:27:48.388239+0000","last_became_peered":"2024-07-26T08:27:48.388239+0000","last_unstale":"2024-07-26T08:30:17.479043+0000","last_undegraded":"2024-07-26T08:30:17.479043+0000","last_fullsized":"2024-07-26T08:30:17.479043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:14:17.903405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:33:06.176201+0000","last_change":"2024-07-26T08:27:29.237641+0000","last_active":"2024-07-26T08:33:06.176201+0000","last_peered":"2024-07-26T08:33:06.176201+0000","last_clean":"2024-07-26T08:33:06.176201+0000","last_became_active":"2024-07-26T08:27:29.237207+0000","last_became_peered":"2024-07-26T08:27:29.237207+0000","last_unstale":"2024-07-26T08:33:06.176201+0000","last_undegraded":"2024-07-26T08:33:06.176201+0000","last_fullsized":"2024-07-26T08:33:06.176201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:28.214005+0000","last_clean_scrub_stamp":"2024-07-26T08:27:28.214005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:00:38.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.675755+0000","last_change":"2024-07-26T08:27:34.295975+0000","last_active":"2024-07-26T08:30:34.675755+0000","last_peered":"2024-07-26T08:30:34.675755+0000","last_clean":"2024-07-26T08:30:34.675755+0000","last_became_active":"2024-07-26T08:27:34.295530+0000","last_became_peered":"2024-07-26T08:27:34.295530+0000","last_unstale":"2024-07-26T08:30:34.675755+0000","last_undegraded":"2024-07-26T08:30:34.675755+0000","last_fullsized":"2024-07-26T08:30:34.675755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:16:13.213901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:17.479066+0000","last_change":"2024-07-26T08:28:35.789763+0000","last_active":"2024-07-26T08:30:17.479066+0000","last_peered":"2024-07-26T08:30:17.479066+0000","last_clean":"2024-07-26T08:30:17.479066+0000","last_became_active":"2024-07-26T08:28:35.789302+0000","last_became_peered":"2024-07-26T08:28:35.789302+0000","last_unstale":"2024-07-26T08:30:17.479066+0000","last_undegraded":"2024-07-26T08:30:17.479066+0000","last_fullsized":"2024-07-26T08:30:17.479066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:47.348679+0000","last_clean_scrub_stamp":"2024-07-26T08:27:47.348679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:53:04.113778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,7,11],"acting":[2,8,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671670+0000","last_change":"2024-07-26T08:27:34.302695+0000","last_active":"2024-07-26T08:30:34.671670+0000","last_peered":"2024-07-26T08:30:34.671670+0000","last_clean":"2024-07-26T08:30:34.671670+0000","last_became_active":"2024-07-26T08:27:34.302332+0000","last_became_peered":"2024-07-26T08:27:34.302332+0000","last_unstale":"2024-07-26T08:30:34.671670+0000","last_undegraded":"2024-07-26T08:30:34.671670+0000","last_fullsized":"2024-07-26T08:30:34.671670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:13:43.437666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674878+0000","last_change":"2024-07-26T08:27:34.299375+0000","last_active":"2024-07-26T08:30:34.674878+0000","last_peered":"2024-07-26T08:30:34.674878+0000","last_clean":"2024-07-26T08:30:34.674878+0000","last_became_active":"2024-07-26T08:27:34.298962+0000","last_became_peered":"2024-07-26T08:27:34.298962+0000","last_unstale":"2024-07-26T08:30:34.674878+0000","last_undegraded":"2024-07-26T08:30:34.674878+0000","last_fullsized":"2024-07-26T08:30:34.674878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:02:18.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.700140+0000","last_change":"2024-07-26T08:27:34.319689+0000","last_active":"2024-07-26T08:30:34.700140+0000","last_peered":"2024-07-26T08:30:34.700140+0000","last_clean":"2024-07-26T08:30:34.700140+0000","last_became_active":"2024-07-26T08:27:34.319391+0000","last_became_peered":"2024-07-26T08:27:34.319391+0000","last_unstale":"2024-07-26T08:30:34.700140+0000","last_undegraded":"2024-07-26T08:30:34.700140+0000","last_fullsized":"2024-07-26T08:30:34.700140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:29:52.835961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.713954+0000","last_change":"2024-07-26T08:27:34.321504+0000","last_active":"2024-07-26T08:30:34.713954+0000","last_peered":"2024-07-26T08:30:34.713954+0000","last_clean":"2024-07-26T08:30:34.713954+0000","last_became_active":"2024-07-26T08:27:34.320944+0000","last_became_peered":"2024-07-26T08:27:34.320944+0000","last_unstale":"2024-07-26T08:30:34.713954+0000","last_undegraded":"2024-07-26T08:30:34.713954+0000","last_fullsized":"2024-07-26T08:30:34.713954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:09:55.500139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.711478+0000","last_change":"2024-07-26T08:27:34.321118+0000","last_active":"2024-07-26T08:30:34.711478+0000","last_peered":"2024-07-26T08:30:34.711478+0000","last_clean":"2024-07-26T08:30:34.711478+0000","last_became_active":"2024-07-26T08:27:34.319460+0000","last_became_peered":"2024-07-26T08:27:34.319460+0000","last_unstale":"2024-07-26T08:30:34.711478+0000","last_undegraded":"2024-07-26T08:30:34.711478+0000","last_fullsized":"2024-07-26T08:30:34.711478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T11:47:04.939867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673719+0000","last_change":"2024-07-26T08:29:36.916212+0000","last_active":"2024-07-26T08:30:34.673719+0000","last_peered":"2024-07-26T08:30:34.673719+0000","last_clean":"2024-07-26T08:30:34.673719+0000","last_became_active":"2024-07-26T08:29:36.915665+0000","last_became_peered":"2024-07-26T08:29:36.915665+0000","last_unstale":"2024-07-26T08:30:34.673719+0000","last_undegraded":"2024-07-26T08:30:34.673719+0000","last_fullsized":"2024-07-26T08:30:34.673719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:54:03.799258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.673854+0000","last_change":"2024-07-26T08:27:34.300781+0000","last_active":"2024-07-26T08:30:34.673854+0000","last_peered":"2024-07-26T08:30:34.673854+0000","last_clean":"2024-07-26T08:30:34.673854+0000","last_became_active":"2024-07-26T08:27:34.300437+0000","last_became_peered":"2024-07-26T08:27:34.300437+0000","last_unstale":"2024-07-26T08:30:34.673854+0000","last_undegraded":"2024-07-26T08:30:34.673854+0000","last_fullsized":"2024-07-26T08:30:34.673854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:53:24.607136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671940+0000","last_change":"2024-07-26T08:29:36.687531+0000","last_active":"2024-07-26T08:30:34.671940+0000","last_peered":"2024-07-26T08:30:34.671940+0000","last_clean":"2024-07-26T08:30:34.671940+0000","last_became_active":"2024-07-26T08:29:36.686026+0000","last_became_peered":"2024-07-26T08:29:36.686026+0000","last_unstale":"2024-07-26T08:30:34.671940+0000","last_undegraded":"2024-07-26T08:30:34.671940+0000","last_fullsized":"2024-07-26T08:30:34.671940+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:27:56.287877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.708002+0000","last_change":"2024-07-26T08:27:34.313351+0000","last_active":"2024-07-26T08:30:34.708002+0000","last_peered":"2024-07-26T08:30:34.708002+0000","last_clean":"2024-07-26T08:30:34.708002+0000","last_became_active":"2024-07-26T08:27:34.313075+0000","last_became_peered":"2024-07-26T08:27:34.313075+0000","last_unstale":"2024-07-26T08:30:34.708002+0000","last_undegraded":"2024-07-26T08:30:34.708002+0000","last_fullsized":"2024-07-26T08:30:34.708002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:55:37.497271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.705173+0000","last_change":"2024-07-26T08:27:34.308138+0000","last_active":"2024-07-26T08:30:34.705173+0000","last_peered":"2024-07-26T08:30:34.705173+0000","last_clean":"2024-07-26T08:30:34.705173+0000","last_became_active":"2024-07-26T08:27:34.305364+0000","last_became_peered":"2024-07-26T08:27:34.305364+0000","last_unstale":"2024-07-26T08:30:34.705173+0000","last_undegraded":"2024-07-26T08:30:34.705173+0000","last_fullsized":"2024-07-26T08:30:34.705173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:20:36.164081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706758+0000","last_change":"2024-07-26T08:27:34.315277+0000","last_active":"2024-07-26T08:30:34.706758+0000","last_peered":"2024-07-26T08:30:34.706758+0000","last_clean":"2024-07-26T08:30:34.706758+0000","last_became_active":"2024-07-26T08:27:34.314801+0000","last_became_peered":"2024-07-26T08:27:34.314801+0000","last_unstale":"2024-07-26T08:30:34.706758+0000","last_undegraded":"2024-07-26T08:30:34.706758+0000","last_fullsized":"2024-07-26T08:30:34.706758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:57:14.445966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.714091+0000","last_change":"2024-07-26T08:27:34.326787+0000","last_active":"2024-07-26T08:30:34.714091+0000","last_peered":"2024-07-26T08:30:34.714091+0000","last_clean":"2024-07-26T08:30:34.714091+0000","last_became_active":"2024-07-26T08:27:34.323078+0000","last_became_peered":"2024-07-26T08:27:34.323078+0000","last_unstale":"2024-07-26T08:30:34.714091+0000","last_undegraded":"2024-07-26T08:30:34.714091+0000","last_fullsized":"2024-07-26T08:30:34.714091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:32:33.049437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674941+0000","last_change":"2024-07-26T08:27:34.298214+0000","last_active":"2024-07-26T08:30:34.674941+0000","last_peered":"2024-07-26T08:30:34.674941+0000","last_clean":"2024-07-26T08:30:34.674941+0000","last_became_active":"2024-07-26T08:27:34.297816+0000","last_became_peered":"2024-07-26T08:27:34.297816+0000","last_unstale":"2024-07-26T08:30:34.674941+0000","last_undegraded":"2024-07-26T08:30:34.674941+0000","last_fullsized":"2024-07-26T08:30:34.674941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:30:32.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.707129+0000","last_change":"2024-07-26T08:27:34.302293+0000","last_active":"2024-07-26T08:30:34.707129+0000","last_peered":"2024-07-26T08:30:34.707129+0000","last_clean":"2024-07-26T08:30:34.707129+0000","last_became_active":"2024-07-26T08:27:34.301911+0000","last_became_peered":"2024-07-26T08:27:34.301911+0000","last_unstale":"2024-07-26T08:30:34.707129+0000","last_undegraded":"2024-07-26T08:30:34.707129+0000","last_fullsized":"2024-07-26T08:30:34.707129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:04:05.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688253+0000","last_change":"2024-07-26T08:27:34.310586+0000","last_active":"2024-07-26T08:30:34.688253+0000","last_peered":"2024-07-26T08:30:34.688253+0000","last_clean":"2024-07-26T08:30:34.688253+0000","last_became_active":"2024-07-26T08:27:34.304544+0000","last_became_peered":"2024-07-26T08:27:34.304544+0000","last_unstale":"2024-07-26T08:30:34.688253+0000","last_undegraded":"2024-07-26T08:30:34.688253+0000","last_fullsized":"2024-07-26T08:30:34.688253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T09:40:03.148937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702903+0000","last_change":"2024-07-26T08:27:34.325287+0000","last_active":"2024-07-26T08:30:34.702903+0000","last_peered":"2024-07-26T08:30:34.702903+0000","last_clean":"2024-07-26T08:30:34.702903+0000","last_became_active":"2024-07-26T08:27:34.324983+0000","last_became_peered":"2024-07-26T08:27:34.324983+0000","last_unstale":"2024-07-26T08:30:34.702903+0000","last_undegraded":"2024-07-26T08:30:34.702903+0000","last_fullsized":"2024-07-26T08:30:34.702903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:04:07.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703845+0000","last_change":"2024-07-26T08:27:34.321906+0000","last_active":"2024-07-26T08:30:34.703845+0000","last_peered":"2024-07-26T08:30:34.703845+0000","last_clean":"2024-07-26T08:30:34.703845+0000","last_became_active":"2024-07-26T08:27:34.321497+0000","last_became_peered":"2024-07-26T08:27:34.321497+0000","last_unstale":"2024-07-26T08:30:34.703845+0000","last_undegraded":"2024-07-26T08:30:34.703845+0000","last_fullsized":"2024-07-26T08:30:34.703845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:44:27.831210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.697407+0000","last_change":"2024-07-26T08:27:34.316262+0000","last_active":"2024-07-26T08:30:34.697407+0000","last_peered":"2024-07-26T08:30:34.697407+0000","last_clean":"2024-07-26T08:30:34.697407+0000","last_became_active":"2024-07-26T08:27:34.315883+0000","last_became_peered":"2024-07-26T08:27:34.315883+0000","last_unstale":"2024-07-26T08:30:34.697407+0000","last_undegraded":"2024-07-26T08:30:34.697407+0000","last_fullsized":"2024-07-26T08:30:34.697407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:12:36.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702516+0000","last_change":"2024-07-26T08:27:34.318311+0000","last_active":"2024-07-26T08:30:34.702516+0000","last_peered":"2024-07-26T08:30:34.702516+0000","last_clean":"2024-07-26T08:30:34.702516+0000","last_became_active":"2024-07-26T08:27:34.317863+0000","last_became_peered":"2024-07-26T08:27:34.317863+0000","last_unstale":"2024-07-26T08:30:34.702516+0000","last_undegraded":"2024-07-26T08:30:34.702516+0000","last_fullsized":"2024-07-26T08:30:34.702516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:10:45.392825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.714165+0000","last_change":"2024-07-26T08:27:34.298012+0000","last_active":"2024-07-26T08:30:34.714165+0000","last_peered":"2024-07-26T08:30:34.714165+0000","last_clean":"2024-07-26T08:30:34.714165+0000","last_became_active":"2024-07-26T08:27:34.297472+0000","last_became_peered":"2024-07-26T08:27:34.297472+0000","last_unstale":"2024-07-26T08:30:34.714165+0000","last_undegraded":"2024-07-26T08:30:34.714165+0000","last_fullsized":"2024-07-26T08:30:34.714165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:45.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.672641+0000","last_change":"2024-07-26T08:27:34.300115+0000","last_active":"2024-07-26T08:30:34.672641+0000","last_peered":"2024-07-26T08:30:34.672641+0000","last_clean":"2024-07-26T08:30:34.672641+0000","last_became_active":"2024-07-26T08:27:34.299692+0000","last_became_peered":"2024-07-26T08:27:34.299692+0000","last_unstale":"2024-07-26T08:30:34.672641+0000","last_undegraded":"2024-07-26T08:30:34.672641+0000","last_fullsized":"2024-07-26T08:30:34.672641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:38.652370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685731+0000","last_change":"2024-07-26T08:27:34.307982+0000","last_active":"2024-07-26T08:30:34.685731+0000","last_peered":"2024-07-26T08:30:34.685731+0000","last_clean":"2024-07-26T08:30:34.685731+0000","last_became_active":"2024-07-26T08:27:34.307439+0000","last_became_peered":"2024-07-26T08:27:34.307439+0000","last_unstale":"2024-07-26T08:30:34.685731+0000","last_undegraded":"2024-07-26T08:30:34.685731+0000","last_fullsized":"2024-07-26T08:30:34.685731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:18:39.855895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.671159+0000","last_change":"2024-07-26T08:27:34.300658+0000","last_active":"2024-07-26T08:30:34.671159+0000","last_peered":"2024-07-26T08:30:34.671159+0000","last_clean":"2024-07-26T08:30:34.671159+0000","last_became_active":"2024-07-26T08:27:34.300248+0000","last_became_peered":"2024-07-26T08:27:34.300248+0000","last_unstale":"2024-07-26T08:30:34.671159+0000","last_undegraded":"2024-07-26T08:30:34.671159+0000","last_fullsized":"2024-07-26T08:30:34.671159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:29:19.256273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.685314+0000","last_change":"2024-07-26T08:28:35.790936+0000","last_active":"2024-07-26T08:30:34.685314+0000","last_peered":"2024-07-26T08:30:34.685314+0000","last_clean":"2024-07-26T08:30:34.685314+0000","last_became_active":"2024-07-26T08:28:35.790509+0000","last_became_peered":"2024-07-26T08:28:35.790509+0000","last_unstale":"2024-07-26T08:30:34.685314+0000","last_undegraded":"2024-07-26T08:30:34.685314+0000","last_fullsized":"2024-07-26T08:30:34.685314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:30:13.618883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706435+0000","last_change":"2024-07-26T08:27:34.311280+0000","last_active":"2024-07-26T08:30:34.706435+0000","last_peered":"2024-07-26T08:30:34.706435+0000","last_clean":"2024-07-26T08:30:34.706435+0000","last_became_active":"2024-07-26T08:27:34.310849+0000","last_became_peered":"2024-07-26T08:27:34.310849+0000","last_unstale":"2024-07-26T08:30:34.706435+0000","last_undegraded":"2024-07-26T08:30:34.706435+0000","last_fullsized":"2024-07-26T08:30:34.706435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:22.810054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.688595+0000","last_change":"2024-07-26T08:27:34.311344+0000","last_active":"2024-07-26T08:30:34.688595+0000","last_peered":"2024-07-26T08:30:34.688595+0000","last_clean":"2024-07-26T08:30:34.688595+0000","last_became_active":"2024-07-26T08:27:34.310851+0000","last_became_peered":"2024-07-26T08:27:34.310851+0000","last_unstale":"2024-07-26T08:30:34.688595+0000","last_undegraded":"2024-07-26T08:30:34.688595+0000","last_fullsized":"2024-07-26T08:30:34.688595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:15:19.753164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.674363+0000","last_change":"2024-07-26T08:29:36.917413+0000","last_active":"2024-07-26T08:30:34.674363+0000","last_peered":"2024-07-26T08:30:34.674363+0000","last_clean":"2024-07-26T08:30:34.674363+0000","last_became_active":"2024-07-26T08:29:36.916786+0000","last_became_peered":"2024-07-26T08:29:36.916786+0000","last_unstale":"2024-07-26T08:30:34.674363+0000","last_undegraded":"2024-07-26T08:30:34.674363+0000","last_fullsized":"2024-07-26T08:30:34.674363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:17:44.644656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.706281+0000","last_change":"2024-07-26T08:27:34.315125+0000","last_active":"2024-07-26T08:30:34.706281+0000","last_peered":"2024-07-26T08:30:34.706281+0000","last_clean":"2024-07-26T08:30:34.706281+0000","last_became_active":"2024-07-26T08:27:34.314722+0000","last_became_peered":"2024-07-26T08:27:34.314722+0000","last_unstale":"2024-07-26T08:30:34.706281+0000","last_undegraded":"2024-07-26T08:30:34.706281+0000","last_fullsized":"2024-07-26T08:30:34.706281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:57:29.200137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.677278+0000","last_change":"2024-07-26T08:27:34.299153+0000","last_active":"2024-07-26T08:30:34.677278+0000","last_peered":"2024-07-26T08:30:34.677278+0000","last_clean":"2024-07-26T08:30:34.677278+0000","last_became_active":"2024-07-26T08:27:34.298679+0000","last_became_peered":"2024-07-26T08:27:34.298679+0000","last_unstale":"2024-07-26T08:30:34.677278+0000","last_undegraded":"2024-07-26T08:30:34.677278+0000","last_fullsized":"2024-07-26T08:30:34.677278+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T08:46:07.143555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.699740+0000","last_change":"2024-07-26T08:27:34.315030+0000","last_active":"2024-07-26T08:30:34.699740+0000","last_peered":"2024-07-26T08:30:34.699740+0000","last_clean":"2024-07-26T08:30:34.699740+0000","last_became_active":"2024-07-26T08:27:34.314593+0000","last_became_peered":"2024-07-26T08:27:34.314593+0000","last_unstale":"2024-07-26T08:30:34.699740+0000","last_undegraded":"2024-07-26T08:30:34.699740+0000","last_fullsized":"2024-07-26T08:30:34.699740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T10:40:17.332896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.703025+0000","last_change":"2024-07-26T08:27:34.324081+0000","last_active":"2024-07-26T08:30:34.703025+0000","last_peered":"2024-07-26T08:30:34.703025+0000","last_clean":"2024-07-26T08:30:34.703025+0000","last_became_active":"2024-07-26T08:27:34.323493+0000","last_became_peered":"2024-07-26T08:27:34.323493+0000","last_unstale":"2024-07-26T08:30:34.703025+0000","last_undegraded":"2024-07-26T08:30:34.703025+0000","last_fullsized":"2024-07-26T08:30:34.703025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:24:42.833532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-07-26T08:30:34.702814+0000","last_change":"2024-07-26T08:27:34.320802+0000","last_active":"2024-07-26T08:30:34.702814+0000","last_peered":"2024-07-26T08:30:34.702814+0000","last_clean":"2024-07-26T08:30:34.702814+0000","last_became_active":"2024-07-26T08:27:34.320404+0000","last_became_peered":"2024-07-26T08:27:34.320404+0000","last_unstale":"2024-07-26T08:30:34.702814+0000","last_undegraded":"2024-07-26T08:30:34.702814+0000","last_fullsized":"2024-07-26T08:30:34.702814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T08:27:33.255732+0000","last_clean_scrub_stamp":"2024-07-26T08:27:33.255732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:31.809930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71611,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1499,"num_read_kb":826,"num_write":178,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678100,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":535351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874329,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1194716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":535587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234086,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":534925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430315,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1131025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593839,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":530763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790070,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1126613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953597,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":535995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149824,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":530957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378760,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":600024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542286,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":598674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705810,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":532151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T08:33:10.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:33:11.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:11 smithi043 ceph-mon[32384]: from='client.25373 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:11.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:11 smithi043 ceph-mon[32384]: from='client.25379 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:11.451 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:33:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:11 smithi133 ceph-mon[37053]: from='client.25373 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:11 smithi133 ceph-mon[37053]: from='client.25379 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:11.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:11 smithi063 ceph-mon[36747]: from='client.25373 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:11.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:11 smithi063 ceph-mon[36747]: from='client.25379 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:12 smithi043 ceph-mon[32384]: pgmap v486: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-07-26T08:33:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:12 smithi043 ceph-mon[32384]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:12 smithi133 ceph-mon[37053]: pgmap v486: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-07-26T08:33:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:12 smithi133 ceph-mon[37053]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:12 smithi063 ceph-mon[36747]: pgmap v486: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-07-26T08:33:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:12 smithi063 ceph-mon[36747]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T08:33:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.022+0000 7fc43ee00640 1 -- 172.21.15.43:0/939491135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc438109650 msgr2=0x7fc43810fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.022+0000 7fc43ee00640 1 --2- 172.21.15.43:0/939491135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc438109650 0x7fc43810fe80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc430009be0 tx=0x7fc43002a6c0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.022+0000 7fc43ee00640 1 -- 172.21.15.43:0/939491135 shutdown_connections 2024-07-26T08:33:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.023+0000 7fc43ee00640 1 --2- 172.21.15.43:0/939491135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438108d00 0x7fc438109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.023+0000 7fc43ee00640 1 --2- 172.21.15.43:0/939491135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc438109650 0x7fc43810fe80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.023+0000 7fc43ee00640 1 --2- 172.21.15.43:0/939491135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4381033c0 0x7fc4381037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.023+0000 7fc43ee00640 1 -- 172.21.15.43:0/939491135 >> 172.21.15.43:0/939491135 conn(0x7fc4380fee10 msgr2=0x7fc438101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:14.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.023+0000 7fc43ee00640 1 -- 172.21.15.43:0/939491135 shutdown_connections 2024-07-26T08:33:14.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.023+0000 7fc43ee00640 1 -- 172.21.15.43:0/939491135 wait complete. 2024-07-26T08:33:14.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 Processor -- start 2024-07-26T08:33:14.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 -- start start 2024-07-26T08:33:14.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4381033c0 0x7fc438199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:14.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438108d00 0x7fc43819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:14.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 0x7fc43819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:14.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc438113430 con 0x7fc4381033c0 2024-07-26T08:33:14.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.024+0000 7fc43ee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381132b0 con 0x7fc438108d00 2024-07-26T08:33:14.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381135b0 con 0x7fc438109650 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4381033c0 0x7fc438199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 0x7fc43819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 0x7fc43819f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49402/0 (socket says 172.21.15.43:49402) 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43e400640 1 -- 172.21.15.43:0/795792805 learned_addr learned my addr 172.21.15.43:0/795792805 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43d000640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438108d00 0x7fc43819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43da00640 1 -- 172.21.15.43:0/795792805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 msgr2=0x7fc43819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43da00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 0x7fc43819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43da00640 1 -- 172.21.15.43:0/795792805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438108d00 msgr2=0x7fc43819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.025+0000 7fc43da00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438108d00 0x7fc43819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc43da00640 1 -- 172.21.15.43:0/795792805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43819fd70 con 0x7fc4381033c0 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc43d000640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438108d00 0x7fc43819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc43e400640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 0x7fc43819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc43da00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4381033c0 0x7fc438199e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00e790 tx=0x7fc42c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:14.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00eea0 con 0x7fc4381033c0 2024-07-26T08:33:14.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4381a0060 con 0x7fc4381033c0 2024-07-26T08:33:14.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc42c00ccc0 con 0x7fc4381033c0 2024-07-26T08:33:14.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0187e0 con 0x7fc4381033c0 2024-07-26T08:33:14.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.026+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4381a67c0 con 0x7fc4381033c0 2024-07-26T08:33:14.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.028+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4381037d0 con 0x7fc4381033c0 2024-07-26T08:33:14.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.030+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fc42c010430 con 0x7fc4381033c0 2024-07-26T08:33:14.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.032+0000 7fc436000640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc4200b3c20 0x7fc4200b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:14.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.032+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc42c0e4780 con 0x7fc4381033c0 2024-07-26T08:33:14.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.032+0000 7fc43d000640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc4200b3c20 0x7fc4200b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:14.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.033+0000 7fc43d000640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc4200b3c20 0x7fc4200b6130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc438105600 tx=0x7fc424005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:14.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.034+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc42c0ab260 con 0x7fc4381033c0 2024-07-26T08:33:14.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.277+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc43810b4a0 con 0x7fc4381033c0 2024-07-26T08:33:14.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.279+0000 7fc436000640 1 -- 172.21.15.43:0/795792805 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11895 (secure 0 0 0) 0x7fc42c0af7b0 con 0x7fc4381033c0 2024-07-26T08:33:14.281 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"btime":"2024-07-26T08:33:02:007771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:33:01.263024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24733,24710,24709]},"id":1}]} 2024-07-26T08:33:14.281 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 25 2024-07-26T08:33:14.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc4200b3c20 msgr2=0x7fc4200b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:14.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc4200b3c20 0x7fc4200b6130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc438105600 tx=0x7fc424005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:14.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4381033c0 msgr2=0x7fc438199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:14.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4381033c0 0x7fc438199e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00e790 tx=0x7fc42c00ec50 comp rx=0 tx=0).stop 2024-07-26T08:33:14.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 shutdown_connections 2024-07-26T08:33:14.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc4200b3c20 0x7fc4200b6130 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc438109650 0x7fc43819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438108d00 0x7fc43819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 --2- 172.21.15.43:0/795792805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4381033c0 0x7fc438199e00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:14.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 >> 172.21.15.43:0/795792805 conn(0x7fc4380fee10 msgr2=0x7fc438101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:14.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 shutdown_connections 2024-07-26T08:33:14.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:14.282+0000 7fc43ee00640 1 -- 172.21.15.43:0/795792805 wait complete. 2024-07-26T08:33:14.363 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:14 smithi043 ceph-mon[32384]: pgmap v487: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:33:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:14 smithi133 ceph-mon[37053]: pgmap v487: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:33:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:14 smithi063 ceph-mon[36747]: pgmap v487: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:33:15.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T08:33:15.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:15 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/795792805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:33:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:15 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/795792805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:33:15.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:15 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/795792805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:33:15.822 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:33:16.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:16 smithi043 ceph-mon[32384]: pgmap v488: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-07-26T08:33:16.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:16 smithi063 ceph-mon[36747]: pgmap v488: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-07-26T08:33:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:16 smithi133 ceph-mon[37053]: pgmap v488: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-07-26T08:33:18.316 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:18 smithi043 ceph-mon[32384]: pgmap v489: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 -- 172.21.15.43:0/2993702147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a01055f0 msgr2=0x7f88a0105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 --2- 172.21.15.43:0/2993702147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a01055f0 0x7f88a0105a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8890009ca0 tx=0x7f889002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 -- 172.21.15.43:0/2993702147 shutdown_connections 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 --2- 172.21.15.43:0/2993702147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a010b880 0x7f88a01120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 --2- 172.21.15.43:0/2993702147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010af30 0x7f88a010b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 --2- 172.21.15.43:0/2993702147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a01055f0 0x7f88a0105a00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 -- 172.21.15.43:0/2993702147 >> 172.21.15.43:0/2993702147 conn(0x7f88a0101060 msgr2=0x7f88a01034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 -- 172.21.15.43:0/2993702147 shutdown_connections 2024-07-26T08:33:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.420+0000 7f88a6600640 1 -- 172.21.15.43:0/2993702147 wait complete. 2024-07-26T08:33:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.422+0000 7f88a6600640 1 Processor -- start 2024-07-26T08:33:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.422+0000 7f88a6600640 1 -- start start 2024-07-26T08:33:18.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a6600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a01055f0 0x7f88a019bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 0x7f88a019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a6600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010b880 0x7f88a01a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a6600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0115680 con 0x7f88a010af30 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a6600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0115500 con 0x7f88a010b880 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a6600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0115800 con 0x7f88a01055f0 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f889fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 0x7f88a019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f889fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 0x7f88a019c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47560/0 (socket says 172.21.15.43:47560) 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f889fe00640 1 -- 172.21.15.43:0/1683293267 learned_addr learned my addr 172.21.15.43:0/1683293267 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.423+0000 7f88a5c00640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010b880 0x7f88a01a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f88a5200640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a01055f0 0x7f88a019bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f889fe00640 1 -- 172.21.15.43:0/1683293267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a01055f0 msgr2=0x7f88a019bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f889fe00640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a01055f0 0x7f88a019bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f889fe00640 1 -- 172.21.15.43:0/1683293267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010b880 msgr2=0x7f88a01a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f889fe00640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010b880 0x7f88a01a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f889fe00640 1 -- 172.21.15.43:0/1683293267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a01a1f60 con 0x7f88a010af30 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f88a5c00640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010b880 0x7f88a01a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.424+0000 7f889fe00640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 0x7f88a019c590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f888800e9f0 tx=0x7f888800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.425+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888800ccc0 con 0x7f88a010af30 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.425+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8888010900 con 0x7f88a010af30 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.425+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a01a2250 con 0x7f88a010af30 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.425+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888018900 con 0x7f88a010af30 2024-07-26T08:33:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.425+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a01a89b0 con 0x7f88a010af30 2024-07-26T08:33:18.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.426+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a0105a00 con 0x7f88a010af30 2024-07-26T08:33:18.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.429+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f8888010ab0 con 0x7f88a010af30 2024-07-26T08:33:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.430+0000 7f889d600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88840b3c20 0x7f88840b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.431+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f88880e48c0 con 0x7f88a010af30 2024-07-26T08:33:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.431+0000 7f88a5200640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88840b3c20 0x7f88840b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.432+0000 7f88a5200640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88840b3c20 0x7f88840b6130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8890005e30 tx=0x7f8890009360 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.432+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f88880ab3a0 con 0x7f88a010af30 2024-07-26T08:33:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:18 smithi133 ceph-mon[37053]: pgmap v489: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-07-26T08:33:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:18 smithi063 ceph-mon[36747]: pgmap v489: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-07-26T08:33:18.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.636+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88a019d120 con 0x7f88a010af30 2024-07-26T08:33:18.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.638+0000 7f889d600640 1 -- 172.21.15.43:0/1683293267 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25089 (secure 0 0 0) 0x7f88a019d120 con 0x7f88a010af30 2024-07-26T08:33:18.640 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:33:18.640 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":90,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:29:36.355318+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T08:33:18.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88840b3c20 msgr2=0x7f88840b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:18.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88840b3c20 0x7f88840b6130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8890005e30 tx=0x7f8890009360 comp rx=0 tx=0).stop 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 msgr2=0x7f88a019c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 0x7f88a019c590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f888800e9f0 tx=0x7f888800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 shutdown_connections 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88840b3c20 0x7f88840b6130 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88a010b880 0x7f88a01a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88a010af30 0x7f88a019c590 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 --2- 172.21.15.43:0/1683293267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a01055f0 0x7f88a019bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.641+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 >> 172.21.15.43:0/1683293267 conn(0x7f88a0101060 msgr2=0x7f88a0103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:18.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.642+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 shutdown_connections 2024-07-26T08:33:18.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:18.642+0000 7f88a6600640 1 -- 172.21.15.43:0/1683293267 wait complete. 2024-07-26T08:33:19.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:19 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1683293267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:33:19.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:19 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1683293267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:33:19.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:19 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1683293267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T08:33:19.626 DEBUG:tasks.fwd_scrub:Yielding 2024-07-26T08:33:19.682 INFO:teuthology.run_tasks:Running task exec... 2024-07-26T08:33:19.692 INFO:teuthology.task.exec:Executing custom commands... 2024-07-26T08:33:19.692 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T08:33:19.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-07-26T08:33:19.693 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-07-26T08:33:19.693 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-26T08:33:19.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-26T08:33:19.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 -- 172.21.15.43:0/1243389839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd8102240 msgr2=0x7f3bd8102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 --2- 172.21.15.43:0/1243389839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd8102240 0x7f3bd8102650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009900 tx=0x7f3bcc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 -- 172.21.15.43:0/1243389839 shutdown_connections 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 --2- 172.21.15.43:0/1243389839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd81085d0 0x7f3bd810ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 --2- 172.21.15.43:0/1243389839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 0x7f3bd8108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 --2- 172.21.15.43:0/1243389839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd8102240 0x7f3bd8102650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 -- 172.21.15.43:0/1243389839 >> 172.21.15.43:0/1243389839 conn(0x7f3bd80fdc80 msgr2=0x7f3bd81000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 -- 172.21.15.43:0/1243389839 shutdown_connections 2024-07-26T08:33:19.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.961+0000 7f3bdee00640 1 -- 172.21.15.43:0/1243389839 wait complete. 2024-07-26T08:33:19.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.962+0000 7f3bdee00640 1 Processor -- start 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.962+0000 7f3bdee00640 1 -- start start 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 0x7f3bd80fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 0x7f3bd80fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd81085d0 0x7f3bd80fec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81123d0 con 0x7f3bd8102240 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8112250 con 0x7f3bd8107c80 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8112550 con 0x7f3bd81085d0 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 0x7f3bd80fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 0x7f3bd80fe1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47576/0 (socket says 172.21.15.43:47576) 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdda00640 1 -- 172.21.15.43:0/2911069294 learned_addr learned my addr 172.21.15.43:0/2911069294 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bdd000640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 0x7f3bd80fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.963+0000 7f3bde400640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd81085d0 0x7f3bd80fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:19.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdda00640 1 -- 172.21.15.43:0/2911069294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd81085d0 msgr2=0x7f3bd80fec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdda00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd81085d0 0x7f3bd80fec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdda00640 1 -- 172.21.15.43:0/2911069294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 msgr2=0x7f3bd80fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdda00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 0x7f3bd80fe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdda00640 1 -- 172.21.15.43:0/2911069294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd81a8170 con 0x7f3bd8102240 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdd000640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 0x7f3bd80fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bdda00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 0x7f3bd80fe1b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005ab0 tx=0x7f3bcc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.964+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc03f030 con 0x7f3bd8102240 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.965+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd81a8400 con 0x7f3bd8102240 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.965+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3bcc003ac0 con 0x7f3bd8102240 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.965+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc035070 con 0x7f3bd8102240 2024-07-26T08:33:19.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.965+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd81a8940 con 0x7f3bd8102240 2024-07-26T08:33:19.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.966+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd81034b0 con 0x7f3bd8102240 2024-07-26T08:33:19.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.968+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f3bcc042030 con 0x7f3bd8102240 2024-07-26T08:33:19.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.970+0000 7f3bd6000640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3bc00b3cd0 0x7f3bc00b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:19.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.970+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3bcc1043f0 con 0x7f3bd8102240 2024-07-26T08:33:19.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.971+0000 7f3bdd000640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3bc00b3cd0 0x7f3bc00b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:19.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.972+0000 7f3bdd000640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3bc00b3cd0 0x7f3bc00b61e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3bd81084a0 tx=0x7f3bc4005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:19.975+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3bcc0caed0 con 0x7f3bd8102240 2024-07-26T08:33:20.203 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:33:20.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.242+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3bd8063230 con 0x7f3bc00b3cd0 2024-07-26T08:33:20.415 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:20 smithi043 ceph-mon[32384]: pgmap v490: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:20 smithi133 ceph-mon[37053]: pgmap v490: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:20.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.547+0000 7f3bd6000640 1 -- 172.21.15.43:0/2911069294 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3bd8063230 con 0x7f3bc00b3cd0 2024-07-26T08:33:20.549 INFO:teuthology.orchestra.run.smithi043.stdout:Schedule set for path / 2024-07-26T08:33:20.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3bc00b3cd0 msgr2=0x7f3bc00b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:20.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3bc00b3cd0 0x7f3bc00b61e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3bd81084a0 tx=0x7f3bc4005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:20.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 msgr2=0x7f3bd80fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:20.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 0x7f3bd80fe1b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005ab0 tx=0x7f3bcc0040c0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 shutdown_connections 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3bc00b3cd0 0x7f3bc00b61e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bd81085d0 0x7f3bd80fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3bd8107c80 0x7f3bd80fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 --2- 172.21.15.43:0/2911069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8102240 0x7f3bd80fe1b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 >> 172.21.15.43:0/2911069294 conn(0x7f3bd80fdc80 msgr2=0x7f3bd806b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 shutdown_connections 2024-07-26T08:33:20.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.551+0000 7f3bdee00640 1 -- 172.21.15.43:0/2911069294 wait complete. 2024-07-26T08:33:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:20 smithi063 ceph-mon[36747]: pgmap v490: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:20.585 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 -- 172.21.15.43:0/2040374178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 msgr2=0x7fc930108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 --2- 172.21.15.43:0/2040374178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc930108120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc918009900 tx=0x7fc91802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 -- 172.21.15.43:0/2040374178 shutdown_connections 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 --2- 172.21.15.43:0/2040374178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc930108120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 --2- 172.21.15.43:0/2040374178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 0x7fc93010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 --2- 172.21.15.43:0/2040374178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 0x7fc9301027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.843+0000 7fc937400640 1 -- 172.21.15.43:0/2040374178 >> 172.21.15.43:0/2040374178 conn(0x7fc93007a170 msgr2=0x7fc93007a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.844+0000 7fc937400640 1 -- 172.21.15.43:0/2040374178 shutdown_connections 2024-07-26T08:33:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.844+0000 7fc937400640 1 -- 172.21.15.43:0/2040374178 wait complete. 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.845+0000 7fc937400640 1 Processor -- start 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 -- start start 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 0x7fc93010f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc93010feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 0x7fc9301103f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc930113560 con 0x7fc930108660 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301133e0 con 0x7fc9301023e0 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.846+0000 7fc937400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301136e0 con 0x7fc930107d10 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc935400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 0x7fc9301103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc927e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc93010feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc934a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 0x7fc93010f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc927e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc93010feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41922/0 (socket says 172.21.15.43:41922) 2024-07-26T08:33:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc935400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 0x7fc9301103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47610/0 (socket says 172.21.15.43:47610) 2024-07-26T08:33:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc927e00640 1 -- 172.21.15.43:0/1310100005 learned_addr learned my addr 172.21.15.43:0/1310100005 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc934a00640 1 -- 172.21.15.43:0/1310100005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 msgr2=0x7fc93010feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc934a00640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc93010feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc934a00640 1 -- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 msgr2=0x7fc9301103f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc934a00640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 0x7fc9301103f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc934a00640 1 -- 172.21.15.43:0/1310100005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9301a81d0 con 0x7fc9301023e0 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.847+0000 7fc927e00640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc93010feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.848+0000 7fc934a00640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 0x7fc93010f970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e9f0 tx=0x7fc92000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.848+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92000ccc0 con 0x7fc9301023e0 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.848+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc920005020 con 0x7fc9301023e0 2024-07-26T08:33:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.848+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9200049c0 con 0x7fc9301023e0 2024-07-26T08:33:20.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.848+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9301a84c0 con 0x7fc9301023e0 2024-07-26T08:33:20.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.848+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9301a89c0 con 0x7fc9301023e0 2024-07-26T08:33:20.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.849+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9301027f0 con 0x7fc9301023e0 2024-07-26T08:33:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.852+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fc9200051d0 con 0x7fc9301023e0 2024-07-26T08:33:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.853+0000 7fc92e000640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9140b3cd0 0x7fc9140b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.854+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc9200e4150 con 0x7fc9301023e0 2024-07-26T08:33:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.854+0000 7fc927e00640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9140b3cd0 0x7fc9140b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.855+0000 7fc927e00640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9140b3cd0 0x7fc9140b61e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9301078a0 tx=0x7fc9180058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:20.855+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc9200ab310 con 0x7fc9301023e0 2024-07-26T08:33:21.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.094+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc930063230 con 0x7fc9140b3cd0 2024-07-26T08:33:21.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.154+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7fc9200a6ea0 con 0x7fc9301023e0 2024-07-26T08:33:21.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.270+0000 7fc92e000640 1 -- 172.21.15.43:0/1310100005 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc930063230 con 0x7fc9140b3cd0 2024-07-26T08:33:21.272 INFO:teuthology.orchestra.run.smithi043.stdout:Retention added to path / 2024-07-26T08:33:21.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.274+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9140b3cd0 msgr2=0x7fc9140b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.274+0000 7fc937400640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9140b3cd0 0x7fc9140b61e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9301078a0 tx=0x7fc9180058d0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.274+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 msgr2=0x7fc93010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.274+0000 7fc937400640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 0x7fc93010f970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e9f0 tx=0x7fc92000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 shutdown_connections 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc9140b3cd0 0x7fc9140b61e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc930107d10 0x7fc93010feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc930108660 0x7fc9301103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 --2- 172.21.15.43:0/1310100005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9301023e0 0x7fc93010f970 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 >> 172.21.15.43:0/1310100005 conn(0x7fc93007a170 msgr2=0x7fc930105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:21.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 shutdown_connections 2024-07-26T08:33:21.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.275+0000 7fc937400640 1 -- 172.21.15.43:0/1310100005 wait complete. 2024-07-26T08:33:21.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-07-26T08:33:21.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:21 smithi043 ceph-mon[32384]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:21 smithi133 ceph-mon[37053]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:21.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.561+0000 7f3f3f000640 1 -- 172.21.15.43:0/2186820567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38108c80 msgr2=0x7f3f38109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.561+0000 7f3f3f000640 1 --2- 172.21.15.43:0/2186820567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38108c80 0x7f3f38109090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009900 tx=0x7f3f2402a410 comp rx=0 tx=0).stop 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 -- 172.21.15.43:0/2186820567 shutdown_connections 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 --2- 172.21.15.43:0/2186820567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 0x7f3f3810fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 --2- 172.21.15.43:0/2186820567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38108c80 0x7f3f38109090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 --2- 172.21.15.43:0/2186820567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f38103350 0x7f3f38103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 -- 172.21.15.43:0/2186820567 >> 172.21.15.43:0/2186820567 conn(0x7f3f380fed50 msgr2=0x7f3f381011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 -- 172.21.15.43:0/2186820567 shutdown_connections 2024-07-26T08:33:21.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.562+0000 7f3f3f000640 1 -- 172.21.15.43:0/2186820567 wait complete. 2024-07-26T08:33:21.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.563+0000 7f3f3f000640 1 Processor -- start 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.563+0000 7f3f3f000640 1 -- start start 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 0x7f3f3819bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f38108c80 0x7f3f3819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 0x7f3f381a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f381133b0 con 0x7f3f38103350 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38113230 con 0x7f3f38108c80 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38113530 con 0x7f3f381095d0 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 0x7f3f3819bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 0x7f3f3819bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47638/0 (socket says 172.21.15.43:47638) 2024-07-26T08:33:21.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3dc00640 1 -- 172.21.15.43:0/3290558566 learned_addr learned my addr 172.21.15.43:0/3290558566 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3e600640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 0x7f3f381a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3d200640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f38108c80 0x7f3f3819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3e600640 1 -- 172.21.15.43:0/3290558566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f38108c80 msgr2=0x7f3f3819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3e600640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f38108c80 0x7f3f3819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3e600640 1 -- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 msgr2=0x7f3f3819bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3e600640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 0x7f3f3819bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3e600640 1 -- 172.21.15.43:0/3290558566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f381a1ee0 con 0x7f3f381095d0 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.564+0000 7f3f3dc00640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 0x7f3f3819bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.565+0000 7f3f3e600640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 0x7f3f381a17e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000ec50 tx=0x7f3f3000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.565+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30003b70 con 0x7f3f381095d0 2024-07-26T08:33:21.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.565+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f381a21d0 con 0x7f3f381095d0 2024-07-26T08:33:21.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.565+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3f30003d10 con 0x7f3f381095d0 2024-07-26T08:33:21.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.565+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f300108b0 con 0x7f3f381095d0 2024-07-26T08:33:21.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.565+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f381a8960 con 0x7f3f381095d0 2024-07-26T08:33:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:21 smithi063 ceph-mon[36747]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:21.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.567+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38103760 con 0x7f3f381095d0 2024-07-26T08:33:21.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.569+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7f3f30003fc0 con 0x7f3f381095d0 2024-07-26T08:33:21.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.570+0000 7f3f36000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3f1c0b3cb0 0x7f3f1c0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:21.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.571+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3f300e4880 con 0x7f3f381095d0 2024-07-26T08:33:21.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.571+0000 7f3f3dc00640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3f1c0b3cb0 0x7f3f1c0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:21.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.571+0000 7f3f3dc00640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3f1c0b3cb0 0x7f3f1c0b61c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f28011550 tx=0x7f3f28005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:21.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.574+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3f300ab850 con 0x7f3f381095d0 2024-07-26T08:33:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.817+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f3f3810f0b0 con 0x7f3f1c0b3cb0 2024-07-26T08:33:21.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.829+0000 7f3f36000640 1 -- 172.21.15.43:0/3290558566 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f3f3810f0b0 con 0x7f3f1c0b3cb0 2024-07-26T08:33:21.831 INFO:teuthology.orchestra.run.smithi043.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-07-26T00:00:00", "created": "2024-07-26T08:33:20", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3f1c0b3cb0 msgr2=0x7f3f1c0b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3f1c0b3cb0 0x7f3f1c0b61c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f28011550 tx=0x7f3f28005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 msgr2=0x7f3f381a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 0x7f3f381a17e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000ec50 tx=0x7f3f3000c6a0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 shutdown_connections 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3f1c0b3cb0 0x7f3f1c0b61c0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f28011550 tx=0x7f3f28005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f381095d0 0x7f3f381a17e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f38108c80 0x7f3f3819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 --2- 172.21.15.43:0/3290558566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f38103350 0x7f3f3819bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.832+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 >> 172.21.15.43:0/3290558566 conn(0x7f3f380fed50 msgr2=0x7f3f381082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:21.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.833+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 shutdown_connections 2024-07-26T08:33:21.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:21.833+0000 7f3f3f000640 1 -- 172.21.15.43:0/3290558566 wait complete. 2024-07-26T08:33:21.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-07-26T08:33:22.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 -- 172.21.15.43:0/1418659046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48103360 msgr2=0x7fde48103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 --2- 172.21.15.43:0/1418659046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48103360 0x7fde48103770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde38009900 tx=0x7fde3802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 -- 172.21.15.43:0/1418659046 shutdown_connections 2024-07-26T08:33:22.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 --2- 172.21.15.43:0/1418659046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48108c90 0x7fde481090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 --2- 172.21.15.43:0/1418659046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde481095e0 0x7fde4810fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 --2- 172.21.15.43:0/1418659046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48103360 0x7fde48103770 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 -- 172.21.15.43:0/1418659046 >> 172.21.15.43:0/1418659046 conn(0x7fde480fedc0 msgr2=0x7fde48101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 -- 172.21.15.43:0/1418659046 shutdown_connections 2024-07-26T08:33:22.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.129+0000 7fde4d000640 1 -- 172.21.15.43:0/1418659046 wait complete. 2024-07-26T08:33:22.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 Processor -- start 2024-07-26T08:33:22.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 -- start start 2024-07-26T08:33:22.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 0x7fde4819c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48108c90 0x7fde4819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde481095e0 0x7fde481a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde481133e0 con 0x7fde48108c90 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde48113260 con 0x7fde481095e0 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.131+0000 7fde4d000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fde48113560 con 0x7fde48103360 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 0x7fde4819c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde3ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48108c90 0x7fde4819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 0x7fde4819c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41948/0 (socket says 172.21.15.43:41948) 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 -- 172.21.15.43:0/2729263808 learned_addr learned my addr 172.21.15.43:0/2729263808 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47e00640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde481095e0 0x7fde481a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 -- 172.21.15.43:0/2729263808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde481095e0 msgr2=0x7fde481a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde481095e0 0x7fde481a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 -- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48108c90 msgr2=0x7fde4819c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48108c90 0x7fde4819c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 -- 172.21.15.43:0/2729263808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde481a1f30 con 0x7fde48103360 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.132+0000 7fde47400640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 0x7fde4819c000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde38005ab0 tx=0x7fde380040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.133+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3803f030 con 0x7fde48103360 2024-07-26T08:33:22.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.133+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde481a21c0 con 0x7fde48103360 2024-07-26T08:33:22.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.133+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde38003ac0 con 0x7fde48103360 2024-07-26T08:33:22.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.133+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38035070 con 0x7fde48103360 2024-07-26T08:33:22.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.133+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde481a89b0 con 0x7fde48103360 2024-07-26T08:33:22.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.134+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde481045d0 con 0x7fde48103360 2024-07-26T08:33:22.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.137+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7fde38042030 con 0x7fde48103360 2024-07-26T08:33:22.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.138+0000 7fde44c00640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde2c0b3cb0 0x7fde2c0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.139+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fde38104c20 con 0x7fde48103360 2024-07-26T08:33:22.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.139+0000 7fde3ea00640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde2c0b3cb0 0x7fde2c0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.140+0000 7fde3ea00640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde2c0b3cb0 0x7fde2c0b61c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fde481053b0 tx=0x7fde30005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.140+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fde380cb5a0 con 0x7fde48103360 2024-07-26T08:33:22.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:22 smithi043 ceph-mon[32384]: pgmap v491: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:22.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:22 smithi043 ceph-mon[32384]: from='client.25415 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:22.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:22 smithi043 ceph-mon[32384]: mgrmap e24: x(active, since 13m), standbys: z, y 2024-07-26T08:33:22.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.394+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fde4810f0c0 con 0x7fde2c0b3cb0 2024-07-26T08:33:22.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.406+0000 7fde44c00640 1 -- 172.21.15.43:0/2729263808 <== mgr.24110 v2:172.21.15.43:6800/3495158800 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fde4810f0c0 con 0x7fde2c0b3cb0 2024-07-26T08:33:22.407 INFO:teuthology.orchestra.run.smithi043.stdout:/ 1m 6m3h 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.408+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde2c0b3cb0 msgr2=0x7fde2c0b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.408+0000 7fde4d000640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde2c0b3cb0 0x7fde2c0b61c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fde481053b0 tx=0x7fde30005f90 comp rx=0 tx=0).stop 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.408+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 msgr2=0x7fde4819c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.408+0000 7fde4d000640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 0x7fde4819c000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde38005ab0 tx=0x7fde380040c0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 shutdown_connections 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde2c0b3cb0 0x7fde2c0b61c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde481095e0 0x7fde481a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde48108c90 0x7fde4819c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 --2- 172.21.15.43:0/2729263808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde48103360 0x7fde4819c000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 >> 172.21.15.43:0/2729263808 conn(0x7fde480fedc0 msgr2=0x7fde481082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 shutdown_connections 2024-07-26T08:33:22.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.409+0000 7fde4d000640 1 -- 172.21.15.43:0/2729263808 wait complete. 2024-07-26T08:33:22.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-07-26T08:33:22.515 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-07-26T08:33:22.539 INFO:teuthology.run_tasks:Running task workunit... 2024-07-26T08:33:22.561 INFO:tasks.workunit:Pulling workunits from ref e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:33:22.562 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-07-26T08:33:22.562 INFO:tasks.workunit:timeout=3h 2024-07-26T08:33:22.562 INFO:tasks.workunit:cleanup=True 2024-07-26T08:33:22.563 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-07-26T08:33:22.563 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:22 smithi133 ceph-mon[37053]: pgmap v491: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:22.563 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:22 smithi133 ceph-mon[37053]: from='client.25415 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:22.563 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:22 smithi133 ceph-mon[37053]: mgrmap e24: x(active, since 13m), standbys: z, y 2024-07-26T08:33:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:22 smithi063 ceph-mon[36747]: pgmap v491: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:22 smithi063 ceph-mon[36747]: from='client.25415 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:22 smithi063 ceph-mon[36747]: mgrmap e24: x(active, since 13m), standbys: z, y 2024-07-26T08:33:22.613 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-07-26 08:29:25.020082450 +0000 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-07-26 08:29:25.020082450 +0000 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-07-26 08:33:00.060337358 +0000 2024-07-26T08:33:22.614 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-07-26 08:29:25.020082450 +0000 2024-07-26T08:33:22.614 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-07-26T08:33:22.615 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-07-26T08:33:22.716 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T08:33:22.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 -- 172.21.15.43:0/962609272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c1035c0 msgr2=0x7faf2c1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 --2- 172.21.15.43:0/962609272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c1035c0 0x7faf2c1039d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf20009900 tx=0x7faf2002a410 comp rx=0 tx=0).stop 2024-07-26T08:33:22.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 -- 172.21.15.43:0/962609272 shutdown_connections 2024-07-26T08:33:22.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 --2- 172.21.15.43:0/962609272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf2c109850 0x7faf2c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 --2- 172.21.15.43:0/962609272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf2c108f00 0x7faf2c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 --2- 172.21.15.43:0/962609272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c1035c0 0x7faf2c1039d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 -- 172.21.15.43:0/962609272 >> 172.21.15.43:0/962609272 conn(0x7faf2c0ff010 msgr2=0x7faf2c101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 -- 172.21.15.43:0/962609272 shutdown_connections 2024-07-26T08:33:22.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.760+0000 7faf34800640 1 -- 172.21.15.43:0/962609272 wait complete. 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.761+0000 7faf34800640 1 Processor -- start 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.761+0000 7faf34800640 1 -- start start 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf34800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 0x7faf2c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf34800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf2c109850 0x7faf2c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf34800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf2c1a1ab0 0x7faf2c1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf34800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1136a0 con 0x7faf2c1a1ab0 2024-07-26T08:33:22.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf34800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c113520 con 0x7faf2c108f00 2024-07-26T08:33:22.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf34800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c113820 con 0x7faf2c109850 2024-07-26T08:33:22.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf31e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 0x7faf2c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf31400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf2c109850 0x7faf2c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf31e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 0x7faf2c19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38576/0 (socket says 172.21.15.43:38576) 2024-07-26T08:33:22.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.762+0000 7faf31e00640 1 -- 172.21.15.43:0/1157519173 learned_addr learned my addr 172.21.15.43:0/1157519173 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:22.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf32800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf2c1a1ab0 0x7faf2c1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf31e00640 1 -- 172.21.15.43:0/1157519173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf2c109850 msgr2=0x7faf2c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf31e00640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf2c109850 0x7faf2c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf31e00640 1 -- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf2c1a1ab0 msgr2=0x7faf2c1a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf31e00640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf2c1a1ab0 0x7faf2c1a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf31e00640 1 -- 172.21.15.43:0/1157519173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c1a2690 con 0x7faf2c108f00 2024-07-26T08:33:22.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.763+0000 7faf31e00640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 0x7faf2c19c330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf200314b0 tx=0x7faf20003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.764+0000 7faf26a00640 1 -- 172.21.15.43:0/1157519173 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2003f020 con 0x7faf2c108f00 2024-07-26T08:33:22.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.764+0000 7faf26a00640 1 -- 172.21.15.43:0/1157519173 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf20031bf0 con 0x7faf2c108f00 2024-07-26T08:33:22.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.764+0000 7faf26a00640 1 -- 172.21.15.43:0/1157519173 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20035070 con 0x7faf2c108f00 2024-07-26T08:33:22.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.764+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1a8c30 con 0x7faf2c108f00 2024-07-26T08:33:22.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.764+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1a8fd0 con 0x7faf2c108f00 2024-07-26T08:33:22.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 Processor -- start 2024-07-26T08:33:22.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 -- start start 2024-07-26T08:33:22.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf771dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf771e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7358670 0x55ddf771e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ddf7694be0 con 0x55ddf7379350 2024-07-26T08:33:22.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ddf76840e0 con 0x55ddf7350490 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf3b497740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ddf7688120 con 0x55ddf7358670 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.769+0000 7faf26a00640 1 -- 172.21.15.43:0/1157519173 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7faf20042020 con 0x7faf2c108f00 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf771dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf771dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47678/0 (socket says 172.21.15.43:47678) 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 -- 172.21.15.43:0/2108591425 learned_addr learned my addr 172.21.15.43:0/2108591425 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf31400640 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7358670 0x55ddf771e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf31e00640 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf771e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 -- 172.21.15.43:0/2108591425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7358670 msgr2=0x55ddf771e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7358670 0x55ddf771e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 -- 172.21.15.43:0/2108591425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 msgr2=0x55ddf771e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf771e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf32800640 1 -- 172.21.15.43:0/2108591425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf73e4930 con 0x55ddf7379350 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.770+0000 7faf31400640 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7358670 0x55ddf771e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:22.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.771+0000 7faf32800640 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf771dd80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf28009fc0 tx=0x7faf28010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcaa3c1225f5a390 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.771+0000 7faf1b000640 1 -- 172.21.15.43:0/2108591425 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28003b70 con 0x55ddf7379350 2024-07-26T08:33:22.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.772+0000 7faf1b000640 1 -- 172.21.15.43:0/2108591425 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf28003d10 con 0x55ddf7379350 2024-07-26T08:33:22.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.772+0000 7faf1b000640 1 -- 172.21.15.43:0/2108591425 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28011a40 con 0x55ddf7379350 2024-07-26T08:33:22.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.772+0000 7faf26a00640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf140b3d30 0x7faf140b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.772+0000 7faf31e00640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf140b3d30 0x7faf140b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf26a00640 1 -- 172.21.15.43:0/1157519173 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7faf20104af0 con 0x7faf2c108f00 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 -- 172.21.15.43:0/2108591425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 msgr2=0x55ddf771dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf771dd80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf28009fc0 tx=0x7faf28010860 comp rx=0 tx=0).stop 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 -- 172.21.15.43:0/2108591425 shutdown_connections 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7358670 0x55ddf771e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf771e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 --2- 172.21.15.43:0/2108591425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf771dd80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 -- 172.21.15.43:0/2108591425 >> 172.21.15.43:0/2108591425 conn(0x55ddf736d740 msgr2=0x55ddf771bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.776 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-07-26T08:33:22.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 -- 172.21.15.43:0/2108591425 shutdown_connections 2024-07-26T08:33:22.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.773+0000 7faf3b497740 1 -- 172.21.15.43:0/2108591425 wait complete. 2024-07-26T08:33:22.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.774+0000 7faf31e00640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf140b3d30 0x7faf140b6240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf200c7440 tx=0x7faf201085a0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.774+0000 7faf3b497740 1 -- start start 2024-07-26T08:33:22.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.774+0000 7faf3b497740 1 Processor -- start 2024-07-26T08:33:22.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf7732510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7358670 0x55ddf7732af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf7737b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74e7890 con 0x55ddf7358670 2024-07-26T08:33:22.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ddf7620320 con 0x55ddf7350490 2024-07-26T08:33:22.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ddf772c560 con 0x55ddf7379350 2024-07-26T08:33:22.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf3b497740 10 client.0 _ll_register_callbacks cb 0x55ddf764c000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:33:22.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf32800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf7732510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf31400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7358670 0x55ddf7732af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf32800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf7732510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38588/0 (socket says 172.21.15.43:38588) 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.775+0000 7faf32800640 1 -- 172.21.15.43:0/1665528162 learned_addr learned my addr 172.21.15.43:0/1665528162 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf7737b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 -- 172.21.15.43:0/1665528162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 msgr2=0x55ddf7737b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf7737b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 -- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7358670 msgr2=0x55ddf7732af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7358670 0x55ddf7732af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 -- 172.21.15.43:0/1665528162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf7738180 con 0x55ddf7350490 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf32800640 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf7732510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf28011740 tx=0x7faf28011640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198a8288c2d63274 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.776+0000 7faf0f400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.777+0000 7faf0f400640 1 -- 172.21.15.43:0/1665528162 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28024040 con 0x55ddf7350490 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.777+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf28003d10 con 0x55ddf7350490 2024-07-26T08:33:22.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.777+0000 7faf0f400640 1 -- 172.21.15.43:0/1665528162 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7faf28004c40 con 0x55ddf7350490 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.777+0000 7faf0f400640 1 -- 172.21.15.43:0/1665528162 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faf28030050 con 0x55ddf7350490 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.777+0000 7faf3b497740 10 client.25439 fetch_fsmap learned FSMap version 25 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.777+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ddf7740c20 con 0x55ddf7350490 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf0f400640 1 -- 172.21.15.43:0/1665528162 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf28003d10 con 0x55ddf7350490 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf0f400640 1 -- 172.21.15.43:0/1665528162 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7faf2802b420 con 0x55ddf7350490 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf3b497740 10 client.25439 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf3b497740 10 client.25439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf3b497740 20 client.25439 populate_metadata read hostname 'smithi043' 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf3b497740 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf7337cd0 0x55ddf7744040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf3b497740 4 client.25439 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:33:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.778+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddf7696b30 con 0x55ddf7337cd0 2024-07-26T08:33:22.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.779+0000 7faf31400640 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf7337cd0 0x55ddf7744040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.779+0000 7faf31400640 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf7337cd0 0x55ddf7744040 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4134ae0ace4af804 server_cookie=50638233286514cc in_seq=0 out_seq=0 2024-07-26T08:33:22.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.779+0000 7faf0f400640 10 client.25439 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:22.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf0f400640 1 -- 172.21.15.43:0/1665528162 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddf7696b30 con 0x55ddf7337cd0 2024-07-26T08:33:22.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf0f400640 10 client.25439 handle_command_reply: tid=0 2024-07-26T08:33:22.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 client.25439 shutdown 2024-07-26T08:33:22.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 msgr2=0x55ddf7732510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf7732510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf28011740 tx=0x7faf28011640 comp rx=0 tx=0).stop 2024-07-26T08:33:22.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 shutdown_connections 2024-07-26T08:33:22.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf7337cd0 0x55ddf7744040 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf7737b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7358670 0x55ddf7732af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 --2- 172.21.15.43:0/1665528162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7350490 0x55ddf7732510 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 >> 172.21.15.43:0/1665528162 conn(0x55ddf736d740 msgr2=0x55ddf7720f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.781+0000 7faf0f400640 0 client.25439 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.782+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 shutdown_connections 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.782+0000 7faf3b497740 1 -- 172.21.15.43:0/1665528162 wait complete. 2024-07-26T08:33:22.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.782+0000 7faf3b497740 20 client.25439 trim_cache size 0 max 16384 2024-07-26T08:33:22.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.801+0000 7faf3b497740 1 Processor -- start 2024-07-26T08:33:22.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.801+0000 7faf3b497740 1 -- start start 2024-07-26T08:33:22.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf3b497740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7350490 0x55ddf771f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf3b497740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf7731ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf3b497740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf77341f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf3b497740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1b1690 con 0x55ddf7379350 2024-07-26T08:33:22.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf3b497740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1aef60 con 0x55ddf7358670 2024-07-26T08:33:22.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf3b497740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1acdf0 con 0x55ddf7350490 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf31400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf7731ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf31400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf7731ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38604/0 (socket says 172.21.15.43:38604) 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf31400640 1 -- 172.21.15.43:0/2541921087 learned_addr learned my addr 172.21.15.43:0/2541921087 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.802+0000 7faf32800640 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7350490 0x55ddf771f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf32800640 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf77341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf31400640 1 -- 172.21.15.43:0/2541921087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7350490 msgr2=0x55ddf771f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf31400640 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7350490 0x55ddf771f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf31400640 1 -- 172.21.15.43:0/2541921087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 msgr2=0x55ddf77341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf31400640 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf77341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf31400640 1 -- 172.21.15.43:0/2541921087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf77333b0 con 0x55ddf7358670 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf32800640 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7350490 0x55ddf771f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.803+0000 7faf31400640 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf7731ba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000c00 tx=0x7faf1c00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0a2c22ad8a207 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.804+0000 7faf1a600640 1 -- 172.21.15.43:0/2541921087 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c003e00 con 0x55ddf7358670 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.804+0000 7faf1a600640 1 -- 172.21.15.43:0/2541921087 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf1c011910 con 0x55ddf7358670 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.804+0000 7faf1a600640 1 -- 172.21.15.43:0/2541921087 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c026970 con 0x55ddf7358670 2024-07-26T08:33:22.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 -- 172.21.15.43:0/2541921087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 msgr2=0x55ddf7731ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf7731ba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000c00 tx=0x7faf1c00b390 comp rx=0 tx=0).stop 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 -- 172.21.15.43:0/2541921087 shutdown_connections 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7379350 0x55ddf77341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf7731ba0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 --2- 172.21.15.43:0/2541921087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7350490 0x55ddf771f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.805+0000 7faf3b497740 1 -- 172.21.15.43:0/2541921087 >> 172.21.15.43:0/2541921087 conn(0x55ddf736d740 msgr2=0x55ddf77368e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.806+0000 7faf3b497740 1 -- 172.21.15.43:0/2541921087 shutdown_connections 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.806+0000 7faf3b497740 1 -- 172.21.15.43:0/2541921087 wait complete. 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.806+0000 7faf3b497740 1 -- start start 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.806+0000 7faf3b497740 1 Processor -- start 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7350490 0x55ddf771ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf771b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf77aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1ad440 con 0x55ddf7350490 2024-07-26T08:33:22.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1ae890 con 0x55ddf7358670 2024-07-26T08:33:22.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1adaf0 con 0x55ddf7379350 2024-07-26T08:33:22.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf3b497740 10 client.0 _ll_register_callbacks cb 0x7faf20108470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:33:22.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.807+0000 7faf31400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf771b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf771b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38614/0 (socket says 172.21.15.43:38614) 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 -- 172.21.15.43:0/1342876379 learned_addr learned my addr 172.21.15.43:0/1342876379 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf32800640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7350490 0x55ddf771ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf32800640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf77aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 -- 172.21.15.43:0/1342876379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 msgr2=0x55ddf77aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf77aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 -- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7350490 msgr2=0x55ddf771ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7350490 0x55ddf771ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 -- 172.21.15.43:0/1342876379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf77aabd0 con 0x55ddf7358670 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.808+0000 7faf31400640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf771b2d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005d80 tx=0x7faf1c003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8352ba2d4b684cb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:22.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf0f400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf0f400640 1 -- 172.21.15.43:0/1342876379 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c011ac0 con 0x55ddf7358670 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf0f400640 1 -- 172.21.15.43:0/1342876379 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7faf1c011c60 con 0x55ddf7358670 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf1c011910 con 0x55ddf7358670 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf0f400640 1 -- 172.21.15.43:0/1342876379 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faf1c038050 con 0x55ddf7358670 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf3b497740 10 client.25445 fetch_fsmap learned FSMap version 25 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.809+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ddf77abda0 con 0x55ddf7358670 2024-07-26T08:33:22.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf0f400640 1 -- 172.21.15.43:0/1342876379 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf1c011910 con 0x55ddf7358670 2024-07-26T08:33:22.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf0f400640 1 -- 172.21.15.43:0/1342876379 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7faf1c02d020 con 0x55ddf7358670 2024-07-26T08:33:22.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf3b497740 10 client.25445 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:33:22.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf3b497740 10 client.25445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:33:22.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf3b497740 20 client.25445 populate_metadata read hostname 'smithi043' 2024-07-26T08:33:22.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf3b497740 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf730d080 0x55ddf77ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:22.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf3b497740 4 client.25445 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-26T08:33:22.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.810+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ddf76925d0 con 0x55ddf730d080 2024-07-26T08:33:22.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.811+0000 7faf32800640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf730d080 0x55ddf77ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:22.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.811+0000 7faf32800640 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf730d080 0x55ddf77ae420 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62fbd1fb794119a server_cookie=f075f75fdfb36a8a in_seq=0 out_seq=0 2024-07-26T08:33:22.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.811+0000 7faf0f400640 10 client.25445 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:22.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.813+0000 7faf0f400640 1 -- 172.21.15.43:0/1342876379 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ddf76925d0 con 0x55ddf730d080 2024-07-26T08:33:22.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.813+0000 7faf0f400640 10 client.25445 handle_command_reply: tid=0 2024-07-26T08:33:22.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.813+0000 7faf3b497740 1 client.25445 shutdown 2024-07-26T08:33:22.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 msgr2=0x55ddf771b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf771b2d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005d80 tx=0x7faf1c003c00 comp rx=0 tx=0).stop 2024-07-26T08:33:22.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 shutdown_connections 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55ddf730d080 0x55ddf77ae420 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddf7379350 0x55ddf77aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ddf7358670 0x55ddf771b2d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 --2- 172.21.15.43:0/1342876379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ddf7350490 0x55ddf771ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 >> 172.21.15.43:0/1342876379 conn(0x55ddf736d740 msgr2=0x55ddf77368e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf0f400640 0 client.25445 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:22.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.814+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 shutdown_connections 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.815+0000 7faf3b497740 1 -- 172.21.15.43:0/1342876379 wait complete. 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.815+0000 7faf3b497740 20 client.25445 trim_cache size 0 max 16384 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stdout: "return_code": 0, 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_tag": "7ceb9661-3876-4350-8b8a-f66735c3312f", 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": "asynchronous" 2024-07-26T08:33:22.817 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf140b3d30 msgr2=0x7faf140b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf140b3d30 0x7faf140b6240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf200c7440 tx=0x7faf201085a0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 msgr2=0x7faf2c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 0x7faf2c19c330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf200314b0 tx=0x7faf20003c10 comp rx=0 tx=0).stop 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 shutdown_connections 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf140b3d30 0x7faf140b6240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf2c109850 0x7faf2c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf2c1a1ab0 0x7faf2c1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 --2- 172.21.15.43:0/1157519173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c108f00 0x7faf2c19c330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:22.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.816+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 >> 172.21.15.43:0/1157519173 conn(0x7faf2c0ff010 msgr2=0x7faf2c10e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:22.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.817+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 shutdown_connections 2024-07-26T08:33:22.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:22.817+0000 7faf34800640 1 -- 172.21.15.43:0/1157519173 wait complete. 2024-07-26T08:33:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:23 smithi043 ceph-mon[32384]: from='client.25450 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:23 smithi043 ceph-mon[32384]: from='client.25456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:23.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:23 smithi133 ceph-mon[37053]: from='client.25450 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:23 smithi133 ceph-mon[37053]: from='client.25456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:23 smithi063 ceph-mon[36747]: from='client.25450 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:23 smithi063 ceph-mon[36747]: from='client.25456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T08:33:23.782 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:33:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:33:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:24 smithi043 ceph-mon[32384]: scrub queued for path: / 2024-07-26T08:33:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:24 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:33:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:24 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:33:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:24 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:33:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:24 smithi043 ceph-mon[32384]: pgmap v492: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 73 KiB/s wr, 14 op/s 2024-07-26T08:33:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:24 smithi133 ceph-mon[37053]: scrub queued for path: / 2024-07-26T08:33:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:24 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:33:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:24 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:33:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:24 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:33:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:24 smithi133 ceph-mon[37053]: pgmap v492: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 73 KiB/s wr, 14 op/s 2024-07-26T08:33:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:24 smithi063 ceph-mon[36747]: scrub queued for path: / 2024-07-26T08:33:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:24 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:33:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:24 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:33:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:24 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:33:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:24 smithi063 ceph-mon[36747]: pgmap v492: 129 pgs: 129 active+clean; 1.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 73 KiB/s wr, 14 op/s 2024-07-26T08:33:26.327 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:26 smithi043 ceph-mon[32384]: pgmap v493: 129 pgs: 129 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 174 KiB/s wr, 52 op/s 2024-07-26T08:33:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:26 smithi133 ceph-mon[37053]: pgmap v493: 129 pgs: 129 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 174 KiB/s wr, 52 op/s 2024-07-26T08:33:26.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:26 smithi063 ceph-mon[36747]: pgmap v493: 129 pgs: 129 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 174 KiB/s wr, 52 op/s 2024-07-26T08:33:26.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.652+0000 7ff718c00640 1 -- 172.21.15.43:0/2903081961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 msgr2=0x7ff714109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.652+0000 7ff718c00640 1 --2- 172.21.15.43:0/2903081961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff714109110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009900 tx=0x7ff6fc02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 -- 172.21.15.43:0/2903081961 shutdown_connections 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 --2- 172.21.15.43:0/2903081961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff714109650 0x7ff71410fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 --2- 172.21.15.43:0/2903081961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff714109110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 --2- 172.21.15.43:0/2903081961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7141033c0 0x7ff7141037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 -- 172.21.15.43:0/2903081961 >> 172.21.15.43:0/2903081961 conn(0x7ff7140fee10 msgr2=0x7ff714101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 -- 172.21.15.43:0/2903081961 shutdown_connections 2024-07-26T08:33:26.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.653+0000 7ff718c00640 1 -- 172.21.15.43:0/2903081961 wait complete. 2024-07-26T08:33:26.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.654+0000 7ff718c00640 1 Processor -- start 2024-07-26T08:33:26.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.654+0000 7ff718c00640 1 -- start start 2024-07-26T08:33:26.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.654+0000 7ff718c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7141033c0 0x7ff71419c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.654+0000 7ff718c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff71419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.654+0000 7ff718c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff714109650 0x7ff7141a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff718c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff714113430 con 0x7ff714108d00 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff718c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141132b0 con 0x7ff7141033c0 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff718c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141135b0 con 0x7ff714109650 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff70be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff71419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7141033c0 0x7ff71419c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff70be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff71419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55626/0 (socket says 172.21.15.43:55626) 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff70be00640 1 -- 172.21.15.43:0/2551930724 learned_addr learned my addr 172.21.15.43:0/2551930724 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:26.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713e00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff714109650 0x7ff7141a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713400640 1 -- 172.21.15.43:0/2551930724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff714109650 msgr2=0x7ff7141a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713400640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff714109650 0x7ff7141a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713400640 1 -- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 msgr2=0x7ff71419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713400640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff71419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.655+0000 7ff713400640 1 -- 172.21.15.43:0/2551930724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7141a1ff0 con 0x7ff7141033c0 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.656+0000 7ff70be00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff71419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:33:26.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.656+0000 7ff713400640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7141033c0 0x7ff71419c080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff70400d720 tx=0x7ff70400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:26.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.656+0000 7ff710c00640 1 -- 172.21.15.43:0/2551930724 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704017070 con 0x7ff7141033c0 2024-07-26T08:33:26.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.656+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7141a22e0 con 0x7ff7141033c0 2024-07-26T08:33:26.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.656+0000 7ff710c00640 1 -- 172.21.15.43:0/2551930724 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff70400de30 con 0x7ff7141033c0 2024-07-26T08:33:26.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.656+0000 7ff710c00640 1 -- 172.21.15.43:0/2551930724 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7040047a0 con 0x7ff7141033c0 2024-07-26T08:33:26.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.657+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7141a8a40 con 0x7ff7141033c0 2024-07-26T08:33:26.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.660+0000 7ff720dca740 1 Processor -- start 2024-07-26T08:33:26.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.660+0000 7ff720dca740 1 -- start start 2024-07-26T08:33:26.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.660+0000 7ff710c00640 1 -- 172.21.15.43:0/2551930724 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7ff7040099d0 con 0x7ff7141033c0 2024-07-26T08:33:26.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff720dca740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 0x5603afc47fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff720dca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc48510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff720dca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af882390 0x5603afc48a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff720dca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5603afbbeb90 con 0x5603af87a1b0 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff720dca740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5603afbae090 con 0x5603af8a3070 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff720dca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5603afbb20d0 con 0x5603af882390 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff713e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 0x5603afc47fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff713e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 0x5603afc47fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:53528/0 (socket says 172.21.15.43:53528) 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff713e00640 1 -- 172.21.15.43:0/3873189719 learned_addr learned my addr 172.21.15.43:0/3873189719 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff713400640 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc48510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.661+0000 7ff70be00640 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af882390 0x5603afc48a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713e00640 1 -- 172.21.15.43:0/3873189719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af882390 msgr2=0x5603afc48a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713e00640 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af882390 0x5603afc48a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713e00640 1 -- 172.21.15.43:0/3873189719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 msgr2=0x5603afc48510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713e00640 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc48510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713e00640 1 -- 172.21.15.43:0/3873189719 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603af90e650 con 0x5603af8a3070 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713400640 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc48510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff713e00640 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 0x5603afc47fd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0039f0 tx=0x7ff70c003df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25b675ebc516428e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff703e00640 1 -- 172.21.15.43:0/3873189719 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c01a470 con 0x5603af8a3070 2024-07-26T08:33:26.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff703e00640 1 -- 172.21.15.43:0/3873189719 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff70c015070 con 0x5603af8a3070 2024-07-26T08:33:26.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.662+0000 7ff703e00640 1 -- 172.21.15.43:0/3873189719 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c011940 con 0x5603af8a3070 2024-07-26T08:33:26.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.663+0000 7ff710c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6f80b3cb0 0x7ff6f80b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.663+0000 7ff713400640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6f80b3cb0 0x7ff6f80b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.663+0000 7ff710c00640 1 -- 172.21.15.43:0/2551930724 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff7040e3f30 con 0x7ff7141033c0 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 -- 172.21.15.43:0/3873189719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 msgr2=0x5603afc47fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 0x5603afc47fd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0039f0 tx=0x7ff70c003df0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 -- 172.21.15.43:0/3873189719 shutdown_connections 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af882390 0x5603afc48a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc48510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 --2- 172.21.15.43:0/3873189719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af8a3070 0x5603afc47fd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 -- 172.21.15.43:0/3873189719 >> 172.21.15.43:0/3873189719 conn(0x5603af897460 msgr2=0x5603afc45ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 -- 172.21.15.43:0/3873189719 shutdown_connections 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff713400640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6f80b3cb0 0x7ff6f80b61c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff7040e13f0 tx=0x7ff7040cd040 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:26.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.664+0000 7ff720dca740 1 -- 172.21.15.43:0/3873189719 wait complete. 2024-07-26T08:33:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.665+0000 7ff720dca740 1 -- start start 2024-07-26T08:33:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.665+0000 7ff720dca740 1 Processor -- start 2024-07-26T08:33:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc53600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc54080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5603afa11700 con 0x5603af87a1b0 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5603afb4a660 con 0x5603af882390 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5603afc567b0 con 0x5603af8a3070 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff720dca740 10 client.0 _ll_register_callbacks cb 0x5603afb5a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff70be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff70be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc53b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:53532/0 (socket says 172.21.15.43:53532) 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff70be00640 1 -- 172.21.15.43:0/1127566188 learned_addr learned my addr 172.21.15.43:0/1127566188 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff713e00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc53600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff713e00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc54080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.666+0000 7ff70be00640 1 -- 172.21.15.43:0/1127566188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 msgr2=0x5603afc54080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff70be00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc54080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff70be00640 1 -- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 msgr2=0x5603afc53600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff70be00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc53600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff70be00640 1 -- 172.21.15.43:0/1127566188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603afb61800 con 0x5603af882390 2024-07-26T08:33:26.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff713e00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc54080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:33:26.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff70be00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc53b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc006010 tx=0x7ff6fc031880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eda091365abca323 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:26.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff700c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:33:26.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff700c00640 1 -- 172.21.15.43:0/1127566188 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc035040 con 0x5603af882390 2024-07-26T08:33:26.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff700c00640 1 -- 172.21.15.43:0/1127566188 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff6fc004450 con 0x5603af882390 2024-07-26T08:33:26.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.667+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff70c015070 con 0x5603af882390 2024-07-26T08:33:26.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.668+0000 7ff700c00640 1 -- 172.21.15.43:0/1127566188 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6fc050050 con 0x5603af882390 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.668+0000 7ff720dca740 10 client.25457 fetch_fsmap learned FSMap version 25 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.668+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5603afc623e0 con 0x5603af882390 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.668+0000 7ff700c00640 1 -- 172.21.15.43:0/1127566188 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff70c015070 con 0x5603af882390 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.668+0000 7ff700c00640 1 -- 172.21.15.43:0/1127566188 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff6fc0035f0 con 0x5603af882390 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff720dca740 10 client.25457 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff720dca740 10 client.25457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff720dca740 20 client.25457 populate_metadata read hostname 'smithi043' 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff720dca740 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af8619f0 0x5603afc65920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff720dca740 4 client.25457 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603afbc0ae0 con 0x5603af8619f0 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.669+0000 7ff713e00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af8619f0 0x5603afc65920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.670+0000 7ff713e00640 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af8619f0 0x5603afc65920 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e56e3bdbbaa7ce2 server_cookie=b576edef50251d0f in_seq=0 out_seq=0 2024-07-26T08:33:26.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.670+0000 7ff700c00640 10 client.25457 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:26.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.670+0000 7ff700c00640 1 -- 172.21.15.43:0/1127566188 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603afbc0ae0 con 0x5603af8619f0 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.670+0000 7ff700c00640 10 client.25457 handle_command_reply: tid=0 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.670+0000 7ff720dca740 1 client.25457 shutdown 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 msgr2=0x5603afc53b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc53b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc006010 tx=0x7ff6fc031880 comp rx=0 tx=0).stop 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 shutdown_connections 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af8619f0 0x5603afc65920 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc54080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc53b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 --2- 172.21.15.43:0/1127566188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc53600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff700c00640 0 client.25457 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 >> 172.21.15.43:0/1127566188 conn(0x5603af897460 msgr2=0x5603afc4b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:26.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 shutdown_connections 2024-07-26T08:33:26.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 1 -- 172.21.15.43:0/1127566188 wait complete. 2024-07-26T08:33:26.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.671+0000 7ff720dca740 20 client.25457 trim_cache size 0 max 16384 2024-07-26T08:33:26.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.690+0000 7ff720dca740 1 Processor -- start 2024-07-26T08:33:26.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 -- start start 2024-07-26T08:33:26.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 0x5603afc554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc44500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af8a3070 0x5603afc49710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141b5300 con 0x5603af8a3070 2024-07-26T08:33:26.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141b2bd0 con 0x5603af882390 2024-07-26T08:33:26.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff720dca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141b0a20 con 0x5603af87a1b0 2024-07-26T08:33:26.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff713e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 0x5603afc554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff713e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 0x5603afc554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57126/0 (socket says 172.21.15.43:57126) 2024-07-26T08:33:26.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff713e00640 1 -- 172.21.15.43:0/1053830686 learned_addr learned my addr 172.21.15.43:0/1053830686 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff713e00640 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af8a3070 0x5603afc49710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.691+0000 7ff70be00640 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc44500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.692+0000 7ff713e00640 1 -- 172.21.15.43:0/1053830686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 msgr2=0x5603afc44500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.692+0000 7ff713e00640 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc44500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.692+0000 7ff713e00640 1 -- 172.21.15.43:0/1053830686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af8a3070 msgr2=0x5603afc49710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.692+0000 7ff713e00640 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af8a3070 0x5603afc49710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.692+0000 7ff713e00640 1 -- 172.21.15.43:0/1053830686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603afc548c0 con 0x5603af87a1b0 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.692+0000 7ff713e00640 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 0x5603afc554e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009fa0 tx=0x7ff70c0096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c9d6944d270cdc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.693+0000 7ff703400640 1 -- 172.21.15.43:0/1053830686 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c011a80 con 0x5603af87a1b0 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.693+0000 7ff703400640 1 -- 172.21.15.43:0/1053830686 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff70c015070 con 0x5603af87a1b0 2024-07-26T08:33:26.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.693+0000 7ff703400640 1 -- 172.21.15.43:0/1053830686 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c028420 con 0x5603af87a1b0 2024-07-26T08:33:26.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.693+0000 7ff720dca740 1 -- 172.21.15.43:0/1053830686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 msgr2=0x5603afc554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.693+0000 7ff720dca740 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 0x5603afc554e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009fa0 tx=0x7ff70c0096a0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 -- 172.21.15.43:0/1053830686 shutdown_connections 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af8a3070 0x5603afc49710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc44500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 --2- 172.21.15.43:0/1053830686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af87a1b0 0x5603afc554e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 -- 172.21.15.43:0/1053830686 >> 172.21.15.43:0/1053830686 conn(0x5603af897460 msgr2=0x5603afc49000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 -- 172.21.15.43:0/1053830686 shutdown_connections 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 -- 172.21.15.43:0/1053830686 wait complete. 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.694+0000 7ff720dca740 1 -- start start 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 Processor -- start 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc5be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc57810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141b1090 con 0x5603af87a1b0 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141b2500 con 0x5603af882390 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff7141b1760 con 0x5603af8a3070 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff720dca740 10 client.0 _ll_register_callbacks cb 0x7ff6fc031510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.695+0000 7ff713e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc5be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff713e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc5be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55674/0 (socket says 172.21.15.43:55674) 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff713e00640 1 -- 172.21.15.43:0/2608884868 learned_addr learned my addr 172.21.15.43:0/2608884868 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff713e00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc57810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 -- 172.21.15.43:0/2608884868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 msgr2=0x5603afc57810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc57810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 -- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 msgr2=0x5603afc5be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc5be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 -- 172.21.15.43:0/2608884868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603afc57d50 con 0x5603af882390 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff713e00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc5be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff70be00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc572d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc000c00 tx=0x7ff6fc003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=910f5ed5cbfb4c33 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.696+0000 7ff700c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff700c00640 1 -- 172.21.15.43:0/2608884868 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc035070 con 0x5603af882390 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff700c00640 1 -- 172.21.15.43:0/2608884868 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff6fc004250 con 0x5603af882390 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff70c015070 con 0x5603af882390 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff700c00640 1 -- 172.21.15.43:0/2608884868 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6fc062050 con 0x5603af882390 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff720dca740 10 client.25463 fetch_fsmap learned FSMap version 25 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5603afccdd50 con 0x5603af882390 2024-07-26T08:33:26.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.697+0000 7ff700c00640 1 -- 172.21.15.43:0/2608884868 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff70c015070 con 0x5603af882390 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff700c00640 1 -- 172.21.15.43:0/2608884868 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff6fc03dce0 con 0x5603af882390 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff720dca740 10 client.25463 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff720dca740 10 client.25463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff720dca740 20 client.25463 populate_metadata read hostname 'smithi043' 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff720dca740 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af836da0 0x5603afcd0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff720dca740 4 client.25463 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603afbbc580 con 0x5603af836da0 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.698+0000 7ff713e00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af836da0 0x5603afcd0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff713e00640 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af836da0 0x5603afcd0530 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ea6f9bd8e123515 server_cookie=2bdd64f178a7729a in_seq=0 out_seq=0 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff700c00640 10 client.25463 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff700c00640 1 -- 172.21.15.43:0/2608884868 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5603afbbc580 con 0x5603af836da0 2024-07-26T08:33:26.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff700c00640 10 client.25463 handle_command_reply: tid=0 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 client.25463 shutdown 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 msgr2=0x5603afc572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc572d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc000c00 tx=0x7ff6fc003820 comp rx=0 tx=0).stop 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 shutdown_connections 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5603af836da0 0x5603afcd0530 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603af8a3070 0x5603afc57810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5603af882390 0x5603afc572d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.700+0000 7ff700c00640 0 client.25463 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.699+0000 7ff720dca740 1 --2- 172.21.15.43:0/2608884868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5603af87a1b0 0x5603afc5be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.700+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 >> 172.21.15.43:0/2608884868 conn(0x5603af897460 msgr2=0x5603afc55220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.700+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 shutdown_connections 2024-07-26T08:33:26.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.700+0000 7ff720dca740 1 -- 172.21.15.43:0/2608884868 wait complete. 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.700+0000 7ff720dca740 20 client.25463 trim_cache size 0 max 16384 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: "7ceb9661-3876-4350-8b8a-f66735c3312f": { 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "7ceb9661-3876-4350-8b8a-f66735c3312f", 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:33:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:33:26.706 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:33:26.706 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6f80b3cb0 msgr2=0x7ff6f80b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6f80b3cb0 0x7ff6f80b61c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff7040e13f0 tx=0x7ff7040cd040 comp rx=0 tx=0).stop 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7141033c0 msgr2=0x7ff71419c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7141033c0 0x7ff71419c080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff70400d720 tx=0x7ff70400dbe0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 shutdown_connections 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff6f80b3cb0 0x7ff6f80b61c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff714109650 0x7ff7141a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff714108d00 0x7ff71419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 --2- 172.21.15.43:0/2551930724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7141033c0 0x7ff71419c080 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 >> 172.21.15.43:0/2551930724 conn(0x7ff7140fee10 msgr2=0x7ff7141083f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 shutdown_connections 2024-07-26T08:33:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:33:26.701+0000 7ff718c00640 1 -- 172.21.15.43:0/2551930724 wait complete. 2024-07-26T08:33:27.702 INFO:tasks.cephfs.filesystem:scrub status for tag:7ceb9661-3876-4350-8b8a-f66735c3312f - {'path': '/', 'tag': '7ceb9661-3876-4350-8b8a-f66735c3312f', 'options': 'recursive,force'} 2024-07-26T08:33:28.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:28 smithi043 ceph-mon[32384]: pgmap v494: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:28 smithi133 ceph-mon[37053]: pgmap v494: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:28.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:28 smithi063 ceph-mon[36747]: pgmap v494: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:30 smithi043 ceph-mon[32384]: pgmap v495: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:30 smithi133 ceph-mon[37053]: pgmap v495: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:30 smithi063 ceph-mon[36747]: pgmap v495: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:32 smithi043 ceph-mon[32384]: pgmap v496: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-07-26T08:33:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:32 smithi133 ceph-mon[37053]: pgmap v496: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-07-26T08:33:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:32 smithi063 ceph-mon[36747]: pgmap v496: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-07-26T08:33:34.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:34 smithi043 ceph-mon[32384]: pgmap v497: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:34 smithi133 ceph-mon[37053]: pgmap v497: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:34 smithi063 ceph-mon[36747]: pgmap v497: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-07-26T08:33:36.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:36 smithi043 ceph-mon[32384]: pgmap v498: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 103 KiB/s wr, 44 op/s 2024-07-26T08:33:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:36 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:33:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:36 smithi133 ceph-mon[37053]: pgmap v498: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 103 KiB/s wr, 44 op/s 2024-07-26T08:33:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:36 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:33:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:36 smithi063 ceph-mon[36747]: pgmap v498: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 103 KiB/s wr, 44 op/s 2024-07-26T08:33:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:36 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:33:38.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:38 smithi043 ceph-mon[32384]: pgmap v499: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-07-26T08:33:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:38 smithi133 ceph-mon[37053]: pgmap v499: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-07-26T08:33:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:38 smithi063 ceph-mon[36747]: pgmap v499: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-07-26T08:33:40.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:40 smithi043 ceph-mon[32384]: pgmap v500: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:33:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:40 smithi133 ceph-mon[37053]: pgmap v500: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:33:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:40 smithi063 ceph-mon[36747]: pgmap v500: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-07-26T08:33:41.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:33:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:33:41.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:42 smithi043 ceph-mon[32384]: pgmap v501: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:33:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:42 smithi133 ceph-mon[37053]: pgmap v501: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:33:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:42 smithi063 ceph-mon[36747]: pgmap v501: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:33:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:33:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:33:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:44 smithi043 ceph-mon[32384]: pgmap v502: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:44 smithi133 ceph-mon[37053]: pgmap v502: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:44.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:44 smithi063 ceph-mon[36747]: pgmap v502: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:46 smithi043 ceph-mon[32384]: pgmap v503: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:33:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:46 smithi133 ceph-mon[37053]: pgmap v503: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:33:46.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:46 smithi063 ceph-mon[36747]: pgmap v503: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:33:48.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:48 smithi043 ceph-mon[32384]: pgmap v504: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:48 smithi133 ceph-mon[37053]: pgmap v504: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:48 smithi063 ceph-mon[36747]: pgmap v504: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:50 smithi043 ceph-mon[32384]: pgmap v505: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:50.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:50 smithi133 ceph-mon[37053]: pgmap v505: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:50 smithi063 ceph-mon[36747]: pgmap v505: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:52 smithi043 ceph-mon[32384]: pgmap v506: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:52 smithi133 ceph-mon[37053]: pgmap v506: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:52 smithi063 ceph-mon[36747]: pgmap v506: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:33:54.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:54 smithi043 ceph-mon[32384]: pgmap v507: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:54 smithi133 ceph-mon[37053]: pgmap v507: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:54.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:54 smithi063 ceph-mon[36747]: pgmap v507: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:33:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:56 smithi133 ceph-mon[37053]: pgmap v508: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:33:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:56 smithi063 ceph-mon[36747]: pgmap v508: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:33:56.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:56 smithi043 ceph-mon[32384]: pgmap v508: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:33:57.704 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:33:58.174 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:33:58.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:33:58 smithi133 ceph-mon[37053]: pgmap v509: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:33:58.538 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:33:58 smithi043 ceph-mon[32384]: pgmap v509: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:33:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:33:58 smithi063 ceph-mon[36747]: pgmap v509: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:34:00.283 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:00 smithi043 ceph-mon[32384]: pgmap v510: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:34:00.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:00 smithi133 ceph-mon[37053]: pgmap v510: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:34:00.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:00 smithi063 ceph-mon[36747]: pgmap v510: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-07-26T08:34:00.613 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:34:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:34:00.288+0000 7fb4bf400640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:34:00.613 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:34:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:34:00.288+0000 7fb4bf400640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:34:00.613 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:34:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:34:00.288+0000 7fb4bf400640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:34:00.613 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:34:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:34:00.288+0000 7fb4bf400640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:34:00.614 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 08:34:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T08:34:00.288+0000 7fb4bf400640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T08:34:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.753+0000 7ff4cf200640 1 -- 172.21.15.43:0/3420504777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810b880 msgr2=0x7ff4c81120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.753+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3420504777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810b880 0x7ff4c81120b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009ca0 tx=0x7ff4c402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 -- 172.21.15.43:0/3420504777 shutdown_connections 2024-07-26T08:34:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3420504777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810b880 0x7ff4c81120b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3420504777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c810af30 0x7ff4c810b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3420504777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c81055f0 0x7ff4c8105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 -- 172.21.15.43:0/3420504777 >> 172.21.15.43:0/3420504777 conn(0x7ff4c8101060 msgr2=0x7ff4c81034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 -- 172.21.15.43:0/3420504777 shutdown_connections 2024-07-26T08:34:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.754+0000 7ff4cf200640 1 -- 172.21.15.43:0/3420504777 wait complete. 2024-07-26T08:34:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.755+0000 7ff4cf200640 1 Processor -- start 2024-07-26T08:34:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.755+0000 7ff4cf200640 1 -- start start 2024-07-26T08:34:00.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.756+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 0x7ff4c819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.756+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810af30 0x7ff4c819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.756+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c810b880 0x7ff4c81a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.756+0000 7ff4cf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8115660 con 0x7ff4c81055f0 2024-07-26T08:34:00.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.756+0000 7ff4cf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81154e0 con 0x7ff4c810b880 2024-07-26T08:34:00.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.756+0000 7ff4cf200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81157e0 con 0x7ff4c810af30 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 0x7ff4c819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 0x7ff4c819bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56614/0 (socket says 172.21.15.43:56614) 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 -- 172.21.15.43:0/3780978786 learned_addr learned my addr 172.21.15.43:0/3780978786 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4ce800640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c810b880 0x7ff4c81a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cd400640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810af30 0x7ff4c819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 -- 172.21.15.43:0/3780978786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810af30 msgr2=0x7ff4c819c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810af30 0x7ff4c819c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 -- 172.21.15.43:0/3780978786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c810b880 msgr2=0x7ff4c81a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c810b880 0x7ff4c81a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cde00640 1 -- 172.21.15.43:0/3780978786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c81a1f00 con 0x7ff4c81055f0 2024-07-26T08:34:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.757+0000 7ff4cd400640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810af30 0x7ff4c819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.758+0000 7ff4cde00640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 0x7ff4c819bf90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d950 tx=0x7ff4bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.758+0000 7ff4c2a00640 1 -- 172.21.15.43:0/3780978786 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc017030 con 0x7ff4c81055f0 2024-07-26T08:34:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.758+0000 7ff4c2a00640 1 -- 172.21.15.43:0/3780978786 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4bc004020 con 0x7ff4c81055f0 2024-07-26T08:34:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.759+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c81a21f0 con 0x7ff4c81055f0 2024-07-26T08:34:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.759+0000 7ff4c2a00640 1 -- 172.21.15.43:0/3780978786 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0047a0 con 0x7ff4c81055f0 2024-07-26T08:34:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.759+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c81a8950 con 0x7ff4c81055f0 2024-07-26T08:34:00.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.763+0000 7ff4d73d2740 1 Processor -- start 2024-07-26T08:34:00.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 -- start start 2024-07-26T08:34:00.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bf4070 0x5634e8f99000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bcb1b0 0x5634e8f99540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8f99a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5634e8f0fbc0 con 0x5634e8bf4070 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5634e8eff0c0 con 0x5634e8bcb1b0 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.764+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5634e8f03100 con 0x5634e8bd3390 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.765+0000 7ff4cd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8f99a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.765+0000 7ff4cd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8f99a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45846/0 (socket says 172.21.15.43:45846) 2024-07-26T08:34:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.765+0000 7ff4cd400640 1 -- 172.21.15.43:0/3157984975 learned_addr learned my addr 172.21.15.43:0/3157984975 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:00.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.765+0000 7ff4ce800640 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bf4070 0x5634e8f99000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.765+0000 7ff4c2a00640 1 -- 172.21.15.43:0/3780978786 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7ff4bc009a30 con 0x7ff4c81055f0 2024-07-26T08:34:00.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4cd400640 1 -- 172.21.15.43:0/3157984975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bcb1b0 msgr2=0x5634e8f99540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:00.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4cd400640 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bcb1b0 0x5634e8f99540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4cd400640 1 -- 172.21.15.43:0/3157984975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bf4070 msgr2=0x5634e8f99000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4cd400640 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bf4070 0x5634e8f99000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4cd400640 1 -- 172.21.15.43:0/3157984975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e8c5f650 con 0x5634e8bd3390 2024-07-26T08:34:00.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4ce800640 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bf4070 0x5634e8f99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:00.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.766+0000 7ff4cd400640 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8f99a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009fd0 tx=0x7ff4b80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a3a4984888fd0d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:00.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.767+0000 7ff4b7000640 1 -- 172.21.15.43:0/3157984975 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b801e070 con 0x5634e8bd3390 2024-07-26T08:34:00.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.767+0000 7ff4b7000640 1 -- 172.21.15.43:0/3157984975 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4b800fa10 con 0x5634e8bd3390 2024-07-26T08:34:00.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.767+0000 7ff4b7000640 1 -- 172.21.15.43:0/3157984975 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8019b20 con 0x5634e8bd3390 2024-07-26T08:34:00.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.768+0000 7ff4c2a00640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4b00b3d30 0x7ff4b00b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.768+0000 7ff4c2a00640 1 -- 172.21.15.43:0/3780978786 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff4bc0e3ae0 con 0x7ff4c81055f0 2024-07-26T08:34:00.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.768+0000 7ff4d73d2740 1 -- 172.21.15.43:0/3157984975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 msgr2=0x5634e8f99a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.768+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8f99a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009fd0 tx=0x7ff4b80118d0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.768+0000 7ff4ce800640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4b00b3d30 0x7ff4b00b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.769+0000 7ff4d73d2740 1 -- 172.21.15.43:0/3157984975 shutdown_connections 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.769+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8f99a80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.769+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bcb1b0 0x5634e8f99540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.769+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/3157984975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bf4070 0x5634e8f99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.769+0000 7ff4d73d2740 1 -- 172.21.15.43:0/3157984975 >> 172.21.15.43:0/3157984975 conn(0x5634e8be8460 msgr2=0x5634e8f96ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:00.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.770+0000 7ff4d73d2740 1 -- 172.21.15.43:0/3157984975 shutdown_connections 2024-07-26T08:34:00.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.770+0000 7ff4ce800640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4b00b3d30 0x7ff4b00b6240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4006010 tx=0x7ff4c4009480 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:00.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.770+0000 7ff4d73d2740 1 -- 172.21.15.43:0/3157984975 wait complete. 2024-07-26T08:34:00.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.771+0000 7ff4d73d2740 1 -- start start 2024-07-26T08:34:00.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.771+0000 7ff4d73d2740 1 Processor -- start 2024-07-26T08:34:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 0x5634e8facda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bd3390 0x5634e8fad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5634e8d62700 con 0x5634e8bd3390 2024-07-26T08:34:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5634e8e9b690 con 0x5634e8bf4070 2024-07-26T08:34:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5634e8faff10 con 0x5634e8bcb1b0 2024-07-26T08:34:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4d73d2740 10 client.0 _ll_register_callbacks cb 0x5634e8eab140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4cde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 0x5634e8facda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.772+0000 7ff4cde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 0x5634e8facda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45854/0 (socket says 172.21.15.43:45854) 2024-07-26T08:34:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cde00640 1 -- 172.21.15.43:0/975643324 learned_addr learned my addr 172.21.15.43:0/975643324 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cd400640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bd3390 0x5634e8fad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4ce800640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cde00640 1 -- 172.21.15.43:0/975643324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 msgr2=0x5634e8fad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cde00640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cde00640 1 -- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bd3390 msgr2=0x5634e8fad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cde00640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bd3390 0x5634e8fad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.773+0000 7ff4cde00640 1 -- 172.21.15.43:0/975643324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e8eb2830 con 0x5634e8bcb1b0 2024-07-26T08:34:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.774+0000 7ff4cde00640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 0x5634e8facda0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0a6430 tx=0x7ff4bc0aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3be8f351864f80 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.774+0000 7ff4ab400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.774+0000 7ff4ab400640 1 -- 172.21.15.43:0/975643324 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0b3460 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.774+0000 7ff4ab400640 1 -- 172.21.15.43:0/975643324 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff4bc0e11c0 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.775+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b800fa10 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.775+0000 7ff4ab400640 1 -- 172.21.15.43:0/975643324 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4bc0041d0 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.775+0000 7ff4d73d2740 10 client.25510 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.775+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5634e8fbbc20 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.775+0000 7ff4ab400640 1 -- 172.21.15.43:0/975643324 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4b800fa10 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4ab400640 1 -- 172.21.15.43:0/975643324 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff4bc0a4ad0 con 0x5634e8bcb1b0 2024-07-26T08:34:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4d73d2740 10 client.25510 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:00.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4d73d2740 10 client.25510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:00.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4d73d2740 20 client.25510 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:00.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8bb29f0 0x5634e8fbf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4d73d2740 4 client.25510 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:00.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.776+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634e8f11b10 con 0x5634e8bb29f0 2024-07-26T08:34:00.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.777+0000 7ff4cd400640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8bb29f0 0x5634e8fbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.778+0000 7ff4cd400640 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8bb29f0 0x5634e8fbf180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=734014119acc8005 server_cookie=7ba6ac858877f62b in_seq=0 out_seq=0 2024-07-26T08:34:00.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.778+0000 7ff4ab400640 10 client.25510 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4ab400640 1 -- 172.21.15.43:0/975643324 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634e8f11b10 con 0x5634e8bb29f0 2024-07-26T08:34:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4ab400640 10 client.25510 handle_command_reply: tid=0 2024-07-26T08:34:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 client.25510 shutdown 2024-07-26T08:34:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 msgr2=0x5634e8facda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 0x5634e8facda0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0a6430 tx=0x7ff4bc0aa000 comp rx=0 tx=0).stop 2024-07-26T08:34:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 shutdown_connections 2024-07-26T08:34:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8bb29f0 0x5634e8fbf180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bd3390 0x5634e8fad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/975643324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bcb1b0 0x5634e8facda0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 >> 172.21.15.43:0/975643324 conn(0x5634e8be8460 msgr2=0x5634e8f95530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.779+0000 7ff4ab400640 0 client.25510 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.780+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 shutdown_connections 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.780+0000 7ff4d73d2740 1 -- 172.21.15.43:0/975643324 wait complete. 2024-07-26T08:34:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.780+0000 7ff4d73d2740 20 client.25510 trim_cache size 0 max 16384 2024-07-26T08:34:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.798+0000 7ff4d73d2740 1 Processor -- start 2024-07-26T08:34:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 -- start start 2024-07-26T08:34:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fc4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bd3390 0x5634e8fc4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 0x5634e8f99f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac012880 con 0x5634e8bcb1b0 2024-07-26T08:34:00.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac010150 con 0x5634e8bd3390 2024-07-26T08:34:00.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.799+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac00dfa0 con 0x5634e8bf4070 2024-07-26T08:34:00.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4cde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fc4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 0x5634e8f99f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 0x5634e8f99f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45870/0 (socket says 172.21.15.43:45870) 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 -- 172.21.15.43:0/1288444412 learned_addr learned my addr 172.21.15.43:0/1288444412 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4cd400640 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bd3390 0x5634e8fc4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 -- 172.21.15.43:0/1288444412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bd3390 msgr2=0x5634e8fc4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bd3390 0x5634e8fc4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 -- 172.21.15.43:0/1288444412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 msgr2=0x5634e8fc4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fc4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 -- 172.21.15.43:0/1288444412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e8f95c10 con 0x5634e8bf4070 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.800+0000 7ff4ce800640 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 0x5634e8f99f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40093d0 tx=0x7ff4c4041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f7c71490827357 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.801+0000 7ff4b6600640 1 -- 172.21.15.43:0/1288444412 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4031450 con 0x5634e8bf4070 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.801+0000 7ff4b6600640 1 -- 172.21.15.43:0/1288444412 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4c4036050 con 0x5634e8bf4070 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.801+0000 7ff4b6600640 1 -- 172.21.15.43:0/1288444412 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4030820 con 0x5634e8bf4070 2024-07-26T08:34:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 -- 172.21.15.43:0/1288444412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 msgr2=0x5634e8f99f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 0x5634e8f99f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40093d0 tx=0x7ff4c4041000 comp rx=0 tx=0).stop 2024-07-26T08:34:00.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 -- 172.21.15.43:0/1288444412 shutdown_connections 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bf4070 0x5634e8f99f50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bd3390 0x5634e8fc4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/1288444412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fc4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 -- 172.21.15.43:0/1288444412 >> 172.21.15.43:0/1288444412 conn(0x5634e8be8460 msgr2=0x5634e8fab620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 -- 172.21.15.43:0/1288444412 shutdown_connections 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.802+0000 7ff4d73d2740 1 -- 172.21.15.43:0/1288444412 wait complete. 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.803+0000 7ff4d73d2740 1 -- start start 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.803+0000 7ff4d73d2740 1 Processor -- start 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.803+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fb1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.803+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8fb2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4d73d2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fa03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac00e610 con 0x5634e8bcb1b0 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac00fa80 con 0x5634e8bf4070 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4d73d2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac00ece0 con 0x5634e8bd3390 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4d73d2740 10 client.0 _ll_register_callbacks cb 0x7ff4bc0a9ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4cd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8fb2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4cd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8fb2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45884/0 (socket says 172.21.15.43:45884) 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4cd400640 1 -- 172.21.15.43:0/2800414915 learned_addr learned my addr 172.21.15.43:0/2800414915 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.804+0000 7ff4ce800640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fa03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cd400640 1 -- 172.21.15.43:0/2800414915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 msgr2=0x5634e8fa03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cd400640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fa03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cd400640 1 -- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 msgr2=0x5634e8fb1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:00.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cde00640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fb1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cd400640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fb1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cd400640 1 -- 172.21.15.43:0/2800414915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e8fa0a30 con 0x5634e8bd3390 2024-07-26T08:34:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cde00640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fb1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:34:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4cd400640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8fb2130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8011dd0 tx=0x7ff4b8019690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7d40cb4a60b16d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.805+0000 7ff4ab400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:00.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4ab400640 1 -- 172.21.15.43:0/2800414915 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b801e040 con 0x5634e8bd3390 2024-07-26T08:34:00.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4ab400640 1 -- 172.21.15.43:0/2800414915 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7ff4b800f540 con 0x5634e8bd3390 2024-07-26T08:34:00.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4c4036050 con 0x5634e8bd3390 2024-07-26T08:34:00.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4ab400640 1 -- 172.21.15.43:0/2800414915 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4b800f740 con 0x5634e8bd3390 2024-07-26T08:34:00.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4d73d2740 10 client.25516 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5634e8fa7dc0 con 0x5634e8bd3390 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.806+0000 7ff4ab400640 1 -- 172.21.15.43:0/2800414915 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4c4036050 con 0x5634e8bd3390 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4ab400640 1 -- 172.21.15.43:0/2800414915 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff4b8019b90 con 0x5634e8bd3390 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4d73d2740 10 client.25516 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4d73d2740 10 client.25516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4d73d2740 20 client.25516 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8b87da0 0x5634e90218e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4d73d2740 4 client.25516 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.807+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5634e8f0d5b0 con 0x5634e8b87da0 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.808+0000 7ff4cde00640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8b87da0 0x5634e90218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4cde00640 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8b87da0 0x5634e90218e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1464a0ab664abb server_cookie=97e167c7bf45bf26 in_seq=0 out_seq=0 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4ab400640 10 client.25516 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4ab400640 1 -- 172.21.15.43:0/2800414915 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5634e8f0d5b0 con 0x5634e8b87da0 2024-07-26T08:34:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4ab400640 10 client.25516 handle_command_reply: tid=0 2024-07-26T08:34:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 client.25516 shutdown 2024-07-26T08:34:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 msgr2=0x5634e8fb2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8fb2130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8011dd0 tx=0x7ff4b8019690 comp rx=0 tx=0).stop 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 shutdown_connections 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5634e8b87da0 0x5634e90218e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5634e8bd3390 0x5634e8fb2130 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5634e8bf4070 0x5634e8fa03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 --2- 172.21.15.43:0/2800414915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5634e8bcb1b0 0x5634e8fb1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4ab400640 0 client.25516 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.809+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 >> 172.21.15.43:0/2800414915 conn(0x5634e8be8460 msgr2=0x5634e8fab970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.810+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 shutdown_connections 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.810+0000 7ff4d73d2740 1 -- 172.21.15.43:0/2800414915 wait complete. 2024-07-26T08:34:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.810+0000 7ff4d73d2740 20 client.25516 trim_cache size 0 max 16384 2024-07-26T08:34:00.814 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:34:00.814 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "no active scrubs running", 2024-07-26T08:34:00.814 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": {} 2024-07-26T08:34:00.814 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:34:00.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4b00b3d30 msgr2=0x7ff4b00b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4b00b3d30 0x7ff4b00b6240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4006010 tx=0x7ff4c4009480 comp rx=0 tx=0).stop 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 msgr2=0x7ff4c819bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 0x7ff4c819bf90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d950 tx=0x7ff4bc00de10 comp rx=0 tx=0).stop 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 shutdown_connections 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff4b00b3d30 0x7ff4b00b6240 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c810af30 0x7ff4c819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c810b880 0x7ff4c81a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 --2- 172.21.15.43:0/3780978786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4c81055f0 0x7ff4c819bf90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.811+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 >> 172.21.15.43:0/3780978786 conn(0x7ff4c8101060 msgr2=0x7ff4c81084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.812+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 shutdown_connections 2024-07-26T08:34:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:00.812+0000 7ff4cf200640 1 -- 172.21.15.43:0/3780978786 wait complete. 2024-07-26T08:34:01.881 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-26T08:34:01.881 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:34:02.337 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:02.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:02 smithi133 ceph-mon[37053]: pgmap v511: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 7 op/s 2024-07-26T08:34:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:02 smithi133 ceph-mon[37053]: mgrmap e25: x(active, since 14m), standbys: z, y 2024-07-26T08:34:02.521 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:02 smithi043 ceph-mon[32384]: pgmap v511: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 7 op/s 2024-07-26T08:34:02.521 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:02 smithi043 ceph-mon[32384]: mgrmap e25: x(active, since 14m), standbys: z, y 2024-07-26T08:34:02.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:02 smithi063 ceph-mon[36747]: pgmap v511: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 7 op/s 2024-07-26T08:34:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:02 smithi063 ceph-mon[36747]: mgrmap e25: x(active, since 14m), standbys: z, y 2024-07-26T08:34:04.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:04 smithi043 ceph-mon[32384]: pgmap v512: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-07-26T08:34:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:04 smithi133 ceph-mon[37053]: pgmap v512: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-07-26T08:34:04.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:04 smithi063 ceph-mon[36747]: pgmap v512: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-07-26T08:34:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 -- 172.21.15.43:0/1838914186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c10d650 msgr2=0x7f338c10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 --2- 172.21.15.43:0/1838914186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c10d650 0x7f338c10fb40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3384009ca0 tx=0x7f338402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 -- 172.21.15.43:0/1838914186 shutdown_connections 2024-07-26T08:34:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 --2- 172.21.15.43:0/1838914186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c10d650 0x7f338c10fb40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 --2- 172.21.15.43:0/1838914186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c104b40 0x7f338c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 --2- 172.21.15.43:0/1838914186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f338c1041f0 0x7f338c104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 -- 172.21.15.43:0/1838914186 >> 172.21.15.43:0/1838914186 conn(0x7f338c0fdcf0 msgr2=0x7f338c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 -- 172.21.15.43:0/1838914186 shutdown_connections 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.664+0000 7f338be00640 1 -- 172.21.15.43:0/1838914186 wait complete. 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.665+0000 7f338be00640 1 Processor -- start 2024-07-26T08:34:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 -- start start 2024-07-26T08:34:04.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 0x7f338c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:04.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c104b40 0x7f338c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f338c10d650 0x7f338c1a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f338c113410 con 0x7f338c1041f0 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f338c113290 con 0x7f338c104b40 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f338c113590 con 0x7f338c10d650 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.666+0000 7f338aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 0x7f338c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 0x7f338c19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56676/0 (socket says 172.21.15.43:56676) 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 -- 172.21.15.43:0/3200473519 learned_addr learned my addr 172.21.15.43:0/3200473519 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338a000640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c104b40 0x7f338c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:04.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 -- 172.21.15.43:0/3200473519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f338c10d650 msgr2=0x7f338c1a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f338c10d650 0x7f338c1a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 -- 172.21.15.43:0/3200473519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c104b40 msgr2=0x7f338c19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c104b40 0x7f338c19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.667+0000 7f338aa00640 1 -- 172.21.15.43:0/3200473519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c1a1ed0 con 0x7f338c1041f0 2024-07-26T08:34:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.668+0000 7f338aa00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 0x7f338c19bf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f337c00d770 tx=0x7f337c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.668+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c017070 con 0x7f338c1041f0 2024-07-26T08:34:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.668+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f337c0054f0 con 0x7f338c1041f0 2024-07-26T08:34:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.668+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338c1a21c0 con 0x7f338c1041f0 2024-07-26T08:34:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.668+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c004ce0 con 0x7f338c1041f0 2024-07-26T08:34:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.668+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338c1a8920 con 0x7f338c1041f0 2024-07-26T08:34:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.670+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c0052c0 con 0x7f338c1041f0 2024-07-26T08:34:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.673+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f337c009c30 con 0x7f338c1041f0 2024-07-26T08:34:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.674+0000 7f3390a00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33700b3f10 0x7f33700b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.675+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f337c0e4040 con 0x7f338c1041f0 2024-07-26T08:34:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.675+0000 7f338a000640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33700b3f10 0x7f33700b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.676+0000 7f338a000640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33700b3f10 0x7f33700b6420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f338c1013f0 tx=0x7f3378005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:04.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.681+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f337c0ab050 con 0x7f338c1041f0 2024-07-26T08:34:04.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.929+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f336c0055b0 con 0x7f338c1041f0 2024-07-26T08:34:04.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.930+0000 7f3390a00640 1 -- 172.21.15.43:0/3200473519 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11895 (secure 0 0 0) 0x7f337c0aa950 con 0x7f338c1041f0 2024-07-26T08:34:04.933 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:34:04.933 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"btime":"2024-07-26T08:33:02:007771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:33:01.263024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24733,24710,24709]},"id":1}]} 2024-07-26T08:34:04.933 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 25 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33700b3f10 msgr2=0x7f33700b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33700b3f10 0x7f33700b6420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f338c1013f0 tx=0x7f3378005f90 comp rx=0 tx=0).stop 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 msgr2=0x7f338c19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 0x7f338c19bf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f337c00d770 tx=0x7f337c00dc30 comp rx=0 tx=0).stop 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 shutdown_connections 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33700b3f10 0x7f33700b6420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f338c10d650 0x7f338c1a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c104b40 0x7f338c19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 --2- 172.21.15.43:0/3200473519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f338c1041f0 0x7f338c19bf60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:04.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 >> 172.21.15.43:0/3200473519 conn(0x7f338c0fdcf0 msgr2=0x7f338c101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:04.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.933+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 shutdown_connections 2024-07-26T08:34:04.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:04.934+0000 7f338be00640 1 -- 172.21.15.43:0/3200473519 wait complete. 2024-07-26T08:34:05.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:05 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3200473519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:34:05.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:05 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3200473519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:34:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:05 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3200473519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:34:05.935 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-07-26T08:34:06.555 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:06.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:06 smithi063 ceph-mon[36747]: pgmap v513: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-07-26T08:34:06.710 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:06 smithi043 ceph-mon[32384]: pgmap v513: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-07-26T08:34:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:06 smithi133 ceph-mon[37053]: pgmap v513: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-07-26T08:34:08.444 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:08 smithi043 ceph-mon[32384]: pgmap v514: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-07-26T08:34:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:08 smithi063 ceph-mon[36747]: pgmap v514: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-07-26T08:34:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:08 smithi133 ceph-mon[37053]: pgmap v514: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-07-26T08:34:08.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.989+0000 7f30d1800640 1 -- 172.21.15.43:0/508046689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc101fe0 msgr2=0x7f30cc1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.989+0000 7f30d1800640 1 --2- 172.21.15.43:0/508046689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc101fe0 0x7f30cc1023f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009890 tx=0x7f30bc02a380 comp rx=0 tx=0).stop 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 -- 172.21.15.43:0/508046689 shutdown_connections 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 --2- 172.21.15.43:0/508046689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc107420 0x7f30cc107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 --2- 172.21.15.43:0/508046689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc102930 0x7f30cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 --2- 172.21.15.43:0/508046689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc101fe0 0x7f30cc1023f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 -- 172.21.15.43:0/508046689 >> 172.21.15.43:0/508046689 conn(0x7f30cc0fdcf0 msgr2=0x7f30cc100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 -- 172.21.15.43:0/508046689 shutdown_connections 2024-07-26T08:34:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.990+0000 7f30d1800640 1 -- 172.21.15.43:0/508046689 wait complete. 2024-07-26T08:34:08.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.991+0000 7f30d1800640 1 Processor -- start 2024-07-26T08:34:08.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 -- start start 2024-07-26T08:34:08.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc101fe0 0x7f30cc1a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:08.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc102930 0x7f30cc1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc107420 0x7f30cc1a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc119a20 con 0x7f30cc102930 2024-07-26T08:34:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1198a0 con 0x7f30cc107420 2024-07-26T08:34:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30d1800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc119ba0 con 0x7f30cc101fe0 2024-07-26T08:34:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.992+0000 7f30cb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc102930 0x7f30cc1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc101fe0 0x7f30cc1a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30d0e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc107420 0x7f30cc1a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc102930 0x7f30cc1a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60984/0 (socket says 172.21.15.43:60984) 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cb400640 1 -- 172.21.15.43:0/1236760792 learned_addr learned my addr 172.21.15.43:0/1236760792 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 -- 172.21.15.43:0/1236760792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc107420 msgr2=0x7f30cc1a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc107420 0x7f30cc1a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 -- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc102930 msgr2=0x7f30cc1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc102930 0x7f30cc1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:08.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 -- 172.21.15.43:0/1236760792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc1a6360 con 0x7f30cc101fe0 2024-07-26T08:34:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.993+0000 7f30cbe00640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc101fe0 0x7f30cc1a03f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30bc035040 tx=0x7f30bc032760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.994+0000 7f30c8c00640 1 -- 172.21.15.43:0/1236760792 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc037040 con 0x7f30cc101fe0 2024-07-26T08:34:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.994+0000 7f30c8c00640 1 -- 172.21.15.43:0/1236760792 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30bc033b50 con 0x7f30cc101fe0 2024-07-26T08:34:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.994+0000 7f30c8c00640 1 -- 172.21.15.43:0/1236760792 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc030990 con 0x7f30cc101fe0 2024-07-26T08:34:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.994+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc1a65f0 con 0x7f30cc101fe0 2024-07-26T08:34:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.994+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc1acdb0 con 0x7f30cc101fe0 2024-07-26T08:34:08.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 Processor -- start 2024-07-26T08:34:08.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 -- start start 2024-07-26T08:34:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141916010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641415481b0 0x564141916550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141916a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56414188cbd0 con 0x564141571070 2024-07-26T08:34:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56414187c0d0 con 0x564141550390 2024-07-26T08:34:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.998+0000 7f30d9a68740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564141880110 con 0x5641415481b0 2024-07-26T08:34:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141916010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141916010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60990/0 (socket says 172.21.15.43:60990) 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 -- 172.21.15.43:0/654953995 learned_addr learned my addr 172.21.15.43:0/654953995 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30cb400640 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141916a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 -- 172.21.15.43:0/654953995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641415481b0 msgr2=0x564141916550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641415481b0 0x564141916550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 -- 172.21.15.43:0/654953995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 msgr2=0x564141916a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141916a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:08.999+0000 7f30d0e00640 1 -- 172.21.15.43:0/654953995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641415dc650 con 0x564141571070 2024-07-26T08:34:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.000+0000 7f30d0e00640 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141916010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009fd0 tx=0x7f30c4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6175336f2534574c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.000+0000 7f30c1600640 1 -- 172.21.15.43:0/654953995 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004d20 con 0x564141571070 2024-07-26T08:34:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.000+0000 7f30c8c00640 1 -- 172.21.15.43:0/1236760792 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f30bc042020 con 0x7f30cc101fe0 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.000+0000 7f30c1600640 1 -- 172.21.15.43:0/654953995 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30c4004030 con 0x564141571070 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.000+0000 7f30c1600640 1 -- 172.21.15.43:0/654953995 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4005260 con 0x564141571070 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 -- 172.21.15.43:0/654953995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 msgr2=0x564141916010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141916010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009fd0 tx=0x7f30c4011810 comp rx=0 tx=0).stop 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 -- 172.21.15.43:0/654953995 shutdown_connections 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641415481b0 0x564141916550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141916a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 --2- 172.21.15.43:0/654953995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141916010 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.002+0000 7f30d9a68740 1 -- 172.21.15.43:0/654953995 >> 172.21.15.43:0/654953995 conn(0x564141565460 msgr2=0x564141913f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.003+0000 7f30d9a68740 1 -- 172.21.15.43:0/654953995 shutdown_connections 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.003+0000 7f30d9a68740 1 -- 172.21.15.43:0/654953995 wait complete. 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.003+0000 7f30c8c00640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30b00b3ef0 0x7f30b00b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.003+0000 7f30c8c00640 1 -- 172.21.15.43:0/1236760792 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f30bc1035c0 con 0x7f30cc101fe0 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.003+0000 7f30d9a68740 1 -- start start 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.004+0000 7f30d9a68740 1 Processor -- start 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.004+0000 7f30cb400640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30b00b3ef0 0x7f30b00b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.004+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141921630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141921b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141571070 0x5641419220b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d9a68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641416df700 con 0x5641415481b0 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d9a68740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5641418186a0 con 0x564141550390 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d9a68740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5641419247f0 con 0x564141571070 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d9a68740 10 client.0 _ll_register_callbacks cb 0x564141828150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30cb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141921b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30cb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141921b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46956/0 (socket says 172.21.15.43:46956) 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30cb400640 1 -- 172.21.15.43:0/4039990659 learned_addr learned my addr 172.21.15.43:0/4039990659 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.005+0000 7f30d0e00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141571070 0x5641419220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30d0e00640 1 -- 172.21.15.43:0/4039990659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 msgr2=0x564141921b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30d0e00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141921b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30d0e00640 1 -- 172.21.15.43:0/4039990659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 msgr2=0x564141921630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:09.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30cbe00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141921630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30d0e00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141921630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30d0e00640 1 -- 172.21.15.43:0/4039990659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414182f840 con 0x564141571070 2024-07-26T08:34:09.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.006+0000 7f30cb400640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30b00b3ef0 0x7f30b00b6400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f30cc107990 tx=0x7f30b8011810 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:09.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30d0e00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141571070 0x5641419220b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f30c4005c40 tx=0x7f30c4004c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8c8a9f018fac0b3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:09.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30b6000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30b6000640 1 -- 172.21.15.43:0/4039990659 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c401e040 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30b6000640 1 -- 172.21.15.43:0/4039990659 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f30c40041e0 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c4004030 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30b6000640 1 -- 172.21.15.43:0/4039990659 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30c4030050 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30d9a68740 10 client.25528 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.007+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641419304a0 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30b6000640 1 -- 172.21.15.43:0/4039990659 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30c4004030 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30b6000640 1 -- 172.21.15.43:0/4039990659 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f30c4018070 con 0x564141571070 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30d9a68740 10 client.25528 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30d9a68740 10 client.25528 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:34:09.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30d9a68740 20 client.25528 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:09.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30d9a68740 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x56414152f9f0 0x5641419338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30d9a68740 4 client.25528 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:09.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.008+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56414188eb20 con 0x56414152f9f0 2024-07-26T08:34:09.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.009+0000 7f30cbe00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x56414152f9f0 0x5641419338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.009+0000 7f30cbe00640 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x56414152f9f0 0x5641419338b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d19f3b20934c2067 server_cookie=4cd9dc86b2d3e7ce in_seq=0 out_seq=0 2024-07-26T08:34:09.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.009+0000 7f30b6000640 10 client.25528 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:09.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.010+0000 7f30b6000640 1 -- 172.21.15.43:0/4039990659 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56414188eb20 con 0x56414152f9f0 2024-07-26T08:34:09.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.010+0000 7f30b6000640 10 client.25528 handle_command_reply: tid=0 2024-07-26T08:34:09.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.010+0000 7f30d9a68740 1 client.25528 shutdown 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141571070 msgr2=0x5641419220b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141571070 0x5641419220b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f30c4005c40 tx=0x7f30c4004c30 comp rx=0 tx=0).stop 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 shutdown_connections 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x56414152f9f0 0x5641419338b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141571070 0x5641419220b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141550390 0x564141921b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 --2- 172.21.15.43:0/4039990659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141921630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 >> 172.21.15.43:0/4039990659 conn(0x564141565460 msgr2=0x5641419191f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:09.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.011+0000 7f30b6000640 0 client.25528 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:09.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.012+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 shutdown_connections 2024-07-26T08:34:09.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.012+0000 7f30d9a68740 1 -- 172.21.15.43:0/4039990659 wait complete. 2024-07-26T08:34:09.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.012+0000 7f30d9a68740 20 client.25528 trim_cache size 0 max 16384 2024-07-26T08:34:09.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.026+0000 7f30d9a68740 1 Processor -- start 2024-07-26T08:34:09.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.026+0000 7f30d9a68740 1 -- start start 2024-07-26T08:34:09.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141912f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141923260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141571070 0x56414191e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30d9a68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1b9810 con 0x5641415481b0 2024-07-26T08:34:09.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30d9a68740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1b70e0 con 0x564141571070 2024-07-26T08:34:09.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30d9a68740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1b4f30 con 0x564141550390 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30cb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141923260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30cb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141923260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35526/0 (socket says 172.21.15.43:35526) 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.027+0000 7f30cb400640 1 -- 172.21.15.43:0/3250811434 learned_addr learned my addr 172.21.15.43:0/3250811434 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30d0e00640 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141571070 0x56414191e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cbe00640 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141912f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cb400640 1 -- 172.21.15.43:0/3250811434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141571070 msgr2=0x56414191e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cb400640 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141571070 0x56414191e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cb400640 1 -- 172.21.15.43:0/3250811434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 msgr2=0x564141912f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cb400640 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141912f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cb400640 1 -- 172.21.15.43:0/3250811434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564141918530 con 0x564141550390 2024-07-26T08:34:09.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.028+0000 7f30cbe00640 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141912f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:09.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.029+0000 7f30cb400640 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141923260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f30b8011fd0 tx=0x7f30b8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e96de692b71148 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.029+0000 7f30c0c00640 1 -- 172.21.15.43:0/3250811434 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b801edb0 con 0x564141550390 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.029+0000 7f30c0c00640 1 -- 172.21.15.43:0/3250811434 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30b800fd90 con 0x564141550390 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.029+0000 7f30c0c00640 1 -- 172.21.15.43:0/3250811434 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8004a90 con 0x564141550390 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 -- 172.21.15.43:0/3250811434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 msgr2=0x564141923260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141923260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f30b8011fd0 tx=0x7f30b8009260 comp rx=0 tx=0).stop 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 -- 172.21.15.43:0/3250811434 shutdown_connections 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141923260 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564141571070 0x56414191e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3250811434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641415481b0 0x564141912f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 -- 172.21.15.43:0/3250811434 >> 172.21.15.43:0/3250811434 conn(0x564141565460 msgr2=0x564141922b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 -- 172.21.15.43:0/3250811434 shutdown_connections 2024-07-26T08:34:09.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.030+0000 7f30d9a68740 1 -- 172.21.15.43:0/3250811434 wait complete. 2024-07-26T08:34:09.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.031+0000 7f30d9a68740 1 -- start start 2024-07-26T08:34:09.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.031+0000 7f30d9a68740 1 Processor -- start 2024-07-26T08:34:09.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 0x564141935bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141936150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141999e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1b55a0 con 0x564141571070 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1b6a10 con 0x5641415481b0 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc1b5c70 con 0x564141550390 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30d9a68740 10 client.0 _ll_register_callbacks cb 0x7f30c4003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 0x564141935bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 0x564141935bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46974/0 (socket says 172.21.15.43:46974) 2024-07-26T08:34:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30cbe00640 1 -- 172.21.15.43:0/3096178705 learned_addr learned my addr 172.21.15.43:0/3096178705 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.032+0000 7f30cb400640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141936150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30cbe00640 1 -- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 msgr2=0x564141936150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30cbe00640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141936150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30cbe00640 1 -- 172.21.15.43:0/3096178705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 msgr2=0x564141999e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30d0e00640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141999e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30cbe00640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141999e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30cbe00640 1 -- 172.21.15.43:0/3096178705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414199a340 con 0x5641415481b0 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.033+0000 7f30d0e00640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141999e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.034+0000 7f30cbe00640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 0x564141935bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0c9be0 tx=0x7f30bc0c9710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ea93af3561e6c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.034+0000 7f30b6000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.034+0000 7f30b6000640 1 -- 172.21.15.43:0/3096178705 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0c9ee0 con 0x5641415481b0 2024-07-26T08:34:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.034+0000 7f30b6000640 1 -- 172.21.15.43:0/3096178705 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f30bc100b90 con 0x5641415481b0 2024-07-26T08:34:09.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.034+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30b800fd90 con 0x5641415481b0 2024-07-26T08:34:09.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.035+0000 7f30b6000640 1 -- 172.21.15.43:0/3096178705 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30bc100d90 con 0x5641415481b0 2024-07-26T08:34:09.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.035+0000 7f30d9a68740 10 client.25508 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:09.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.035+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56414199b4f0 con 0x5641415481b0 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.035+0000 7f30b6000640 1 -- 172.21.15.43:0/3096178705 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30b800fd90 con 0x5641415481b0 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.035+0000 7f30b6000640 1 -- 172.21.15.43:0/3096178705 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f30bc03a070 con 0x5641415481b0 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30d9a68740 10 client.25508 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30d9a68740 10 client.25508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30d9a68740 20 client.25508 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x564141504da0 0x56414199dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30d9a68740 4 client.25508 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:34:09.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56414188a5c0 con 0x564141504da0 2024-07-26T08:34:09.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.036+0000 7f30cb400640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x564141504da0 0x56414199dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:09.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30b6000640 10 client.25508 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:09.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30cb400640 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x564141504da0 0x56414199dc80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca62dc9697782717 server_cookie=947cd256cbb9b601 in_seq=0 out_seq=0 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30b6000640 1 -- 172.21.15.43:0/3096178705 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56414188a5c0 con 0x564141504da0 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30b6000640 10 client.25508 handle_command_reply: tid=0 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 client.25508 shutdown 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 msgr2=0x564141935bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 0x564141935bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0c9be0 tx=0x7f30bc0c9710 comp rx=0 tx=0).stop 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 shutdown_connections 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x564141504da0 0x56414199dc80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564141550390 0x564141936150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564141571070 0x564141999e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 --2- 172.21.15.43:0/3096178705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641415481b0 0x564141935bd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.037+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 >> 172.21.15.43:0/3096178705 conn(0x564141565460 msgr2=0x564141912cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.038+0000 7f30b6000640 0 client.25508 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.038+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 shutdown_connections 2024-07-26T08:34:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.038+0000 7f30d9a68740 1 -- 172.21.15.43:0/3096178705 wait complete. 2024-07-26T08:34:09.041 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.038+0000 7f30d9a68740 20 client.25508 trim_cache size 0 max 16384 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30b00b3ef0 msgr2=0x7f30b00b6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30b00b3ef0 0x7f30b00b6400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f30cc107990 tx=0x7f30b8011810 comp rx=0 tx=0).stop 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc101fe0 msgr2=0x7f30cc1a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc101fe0 0x7f30cc1a03f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30bc035040 tx=0x7f30bc032760 comp rx=0 tx=0).stop 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 shutdown_connections 2024-07-26T08:34:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30b00b3ef0 0x7f30b00b6400 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc107420 0x7f30cc1a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc102930 0x7f30cc1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 --2- 172.21.15.43:0/1236760792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30cc101fe0 0x7f30cc1a03f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.039+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 >> 172.21.15.43:0/1236760792 conn(0x7f30cc0fdcf0 msgr2=0x7f30cc104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.041+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 shutdown_connections 2024-07-26T08:34:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:09.041+0000 7f30d1800640 1 -- 172.21.15.43:0/1236760792 wait complete. 2024-07-26T08:34:10.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-07-26T08:34:10.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:10 smithi043 ceph-mon[32384]: pgmap v515: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-07-26T08:34:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:10 smithi063 ceph-mon[36747]: pgmap v515: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-07-26T08:34:10.731 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:10.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:10 smithi133 ceph-mon[37053]: pgmap v515: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-07-26T08:34:12.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:12 smithi063 ceph-mon[36747]: pgmap v516: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-07-26T08:34:12.617 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:12 smithi043 ceph-mon[32384]: pgmap v516: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-07-26T08:34:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:12 smithi133 ceph-mon[37053]: pgmap v516: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-07-26T08:34:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 -- 172.21.15.43:0/3515608088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c10f9c0 msgr2=0x7f180c111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 --2- 172.21.15.43:0/3515608088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c10f9c0 0x7f180c111de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1804009ca0 tx=0x7f180402a950 comp rx=0 tx=0).stop 2024-07-26T08:34:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 -- 172.21.15.43:0/3515608088 shutdown_connections 2024-07-26T08:34:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 --2- 172.21.15.43:0/3515608088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180c102760 0x7f180c10f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 --2- 172.21.15.43:0/3515608088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c10f9c0 0x7f180c111de0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 --2- 172.21.15.43:0/3515608088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c101e10 0x7f180c102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.174+0000 7f1810a00640 1 -- 172.21.15.43:0/3515608088 >> 172.21.15.43:0/3515608088 conn(0x7f180c0fdcf0 msgr2=0x7f180c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.175+0000 7f1810a00640 1 -- 172.21.15.43:0/3515608088 shutdown_connections 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.175+0000 7f1810a00640 1 -- 172.21.15.43:0/3515608088 wait complete. 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.176+0000 7f1810a00640 1 Processor -- start 2024-07-26T08:34:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.176+0000 7f1810a00640 1 -- start start 2024-07-26T08:34:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f1810a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180c101e10 0x7f180c1042e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f1810a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c102760 0x7f180c104860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f1810a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 0x7f180c10eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f1810a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f180c1155d0 con 0x7f180c102760 2024-07-26T08:34:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f1810a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f180c115450 con 0x7f180c10f9c0 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f1810a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f180c115750 con 0x7f180c101e10 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f180be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 0x7f180c10eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f180be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 0x7f180c10eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46996/0 (socket says 172.21.15.43:46996) 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f180be00640 1 -- 172.21.15.43:0/1145669828 learned_addr learned my addr 172.21.15.43:0/1145669828 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.177+0000 7f180b400640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180c101e10 0x7f180c1042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180aa00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c102760 0x7f180c104860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180be00640 1 -- 172.21.15.43:0/1145669828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180c101e10 msgr2=0x7f180c1042e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180be00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180c101e10 0x7f180c1042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180be00640 1 -- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c102760 msgr2=0x7f180c104860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180be00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c102760 0x7f180c104860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180be00640 1 -- 172.21.15.43:0/1145669828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c10f3d0 con 0x7f180c10f9c0 2024-07-26T08:34:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.178+0000 7f180be00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 0x7f180c10eca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1804004af0 tx=0x7f180402f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.179+0000 7f1803e00640 1 -- 172.21.15.43:0/1145669828 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804034040 con 0x7f180c10f9c0 2024-07-26T08:34:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.179+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180c10f600 con 0x7f180c10f9c0 2024-07-26T08:34:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.179+0000 7f1803e00640 1 -- 172.21.15.43:0/1145669828 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1804030910 con 0x7f180c10f9c0 2024-07-26T08:34:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.179+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180c109ce0 con 0x7f180c10f9c0 2024-07-26T08:34:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.179+0000 7f1803e00640 1 -- 172.21.15.43:0/1145669828 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040046a0 con 0x7f180c10f9c0 2024-07-26T08:34:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.183+0000 7f1818e24740 1 Processor -- start 2024-07-26T08:34:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.184+0000 7f1803e00640 1 -- 172.21.15.43:0/1145669828 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1804037020 con 0x7f180c10f9c0 2024-07-26T08:34:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.184+0000 7f1818e24740 1 -- start start 2024-07-26T08:34:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f1818e24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b5b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f1818e24740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55819278d1b0 0x558192b5b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f1818e24740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558192795390 0x558192b5ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f1818e24740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558192ad1bd0 con 0x558192795390 2024-07-26T08:34:13.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f1818e24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558192ac10d0 con 0x5581927b6070 2024-07-26T08:34:13.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f1818e24740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558192ac5110 con 0x55819278d1b0 2024-07-26T08:34:13.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f180aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b5b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f180aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b5b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46998/0 (socket says 172.21.15.43:46998) 2024-07-26T08:34:13.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f180aa00640 1 -- 172.21.15.43:0/2335804591 learned_addr learned my addr 172.21.15.43:0/2335804591 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.185+0000 7f180aa00640 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558192795390 0x558192b5ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180b400640 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55819278d1b0 0x558192b5b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180aa00640 1 -- 172.21.15.43:0/2335804591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55819278d1b0 msgr2=0x558192b5b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180aa00640 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55819278d1b0 0x558192b5b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180aa00640 1 -- 172.21.15.43:0/2335804591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558192795390 msgr2=0x558192b5ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180aa00640 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558192795390 0x558192b5ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180aa00640 1 -- 172.21.15.43:0/2335804591 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558192821650 con 0x5581927b6070 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.186+0000 7f180aa00640 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b5b010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17f8012710 tx=0x7f17f8009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9890ed3543495a01 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.187+0000 7f17f7e00640 1 -- 172.21.15.43:0/2335804591 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8012c90 con 0x5581927b6070 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.187+0000 7f17f7e00640 1 -- 172.21.15.43:0/2335804591 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17f8012e30 con 0x5581927b6070 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.187+0000 7f17f7e00640 1 -- 172.21.15.43:0/2335804591 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8003850 con 0x5581927b6070 2024-07-26T08:34:13.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.187+0000 7f1803e00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17f00b3d40 0x7f17f00b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.187+0000 7f1803e00640 1 -- 172.21.15.43:0/1145669828 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f1804104fa0 con 0x7f180c10f9c0 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 -- 172.21.15.43:0/2335804591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 msgr2=0x558192b5b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b5b010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17f8012710 tx=0x7f17f8009680 comp rx=0 tx=0).stop 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 -- 172.21.15.43:0/2335804591 shutdown_connections 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55819278d1b0 0x558192b5b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558192795390 0x558192b5ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 --2- 172.21.15.43:0/2335804591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b5b010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 -- 172.21.15.43:0/2335804591 >> 172.21.15.43:0/2335804591 conn(0x5581927aa460 msgr2=0x558192b58f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 -- 172.21.15.43:0/2335804591 shutdown_connections 2024-07-26T08:34:13.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.188+0000 7f1818e24740 1 -- 172.21.15.43:0/2335804591 wait complete. 2024-07-26T08:34:13.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 -- start start 2024-07-26T08:34:13.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 Processor -- start 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b66bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b67170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558192924700 con 0x55819278d1b0 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558192a5d6a0 con 0x5581927b6070 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.189+0000 7f1818e24740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558192b697f0 con 0x558192795390 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.190+0000 7f1818e24740 10 client.0 _ll_register_callbacks cb 0x558192a6d150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.190+0000 7f180b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.190+0000 7f180b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32822/0 (socket says 172.21.15.43:32822) 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.190+0000 7f180b400640 1 -- 172.21.15.43:0/1619330349 learned_addr learned my addr 172.21.15.43:0/1619330349 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.190+0000 7f180aa00640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b66bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.191+0000 7f180b400640 1 -- 172.21.15.43:0/1619330349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 msgr2=0x558192b66bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.191+0000 7f180be00640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b67170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.191+0000 7f180b400640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b66bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.191+0000 7f180b400640 1 -- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 msgr2=0x558192b67170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.191+0000 7f180b400640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b67170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.191+0000 7f180b400640 1 -- 172.21.15.43:0/1619330349 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558192a74840 con 0x55819278d1b0 2024-07-26T08:34:13.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.192+0000 7f180be00640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b67170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.192+0000 7f180b400640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17f00b3d40 0x7f17f00b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.192+0000 7f180aa00640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b66bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.192+0000 7f180b400640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b666b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17fc005bc0 tx=0x7f17fc013b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536edc2658b4b2cf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.192+0000 7f17f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.192+0000 7f17f4c00640 1 -- 172.21.15.43:0/1619330349 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00eac0 con 0x55819278d1b0 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.193+0000 7f17f4c00640 1 -- 172.21.15.43:0/1619330349 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f17fc00ec60 con 0x55819278d1b0 2024-07-26T08:34:13.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.193+0000 7f180b400640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17f00b3d40 0x7f17f00b6250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f17fc023000 tx=0x7f17fc020000 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:13.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.193+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f8012e30 con 0x55819278d1b0 2024-07-26T08:34:13.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.193+0000 7f17f4c00640 1 -- 172.21.15.43:0/1619330349 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f17fc02f050 con 0x55819278d1b0 2024-07-26T08:34:13.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.193+0000 7f1818e24740 10 client.15402 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:13.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.193+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558192b755b0 con 0x55819278d1b0 2024-07-26T08:34:13.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f17f4c00640 1 -- 172.21.15.43:0/1619330349 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17f8012e30 con 0x55819278d1b0 2024-07-26T08:34:13.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f17f4c00640 1 -- 172.21.15.43:0/1619330349 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f17fc00f040 con 0x55819278d1b0 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f1818e24740 10 client.15402 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f1818e24740 10 client.15402 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f1818e24740 20 client.15402 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f1818e24740 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5581927749f0 0x558192b78b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f1818e24740 4 client.15402 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.194+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558192ad3b20 con 0x5581927749f0 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.195+0000 7f180aa00640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5581927749f0 0x558192b78b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.195+0000 7f180aa00640 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5581927749f0 0x558192b78b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7f9bdf69a696a5e server_cookie=85609825fbc9c157 in_seq=0 out_seq=0 2024-07-26T08:34:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.195+0000 7f17f4c00640 10 client.15402 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:13.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.196+0000 7f17f4c00640 1 -- 172.21.15.43:0/1619330349 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558192ad3b20 con 0x5581927749f0 2024-07-26T08:34:13.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.196+0000 7f17f4c00640 10 client.15402 handle_command_reply: tid=0 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.196+0000 7f1818e24740 1 client.15402 shutdown 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.196+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 msgr2=0x558192b666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.196+0000 7f1818e24740 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b666b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17fc005bc0 tx=0x7f17fc013b10 comp rx=0 tx=0).stop 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 shutdown_connections 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b66bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x5581927749f0 0x558192b78b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b67170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 --2- 172.21.15.43:0/1619330349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b666b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 >> 172.21.15.43:0/1619330349 conn(0x5581927aa460 msgr2=0x558192b57540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f17f4c00640 0 client.15402 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 shutdown_connections 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 1 -- 172.21.15.43:0/1619330349 wait complete. 2024-07-26T08:34:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.197+0000 7f1818e24740 20 client.15402 trim_cache size 0 max 16384 2024-07-26T08:34:13.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.224+0000 7f1818e24740 1 Processor -- start 2024-07-26T08:34:13.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.224+0000 7f1818e24740 1 -- start start 2024-07-26T08:34:13.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f1818e24740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b61e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f1818e24740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f1818e24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b60290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f1818e24740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec012890 con 0x55819278d1b0 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f1818e24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec010160 con 0x5581927b6070 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f1818e24740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec00dfb0 con 0x558192795390 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f180be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b60290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f180be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b60290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47018/0 (socket says 172.21.15.43:47018) 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f180b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b61e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.225+0000 7f180be00640 1 -- 172.21.15.43:0/3307741972 learned_addr learned my addr 172.21.15.43:0/3307741972 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 -- 172.21.15.43:0/3307741972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 msgr2=0x558192b60290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b60290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 -- 172.21.15.43:0/3307741972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 msgr2=0x558192b61e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b61e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 -- 172.21.15.43:0/3307741972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558192b79090 con 0x558192795390 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.226+0000 7f180aa00640 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b686a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17f8010d80 tx=0x7f17f801b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8337711f4d26185 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.227+0000 7f17f7400640 1 -- 172.21.15.43:0/3307741972 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8010bc0 con 0x558192795390 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.227+0000 7f17f7400640 1 -- 172.21.15.43:0/3307741972 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17f8031070 con 0x558192795390 2024-07-26T08:34:13.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.227+0000 7f17f7400640 1 -- 172.21.15.43:0/3307741972 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8004650 con 0x558192795390 2024-07-26T08:34:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 -- 172.21.15.43:0/3307741972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 msgr2=0x558192b686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b686a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17f8010d80 tx=0x7f17f801b040 comp rx=0 tx=0).stop 2024-07-26T08:34:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 -- 172.21.15.43:0/3307741972 shutdown_connections 2024-07-26T08:34:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b686a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5581927b6070 0x558192b60290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 --2- 172.21.15.43:0/3307741972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55819278d1b0 0x558192b61e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 -- 172.21.15.43:0/3307741972 >> 172.21.15.43:0/3307741972 conn(0x5581927aa460 msgr2=0x558192b66fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:13.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 -- 172.21.15.43:0/3307741972 shutdown_connections 2024-07-26T08:34:13.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.229+0000 7f1818e24740 1 -- 172.21.15.43:0/3307741972 wait complete. 2024-07-26T08:34:13.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.230+0000 7f1818e24740 1 -- start start 2024-07-26T08:34:13.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.230+0000 7f1818e24740 1 Processor -- start 2024-07-26T08:34:13.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.230+0000 7f1818e24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55819278d1b0 0x558192b60480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f1818e24740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f1818e24740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 0x558192b60f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f1818e24740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec00e620 con 0x5581927b6070 2024-07-26T08:34:13.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f1818e24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec00fa90 con 0x55819278d1b0 2024-07-26T08:34:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f1818e24740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec00ecf0 con 0x558192795390 2024-07-26T08:34:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f1818e24740 10 client.0 _ll_register_callbacks cb 0x7f17fc009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f180be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 0x558192b60f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f180b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55819278d1b0 0x558192b60480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f180be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 0x558192b60f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32846/0 (socket says 172.21.15.43:32846) 2024-07-26T08:34:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f180be00640 1 -- 172.21.15.43:0/910169524 learned_addr learned my addr 172.21.15.43:0/910169524 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.231+0000 7f180aa00640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180b400640 1 -- 172.21.15.43:0/910169524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 msgr2=0x558192b609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180b400640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180b400640 1 -- 172.21.15.43:0/910169524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 msgr2=0x558192b60f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180b400640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 0x558192b60f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180b400640 1 -- 172.21.15.43:0/910169524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558192b6db50 con 0x55819278d1b0 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180be00640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 0x558192b60f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f180b400640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55819278d1b0 0x558192b60480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0095f0 tx=0x7f17fc013eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8d8d4204377252 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.232+0000 7f17f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.233+0000 7f17f4c00640 1 -- 172.21.15.43:0/910169524 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc038060 con 0x55819278d1b0 2024-07-26T08:34:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.233+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f8031070 con 0x55819278d1b0 2024-07-26T08:34:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.233+0000 7f17f4c00640 1 -- 172.21.15.43:0/910169524 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f17fc0047e0 con 0x55819278d1b0 2024-07-26T08:34:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.233+0000 7f17f4c00640 1 -- 172.21.15.43:0/910169524 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f17fc03f050 con 0x55819278d1b0 2024-07-26T08:34:13.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.233+0000 7f1818e24740 10 client.25523 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:13.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.233+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558192b6ed90 con 0x55819278d1b0 2024-07-26T08:34:13.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.234+0000 7f17f4c00640 1 -- 172.21.15.43:0/910169524 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17f8031070 con 0x55819278d1b0 2024-07-26T08:34:13.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f17f4c00640 1 -- 172.21.15.43:0/910169524 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f17fc00ece0 con 0x55819278d1b0 2024-07-26T08:34:13.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f1818e24740 10 client.25523 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f1818e24740 10 client.25523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f1818e24740 20 client.25523 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f1818e24740 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x558192749da0 0x558192be32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f1818e24740 4 client.25523 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558192acf5c0 con 0x558192749da0 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.235+0000 7f180aa00640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x558192749da0 0x558192be32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:13.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.236+0000 7f180aa00640 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x558192749da0 0x558192be32d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bce78f039921321e server_cookie=6f8f337f86c0dc08 in_seq=0 out_seq=0 2024-07-26T08:34:13.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.236+0000 7f17f4c00640 10 client.25523 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:13.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.236+0000 7f17f4c00640 1 -- 172.21.15.43:0/910169524 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558192acf5c0 con 0x558192749da0 2024-07-26T08:34:13.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.236+0000 7f17f4c00640 10 client.25523 handle_command_reply: tid=0 2024-07-26T08:34:13.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.236+0000 7f1818e24740 1 client.25523 shutdown 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55819278d1b0 msgr2=0x558192b60480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55819278d1b0 0x558192b60480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0095f0 tx=0x7f17fc013eb0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 shutdown_connections 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558192795390 0x558192b609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x558192749da0 0x558192be32d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581927b6070 0x558192b60f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 --2- 172.21.15.43:0/910169524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55819278d1b0 0x558192b60480 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 >> 172.21.15.43:0/910169524 conn(0x5581927aa460 msgr2=0x558192b5c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:13.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.237+0000 7f17f4c00640 0 client.25523 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:13.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.238+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 shutdown_connections 2024-07-26T08:34:13.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.238+0000 7f1818e24740 1 -- 172.21.15.43:0/910169524 wait complete. 2024-07-26T08:34:13.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.238+0000 7f1818e24740 20 client.25523 trim_cache size 0 max 16384 2024-07-26T08:34:13.240 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17f00b3d40 msgr2=0x7f17f00b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17f00b3d40 0x7f17f00b6250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f17fc023000 tx=0x7f17fc020000 comp rx=0 tx=0).stop 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 msgr2=0x7f180c10eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 0x7f180c10eca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1804004af0 tx=0x7f180402f3a0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 shutdown_connections 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f17f00b3d40 0x7f17f00b6250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f180c10f9c0 0x7f180c10eca0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f180c102760 0x7f180c104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 --2- 172.21.15.43:0/1145669828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180c101e10 0x7f180c1042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.239+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 >> 172.21.15.43:0/1145669828 conn(0x7f180c0fdcf0 msgr2=0x7f180c111b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:13.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.240+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 shutdown_connections 2024-07-26T08:34:13.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:13.240+0000 7f1810a00640 1 -- 172.21.15.43:0/1145669828 wait complete. 2024-07-26T08:34:14.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-26T08:34:14.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:14 smithi063 ceph-mon[36747]: pgmap v517: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-07-26T08:34:14.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:14 smithi043 ceph-mon[32384]: pgmap v517: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-07-26T08:34:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:14 smithi133 ceph-mon[37053]: pgmap v517: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-07-26T08:34:14.789 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:16.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:16 smithi063 ceph-mon[36747]: pgmap v518: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-07-26T08:34:16.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:16 smithi043 ceph-mon[32384]: pgmap v518: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-07-26T08:34:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:16 smithi133 ceph-mon[37053]: pgmap v518: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-07-26T08:34:18.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:18 smithi043 ceph-mon[32384]: pgmap v519: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:34:18.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:18 smithi063 ceph-mon[36747]: pgmap v519: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:34:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:18 smithi133 ceph-mon[37053]: pgmap v519: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-07-26T08:34:20.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:20 smithi043 ceph-mon[32384]: pgmap v520: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-07-26T08:34:20.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.507+0000 7f719f200640 1 -- 172.21.15.43:0/391815722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71981033e0 msgr2=0x7f71981037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.507+0000 7f719f200640 1 --2- 172.21.15.43:0/391815722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71981033e0 0x7f71981037f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f718c009860 tx=0x7f718c02a340 comp rx=0 tx=0).stop 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.507+0000 7f719f200640 1 -- 172.21.15.43:0/391815722 shutdown_connections 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.507+0000 7f719f200640 1 --2- 172.21.15.43:0/391815722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7198108d20 0x7f7198109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.507+0000 7f719f200640 1 --2- 172.21.15.43:0/391815722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7198109670 0x7f719810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.507+0000 7f719f200640 1 --2- 172.21.15.43:0/391815722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71981033e0 0x7f71981037f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.508+0000 7f719f200640 1 -- 172.21.15.43:0/391815722 >> 172.21.15.43:0/391815722 conn(0x7f71980fee30 msgr2=0x7f7198101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.508+0000 7f719f200640 1 -- 172.21.15.43:0/391815722 shutdown_connections 2024-07-26T08:34:20.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.508+0000 7f719f200640 1 -- 172.21.15.43:0/391815722 wait complete. 2024-07-26T08:34:20.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.510+0000 7f719f200640 1 Processor -- start 2024-07-26T08:34:20.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.510+0000 7f719f200640 1 -- start start 2024-07-26T08:34:20.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71981033e0 0x7f7198197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 0x7f71981981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7198109670 0x7f719819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7198111240 con 0x7f7198109670 2024-07-26T08:34:20.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71981110c0 con 0x7f7198108d20 2024-07-26T08:34:20.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f71981113c0 con 0x7f71981033e0 2024-07-26T08:34:20.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7198109670 0x7f719819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 0x7f71981981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 0x7f71981981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55600/0 (socket says 172.21.15.43:55600) 2024-07-26T08:34:20.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719d400640 1 -- 172.21.15.43:0/2281576120 learned_addr learned my addr 172.21.15.43:0/2281576120 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:20.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.511+0000 7f719de00640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71981033e0 0x7f7198197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.573 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:20 smithi063 ceph-mon[36747]: pgmap v520: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-07-26T08:34:20.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.512+0000 7f719d400640 1 -- 172.21.15.43:0/2281576120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71981033e0 msgr2=0x7f7198197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.512+0000 7f719d400640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71981033e0 0x7f7198197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.512+0000 7f719d400640 1 -- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7198109670 msgr2=0x7f719819d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.512+0000 7f719d400640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7198109670 0x7f719819d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.512+0000 7f719d400640 1 -- 172.21.15.43:0/2281576120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719819db80 con 0x7f7198108d20 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.512+0000 7f719de00640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71981033e0 0x7f7198197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.513+0000 7f719d400640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 0x7f71981981b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f718800e9c0 tx=0x7f718800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.513+0000 7f7192a00640 1 -- 172.21.15.43:0/2281576120 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718800ccc0 con 0x7f7198108d20 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.513+0000 7f7192a00640 1 -- 172.21.15.43:0/2281576120 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7188010900 con 0x7f7198108d20 2024-07-26T08:34:20.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.513+0000 7f7192a00640 1 -- 172.21.15.43:0/2281576120 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188018820 con 0x7f7198108d20 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.513+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719819de70 con 0x7f7198108d20 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.514+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71981a45d0 con 0x7f7198108d20 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.518+0000 7f71a7442740 1 Processor -- start 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.519+0000 7f71a7442740 1 -- start start 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.519+0000 7f71a7442740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.519+0000 7f71a7442740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.519+0000 7f71a7442740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f71a7442740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654c502bbd0 con 0x5654c4cef390 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f71a7442740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5654c501b0d0 con 0x5654c4d10070 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f71a7442740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5654c501f110 con 0x5654c4ce71b0 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55602/0 (socket says 172.21.15.43:55602) 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 -- 172.21.15.43:0/3135548625 learned_addr learned my addr 172.21.15.43:0/3135548625 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f7192a00640 1 -- 172.21.15.43:0/2281576120 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7188010ab0 con 0x7f7198108d20 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 -- 172.21.15.43:0/3135548625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 msgr2=0x5654c50b5550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50b5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 -- 172.21.15.43:0/3135548625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 msgr2=0x5654c50b5a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50b5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.520+0000 7f719e800640 1 -- 172.21.15.43:0/3135548625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c4d7b650 con 0x5654c4d10070 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.521+0000 7f719e800640 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50b5010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71940039f0 tx=0x7f7194003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ff7ca9e2a76d92 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.521+0000 7f7187000640 1 -- 172.21.15.43:0/3135548625 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719401a470 con 0x5654c4d10070 2024-07-26T08:34:20.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.521+0000 7f7187000640 1 -- 172.21.15.43:0/3135548625 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7194015070 con 0x5654c4d10070 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.522+0000 7f71a7442740 1 -- 172.21.15.43:0/3135548625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 msgr2=0x5654c50b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.522+0000 7f71a7442740 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50b5010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71940039f0 tx=0x7f7194003eb0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 -- 172.21.15.43:0/3135548625 shutdown_connections 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 --2- 172.21.15.43:0/3135548625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50b5010 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 -- 172.21.15.43:0/3135548625 >> 172.21.15.43:0/3135548625 conn(0x5654c4d04460 msgr2=0x5654c50b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f7192a00640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f71800b3da0 0x7f71800b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 -- 172.21.15.43:0/3135548625 shutdown_connections 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.523+0000 7f71a7442740 1 -- 172.21.15.43:0/3135548625 wait complete. 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.524+0000 7f719de00640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f71800b3da0 0x7f71800b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.524+0000 7f71a7442740 1 -- start start 2024-07-26T08:34:20.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.524+0000 7f7192a00640 1 -- 172.21.15.43:0/2281576120 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f71880e4550 con 0x7f7198108d20 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.524+0000 7f71a7442740 1 Processor -- start 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f719de00640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f71800b3da0 0x7f71800b62b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f718c02a930 tx=0x7f718c0056d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 0x5654c50c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4d10070 0x5654c50c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654c4e7e700 con 0x5654c4d10070 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5654c4fb76a0 con 0x5654c4ce71b0 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5654c50c3890 con 0x5654c4cef390 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.525+0000 7f71a7442740 10 client.0 _ll_register_callbacks cb 0x5654c4fc7150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.526+0000 7f719d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 0x5654c50c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.526+0000 7f719e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4d10070 0x5654c50c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.526+0000 7f719d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 0x5654c50c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:56984/0 (socket says 172.21.15.43:56984) 2024-07-26T08:34:20.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.526+0000 7f719d400640 1 -- 172.21.15.43:0/1684706199 learned_addr learned my addr 172.21.15.43:0/1684706199 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.526+0000 7f719d400640 1 -- 172.21.15.43:0/1684706199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 msgr2=0x5654c50c04f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f719d400640 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c04f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f719d400640 1 -- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4d10070 msgr2=0x5654c50c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f719d400640 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4d10070 0x5654c50c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f719d400640 1 -- 172.21.15.43:0/1684706199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c4fce840 con 0x5654c4cef390 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f719e800640 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4d10070 0x5654c50c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f719d400640 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 0x5654c50c0a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71880aada0 tx=0x7f7188010ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=602bc9b534e19836 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f717b400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f717b400640 1 -- 172.21.15.43:0/1684706199 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880af360 con 0x5654c4cef390 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.527+0000 7f717b400640 1 -- 172.21.15.43:0/1684706199 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f71880e4280 con 0x5654c4cef390 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.528+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7194015070 con 0x5654c4cef390 2024-07-26T08:34:20.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.528+0000 7f717b400640 1 -- 172.21.15.43:0/1684706199 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f71880b3e10 con 0x5654c4cef390 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.528+0000 7f71a7442740 10 client.25555 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.528+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5654c50cf4f0 con 0x5654c4cef390 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.528+0000 7f717b400640 1 -- 172.21.15.43:0/1684706199 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71880af030 con 0x5654c4cef390 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f717b400640 1 -- 172.21.15.43:0/1684706199 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f71880a9ae0 con 0x5654c4cef390 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f71a7442740 10 client.25555 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f71a7442740 10 client.25555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f71a7442740 20 client.25555 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f71a7442740 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4cce9f0 0x5654c50d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f71a7442740 4 client.25555 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.529+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7194015070 con 0x5654c4cce9f0 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.530+0000 7f719de00640 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4cce9f0 0x5654c50d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.531+0000 7f717b400640 10 client.25555 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.531+0000 7f719de00640 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4cce9f0 0x5654c50d2960 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57cb817c8454ce2 server_cookie=a50934aeeaa13c6a in_seq=0 out_seq=0 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.532+0000 7f717b400640 1 -- 172.21.15.43:0/1684706199 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7194015070 con 0x5654c4cce9f0 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.532+0000 7f717b400640 10 client.25555 handle_command_reply: tid=0 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.532+0000 7f71a7442740 1 client.25555 shutdown 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 msgr2=0x5654c50c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 0x5654c50c0a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71880aada0 tx=0x7f7188010ee0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 shutdown_connections 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4cce9f0 0x5654c50d2960 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4cef390 0x5654c50c0a30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4d10070 0x5654c50c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 --2- 172.21.15.43:0/1684706199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 >> 172.21.15.43:0/1684706199 conn(0x5654c4d04460 msgr2=0x5654c50b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.533+0000 7f717b400640 0 client.25555 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.534+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 shutdown_connections 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.534+0000 7f71a7442740 1 -- 172.21.15.43:0/1684706199 wait complete. 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.534+0000 7f71a7442740 20 client.25555 trim_cache size 0 max 16384 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 Processor -- start 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 -- start start 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50d8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b0fd0 con 0x5654c4cef390 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71981ae8a0 con 0x5654c4d10070 2024-07-26T08:34:20.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.562+0000 7f71a7442740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f71981ac6f0 con 0x5654c4ce71b0 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.563+0000 7f719d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.563+0000 7f719e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50d8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.563+0000 7f719de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.563+0000 7f719e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50d8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55626/0 (socket says 172.21.15.43:55626) 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.563+0000 7f719e800640 1 -- 172.21.15.43:0/1075626560 learned_addr learned my addr 172.21.15.43:0/1075626560 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.564+0000 7f719d400640 1 -- 172.21.15.43:0/1075626560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 msgr2=0x5654c50c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.564+0000 7f719d400640 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.564+0000 7f719d400640 1 -- 172.21.15.43:0/1075626560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 msgr2=0x5654c50d8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.564+0000 7f719d400640 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50d8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.564+0000 7f719d400640 1 -- 172.21.15.43:0/1075626560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c50b7530 con 0x5654c4cef390 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.565+0000 7f719d400640 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50d80e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7188000c00 tx=0x7f718800efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5794e42c851906 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.565+0000 7f7186600640 1 -- 172.21.15.43:0/1075626560 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880e4280 con 0x5654c4cef390 2024-07-26T08:34:20.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.566+0000 7f7186600640 1 -- 172.21.15.43:0/1075626560 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71880af040 con 0x5654c4cef390 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.566+0000 7f7186600640 1 -- 172.21.15.43:0/1075626560 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880b0630 con 0x5654c4cef390 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.567+0000 7f71a7442740 1 -- 172.21.15.43:0/1075626560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 msgr2=0x5654c50d80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.567+0000 7f71a7442740 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50d80e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7188000c00 tx=0x7f718800efb0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 -- 172.21.15.43:0/1075626560 shutdown_connections 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4d10070 0x5654c50d8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50d80e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 --2- 172.21.15.43:0/1075626560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4ce71b0 0x5654c50c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 -- 172.21.15.43:0/1075626560 >> 172.21.15.43:0/1075626560 conn(0x5654c4d04460 msgr2=0x5654c50c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 -- 172.21.15.43:0/1075626560 shutdown_connections 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.568+0000 7f71a7442740 1 -- 172.21.15.43:0/1075626560 wait complete. 2024-07-26T08:34:20.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.569+0000 7f71a7442740 1 -- start start 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.569+0000 7f71a7442740 1 Processor -- start 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4d10070 0x5654c5134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71981acd60 con 0x5654c4cef390 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71981ae1d0 con 0x5654c4ce71b0 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f71981ad430 con 0x5654c4d10070 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.570+0000 7f71a7442740 10 client.0 _ll_register_callbacks cb 0x7f71880aa580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.571+0000 7f719de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.571+0000 7f719de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55628/0 (socket says 172.21.15.43:55628) 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.571+0000 7f719de00640 1 -- 172.21.15.43:0/1304523416 learned_addr learned my addr 172.21.15.43:0/1304523416 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:20.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.571+0000 7f719e800640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4d10070 0x5654c5134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.571+0000 7f719d400640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719de00640 1 -- 172.21.15.43:0/1304523416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4d10070 msgr2=0x5654c5134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719de00640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4d10070 0x5654c5134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719de00640 1 -- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 msgr2=0x5654c50c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719de00640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719de00640 1 -- 172.21.15.43:0/1304523416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c5134700 con 0x5654c4ce71b0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719e800640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4d10070 0x5654c5134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719de00640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c7340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f718c009860 tx=0x7f718c02a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658cea13f6859631 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f717b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.572+0000 7f719d400640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.573+0000 7f717b400640 1 -- 172.21.15.43:0/1304523416 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c037040 con 0x5654c4ce71b0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.573+0000 7f717b400640 1 -- 172.21.15.43:0/1304523416 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f718c030710 con 0x5654c4ce71b0 2024-07-26T08:34:20.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.573+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71880af040 con 0x5654c4ce71b0 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.573+0000 7f717b400640 1 -- 172.21.15.43:0/1304523416 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f718c06c050 con 0x5654c4ce71b0 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.573+0000 7f71a7442740 10 client.25538 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.573+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5654c513ba50 con 0x5654c4ce71b0 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f717b400640 1 -- 172.21.15.43:0/1304523416 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f718c067030 con 0x5654c4ce71b0 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f717b400640 1 -- 172.21.15.43:0/1304523416 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f718c03b670 con 0x5654c4ce71b0 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f71a7442740 10 client.25538 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f71a7442740 10 client.25538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f71a7442740 20 client.25538 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f71a7442740 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4ca3da0 0x5654c513e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f71a7442740 4 client.25538 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.574+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654c502db20 con 0x5654c4ca3da0 2024-07-26T08:34:20.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.575+0000 7f719d400640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4ca3da0 0x5654c513e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.576+0000 7f719d400640 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4ca3da0 0x5654c513e210 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55011daf24847f60 server_cookie=3b6fda43eb06a3ec in_seq=0 out_seq=0 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.576+0000 7f717b400640 10 client.25538 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f717b400640 1 -- 172.21.15.43:0/1304523416 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654c502db20 con 0x5654c4ca3da0 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f717b400640 10 client.25538 handle_command_reply: tid=0 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 client.25538 shutdown 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 msgr2=0x5654c50c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c7340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f718c009860 tx=0x7f718c02a340 comp rx=0 tx=0).stop 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 shutdown_connections 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5654c4ca3da0 0x5654c513e210 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5654c4d10070 0x5654c5134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654c4cef390 0x5654c50c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 --2- 172.21.15.43:0/1304523416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c4ce71b0 0x5654c50c7340 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.577+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 >> 172.21.15.43:0/1304523416 conn(0x5654c4d04460 msgr2=0x5654c50bed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.578+0000 7f717b400640 0 client.25538 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.579+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 shutdown_connections 2024-07-26T08:34:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.579+0000 7f71a7442740 1 -- 172.21.15.43:0/1304523416 wait complete. 2024-07-26T08:34:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.579+0000 7f71a7442740 20 client.25538 trim_cache size 0 max 16384 2024-07-26T08:34:20.596 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.580+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f71800b3da0 msgr2=0x7f71800b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.580+0000 7f719f200640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f71800b3da0 0x7f71800b62b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f718c02a930 tx=0x7f718c0056d0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.580+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 msgr2=0x7f71981981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.580+0000 7f719f200640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 0x7f71981981b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f718800e9c0 tx=0x7f718800ee80 comp rx=0 tx=0).stop 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 shutdown_connections 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f71800b3da0 0x7f71800b62b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7198109670 0x7f719819d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7198108d20 0x7f71981981b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 --2- 172.21.15.43:0/2281576120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71981033e0 0x7f7198197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:20.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 >> 172.21.15.43:0/2281576120 conn(0x7f71980fee30 msgr2=0x7f7198101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:20.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 shutdown_connections 2024-07-26T08:34:20.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:20.581+0000 7f719f200640 1 -- 172.21.15.43:0/2281576120 wait complete. 2024-07-26T08:34:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:20 smithi133 ceph-mon[37053]: pgmap v520: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-07-26T08:34:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:22 smithi063 ceph-mon[36747]: pgmap v521: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-07-26T08:34:22.571 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-26T08:34:22.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-26T08:34:22.649 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:22 smithi043 ceph-mon[32384]: pgmap v521: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-07-26T08:34:22.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:22 smithi133 ceph-mon[37053]: pgmap v521: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-07-26T08:34:23.238 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:24 smithi063 ceph-mon[36747]: pgmap v522: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:34:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:24 smithi043 ceph-mon[32384]: pgmap v522: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:34:24.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:24 smithi133 ceph-mon[37053]: pgmap v522: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:34:25.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 -- 172.21.15.43:0/255511749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 msgr2=0x7fe0701028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 --2- 172.21.15.43:0/255511749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 0x7fe0701028a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe060009900 tx=0x7fe06002a410 comp rx=0 tx=0).stop 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 -- 172.21.15.43:0/255511749 shutdown_connections 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 --2- 172.21.15.43:0/255511749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070108720 0x7fe07010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 --2- 172.21.15.43:0/255511749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070107dd0 0x7fe0701081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 --2- 172.21.15.43:0/255511749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 0x7fe0701028a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 -- 172.21.15.43:0/255511749 >> 172.21.15.43:0/255511749 conn(0x7fe070079160 msgr2=0x7fe070079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 -- 172.21.15.43:0/255511749 shutdown_connections 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.818+0000 7fe075c00640 1 -- 172.21.15.43:0/255511749 wait complete. 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.819+0000 7fe075c00640 1 Processor -- start 2024-07-26T08:34:25.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.819+0000 7fe075c00640 1 -- start start 2024-07-26T08:34:25.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe075c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 0x7fe070199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe075c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070107dd0 0x7fe07019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe075c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 0x7fe07019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe075c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701135d0 con 0x7fe070102490 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe075c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe070113450 con 0x7fe070108720 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe075c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe070113750 con 0x7fe070107dd0 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe06f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 0x7fe07019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe06ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 0x7fe070199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe06f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 0x7fe07019f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:35044/0 (socket says 172.21.15.43:35044) 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe06f400640 1 -- 172.21.15.43:0/1298996274 learned_addr learned my addr 172.21.15.43:0/1298996274 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.820+0000 7fe06e000640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070107dd0 0x7fe07019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06f400640 1 -- 172.21.15.43:0/1298996274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070107dd0 msgr2=0x7fe07019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06f400640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070107dd0 0x7fe07019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06f400640 1 -- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 msgr2=0x7fe070199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06f400640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 0x7fe070199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06f400640 1 -- 172.21.15.43:0/1298996274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07019feb0 con 0x7fe070108720 2024-07-26T08:34:25.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06e000640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070107dd0 0x7fe07019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:25.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe06f400640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 0x7fe07019f780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe06800efd0 tx=0x7fe06800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:25.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe067400640 1 -- 172.21.15.43:0/1298996274 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068003b70 con 0x7fe070108720 2024-07-26T08:34:25.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a01a0 con 0x7fe070108720 2024-07-26T08:34:25.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe067400640 1 -- 172.21.15.43:0/1298996274 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe068003d10 con 0x7fe070108720 2024-07-26T08:34:25.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.821+0000 7fe067400640 1 -- 172.21.15.43:0/1298996274 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068010990 con 0x7fe070108720 2024-07-26T08:34:25.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.822+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701a6900 con 0x7fe070108720 2024-07-26T08:34:25.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.825+0000 7fe07ca15740 1 Processor -- start 2024-07-26T08:34:25.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.825+0000 7fe067400640 1 -- 172.21.15.43:0/1298996274 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe068004020 con 0x7fe070108720 2024-07-26T08:34:25.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 -- start start 2024-07-26T08:34:25.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41d2350 0x55cbd4576d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41a9490 0x55cbd45772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41b1670 0x55cbd4577800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cbd44edbe0 con 0x55cbd41d2350 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cbd44dd0e0 con 0x55cbd41a9490 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.826+0000 7fe07ca15740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cbd44e1120 con 0x55cbd41b1670 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41d2350 0x55cbd4576d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41a9490 0x55cbd45772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41d2350 0x55cbd4576d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37488/0 (socket says 172.21.15.43:37488) 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06e000640 1 -- 172.21.15.43:0/2875889767 learned_addr learned my addr 172.21.15.43:0/2875889767 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06e000640 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41b1670 0x55cbd4577800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06ea00640 1 -- 172.21.15.43:0/2875889767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41b1670 msgr2=0x55cbd4577800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06ea00640 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41b1670 0x55cbd4577800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06ea00640 1 -- 172.21.15.43:0/2875889767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41d2350 msgr2=0x55cbd4576d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06ea00640 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41d2350 0x55cbd4576d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.827+0000 7fe06ea00640 1 -- 172.21.15.43:0/2875889767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbd423d930 con 0x55cbd41a9490 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe067400640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0540b3d40 0x7fe0540b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe06ea00640 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41a9490 0x55cbd45772c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe060005940 tx=0x7fe060005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9261a9f3ca355e3a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe067400640 1 -- 172.21.15.43:0/1298996274 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe0680e4830 con 0x7fe070108720 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe05be00640 1 -- 172.21.15.43:0/2875889767 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060040070 con 0x55cbd41a9490 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe06e000640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0540b3d40 0x7fe0540b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe05be00640 1 -- 172.21.15.43:0/2875889767 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe060004020 con 0x55cbd41a9490 2024-07-26T08:34:25.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.828+0000 7fe05be00640 1 -- 172.21.15.43:0/2875889767 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060035040 con 0x55cbd41a9490 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 -- 172.21.15.43:0/2875889767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41a9490 msgr2=0x55cbd45772c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe06e000640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0540b3d40 0x7fe0540b6250 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009fd0 tx=0x7fe05c009b50 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41a9490 0x55cbd45772c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe060005940 tx=0x7fe060005e60 comp rx=0 tx=0).stop 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 -- 172.21.15.43:0/2875889767 shutdown_connections 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41b1670 0x55cbd4577800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41a9490 0x55cbd45772c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2875889767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41d2350 0x55cbd4576d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 -- 172.21.15.43:0/2875889767 >> 172.21.15.43:0/2875889767 conn(0x55cbd41c6740 msgr2=0x55cbd4574c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:25.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 -- 172.21.15.43:0/2875889767 shutdown_connections 2024-07-26T08:34:25.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.829+0000 7fe07ca15740 1 -- 172.21.15.43:0/2875889767 wait complete. 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.830+0000 7fe07ca15740 1 -- start start 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.830+0000 7fe07ca15740 1 Processor -- start 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd457e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd457e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd457ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cbd4340890 con 0x55cbd41b1670 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cbd4479320 con 0x55cbd41d2350 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cbd458dcf0 con 0x55cbd41a9490 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe07ca15740 10 client.0 _ll_register_callbacks cb 0x55cbd44a5000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:25.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe06e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd457e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe06e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd457e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37496/0 (socket says 172.21.15.43:37496) 2024-07-26T08:34:25.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe06e000640 1 -- 172.21.15.43:0/3607290403 learned_addr learned my addr 172.21.15.43:0/3607290403 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:25.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe06ea00640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd457e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.831+0000 7fe06f400640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd457ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06ea00640 1 -- 172.21.15.43:0/3607290403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 msgr2=0x55cbd457ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06ea00640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd457ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06ea00640 1 -- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 msgr2=0x55cbd457e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06ea00640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd457e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06ea00640 1 -- 172.21.15.43:0/3607290403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbd4597150 con 0x55cbd41a9490 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06e000640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd457e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe06ea00640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd457e300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe060000c00 tx=0x7fe060004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea56367bdaebe37 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.832+0000 7fe058c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe058c00640 1 -- 172.21.15.43:0/3607290403 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06004c020 con 0x55cbd41a9490 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe060004020 con 0x55cbd41a9490 2024-07-26T08:34:25.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe058c00640 1 -- 172.21.15.43:0/3607290403 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe0600051a0 con 0x55cbd41a9490 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe058c00640 1 -- 172.21.15.43:0/3607290403 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe060057050 con 0x55cbd41a9490 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe07ca15740 10 client.25573 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbd4599a80 con 0x55cbd41a9490 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.833+0000 7fe058c00640 1 -- 172.21.15.43:0/3607290403 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe060004020 con 0x55cbd41a9490 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe058c00640 1 -- 172.21.15.43:0/3607290403 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe0600035f0 con 0x55cbd41a9490 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe07ca15740 10 client.25573 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe07ca15740 10 client.25573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe07ca15740 20 client.25573 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe07ca15740 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4190cd0 0x55cbd459cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe07ca15740 4 client.25573 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbd44efb30 con 0x55cbd4190cd0 2024-07-26T08:34:25.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.834+0000 7fe06e000640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4190cd0 0x55cbd459cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.835+0000 7fe06e000640 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4190cd0 0x55cbd459cde0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9602701a9c3c5dc server_cookie=5cb28e5b2a775ea2 in_seq=0 out_seq=0 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.835+0000 7fe058c00640 10 client.25573 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe058c00640 1 -- 172.21.15.43:0/3607290403 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbd44efb30 con 0x55cbd4190cd0 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe058c00640 10 client.25573 handle_command_reply: tid=0 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 client.25573 shutdown 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 msgr2=0x55cbd457e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd457e300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe060000c00 tx=0x7fe060004480 comp rx=0 tx=0).stop 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 shutdown_connections 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4190cd0 0x55cbd459cde0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd457ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd457e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 --2- 172.21.15.43:0/3607290403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd457e300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe058c00640 0 client.25573 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:25.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.836+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 >> 172.21.15.43:0/3607290403 conn(0x55cbd41c6740 msgr2=0x55cbd4573230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:25.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.837+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 shutdown_connections 2024-07-26T08:34:25.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.837+0000 7fe07ca15740 1 -- 172.21.15.43:0/3607290403 wait complete. 2024-07-26T08:34:25.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.837+0000 7fe07ca15740 20 client.25573 trim_cache size 0 max 16384 2024-07-26T08:34:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.856+0000 7fe07ca15740 1 Processor -- start 2024-07-26T08:34:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.856+0000 7fe07ca15740 1 -- start start 2024-07-26T08:34:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd4596650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd459fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45a0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe07ca15740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b0f40 con 0x55cbd41b1670 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe07ca15740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701ae810 con 0x55cbd41d2350 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe07ca15740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701ac660 con 0x55cbd41a9490 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe06ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd4596650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe06f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe06e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd459fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe06ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd4596650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41896/0 (socket says 172.21.15.43:41896) 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe06f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45a0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:35068/0 (socket says 172.21.15.43:35068) 2024-07-26T08:34:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.857+0000 7fe06ea00640 1 -- 172.21.15.43:0/2043199429 learned_addr learned my addr 172.21.15.43:0/2043199429 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe06ea00640 1 -- 172.21.15.43:0/2043199429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 msgr2=0x55cbd45a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe06ea00640 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe06ea00640 1 -- 172.21.15.43:0/2043199429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 msgr2=0x55cbd459fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe06ea00640 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd459fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe06ea00640 1 -- 172.21.15.43:0/2043199429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbd45796a0 con 0x55cbd41a9490 2024-07-26T08:34:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe06ea00640 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd4596650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe060005f70 tx=0x7fe060005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e185226a51421fc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:25.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe05b400640 1 -- 172.21.15.43:0/2043199429 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06004c070 con 0x55cbd41a9490 2024-07-26T08:34:25.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe05b400640 1 -- 172.21.15.43:0/2043199429 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe060003c00 con 0x55cbd41a9490 2024-07-26T08:34:25.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.858+0000 7fe05b400640 1 -- 172.21.15.43:0/2043199429 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060040070 con 0x55cbd41a9490 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 -- 172.21.15.43:0/2043199429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 msgr2=0x55cbd4596650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd4596650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe060005f70 tx=0x7fe060005e40 comp rx=0 tx=0).stop 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 -- 172.21.15.43:0/2043199429 shutdown_connections 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd459fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 --2- 172.21.15.43:0/2043199429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd4596650 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 -- 172.21.15.43:0/2043199429 >> 172.21.15.43:0/2043199429 conn(0x55cbd41c6740 msgr2=0x55cbd4595f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.859+0000 7fe07ca15740 1 -- 172.21.15.43:0/2043199429 shutdown_connections 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.860+0000 7fe07ca15740 1 -- 172.21.15.43:0/2043199429 wait complete. 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.860+0000 7fe07ca15740 1 -- start start 2024-07-26T08:34:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.860+0000 7fe07ca15740 1 Processor -- start 2024-07-26T08:34:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd45f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd45f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45fe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701accd0 con 0x55cbd41b1670 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701ae140 con 0x55cbd41d2350 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701ad3a0 con 0x55cbd41a9490 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe07ca15740 10 client.0 _ll_register_callbacks cb 0x7fe05c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe06ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd45f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe06e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd45f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe06ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd45f94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41912/0 (socket says 172.21.15.43:41912) 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.861+0000 7fe06ea00640 1 -- 172.21.15.43:0/124135343 learned_addr learned my addr 172.21.15.43:0/124135343 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06f400640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06ea00640 1 -- 172.21.15.43:0/124135343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 msgr2=0x55cbd45fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06ea00640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06ea00640 1 -- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 msgr2=0x55cbd45f9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06ea00640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd45f9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06ea00640 1 -- 172.21.15.43:0/124135343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbd45fe9f0 con 0x55cbd41a9490 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06e000640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd45f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe06ea00640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd45f94c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe0600038a0 tx=0x7fe0600038d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e952b884c66220a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.862+0000 7fe058c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.863+0000 7fe058c00640 1 -- 172.21.15.43:0/124135343 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060040040 con 0x55cbd41a9490 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.863+0000 7fe058c00640 1 -- 172.21.15.43:0/124135343 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe060031720 con 0x55cbd41a9490 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.863+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe060003c00 con 0x55cbd41a9490 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.863+0000 7fe058c00640 1 -- 172.21.15.43:0/124135343 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe06006c050 con 0x55cbd41a9490 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.863+0000 7fe07ca15740 10 client.25579 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.863+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbd4605e00 con 0x55cbd41a9490 2024-07-26T08:34:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe058c00640 1 -- 172.21.15.43:0/124135343 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe060003c00 con 0x55cbd41a9490 2024-07-26T08:34:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe058c00640 1 -- 172.21.15.43:0/124135343 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe060004a50 con 0x55cbd41a9490 2024-07-26T08:34:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe07ca15740 10 client.25579 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe07ca15740 10 client.25579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe07ca15740 20 client.25579 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe07ca15740 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4166080 0x55cbd46084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe07ca15740 4 client.25579 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cbd44eb5d0 con 0x55cbd4166080 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.864+0000 7fe06e000640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4166080 0x55cbd46084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.865+0000 7fe06e000640 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4166080 0x55cbd46084a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919b1e38775006bb server_cookie=a5e2ee7793a2cc64 in_seq=0 out_seq=0 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.865+0000 7fe058c00640 10 client.25579 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.866+0000 7fe058c00640 1 -- 172.21.15.43:0/124135343 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cbd44eb5d0 con 0x55cbd4166080 2024-07-26T08:34:25.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.866+0000 7fe058c00640 10 client.25579 handle_command_reply: tid=0 2024-07-26T08:34:25.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.866+0000 7fe07ca15740 1 client.25579 shutdown 2024-07-26T08:34:25.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 msgr2=0x55cbd45f94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd45f94c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe0600038a0 tx=0x7fe0600038d0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 shutdown_connections 2024-07-26T08:34:25.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55cbd4166080 0x55cbd46084a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbd41d2350 0x55cbd45fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbd41b1670 0x55cbd45f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 --2- 172.21.15.43:0/124135343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbd41a9490 0x55cbd45f94c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.867+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 >> 172.21.15.43:0/124135343 conn(0x55cbd41c6740 msgr2=0x55cbd4578770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.868+0000 7fe058c00640 0 client.25579 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.868+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 shutdown_connections 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.868+0000 7fe07ca15740 1 -- 172.21.15.43:0/124135343 wait complete. 2024-07-26T08:34:25.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.868+0000 7fe07ca15740 20 client.25579 trim_cache size 0 max 16384 2024-07-26T08:34:25.871 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:34:25.871 INFO:teuthology.orchestra.run.smithi043.stdout: "return_code": 0, 2024-07-26T08:34:25.871 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_tag": "3f0504ed-db4e-4d32-8af5-e21aa6dffc58", 2024-07-26T08:34:25.871 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": "asynchronous" 2024-07-26T08:34:25.871 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0540b3d40 msgr2=0x7fe0540b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0540b3d40 0x7fe0540b6250 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009fd0 tx=0x7fe05c009b50 comp rx=0 tx=0).stop 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 msgr2=0x7fe07019f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 0x7fe07019f780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe06800efd0 tx=0x7fe06800c6a0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 shutdown_connections 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe0540b3d40 0x7fe0540b6250 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe070107dd0 0x7fe07019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe070108720 0x7fe07019f780 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 --2- 172.21.15.43:0/1298996274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe070102490 0x7fe070199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.869+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 >> 172.21.15.43:0/1298996274 conn(0x7fe070079160 msgr2=0x7fe070100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.870+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 shutdown_connections 2024-07-26T08:34:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:25.870+0000 7fe075c00640 1 -- 172.21.15.43:0/1298996274 wait complete. 2024-07-26T08:34:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:26 smithi063 ceph-mon[36747]: pgmap v523: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:26 smithi063 ceph-mon[36747]: scrub queued for path: / 2024-07-26T08:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:26 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:26 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:26 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:26 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:34:26.660 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:26 smithi043 ceph-mon[32384]: pgmap v523: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:34:26.661 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:26 smithi043 ceph-mon[32384]: scrub queued for path: / 2024-07-26T08:34:26.661 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:26 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:26.661 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:26 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:34:26.661 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:26 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:26.661 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:26 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:26 smithi133 ceph-mon[37053]: pgmap v523: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-07-26T08:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:26 smithi133 ceph-mon[37053]: scrub queued for path: / 2024-07-26T08:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:26 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:26 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:34:26.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:26 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:26.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:26 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:34:27.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:34:27.774 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:28.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:28 smithi063 ceph-mon[36747]: pgmap v524: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:34:28.568 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:28 smithi133 ceph-mon[37053]: pgmap v524: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:34:28.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:28 smithi043 ceph-mon[32384]: pgmap v524: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-07-26T08:34:29.651 INFO:tasks.workunit.client.0.smithi043.stderr:Updating files: 55% (7063/12697) Updating files: 56% (7111/12697) Updating files: 57% (7238/12697) Updating files: 58% (7365/12697) Updating files: 59% (7492/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 91% (11562/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-07-26T08:34:30.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 -- 172.21.15.43:0/3772367103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0010d630 msgr2=0x7f4b0010fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 --2- 172.21.15.43:0/3772367103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0010d630 0x7f4b0010fb40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009ca0 tx=0x7f4af802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 -- 172.21.15.43:0/3772367103 shutdown_connections 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 --2- 172.21.15.43:0/3772367103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b00104ab0 0x7f4b0010d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 --2- 172.21.15.43:0/3772367103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b0010d630 0x7f4b0010fb40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 --2- 172.21.15.43:0/3772367103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b00104080 0x7f4b00104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.334+0000 7f4b04a00640 1 -- 172.21.15.43:0/3772367103 >> 172.21.15.43:0/3772367103 conn(0x7f4b000fdcf0 msgr2=0x7f4b00100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.335+0000 7f4b04a00640 1 -- 172.21.15.43:0/3772367103 shutdown_connections 2024-07-26T08:34:30.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.335+0000 7f4b04a00640 1 -- 172.21.15.43:0/3772367103 wait complete. 2024-07-26T08:34:30.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.336+0000 7f4b04a00640 1 Processor -- start 2024-07-26T08:34:30.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.336+0000 7f4b04a00640 1 -- start start 2024-07-26T08:34:30.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4b04a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 0x7f4b00101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4b04a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b00104ab0 0x7f4b001024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4b04a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0010d630 0x7f4b00102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4b04a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001133f0 con 0x7f4b0010d630 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4b04a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00113270 con 0x7f4b00104080 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4b04a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00113570 con 0x7f4b00104ab0 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4aff400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 0x7f4b00101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4afea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b00104ab0 0x7f4b001024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4aff400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 0x7f4b00101f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:35100/0 (socket says 172.21.15.43:35100) 2024-07-26T08:34:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4aff400640 1 -- 172.21.15.43:0/596652162 learned_addr learned my addr 172.21.15.43:0/596652162 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:30.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.337+0000 7f4affe00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0010d630 0x7f4b00102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4aff400640 1 -- 172.21.15.43:0/596652162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b00104ab0 msgr2=0x7f4b001024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4aff400640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b00104ab0 0x7f4b001024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4aff400640 1 -- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0010d630 msgr2=0x7f4b00102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4aff400640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0010d630 0x7f4b00102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4aff400640 1 -- 172.21.15.43:0/596652162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b001a8020 con 0x7f4b00104080 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4aff400640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 0x7f4b00101f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9f0 tx=0x7f4af000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.338+0000 7f4af7e00640 1 -- 172.21.15.43:0/596652162 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af000cd80 con 0x7f4b00104080 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.339+0000 7f4af7e00640 1 -- 172.21.15.43:0/596652162 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4af0010900 con 0x7f4b00104080 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.339+0000 7f4af7e00640 1 -- 172.21.15.43:0/596652162 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0018920 con 0x7f4b00104080 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.339+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b001a8310 con 0x7f4b00104080 2024-07-26T08:34:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.339+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b001a8800 con 0x7f4b00104080 2024-07-26T08:34:30.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 Processor -- start 2024-07-26T08:34:30.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 -- start start 2024-07-26T08:34:30.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35e9070 0x5618e398dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e398e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e398ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5618e3904b90 con 0x5618e35c8390 2024-07-26T08:34:30.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5618e38f4090 con 0x5618e35c01b0 2024-07-26T08:34:30.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.343+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5618e38f80d0 con 0x5618e35e9070 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e398ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e398ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37542/0 (socket says 172.21.15.43:37542) 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 -- 172.21.15.43:0/4148587040 learned_addr learned my addr 172.21.15.43:0/4148587040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4affe00640 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35e9070 0x5618e398dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4af7e00640 1 -- 172.21.15.43:0/596652162 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4af0010ab0 con 0x7f4b00104080 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4aff400640 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e398e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 -- 172.21.15.43:0/4148587040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35e9070 msgr2=0x5618e398dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35e9070 0x5618e398dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 -- 172.21.15.43:0/4148587040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 msgr2=0x5618e398e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e398e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4afea00640 1 -- 172.21.15.43:0/4148587040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e3654650 con 0x5618e35c8390 2024-07-26T08:34:30.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.344+0000 7f4aff400640 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e398e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:30.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.345+0000 7f4afea00640 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e398ea50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009c20 tx=0x7f4aec011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdcecd5bb1073b1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:30.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.345+0000 7f4aebe00640 1 -- 172.21.15.43:0/4148587040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec004230 con 0x5618e35c8390 2024-07-26T08:34:30.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.346+0000 7f4aebe00640 1 -- 172.21.15.43:0/4148587040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4aec0043d0 con 0x5618e35c8390 2024-07-26T08:34:30.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.346+0000 7f4aebe00640 1 -- 172.21.15.43:0/4148587040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec004dd0 con 0x5618e35c8390 2024-07-26T08:34:30.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.346+0000 7f4af7e00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4ae40b3dc0 0x7f4ae40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.346+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4148587040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 msgr2=0x5618e398ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.346+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e398ea50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009c20 tx=0x7f4aec011810 comp rx=0 tx=0).stop 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4148587040 shutdown_connections 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e398ea50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e398e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4148587040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35e9070 0x5618e398dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4148587040 >> 172.21.15.43:0/4148587040 conn(0x5618e35dd460 msgr2=0x5618e398bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4af7e00640 1 -- 172.21.15.43:0/596652162 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f4af00e47f0 con 0x7f4b00104080 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4affe00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4ae40b3dc0 0x7f4ae40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4148587040 shutdown_connections 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.347+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4148587040 wait complete. 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.348+0000 7f4b0ccb2740 1 -- start start 2024-07-26T08:34:30.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.348+0000 7f4affe00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4ae40b3dc0 0x7f4ae40b62d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4af80094e0 tx=0x7f4af8009800 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:30.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.348+0000 7f4b0ccb2740 1 Processor -- start 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e3999550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 0x5618e3999a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35e9070 0x5618e3999fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5618e3757700 con 0x5618e35e9070 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5618e3890660 con 0x5618e35c01b0 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5618e399c7b0 con 0x5618e35c8390 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4b0ccb2740 10 client.0 _ll_register_callbacks cb 0x5618e38a0110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4afea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 0x5618e3999a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4afea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 0x5618e3999a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41964/0 (socket says 172.21.15.43:41964) 2024-07-26T08:34:30.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4afea00640 1 -- 172.21.15.43:0/4179164967 learned_addr learned my addr 172.21.15.43:0/4179164967 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4aff400640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e3999550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.349+0000 7f4affe00640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35e9070 0x5618e3999fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4afea00640 1 -- 172.21.15.43:0/4179164967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 msgr2=0x5618e3999550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4afea00640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e3999550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4afea00640 1 -- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35e9070 msgr2=0x5618e3999fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4afea00640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35e9070 0x5618e3999fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4afea00640 1 -- 172.21.15.43:0/4179164967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e38a7800 con 0x5618e35c8390 2024-07-26T08:34:30.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4afea00640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 0x5618e3999a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4aec019c30 tx=0x7f4aec019c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e304c8d0922878c5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:30.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.350+0000 7f4ae8c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:30.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.351+0000 7f4ae8c00640 1 -- 172.21.15.43:0/4179164967 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec028020 con 0x5618e35c8390 2024-07-26T08:34:30.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.351+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aec0043d0 con 0x5618e35c8390 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.351+0000 7f4ae8c00640 1 -- 172.21.15.43:0/4179164967 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f4aec024830 con 0x5618e35c8390 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.351+0000 7f4ae8c00640 1 -- 172.21.15.43:0/4179164967 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4aec033050 con 0x5618e35c8390 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.351+0000 7f4b0ccb2740 10 client.25591 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.351+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618e39a83b0 con 0x5618e35c8390 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4ae8c00640 1 -- 172.21.15.43:0/4179164967 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4aec0043d0 con 0x5618e35c8390 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4ae8c00640 1 -- 172.21.15.43:0/4179164967 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f4aec018070 con 0x5618e35c8390 2024-07-26T08:34:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4b0ccb2740 10 client.25591 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4b0ccb2740 10 client.25591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4b0ccb2740 20 client.25591 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35a79f0 0x5618e39ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4b0ccb2740 4 client.25591 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618e3906ae0 con 0x5618e35a79f0 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.352+0000 7f4aff400640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35a79f0 0x5618e39ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.353+0000 7f4aff400640 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35a79f0 0x5618e39ab710 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=421128ebe0e7a0f0 server_cookie=6cf9105b735f44f9 in_seq=0 out_seq=0 2024-07-26T08:34:30.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.353+0000 7f4ae8c00640 10 client.25591 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:30.358 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528'. 2024-07-26T08:34:30.358 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.359 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-07-26T08:34:30.360 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at e8f88bb1fe0 Merge PR #54435 into wip-vshankar-testing-20240725.121331-debug 2024-07-26T08:34:30.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4ae8c00640 1 -- 172.21.15.43:0/4179164967 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618e3906ae0 con 0x5618e35a79f0 2024-07-26T08:34:30.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4ae8c00640 10 client.25591 handle_command_reply: tid=0 2024-07-26T08:34:30.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 client.25591 shutdown 2024-07-26T08:34:30.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 msgr2=0x5618e3999a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 0x5618e3999a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4aec019c30 tx=0x7f4aec019c60 comp rx=0 tx=0).stop 2024-07-26T08:34:30.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 shutdown_connections 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35a79f0 0x5618e39ab710 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c8390 0x5618e3999a90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35e9070 0x5618e3999fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4ae8c00640 0 client.25591 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/4179164967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c01b0 0x5618e3999550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.354+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 >> 172.21.15.43:0/4179164967 conn(0x5618e35dd460 msgr2=0x5618e3991160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.355+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 shutdown_connections 2024-07-26T08:34:30.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.355+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/4179164967 wait complete. 2024-07-26T08:34:30.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.355+0000 7f4b0ccb2740 20 client.25591 trim_cache size 0 max 16384 2024-07-26T08:34:30.365 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-07-26T08:34:30.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.374+0000 7f4b0ccb2740 1 Processor -- start 2024-07-26T08:34:30.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.374+0000 7f4b0ccb2740 1 -- start start 2024-07-26T08:34:30.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 0x5618e3994c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c01b0 0x5618e398f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e399b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001b5380 con 0x5618e35c8390 2024-07-26T08:34:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001b2c50 con 0x5618e35dd460 2024-07-26T08:34:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001b0aa0 con 0x5618e35c01b0 2024-07-26T08:34:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4afea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c01b0 0x5618e398f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4affe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e399b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4aff400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 0x5618e3994c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4aff400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 0x5618e3994c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:35134/0 (socket says 172.21.15.43:35134) 2024-07-26T08:34:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4afea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c01b0 0x5618e398f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41978/0 (socket says 172.21.15.43:41978) 2024-07-26T08:34:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.375+0000 7f4aff400640 1 -- 172.21.15.43:0/133467342 learned_addr learned my addr 172.21.15.43:0/133467342 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aff400640 1 -- 172.21.15.43:0/133467342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c01b0 msgr2=0x5618e398f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aff400640 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c01b0 0x5618e398f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aff400640 1 -- 172.21.15.43:0/133467342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 msgr2=0x5618e399b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aff400640 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e399b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aff400640 1 -- 172.21.15.43:0/133467342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e399c080 con 0x5618e35dd460 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aff400640 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 0x5618e3994c10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c6a0 tx=0x7f4af001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84a8334e6b0d68c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:30.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aeb400640 1 -- 172.21.15.43:0/133467342 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00ea020 con 0x5618e35dd460 2024-07-26T08:34:30.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aeb400640 1 -- 172.21.15.43:0/133467342 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4af00ab000 con 0x5618e35dd460 2024-07-26T08:34:30.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.376+0000 7f4aeb400640 1 -- 172.21.15.43:0/133467342 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00e43d0 con 0x5618e35dd460 2024-07-26T08:34:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/133467342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 msgr2=0x5618e3994c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 0x5618e3994c10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c6a0 tx=0x7f4af001f000 comp rx=0 tx=0).stop 2024-07-26T08:34:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/133467342 shutdown_connections 2024-07-26T08:34:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35c01b0 0x5618e398f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c8390 0x5618e399b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/133467342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35dd460 0x5618e3994c10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.377+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/133467342 >> 172.21.15.43:0/133467342 conn(0x5618e398c0f0 msgr2=0x5618e399aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.378+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/133467342 shutdown_connections 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.378+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/133467342 wait complete. 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.378+0000 7f4b0ccb2740 1 -- start start 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.378+0000 7f4b0ccb2740 1 Processor -- start 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 0x5618e399d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 0x5618e399d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35dd460 0x5618e3a11d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001b1110 con 0x5618e35c01b0 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001b2580 con 0x5618e35c8390 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001b17e0 con 0x5618e35dd460 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4b0ccb2740 10 client.0 _ll_register_callbacks cb 0x7f4aec019840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4aff400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 0x5618e399d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4afea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 0x5618e399d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4aff400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 0x5618e399d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37554/0 (socket says 172.21.15.43:37554) 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4afea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 0x5618e399d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:35148/0 (socket says 172.21.15.43:35148) 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4aff400640 1 -- 172.21.15.43:0/3051129227 learned_addr learned my addr 172.21.15.43:0/3051129227 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.379+0000 7f4affe00640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35dd460 0x5618e3a11d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4aff400640 1 -- 172.21.15.43:0/3051129227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35dd460 msgr2=0x5618e3a11d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4aff400640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35dd460 0x5618e3a11d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4aff400640 1 -- 172.21.15.43:0/3051129227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 msgr2=0x5618e399d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4aff400640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 0x5618e399d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4aff400640 1 -- 172.21.15.43:0/3051129227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e3a122c0 con 0x5618e35c01b0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4afea00640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 0x5618e399d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4aff400640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 0x5618e399d020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9c0 tx=0x7f4af00e1e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da407694135e386 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4ae8c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4ae8c00640 1 -- 172.21.15.43:0/3051129227 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00ea070 con 0x5618e35c01b0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.380+0000 7f4ae8c00640 1 -- 172.21.15.43:0/3051129227 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f4af00e43d0 con 0x5618e35c01b0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af00ab000 con 0x5618e35c01b0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4ae8c00640 1 -- 172.21.15.43:0/3051129227 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4af00c0440 con 0x5618e35c01b0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618e3a134b0 con 0x5618e35c01b0 2024-07-26T08:34:30.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4ae8c00640 1 -- 172.21.15.43:0/3051129227 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4af00ab000 con 0x5618e35c01b0 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4ae8c00640 1 -- 172.21.15.43:0/3051129227 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f4af00be020 con 0x5618e35c01b0 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 20 client.15459 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35e9070 0x5618e3a15ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 4 client.15459 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.381+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5618e3902580 con 0x5618e35e9070 2024-07-26T08:34:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.382+0000 7f4afea00640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35e9070 0x5618e3a15ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.382+0000 7f4ae8c00640 10 client.15459 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.383+0000 7f4afea00640 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35e9070 0x5618e3a15ca0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718a37650c4e6ee7 server_cookie=bba7332c4d875e0a in_seq=0 out_seq=0 2024-07-26T08:34:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.383+0000 7f4ae8c00640 1 -- 172.21.15.43:0/3051129227 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5618e3902580 con 0x5618e35e9070 2024-07-26T08:34:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.383+0000 7f4ae8c00640 10 client.15459 handle_command_reply: tid=0 2024-07-26T08:34:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.383+0000 7f4b0ccb2740 1 client.15459 shutdown 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 msgr2=0x5618e399d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 0x5618e399d020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9c0 tx=0x7f4af00e1e50 comp rx=0 tx=0).stop 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 shutdown_connections 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x5618e35e9070 0x5618e3a15ca0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618e35dd460 0x5618e3a11d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5618e35c8390 0x5618e399d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 --2- 172.21.15.43:0/3051129227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618e35c01b0 0x5618e399d020 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 >> 172.21.15.43:0/3051129227 conn(0x5618e398c0f0 msgr2=0x5618e399b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4ae8c00640 0 client.15459 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 shutdown_connections 2024-07-26T08:34:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 1 -- 172.21.15.43:0/3051129227 wait complete. 2024-07-26T08:34:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.384+0000 7f4b0ccb2740 20 client.15459 trim_cache size 0 max 16384 2024-07-26T08:34:30.391 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:34:30.392 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "no active scrubs running", 2024-07-26T08:34:30.392 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": {} 2024-07-26T08:34:30.392 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:34:30.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4ae40b3dc0 msgr2=0x7f4ae40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4ae40b3dc0 0x7f4ae40b62d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4af80094e0 tx=0x7f4af8009800 comp rx=0 tx=0).stop 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 msgr2=0x7f4b00101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 0x7f4b00101f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9f0 tx=0x7f4af000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 shutdown_connections 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f4ae40b3dc0 0x7f4ae40b62d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b00104ab0 0x7f4b001024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0010d630 0x7f4b00102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 --2- 172.21.15.43:0/596652162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b00104080 0x7f4b00101f90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.385+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 >> 172.21.15.43:0/596652162 conn(0x7f4b000fdcf0 msgr2=0x7f4b00107140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.386+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 shutdown_connections 2024-07-26T08:34:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:30.386+0000 7f4b04a00640 1 -- 172.21.15.43:0/596652162 wait complete. 2024-07-26T08:34:30.449 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-07-26T08:34:30.455 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-07-26T08:34:30.455 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-07-26T08:34:30.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:30 smithi063 ceph-mon[36747]: pgmap v525: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:34:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:30 smithi043 ceph-mon[32384]: pgmap v525: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:34:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:30 smithi133 ceph-mon[37053]: pgmap v525: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:34:31.677 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-26T08:34:31.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:34:32.052 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-07-26T08:34:32.157 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-07-26T08:34:32.226 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:32.250 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-07-26T08:34:32.254 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-07-26T08:34:32.255 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-07-26T08:34:32.340 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-07-26T08:34:32.351 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T08:34:32.351 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-07-26T08:34:32.411 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-07-26T08:34:32.412 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-07-26T08:34:32.412 DEBUG:teuthology.orchestra.run.smithi043:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-07-26T08:34:32.490 INFO:tasks.workunit.client.0.smithi043.stderr:+ KERNEL=linux-4.0.5 2024-07-26T08:34:32.490 INFO:tasks.workunit.client.0.smithi043.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-07-26T08:34:32.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:32 smithi043 ceph-mon[32384]: pgmap v526: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-07-26T08:34:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:32 smithi133 ceph-mon[37053]: pgmap v526: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-07-26T08:34:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:32 smithi063 ceph-mon[36747]: pgmap v526: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-07-26T08:34:34.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:34 smithi043 ceph-mon[32384]: pgmap v527: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-07-26T08:34:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:34 smithi133 ceph-mon[37053]: pgmap v527: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-07-26T08:34:34.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.811+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1671174183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 msgr2=0x7fe3c410b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:34.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.811+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1671174183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c410b340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009ca0 tx=0x7fe3ac02a8b0 comp rx=0 tx=0).stop 2024-07-26T08:34:34.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.811+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1671174183 shutdown_connections 2024-07-26T08:34:34.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.811+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1671174183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c410b880 0x7fe3c41120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:34.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.811+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1671174183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c410b340 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:34.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.811+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1671174183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c41055f0 0x7fe3c4105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:34.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.812+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1671174183 >> 172.21.15.43:0/1671174183 conn(0x7fe3c4101060 msgr2=0x7fe3c41034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:34.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.812+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1671174183 shutdown_connections 2024-07-26T08:34:34.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.812+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1671174183 wait complete. 2024-07-26T08:34:34.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.813+0000 7fe3c9a00640 1 Processor -- start 2024-07-26T08:34:34.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.813+0000 7fe3c9a00640 1 -- start start 2024-07-26T08:34:34.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c41055f0 0x7fe3c419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:34.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:34.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c410b880 0x7fe3c41a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:34.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c4115660 con 0x7fe3c410af30 2024-07-26T08:34:34.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41154e0 con 0x7fe3c410b880 2024-07-26T08:34:34.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41157e0 con 0x7fe3c41055f0 2024-07-26T08:34:34.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c41055f0 0x7fe3c419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:34.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:34.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37576/0 (socket says 172.21.15.43:37576) 2024-07-26T08:34:34.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c3400640 1 -- 172.21.15.43:0/1408011812 learned_addr learned my addr 172.21.15.43:0/1408011812 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:34.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c41055f0 0x7fe3c419c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:42000/0 (socket says 172.21.15.43:42000) 2024-07-26T08:34:34.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.814+0000 7fe3c9000640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c410b880 0x7fe3c41a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:34.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.815+0000 7fe3c3400640 1 -- 172.21.15.43:0/1408011812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c41055f0 msgr2=0x7fe3c419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:34.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.815+0000 7fe3c3400640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c41055f0 0x7fe3c419c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:34.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.815+0000 7fe3c3400640 1 -- 172.21.15.43:0/1408011812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c410b880 msgr2=0x7fe3c41a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:34.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.815+0000 7fe3c3400640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c410b880 0x7fe3c41a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:34.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.815+0000 7fe3c3400640 1 -- 172.21.15.43:0/1408011812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c41a1f80 con 0x7fe3c410af30 2024-07-26T08:34:34.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.815+0000 7fe3c9000640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c410b880 0x7fe3c41a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:34.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.816+0000 7fe3c3400640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c419c5b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000f80 tx=0x7fe3ac030ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:34.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.816+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0319d0 con 0x7fe3c410af30 2024-07-26T08:34:34.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.816+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3ac031b70 con 0x7fe3c410af30 2024-07-26T08:34:34.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.816+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c41a2210 con 0x7fe3c410af30 2024-07-26T08:34:34.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.816+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac03a6f0 con 0x7fe3c410af30 2024-07-26T08:34:34.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.816+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41a89d0 con 0x7fe3c410af30 2024-07-26T08:34:34.824 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:34 smithi063 ceph-mon[36747]: pgmap v527: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-07-26T08:34:34.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.818+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c4105a00 con 0x7fe3c410af30 2024-07-26T08:34:34.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.823+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe3ac0469e0 con 0x7fe3c410af30 2024-07-26T08:34:34.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.825+0000 7fe3c0c00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3a40b3dc0 0x7fe3a40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:34.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.826+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe3ac105a50 con 0x7fe3c410af30 2024-07-26T08:34:34.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.826+0000 7fe3c3e00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3a40b3dc0 0x7fe3a40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:34.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.827+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe3ac0cca70 con 0x7fe3c410af30 2024-07-26T08:34:34.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:34.827+0000 7fe3c3e00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3a40b3dc0 0x7fe3a40b62d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400bbe0 tx=0x7fe3b400b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:35.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.083+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3c419d140 con 0x7fe3c410af30 2024-07-26T08:34:35.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.085+0000 7fe3c0c00640 1 -- 172.21.15.43:0/1408011812 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11895 (secure 0 0 0) 0x7fe3ac0cc370 con 0x7fe3c410af30 2024-07-26T08:34:35.087 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:34:35.087 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"btime":"2024-07-26T08:33:02:007771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:33:01.263024+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24733,24710,24709]},"id":1}]} 2024-07-26T08:34:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 25 2024-07-26T08:34:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3a40b3dc0 msgr2=0x7fe3a40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3a40b3dc0 0x7fe3a40b62d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400bbe0 tx=0x7fe3b400b390 comp rx=0 tx=0).stop 2024-07-26T08:34:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 msgr2=0x7fe3c419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c419c5b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000f80 tx=0x7fe3ac030ea0 comp rx=0 tx=0).stop 2024-07-26T08:34:35.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 shutdown_connections 2024-07-26T08:34:35.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3a40b3dc0 0x7fe3a40b62d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:35.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3c410b880 0x7fe3c41a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:35.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3c410af30 0x7fe3c419c5b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.088+0000 7fe3c9a00640 1 --2- 172.21.15.43:0/1408011812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c41055f0 0x7fe3c419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.089+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 >> 172.21.15.43:0/1408011812 conn(0x7fe3c4101060 msgr2=0x7fe3c4103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.089+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 shutdown_connections 2024-07-26T08:34:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:35.089+0000 7fe3c9a00640 1 -- 172.21.15.43:0/1408011812 wait complete. 2024-07-26T08:34:35.447 INFO:tasks.workunit.client.0.smithi043.stderr:+ mkdir untar_tar 2024-07-26T08:34:35.450 INFO:tasks.workunit.client.0.smithi043.stderr:+ cd untar_tar 2024-07-26T08:34:35.451 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-07-26T08:34:35.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ 2024-07-26T08:34:35.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/00-INDEX 2024-07-26T08:34:35.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/ 2024-07-26T08:34:35.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/README 2024-07-26T08:34:35.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-07-26T08:34:35.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-07-26T08:34:35.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-07-26T08:34:35.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-07-26T08:34:35.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-07-26T08:34:35.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-07-26T08:34:35.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-07-26T08:34:35.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-07-26T08:34:35.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-07-26T08:34:35.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-07-26T08:34:35.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-07-26T08:34:35.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-07-26T08:34:35.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-07-26T08:34:35.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-07-26T08:34:35.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-07-26T08:34:35.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-07-26T08:34:35.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-07-26T08:34:35.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-07-26T08:34:35.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-07-26T08:34:35.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-07-26T08:34:35.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-07-26T08:34:35.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-07-26T08:34:35.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-07-26T08:34:35.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-07-26T08:34:35.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-07-26T08:34:35.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-07-26T08:34:35.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-07-26T08:34:35.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-07-26T08:34:35.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-07-26T08:34:35.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-07-26T08:34:35.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-07-26T08:34:35.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-07-26T08:34:35.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-07-26T08:34:35.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-07-26T08:34:35.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-07-26T08:34:35.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-07-26T08:34:35.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-07-26T08:34:35.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-07-26T08:34:35.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-07-26T08:34:35.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-07-26T08:34:35.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-07-26T08:34:35.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-07-26T08:34:35.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-07-26T08:34:35.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-07-26T08:34:35.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-07-26T08:34:35.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-07-26T08:34:35.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-07-26T08:34:35.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-07-26T08:34:35.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-07-26T08:34:35.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-07-26T08:34:35.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-07-26T08:34:35.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:35 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1408011812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:34:35.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-07-26T08:34:35.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-07-26T08:34:35.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-07-26T08:34:35.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-07-26T08:34:35.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-07-26T08:34:35.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-07-26T08:34:35.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-07-26T08:34:35.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-07-26T08:34:35.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-07-26T08:34:35.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-07-26T08:34:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:35 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1408011812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:34:35.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-07-26T08:34:35.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-07-26T08:34:35.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-07-26T08:34:35.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-07-26T08:34:35.779 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-07-26T08:34:35.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-07-26T08:34:35.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-07-26T08:34:35.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-07-26T08:34:35.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-07-26T08:34:35.796 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-07-26T08:34:35.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-07-26T08:34:35.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-07-26T08:34:35.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-07-26T08:34:35.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-07-26T08:34:35.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-07-26T08:34:35.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-07-26T08:34:35.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:35 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1408011812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:34:35.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-07-26T08:34:35.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-07-26T08:34:35.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-07-26T08:34:35.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-07-26T08:34:35.833 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-07-26T08:34:35.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-07-26T08:34:35.839 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-07-26T08:34:35.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-07-26T08:34:35.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-07-26T08:34:35.849 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-07-26T08:34:35.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-07-26T08:34:35.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-07-26T08:34:35.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-07-26T08:34:35.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-07-26T08:34:35.865 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-07-26T08:34:35.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-07-26T08:34:35.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-07-26T08:34:35.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-07-26T08:34:35.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-07-26T08:34:35.882 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-07-26T08:34:35.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-07-26T08:34:35.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-07-26T08:34:35.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-07-26T08:34:35.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-07-26T08:34:35.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-07-26T08:34:35.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-07-26T08:34:35.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-07-26T08:34:35.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-07-26T08:34:35.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-07-26T08:34:35.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-07-26T08:34:35.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-07-26T08:34:35.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-07-26T08:34:35.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-07-26T08:34:35.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-07-26T08:34:35.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-07-26T08:34:35.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-07-26T08:34:35.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-07-26T08:34:35.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-07-26T08:34:35.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-07-26T08:34:35.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-07-26T08:34:35.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-07-26T08:34:35.951 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-07-26T08:34:35.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-07-26T08:34:35.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-07-26T08:34:35.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-07-26T08:34:35.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-07-26T08:34:35.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-07-26T08:34:35.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-07-26T08:34:35.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-07-26T08:34:35.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-07-26T08:34:35.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-07-26T08:34:35.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-07-26T08:34:35.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-07-26T08:34:35.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-07-26T08:34:35.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-07-26T08:34:35.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-07-26T08:34:36.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-07-26T08:34:36.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-07-26T08:34:36.007 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-07-26T08:34:36.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-07-26T08:34:36.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-07-26T08:34:36.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-07-26T08:34:36.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-07-26T08:34:36.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-07-26T08:34:36.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-07-26T08:34:36.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-07-26T08:34:36.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-07-26T08:34:36.033 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-07-26T08:34:36.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-07-26T08:34:36.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-07-26T08:34:36.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-07-26T08:34:36.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-07-26T08:34:36.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-07-26T08:34:36.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-07-26T08:34:36.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-07-26T08:34:36.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-07-26T08:34:36.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-07-26T08:34:36.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-07-26T08:34:36.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-07-26T08:34:36.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-07-26T08:34:36.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-07-26T08:34:36.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-07-26T08:34:36.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-07-26T08:34:36.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-07-26T08:34:36.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-07-26T08:34:36.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-07-26T08:34:36.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-07-26T08:34:36.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-07-26T08:34:36.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-07-26T08:34:36.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-07-26T08:34:36.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-07-26T08:34:36.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-07-26T08:34:36.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-07-26T08:34:36.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-07-26T08:34:36.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-07-26T08:34:36.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-07-26T08:34:36.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-07-26T08:34:36.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-07-26T08:34:36.123 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-07-26T08:34:36.127 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-07-26T08:34:36.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-07-26T08:34:36.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-07-26T08:34:36.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-07-26T08:34:36.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-07-26T08:34:36.144 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-07-26T08:34:36.148 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-07-26T08:34:36.151 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-07-26T08:34:36.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-07-26T08:34:36.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-07-26T08:34:36.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-07-26T08:34:36.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-07-26T08:34:36.165 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-07-26T08:34:36.168 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-07-26T08:34:36.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-07-26T08:34:36.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-07-26T08:34:36.178 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-07-26T08:34:36.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-07-26T08:34:36.181 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-07-26T08:34:36.188 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-07-26T08:34:36.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-07-26T08:34:36.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-07-26T08:34:36.334 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-07-26T08:34:36.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-07-26T08:34:36.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-07-26T08:34:36.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-07-26T08:34:36.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-07-26T08:34:36.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-07-26T08:34:36.348 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-07-26T08:34:36.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-07-26T08:34:36.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-07-26T08:34:36.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-07-26T08:34:36.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-07-26T08:34:36.363 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-07-26T08:34:36.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-07-26T08:34:36.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-07-26T08:34:36.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-07-26T08:34:36.375 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-07-26T08:34:36.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-07-26T08:34:36.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-07-26T08:34:36.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-07-26T08:34:36.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-07-26T08:34:36.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-07-26T08:34:36.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-07-26T08:34:36.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-07-26T08:34:36.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-07-26T08:34:36.401 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-07-26T08:34:36.407 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-07-26T08:34:36.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-07-26T08:34:36.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-07-26T08:34:36.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-07-26T08:34:36.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-07-26T08:34:36.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-07-26T08:34:36.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-07-26T08:34:36.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-07-26T08:34:36.423 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-07-26T08:34:36.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-07-26T08:34:36.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-07-26T08:34:36.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-07-26T08:34:36.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-07-26T08:34:36.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-07-26T08:34:36.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-07-26T08:34:36.434 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-07-26T08:34:36.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-07-26T08:34:36.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-07-26T08:34:36.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-07-26T08:34:36.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-07-26T08:34:36.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-07-26T08:34:36.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-07-26T08:34:36.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-07-26T08:34:36.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-07-26T08:34:36.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-07-26T08:34:36.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-07-26T08:34:36.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-07-26T08:34:36.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-07-26T08:34:36.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-07-26T08:34:36.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-07-26T08:34:36.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-07-26T08:34:36.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-07-26T08:34:36.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-07-26T08:34:36.469 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-07-26T08:34:36.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-07-26T08:34:36.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-07-26T08:34:36.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/Changes 2024-07-26T08:34:36.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-07-26T08:34:36.479 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/CodingStyle 2024-07-26T08:34:36.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-07-26T08:34:36.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-07-26T08:34:36.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-07-26T08:34:36.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-07-26T08:34:36.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/ 2024-07-26T08:34:36.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-07-26T08:34:36.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-07-26T08:34:36.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-07-26T08:34:36.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-07-26T08:34:36.497 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-07-26T08:34:36.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-07-26T08:34:36.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-07-26T08:34:36.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-07-26T08:34:36.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-07-26T08:34:36.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-07-26T08:34:36.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-07-26T08:34:36.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-07-26T08:34:36.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-07-26T08:34:36.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-07-26T08:34:36.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-07-26T08:34:36.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-07-26T08:34:36.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-07-26T08:34:36.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-07-26T08:34:36.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-07-26T08:34:36.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-07-26T08:34:36.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-07-26T08:34:36.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-07-26T08:34:36.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-07-26T08:34:36.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-07-26T08:34:36.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-07-26T08:34:36.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-07-26T08:34:36.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-07-26T08:34:36.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-07-26T08:34:36.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-07-26T08:34:36.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-07-26T08:34:36.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-07-26T08:34:36.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-07-26T08:34:36.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-07-26T08:34:36.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-07-26T08:34:36.551 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-07-26T08:34:36.552 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-07-26T08:34:36.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-07-26T08:34:36.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-07-26T08:34:36.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-07-26T08:34:36.558 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-07-26T08:34:36.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-07-26T08:34:36.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-07-26T08:34:36.564 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-07-26T08:34:36.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-07-26T08:34:36.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-07-26T08:34:36.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-07-26T08:34:36.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-07-26T08:34:36.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-07-26T08:34:36.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-07-26T08:34:36.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-07-26T08:34:36.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-07-26T08:34:36.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-07-26T08:34:36.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-07-26T08:34:36.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-07-26T08:34:36.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-07-26T08:34:36.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-07-26T08:34:36.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-07-26T08:34:36.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-07-26T08:34:36.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-07-26T08:34:36.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-07-26T08:34:36.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-07-26T08:34:36.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-07-26T08:34:36.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-07-26T08:34:36.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-07-26T08:34:36.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-07-26T08:34:36.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-07-26T08:34:36.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-07-26T08:34:36.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-07-26T08:34:36.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-07-26T08:34:36.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-07-26T08:34:36.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-07-26T08:34:36.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-07-26T08:34:36.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-07-26T08:34:36.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-07-26T08:34:36.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-07-26T08:34:36.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-07-26T08:34:36.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-07-26T08:34:36.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-07-26T08:34:36.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-07-26T08:34:36.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-07-26T08:34:36.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-07-26T08:34:36.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-07-26T08:34:36.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-07-26T08:34:36.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-07-26T08:34:36.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-07-26T08:34:36.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-07-26T08:34:36.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-07-26T08:34:36.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-07-26T08:34:36.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-07-26T08:34:36.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-07-26T08:34:36.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-07-26T08:34:36.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-07-26T08:34:36.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-07-26T08:34:36.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-07-26T08:34:36.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-07-26T08:34:36.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-07-26T08:34:36.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-07-26T08:34:36.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-07-26T08:34:36.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-07-26T08:34:36.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-07-26T08:34:36.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-07-26T08:34:36.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-07-26T08:34:36.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-07-26T08:34:36.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-07-26T08:34:36.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-07-26T08:34:36.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-07-26T08:34:36.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-07-26T08:34:36.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-07-26T08:34:36.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-07-26T08:34:36.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-07-26T08:34:36.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-07-26T08:34:36.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-07-26T08:34:36.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-07-26T08:34:36.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-07-26T08:34:36.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-07-26T08:34:36.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-07-26T08:34:36.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-07-26T08:34:36.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-07-26T08:34:36.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-07-26T08:34:36.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-07-26T08:34:36.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-07-26T08:34:36.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-07-26T08:34:36.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-07-26T08:34:36.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-07-26T08:34:36.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-07-26T08:34:36.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-07-26T08:34:36.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-07-26T08:34:36.681 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-07-26T08:34:36.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-07-26T08:34:36.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-07-26T08:34:36.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-07-26T08:34:36.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-07-26T08:34:36.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-07-26T08:34:36.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-07-26T08:34:36.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-07-26T08:34:36.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-07-26T08:34:36.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-07-26T08:34:36.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-07-26T08:34:36.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-07-26T08:34:36.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-07-26T08:34:36.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-07-26T08:34:36.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-07-26T08:34:36.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-07-26T08:34:36.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-07-26T08:34:36.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-07-26T08:34:36.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-07-26T08:34:36.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-07-26T08:34:36.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-07-26T08:34:36.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-07-26T08:34:36.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-07-26T08:34:36.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-07-26T08:34:36.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-07-26T08:34:36.717 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:36.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-07-26T08:34:36.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-07-26T08:34:36.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-07-26T08:34:36.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-07-26T08:34:36.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-07-26T08:34:36.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-07-26T08:34:36.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-07-26T08:34:36.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-07-26T08:34:36.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-07-26T08:34:36.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-07-26T08:34:36.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-07-26T08:34:36.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-07-26T08:34:36.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:36 smithi043 ceph-mon[32384]: pgmap v528: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-07-26T08:34:36.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-07-26T08:34:36.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-07-26T08:34:36.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-07-26T08:34:36.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-07-26T08:34:36.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-07-26T08:34:36.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-07-26T08:34:36.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-07-26T08:34:36.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-07-26T08:34:36.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-07-26T08:34:36.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-07-26T08:34:36.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-07-26T08:34:36.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-07-26T08:34:36.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-07-26T08:34:36.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-07-26T08:34:36.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-07-26T08:34:36.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-07-26T08:34:36.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-07-26T08:34:36.755 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-07-26T08:34:36.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-07-26T08:34:36.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-07-26T08:34:36.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-07-26T08:34:36.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-07-26T08:34:36.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-07-26T08:34:36.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-07-26T08:34:36.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-07-26T08:34:36.765 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-07-26T08:34:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:36 smithi133 ceph-mon[37053]: pgmap v528: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-07-26T08:34:36.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-07-26T08:34:36.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-07-26T08:34:36.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-07-26T08:34:36.772 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-07-26T08:34:36.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-07-26T08:34:36.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-07-26T08:34:36.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-07-26T08:34:36.779 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-07-26T08:34:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:36 smithi063 ceph-mon[36747]: pgmap v528: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-07-26T08:34:38.575 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:38 smithi043 ceph-mon[32384]: pgmap v529: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-07-26T08:34:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:38 smithi133 ceph-mon[37053]: pgmap v529: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-07-26T08:34:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:38 smithi063 ceph-mon[36747]: pgmap v529: 129 pgs: 129 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.129+0000 7f9284a00640 1 -- 172.21.15.43:0/489303001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928010d650 msgr2=0x7f928010fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.129+0000 7f9284a00640 1 --2- 172.21.15.43:0/489303001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928010d650 0x7f928010fb40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9278009900 tx=0x7f927802a410 comp rx=0 tx=0).stop 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 -- 172.21.15.43:0/489303001 shutdown_connections 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 --2- 172.21.15.43:0/489303001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928010d650 0x7f928010fb40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 --2- 172.21.15.43:0/489303001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9280104b40 0x7f928010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 --2- 172.21.15.43:0/489303001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 -- 172.21.15.43:0/489303001 >> 172.21.15.43:0/489303001 conn(0x7f92800fdcf0 msgr2=0x7f9280100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:39.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 -- 172.21.15.43:0/489303001 shutdown_connections 2024-07-26T08:34:39.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.130+0000 7f9284a00640 1 -- 172.21.15.43:0/489303001 wait complete. 2024-07-26T08:34:39.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.131+0000 7f9284a00640 1 Processor -- start 2024-07-26T08:34:39.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 -- start start 2024-07-26T08:34:39.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9280104b40 0x7f9280102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f928010d650 0x7f92801029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92801133f0 con 0x7f928010d650 2024-07-26T08:34:39.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9280113270 con 0x7f92801041f0 2024-07-26T08:34:39.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.132+0000 7f9284a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9280113570 con 0x7f9280104b40 2024-07-26T08:34:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f928010d650 0x7f92801029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56334/0 (socket says 172.21.15.43:56334) 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 -- 172.21.15.43:0/937199855 learned_addr learned my addr 172.21.15.43:0/937199855 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927ea00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9280104b40 0x7f9280102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 -- 172.21.15.43:0/937199855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9280104b40 msgr2=0x7f9280102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9280104b40 0x7f9280102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 -- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f928010d650 msgr2=0x7f92801029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f928010d650 0x7f92801029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927f400640 1 -- 172.21.15.43:0/937199855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92801a80c0 con 0x7f92801041f0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.133+0000 7f927ea00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9280104b40 0x7f9280102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.134+0000 7f927f400640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280101f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f927000ebc0 tx=0x7f927000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.134+0000 7f9277e00640 1 -- 172.21.15.43:0/937199855 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270010630 con 0x7f92801041f0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.134+0000 7f9277e00640 1 -- 172.21.15.43:0/937199855 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9270010ca0 con 0x7f92801041f0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.134+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92801a83b0 con 0x7f92801041f0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.134+0000 7f9277e00640 1 -- 172.21.15.43:0/937199855 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270018ba0 con 0x7f92801041f0 2024-07-26T08:34:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.134+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92801a88f0 con 0x7f92801041f0 2024-07-26T08:34:39.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.137+0000 7f928cc5b740 1 Processor -- start 2024-07-26T08:34:39.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 -- start start 2024-07-26T08:34:39.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f9277e00640 1 -- 172.21.15.43:0/937199855 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f92700107d0 con 0x7f92801041f0 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 0x55aa5b043010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b043550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac7d390 0x55aa5b043a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa5afb9bd0 con 0x55aa5ac9e070 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55aa5afa90d0 con 0x55aa5ac751b0 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.138+0000 7f928cc5b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55aa5afad110 con 0x55aa5ac7d390 2024-07-26T08:34:39.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 0x55aa5b043010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b043550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 0x55aa5b043010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46912/0 (socket says 172.21.15.43:46912) 2024-07-26T08:34:39.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927fe00640 1 -- 172.21.15.43:0/3788467160 learned_addr learned my addr 172.21.15.43:0/3788467160 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:39.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927ea00640 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac7d390 0x55aa5b043a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927f400640 1 -- 172.21.15.43:0/3788467160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac7d390 msgr2=0x55aa5b043a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927f400640 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac7d390 0x55aa5b043a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927f400640 1 -- 172.21.15.43:0/3788467160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 msgr2=0x55aa5b043010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927f400640 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 0x55aa5b043010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927f400640 1 -- 172.21.15.43:0/3788467160 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa5ad09650 con 0x55aa5ac751b0 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.139+0000 7f927fe00640 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 0x55aa5b043010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f927f400640 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b043550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f92700e1d40 tx=0x7f92700ec670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabd7b4af0e0d803 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f926be00640 1 -- 172.21.15.43:0/3788467160 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700f3070 con 0x55aa5ac751b0 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f9277e00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f92640b3d40 0x7f92640b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f926be00640 1 -- 172.21.15.43:0/3788467160 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92700efaf0 con 0x55aa5ac751b0 2024-07-26T08:34:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f926be00640 1 -- 172.21.15.43:0/3788467160 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700ee950 con 0x55aa5ac751b0 2024-07-26T08:34:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f9277e00640 1 -- 172.21.15.43:0/937199855 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f92700e49f0 con 0x7f92801041f0 2024-07-26T08:34:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.140+0000 7f927fe00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f92640b3d40 0x7f92640b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 -- 172.21.15.43:0/3788467160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 msgr2=0x55aa5b043550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b043550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f92700e1d40 tx=0x7f92700ec670 comp rx=0 tx=0).stop 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 -- 172.21.15.43:0/3788467160 shutdown_connections 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac7d390 0x55aa5b043a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b043550 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 --2- 172.21.15.43:0/3788467160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac9e070 0x55aa5b043010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 -- 172.21.15.43:0/3788467160 >> 172.21.15.43:0/3788467160 conn(0x55aa5ac92460 msgr2=0x55aa5b040f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f927fe00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f92640b3d40 0x7f92640b6250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9278005f70 tx=0x7f9278005ee0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 -- 172.21.15.43:0/3788467160 shutdown_connections 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.141+0000 7f928cc5b740 1 -- 172.21.15.43:0/3788467160 wait complete. 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.142+0000 7f928cc5b740 1 -- start start 2024-07-26T08:34:39.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.142+0000 7f928cc5b740 1 Processor -- start 2024-07-26T08:34:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b04e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b04eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa5ae0c700 con 0x55aa5ac7d390 2024-07-26T08:34:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55aa5af456a0 con 0x55aa5ac751b0 2024-07-26T08:34:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55aa5b051840 con 0x55aa5ac9e070 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f928cc5b740 10 client.0 _ll_register_callbacks cb 0x55aa5af55150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f927ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b04eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f927ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b04eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46916/0 (socket says 172.21.15.43:46916) 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f927fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f927f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b04e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.143+0000 7f927ea00640 1 -- 172.21.15.43:0/2173811628 learned_addr learned my addr 172.21.15.43:0/2173811628 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927f400640 1 -- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 msgr2=0x55aa5b04f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927f400640 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927f400640 1 -- 172.21.15.43:0/2173811628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 msgr2=0x55aa5b04eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927f400640 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b04eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927f400640 1 -- 172.21.15.43:0/2173811628 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa5af5c840 con 0x55aa5ac751b0 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927fe00640 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f927f400640 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b04e640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f927000cba0 tx=0x7f9270000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3590a7ca81adda47 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.144+0000 7f9268c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f9268c00640 1 -- 172.21.15.43:0/2173811628 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700f3070 con 0x55aa5ac751b0 2024-07-26T08:34:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f9268c00640 1 -- 172.21.15.43:0/2173811628 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f92700af560 con 0x55aa5ac751b0 2024-07-26T08:34:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92700efaf0 con 0x55aa5ac751b0 2024-07-26T08:34:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f9268c00640 1 -- 172.21.15.43:0/2173811628 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92700a7170 con 0x55aa5ac751b0 2024-07-26T08:34:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f928cc5b740 10 client.25592 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa5b05d3f0 con 0x55aa5ac751b0 2024-07-26T08:34:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f9268c00640 1 -- 172.21.15.43:0/2173811628 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92700efaf0 con 0x55aa5ac751b0 2024-07-26T08:34:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.145+0000 7f9268c00640 1 -- 172.21.15.43:0/2173811628 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f92700ab510 con 0x55aa5ac751b0 2024-07-26T08:34:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f928cc5b740 10 client.25592 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f928cc5b740 10 client.25592 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:34:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f928cc5b740 20 client.25592 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac5c9f0 0x55aa5b060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f928cc5b740 4 client.25592 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa5afbbb20 con 0x55aa5ac5c9f0 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.146+0000 7f927ea00640 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac5c9f0 0x55aa5b060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.147+0000 7f927ea00640 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac5c9f0 0x55aa5b060750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c85458d711db1120 server_cookie=ba074d6e02be77ce in_seq=0 out_seq=0 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.147+0000 7f9268c00640 10 client.25592 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f9268c00640 1 -- 172.21.15.43:0/2173811628 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa5afbbb20 con 0x55aa5ac5c9f0 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f9268c00640 10 client.25592 handle_command_reply: tid=0 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 client.25592 shutdown 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 msgr2=0x55aa5b04e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b04e640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f927000cba0 tx=0x7f9270000f40 comp rx=0 tx=0).stop 2024-07-26T08:34:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 shutdown_connections 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac5c9f0 0x55aa5b060750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b04eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2173811628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b04e640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f9268c00640 0 client.25592 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 >> 172.21.15.43:0/2173811628 conn(0x55aa5ac92460 msgr2=0x55aa5b0461f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 shutdown_connections 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.148+0000 7f928cc5b740 1 -- 172.21.15.43:0/2173811628 wait complete. 2024-07-26T08:34:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.149+0000 7f928cc5b740 20 client.25592 trim_cache size 0 max 16384 2024-07-26T08:34:39.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.163+0000 7f928cc5b740 1 Processor -- start 2024-07-26T08:34:39.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.163+0000 7f928cc5b740 1 -- start start 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 0x55aa5b03ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac7d390 0x55aa5b05a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f928cc5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92801b5430 con 0x55aa5ac751b0 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f928cc5b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f92801b2d00 con 0x55aa5ac7d390 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f928cc5b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f92801b0b50 con 0x55aa5ac9e070 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f927f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 0x55aa5b03ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f927f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 0x55aa5b03ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46918/0 (socket says 172.21.15.43:46918) 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f927f400640 1 -- 172.21.15.43:0/2217529811 learned_addr learned my addr 172.21.15.43:0/2217529811 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f927ea00640 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac7d390 0x55aa5b05a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.164+0000 7f927fe00640 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927f400640 1 -- 172.21.15.43:0/2217529811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 msgr2=0x55aa5b04b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927f400640 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927f400640 1 -- 172.21.15.43:0/2217529811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac7d390 msgr2=0x55aa5b05a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927f400640 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac7d390 0x55aa5b05a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927f400640 1 -- 172.21.15.43:0/2217529811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa5b04f900 con 0x55aa5ac751b0 2024-07-26T08:34:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927ea00640 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac7d390 0x55aa5b05a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.165+0000 7f927f400640 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 0x55aa5b03ff00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f92700c2040 tx=0x7f9270009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a810c553a9d57e38 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.166+0000 7f926b400640 1 -- 172.21.15.43:0/2217529811 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700f3030 con 0x55aa5ac751b0 2024-07-26T08:34:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.166+0000 7f926b400640 1 -- 172.21.15.43:0/2217529811 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92700ece70 con 0x55aa5ac751b0 2024-07-26T08:34:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.166+0000 7f926b400640 1 -- 172.21.15.43:0/2217529811 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700e21d0 con 0x55aa5ac751b0 2024-07-26T08:34:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 -- 172.21.15.43:0/2217529811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 msgr2=0x55aa5b03ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 0x55aa5b03ff00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f92700c2040 tx=0x7f9270009200 comp rx=0 tx=0).stop 2024-07-26T08:34:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 -- 172.21.15.43:0/2217529811 shutdown_connections 2024-07-26T08:34:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b04b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac7d390 0x55aa5b05a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2217529811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac751b0 0x55aa5b03ff00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 -- 172.21.15.43:0/2217529811 >> 172.21.15.43:0/2217529811 conn(0x55aa5ac92460 msgr2=0x55aa5b059a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 -- 172.21.15.43:0/2217529811 shutdown_connections 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 -- 172.21.15.43:0/2217529811 wait complete. 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.167+0000 7f928cc5b740 1 -- start start 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 Processor -- start 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b063090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92801b11c0 con 0x55aa5ac7d390 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f92801b2630 con 0x55aa5ac751b0 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f92801b1890 con 0x55aa5ac9e070 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.168+0000 7f928cc5b740 10 client.0 _ll_register_callbacks cb 0x7f92700eaa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b062ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56370/0 (socket says 172.21.15.43:56370) 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 -- 172.21.15.43:0/2112407318 learned_addr learned my addr 172.21.15.43:0/2112407318 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927ea00640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927fe00640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 -- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 msgr2=0x55aa5b0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b0c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 -- 172.21.15.43:0/2112407318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 msgr2=0x55aa5b063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:39.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b063090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927f400640 1 -- 172.21.15.43:0/2112407318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa5b0c71e0 con 0x55aa5ac751b0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927fe00640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.169+0000 7f927ea00640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f927f400640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b062ad0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92700ab240 tx=0x7f92700ab740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec005a8c6673d654 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f9268c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f9268c00640 1 -- 172.21.15.43:0/2112407318 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700cb060 con 0x55aa5ac751b0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f9268c00640 1 -- 172.21.15.43:0/2112407318 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f92700ea040 con 0x55aa5ac751b0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92700ece70 con 0x55aa5ac751b0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f9268c00640 1 -- 172.21.15.43:0/2112407318 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92700aaa20 con 0x55aa5ac751b0 2024-07-26T08:34:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f928cc5b740 10 client.25598 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.170+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa5b0c71e0 con 0x55aa5ac751b0 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f9268c00640 1 -- 172.21.15.43:0/2112407318 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92700ece70 con 0x55aa5ac751b0 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f9268c00640 1 -- 172.21.15.43:0/2112407318 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f92700cc250 con 0x55aa5ac751b0 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f928cc5b740 10 client.25598 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f928cc5b740 10 client.25598 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f928cc5b740 20 client.25598 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac31da0 0x55aa5b0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f928cc5b740 4 client.25598 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa5afb75c0 con 0x55aa5ac31da0 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.171+0000 7f927ea00640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac31da0 0x55aa5b0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.172+0000 7f927ea00640 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac31da0 0x55aa5b0ca690 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f34ceb5a30aee1b7 server_cookie=2dfff487461e7681 in_seq=0 out_seq=0 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.172+0000 7f9268c00640 10 client.25598 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.172+0000 7f9268c00640 1 -- 172.21.15.43:0/2112407318 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa5afb75c0 con 0x55aa5ac31da0 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.172+0000 7f9268c00640 10 client.25598 handle_command_reply: tid=0 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.172+0000 7f928cc5b740 1 client.25598 shutdown 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 msgr2=0x55aa5b062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b062ad0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92700ab240 tx=0x7f92700ab740 comp rx=0 tx=0).stop 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 shutdown_connections 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55aa5ac31da0 0x55aa5b0ca690 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa5ac9e070 0x55aa5b0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa5ac7d390 0x55aa5b063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f9268c00640 0 client.25598 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 --2- 172.21.15.43:0/2112407318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aa5ac751b0 0x55aa5b062ad0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 >> 172.21.15.43:0/2112407318 conn(0x55aa5ac92460 msgr2=0x55aa5b03fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 shutdown_connections 2024-07-26T08:34:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 1 -- 172.21.15.43:0/2112407318 wait complete. 2024-07-26T08:34:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.173+0000 7f928cc5b740 20 client.25598 trim_cache size 0 max 16384 2024-07-26T08:34:39.178 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:34:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f92640b3d40 msgr2=0x7f92640b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f92640b3d40 0x7f92640b6250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9278005f70 tx=0x7f9278005ee0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 msgr2=0x7f9280101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280101f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f927000ebc0 tx=0x7f927000c6a0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 shutdown_connections 2024-07-26T08:34:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f92640b3d40 0x7f92640b6250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9280104b40 0x7f9280102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f928010d650 0x7f92801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 --2- 172.21.15.43:0/937199855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92801041f0 0x7f9280101f30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.174+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 >> 172.21.15.43:0/937199855 conn(0x7f92800fdcf0 msgr2=0x7f9280107100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.175+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 shutdown_connections 2024-07-26T08:34:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:39.175+0000 7f9284a00640 1 -- 172.21.15.43:0/937199855 wait complete. 2024-07-26T08:34:40.317 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-07-26T08:34:40.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:40 smithi043 ceph-mon[32384]: pgmap v530: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 350 KiB/s wr, 7 op/s 2024-07-26T08:34:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:40 smithi133 ceph-mon[37053]: pgmap v530: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 350 KiB/s wr, 7 op/s 2024-07-26T08:34:40.803 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:40.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:40 smithi063 ceph-mon[36747]: pgmap v530: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 350 KiB/s wr, 7 op/s 2024-07-26T08:34:41.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-07-26T08:34:41.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-07-26T08:34:41.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-07-26T08:34:41.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-07-26T08:34:41.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-07-26T08:34:41.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-07-26T08:34:41.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-07-26T08:34:41.434 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-07-26T08:34:41.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-07-26T08:34:41.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-07-26T08:34:41.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-07-26T08:34:41.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-07-26T08:34:41.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-07-26T08:34:41.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-07-26T08:34:41.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-07-26T08:34:41.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-07-26T08:34:41.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-07-26T08:34:41.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-07-26T08:34:41.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-07-26T08:34:41.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-07-26T08:34:41.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-07-26T08:34:41.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-07-26T08:34:41.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-07-26T08:34:41.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-07-26T08:34:41.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-07-26T08:34:41.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-07-26T08:34:41.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-07-26T08:34:41.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-07-26T08:34:41.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-07-26T08:34:41.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-07-26T08:34:41.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-07-26T08:34:41.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-07-26T08:34:41.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-07-26T08:34:41.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-07-26T08:34:41.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/ 2024-07-26T08:34:41.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-07-26T08:34:41.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-07-26T08:34:41.479 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-07-26T08:34:41.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-07-26T08:34:41.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-07-26T08:34:41.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-07-26T08:34:41.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-07-26T08:34:41.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-07-26T08:34:41.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-07-26T08:34:41.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/hex 2024-07-26T08:34:41.489 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/HOWTO 2024-07-26T08:34:41.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-07-26T08:34:41.492 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-07-26T08:34:41.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-07-26T08:34:41.494 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-07-26T08:34:41.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-07-26T08:34:41.497 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/Makefile 2024-07-26T08:34:41.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-07-26T08:34:41.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/ 2024-07-26T08:34:41.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-07-26T08:34:41.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-07-26T08:34:41.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-07-26T08:34:41.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-07-26T08:34:41.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-07-26T08:34:41.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-07-26T08:34:41.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-07-26T08:34:41.511 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/ 2024-07-26T08:34:41.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-07-26T08:34:41.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-07-26T08:34:41.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-07-26T08:34:41.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-07-26T08:34:41.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-07-26T08:34:41.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-07-26T08:34:41.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-07-26T08:34:41.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-07-26T08:34:41.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-07-26T08:34:41.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-07-26T08:34:41.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-07-26T08:34:41.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-07-26T08:34:41.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-07-26T08:34:41.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-07-26T08:34:41.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-07-26T08:34:41.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-07-26T08:34:41.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-07-26T08:34:41.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-07-26T08:34:41.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SAK.txt 2024-07-26T08:34:41.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SM501.txt 2024-07-26T08:34:41.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-07-26T08:34:41.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-07-26T08:34:41.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-07-26T08:34:41.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-07-26T08:34:41.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-07-26T08:34:41.551 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/ 2024-07-26T08:34:41.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-07-26T08:34:41.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-07-26T08:34:41.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-07-26T08:34:41.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-07-26T08:34:41.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-07-26T08:34:41.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-07-26T08:34:41.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-07-26T08:34:41.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/ 2024-07-26T08:34:41.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-07-26T08:34:41.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-07-26T08:34:41.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-07-26T08:34:41.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-07-26T08:34:41.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-07-26T08:34:41.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-07-26T08:34:41.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-07-26T08:34:41.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-07-26T08:34:41.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-07-26T08:34:41.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-07-26T08:34:41.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-07-26T08:34:41.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-07-26T08:34:41.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-07-26T08:34:41.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/ 2024-07-26T08:34:41.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-07-26T08:34:41.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-07-26T08:34:41.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-07-26T08:34:41.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-07-26T08:34:41.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-07-26T08:34:41.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-07-26T08:34:41.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-07-26T08:34:41.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/ 2024-07-26T08:34:41.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-07-26T08:34:41.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-07-26T08:34:41.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-07-26T08:34:41.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Booting 2024-07-26T08:34:41.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-07-26T08:34:41.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-07-26T08:34:41.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-07-26T08:34:41.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-07-26T08:34:41.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-07-26T08:34:41.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-07-26T08:34:41.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-07-26T08:34:41.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-07-26T08:34:41.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-07-26T08:34:41.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-07-26T08:34:41.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Porting 2024-07-26T08:34:41.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/README 2024-07-26T08:34:41.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-07-26T08:34:41.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-07-26T08:34:41.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-07-26T08:34:41.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-07-26T08:34:41.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-07-26T08:34:41.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-07-26T08:34:41.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-07-26T08:34:41.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-07-26T08:34:41.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-07-26T08:34:41.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-07-26T08:34:41.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-07-26T08:34:41.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-07-26T08:34:41.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-07-26T08:34:41.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-07-26T08:34:41.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-07-26T08:34:41.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-07-26T08:34:41.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-07-26T08:34:41.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-07-26T08:34:41.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-07-26T08:34:41.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-07-26T08:34:41.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-07-26T08:34:41.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-07-26T08:34:41.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-07-26T08:34:41.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-07-26T08:34:41.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-07-26T08:34:41.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-07-26T08:34:41.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-07-26T08:34:41.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-07-26T08:34:41.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-07-26T08:34:41.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-07-26T08:34:41.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-07-26T08:34:41.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-07-26T08:34:41.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-07-26T08:34:41.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-07-26T08:34:41.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-07-26T08:34:41.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-07-26T08:34:41.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-07-26T08:34:41.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-07-26T08:34:41.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-07-26T08:34:41.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-07-26T08:34:41.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-07-26T08:34:41.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-07-26T08:34:41.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-07-26T08:34:41.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Setup 2024-07-26T08:34:41.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-07-26T08:34:41.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-07-26T08:34:41.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-07-26T08:34:41.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-07-26T08:34:41.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-07-26T08:34:41.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-07-26T08:34:41.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-07-26T08:34:41.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-07-26T08:34:41.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-07-26T08:34:41.765 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-07-26T08:34:41.767 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-07-26T08:34:41.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-07-26T08:34:41.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-07-26T08:34:41.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-07-26T08:34:41.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-07-26T08:34:41.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-07-26T08:34:41.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-07-26T08:34:41.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-07-26T08:34:41.784 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-07-26T08:34:41.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-07-26T08:34:41.788 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-07-26T08:34:41.790 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-07-26T08:34:41.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-07-26T08:34:41.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-07-26T08:34:41.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-07-26T08:34:41.800 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-07-26T08:34:41.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-07-26T08:34:41.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-07-26T08:34:41.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-07-26T08:34:41.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-07-26T08:34:41.811 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/ 2024-07-26T08:34:41.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-07-26T08:34:41.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-07-26T08:34:41.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-07-26T08:34:41.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-07-26T08:34:41.824 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-07-26T08:34:41.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-07-26T08:34:41.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-07-26T08:34:41.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-07-26T08:34:41.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-07-26T08:34:41.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-07-26T08:34:41.840 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-07-26T08:34:41.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-07-26T08:34:41.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/backlight/ 2024-07-26T08:34:41.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-07-26T08:34:41.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-07-26T08:34:41.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-07-26T08:34:41.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bcache.txt 2024-07-26T08:34:41.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-07-26T08:34:41.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/ 2024-07-26T08:34:41.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-07-26T08:34:41.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-07-26T08:34:41.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-07-26T08:34:41.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-07-26T08:34:41.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-07-26T08:34:41.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/ 2024-07-26T08:34:41.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-07-26T08:34:41.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-07-26T08:34:41.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-07-26T08:34:41.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-07-26T08:34:41.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-07-26T08:34:41.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-07-26T08:34:41.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-07-26T08:34:41.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-07-26T08:34:41.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-07-26T08:34:41.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-07-26T08:34:41.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-07-26T08:34:41.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/request.txt 2024-07-26T08:34:41.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-07-26T08:34:41.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-07-26T08:34:41.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-07-26T08:34:41.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/ 2024-07-26T08:34:41.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-07-26T08:34:41.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-07-26T08:34:41.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-07-26T08:34:41.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-07-26T08:34:41.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-07-26T08:34:41.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-07-26T08:34:41.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-07-26T08:34:41.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-07-26T08:34:41.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-07-26T08:34:41.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-07-26T08:34:41.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-07-26T08:34:41.921 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-07-26T08:34:41.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-07-26T08:34:41.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-07-26T08:34:41.927 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-07-26T08:34:41.929 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-07-26T08:34:41.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-07-26T08:34:41.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-07-26T08:34:41.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-07-26T08:34:41.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-07-26T08:34:41.938 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-07-26T08:34:41.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-07-26T08:34:41.943 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-07-26T08:34:41.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-07-26T08:34:41.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-07-26T08:34:41.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-07-26T08:34:41.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/ 2024-07-26T08:34:41.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-07-26T08:34:41.957 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-07-26T08:34:41.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-07-26T08:34:41.962 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-07-26T08:34:41.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-07-26T08:34:41.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/ 2024-07-26T08:34:41.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-07-26T08:34:41.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-07-26T08:34:41.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-07-26T08:34:41.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-07-26T08:34:41.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-07-26T08:34:41.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-07-26T08:34:41.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-07-26T08:34:41.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-07-26T08:34:41.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-07-26T08:34:41.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-07-26T08:34:41.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-07-26T08:34:41.993 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-07-26T08:34:41.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-07-26T08:34:41.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-07-26T08:34:42.002 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/clk.txt 2024-07-26T08:34:42.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-07-26T08:34:42.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/ 2024-07-26T08:34:42.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-07-26T08:34:42.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-07-26T08:34:42.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-07-26T08:34:42.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-07-26T08:34:42.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-07-26T08:34:42.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/console/ 2024-07-26T08:34:42.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/console/console.txt 2024-07-26T08:34:42.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-07-26T08:34:42.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-07-26T08:34:42.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-07-26T08:34:42.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-07-26T08:34:42.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-07-26T08:34:42.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-07-26T08:34:42.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-07-26T08:34:42.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-07-26T08:34:42.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-07-26T08:34:42.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-07-26T08:34:42.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-07-26T08:34:42.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-07-26T08:34:42.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-07-26T08:34:42.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-07-26T08:34:42.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-07-26T08:34:42.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-07-26T08:34:42.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-07-26T08:34:42.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-07-26T08:34:42.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-07-26T08:34:42.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-07-26T08:34:42.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crc32.txt 2024-07-26T08:34:42.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cris/ 2024-07-26T08:34:42.062 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cris/README 2024-07-26T08:34:42.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/ 2024-07-26T08:34:42.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-07-26T08:34:42.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-07-26T08:34:42.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-07-26T08:34:42.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-07-26T08:34:42.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-07-26T08:34:42.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-07-26T08:34:42.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-07-26T08:34:42.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-07-26T08:34:42.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-07-26T08:34:42.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/ 2024-07-26T08:34:42.081 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-07-26T08:34:42.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-07-26T08:34:42.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-07-26T08:34:42.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-07-26T08:34:42.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-07-26T08:34:42.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-07-26T08:34:42.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-07-26T08:34:42.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-07-26T08:34:42.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-07-26T08:34:42.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-07-26T08:34:42.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-07-26T08:34:42.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-07-26T08:34:42.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-07-26T08:34:42.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-07-26T08:34:42.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-07-26T08:34:42.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-07-26T08:34:42.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-07-26T08:34:42.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-07-26T08:34:42.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-07-26T08:34:42.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-07-26T08:34:42.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-07-26T08:34:42.110 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-07-26T08:34:42.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-07-26T08:34:42.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-07-26T08:34:42.113 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-07-26T08:34:42.115 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-07-26T08:34:42.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-07-26T08:34:42.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-07-26T08:34:42.118 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-07-26T08:34:42.119 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-07-26T08:34:42.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-07-26T08:34:42.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devices.txt 2024-07-26T08:34:42.124 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/ 2024-07-26T08:34:42.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-07-26T08:34:42.126 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-07-26T08:34:42.127 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-07-26T08:34:42.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-07-26T08:34:42.129 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-07-26T08:34:42.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-07-26T08:34:42.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-07-26T08:34:42.133 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-07-26T08:34:42.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-07-26T08:34:42.135 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-07-26T08:34:42.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-07-26T08:34:42.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-07-26T08:34:42.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-07-26T08:34:42.140 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-07-26T08:34:42.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-07-26T08:34:42.142 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-07-26T08:34:42.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-07-26T08:34:42.144 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-07-26T08:34:42.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-07-26T08:34:42.147 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-07-26T08:34:42.148 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-07-26T08:34:42.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-07-26T08:34:42.150 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-07-26T08:34:42.152 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-07-26T08:34:42.153 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-07-26T08:34:42.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-07-26T08:34:42.155 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-07-26T08:34:42.156 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-07-26T08:34:42.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-07-26T08:34:42.159 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-07-26T08:34:42.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-07-26T08:34:42.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-07-26T08:34:42.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-07-26T08:34:42.163 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-07-26T08:34:42.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-07-26T08:34:42.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-07-26T08:34:42.167 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-07-26T08:34:42.168 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-07-26T08:34:42.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-07-26T08:34:42.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-07-26T08:34:42.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-07-26T08:34:42.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-07-26T08:34:42.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-07-26T08:34:42.175 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-07-26T08:34:42.176 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-07-26T08:34:42.177 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-07-26T08:34:42.179 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-07-26T08:34:42.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-07-26T08:34:42.181 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-07-26T08:34:42.182 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-07-26T08:34:42.183 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-07-26T08:34:42.185 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-07-26T08:34:42.186 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-07-26T08:34:42.187 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-07-26T08:34:42.188 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-07-26T08:34:42.189 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-07-26T08:34:42.190 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-07-26T08:34:42.191 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-07-26T08:34:42.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-07-26T08:34:42.194 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-07-26T08:34:42.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-07-26T08:34:42.196 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-07-26T08:34:42.197 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-07-26T08:34:42.198 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-07-26T08:34:42.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-07-26T08:34:42.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-07-26T08:34:42.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-07-26T08:34:42.203 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-07-26T08:34:42.205 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-07-26T08:34:42.206 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-07-26T08:34:42.207 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-07-26T08:34:42.208 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-07-26T08:34:42.210 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-07-26T08:34:42.211 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-07-26T08:34:42.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-07-26T08:34:42.213 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-07-26T08:34:42.215 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-07-26T08:34:42.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-07-26T08:34:42.217 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-07-26T08:34:42.219 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-07-26T08:34:42.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-07-26T08:34:42.221 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-07-26T08:34:42.222 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-07-26T08:34:42.223 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-07-26T08:34:42.224 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-07-26T08:34:42.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-07-26T08:34:42.226 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-07-26T08:34:42.228 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-07-26T08:34:42.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-07-26T08:34:42.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-07-26T08:34:42.232 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-07-26T08:34:42.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-07-26T08:34:42.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-07-26T08:34:42.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-07-26T08:34:42.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-07-26T08:34:42.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-07-26T08:34:42.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-07-26T08:34:42.248 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-07-26T08:34:42.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-07-26T08:34:42.251 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-07-26T08:34:42.253 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-07-26T08:34:42.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-07-26T08:34:42.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-07-26T08:34:42.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-07-26T08:34:42.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-07-26T08:34:42.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-07-26T08:34:42.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-07-26T08:34:42.262 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-07-26T08:34:42.264 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-07-26T08:34:42.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-07-26T08:34:42.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-07-26T08:34:42.267 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-07-26T08:34:42.268 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-07-26T08:34:42.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-07-26T08:34:42.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-07-26T08:34:42.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-07-26T08:34:42.273 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-07-26T08:34:42.274 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-07-26T08:34:42.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-07-26T08:34:42.276 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-07-26T08:34:42.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-07-26T08:34:42.279 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-07-26T08:34:42.280 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-07-26T08:34:42.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-07-26T08:34:42.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-07-26T08:34:42.283 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-07-26T08:34:42.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-07-26T08:34:42.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-07-26T08:34:42.287 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-07-26T08:34:42.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-07-26T08:34:42.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-07-26T08:34:42.291 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-07-26T08:34:42.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-07-26T08:34:42.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-07-26T08:34:42.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-07-26T08:34:42.295 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-07-26T08:34:42.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-07-26T08:34:42.297 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-07-26T08:34:42.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-07-26T08:34:42.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-07-26T08:34:42.301 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-07-26T08:34:42.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-07-26T08:34:42.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-07-26T08:34:42.305 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-07-26T08:34:42.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-07-26T08:34:42.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-07-26T08:34:42.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-07-26T08:34:42.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-07-26T08:34:42.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-07-26T08:34:42.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-07-26T08:34:42.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-07-26T08:34:42.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-07-26T08:34:42.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-07-26T08:34:42.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-07-26T08:34:42.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-07-26T08:34:42.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-07-26T08:34:42.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-07-26T08:34:42.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-07-26T08:34:42.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-07-26T08:34:42.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-07-26T08:34:42.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-07-26T08:34:42.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-07-26T08:34:42.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-07-26T08:34:42.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-07-26T08:34:42.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-07-26T08:34:42.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-07-26T08:34:42.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-07-26T08:34:42.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-07-26T08:34:42.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-07-26T08:34:42.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-07-26T08:34:42.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-07-26T08:34:42.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-07-26T08:34:42.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-07-26T08:34:42.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-07-26T08:34:42.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-07-26T08:34:42.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-07-26T08:34:42.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-07-26T08:34:42.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-07-26T08:34:42.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-07-26T08:34:42.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-07-26T08:34:42.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-07-26T08:34:42.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-07-26T08:34:42.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-07-26T08:34:42.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-07-26T08:34:42.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-07-26T08:34:42.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-07-26T08:34:42.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-07-26T08:34:42.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-07-26T08:34:42.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-07-26T08:34:42.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-07-26T08:34:42.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-07-26T08:34:42.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-07-26T08:34:42.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-07-26T08:34:42.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-07-26T08:34:42.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-07-26T08:34:42.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-07-26T08:34:42.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-07-26T08:34:42.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-07-26T08:34:42.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-07-26T08:34:42.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-07-26T08:34:42.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-07-26T08:34:42.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-07-26T08:34:42.732 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-07-26T08:34:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:42 smithi043 ceph-mon[32384]: pgmap v531: 129 pgs: 129 active+clean; 34 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T08:34:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:34:42.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-07-26T08:34:42.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-07-26T08:34:42.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-07-26T08:34:42.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-07-26T08:34:42.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-07-26T08:34:42.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-07-26T08:34:42.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-07-26T08:34:42.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-07-26T08:34:42.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-07-26T08:34:42.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-07-26T08:34:42.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-07-26T08:34:42.755 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-07-26T08:34:42.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-07-26T08:34:42.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-07-26T08:34:42.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-07-26T08:34:42.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-07-26T08:34:42.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-07-26T08:34:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:42 smithi133 ceph-mon[37053]: pgmap v531: 129 pgs: 129 active+clean; 34 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T08:34:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:34:42.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-07-26T08:34:42.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-07-26T08:34:42.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-07-26T08:34:42.772 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-07-26T08:34:42.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-07-26T08:34:42.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-07-26T08:34:42.778 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-07-26T08:34:42.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-07-26T08:34:42.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-07-26T08:34:42.785 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-07-26T08:34:42.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-07-26T08:34:42.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-07-26T08:34:42.791 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-07-26T08:34:42.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-07-26T08:34:42.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-07-26T08:34:42.796 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-07-26T08:34:42.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-07-26T08:34:42.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-07-26T08:34:42.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-07-26T08:34:42.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-07-26T08:34:42.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-07-26T08:34:42.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-07-26T08:34:42.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-07-26T08:34:42.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-07-26T08:34:42.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-07-26T08:34:42.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-07-26T08:34:42.811 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-07-26T08:34:42.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-07-26T08:34:42.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-07-26T08:34:42.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-07-26T08:34:42.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-07-26T08:34:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:42 smithi063 ceph-mon[36747]: pgmap v531: 129 pgs: 129 active+clean; 34 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T08:34:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:34:42.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-07-26T08:34:42.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-07-26T08:34:42.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-07-26T08:34:42.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-07-26T08:34:42.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-07-26T08:34:42.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-07-26T08:34:42.825 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-07-26T08:34:42.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-07-26T08:34:42.827 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-07-26T08:34:42.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-07-26T08:34:42.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-07-26T08:34:42.830 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-07-26T08:34:42.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-07-26T08:34:42.833 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-07-26T08:34:42.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-07-26T08:34:42.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-07-26T08:34:42.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-07-26T08:34:42.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-07-26T08:34:42.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-07-26T08:34:42.840 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-07-26T08:34:42.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-07-26T08:34:42.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-07-26T08:34:42.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-07-26T08:34:42.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-07-26T08:34:42.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-07-26T08:34:42.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-07-26T08:34:42.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-07-26T08:34:42.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-07-26T08:34:42.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-07-26T08:34:42.853 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-07-26T08:34:42.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-07-26T08:34:42.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-07-26T08:34:42.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-07-26T08:34:42.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-07-26T08:34:42.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-07-26T08:34:42.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-07-26T08:34:42.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-07-26T08:34:42.864 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-07-26T08:34:42.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-07-26T08:34:42.867 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-07-26T08:34:42.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-07-26T08:34:42.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-07-26T08:34:42.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-07-26T08:34:42.871 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-07-26T08:34:42.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-07-26T08:34:42.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-07-26T08:34:42.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-07-26T08:34:42.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-07-26T08:34:42.877 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-07-26T08:34:42.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-07-26T08:34:42.879 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-07-26T08:34:42.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-07-26T08:34:42.882 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-07-26T08:34:42.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-07-26T08:34:42.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-07-26T08:34:42.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-07-26T08:34:42.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-07-26T08:34:42.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-07-26T08:34:42.890 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-07-26T08:34:42.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-07-26T08:34:42.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-07-26T08:34:42.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-07-26T08:34:42.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-07-26T08:34:42.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-07-26T08:34:42.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-07-26T08:34:42.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-07-26T08:34:42.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-07-26T08:34:42.904 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-07-26T08:34:42.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-07-26T08:34:42.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-07-26T08:34:42.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-07-26T08:34:42.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-07-26T08:34:42.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-07-26T08:34:42.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-07-26T08:34:42.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-07-26T08:34:42.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-07-26T08:34:42.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-07-26T08:34:42.924 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-07-26T08:34:42.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-07-26T08:34:42.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-07-26T08:34:42.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-07-26T08:34:42.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-07-26T08:34:42.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-07-26T08:34:42.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-07-26T08:34:42.938 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-07-26T08:34:42.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-07-26T08:34:42.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-07-26T08:34:42.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-07-26T08:34:42.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-07-26T08:34:42.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-07-26T08:34:42.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-07-26T08:34:42.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-07-26T08:34:42.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-07-26T08:34:42.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-07-26T08:34:42.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-07-26T08:34:42.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-07-26T08:34:42.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-07-26T08:34:42.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-07-26T08:34:42.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-07-26T08:34:42.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-07-26T08:34:42.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-07-26T08:34:42.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-07-26T08:34:42.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-07-26T08:34:42.974 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-07-26T08:34:42.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-07-26T08:34:42.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-07-26T08:34:42.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-07-26T08:34:42.979 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-07-26T08:34:42.981 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-07-26T08:34:42.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-07-26T08:34:42.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-07-26T08:34:42.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-07-26T08:34:42.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-07-26T08:34:42.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-07-26T08:34:42.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-07-26T08:34:42.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-07-26T08:34:42.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-07-26T08:34:42.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-07-26T08:34:42.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-07-26T08:34:42.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-07-26T08:34:42.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-07-26T08:34:42.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-07-26T08:34:43.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-07-26T08:34:43.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-07-26T08:34:43.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-07-26T08:34:43.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-07-26T08:34:43.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-07-26T08:34:43.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-07-26T08:34:43.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-07-26T08:34:43.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-07-26T08:34:43.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-07-26T08:34:43.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-07-26T08:34:43.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-07-26T08:34:43.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-07-26T08:34:43.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-07-26T08:34:43.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-07-26T08:34:43.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-07-26T08:34:43.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-07-26T08:34:43.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-07-26T08:34:43.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-07-26T08:34:43.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-07-26T08:34:43.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-07-26T08:34:43.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-07-26T08:34:43.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-07-26T08:34:43.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-07-26T08:34:43.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-07-26T08:34:43.030 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-07-26T08:34:43.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-07-26T08:34:43.032 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-07-26T08:34:43.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-07-26T08:34:43.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-07-26T08:34:43.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-07-26T08:34:43.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-07-26T08:34:43.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-07-26T08:34:43.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-07-26T08:34:43.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-07-26T08:34:43.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-07-26T08:34:43.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-07-26T08:34:43.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-07-26T08:34:43.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-07-26T08:34:43.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-07-26T08:34:43.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-07-26T08:34:43.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-07-26T08:34:43.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-07-26T08:34:43.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-07-26T08:34:43.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-07-26T08:34:43.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-07-26T08:34:43.062 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-07-26T08:34:43.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-07-26T08:34:43.065 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-07-26T08:34:43.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-07-26T08:34:43.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-07-26T08:34:43.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-07-26T08:34:43.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-07-26T08:34:43.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-07-26T08:34:43.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-07-26T08:34:43.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-07-26T08:34:43.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-07-26T08:34:43.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-07-26T08:34:43.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-07-26T08:34:43.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-07-26T08:34:43.079 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-07-26T08:34:43.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-07-26T08:34:43.081 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-07-26T08:34:43.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-07-26T08:34:43.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-07-26T08:34:43.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-07-26T08:34:43.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-07-26T08:34:43.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-07-26T08:34:43.088 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-07-26T08:34:43.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-07-26T08:34:43.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-07-26T08:34:43.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-07-26T08:34:43.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-07-26T08:34:43.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-07-26T08:34:43.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-07-26T08:34:43.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-07-26T08:34:43.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-07-26T08:34:43.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-07-26T08:34:43.099 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-07-26T08:34:43.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-07-26T08:34:43.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-07-26T08:34:43.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-07-26T08:34:43.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-07-26T08:34:43.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-07-26T08:34:43.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-07-26T08:34:43.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-07-26T08:34:43.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-07-26T08:34:43.110 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-07-26T08:34:43.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-07-26T08:34:43.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-07-26T08:34:43.113 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-07-26T08:34:43.115 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-07-26T08:34:43.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-07-26T08:34:43.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-07-26T08:34:43.119 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-07-26T08:34:43.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-07-26T08:34:43.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-07-26T08:34:43.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-07-26T08:34:43.123 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-07-26T08:34:43.124 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-07-26T08:34:43.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-07-26T08:34:43.126 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-07-26T08:34:43.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-07-26T08:34:43.129 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-07-26T08:34:43.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-07-26T08:34:43.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-07-26T08:34:43.133 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-07-26T08:34:43.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-07-26T08:34:43.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-07-26T08:34:43.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-07-26T08:34:43.138 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-07-26T08:34:43.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-07-26T08:34:43.140 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-07-26T08:34:43.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-07-26T08:34:43.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-07-26T08:34:43.144 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-07-26T08:34:43.145 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-07-26T08:34:43.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-07-26T08:34:43.147 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-07-26T08:34:43.148 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-07-26T08:34:43.150 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-07-26T08:34:43.151 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-07-26T08:34:43.153 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-07-26T08:34:43.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-07-26T08:34:43.156 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-07-26T08:34:43.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-07-26T08:34:43.158 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-07-26T08:34:43.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-07-26T08:34:43.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-07-26T08:34:43.163 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-07-26T08:34:43.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-07-26T08:34:43.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-07-26T08:34:43.167 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-07-26T08:34:43.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-07-26T08:34:43.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-07-26T08:34:43.173 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-07-26T08:34:43.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-07-26T08:34:43.176 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-07-26T08:34:43.177 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-07-26T08:34:43.179 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-07-26T08:34:43.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-07-26T08:34:43.182 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-07-26T08:34:43.183 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-07-26T08:34:43.185 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-07-26T08:34:43.186 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-07-26T08:34:43.187 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-07-26T08:34:43.189 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-07-26T08:34:43.191 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-07-26T08:34:43.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-07-26T08:34:43.194 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-07-26T08:34:43.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-07-26T08:34:43.197 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-07-26T08:34:43.198 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-07-26T08:34:43.200 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-07-26T08:34:43.201 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-07-26T08:34:43.203 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-07-26T08:34:43.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-07-26T08:34:43.206 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-07-26T08:34:43.208 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-07-26T08:34:43.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-07-26T08:34:43.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-07-26T08:34:43.215 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-07-26T08:34:43.217 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-07-26T08:34:43.219 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-07-26T08:34:43.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-07-26T08:34:43.222 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-07-26T08:34:43.223 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-07-26T08:34:43.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-07-26T08:34:43.226 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-07-26T08:34:43.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-07-26T08:34:43.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-07-26T08:34:43.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-07-26T08:34:43.232 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-07-26T08:34:43.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-07-26T08:34:43.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-07-26T08:34:43.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-07-26T08:34:43.237 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-07-26T08:34:43.239 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-07-26T08:34:43.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-07-26T08:34:43.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-07-26T08:34:43.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-07-26T08:34:43.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-07-26T08:34:43.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-07-26T08:34:43.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-07-26T08:34:43.247 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-07-26T08:34:43.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-07-26T08:34:43.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-07-26T08:34:43.251 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-07-26T08:34:43.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-07-26T08:34:43.254 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-07-26T08:34:43.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-07-26T08:34:43.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-07-26T08:34:43.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-07-26T08:34:43.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-07-26T08:34:43.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-07-26T08:34:43.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-07-26T08:34:43.264 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-07-26T08:34:43.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-07-26T08:34:43.267 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-07-26T08:34:43.269 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-07-26T08:34:43.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-07-26T08:34:43.271 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-07-26T08:34:43.273 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-07-26T08:34:43.274 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-07-26T08:34:43.276 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-07-26T08:34:43.277 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-07-26T08:34:43.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-07-26T08:34:43.280 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-07-26T08:34:43.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-07-26T08:34:43.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-07-26T08:34:43.284 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-07-26T08:34:43.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-07-26T08:34:43.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-07-26T08:34:43.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-07-26T08:34:43.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-07-26T08:34:43.290 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-07-26T08:34:43.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-07-26T08:34:43.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-07-26T08:34:43.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-07-26T08:34:43.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-07-26T08:34:43.297 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-07-26T08:34:43.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-07-26T08:34:43.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-07-26T08:34:43.301 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-07-26T08:34:43.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-07-26T08:34:43.304 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-07-26T08:34:43.305 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-07-26T08:34:43.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-07-26T08:34:43.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-07-26T08:34:43.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-07-26T08:34:43.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-07-26T08:34:43.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-07-26T08:34:43.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-07-26T08:34:43.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-07-26T08:34:43.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-07-26T08:34:43.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-07-26T08:34:43.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-07-26T08:34:43.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-07-26T08:34:43.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-07-26T08:34:43.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-07-26T08:34:43.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-07-26T08:34:43.326 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-07-26T08:34:43.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-07-26T08:34:43.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-07-26T08:34:43.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-07-26T08:34:43.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-07-26T08:34:43.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-07-26T08:34:43.335 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-07-26T08:34:43.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-07-26T08:34:43.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-07-26T08:34:43.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-07-26T08:34:43.341 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-07-26T08:34:43.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-07-26T08:34:43.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-07-26T08:34:43.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-07-26T08:34:43.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-07-26T08:34:43.348 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-07-26T08:34:43.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-07-26T08:34:43.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-07-26T08:34:43.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-07-26T08:34:43.354 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-07-26T08:34:43.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-07-26T08:34:43.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-07-26T08:34:43.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-07-26T08:34:43.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-07-26T08:34:43.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-07-26T08:34:43.367 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-07-26T08:34:43.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-07-26T08:34:43.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-07-26T08:34:43.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-07-26T08:34:43.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-07-26T08:34:43.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-07-26T08:34:43.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-07-26T08:34:43.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-07-26T08:34:43.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-07-26T08:34:43.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-07-26T08:34:43.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-07-26T08:34:43.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-07-26T08:34:43.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-07-26T08:34:43.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-07-26T08:34:43.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-07-26T08:34:43.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-07-26T08:34:43.407 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-07-26T08:34:43.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-07-26T08:34:43.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-07-26T08:34:43.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-07-26T08:34:43.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-07-26T08:34:43.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 -- 172.21.15.43:0/494953867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 msgr2=0x7fc0b8075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 --2- 172.21.15.43:0/494953867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b8075c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009900 tx=0x7fc0a402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 -- 172.21.15.43:0/494953867 shutdown_connections 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 --2- 172.21.15.43:0/494953867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8113e60 0x7fc0b8116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 --2- 172.21.15.43:0/494953867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b8075c10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 --2- 172.21.15.43:0/494953867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8076db0 0x7fc0b80751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 -- 172.21.15.43:0/494953867 >> 172.21.15.43:0/494953867 conn(0x7fc0b807b280 msgr2=0x7fc0b807b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.431+0000 7fc0bd800640 1 -- 172.21.15.43:0/494953867 shutdown_connections 2024-07-26T08:34:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.432+0000 7fc0bd800640 1 -- 172.21.15.43:0/494953867 wait complete. 2024-07-26T08:34:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.433+0000 7fc0bd800640 1 Processor -- start 2024-07-26T08:34:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.433+0000 7fc0bd800640 1 -- start start 2024-07-26T08:34:43.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.433+0000 7fc0bd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b81a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.433+0000 7fc0bd800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 0x7fc0b81a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0bd800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8113e60 0x7fc0b81a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0bd800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8119c10 con 0x7fc0b8075800 2024-07-26T08:34:43.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0bd800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8119a90 con 0x7fc0b8076db0 2024-07-26T08:34:43.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0bd800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8119d90 con 0x7fc0b8113e60 2024-07-26T08:34:43.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 0x7fc0b81a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b81a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 0x7fc0b81a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56390/0 (socket says 172.21.15.43:56390) 2024-07-26T08:34:43.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6000640 1 -- 172.21.15.43:0/3414841323 learned_addr learned my addr 172.21.15.43:0/3414841323 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b7400640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8113e60 0x7fc0b81a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6000640 1 -- 172.21.15.43:0/3414841323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8113e60 msgr2=0x7fc0b81a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6000640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8113e60 0x7fc0b81a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.434+0000 7fc0b6000640 1 -- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 msgr2=0x7fc0b81a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.435+0000 7fc0b6000640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b81a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.435+0000 7fc0b6000640 1 -- 172.21.15.43:0/3414841323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b81a64f0 con 0x7fc0b8076db0 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.435+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b81a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.435+0000 7fc0b6000640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 0x7fc0b81a0b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0a402a9e0 tx=0x7fc0a4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.435+0000 7fc0af400640 1 -- 172.21.15.43:0/3414841323 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a403f070 con 0x7fc0b8076db0 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.436+0000 7fc0af400640 1 -- 172.21.15.43:0/3414841323 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0a4031be0 con 0x7fc0b8076db0 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.436+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b81a6780 con 0x7fc0b8076db0 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.436+0000 7fc0af400640 1 -- 172.21.15.43:0/3414841323 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4035030 con 0x7fc0b8076db0 2024-07-26T08:34:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.436+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b81acf40 con 0x7fc0b8076db0 2024-07-26T08:34:43.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.440+0000 7fc0c443b740 1 Processor -- start 2024-07-26T08:34:43.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 -- start start 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 0x55ca9adb8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adb9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adb98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ca9ad2fbd0 con 0x55ca9a9f3390 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ca9ad1f0d0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0c443b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ca9ad23110 con 0x55ca9aa14070 2024-07-26T08:34:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.441+0000 7fc0af400640 1 -- 172.21.15.43:0/3414841323 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc0a4042070 con 0x7fc0b8076db0 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 0x55ca9adb8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 0x55ca9adb8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49858/0 (socket says 172.21.15.43:49858) 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 -- 172.21.15.43:0/3534549924 learned_addr learned my addr 172.21.15.43:0/3534549924 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 -- 172.21.15.43:0/3534549924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 msgr2=0x55ca9adb9370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adb9370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 -- 172.21.15.43:0/3534549924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 msgr2=0x55ca9adb98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b6000640 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adb98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adb98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b7400640 1 -- 172.21.15.43:0/3534549924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9aa7f650 con 0x55ca9aa14070 2024-07-26T08:34:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.442+0000 7fc0b6000640 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adb98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:34:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.443+0000 7fc0b7400640 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 0x55ca9adb8e30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009f90 tx=0x7fc0b0010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43817f7447a87f5f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.443+0000 7fc0a3e00640 1 -- 172.21.15.43:0/3534549924 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011700 con 0x55ca9aa14070 2024-07-26T08:34:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.443+0000 7fc0a3e00640 1 -- 172.21.15.43:0/3534549924 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0b0011d70 con 0x55ca9aa14070 2024-07-26T08:34:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.443+0000 7fc0a3e00640 1 -- 172.21.15.43:0/3534549924 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0018380 con 0x55ca9aa14070 2024-07-26T08:34:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.444+0000 7fc0af400640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc09c0b3d40 0x7fc09c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.444+0000 7fc0af400640 1 -- 172.21.15.43:0/3414841323 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc0a4104b00 con 0x7fc0b8076db0 2024-07-26T08:34:43.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.444+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc09c0b3d40 0x7fc09c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.444+0000 7fc0c443b740 1 -- 172.21.15.43:0/3534549924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 msgr2=0x55ca9adb8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.444+0000 7fc0c443b740 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 0x55ca9adb8e30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009f90 tx=0x7fc0b0010860 comp rx=0 tx=0).stop 2024-07-26T08:34:43.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 -- 172.21.15.43:0/3534549924 shutdown_connections 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adb98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adb9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 --2- 172.21.15.43:0/3534549924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa14070 0x55ca9adb8e30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 -- 172.21.15.43:0/3534549924 >> 172.21.15.43:0/3534549924 conn(0x55ca9aa08460 msgr2=0x55ca9adb6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 -- 172.21.15.43:0/3534549924 shutdown_connections 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0c443b740 1 -- 172.21.15.43:0/3534549924 wait complete. 2024-07-26T08:34:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.445+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc09c0b3d40 0x7fc09c0b6250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55ca9adb7ab0 tx=0x7fc0a800b410 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:43.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.446+0000 7fc0c443b740 1 -- start start 2024-07-26T08:34:43.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.446+0000 7fc0c443b740 1 Processor -- start 2024-07-26T08:34:43.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adc43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9f3390 0x55ca9adc4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa14070 0x55ca9adc4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ca9ab82700 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ca9acbb6a0 con 0x55ca9aa14070 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ca9adc7610 con 0x55ca9a9f3390 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0c443b740 10 client.0 _ll_register_callbacks cb 0x55ca9accb150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adc43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0b6000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9f3390 0x55ca9adc4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adc43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46968/0 (socket says 172.21.15.43:46968) 2024-07-26T08:34:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0b6a00640 1 -- 172.21.15.43:0/2348504511 learned_addr learned my addr 172.21.15.43:0/2348504511 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.447+0000 7fc0b7400640 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa14070 0x55ca9adc4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.448+0000 7fc0b7400640 1 -- 172.21.15.43:0/2348504511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9f3390 msgr2=0x55ca9adc4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.448+0000 7fc0b7400640 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9f3390 0x55ca9adc4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.448+0000 7fc0b7400640 1 -- 172.21.15.43:0/2348504511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9eb1b0 msgr2=0x55ca9adc43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.448+0000 7fc0b7400640 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adc43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.448+0000 7fc0b7400640 1 -- 172.21.15.43:0/2348504511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca9acd2840 con 0x55ca9aa14070 2024-07-26T08:34:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.448+0000 7fc0b7400640 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa14070 0x55ca9adc4e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0019c20 tx=0x7fc0b0009cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5969a786eae9f1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0a0c00640 1 -- 172.21.15.43:0/2348504511 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0027020 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0a0c00640 1 -- 172.21.15.43:0/2348504511 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc0b00193d0 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b0011d70 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0a0c00640 1 -- 172.21.15.43:0/2348504511 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc0b0032050 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0c443b740 10 client.25607 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.449+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca9add3180 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0a0c00640 1 -- 172.21.15.43:0/2348504511 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0b0011d70 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0a0c00640 1 -- 172.21.15.43:0/2348504511 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc0b0011990 con 0x55ca9aa14070 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0c443b740 10 client.25607 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0c443b740 10 client.25607 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0c443b740 20 client.25607 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0c443b740 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9a9d29f0 0x55ca9add6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0c443b740 4 client.25607 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca9ad31b20 con 0x55ca9a9d29f0 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.450+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9a9d29f0 0x55ca9add6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.451+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9a9d29f0 0x55ca9add6590 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9123fb36ddf62352 server_cookie=63db7e202efe83ec in_seq=0 out_seq=0 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.451+0000 7fc0a0c00640 10 client.25607 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0a0c00640 1 -- 172.21.15.43:0/2348504511 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca9ad31b20 con 0x55ca9a9d29f0 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0a0c00640 10 client.25607 handle_command_reply: tid=0 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 client.25607 shutdown 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa14070 msgr2=0x55ca9adc4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa14070 0x55ca9adc4e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0019c20 tx=0x7fc0b0009cc0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 shutdown_connections 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9f3390 0x55ca9adc4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9a9d29f0 0x55ca9add6590 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa14070 0x55ca9adc4e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 --2- 172.21.15.43:0/2348504511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adc43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.452+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 >> 172.21.15.43:0/2348504511 conn(0x55ca9aa08460 msgr2=0x55ca9adbbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.453+0000 7fc0a0c00640 0 client.25607 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.453+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 shutdown_connections 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.453+0000 7fc0c443b740 1 -- 172.21.15.43:0/2348504511 wait complete. 2024-07-26T08:34:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.453+0000 7fc0c443b740 20 client.25607 trim_cache size 0 max 16384 2024-07-26T08:34:43.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 Processor -- start 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 -- start start 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa08460 0x55ca9adc63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adcff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81b9840 con 0x55ca9a9f3390 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81b7110 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.468+0000 7fc0c443b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81b4f60 con 0x55ca9aa08460 2024-07-26T08:34:43.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adba820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56414/0 (socket says 172.21.15.43:56414) 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa08460 0x55ca9adc63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 -- 172.21.15.43:0/1381648226 learned_addr learned my addr 172.21.15.43:0/1381648226 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b7400640 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adcff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 -- 172.21.15.43:0/1381648226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa08460 msgr2=0x55ca9adc63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa08460 0x55ca9adc63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 -- 172.21.15.43:0/1381648226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 msgr2=0x55ca9adcff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adcff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b6000640 1 -- 172.21.15.43:0/1381648226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9a9d2c20 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.469+0000 7fc0b7400640 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adcff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.470+0000 7fc0b6000640 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adba820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40cb0c0 tx=0x7fc0a403b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be7a5c3cac94b135 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.470+0000 7fc0a3400640 1 -- 172.21.15.43:0/1381648226 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4049040 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.470+0000 7fc0a3400640 1 -- 172.21.15.43:0/1381648226 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0a40d43c0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.470+0000 7fc0a3400640 1 -- 172.21.15.43:0/1381648226 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40d3f30 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 -- 172.21.15.43:0/1381648226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 msgr2=0x55ca9adba820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adba820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40cb0c0 tx=0x7fc0a403b890 comp rx=0 tx=0).stop 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 -- 172.21.15.43:0/1381648226 shutdown_connections 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9adcff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9a9eb1b0 0x55ca9adba820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 --2- 172.21.15.43:0/1381648226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9aa08460 0x55ca9adc63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 -- 172.21.15.43:0/1381648226 >> 172.21.15.43:0/1381648226 conn(0x55ca9adb1f70 msgr2=0x55ca9adcf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:43.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 -- 172.21.15.43:0/1381648226 shutdown_connections 2024-07-26T08:34:43.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.471+0000 7fc0c443b740 1 -- 172.21.15.43:0/1381648226 wait complete. 2024-07-26T08:34:43.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.472+0000 7fc0c443b740 1 -- start start 2024-07-26T08:34:43.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.472+0000 7fc0c443b740 1 Processor -- start 2024-07-26T08:34:43.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 0x55ca9ae32a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9ae32fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa08460 0x55ca9ae334f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81b55d0 con 0x55ca9a9f3390 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81b6a40 con 0x55ca9aa08460 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81b5ca0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.473+0000 7fc0c443b740 10 client.0 _ll_register_callbacks cb 0x7fc0b0019970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 0x55ca9ae32a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9ae32fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 0x55ca9ae32a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49888/0 (socket says 172.21.15.43:49888) 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa08460 0x55ca9ae334f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 -- 172.21.15.43:0/405658539 learned_addr learned my addr 172.21.15.43:0/405658539 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:43.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 -- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa08460 msgr2=0x55ca9ae334f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa08460 0x55ca9ae334f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 -- 172.21.15.43:0/405658539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 msgr2=0x55ca9ae32fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9ae32fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.474+0000 7fc0b6a00640 1 -- 172.21.15.43:0/405658539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca9ae3dbf0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.475+0000 7fc0b6a00640 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 0x55ca9ae32a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ca9acbb730 tx=0x7fc0a8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a9ea80de1e2844 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.475+0000 7fc0a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:34:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.475+0000 7fc0a0c00640 1 -- 172.21.15.43:0/405658539 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8020b10 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.475+0000 7fc0a0c00640 1 -- 172.21.15.43:0/405658539 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fc0a8020cb0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.475+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0a40d43c0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.476+0000 7fc0a0c00640 1 -- 172.21.15.43:0/405658539 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc0a8038050 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.476+0000 7fc0c443b740 10 client.25639 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.476+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca9ae3ee70 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.476+0000 7fc0a0c00640 1 -- 172.21.15.43:0/405658539 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0a40d43c0 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.476+0000 7fc0a0c00640 1 -- 172.21.15.43:0/405658539 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc0a802f410 con 0x55ca9a9eb1b0 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0c443b740 10 client.25639 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0c443b740 10 client.25639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0c443b740 20 client.25639 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0c443b740 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9aa14070 0x55ca9ae41610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0c443b740 4 client.25639 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca9ad2d5c0 con 0x55ca9aa14070 2024-07-26T08:34:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.477+0000 7fc0b6000640 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9aa14070 0x55ca9ae41610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0b6000640 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9aa14070 0x55ca9ae41610 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e17f86f5710356f server_cookie=83ea827b2290fb69 in_seq=0 out_seq=0 2024-07-26T08:34:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0a0c00640 10 client.25639 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0a0c00640 1 -- 172.21.15.43:0/405658539 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca9ad2d5c0 con 0x55ca9aa14070 2024-07-26T08:34:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0a0c00640 10 client.25639 handle_command_reply: tid=0 2024-07-26T08:34:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0c443b740 1 client.25639 shutdown 2024-07-26T08:34:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 msgr2=0x55ca9ae32a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0c443b740 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 0x55ca9ae32a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ca9acbb730 tx=0x7fc0a8013000 comp rx=0 tx=0).stop 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 shutdown_connections 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.478+0000 7fc0c443b740 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x55ca9aa14070 0x55ca9ae41610 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca9aa08460 0x55ca9ae334f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca9a9f3390 0x55ca9ae32fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 1 --2- 172.21.15.43:0/405658539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca9a9eb1b0 0x55ca9ae32a70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 >> 172.21.15.43:0/405658539 conn(0x55ca9adb1f70 msgr2=0x55ca9adba580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0a0c00640 0 client.25639 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 shutdown_connections 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 1 -- 172.21.15.43:0/405658539 wait complete. 2024-07-26T08:34:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.479+0000 7fc0c443b740 20 client.25639 trim_cache size 0 max 16384 2024-07-26T08:34:43.483 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:34:43.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc09c0b3d40 msgr2=0x7fc09c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc09c0b3d40 0x7fc09c0b6250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55ca9adb7ab0 tx=0x7fc0a800b410 comp rx=0 tx=0).stop 2024-07-26T08:34:43.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 msgr2=0x7fc0b81a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:43.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 0x7fc0b81a0b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0a402a9e0 tx=0x7fc0a4003b90 comp rx=0 tx=0).stop 2024-07-26T08:34:43.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 shutdown_connections 2024-07-26T08:34:43.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fc09c0b3d40 0x7fc09c0b6250 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8113e60 0x7fc0b81a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0b8076db0 0x7fc0b81a0b20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 --2- 172.21.15.43:0/3414841323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b8075800 0x7fc0b81a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:43.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.480+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 >> 172.21.15.43:0/3414841323 conn(0x7fc0b807b280 msgr2=0x7fc0b8112730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:43.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.481+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 shutdown_connections 2024-07-26T08:34:43.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:43.481+0000 7fc0bd800640 1 -- 172.21.15.43:0/3414841323 wait complete. 2024-07-26T08:34:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:34:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:34:43.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:34:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:34:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:34:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:34:43.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:34:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:34:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:34:43.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-07-26T08:34:44.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-07-26T08:34:44.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-07-26T08:34:44.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-07-26T08:34:44.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-07-26T08:34:44.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-07-26T08:34:44.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-07-26T08:34:44.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-07-26T08:34:44.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-07-26T08:34:44.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-07-26T08:34:44.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-07-26T08:34:44.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-07-26T08:34:44.123 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-07-26T08:34:44.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-07-26T08:34:44.127 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-07-26T08:34:44.130 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-07-26T08:34:44.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-07-26T08:34:44.135 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-07-26T08:34:44.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-07-26T08:34:44.140 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-07-26T08:34:44.142 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-07-26T08:34:44.145 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-07-26T08:34:44.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-07-26T08:34:44.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-07-26T08:34:44.151 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-07-26T08:34:44.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-07-26T08:34:44.156 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-07-26T08:34:44.159 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-07-26T08:34:44.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-07-26T08:34:44.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-07-26T08:34:44.167 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-07-26T08:34:44.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-07-26T08:34:44.173 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-07-26T08:34:44.176 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-07-26T08:34:44.178 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-07-26T08:34:44.181 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-07-26T08:34:44.184 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-07-26T08:34:44.187 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-07-26T08:34:44.190 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-07-26T08:34:44.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-07-26T08:34:44.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-07-26T08:34:44.198 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-07-26T08:34:44.201 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-07-26T08:34:44.203 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-07-26T08:34:44.206 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-07-26T08:34:44.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-07-26T08:34:44.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-07-26T08:34:44.214 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-07-26T08:34:44.217 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-07-26T08:34:44.219 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-07-26T08:34:44.222 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-07-26T08:34:44.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-07-26T08:34:44.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-07-26T08:34:44.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-07-26T08:34:44.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-07-26T08:34:44.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-07-26T08:34:44.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-07-26T08:34:44.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-07-26T08:34:44.243 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-07-26T08:34:44.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-07-26T08:34:44.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-07-26T08:34:44.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-07-26T08:34:44.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-07-26T08:34:44.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-07-26T08:34:44.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-07-26T08:34:44.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-07-26T08:34:44.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-07-26T08:34:44.269 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-07-26T08:34:44.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-07-26T08:34:44.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-07-26T08:34:44.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-07-26T08:34:44.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-07-26T08:34:44.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-07-26T08:34:44.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-07-26T08:34:44.290 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-07-26T08:34:44.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-07-26T08:34:44.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-07-26T08:34:44.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-07-26T08:34:44.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-07-26T08:34:44.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-07-26T08:34:44.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-07-26T08:34:44.309 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-07-26T08:34:44.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-07-26T08:34:44.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-07-26T08:34:44.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-07-26T08:34:44.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-07-26T08:34:44.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-07-26T08:34:44.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-07-26T08:34:44.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-07-26T08:34:44.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-07-26T08:34:44.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-07-26T08:34:44.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-07-26T08:34:44.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-07-26T08:34:44.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-07-26T08:34:44.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-07-26T08:34:44.354 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-07-26T08:34:44.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-07-26T08:34:44.360 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-07-26T08:34:44.363 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-07-26T08:34:44.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-07-26T08:34:44.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-07-26T08:34:44.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-07-26T08:34:44.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-07-26T08:34:44.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-07-26T08:34:44.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-07-26T08:34:44.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-07-26T08:34:44.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-07-26T08:34:44.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-07-26T08:34:44.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-07-26T08:34:44.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-07-26T08:34:44.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-07-26T08:34:44.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-07-26T08:34:44.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-07-26T08:34:44.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-07-26T08:34:44.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-07-26T08:34:44.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-07-26T08:34:44.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-07-26T08:34:44.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-07-26T08:34:44.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-07-26T08:34:44.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-07-26T08:34:44.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-07-26T08:34:44.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-07-26T08:34:44.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-07-26T08:34:44.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-07-26T08:34:44.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-07-26T08:34:44.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-07-26T08:34:44.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-07-26T08:34:44.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-07-26T08:34:44.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-07-26T08:34:44.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-07-26T08:34:44.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-07-26T08:34:44.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-07-26T08:34:44.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-07-26T08:34:44.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-07-26T08:34:44.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-07-26T08:34:44.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-07-26T08:34:44.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-07-26T08:34:44.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-26T08:34:44.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-07-26T08:34:44.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-07-26T08:34:44.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-07-26T08:34:44.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-07-26T08:34:44.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-07-26T08:34:44.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-07-26T08:34:44.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-07-26T08:34:44.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-07-26T08:34:44.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-07-26T08:34:44.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-07-26T08:34:44.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-07-26T08:34:44.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-07-26T08:34:44.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-07-26T08:34:44.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-07-26T08:34:44.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-07-26T08:34:44.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-07-26T08:34:44.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-07-26T08:34:44.492 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-07-26T08:34:44.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-07-26T08:34:44.494 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-07-26T08:34:44.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-07-26T08:34:44.497 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-07-26T08:34:44.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-07-26T08:34:44.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-07-26T08:34:44.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-07-26T08:34:44.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-07-26T08:34:44.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-07-26T08:34:44.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-07-26T08:34:44.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-07-26T08:34:44.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-07-26T08:34:44.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-07-26T08:34:44.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-07-26T08:34:44.511 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-07-26T08:34:44.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-07-26T08:34:44.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-07-26T08:34:44.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-07-26T08:34:44.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-07-26T08:34:44.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-07-26T08:34:44.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-07-26T08:34:44.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-07-26T08:34:44.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-07-26T08:34:44.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-07-26T08:34:44.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-07-26T08:34:44.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-07-26T08:34:44.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-07-26T08:34:44.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-07-26T08:34:44.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-07-26T08:34:44.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-07-26T08:34:44.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-07-26T08:34:44.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-07-26T08:34:44.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-07-26T08:34:44.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-07-26T08:34:44.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-07-26T08:34:44.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-07-26T08:34:44.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-07-26T08:34:44.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-07-26T08:34:44.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-07-26T08:34:44.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-07-26T08:34:44.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-07-26T08:34:44.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-07-26T08:34:44.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-07-26T08:34:44.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-07-26T08:34:44.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-07-26T08:34:44.548 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-07-26T08:34:44.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-07-26T08:34:44.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-07-26T08:34:44.552 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-07-26T08:34:44.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-07-26T08:34:44.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-07-26T08:34:44.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-07-26T08:34:44.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-07-26T08:34:44.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-07-26T08:34:44.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-07-26T08:34:44.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-07-26T08:34:44.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-07-26T08:34:44.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-07-26T08:34:44.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-07-26T08:34:44.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-07-26T08:34:44.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-07-26T08:34:44.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-07-26T08:34:44.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-07-26T08:34:44.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-07-26T08:34:44.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-07-26T08:34:44.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-07-26T08:34:44.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-07-26T08:34:44.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-07-26T08:34:44.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-07-26T08:34:44.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-07-26T08:34:44.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-07-26T08:34:44.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-07-26T08:34:44.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-07-26T08:34:44.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-07-26T08:34:44.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-07-26T08:34:44.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-07-26T08:34:44.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-07-26T08:34:44.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-07-26T08:34:44.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-07-26T08:34:44.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-07-26T08:34:44.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-07-26T08:34:44.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-07-26T08:34:44.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-07-26T08:34:44.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-07-26T08:34:44.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-07-26T08:34:44.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-07-26T08:34:44.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-07-26T08:34:44.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-07-26T08:34:44.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-07-26T08:34:44.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-07-26T08:34:44.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-07-26T08:34:44.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-07-26T08:34:44.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-07-26T08:34:44.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-07-26T08:34:44.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-07-26T08:34:44.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-07-26T08:34:44.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-07-26T08:34:44.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-07-26T08:34:44.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-07-26T08:34:44.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-07-26T08:34:44.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-07-26T08:34:44.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-07-26T08:34:44.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-07-26T08:34:44.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-07-26T08:34:44.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-07-26T08:34:44.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-07-26T08:34:44.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-07-26T08:34:44.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-07-26T08:34:44.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-07-26T08:34:44.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-07-26T08:34:44.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-07-26T08:34:44.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-07-26T08:34:44.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-07-26T08:34:44.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-07-26T08:34:44.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-07-26T08:34:44.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-07-26T08:34:44.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-07-26T08:34:44.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-07-26T08:34:44.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-07-26T08:34:44.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-07-26T08:34:44.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-07-26T08:34:44.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-07-26T08:34:44.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-07-26T08:34:44.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-07-26T08:34:44.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-07-26T08:34:44.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-07-26T08:34:44.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-07-26T08:34:44.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-07-26T08:34:44.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-07-26T08:34:44.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-07-26T08:34:44.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-07-26T08:34:44.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-07-26T08:34:44.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-07-26T08:34:44.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-07-26T08:34:44.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-07-26T08:34:44.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-07-26T08:34:44.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-07-26T08:34:44.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-07-26T08:34:44.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-07-26T08:34:44.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-07-26T08:34:44.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-07-26T08:34:44.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-07-26T08:34:44.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-07-26T08:34:44.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-07-26T08:34:44.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-07-26T08:34:44.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-07-26T08:34:44.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-07-26T08:34:44.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-07-26T08:34:44.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:44 smithi043 ceph-mon[32384]: pgmap v532: 129 pgs: 129 active+clean; 54 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T08:34:44.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-07-26T08:34:44.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-07-26T08:34:44.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-07-26T08:34:44.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-07-26T08:34:44.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-07-26T08:34:44.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-07-26T08:34:44.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-07-26T08:34:44.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-07-26T08:34:44.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-07-26T08:34:44.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-07-26T08:34:44.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-07-26T08:34:44.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-07-26T08:34:44.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-07-26T08:34:44.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-07-26T08:34:44.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-07-26T08:34:44.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-07-26T08:34:44.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-07-26T08:34:44.765 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-07-26T08:34:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:44 smithi133 ceph-mon[37053]: pgmap v532: 129 pgs: 129 active+clean; 54 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T08:34:44.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-07-26T08:34:44.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-07-26T08:34:44.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-07-26T08:34:44.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-07-26T08:34:44.772 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-07-26T08:34:44.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-07-26T08:34:44.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-07-26T08:34:44.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-07-26T08:34:44.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-07-26T08:34:44.779 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-07-26T08:34:44.781 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-07-26T08:34:44.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-07-26T08:34:44.785 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-07-26T08:34:44.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-07-26T08:34:44.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-07-26T08:34:44.791 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-07-26T08:34:44.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-07-26T08:34:44.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-07-26T08:34:44.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-07-26T08:34:44.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-07-26T08:34:44.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-07-26T08:34:44.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-07-26T08:34:44.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-07-26T08:34:44.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-07-26T08:34:44.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-07-26T08:34:44.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-07-26T08:34:44.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-07-26T08:34:44.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-07-26T08:34:44.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-07-26T08:34:44.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-07-26T08:34:44.817 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-07-26T08:34:44.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:44 smithi063 ceph-mon[36747]: pgmap v532: 129 pgs: 129 active+clean; 54 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T08:34:44.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-07-26T08:34:44.819 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-07-26T08:34:44.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-07-26T08:34:44.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-07-26T08:34:44.825 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-07-26T08:34:44.827 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-07-26T08:34:44.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-07-26T08:34:44.830 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-07-26T08:34:44.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-07-26T08:34:44.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-07-26T08:34:44.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-07-26T08:34:44.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-07-26T08:34:44.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-07-26T08:34:44.839 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-07-26T08:34:44.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-07-26T08:34:44.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-07-26T08:34:44.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-07-26T08:34:44.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-07-26T08:34:44.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-07-26T08:34:44.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-07-26T08:34:44.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-07-26T08:34:44.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-07-26T08:34:44.856 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-07-26T08:34:44.858 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-07-26T08:34:44.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-07-26T08:34:44.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-07-26T08:34:44.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-07-26T08:34:44.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-07-26T08:34:44.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-07-26T08:34:44.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-07-26T08:34:44.867 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-07-26T08:34:44.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-07-26T08:34:44.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-07-26T08:34:44.871 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-07-26T08:34:44.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-07-26T08:34:44.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-07-26T08:34:44.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-07-26T08:34:44.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-07-26T08:34:44.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-07-26T08:34:44.882 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-07-26T08:34:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-07-26T08:34:44.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-07-26T08:34:44.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-07-26T08:34:44.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-07-26T08:34:44.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-07-26T08:34:44.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-07-26T08:34:44.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-07-26T08:34:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-07-26T08:34:44.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-07-26T08:34:44.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-07-26T08:34:44.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-07-26T08:34:44.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-07-26T08:34:44.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-07-26T08:34:44.904 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-07-26T08:34:44.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-07-26T08:34:44.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-07-26T08:34:44.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-07-26T08:34:44.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-07-26T08:34:44.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-07-26T08:34:44.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-07-26T08:34:44.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-07-26T08:34:44.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-07-26T08:34:44.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-07-26T08:34:44.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-07-26T08:34:44.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-07-26T08:34:44.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-07-26T08:34:44.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-07-26T08:34:44.921 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-07-26T08:34:44.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-07-26T08:34:44.924 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-07-26T08:34:44.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-07-26T08:34:44.927 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-07-26T08:34:44.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-07-26T08:34:44.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-07-26T08:34:44.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-07-26T08:34:44.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-07-26T08:34:44.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-07-26T08:34:44.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-07-26T08:34:44.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-07-26T08:34:44.938 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-07-26T08:34:44.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-07-26T08:34:44.941 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-07-26T08:34:44.942 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:44.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-07-26T08:34:44.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-07-26T08:34:44.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-07-26T08:34:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-07-26T08:34:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-07-26T08:34:44.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-07-26T08:34:44.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-07-26T08:34:44.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-07-26T08:34:44.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-07-26T08:34:44.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-07-26T08:34:44.957 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-07-26T08:34:44.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-07-26T08:34:44.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-07-26T08:34:44.962 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-07-26T08:34:44.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-07-26T08:34:44.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-07-26T08:34:44.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-07-26T08:34:44.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-07-26T08:34:44.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-07-26T08:34:44.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-07-26T08:34:44.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-07-26T08:34:44.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-07-26T08:34:44.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-07-26T08:34:44.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-07-26T08:34:44.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-07-26T08:34:44.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-07-26T08:34:44.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-07-26T08:34:44.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-07-26T08:34:44.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-07-26T08:34:44.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-07-26T08:34:44.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-07-26T08:34:44.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-07-26T08:34:44.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-07-26T08:34:44.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-07-26T08:34:44.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-07-26T08:34:44.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-07-26T08:34:44.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-07-26T08:34:44.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-07-26T08:34:44.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-07-26T08:34:45.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-07-26T08:34:45.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-07-26T08:34:45.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-07-26T08:34:45.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-07-26T08:34:45.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-07-26T08:34:45.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-07-26T08:34:45.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-07-26T08:34:45.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-07-26T08:34:45.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-07-26T08:34:45.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-07-26T08:34:45.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-07-26T08:34:45.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-07-26T08:34:45.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-07-26T08:34:45.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-07-26T08:34:45.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-07-26T08:34:45.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-07-26T08:34:45.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-07-26T08:34:45.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-07-26T08:34:45.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-07-26T08:34:45.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-07-26T08:34:45.030 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-07-26T08:34:45.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-07-26T08:34:45.033 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-07-26T08:34:45.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-07-26T08:34:45.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-07-26T08:34:45.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-07-26T08:34:45.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-07-26T08:34:45.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-07-26T08:34:45.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-07-26T08:34:45.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-07-26T08:34:45.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-07-26T08:34:45.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-07-26T08:34:45.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-07-26T08:34:45.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-07-26T08:34:45.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-07-26T08:34:45.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-07-26T08:34:45.341 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-07-26T08:34:45.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-07-26T08:34:45.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-07-26T08:34:45.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-07-26T08:34:45.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-07-26T08:34:45.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-07-26T08:34:45.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-07-26T08:34:45.364 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-07-26T08:34:45.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-07-26T08:34:45.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-07-26T08:34:45.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-07-26T08:34:45.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-07-26T08:34:45.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-07-26T08:34:45.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-07-26T08:34:45.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-07-26T08:34:45.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-07-26T08:34:45.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-07-26T08:34:45.385 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-07-26T08:34:45.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-07-26T08:34:45.391 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-07-26T08:34:45.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-07-26T08:34:45.396 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-07-26T08:34:45.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-07-26T08:34:45.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-07-26T08:34:45.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-07-26T08:34:45.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-07-26T08:34:45.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-07-26T08:34:45.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-07-26T08:34:45.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-07-26T08:34:45.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-07-26T08:34:45.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-07-26T08:34:45.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-07-26T08:34:45.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-07-26T08:34:45.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-07-26T08:34:45.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-07-26T08:34:45.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-07-26T08:34:45.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-07-26T08:34:45.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-07-26T08:34:45.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-07-26T08:34:45.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-07-26T08:34:45.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-07-26T08:34:45.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-07-26T08:34:45.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-07-26T08:34:45.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-07-26T08:34:45.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-07-26T08:34:45.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-07-26T08:34:45.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-07-26T08:34:45.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-07-26T08:34:45.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-07-26T08:34:45.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-07-26T08:34:45.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-07-26T08:34:45.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-07-26T08:34:45.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-07-26T08:34:45.459 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-07-26T08:34:45.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-07-26T08:34:45.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-07-26T08:34:45.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-07-26T08:34:45.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-07-26T08:34:45.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-07-26T08:34:45.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-07-26T08:34:45.469 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-07-26T08:34:45.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-07-26T08:34:45.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-07-26T08:34:45.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-07-26T08:34:45.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-07-26T08:34:45.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-07-26T08:34:45.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-07-26T08:34:45.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-07-26T08:34:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-07-26T08:34:45.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-07-26T08:34:45.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-07-26T08:34:45.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-07-26T08:34:45.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-07-26T08:34:45.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-07-26T08:34:45.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-07-26T08:34:45.494 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-07-26T08:34:45.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-07-26T08:34:45.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-07-26T08:34:45.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-07-26T08:34:45.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-07-26T08:34:45.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-07-26T08:34:45.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-07-26T08:34:45.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-07-26T08:34:45.511 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-07-26T08:34:45.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-07-26T08:34:45.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-07-26T08:34:45.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-07-26T08:34:45.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-07-26T08:34:45.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-07-26T08:34:45.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-07-26T08:34:45.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-07-26T08:34:45.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-07-26T08:34:45.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-07-26T08:34:45.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-07-26T08:34:45.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-07-26T08:34:45.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-07-26T08:34:45.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-07-26T08:34:45.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-07-26T08:34:45.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-07-26T08:34:45.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-07-26T08:34:45.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-07-26T08:34:45.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-07-26T08:34:45.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-07-26T08:34:45.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-07-26T08:34:45.548 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-07-26T08:34:45.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-07-26T08:34:45.551 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-07-26T08:34:45.552 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-07-26T08:34:45.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-07-26T08:34:45.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-07-26T08:34:45.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-07-26T08:34:45.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-07-26T08:34:45.558 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-07-26T08:34:45.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-07-26T08:34:45.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-07-26T08:34:45.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-07-26T08:34:45.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-07-26T08:34:45.564 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-07-26T08:34:45.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-07-26T08:34:45.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-07-26T08:34:45.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-07-26T08:34:45.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-07-26T08:34:45.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-07-26T08:34:45.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-07-26T08:34:45.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-07-26T08:34:45.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-07-26T08:34:45.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-07-26T08:34:45.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-07-26T08:34:45.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-07-26T08:34:45.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-07-26T08:34:45.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-07-26T08:34:45.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-07-26T08:34:45.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-07-26T08:34:45.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-07-26T08:34:45.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-07-26T08:34:45.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-07-26T08:34:45.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-07-26T08:34:45.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-07-26T08:34:45.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-07-26T08:34:45.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-07-26T08:34:45.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-07-26T08:34:45.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-07-26T08:34:45.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-07-26T08:34:45.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-07-26T08:34:45.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-07-26T08:34:45.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-07-26T08:34:45.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-07-26T08:34:45.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-07-26T08:34:45.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-07-26T08:34:45.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-07-26T08:34:45.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-07-26T08:34:45.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-07-26T08:34:45.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-07-26T08:34:45.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-07-26T08:34:45.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-07-26T08:34:45.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-07-26T08:34:45.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-07-26T08:34:45.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-07-26T08:34:45.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-07-26T08:34:45.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-07-26T08:34:45.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-07-26T08:34:45.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-07-26T08:34:45.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-07-26T08:34:45.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-07-26T08:34:45.630 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-07-26T08:34:45.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-07-26T08:34:45.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-07-26T08:34:45.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-07-26T08:34:45.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-07-26T08:34:45.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-07-26T08:34:45.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-07-26T08:34:45.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-07-26T08:34:45.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-07-26T08:34:45.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-07-26T08:34:45.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-07-26T08:34:45.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-07-26T08:34:45.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-07-26T08:34:45.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-07-26T08:34:45.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-07-26T08:34:45.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-07-26T08:34:45.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-07-26T08:34:45.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-07-26T08:34:45.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-07-26T08:34:45.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-07-26T08:34:45.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-07-26T08:34:45.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-07-26T08:34:45.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-07-26T08:34:45.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-07-26T08:34:45.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-07-26T08:34:45.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-07-26T08:34:45.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-07-26T08:34:45.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-07-26T08:34:45.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-07-26T08:34:45.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-07-26T08:34:45.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-07-26T08:34:45.693 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-07-26T08:34:45.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-07-26T08:34:45.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-07-26T08:34:45.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-07-26T08:34:45.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-07-26T08:34:45.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-07-26T08:34:45.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-07-26T08:34:45.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-07-26T08:34:45.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-07-26T08:34:45.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-07-26T08:34:45.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-07-26T08:34:45.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-07-26T08:34:45.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-07-26T08:34:45.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-07-26T08:34:45.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-07-26T08:34:45.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-07-26T08:34:45.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-07-26T08:34:45.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-07-26T08:34:45.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-07-26T08:34:45.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-07-26T08:34:45.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-07-26T08:34:45.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-07-26T08:34:45.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-07-26T08:34:45.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-07-26T08:34:45.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-07-26T08:34:45.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-07-26T08:34:45.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-07-26T08:34:45.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-07-26T08:34:45.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-07-26T08:34:45.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-07-26T08:34:45.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-07-26T08:34:45.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-07-26T08:34:45.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-07-26T08:34:45.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-07-26T08:34:45.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-07-26T08:34:45.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-07-26T08:34:45.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-07-26T08:34:45.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-07-26T08:34:45.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-07-26T08:34:45.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-07-26T08:34:45.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-07-26T08:34:45.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-07-26T08:34:45.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-07-26T08:34:45.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-07-26T08:34:45.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-07-26T08:34:45.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-07-26T08:34:45.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-07-26T08:34:45.767 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-07-26T08:34:45.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-07-26T08:34:45.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-07-26T08:34:45.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-07-26T08:34:45.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-07-26T08:34:45.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-07-26T08:34:45.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-07-26T08:34:45.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-07-26T08:34:45.778 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-07-26T08:34:45.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-07-26T08:34:45.781 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-07-26T08:34:45.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-07-26T08:34:45.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-07-26T08:34:45.785 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-07-26T08:34:45.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-07-26T08:34:45.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-07-26T08:34:45.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-07-26T08:34:45.790 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-07-26T08:34:45.791 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-07-26T08:34:45.792 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-07-26T08:34:45.794 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-07-26T08:34:45.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-07-26T08:34:45.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-07-26T08:34:45.798 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-07-26T08:34:45.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-07-26T08:34:45.800 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-07-26T08:34:45.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-07-26T08:34:45.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-07-26T08:34:45.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-07-26T08:34:45.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-07-26T08:34:45.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-07-26T08:34:45.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-07-26T08:34:45.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-07-26T08:34:45.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-07-26T08:34:45.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-07-26T08:34:45.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-07-26T08:34:45.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-07-26T08:34:45.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-07-26T08:34:45.819 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-07-26T08:34:45.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-07-26T08:34:45.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-07-26T08:34:45.824 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-07-26T08:34:45.825 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-07-26T08:34:45.827 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-07-26T08:34:45.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-07-26T08:34:45.830 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-07-26T08:34:45.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-07-26T08:34:45.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-07-26T08:34:45.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-07-26T08:34:45.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-07-26T08:34:45.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-07-26T08:34:45.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-07-26T08:34:45.839 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-07-26T08:34:45.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-07-26T08:34:45.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-07-26T08:34:45.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-07-26T08:34:45.845 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-07-26T08:34:45.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-07-26T08:34:45.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-07-26T08:34:45.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-07-26T08:34:45.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-07-26T08:34:45.853 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-07-26T08:34:45.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-07-26T08:34:45.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-07-26T08:34:45.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-07-26T08:34:45.858 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-07-26T08:34:45.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-07-26T08:34:45.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-07-26T08:34:45.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-07-26T08:34:45.864 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-07-26T08:34:45.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-07-26T08:34:45.867 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-07-26T08:34:45.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-07-26T08:34:45.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-07-26T08:34:45.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-07-26T08:34:45.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-07-26T08:34:45.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-07-26T08:34:45.877 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-07-26T08:34:45.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-07-26T08:34:45.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-07-26T08:34:45.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-07-26T08:34:45.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-07-26T08:34:45.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-07-26T08:34:45.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-07-26T08:34:45.890 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-07-26T08:34:45.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-07-26T08:34:45.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-07-26T08:34:45.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-07-26T08:34:45.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-07-26T08:34:45.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-07-26T08:34:45.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-07-26T08:34:45.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-07-26T08:34:45.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-07-26T08:34:45.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-07-26T08:34:45.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-07-26T08:34:45.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-07-26T08:34:45.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-07-26T08:34:45.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-07-26T08:34:45.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-07-26T08:34:45.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-07-26T08:34:45.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-07-26T08:34:45.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-07-26T08:34:45.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-07-26T08:34:45.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-07-26T08:34:45.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-07-26T08:34:45.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-07-26T08:34:45.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-07-26T08:34:45.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-07-26T08:34:45.929 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-07-26T08:34:45.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-07-26T08:34:45.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-07-26T08:34:45.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-07-26T08:34:45.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-07-26T08:34:45.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-07-26T08:34:45.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-07-26T08:34:45.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-07-26T08:34:45.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-07-26T08:34:45.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-07-26T08:34:45.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-07-26T08:34:45.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-07-26T08:34:45.951 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-07-26T08:34:45.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-07-26T08:34:45.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-07-26T08:34:45.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-07-26T08:34:45.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-07-26T08:34:45.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-07-26T08:34:45.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-07-26T08:34:45.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-07-26T08:34:45.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-07-26T08:34:45.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-07-26T08:34:45.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-07-26T08:34:45.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-07-26T08:34:45.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-07-26T08:34:45.974 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-07-26T08:34:45.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-07-26T08:34:45.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-07-26T08:34:45.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-07-26T08:34:45.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-07-26T08:34:45.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-07-26T08:34:45.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-07-26T08:34:45.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-07-26T08:34:45.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-07-26T08:34:45.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-07-26T08:34:45.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-07-26T08:34:45.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-07-26T08:34:45.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-07-26T08:34:45.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-07-26T08:34:46.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-07-26T08:34:46.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-07-26T08:34:46.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-07-26T08:34:46.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-07-26T08:34:46.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-07-26T08:34:46.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-07-26T08:34:46.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-07-26T08:34:46.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-07-26T08:34:46.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-07-26T08:34:46.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-07-26T08:34:46.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-07-26T08:34:46.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-07-26T08:34:46.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-07-26T08:34:46.021 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-07-26T08:34:46.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-07-26T08:34:46.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-07-26T08:34:46.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-07-26T08:34:46.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-07-26T08:34:46.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-07-26T08:34:46.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-07-26T08:34:46.032 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-07-26T08:34:46.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-07-26T08:34:46.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-07-26T08:34:46.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-07-26T08:34:46.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-07-26T08:34:46.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-07-26T08:34:46.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-07-26T08:34:46.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-07-26T08:34:46.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-07-26T08:34:46.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-07-26T08:34:46.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-07-26T08:34:46.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-07-26T08:34:46.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-07-26T08:34:46.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-07-26T08:34:46.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-07-26T08:34:46.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-07-26T08:34:46.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-07-26T08:34:46.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-07-26T08:34:46.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-07-26T08:34:46.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-07-26T08:34:46.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-07-26T08:34:46.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-07-26T08:34:46.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-07-26T08:34:46.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-07-26T08:34:46.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-07-26T08:34:46.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-07-26T08:34:46.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-07-26T08:34:46.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-07-26T08:34:46.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-07-26T08:34:46.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-07-26T08:34:46.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-07-26T08:34:46.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-07-26T08:34:46.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-07-26T08:34:46.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-07-26T08:34:46.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-07-26T08:34:46.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-07-26T08:34:46.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-07-26T08:34:46.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-07-26T08:34:46.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-07-26T08:34:46.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-07-26T08:34:46.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-07-26T08:34:46.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-07-26T08:34:46.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-07-26T08:34:46.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-07-26T08:34:46.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-07-26T08:34:46.126 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-07-26T08:34:46.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-07-26T08:34:46.130 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-07-26T08:34:46.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-07-26T08:34:46.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-07-26T08:34:46.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-07-26T08:34:46.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-07-26T08:34:46.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-07-26T08:34:46.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-07-26T08:34:46.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-07-26T08:34:46.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-07-26T08:34:46.152 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-07-26T08:34:46.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-07-26T08:34:46.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-07-26T08:34:46.159 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-07-26T08:34:46.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-07-26T08:34:46.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-07-26T08:34:46.167 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-07-26T08:34:46.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-07-26T08:34:46.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-07-26T08:34:46.175 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-07-26T08:34:46.177 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-07-26T08:34:46.179 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-07-26T08:34:46.182 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-07-26T08:34:46.184 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-07-26T08:34:46.187 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-07-26T08:34:46.190 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-07-26T08:34:46.193 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-07-26T08:34:46.196 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-07-26T08:34:46.199 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-07-26T08:34:46.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-07-26T08:34:46.205 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-07-26T08:34:46.207 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-07-26T08:34:46.210 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-07-26T08:34:46.213 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-07-26T08:34:46.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-07-26T08:34:46.218 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-07-26T08:34:46.222 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-07-26T08:34:46.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-07-26T08:34:46.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-07-26T08:34:46.232 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-07-26T08:34:46.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-07-26T08:34:46.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-07-26T08:34:46.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-07-26T08:34:46.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-07-26T08:34:46.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-07-26T08:34:46.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-07-26T08:34:46.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-07-26T08:34:46.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-07-26T08:34:46.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-07-26T08:34:46.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-07-26T08:34:46.273 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-07-26T08:34:46.277 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-07-26T08:34:46.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-07-26T08:34:46.284 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-07-26T08:34:46.287 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-07-26T08:34:46.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-07-26T08:34:46.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-07-26T08:34:46.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-07-26T08:34:46.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-07-26T08:34:46.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-07-26T08:34:46.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-07-26T08:34:46.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-07-26T08:34:46.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-07-26T08:34:46.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-07-26T08:34:46.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-07-26T08:34:46.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-07-26T08:34:46.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-07-26T08:34:46.334 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-07-26T08:34:46.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-07-26T08:34:46.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-07-26T08:34:46.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-07-26T08:34:46.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-07-26T08:34:46.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-07-26T08:34:46.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-07-26T08:34:46.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-07-26T08:34:46.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-07-26T08:34:46.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-07-26T08:34:46.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-07-26T08:34:46.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-07-26T08:34:46.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-07-26T08:34:46.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-07-26T08:34:46.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-07-26T08:34:46.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-07-26T08:34:46.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-07-26T08:34:46.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-07-26T08:34:46.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-07-26T08:34:46.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-07-26T08:34:46.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-07-26T08:34:46.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-07-26T08:34:46.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-07-26T08:34:46.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-07-26T08:34:46.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-07-26T08:34:46.391 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-07-26T08:34:46.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-07-26T08:34:46.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-07-26T08:34:46.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-07-26T08:34:46.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-07-26T08:34:46.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-07-26T08:34:46.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-07-26T08:34:46.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-07-26T08:34:46.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-07-26T08:34:46.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-07-26T08:34:46.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-07-26T08:34:46.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-07-26T08:34:46.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-07-26T08:34:46.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-07-26T08:34:46.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-07-26T08:34:46.434 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-07-26T08:34:46.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-07-26T08:34:46.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/digsig.txt 2024-07-26T08:34:46.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-07-26T08:34:46.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-07-26T08:34:46.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-07-26T08:34:46.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-07-26T08:34:46.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-07-26T08:34:46.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-07-26T08:34:46.459 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dontdiff 2024-07-26T08:34:46.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/ 2024-07-26T08:34:46.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-07-26T08:34:46.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-07-26T08:34:46.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-07-26T08:34:46.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-07-26T08:34:46.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-07-26T08:34:46.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-07-26T08:34:46.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-07-26T08:34:46.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-07-26T08:34:46.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-07-26T08:34:46.492 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-07-26T08:34:46.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/ 2024-07-26T08:34:46.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-07-26T08:34:46.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-07-26T08:34:46.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-07-26T08:34:46.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-07-26T08:34:46.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-07-26T08:34:46.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-07-26T08:34:46.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-07-26T08:34:46.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-07-26T08:34:46.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-07-26T08:34:46.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-07-26T08:34:46.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-07-26T08:34:46.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-07-26T08:34:46.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-07-26T08:34:46.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-07-26T08:34:46.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-07-26T08:34:46.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-07-26T08:34:46.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-07-26T08:34:46.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-07-26T08:34:46.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/edac.txt 2024-07-26T08:34:46.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-07-26T08:34:46.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/eisa.txt 2024-07-26T08:34:46.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-07-26T08:34:46.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/extcon/ 2024-07-26T08:34:46.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-07-26T08:34:46.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-07-26T08:34:46.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-07-26T08:34:46.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-07-26T08:34:46.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-07-26T08:34:46.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/ 2024-07-26T08:34:46.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-07-26T08:34:46.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-07-26T08:34:46.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-07-26T08:34:46.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-07-26T08:34:46.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-07-26T08:34:46.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-07-26T08:34:46.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-07-26T08:34:46.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-07-26T08:34:46.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-07-26T08:34:46.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-07-26T08:34:46.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-07-26T08:34:46.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-07-26T08:34:46.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-07-26T08:34:46.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-07-26T08:34:46.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-07-26T08:34:46.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-07-26T08:34:46.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-07-26T08:34:46.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-07-26T08:34:46.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-07-26T08:34:46.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-07-26T08:34:46.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-07-26T08:34:46.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-07-26T08:34:46.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-07-26T08:34:46.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-07-26T08:34:46.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-07-26T08:34:46.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-07-26T08:34:46.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-07-26T08:34:46.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-07-26T08:34:46.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-07-26T08:34:46.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-07-26T08:34:46.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-07-26T08:34:46.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-07-26T08:34:46.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-07-26T08:34:46.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-07-26T08:34:46.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-07-26T08:34:46.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ 2024-07-26T08:34:46.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-07-26T08:34:46.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-07-26T08:34:46.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-07-26T08:34:46.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-07-26T08:34:46.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-07-26T08:34:46.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-07-26T08:34:46.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-07-26T08:34:46.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-07-26T08:34:46.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-07-26T08:34:46.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-07-26T08:34:46.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-07-26T08:34:46.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-07-26T08:34:46.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-07-26T08:34:46.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-07-26T08:34:46.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-07-26T08:34:46.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-07-26T08:34:46.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-07-26T08:34:46.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-07-26T08:34:46.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-07-26T08:34:46.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-07-26T08:34:46.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-07-26T08:34:46.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-07-26T08:34:46.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-07-26T08:34:46.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-07-26T08:34:46.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-07-26T08:34:46.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-07-26T08:34:46.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-07-26T08:34:46.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-07-26T08:34:46.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-07-26T08:34:46.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:46 smithi043 ceph-mon[32384]: pgmap v533: 129 pgs: 129 active+clean; 71 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 27 op/s 2024-07-26T08:34:46.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-07-26T08:34:46.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-07-26T08:34:46.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-07-26T08:34:46.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-07-26T08:34:46.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-07-26T08:34:46.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-07-26T08:34:46.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-07-26T08:34:46.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-07-26T08:34:46.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-07-26T08:34:46.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-07-26T08:34:46.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-07-26T08:34:46.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-07-26T08:34:46.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-07-26T08:34:46.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-07-26T08:34:46.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-07-26T08:34:46.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-07-26T08:34:46.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-07-26T08:34:46.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-07-26T08:34:46.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-07-26T08:34:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:46 smithi133 ceph-mon[37053]: pgmap v533: 129 pgs: 129 active+clean; 71 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 27 op/s 2024-07-26T08:34:46.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-07-26T08:34:46.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-07-26T08:34:46.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-07-26T08:34:46.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-07-26T08:34:46.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-07-26T08:34:46.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-07-26T08:34:46.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-07-26T08:34:46.779 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-07-26T08:34:46.781 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-07-26T08:34:46.784 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-07-26T08:34:46.785 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-07-26T08:34:46.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-07-26T08:34:46.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-07-26T08:34:46.791 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-07-26T08:34:46.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-07-26T08:34:46.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-07-26T08:34:46.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-07-26T08:34:46.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-07-26T08:34:46.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-07-26T08:34:46.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-07-26T08:34:46.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-07-26T08:34:46.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-07-26T08:34:46.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-07-26T08:34:46.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-07-26T08:34:46.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-07-26T08:34:46.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-07-26T08:34:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:46 smithi063 ceph-mon[36747]: pgmap v533: 129 pgs: 129 active+clean; 71 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 27 op/s 2024-07-26T08:34:46.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-07-26T08:34:46.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-07-26T08:34:46.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-07-26T08:34:46.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-07-26T08:34:46.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-07-26T08:34:46.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-07-26T08:34:46.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-07-26T08:34:46.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-07-26T08:34:46.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-07-26T08:34:46.839 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-07-26T08:34:46.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-07-26T08:34:46.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-07-26T08:34:46.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-07-26T08:34:46.849 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-07-26T08:34:46.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-07-26T08:34:46.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-07-26T08:34:46.856 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-07-26T08:34:46.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-07-26T08:34:46.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-07-26T08:34:46.865 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-07-26T08:34:46.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-07-26T08:34:46.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-07-26T08:34:46.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-07-26T08:34:46.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-07-26T08:34:46.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-07-26T08:34:46.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-07-26T08:34:46.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-07-26T08:34:46.889 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-07-26T08:34:46.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-07-26T08:34:46.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-07-26T08:34:46.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-07-26T08:34:46.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-07-26T08:34:46.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-07-26T08:34:46.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-07-26T08:34:46.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-07-26T08:34:46.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-07-26T08:34:46.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-07-26T08:34:46.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-07-26T08:34:46.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-07-26T08:34:46.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-07-26T08:34:46.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-07-26T08:34:46.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-07-26T08:34:46.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-07-26T08:34:46.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-07-26T08:34:46.924 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-07-26T08:34:46.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/ 2024-07-26T08:34:46.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-07-26T08:34:46.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-07-26T08:34:46.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-07-26T08:34:46.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-07-26T08:34:46.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-07-26T08:34:46.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-07-26T08:34:46.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-07-26T08:34:46.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-07-26T08:34:46.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-07-26T08:34:46.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-07-26T08:34:46.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-07-26T08:34:46.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/ 2024-07-26T08:34:46.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-07-26T08:34:46.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-07-26T08:34:46.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-07-26T08:34:46.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-07-26T08:34:46.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-07-26T08:34:46.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-07-26T08:34:46.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-07-26T08:34:46.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-07-26T08:34:46.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-07-26T08:34:46.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-07-26T08:34:46.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-07-26T08:34:46.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gcov.txt 2024-07-26T08:34:46.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-07-26T08:34:46.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/ 2024-07-26T08:34:46.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-07-26T08:34:46.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-07-26T08:34:47.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-07-26T08:34:47.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-07-26T08:34:47.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-07-26T08:34:47.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-07-26T08:34:47.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-07-26T08:34:47.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/ 2024-07-26T08:34:47.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-07-26T08:34:47.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-07-26T08:34:47.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-07-26T08:34:47.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-07-26T08:34:47.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-07-26T08:34:47.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/highuid.txt 2024-07-26T08:34:47.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hsi.txt 2024-07-26T08:34:47.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-07-26T08:34:47.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ 2024-07-26T08:34:47.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-07-26T08:34:47.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-07-26T08:34:47.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-07-26T08:34:47.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-07-26T08:34:47.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-07-26T08:34:47.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-07-26T08:34:47.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-07-26T08:34:47.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-07-26T08:34:47.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-07-26T08:34:47.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-07-26T08:34:47.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-07-26T08:34:47.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-07-26T08:34:47.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-07-26T08:34:47.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-07-26T08:34:47.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-07-26T08:34:47.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-07-26T08:34:47.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-07-26T08:34:47.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-07-26T08:34:47.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-07-26T08:34:47.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-07-26T08:34:47.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-07-26T08:34:47.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-07-26T08:34:47.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-07-26T08:34:47.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-07-26T08:34:47.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-07-26T08:34:47.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-07-26T08:34:47.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-07-26T08:34:47.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-07-26T08:34:47.088 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-07-26T08:34:47.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-07-26T08:34:47.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-07-26T08:34:47.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-07-26T08:34:47.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-07-26T08:34:47.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-07-26T08:34:47.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-07-26T08:34:47.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-07-26T08:34:47.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-07-26T08:34:47.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-07-26T08:34:47.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-07-26T08:34:47.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-07-26T08:34:47.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-07-26T08:34:47.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-07-26T08:34:47.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-07-26T08:34:47.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-07-26T08:34:47.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-07-26T08:34:47.118 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-07-26T08:34:47.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-07-26T08:34:47.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-07-26T08:34:47.124 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-07-26T08:34:47.127 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-07-26T08:34:47.129 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-07-26T08:34:47.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-07-26T08:34:47.133 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-07-26T08:34:47.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-07-26T08:34:47.138 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-07-26T08:34:47.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-07-26T08:34:47.144 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-07-26T08:34:47.147 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-07-26T08:34:47.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-07-26T08:34:47.152 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-07-26T08:34:47.155 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-07-26T08:34:47.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-07-26T08:34:47.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-07-26T08:34:47.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-07-26T08:34:47.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-07-26T08:34:47.167 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-07-26T08:34:47.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-07-26T08:34:47.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-07-26T08:34:47.175 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-07-26T08:34:47.178 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-07-26T08:34:47.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-07-26T08:34:47.183 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-07-26T08:34:47.185 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-07-26T08:34:47.188 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-07-26T08:34:47.191 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-07-26T08:34:47.194 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-07-26T08:34:47.196 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-07-26T08:34:47.199 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-07-26T08:34:47.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-07-26T08:34:47.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-07-26T08:34:47.208 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-07-26T08:34:47.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-07-26T08:34:47.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-07-26T08:34:47.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-07-26T08:34:47.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-07-26T08:34:47.222 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-07-26T08:34:47.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-07-26T08:34:47.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-07-26T08:34:47.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-07-26T08:34:47.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-07-26T08:34:47.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-07-26T08:34:47.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-07-26T08:34:47.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-07-26T08:34:47.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-07-26T08:34:47.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-07-26T08:34:47.247 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-07-26T08:34:47.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-07-26T08:34:47.253 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-07-26T08:34:47.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-07-26T08:34:47.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-07-26T08:34:47.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-07-26T08:34:47.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-07-26T08:34:47.267 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-07-26T08:34:47.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-07-26T08:34:47.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-07-26T08:34:47.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-07-26T08:34:47.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-07-26T08:34:47.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-07-26T08:34:47.284 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-07-26T08:34:47.287 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-07-26T08:34:47.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-07-26T08:34:47.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-07-26T08:34:47.297 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-07-26T08:34:47.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-07-26T08:34:47.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-07-26T08:34:47.305 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-07-26T08:34:47.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-07-26T08:34:47.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-07-26T08:34:47.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-07-26T08:34:47.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-07-26T08:34:47.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-07-26T08:34:47.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-07-26T08:34:47.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-07-26T08:34:47.326 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-07-26T08:34:47.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-07-26T08:34:47.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-07-26T08:34:47.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-07-26T08:34:47.335 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-07-26T08:34:47.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-07-26T08:34:47.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-07-26T08:34:47.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-07-26T08:34:47.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-07-26T08:34:47.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-07-26T08:34:47.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-07-26T08:34:47.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-07-26T08:34:47.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-07-26T08:34:47.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-07-26T08:34:47.363 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/ 2024-07-26T08:34:47.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-07-26T08:34:47.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-07-26T08:34:47.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-07-26T08:34:47.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-07-26T08:34:47.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-07-26T08:34:47.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-07-26T08:34:47.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-07-26T08:34:47.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-07-26T08:34:47.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-07-26T08:34:47.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-07-26T08:34:47.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-07-26T08:34:47.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-07-26T08:34:47.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-07-26T08:34:47.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-07-26T08:34:47.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-07-26T08:34:47.399 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-07-26T08:34:47.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-07-26T08:34:47.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-07-26T08:34:47.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-07-26T08:34:47.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-07-26T08:34:47.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-07-26T08:34:47.412 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-07-26T08:34:47.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-07-26T08:34:47.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-07-26T08:34:47.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-07-26T08:34:47.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-07-26T08:34:47.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-07-26T08:34:47.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-07-26T08:34:47.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-07-26T08:34:47.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-07-26T08:34:47.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-07-26T08:34:47.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-07-26T08:34:47.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/summary 2024-07-26T08:34:47.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-07-26T08:34:47.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-07-26T08:34:47.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-07-26T08:34:47.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2o/ 2024-07-26T08:34:47.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2o/README 2024-07-26T08:34:47.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-07-26T08:34:47.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/ 2024-07-26T08:34:47.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-07-26T08:34:47.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-07-26T08:34:47.459 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-07-26T08:34:47.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/README 2024-07-26T08:34:47.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-07-26T08:34:47.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-07-26T08:34:47.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 -- 172.21.15.43:0/2081894824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16501041f0 msgr2=0x7f1650104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 --2- 172.21.15.43:0/2081894824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16501041f0 0x7f1650104600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1644009900 tx=0x7f164402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 -- 172.21.15.43:0/2081894824 shutdown_connections 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 --2- 172.21.15.43:0/2081894824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165010d650 0x7f165010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 --2- 172.21.15.43:0/2081894824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1650104b40 0x7f165010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 --2- 172.21.15.43:0/2081894824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16501041f0 0x7f1650104600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 -- 172.21.15.43:0/2081894824 >> 172.21.15.43:0/2081894824 conn(0x7f16500fdcf0 msgr2=0x7f1650100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 -- 172.21.15.43:0/2081894824 shutdown_connections 2024-07-26T08:34:47.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.464+0000 7f1655e00640 1 -- 172.21.15.43:0/2081894824 wait complete. 2024-07-26T08:34:47.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-07-26T08:34:47.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.465+0000 7f1655e00640 1 Processor -- start 2024-07-26T08:34:47.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 -- start start 2024-07-26T08:34:47.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16501041f0 0x7f1650101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 0x7f1650102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f165010d650 0x7f16501029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16501133f0 con 0x7f1650104b40 2024-07-26T08:34:47.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1650113270 con 0x7f165010d650 2024-07-26T08:34:47.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f1655e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1650113570 con 0x7f16501041f0 2024-07-26T08:34:47.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-07-26T08:34:47.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.466+0000 7f164fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 0x7f1650102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f1654a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16501041f0 0x7f1650101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 0x7f1650102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43878/0 (socket says 172.21.15.43:43878) 2024-07-26T08:34:47.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f1654a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16501041f0 0x7f1650101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:50042/0 (socket says 172.21.15.43:50042) 2024-07-26T08:34:47.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 -- 172.21.15.43:0/1093255317 learned_addr learned my addr 172.21.15.43:0/1093255317 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:47.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 -- 172.21.15.43:0/1093255317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16501041f0 msgr2=0x7f1650101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16501041f0 0x7f1650101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 -- 172.21.15.43:0/1093255317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f165010d650 msgr2=0x7f16501029b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-26T08:34:47.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f165010d650 0x7f16501029b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.467+0000 7f164fe00640 1 -- 172.21.15.43:0/1093255317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16501a8100 con 0x7f1650104b40 2024-07-26T08:34:47.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.468+0000 7f164fe00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 0x7f1650102470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f163c00e970 tx=0x7f163c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:47.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.468+0000 7f164d600640 1 -- 172.21.15.43:0/1093255317 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c00cd80 con 0x7f1650104b40 2024-07-26T08:34:47.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.468+0000 7f164d600640 1 -- 172.21.15.43:0/1093255317 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f163c0035f0 con 0x7f1650104b40 2024-07-26T08:34:47.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.468+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16501a83f0 con 0x7f1650104b40 2024-07-26T08:34:47.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.468+0000 7f164d600640 1 -- 172.21.15.43:0/1093255317 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c010690 con 0x7f1650104b40 2024-07-26T08:34:47.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.468+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16501a8980 con 0x7f1650104b40 2024-07-26T08:34:47.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-07-26T08:34:47.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-07-26T08:34:47.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.473+0000 7f165e05d740 1 Processor -- start 2024-07-26T08:34:47.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.473+0000 7f165e05d740 1 -- start start 2024-07-26T08:34:47.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.473+0000 7f165e05d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca240220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f165e05d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca240760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f165e05d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca240ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f165e05d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a7ca1b6bf0 con 0x55a7c9e721b0 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f165e05d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a7ca1a60f0 con 0x55a7c9e9b070 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f165e05d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a7ca1aa130 con 0x55a7c9e7a390 2024-07-26T08:34:47.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f1654a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca240760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f1654a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca240760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43888/0 (socket says 172.21.15.43:43888) 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f1654a00640 1 -- 172.21.15.43:0/1357207092 learned_addr learned my addr 172.21.15.43:0/1357207092 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.474+0000 7f1655400640 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca240220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f1654a00640 1 -- 172.21.15.43:0/1357207092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 msgr2=0x55a7ca240ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f1654a00640 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca240ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f1654a00640 1 -- 172.21.15.43:0/1357207092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 msgr2=0x55a7ca240220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f1654a00640 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca240220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f1654a00640 1 -- 172.21.15.43:0/1357207092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c9f06650 con 0x55a7c9e721b0 2024-07-26T08:34:47.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f164d600640 1 -- 172.21.15.43:0/1093255317 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f163c003b30 con 0x7f1650104b40 2024-07-26T08:34:47.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.475+0000 7f1654a00640 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca240760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f164402a910 tx=0x7f1644005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9d09f30d7d9cc9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:47.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-07-26T08:34:47.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.476+0000 7f1641c00640 1 -- 172.21.15.43:0/1357207092 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644040070 con 0x55a7c9e721b0 2024-07-26T08:34:47.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.476+0000 7f1641c00640 1 -- 172.21.15.43:0/1357207092 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1644004020 con 0x55a7c9e721b0 2024-07-26T08:34:47.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.476+0000 7f1641c00640 1 -- 172.21.15.43:0/1357207092 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644035040 con 0x55a7c9e721b0 2024-07-26T08:34:47.479 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 -- 172.21.15.43:0/1357207092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 msgr2=0x55a7ca240760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca240760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f164402a910 tx=0x7f1644005f10 comp rx=0 tx=0).stop 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 -- 172.21.15.43:0/1357207092 shutdown_connections 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca240ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca240760 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 --2- 172.21.15.43:0/1357207092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca240220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 -- 172.21.15.43:0/1357207092 >> 172.21.15.43:0/1357207092 conn(0x55a7c9e8f460 msgr2=0x55a7ca23e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:47.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 -- 172.21.15.43:0/1357207092 shutdown_connections 2024-07-26T08:34:47.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-07-26T08:34:47.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.478+0000 7f165e05d740 1 -- 172.21.15.43:0/1357207092 wait complete. 2024-07-26T08:34:47.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.479+0000 7f164d600640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f16380b3d50 0x7f16380b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.479+0000 7f164d600640 1 -- 172.21.15.43:0/1093255317 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f163c0e46e0 con 0x7f1650104b40 2024-07-26T08:34:47.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.479+0000 7f1654a00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f16380b3d50 0x7f16380b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.479+0000 7f165e05d740 1 -- start start 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.480+0000 7f165e05d740 1 Processor -- start 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 0x55a7ca24b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e7a390 0x55a7ca24bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca24c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a7ca009700 con 0x55a7c9e7a390 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a7ca1426c0 con 0x55a7c9e721b0 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a7ca24e9a0 con 0x55a7c9e9b070 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f16380b3d50 0x7f16380b6260 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f16440096c0 tx=0x7f1644005fd0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f165e05d740 10 client.0 _ll_register_callbacks cb 0x55a7ca152170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 0x55a7ca24b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 0x55a7ca24b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49398/0 (socket says 172.21.15.43:49398) 2024-07-26T08:34:47.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 -- 172.21.15.43:0/2008990977 learned_addr learned my addr 172.21.15.43:0/2008990977 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:47.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-07-26T08:34:47.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 -- 172.21.15.43:0/2008990977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 msgr2=0x55a7ca24c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T08:34:47.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca24c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.481+0000 7f1654a00640 1 -- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e7a390 msgr2=0x55a7ca24bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:47.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.482+0000 7f1654a00640 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e7a390 0x55a7ca24bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.482+0000 7f1654a00640 1 -- 172.21.15.43:0/2008990977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ca159860 con 0x55a7c9e721b0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.482+0000 7f1654a00640 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 0x55a7ca24b870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1644031f00 tx=0x7f16440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0bf9dcc0526b9a4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.482+0000 7f1636000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f1636000640 1 -- 172.21.15.43:0/2008990977 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644035070 con 0x55a7c9e721b0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1644004020 con 0x55a7c9e721b0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f1636000640 1 -- 172.21.15.43:0/2008990977 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f164404a030 con 0x55a7c9e721b0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f1636000640 1 -- 172.21.15.43:0/2008990977 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16440318e0 con 0x55a7c9e721b0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f165e05d740 10 client.25619 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7ca25a600 con 0x55a7c9e721b0 2024-07-26T08:34:47.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.483+0000 7f1636000640 1 -- 172.21.15.43:0/2008990977 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1644004020 con 0x55a7c9e721b0 2024-07-26T08:34:47.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-07-26T08:34:47.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f1636000640 1 -- 172.21.15.43:0/2008990977 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f16440035f0 con 0x55a7c9e721b0 2024-07-26T08:34:47.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f165e05d740 10 client.25619 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:47.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f165e05d740 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:47.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f165e05d740 20 client.25619 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:47.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f165e05d740 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e599f0 0x55a7ca25d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f165e05d740 4 client.25619 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:47.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.485+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7ca1b8b40 con 0x55a7c9e599f0 2024-07-26T08:34:47.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.486+0000 7f164fe00640 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e599f0 0x55a7ca25d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-07-26T08:34:47.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.486+0000 7f164fe00640 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e599f0 0x55a7ca25d960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e151a7f7edfa56 server_cookie=a2c1e057c1da53ee in_seq=0 out_seq=0 2024-07-26T08:34:47.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.486+0000 7f1636000640 10 client.25619 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:47.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.488+0000 7f1636000640 1 -- 172.21.15.43:0/2008990977 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7ca1b8b40 con 0x55a7c9e599f0 2024-07-26T08:34:47.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.488+0000 7f1636000640 10 client.25619 handle_command_reply: tid=0 2024-07-26T08:34:47.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 client.25619 shutdown 2024-07-26T08:34:47.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 msgr2=0x55a7ca24b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 0x55a7ca24b870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1644031f00 tx=0x7f16440046c0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 shutdown_connections 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e599f0 0x55a7ca25d960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca24c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e7a390 0x55a7ca24bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 --2- 172.21.15.43:0/2008990977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e721b0 0x55a7ca24b870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 >> 172.21.15.43:0/2008990977 conn(0x55a7c9e8f460 msgr2=0x55a7ca2433b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.489+0000 7f1636000640 0 client.25619 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:47.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.490+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 shutdown_connections 2024-07-26T08:34:47.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.490+0000 7f165e05d740 1 -- 172.21.15.43:0/2008990977 wait complete. 2024-07-26T08:34:47.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.490+0000 7f165e05d740 20 client.25619 trim_cache size 0 max 16384 2024-07-26T08:34:47.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-07-26T08:34:47.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-07-26T08:34:47.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/ 2024-07-26T08:34:47.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-07-26T08:34:47.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-07-26T08:34:47.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-07-26T08:34:47.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-07-26T08:34:47.507 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-07-26T08:34:47.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/init.txt 2024-07-26T08:34:47.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/initrd.txt 2024-07-26T08:34:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.510+0000 7f165e05d740 1 Processor -- start 2024-07-26T08:34:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.510+0000 7f165e05d740 1 -- start start 2024-07-26T08:34:47.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.510+0000 7f165e05d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca23d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/ 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.510+0000 7f165e05d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca24d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f165e05d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca241960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f165e05d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16501b5450 con 0x55a7c9e721b0 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f165e05d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f16501b2d20 con 0x55a7c9e9b070 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f165e05d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f16501b0b70 con 0x55a7c9e7a390 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f1654a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca23d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f1654a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca23d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43910/0 (socket says 172.21.15.43:43910) 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f1654a00640 1 -- 172.21.15.43:0/4046986799 learned_addr learned my addr 172.21.15.43:0/4046986799 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f1655400640 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca241960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.511+0000 7f164fe00640 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca24d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f164fe00640 1 -- 172.21.15.43:0/4046986799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 msgr2=0x55a7ca241960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f164fe00640 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca241960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f164fe00640 1 -- 172.21.15.43:0/4046986799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 msgr2=0x55a7ca23d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f164fe00640 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca23d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f164fe00640 1 -- 172.21.15.43:0/4046986799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ca242950 con 0x55a7c9e7a390 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f1655400640 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca241960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.512+0000 7f164fe00640 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca24d750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f163c0e1a00 tx=0x7f163c0aaac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db97a84a94f8786b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.513+0000 7f1641200640 1 -- 172.21.15.43:0/4046986799 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c08f070 con 0x55a7c9e7a390 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.513+0000 7f1641200640 1 -- 172.21.15.43:0/4046986799 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f163c0e3040 con 0x55a7c9e7a390 2024-07-26T08:34:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.513+0000 7f1641200640 1 -- 172.21.15.43:0/4046986799 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0e1cb0 con 0x55a7c9e7a390 2024-07-26T08:34:47.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-07-26T08:34:47.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 -- 172.21.15.43:0/4046986799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 msgr2=0x55a7ca24d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca24d750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f163c0e1a00 tx=0x7f163c0aaac0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 -- 172.21.15.43:0/4046986799 shutdown_connections 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e7a390 0x55a7ca24d750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e9b070 0x55a7ca241960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 --2- 172.21.15.43:0/4046986799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca23d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.514+0000 7f165e05d740 1 -- 172.21.15.43:0/4046986799 >> 172.21.15.43:0/4046986799 conn(0x55a7c9e8f460 msgr2=0x55a7ca241250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.515+0000 7f165e05d740 1 -- 172.21.15.43:0/4046986799 shutdown_connections 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.515+0000 7f165e05d740 1 -- 172.21.15.43:0/4046986799 wait complete. 2024-07-26T08:34:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.515+0000 7f165e05d740 1 -- start start 2024-07-26T08:34:47.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-07-26T08:34:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.516+0000 7f165e05d740 1 Processor -- start 2024-07-26T08:34:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.516+0000 7f165e05d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca254180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.516+0000 7f165e05d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e7a390 0x55a7ca2516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.516+0000 7f165e05d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca251be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f165e05d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16501b11e0 con 0x55a7c9e721b0 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f165e05d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f16501b2650 con 0x55a7c9e7a390 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f165e05d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f16501b18b0 con 0x55a7c9e9b070 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f165e05d740 10 client.0 _ll_register_callbacks cb 0x7f1644004380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f1654a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca254180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f1654a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca254180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43922/0 (socket says 172.21.15.43:43922) 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f164fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e7a390 0x55a7ca2516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f1654a00640 1 -- 172.21.15.43:0/3433754764 learned_addr learned my addr 172.21.15.43:0/3433754764 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:47.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-07-26T08:34:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f1655400640 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca251be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f1654a00640 1 -- 172.21.15.43:0/3433754764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 msgr2=0x55a7ca251be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.517+0000 7f1654a00640 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca251be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1654a00640 1 -- 172.21.15.43:0/3433754764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e7a390 msgr2=0x55a7ca2516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1654a00640 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e7a390 0x55a7ca2516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1654a00640 1 -- 172.21.15.43:0/3433754764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ca242ee0 con 0x55a7c9e721b0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1654a00640 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca254180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f16440092a0 tx=0x7f1644003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a8011baf23bb24 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1636000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1636000640 1 -- 172.21.15.43:0/3433754764 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644035040 con 0x55a7c9e721b0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.518+0000 7f1636000640 1 -- 172.21.15.43:0/3433754764 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f1644004990 con 0x55a7c9e721b0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.519+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163c0e3040 con 0x55a7c9e721b0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.519+0000 7f1636000640 1 -- 172.21.15.43:0/3433754764 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1644004b90 con 0x55a7c9e721b0 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.519+0000 7f165e05d740 10 client.15510 fetch_fsmap learned FSMap version 25 2024-07-26T08:34:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.519+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7ca2c5b10 con 0x55a7c9e721b0 2024-07-26T08:34:47.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-07-26T08:34:47.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.519+0000 7f1636000640 1 -- 172.21.15.43:0/3433754764 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f163c0e3040 con 0x55a7c9e721b0 2024-07-26T08:34:47.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f1636000640 1 -- 172.21.15.43:0/3433754764 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f164406f030 con 0x55a7c9e721b0 2024-07-26T08:34:47.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f165e05d740 10 client.15510 fetch_fsmap finished waiting for FSMap version 25 2024-07-26T08:34:47.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f165e05d740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:47.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f165e05d740 20 client.15510 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:47.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f165e05d740 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e2eda0 0x55a7ca2c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:47.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f165e05d740 4 client.15510 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:34:47.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7ca1b45e0 con 0x55a7c9e2eda0 2024-07-26T08:34:47.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.520+0000 7f164fe00640 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e2eda0 0x55a7ca2c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:47.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-07-26T08:34:47.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.521+0000 7f164fe00640 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e2eda0 0x55a7ca2c80e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55c48dc05f5bd9b8 server_cookie=d40f0db0005e6ee2 in_seq=0 out_seq=0 2024-07-26T08:34:47.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.521+0000 7f1636000640 10 client.15510 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:47.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-07-26T08:34:47.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.523+0000 7f1636000640 1 -- 172.21.15.43:0/3433754764 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7ca1b45e0 con 0x55a7c9e2eda0 2024-07-26T08:34:47.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.523+0000 7f1636000640 10 client.15510 handle_command_reply: tid=0 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.523+0000 7f165e05d740 1 client.15510 shutdown 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 msgr2=0x55a7ca254180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca254180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f16440092a0 tx=0x7f1644003820 comp rx=0 tx=0).stop 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 shutdown_connections 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55a7c9e2eda0 0x55a7ca2c80e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7c9e9b070 0x55a7ca251be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a7c9e7a390 0x55a7ca2516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 --2- 172.21.15.43:0/3433754764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7c9e721b0 0x55a7ca254180 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 >> 172.21.15.43:0/3433754764 conn(0x55a7c9e8f460 msgr2=0x55a7ca24d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.524+0000 7f1636000640 0 client.15510 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:47.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-07-26T08:34:47.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.525+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 shutdown_connections 2024-07-26T08:34:47.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.525+0000 7f165e05d740 1 -- 172.21.15.43:0/3433754764 wait complete. 2024-07-26T08:34:47.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.525+0000 7f165e05d740 20 client.15510 trim_cache size 0 max 16384 2024-07-26T08:34:47.531 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.526+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f16380b3d50 msgr2=0x7f16380b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.526+0000 7f1655e00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f16380b3d50 0x7f16380b6260 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f16440096c0 tx=0x7f1644005fd0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.526+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 msgr2=0x7f1650102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.526+0000 7f1655e00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 0x7f1650102470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f163c00e970 tx=0x7f163c00ee30 comp rx=0 tx=0).stop 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.526+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 shutdown_connections 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f16380b3d50 0x7f16380b6260 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f165010d650 0x7f16501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1650104b40 0x7f1650102470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 --2- 172.21.15.43:0/1093255317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16501041f0 0x7f1650101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:47.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 >> 172.21.15.43:0/1093255317 conn(0x7f16500fdcf0 msgr2=0x7f1650100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:47.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 shutdown_connections 2024-07-26T08:34:47.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:47.527+0000 7f1655e00640 1 -- 172.21.15.43:0/1093255317 wait complete. 2024-07-26T08:34:47.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-07-26T08:34:47.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-07-26T08:34:47.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-07-26T08:34:47.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-07-26T08:34:47.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-07-26T08:34:47.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-07-26T08:34:47.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-07-26T08:34:47.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-07-26T08:34:47.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-07-26T08:34:47.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-07-26T08:34:47.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/input.txt 2024-07-26T08:34:47.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-07-26T08:34:47.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-07-26T08:34:47.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-07-26T08:34:47.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-07-26T08:34:47.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-07-26T08:34:47.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-07-26T08:34:47.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-07-26T08:34:47.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-07-26T08:34:47.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-07-26T08:34:47.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-07-26T08:34:47.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-07-26T08:34:47.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-07-26T08:34:47.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-07-26T08:34:47.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-07-26T08:34:47.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-07-26T08:34:47.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-07-26T08:34:47.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/ 2024-07-26T08:34:47.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-07-26T08:34:47.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-07-26T08:34:47.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-07-26T08:34:47.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-07-26T08:34:47.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-07-26T08:34:47.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-07-26T08:34:47.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/iostats.txt 2024-07-26T08:34:47.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-07-26T08:34:47.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-07-26T08:34:47.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/ 2024-07-26T08:34:47.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-07-26T08:34:47.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-07-26T08:34:47.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-07-26T08:34:47.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-07-26T08:34:47.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-07-26T08:34:47.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-07-26T08:34:47.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README 2024-07-26T08:34:47.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-07-26T08:34:47.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-07-26T08:34:47.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-07-26T08:34:47.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-07-26T08:34:47.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-07-26T08:34:47.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-07-26T08:34:47.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-07-26T08:34:47.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-07-26T08:34:47.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-07-26T08:34:47.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-07-26T08:34:47.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-07-26T08:34:47.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-07-26T08:34:47.621 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-07-26T08:34:47.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-07-26T08:34:47.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-07-26T08:34:47.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-07-26T08:34:47.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-07-26T08:34:47.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-07-26T08:34:47.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-07-26T08:34:47.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-07-26T08:34:47.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-07-26T08:34:47.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-07-26T08:34:47.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-07-26T08:34:47.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-07-26T08:34:47.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/java.txt 2024-07-26T08:34:47.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kasan.txt 2024-07-26T08:34:47.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/ 2024-07-26T08:34:47.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-07-26T08:34:47.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-07-26T08:34:47.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-07-26T08:34:47.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-07-26T08:34:47.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-07-26T08:34:47.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-07-26T08:34:47.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-07-26T08:34:47.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kdump/ 2024-07-26T08:34:47.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-07-26T08:34:47.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-07-26T08:34:47.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-07-26T08:34:47.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-07-26T08:34:47.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-07-26T08:34:47.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-07-26T08:34:47.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-07-26T08:34:47.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-07-26T08:34:47.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-07-26T08:34:47.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-07-26T08:34:47.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-07-26T08:34:47.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kobject.txt 2024-07-26T08:34:47.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-07-26T08:34:47.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kref.txt 2024-07-26T08:34:47.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-07-26T08:34:47.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/ 2024-07-26T08:34:47.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-07-26T08:34:47.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-07-26T08:34:47.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-07-26T08:34:47.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-07-26T08:34:47.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-07-26T08:34:47.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-07-26T08:34:47.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-07-26T08:34:47.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-07-26T08:34:47.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-07-26T08:34:47.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-07-26T08:34:47.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-07-26T08:34:47.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-07-26T08:34:47.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ldm.txt 2024-07-26T08:34:47.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/ 2024-07-26T08:34:47.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-07-26T08:34:47.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-07-26T08:34:47.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-07-26T08:34:47.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-07-26T08:34:47.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-07-26T08:34:47.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-07-26T08:34:47.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-07-26T08:34:47.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-07-26T08:34:47.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-07-26T08:34:47.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-07-26T08:34:47.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-07-26T08:34:47.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-07-26T08:34:47.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/ 2024-07-26T08:34:47.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-07-26T08:34:47.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-07-26T08:34:47.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-07-26T08:34:47.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-07-26T08:34:47.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-07-26T08:34:47.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-07-26T08:34:47.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-07-26T08:34:47.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-07-26T08:34:47.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-07-26T08:34:47.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-07-26T08:34:47.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-07-26T08:34:47.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/logo.gif 2024-07-26T08:34:47.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/logo.txt 2024-07-26T08:34:47.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/lzo.txt 2024-07-26T08:34:47.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/ 2024-07-26T08:34:47.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-07-26T08:34:47.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-07-26T08:34:47.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-07-26T08:34:47.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-07-26T08:34:47.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-07-26T08:34:47.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/md.txt 2024-07-26T08:34:47.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-07-26T08:34:47.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-07-26T08:34:48.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-07-26T08:34:48.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-07-26T08:34:48.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-07-26T08:34:48.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/metag/ 2024-07-26T08:34:48.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-07-26T08:34:48.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-07-26T08:34:48.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/ 2024-07-26T08:34:48.062 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-07-26T08:34:48.065 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-07-26T08:34:48.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-07-26T08:34:48.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-07-26T08:34:48.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-07-26T08:34:48.077 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-07-26T08:34:48.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-07-26T08:34:48.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-07-26T08:34:48.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-07-26T08:34:48.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-07-26T08:34:48.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mips/ 2024-07-26T08:34:48.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-07-26T08:34:48.099 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-07-26T08:34:48.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-07-26T08:34:48.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-07-26T08:34:48.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-07-26T08:34:48.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-07-26T08:34:48.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-07-26T08:34:48.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-07-26T08:34:48.119 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-07-26T08:34:48.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-07-26T08:34:48.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-07-26T08:34:48.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-07-26T08:34:48.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-07-26T08:34:48.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-07-26T08:34:48.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-07-26T08:34:48.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-07-26T08:34:48.142 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-07-26T08:34:48.145 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-07-26T08:34:48.147 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-07-26T08:34:48.150 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-07-26T08:34:48.153 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-07-26T08:34:48.156 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/ 2024-07-26T08:34:48.158 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-07-26T08:34:48.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-07-26T08:34:48.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-07-26T08:34:48.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-07-26T08:34:48.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mn10300/ 2024-07-26T08:34:48.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-07-26T08:34:48.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-07-26T08:34:48.177 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-07-26T08:34:48.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mono.txt 2024-07-26T08:34:48.184 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/ 2024-07-26T08:34:48.186 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-07-26T08:34:48.189 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-07-26T08:34:48.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-07-26T08:34:48.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-07-26T08:34:48.198 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/namespaces/ 2024-07-26T08:34:48.201 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-07-26T08:34:48.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-07-26T08:34:48.207 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/ 2024-07-26T08:34:48.210 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-07-26T08:34:48.213 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-07-26T08:34:48.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-07-26T08:34:48.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-07-26T08:34:48.223 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-07-26T08:34:48.226 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ 2024-07-26T08:34:48.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-07-26T08:34:48.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-07-26T08:34:48.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-07-26T08:34:48.239 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-07-26T08:34:48.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-07-26T08:34:48.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-07-26T08:34:48.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-07-26T08:34:48.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-07-26T08:34:48.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-07-26T08:34:48.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-07-26T08:34:48.262 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-07-26T08:34:48.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-07-26T08:34:48.268 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-07-26T08:34:48.271 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-07-26T08:34:48.276 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-07-26T08:34:48.279 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-07-26T08:34:48.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-07-26T08:34:48.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-07-26T08:34:48.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-07-26T08:34:48.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-07-26T08:34:48.297 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-07-26T08:34:48.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-07-26T08:34:48.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-07-26T08:34:48.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-07-26T08:34:48.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-07-26T08:34:48.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-07-26T08:34:48.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-07-26T08:34:48.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-07-26T08:34:48.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-07-26T08:34:48.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-07-26T08:34:48.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-07-26T08:34:48.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-07-26T08:34:48.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-07-26T08:34:48.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-07-26T08:34:48.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-07-26T08:34:48.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-07-26T08:34:48.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-07-26T08:34:48.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-07-26T08:34:48.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-07-26T08:34:48.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-07-26T08:34:48.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-07-26T08:34:48.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-07-26T08:34:48.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-07-26T08:34:48.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-07-26T08:34:48.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-07-26T08:34:48.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-07-26T08:34:48.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-07-26T08:34:48.385 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-07-26T08:34:48.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-07-26T08:34:48.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-07-26T08:34:48.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-07-26T08:34:48.396 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-07-26T08:34:48.399 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-07-26T08:34:48.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-07-26T08:34:48.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-07-26T08:34:48.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-07-26T08:34:48.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-07-26T08:34:48.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-07-26T08:34:48.418 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-07-26T08:34:48.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-07-26T08:34:48.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-07-26T08:34:48.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-07-26T08:34:48.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-07-26T08:34:48.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-07-26T08:34:48.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-07-26T08:34:48.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-07-26T08:34:48.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-07-26T08:34:48.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-07-26T08:34:48.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-07-26T08:34:48.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-07-26T08:34:48.459 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-07-26T08:34:48.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-07-26T08:34:48.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-07-26T08:34:48.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-07-26T08:34:48.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-07-26T08:34:48.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-07-26T08:34:48.476 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-07-26T08:34:48.479 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-07-26T08:34:48.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-07-26T08:34:48.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-07-26T08:34:48.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-07-26T08:34:48.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-07-26T08:34:48.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-07-26T08:34:48.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-07-26T08:34:48.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-07-26T08:34:48.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-07-26T08:34:48.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-07-26T08:34:48.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-07-26T08:34:48.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-07-26T08:34:48.511 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-07-26T08:34:48.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-07-26T08:34:48.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-07-26T08:34:48.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-07-26T08:34:48.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-07-26T08:34:48.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-07-26T08:34:48.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-07-26T08:34:48.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-07-26T08:34:48.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-07-26T08:34:48.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-07-26T08:34:48.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-07-26T08:34:48.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-07-26T08:34:48.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-07-26T08:34:48.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-07-26T08:34:48.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-07-26T08:34:48.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-07-26T08:34:48.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-07-26T08:34:48.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-07-26T08:34:48.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-07-26T08:34:48.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-07-26T08:34:48.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-07-26T08:34:48.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-07-26T08:34:48.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-07-26T08:34:48.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-07-26T08:34:48.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-07-26T08:34:48.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-07-26T08:34:48.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-07-26T08:34:48.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-07-26T08:34:48.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-07-26T08:34:48.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-07-26T08:34:48.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-07-26T08:34:48.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-07-26T08:34:48.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-07-26T08:34:48.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-07-26T08:34:48.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-07-26T08:34:48.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-07-26T08:34:48.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-07-26T08:34:48.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-07-26T08:34:48.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-07-26T08:34:48.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-07-26T08:34:48.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-07-26T08:34:48.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-07-26T08:34:48.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-07-26T08:34:48.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-07-26T08:34:48.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-07-26T08:34:48.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-07-26T08:34:48.625 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nfc/ 2024-07-26T08:34:48.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-07-26T08:34:48.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-07-26T08:34:48.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nios2/ 2024-07-26T08:34:48.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nios2/README 2024-07-26T08:34:48.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-07-26T08:34:48.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/numastat.txt 2024-07-26T08:34:48.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-07-26T08:34:48.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/padata.txt 2024-07-26T08:34:48.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/ 2024-07-26T08:34:48.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-07-26T08:34:48.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-07-26T08:34:48.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/registers 2024-07-26T08:34:48.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-07-26T08:34:48.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parport.txt 2024-07-26T08:34:48.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-07-26T08:34:48.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-07-26T08:34:48.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-07-26T08:34:48.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-07-26T08:34:48.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-07-26T08:34:48.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-07-26T08:34:48.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-07-26T08:34:48.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-07-26T08:34:48.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-07-26T08:34:48.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/phy.txt 2024-07-26T08:34:48.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/phy/ 2024-07-26T08:34:48.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-07-26T08:34:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:48 smithi043 ceph-mon[32384]: pgmap v534: 129 pgs: 129 active+clean; 83 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-07-26T08:34:48.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-07-26T08:34:48.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-07-26T08:34:48.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/platform/ 2024-07-26T08:34:48.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-07-26T08:34:48.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pnp.txt 2024-07-26T08:34:48.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/ 2024-07-26T08:34:48.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-07-26T08:34:48.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-07-26T08:34:48.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-07-26T08:34:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:48 smithi133 ceph-mon[37053]: pgmap v534: 129 pgs: 129 active+clean; 83 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-07-26T08:34:48.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-07-26T08:34:48.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-07-26T08:34:48.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-07-26T08:34:48.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-07-26T08:34:48.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-07-26T08:34:48.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-07-26T08:34:48.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-07-26T08:34:48.790 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-07-26T08:34:48.794 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-07-26T08:34:48.798 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-07-26T08:34:48.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-07-26T08:34:48.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-07-26T08:34:48.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-07-26T08:34:48.811 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-07-26T08:34:48.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-07-26T08:34:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:48 smithi063 ceph-mon[36747]: pgmap v534: 129 pgs: 129 active+clean; 83 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-07-26T08:34:48.817 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-07-26T08:34:48.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-07-26T08:34:48.824 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-07-26T08:34:48.827 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-07-26T08:34:48.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-07-26T08:34:48.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/states.txt 2024-07-26T08:34:48.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-07-26T08:34:48.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-07-26T08:34:48.845 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-07-26T08:34:48.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-07-26T08:34:48.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-07-26T08:34:48.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-07-26T08:34:48.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-07-26T08:34:48.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/video.txt 2024-07-26T08:34:48.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/ 2024-07-26T08:34:48.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-07-26T08:34:48.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-07-26T08:34:48.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-07-26T08:34:48.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-07-26T08:34:48.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-07-26T08:34:48.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-07-26T08:34:48.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-07-26T08:34:48.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-07-26T08:34:48.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-07-26T08:34:48.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-07-26T08:34:48.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-07-26T08:34:48.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-07-26T08:34:48.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-07-26T08:34:48.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pps/ 2024-07-26T08:34:48.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-07-26T08:34:48.924 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/ 2024-07-26T08:34:48.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-07-26T08:34:48.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-07-26T08:34:48.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-07-26T08:34:48.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-07-26T08:34:48.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-07-26T08:34:48.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-07-26T08:34:48.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-07-26T08:34:48.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-07-26T08:34:48.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-07-26T08:34:48.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pti/ 2024-07-26T08:34:48.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-07-26T08:34:48.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/ 2024-07-26T08:34:48.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-07-26T08:34:48.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-07-26T08:34:48.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-07-26T08:34:48.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-07-26T08:34:48.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-07-26T08:34:48.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pwm.txt 2024-07-26T08:34:48.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-07-26T08:34:48.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/ 2024-07-26T08:34:49.002 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-07-26T08:34:49.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-07-26T08:34:49.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-07-26T08:34:49.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-07-26T08:34:49.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-07-26T08:34:49.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-07-26T08:34:49.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-07-26T08:34:49.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-07-26T08:34:49.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-07-26T08:34:49.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rtc.txt 2024-07-26T08:34:49.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/ 2024-07-26T08:34:49.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-07-26T08:34:49.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-07-26T08:34:49.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-07-26T08:34:49.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-07-26T08:34:49.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/DASD 2024-07-26T08:34:49.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-07-26T08:34:49.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-07-26T08:34:49.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-07-26T08:34:49.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-07-26T08:34:49.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-07-26T08:34:49.081 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-07-26T08:34:49.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-07-26T08:34:49.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-07-26T08:34:49.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-07-26T08:34:49.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/ 2024-07-26T08:34:49.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-07-26T08:34:49.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-07-26T08:34:49.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-07-26T08:34:49.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-07-26T08:34:49.110 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-07-26T08:34:49.113 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-07-26T08:34:49.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-07-26T08:34:49.118 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-07-26T08:34:49.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-07-26T08:34:49.124 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-07-26T08:34:49.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ 2024-07-26T08:34:49.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-07-26T08:34:49.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-07-26T08:34:49.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-07-26T08:34:49.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-07-26T08:34:49.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-07-26T08:34:49.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-07-26T08:34:49.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-07-26T08:34:49.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-07-26T08:34:49.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-07-26T08:34:49.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-07-26T08:34:49.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-07-26T08:34:49.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-07-26T08:34:49.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-07-26T08:34:49.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-07-26T08:34:49.176 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-07-26T08:34:49.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-07-26T08:34:49.184 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-07-26T08:34:49.188 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-07-26T08:34:49.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-07-26T08:34:49.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-07-26T08:34:49.199 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-07-26T08:34:49.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-07-26T08:34:49.208 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-07-26T08:34:49.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-07-26T08:34:49.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-07-26T08:34:49.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-07-26T08:34:49.224 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-07-26T08:34:49.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-07-26T08:34:49.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-07-26T08:34:49.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-07-26T08:34:49.237 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-07-26T08:34:49.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-07-26T08:34:49.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-07-26T08:34:49.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-07-26T08:34:49.253 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-07-26T08:34:49.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-07-26T08:34:49.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-07-26T08:34:49.264 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-07-26T08:34:49.268 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-07-26T08:34:49.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-07-26T08:34:49.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-07-26T08:34:49.279 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-07-26T08:34:49.283 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-07-26T08:34:49.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-07-26T08:34:49.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-07-26T08:34:49.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-07-26T08:34:49.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-07-26T08:34:49.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-07-26T08:34:49.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-07-26T08:34:49.309 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-07-26T08:34:49.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-07-26T08:34:49.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-07-26T08:34:49.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-07-26T08:34:49.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-07-26T08:34:49.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-07-26T08:34:49.334 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-07-26T08:34:49.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-07-26T08:34:49.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-07-26T08:34:49.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-07-26T08:34:49.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/ 2024-07-26T08:34:49.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-07-26T08:34:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-07-26T08:34:49.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-07-26T08:34:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-07-26T08:34:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-07-26T08:34:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-07-26T08:34:49.367 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-07-26T08:34:49.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-07-26T08:34:49.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-07-26T08:34:49.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-07-26T08:34:49.380 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-07-26T08:34:49.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-07-26T08:34:49.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-07-26T08:34:49.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-07-26T08:34:49.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/ 2024-07-26T08:34:49.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-07-26T08:34:49.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-07-26T08:34:49.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/driver 2024-07-26T08:34:49.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-07-26T08:34:49.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-07-26T08:34:49.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-07-26T08:34:49.414 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-07-26T08:34:49.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-07-26T08:34:49.418 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-07-26T08:34:49.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sh/ 2024-07-26T08:34:49.423 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-07-26T08:34:49.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-07-26T08:34:49.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-07-26T08:34:49.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/ 2024-07-26T08:34:49.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-07-26T08:34:49.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-07-26T08:34:49.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-07-26T08:34:49.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-07-26T08:34:49.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-07-26T08:34:49.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-07-26T08:34:49.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-07-26T08:34:49.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-07-26T08:34:49.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-07-26T08:34:49.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-07-26T08:34:49.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-07-26T08:34:49.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-07-26T08:34:49.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-07-26T08:34:49.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-07-26T08:34:49.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-07-26T08:34:49.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-07-26T08:34:49.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-07-26T08:34:49.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-07-26T08:34:49.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-07-26T08:34:49.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-07-26T08:34:49.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-07-26T08:34:49.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-07-26T08:34:49.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-07-26T08:34:49.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-07-26T08:34:49.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-07-26T08:34:49.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-07-26T08:34:49.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-07-26T08:34:49.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-07-26T08:34:49.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-07-26T08:34:49.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-07-26T08:34:49.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-07-26T08:34:49.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-07-26T08:34:49.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-07-26T08:34:49.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-07-26T08:34:49.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-07-26T08:34:49.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-07-26T08:34:49.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-07-26T08:34:49.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-07-26T08:34:49.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-07-26T08:34:49.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-07-26T08:34:49.534 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-26T08:34:49.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-26T08:34:49.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-07-26T08:34:49.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-07-26T08:34:49.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-07-26T08:34:49.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-07-26T08:34:49.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-07-26T08:34:49.548 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-07-26T08:34:49.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-07-26T08:34:49.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-07-26T08:34:49.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-07-26T08:34:49.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-07-26T08:34:49.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-07-26T08:34:49.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-07-26T08:34:49.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-07-26T08:34:49.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-07-26T08:34:49.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-07-26T08:34:49.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-07-26T08:34:49.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-07-26T08:34:49.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-07-26T08:34:49.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-07-26T08:34:49.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-07-26T08:34:49.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-07-26T08:34:49.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-07-26T08:34:49.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sparse.txt 2024-07-26T08:34:49.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/ 2024-07-26T08:34:49.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-07-26T08:34:49.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-07-26T08:34:49.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-07-26T08:34:49.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-07-26T08:34:49.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-07-26T08:34:49.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-07-26T08:34:49.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-07-26T08:34:49.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-07-26T08:34:49.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-07-26T08:34:49.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spidev 2024-07-26T08:34:49.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-07-26T08:34:49.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-07-26T08:34:49.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-07-26T08:34:49.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-07-26T08:34:49.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-07-26T08:34:49.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/svga.txt 2024-07-26T08:34:49.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/ 2024-07-26T08:34:49.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-07-26T08:34:49.621 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/README 2024-07-26T08:34:49.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-07-26T08:34:49.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-07-26T08:34:49.625 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-07-26T08:34:49.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-07-26T08:34:49.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-07-26T08:34:49.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-07-26T08:34:49.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-07-26T08:34:49.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-07-26T08:34:49.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/ 2024-07-26T08:34:49.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-07-26T08:34:49.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-07-26T08:34:49.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-07-26T08:34:49.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/ 2024-07-26T08:34:49.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-07-26T08:34:49.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-07-26T08:34:49.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-07-26T08:34:49.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-07-26T08:34:49.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-07-26T08:34:49.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-07-26T08:34:49.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-07-26T08:34:49.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-07-26T08:34:49.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/ 2024-07-26T08:34:49.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-07-26T08:34:49.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-07-26T08:34:49.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-07-26T08:34:49.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-07-26T08:34:49.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-07-26T08:34:49.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-07-26T08:34:49.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-07-26T08:34:49.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-07-26T08:34:49.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-07-26T08:34:49.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-07-26T08:34:49.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-07-26T08:34:49.681 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/tpm/ 2024-07-26T08:34:49.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-07-26T08:34:49.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ 2024-07-26T08:34:49.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-07-26T08:34:49.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-07-26T08:34:49.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-07-26T08:34:49.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-07-26T08:34:49.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-07-26T08:34:49.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-07-26T08:34:49.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-07-26T08:34:49.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-07-26T08:34:49.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-07-26T08:34:49.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-07-26T08:34:49.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-07-26T08:34:49.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-07-26T08:34:49.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-07-26T08:34:49.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-07-26T08:34:49.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-07-26T08:34:49.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-07-26T08:34:49.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-07-26T08:34:49.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-07-26T08:34:49.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/unicode.txt 2024-07-26T08:34:49.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/unshare.txt 2024-07-26T08:34:49.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/ 2024-07-26T08:34:49.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-07-26T08:34:49.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-07-26T08:34:49.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-07-26T08:34:49.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-07-26T08:34:49.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-07-26T08:34:49.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-07-26T08:34:49.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-07-26T08:34:49.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-07-26T08:34:49.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-07-26T08:34:49.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-07-26T08:34:49.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-07-26T08:34:49.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-07-26T08:34:49.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-07-26T08:34:49.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-07-26T08:34:49.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-07-26T08:34:49.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-07-26T08:34:49.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-07-26T08:34:49.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-07-26T08:34:49.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-07-26T08:34:49.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-07-26T08:34:49.755 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-07-26T08:34:49.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-07-26T08:34:49.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-07-26T08:34:49.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-07-26T08:34:49.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-07-26T08:34:49.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-07-26T08:34:49.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-07-26T08:34:49.765 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-07-26T08:34:49.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-07-26T08:34:49.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-07-26T08:34:49.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-07-26T08:34:49.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-07-26T08:34:49.772 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-07-26T08:34:49.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-07-26T08:34:49.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-07-26T08:34:49.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-07-26T08:34:49.778 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/ 2024-07-26T08:34:49.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-07-26T08:34:49.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-07-26T08:34:49.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-07-26T08:34:49.784 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-07-26T08:34:49.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-07-26T08:34:49.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vfio.txt 2024-07-26T08:34:49.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-07-26T08:34:49.790 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video-output.txt 2024-07-26T08:34:49.792 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/ 2024-07-26T08:34:49.794 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-07-26T08:34:49.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-07-26T08:34:49.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-07-26T08:34:49.798 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-07-26T08:34:49.800 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-07-26T08:34:49.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-07-26T08:34:49.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-07-26T08:34:49.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-07-26T08:34:49.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-07-26T08:34:49.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-07-26T08:34:49.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-07-26T08:34:49.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-07-26T08:34:49.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-07-26T08:34:49.817 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-07-26T08:34:49.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-07-26T08:34:49.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-07-26T08:34:49.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-07-26T08:34:49.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-07-26T08:34:49.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-07-26T08:34:49.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-07-26T08:34:49.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-07-26T08:34:49.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-07-26T08:34:49.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-07-26T08:34:49.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-07-26T08:34:49.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-07-26T08:34:49.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-07-26T08:34:49.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-07-26T08:34:49.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-07-26T08:34:49.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-07-26T08:34:49.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-07-26T08:34:49.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-07-26T08:34:49.853 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-07-26T08:34:49.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-07-26T08:34:49.856 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-07-26T08:34:49.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-07-26T08:34:49.858 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-07-26T08:34:49.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-07-26T08:34:49.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-07-26T08:34:49.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-07-26T08:34:49.864 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-07-26T08:34:49.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-07-26T08:34:49.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-07-26T08:34:49.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-07-26T08:34:49.871 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-07-26T08:34:49.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-07-26T08:34:49.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-07-26T08:34:49.877 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-07-26T08:34:49.879 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-07-26T08:34:49.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-07-26T08:34:49.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-07-26T08:34:49.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-07-26T08:34:49.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-07-26T08:34:49.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-07-26T08:34:49.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-07-26T08:34:49.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-07-26T08:34:49.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-07-26T08:34:49.889 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-07-26T08:34:49.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-07-26T08:34:49.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-07-26T08:34:49.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-07-26T08:34:49.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-07-26T08:34:49.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-07-26T08:34:49.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-07-26T08:34:49.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-07-26T08:34:49.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-07-26T08:34:49.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-07-26T08:34:49.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-07-26T08:34:49.904 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-07-26T08:34:49.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-07-26T08:34:49.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-07-26T08:34:49.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-07-26T08:34:49.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-07-26T08:34:49.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-07-26T08:34:49.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-07-26T08:34:49.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-07-26T08:34:49.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-07-26T08:34:49.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-07-26T08:34:49.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-07-26T08:34:49.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/ 2024-07-26T08:34:49.919 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-07-26T08:34:49.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-07-26T08:34:49.921 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-07-26T08:34:49.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-07-26T08:34:49.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-07-26T08:34:49.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-07-26T08:34:49.927 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-07-26T08:34:49.929 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-07-26T08:34:49.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-07-26T08:34:49.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-07-26T08:34:49.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-07-26T08:34:49.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-07-26T08:34:49.938 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-07-26T08:34:49.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-07-26T08:34:49.941 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-07-26T08:34:49.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-07-26T08:34:49.943 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-07-26T08:34:49.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-07-26T08:34:49.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-07-26T08:34:49.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-07-26T08:34:49.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-07-26T08:34:49.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-07-26T08:34:49.951 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-07-26T08:34:49.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-07-26T08:34:49.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-07-26T08:34:49.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/ 2024-07-26T08:34:49.957 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-07-26T08:34:49.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-07-26T08:34:49.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-07-26T08:34:49.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/balance 2024-07-26T08:34:49.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-07-26T08:34:49.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-07-26T08:34:49.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-07-26T08:34:49.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-07-26T08:34:49.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-07-26T08:34:49.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-07-26T08:34:49.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/numa 2024-07-26T08:34:49.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-07-26T08:34:49.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-07-26T08:34:49.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-07-26T08:34:49.974 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-07-26T08:34:49.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-07-26T08:34:49.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-07-26T08:34:49.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-07-26T08:34:49.979 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-07-26T08:34:49.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-07-26T08:34:49.981 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-07-26T08:34:49.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-07-26T08:34:49.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-07-26T08:34:49.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-07-26T08:34:49.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-07-26T08:34:49.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/ 2024-07-26T08:34:49.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-07-26T08:34:49.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-07-26T08:34:49.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-07-26T08:34:49.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-07-26T08:34:49.993 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-07-26T08:34:49.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-07-26T08:34:49.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-07-26T08:34:49.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-07-26T08:34:49.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-07-26T08:34:49.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-07-26T08:34:50.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-07-26T08:34:50.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-07-26T08:34:50.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-07-26T08:34:50.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-07-26T08:34:50.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-07-26T08:34:50.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-07-26T08:34:50.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/ 2024-07-26T08:34:50.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-07-26T08:34:50.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-07-26T08:34:50.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-07-26T08:34:50.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-07-26T08:34:50.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-07-26T08:34:50.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-07-26T08:34:50.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-07-26T08:34:50.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-07-26T08:34:50.021 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-07-26T08:34:50.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-07-26T08:34:50.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-07-26T08:34:50.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-07-26T08:34:50.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-07-26T08:34:50.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/wimax/ 2024-07-26T08:34:50.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-07-26T08:34:50.030 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-07-26T08:34:50.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-07-26T08:34:50.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/ 2024-07-26T08:34:50.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-07-26T08:34:50.038 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:50.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-07-26T08:34:50.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-07-26T08:34:50.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-07-26T08:34:50.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-07-26T08:34:50.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-07-26T08:34:50.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-07-26T08:34:50.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-07-26T08:34:50.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-07-26T08:34:50.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-07-26T08:34:50.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-07-26T08:34:50.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-07-26T08:34:50.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-07-26T08:34:50.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-07-26T08:34:50.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-07-26T08:34:50.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-07-26T08:34:50.065 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-07-26T08:34:50.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-07-26T08:34:50.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-07-26T08:34:50.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-07-26T08:34:50.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-07-26T08:34:50.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-07-26T08:34:50.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-07-26T08:34:50.077 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-07-26T08:34:50.079 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xtensa/ 2024-07-26T08:34:50.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-07-26T08:34:50.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-07-26T08:34:50.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xz.txt 2024-07-26T08:34:50.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-07-26T08:34:50.088 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-07-26T08:34:50.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-07-26T08:34:50.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-07-26T08:34:50.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-07-26T08:34:50.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-07-26T08:34:50.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-07-26T08:34:50.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-07-26T08:34:50.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-07-26T08:34:50.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-07-26T08:34:50.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-07-26T08:34:50.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-07-26T08:34:50.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-07-26T08:34:50.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-07-26T08:34:50.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-07-26T08:34:50.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-07-26T08:34:50.110 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-07-26T08:34:50.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-07-26T08:34:50.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-07-26T08:34:50.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-07-26T08:34:50.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-07-26T08:34:50.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-07-26T08:34:50.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-07-26T08:34:50.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-07-26T08:34:50.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-07-26T08:34:50.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-07-26T08:34:50.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-07-26T08:34:50.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-07-26T08:34:50.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-07-26T08:34:50.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zorro.txt 2024-07-26T08:34:50.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:50 smithi043 ceph-mon[32384]: pgmap v535: 129 pgs: 129 active+clean; 90 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 7.4 MiB/s wr, 53 op/s 2024-07-26T08:34:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:50 smithi133 ceph-mon[37053]: pgmap v535: 129 pgs: 129 active+clean; 90 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 7.4 MiB/s wr, 53 op/s 2024-07-26T08:34:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:50 smithi063 ceph-mon[36747]: pgmap v535: 129 pgs: 129 active+clean; 90 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 7.4 MiB/s wr, 53 op/s 2024-07-26T08:34:52.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 -- 172.21.15.43:0/2381187717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66810fa40 msgr2=0x7fe668111e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 --2- 172.21.15.43:0/2381187717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66810fa40 0x7fe668111e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe660009be0 tx=0x7fe66002a750 comp rx=0 tx=0).stop 2024-07-26T08:34:52.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 -- 172.21.15.43:0/2381187717 shutdown_connections 2024-07-26T08:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 --2- 172.21.15.43:0/2381187717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6681027e0 0x7fe66810f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 --2- 172.21.15.43:0/2381187717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66810fa40 0x7fe668111e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 --2- 172.21.15.43:0/2381187717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe668101e90 0x7fe6681022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 -- 172.21.15.43:0/2381187717 >> 172.21.15.43:0/2381187717 conn(0x7fe6680fdcf0 msgr2=0x7fe668100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 -- 172.21.15.43:0/2381187717 shutdown_connections 2024-07-26T08:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.531+0000 7fe66ec00640 1 -- 172.21.15.43:0/2381187717 wait complete. 2024-07-26T08:34:52.535 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:52 smithi043 ceph-mon[32384]: pgmap v536: 129 pgs: 129 active+clean; 90 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.1 MiB/s wr, 54 op/s 2024-07-26T08:34:52.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:52 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.533+0000 7fe66ec00640 1 Processor -- start 2024-07-26T08:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.533+0000 7fe66ec00640 1 -- start start 2024-07-26T08:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe668101e90 0x7fe6680747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 0x7fe66806daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe66810fa40 0x7fe66806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681155d0 con 0x7fe6681027e0 2024-07-26T08:34:52.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe668115450 con 0x7fe66810fa40 2024-07-26T08:34:52.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe668115750 con 0x7fe668101e90 2024-07-26T08:34:52.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 0x7fe66806daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 0x7fe66806daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43944/0 (socket says 172.21.15.43:43944) 2024-07-26T08:34:52.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66ce00640 1 -- 172.21.15.43:0/3911433899 learned_addr learned my addr 172.21.15.43:0/3911433899 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66e200640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe66810fa40 0x7fe66806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.534+0000 7fe66d800640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe668101e90 0x7fe6680747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66ce00640 1 -- 172.21.15.43:0/3911433899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe668101e90 msgr2=0x7fe6680747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66ce00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe668101e90 0x7fe6680747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66ce00640 1 -- 172.21.15.43:0/3911433899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe66810fa40 msgr2=0x7fe66806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66ce00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe66810fa40 0x7fe66806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66ce00640 1 -- 172.21.15.43:0/3911433899 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66806e780 con 0x7fe6681027e0 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66d800640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe668101e90 0x7fe6680747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:52.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.535+0000 7fe66ce00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 0x7fe66806daa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe65400ea60 tx=0x7fe65400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.536+0000 7fe666000640 1 -- 172.21.15.43:0/3911433899 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65400cde0 con 0x7fe6681027e0 2024-07-26T08:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.536+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe668073440 con 0x7fe6681027e0 2024-07-26T08:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.536+0000 7fe666000640 1 -- 172.21.15.43:0/3911433899 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe6540035f0 con 0x7fe6681027e0 2024-07-26T08:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.536+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe668073980 con 0x7fe6681027e0 2024-07-26T08:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.536+0000 7fe666000640 1 -- 172.21.15.43:0/3911433899 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654010690 con 0x7fe6681027e0 2024-07-26T08:34:52.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.540+0000 7fe676e6a740 1 Processor -- start 2024-07-26T08:34:52.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.540+0000 7fe676e6a740 1 -- start start 2024-07-26T08:34:52.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dbe9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d824670 0x55677dbea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe676e6a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55677db60bf0 con 0x55677d845350 2024-07-26T08:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe676e6a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55677db500f0 con 0x55677d81c490 2024-07-26T08:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe676e6a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55677db54130 con 0x55677d824670 2024-07-26T08:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe66d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe66d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbea4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49434/0 (socket says 172.21.15.43:49434) 2024-07-26T08:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe66d800640 1 -- 172.21.15.43:0/1971835558 learned_addr learned my addr 172.21.15.43:0/1971835558 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.541+0000 7fe66e200640 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dbe9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe66d800640 1 -- 172.21.15.43:0/1971835558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d824670 msgr2=0x55677dbea9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:34:52.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe66d800640 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d824670 0x55677dbea9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe66d800640 1 -- 172.21.15.43:0/1971835558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 msgr2=0x55677dbe9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe66d800640 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dbe9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe66d800640 1 -- 172.21.15.43:0/1971835558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55677d8b0930 con 0x55677d81c490 2024-07-26T08:34:52.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe666000640 1 -- 172.21.15.43:0/3911433899 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe654004000 con 0x7fe6681027e0 2024-07-26T08:34:52.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe66d800640 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbea4a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0114f0 tx=0x7fe65c0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1fe9206d852e0db server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:52.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe65aa00640 1 -- 172.21.15.43:0/1971835558 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c005020 con 0x55677d81c490 2024-07-26T08:34:52.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe65aa00640 1 -- 172.21.15.43:0/1971835558 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe65c0047a0 con 0x55677d81c490 2024-07-26T08:34:52.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.542+0000 7fe65aa00640 1 -- 172.21.15.43:0/1971835558 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00f980 con 0x55677d81c490 2024-07-26T08:34:52.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.543+0000 7fe676e6a740 1 -- 172.21.15.43:0/1971835558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 msgr2=0x55677dbea4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.543+0000 7fe676e6a740 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbea4a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0114f0 tx=0x7fe65c0119b0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 -- 172.21.15.43:0/1971835558 shutdown_connections 2024-07-26T08:34:52.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d824670 0x55677dbea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbea4a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 --2- 172.21.15.43:0/1971835558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dbe9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 -- 172.21.15.43:0/1971835558 >> 172.21.15.43:0/1971835558 conn(0x55677d839740 msgr2=0x55677dbe7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe666000640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6500b3dc0 0x7fe6500b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 -- 172.21.15.43:0/1971835558 shutdown_connections 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe666000640 1 -- 172.21.15.43:0/3911433899 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe6540e4540 con 0x7fe6681027e0 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe676e6a740 1 -- 172.21.15.43:0/1971835558 wait complete. 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.544+0000 7fe66d800640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6500b3dc0 0x7fe6500b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.545+0000 7fe676e6a740 1 -- start start 2024-07-26T08:34:52.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.545+0000 7fe676e6a740 1 Processor -- start 2024-07-26T08:34:52.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.545+0000 7fe66d800640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6500b3dc0 0x7fe6500b62d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe65c01b040 tx=0x7fe65c000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 0x55677dbf5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dc01ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55677d9b3890 con 0x55677d845350 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55677daec330 con 0x55677d824670 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55677dbf8740 con 0x55677d81c490 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe676e6a740 10 client.0 _ll_register_callbacks cb 0x55677db18010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66d800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 0x55677dbf5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dc01ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 0x55677dbf5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49438/0 (socket says 172.21.15.43:49438) 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66d800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:50080/0 (socket says 172.21.15.43:50080) 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 -- 172.21.15.43:0/3402862207 learned_addr learned my addr 172.21.15.43:0/3402862207 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 -- 172.21.15.43:0/3402862207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 msgr2=0x55677dbf5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 -- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 msgr2=0x55677dc01ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dc01ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.546+0000 7fe66ce00640 1 -- 172.21.15.43:0/3402862207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55677dbf6380 con 0x55677d824670 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.547+0000 7fe66ce00640 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 0x55677dbf5b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6540aaa50 tx=0x7fe6540aa5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67cc4e5f8d55473 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.547+0000 7fe64f400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.547+0000 7fe64f400640 1 -- 172.21.15.43:0/3402862207 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540aad50 con 0x55677d824670 2024-07-26T08:34:52.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.547+0000 7fe64f400640 1 -- 172.21.15.43:0/3402862207 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe6540a7340 con 0x55677d824670 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.547+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe65c0047a0 con 0x55677d824670 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.547+0000 7fe64f400640 1 -- 172.21.15.43:0/3402862207 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe6540af350 con 0x55677d824670 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 10 client.25637 fetch_fsmap learned FSMap version 26 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55677dc046d0 con 0x55677d824670 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe64f400640 1 -- 172.21.15.43:0/3402862207 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe65c0047a0 con 0x55677d824670 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe64f400640 1 -- 172.21.15.43:0/3402862207 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fe6540a66c0 con 0x55677d824670 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 10 client.25637 fetch_fsmap finished waiting for FSMap version 26 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 10 client.25637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 20 client.25637 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d803cd0 0x55677dc07bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 4 client.25637 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:34:52.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.548+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55677db62b40 con 0x55677d803cd0 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.549+0000 7fe66d800640 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d803cd0 0x55677dc07bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.549+0000 7fe66d800640 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d803cd0 0x55677dc07bf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=310b5bebfd530bd3 server_cookie=ea96d08ffc55bc64 in_seq=0 out_seq=0 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.549+0000 7fe64f400640 10 client.25637 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.550+0000 7fe64f400640 1 -- 172.21.15.43:0/3402862207 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55677db62b40 con 0x55677d803cd0 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.550+0000 7fe64f400640 10 client.25637 handle_command_reply: tid=0 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.550+0000 7fe676e6a740 1 client.25637 shutdown 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 msgr2=0x55677dbf5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 0x55677dbf5b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6540aaa50 tx=0x7fe6540aa5f0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 shutdown_connections 2024-07-26T08:34:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d803cd0 0x55677dc07bf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d845350 0x55677dc01ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d824670 0x55677dbf5b70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 --2- 172.21.15.43:0/3402862207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe64f400640 0 client.25637 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:52.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 >> 172.21.15.43:0/3402862207 conn(0x55677d839740 msgr2=0x55677dbed0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:52.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 shutdown_connections 2024-07-26T08:34:52.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 1 -- 172.21.15.43:0/3402862207 wait complete. 2024-07-26T08:34:52.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.551+0000 7fe676e6a740 20 client.25637 trim_cache size 0 max 16384 2024-07-26T08:34:52.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 Processor -- start 2024-07-26T08:34:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 -- start start 2024-07-26T08:34:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbe6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 0x55677dc018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe648012830 con 0x55677d824670 2024-07-26T08:34:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe648010100 con 0x55677d845350 2024-07-26T08:34:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.573+0000 7fe676e6a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe64800df50 con 0x55677d81c490 2024-07-26T08:34:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 0x55677dc018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 0x55677dc018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49454/0 (socket says 172.21.15.43:49454) 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 -- 172.21.15.43:0/83152482 learned_addr learned my addr 172.21.15.43:0/83152482 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66ce00640 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbe6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66d800640 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 -- 172.21.15.43:0/83152482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 msgr2=0x55677dbf0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 -- 172.21.15.43:0/83152482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 msgr2=0x55677dbe6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbe6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.574+0000 7fe66e200640 1 -- 172.21.15.43:0/83152482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55677dbf68f0 con 0x55677d845350 2024-07-26T08:34:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.575+0000 7fe66e200640 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 0x55677dc018b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe660009be0 tx=0x7fe6600305c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787b6728f97790ae server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.575+0000 7fe65a000640 1 -- 172.21.15.43:0/83152482 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660041070 con 0x55677d845350 2024-07-26T08:34:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.575+0000 7fe65a000640 1 -- 172.21.15.43:0/83152482 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe660003e40 con 0x55677d845350 2024-07-26T08:34:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.575+0000 7fe65a000640 1 -- 172.21.15.43:0/83152482 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660036040 con 0x55677d845350 2024-07-26T08:34:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.576+0000 7fe676e6a740 1 -- 172.21.15.43:0/83152482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 msgr2=0x55677dc018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.576+0000 7fe676e6a740 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 0x55677dc018b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe660009be0 tx=0x7fe6600305c0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.576+0000 7fe676e6a740 1 -- 172.21.15.43:0/83152482 shutdown_connections 2024-07-26T08:34:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.576+0000 7fe676e6a740 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d845350 0x55677dc018b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.576+0000 7fe676e6a740 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbe6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.576+0000 7fe676e6a740 1 --2- 172.21.15.43:0/83152482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d81c490 0x55677dbf0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.577+0000 7fe676e6a740 1 -- 172.21.15.43:0/83152482 >> 172.21.15.43:0/83152482 conn(0x55677d839740 msgr2=0x55677dbe7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.577+0000 7fe676e6a740 1 -- 172.21.15.43:0/83152482 shutdown_connections 2024-07-26T08:34:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.577+0000 7fe676e6a740 1 -- 172.21.15.43:0/83152482 wait complete. 2024-07-26T08:34:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.577+0000 7fe676e6a740 1 -- start start 2024-07-26T08:34:52.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.577+0000 7fe676e6a740 1 Processor -- start 2024-07-26T08:34:52.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbfe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbf9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d845350 0x55677dbf9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe64800e5c0 con 0x55677d824670 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe64800fa30 con 0x55677d81c490 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe64800ec90 con 0x55677d845350 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe676e6a740 10 client.0 _ll_register_callbacks cb 0x7fe6540aa730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe66ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbf9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe66d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbfe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe66d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbfe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49456/0 (socket says 172.21.15.43:49456) 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe66d800640 1 -- 172.21.15.43:0/804129968 learned_addr learned my addr 172.21.15.43:0/804129968 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.578+0000 7fe66ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbf9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43982/0 (socket says 172.21.15.43:43982) 2024-07-26T08:34:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66e200640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d845350 0x55677dbf9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66d800640 1 -- 172.21.15.43:0/804129968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d845350 msgr2=0x55677dbf9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66d800640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d845350 0x55677dbf9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66d800640 1 -- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 msgr2=0x55677dbf9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:34:52.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66d800640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbf9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66d800640 1 -- 172.21.15.43:0/804129968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55677dc6f340 con 0x55677d81c490 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66ce00640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbf9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe66d800640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbfe2a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009cb0 tx=0x7fe65c005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d216175a085fe0e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.579+0000 7fe64f400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.580+0000 7fe64f400640 1 -- 172.21.15.43:0/804129968 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00f630 con 0x55677d81c490 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.580+0000 7fe64f400640 1 -- 172.21.15.43:0/804129968 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fe65c00f7d0 con 0x55677d81c490 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.580+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55677db5e5e0 con 0x55677d81c490 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.580+0000 7fe64f400640 1 -- 172.21.15.43:0/804129968 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe65c043050 con 0x55677d81c490 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.580+0000 7fe676e6a740 10 client.25643 fetch_fsmap learned FSMap version 26 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.580+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55677dc70470 con 0x55677d81c490 2024-07-26T08:34:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe64f400640 1 -- 172.21.15.43:0/804129968 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55677db5e5e0 con 0x55677d81c490 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe64f400640 1 -- 172.21.15.43:0/804129968 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fe65c024950 con 0x55677d81c490 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe676e6a740 10 client.25643 fetch_fsmap finished waiting for FSMap version 26 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe676e6a740 10 client.25643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe676e6a740 20 client.25643 populate_metadata read hostname 'smithi043' 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe676e6a740 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d7d9080 0x55677dc72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe676e6a740 4 client.25643 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.581+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55677db5bd20 con 0x55677d7d9080 2024-07-26T08:34:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.582+0000 7fe66ce00640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d7d9080 0x55677dc72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:34:52.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.583+0000 7fe66ce00640 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d7d9080 0x55677dc72a10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3204a1e1542de64a server_cookie=4a1b7d8efd33caf3 in_seq=0 out_seq=0 2024-07-26T08:34:52.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.583+0000 7fe64f400640 10 client.25643 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.584+0000 7fe64f400640 1 -- 172.21.15.43:0/804129968 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55677db5bd20 con 0x55677d7d9080 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.584+0000 7fe64f400640 10 client.25643 handle_command_reply: tid=0 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 client.25643 shutdown 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 msgr2=0x55677dbfe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbfe2a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009cb0 tx=0x7fe65c005a00 comp rx=0 tx=0).stop 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 shutdown_connections 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x55677d7d9080 0x55677dc72a10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55677d845350 0x55677dbf9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55677d824670 0x55677dbf9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 --2- 172.21.15.43:0/804129968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55677d81c490 0x55677dbfe2a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 >> 172.21.15.43:0/804129968 conn(0x55677d839740 msgr2=0x55677dbf6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:52.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.585+0000 7fe64f400640 0 client.25643 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:34:52.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.586+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 shutdown_connections 2024-07-26T08:34:52.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.587+0000 7fe676e6a740 1 -- 172.21.15.43:0/804129968 wait complete. 2024-07-26T08:34:52.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.587+0000 7fe676e6a740 20 client.25643 trim_cache size 0 max 16384 2024-07-26T08:34:52.591 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:34:52.591 INFO:teuthology.orchestra.run.smithi043.stdout: "return_code": 0, 2024-07-26T08:34:52.592 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_tag": "a3d0c796-41c1-472e-a0ff-31f376ee5ffa", 2024-07-26T08:34:52.592 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": "asynchronous" 2024-07-26T08:34:52.592 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6500b3dc0 msgr2=0x7fe6500b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6500b3dc0 0x7fe6500b62d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe65c01b040 tx=0x7fe65c000bc0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 msgr2=0x7fe66806daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 0x7fe66806daa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe65400ea60 tx=0x7fe65400ef20 comp rx=0 tx=0).stop 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 shutdown_connections 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe6500b3dc0 0x7fe6500b62d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe66810fa40 0x7fe66806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6681027e0 0x7fe66806daa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 --2- 172.21.15.43:0/3911433899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe668101e90 0x7fe6680747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 >> 172.21.15.43:0/3911433899 conn(0x7fe6680fdcf0 msgr2=0x7fe668100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:34:52.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 shutdown_connections 2024-07-26T08:34:52.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:34:52.588+0000 7fe66ec00640 1 -- 172.21.15.43:0/3911433899 wait complete. 2024-07-26T08:34:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:52 smithi133 ceph-mon[37053]: pgmap v536: 129 pgs: 129 active+clean; 90 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.1 MiB/s wr, 54 op/s 2024-07-26T08:34:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:52 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:34:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:52 smithi063 ceph-mon[36747]: pgmap v536: 129 pgs: 129 active+clean; 90 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.1 MiB/s wr, 54 op/s 2024-07-26T08:34:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:52 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:34:53.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:53 smithi043 ceph-mon[32384]: scrub queued for path: / 2024-07-26T08:34:53.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:53 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:53.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:53 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:34:53.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:53 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:34:53.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:53 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:53.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:34:53.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:53 smithi133 ceph-mon[37053]: scrub queued for path: / 2024-07-26T08:34:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:53 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:53 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:34:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:53 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:34:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:53 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:53.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:53 smithi063 ceph-mon[36747]: scrub queued for path: / 2024-07-26T08:34:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:53 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:53 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:34:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:53 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:34:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:53 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:53.981 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:34:54.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:54 smithi043 ceph-mon[32384]: pgmap v537: 129 pgs: 129 active+clean; 92 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-07-26T08:34:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:54 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:54 smithi133 ceph-mon[37053]: pgmap v537: 129 pgs: 129 active+clean; 92 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-07-26T08:34:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:54 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:54 smithi063 ceph-mon[36747]: pgmap v537: 129 pgs: 129 active+clean; 92 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-07-26T08:34:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:54 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:34:56.266 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar cf doc.tar linux-4.0.5 2024-07-26T08:34:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:56 smithi043 ceph-mon[32384]: pgmap v538: 129 pgs: 129 active+clean; 93 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 3.4 MiB/s wr, 58 op/s 2024-07-26T08:34:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:56 smithi133 ceph-mon[37053]: pgmap v538: 129 pgs: 129 active+clean; 93 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 3.4 MiB/s wr, 58 op/s 2024-07-26T08:34:56.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:56 smithi063 ceph-mon[36747]: pgmap v538: 129 pgs: 129 active+clean; 93 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 3.4 MiB/s wr, 58 op/s 2024-07-26T08:34:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:57 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:34:57.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:57 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:34:57.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:57 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:34:58.726 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:34:58 smithi043 ceph-mon[32384]: pgmap v539: 129 pgs: 129 active+clean; 93 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 1.9 MiB/s wr, 44 op/s 2024-07-26T08:34:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:34:58 smithi133 ceph-mon[37053]: pgmap v539: 129 pgs: 129 active+clean; 93 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 1.9 MiB/s wr, 44 op/s 2024-07-26T08:34:58.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:34:58 smithi063 ceph-mon[36747]: pgmap v539: 129 pgs: 129 active+clean; 93 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 1.9 MiB/s wr, 44 op/s 2024-07-26T08:35:00.691 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar xf doc.tar 2024-07-26T08:35:00.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:00 smithi043 ceph-mon[32384]: pgmap v540: 129 pgs: 129 active+clean; 94 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1001 KiB/s wr, 43 op/s 2024-07-26T08:35:00.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:00 smithi133 ceph-mon[37053]: pgmap v540: 129 pgs: 129 active+clean; 94 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1001 KiB/s wr, 43 op/s 2024-07-26T08:35:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:00 smithi063 ceph-mon[36747]: pgmap v540: 129 pgs: 129 active+clean; 94 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1001 KiB/s wr, 43 op/s 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 -- 172.21.15.43:0/4249957254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410b860 msgr2=0x7f3d74112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 --2- 172.21.15.43:0/4249957254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410b860 0x7f3d74112090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009ca0 tx=0x7f3d6c02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 -- 172.21.15.43:0/4249957254 shutdown_connections 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 --2- 172.21.15.43:0/4249957254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410b860 0x7f3d74112090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 --2- 172.21.15.43:0/4249957254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410af10 0x7f3d7410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 --2- 172.21.15.43:0/4249957254 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d741059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 -- 172.21.15.43:0/4249957254 >> 172.21.15.43:0/4249957254 conn(0x7f3d74101040 msgr2=0x7f3d74103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:01.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 -- 172.21.15.43:0/4249957254 shutdown_connections 2024-07-26T08:35:01.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.448+0000 7f3d73e00640 1 -- 172.21.15.43:0/4249957254 wait complete. 2024-07-26T08:35:01.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.450+0000 7f3d73e00640 1 Processor -- start 2024-07-26T08:35:01.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.450+0000 7f3d73e00640 1 -- start start 2024-07-26T08:35:01.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d7419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410af10 0x7f3d7419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410b860 0x7f3d741a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d74115690 con 0x7f3d7410b860 2024-07-26T08:35:01.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d74115510 con 0x7f3d741055d0 2024-07-26T08:35:01.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d74115810 con 0x7f3d7410af10 2024-07-26T08:35:01.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d72a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d7419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d6a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410af10 0x7f3d7419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d72a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d7419bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56610/0 (socket says 172.21.15.43:56610) 2024-07-26T08:35:01.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d72a00640 1 -- 172.21.15.43:0/2435468759 learned_addr learned my addr 172.21.15.43:0/2435468759 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:01.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d73400640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410b860 0x7f3d741a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d72a00640 1 -- 172.21.15.43:0/2435468759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410af10 msgr2=0x7f3d7419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.451+0000 7f3d72a00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410af10 0x7f3d7419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.452+0000 7f3d72a00640 1 -- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410b860 msgr2=0x7f3d741a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.452+0000 7f3d72a00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410b860 0x7f3d741a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.452+0000 7f3d72a00640 1 -- 172.21.15.43:0/2435468759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d741a1ef0 con 0x7f3d741055d0 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.452+0000 7f3d73400640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410b860 0x7f3d741a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.452+0000 7f3d72a00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d7419bf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ea60 tx=0x7f3d6400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.453+0000 7f3d78a00640 1 -- 172.21.15.43:0/2435468759 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400cde0 con 0x7f3d741055d0 2024-07-26T08:35:01.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.453+0000 7f3d78a00640 1 -- 172.21.15.43:0/2435468759 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d640035f0 con 0x7f3d741055d0 2024-07-26T08:35:01.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.453+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d741a21e0 con 0x7f3d741055d0 2024-07-26T08:35:01.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.453+0000 7f3d78a00640 1 -- 172.21.15.43:0/2435468759 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64010690 con 0x7f3d741055d0 2024-07-26T08:35:01.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.453+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d741a8940 con 0x7f3d741055d0 2024-07-26T08:35:01.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 Processor -- start 2024-07-26T08:35:01.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 -- start start 2024-07-26T08:35:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 0x560b1545cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b1508f1b0 0x560b1545d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b15097390 0x560b1545da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b153d3b90 con 0x560b1508f1b0 2024-07-26T08:35:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560b153c3090 con 0x560b15097390 2024-07-26T08:35:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d809bd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560b153c70d0 con 0x560b150b8070 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d78a00640 1 -- 172.21.15.43:0/2435468759 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3d64004020 con 0x7f3d741055d0 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.458+0000 7f3d73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 0x560b1545cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 0x560b1545cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49694/0 (socket says 172.21.15.43:49694) 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 -- 172.21.15.43:0/1204453080 learned_addr learned my addr 172.21.15.43:0/1204453080 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d6a000640 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b15097390 0x560b1545da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d72a00640 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b1508f1b0 0x560b1545d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 -- 172.21.15.43:0/1204453080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b15097390 msgr2=0x560b1545da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b15097390 0x560b1545da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 -- 172.21.15.43:0/1204453080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b1508f1b0 msgr2=0x560b1545d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b1508f1b0 0x560b1545d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d73400640 1 -- 172.21.15.43:0/1204453080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b15123650 con 0x560b150b8070 2024-07-26T08:35:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.459+0000 7f3d72a00640 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b1508f1b0 0x560b1545d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.460+0000 7f3d73400640 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 0x560b1545cfd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c0098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5d09f6a2ff09ab server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.460+0000 7f3d63e00640 1 -- 172.21.15.43:0/1204453080 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c031dc0 con 0x560b150b8070 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.460+0000 7f3d63e00640 1 -- 172.21.15.43:0/1204453080 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d6c036040 con 0x560b150b8070 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.460+0000 7f3d63e00640 1 -- 172.21.15.43:0/1204453080 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c004430 con 0x560b150b8070 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.460+0000 7f3d78a00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d580b3d40 0x7f3d580b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d78a00640 1 -- 172.21.15.43:0/2435468759 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3d640e4770 con 0x7f3d741055d0 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d72a00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d580b3d40 0x7f3d580b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 -- 172.21.15.43:0/1204453080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 msgr2=0x560b1545cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 0x560b1545cfd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c0098a0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 -- 172.21.15.43:0/1204453080 shutdown_connections 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b15097390 0x560b1545da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b1508f1b0 0x560b1545d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 --2- 172.21.15.43:0/1204453080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b150b8070 0x560b1545cfd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 -- 172.21.15.43:0/1204453080 >> 172.21.15.43:0/1204453080 conn(0x560b150ac460 msgr2=0x560b1545aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:01.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 -- 172.21.15.43:0/1204453080 shutdown_connections 2024-07-26T08:35:01.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.461+0000 7f3d809bd740 1 -- 172.21.15.43:0/1204453080 wait complete. 2024-07-26T08:35:01.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.462+0000 7f3d72a00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d580b3d40 0x7f3d580b6250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x560b1545bc50 tx=0x7f3d64003f20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:01.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.462+0000 7f3d809bd740 1 -- start start 2024-07-26T08:35:01.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.462+0000 7f3d809bd740 1 Processor -- start 2024-07-26T08:35:01.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15468600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b15468b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b15226700 con 0x560b150b8070 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560b1535f660 con 0x560b1508f1b0 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560b1546b750 con 0x560b15097390 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d809bd740 10 client.0 _ll_register_callbacks cb 0x560b1536f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d6a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b15468b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d73400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15468600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d6a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b15468b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49710/0 (socket says 172.21.15.43:49710) 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d6a000640 1 -- 172.21.15.43:0/2203633721 learned_addr learned my addr 172.21.15.43:0/2203633721 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.463+0000 7f3d73400640 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d6a000640 1 -- 172.21.15.43:0/2203633721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 msgr2=0x560b15468600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d6a000640 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15468600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d6a000640 1 -- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 msgr2=0x560b154690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d6a000640 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d6a000640 1 -- 172.21.15.43:0/2203633721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b15376800 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d6a000640 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b15468b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0126e0 tx=0x7f3d5c012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19daca6c6ed46509 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d60c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d60c00640 1 -- 172.21.15.43:0/2203633721 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c012190 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d60c00640 1 -- 172.21.15.43:0/2203633721 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3d5c00f920 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.464+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d6c036040 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d60c00640 1 -- 172.21.15.43:0/2203633721 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d5c00fb20 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 10 client.25678 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b15477410 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d60c00640 1 -- 172.21.15.43:0/2203633721 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d6c036040 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d60c00640 1 -- 172.21.15.43:0/2203633721 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3d5c01c420 con 0x560b15097390 2024-07-26T08:35:01.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 10 client.25678 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 10 client.25678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 20 client.25678 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b150769f0 0x560b1547aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 4 client.25678 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.465+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b153d5ae0 con 0x560b150769f0 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.466+0000 7f3d73400640 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b150769f0 0x560b1547aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.466+0000 7f3d73400640 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b150769f0 0x560b1547aa30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca4aae00b0b6a60 server_cookie=6450d1735a8c1362 in_seq=0 out_seq=0 2024-07-26T08:35:01.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.466+0000 7f3d60c00640 10 client.25678 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d60c00640 1 -- 172.21.15.43:0/2203633721 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b153d5ae0 con 0x560b150769f0 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d60c00640 10 client.25678 handle_command_reply: tid=0 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 client.25678 shutdown 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 msgr2=0x560b15468b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b15468b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0126e0 tx=0x7f3d5c012ba0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 shutdown_connections 2024-07-26T08:35:01.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b150769f0 0x560b1547aa30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b15468b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 --2- 172.21.15.43:0/2203633721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15468600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d60c00640 0 client.25678 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.467+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 >> 172.21.15.43:0/2203633721 conn(0x560b150ac460 msgr2=0x560b15460160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.468+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 shutdown_connections 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.468+0000 7f3d809bd740 1 -- 172.21.15.43:0/2203633721 wait complete. 2024-07-26T08:35:01.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.468+0000 7f3d809bd740 20 client.25678 trim_cache size 0 max 16384 2024-07-26T08:35:01.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.488+0000 7f3d809bd740 1 Processor -- start 2024-07-26T08:35:01.489 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:01 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.488+0000 7f3d809bd740 1 -- start start 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.488+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15459ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.488+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b1545e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.488+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d809bd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741b5330 con 0x560b150b8070 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d809bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741b2c00 con 0x560b1508f1b0 2024-07-26T08:35:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d809bd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741b0a50 con 0x560b15097390 2024-07-26T08:35:01.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d6a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b1545e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d6a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b1545e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49714/0 (socket says 172.21.15.43:49714) 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d6a000640 1 -- 172.21.15.43:0/381329637 learned_addr learned my addr 172.21.15.43:0/381329637 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d73400640 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15459ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.489+0000 7f3d73400640 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d6a000640 1 -- 172.21.15.43:0/381329637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 msgr2=0x560b15459ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d6a000640 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15459ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d6a000640 1 -- 172.21.15.43:0/381329637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 msgr2=0x560b154801f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d6a000640 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154801f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d6a000640 1 -- 172.21.15.43:0/381329637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b1545b7b0 con 0x560b15097390 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d73400640 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154801f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d6a000640 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b1545e710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00f890 tx=0x7f3d5c00fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db40f0931be47687 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d63400640 1 -- 172.21.15.43:0/381329637 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00fcc0 con 0x560b15097390 2024-07-26T08:35:01.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d63400640 1 -- 172.21.15.43:0/381329637 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d5c00fe60 con 0x560b15097390 2024-07-26T08:35:01.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.490+0000 7f3d63400640 1 -- 172.21.15.43:0/381329637 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c005660 con 0x560b15097390 2024-07-26T08:35:01.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 -- 172.21.15.43:0/381329637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 msgr2=0x560b1545e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b1545e710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00f890 tx=0x7f3d5c00fab0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 -- 172.21.15.43:0/381329637 shutdown_connections 2024-07-26T08:35:01.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b15097390 0x560b1545e710 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b150b8070 0x560b154801f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 --2- 172.21.15.43:0/381329637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b1508f1b0 0x560b15459ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.491+0000 7f3d809bd740 1 -- 172.21.15.43:0/381329637 >> 172.21.15.43:0/381329637 conn(0x560b150ac460 msgr2=0x560b1545e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.492+0000 7f3d809bd740 1 -- 172.21.15.43:0/381329637 shutdown_connections 2024-07-26T08:35:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.492+0000 7f3d809bd740 1 -- 172.21.15.43:0/381329637 wait complete. 2024-07-26T08:35:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.492+0000 7f3d809bd740 1 -- start start 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.492+0000 7f3d809bd740 1 Processor -- start 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 0x560b154711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b15097390 0x560b1546e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b150b8070 0x560b1546ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741b10c0 con 0x560b15097390 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741b2530 con 0x560b150b8070 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741b1790 con 0x560b1508f1b0 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d809bd740 10 client.0 _ll_register_callbacks cb 0x7f3d5c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 0x560b154711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 0x560b154711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:49726/0 (socket says 172.21.15.43:49726) 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.493+0000 7f3d73400640 1 -- 172.21.15.43:0/3113579545 learned_addr learned my addr 172.21.15.43:0/3113579545 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b150b8070 0x560b1546ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 -- 172.21.15.43:0/3113579545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b150b8070 msgr2=0x560b1546ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b150b8070 0x560b1546ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 -- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b15097390 msgr2=0x560b1546e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:01.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d6a000640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b15097390 0x560b1546e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b15097390 0x560b1546e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 -- 172.21.15.43:0/3113579545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b1546f4a0 con 0x560b1508f1b0 2024-07-26T08:35:01.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d6a000640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b15097390 0x560b1546e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d73400640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 0x560b154711c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000f80 tx=0x7f3d6c0098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7beeffbb202d10c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d60c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.494+0000 7f3d60c00640 1 -- 172.21.15.43:0/3113579545 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c031510 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.495+0000 7f3d60c00640 1 -- 172.21.15.43:0/3113579545 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f3d6c0316b0 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.495+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d5c00fe60 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.495+0000 7f3d60c00640 1 -- 172.21.15.43:0/3113579545 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d6c004120 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.495+0000 7f3d809bd740 10 client.25684 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.495+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b154eba70 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.495+0000 7f3d60c00640 1 -- 172.21.15.43:0/3113579545 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d5c00fe60 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d60c00640 1 -- 172.21.15.43:0/3113579545 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3d6c02f840 con 0x560b1508f1b0 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d809bd740 10 client.25684 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d809bd740 10 client.25684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d809bd740 20 client.25684 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:01.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d809bd740 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b1504bda0 0x560b154ede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:01.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d809bd740 4 client.25684 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:35:01.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b153d1580 con 0x560b1504bda0 2024-07-26T08:35:01.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.496+0000 7f3d6a000640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b1504bda0 0x560b154ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.497+0000 7f3d6a000640 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b1504bda0 0x560b154ede30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e613a9e691c6ae8 server_cookie=b9b4c22dada076fa in_seq=0 out_seq=0 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.497+0000 7f3d60c00640 10 client.25684 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.497+0000 7f3d60c00640 1 -- 172.21.15.43:0/3113579545 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560b153d1580 con 0x560b1504bda0 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.497+0000 7f3d60c00640 10 client.25684 handle_command_reply: tid=0 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.497+0000 7f3d809bd740 1 client.25684 shutdown 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.497+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 msgr2=0x560b154711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 0x560b154711c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000f80 tx=0x7f3d6c0098a0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 shutdown_connections 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x560b1504bda0 0x560b154ede30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b150b8070 0x560b1546ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b15097390 0x560b1546e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 --2- 172.21.15.43:0/3113579545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560b1508f1b0 0x560b154711c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 >> 172.21.15.43:0/3113579545 conn(0x560b150ac460 msgr2=0x560b1545e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d60c00640 0 client.25684 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 shutdown_connections 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 1 -- 172.21.15.43:0/3113579545 wait complete. 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.498+0000 7f3d809bd740 20 client.25684 trim_cache size 0 max 16384 2024-07-26T08:35:01.501 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:35:01.502 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "no active scrubs running", 2024-07-26T08:35:01.502 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": {} 2024-07-26T08:35:01.502 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:35:01.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d580b3d40 msgr2=0x7f3d580b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d580b3d40 0x7f3d580b6250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x560b1545bc50 tx=0x7f3d64003f20 comp rx=0 tx=0).stop 2024-07-26T08:35:01.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 msgr2=0x7f3d7419bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d7419bf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ea60 tx=0x7f3d6400ef20 comp rx=0 tx=0).stop 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 shutdown_connections 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3d580b3d40 0x7f3d580b6250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d7410af10 0x7f3d7419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7410b860 0x7f3d741a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 --2- 172.21.15.43:0/2435468759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d741055d0 0x7f3d7419bf80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.499+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 >> 172.21.15.43:0/2435468759 conn(0x7f3d74101040 msgr2=0x7f3d741094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.500+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 shutdown_connections 2024-07-26T08:35:01.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:01.500+0000 7f3d73e00640 1 -- 172.21.15.43:0/2435468759 wait complete. 2024-07-26T08:35:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:01 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:35:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:01 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:35:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:02 smithi043 ceph-mon[32384]: pgmap v541: 129 pgs: 129 active+clean; 98 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 829 KiB/s wr, 107 op/s 2024-07-26T08:35:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:02 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:35:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:02 smithi133 ceph-mon[37053]: pgmap v541: 129 pgs: 129 active+clean; 98 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 829 KiB/s wr, 107 op/s 2024-07-26T08:35:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:02 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:35:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:02 smithi063 ceph-mon[36747]: pgmap v541: 129 pgs: 129 active+clean; 98 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 829 KiB/s wr, 107 op/s 2024-07-26T08:35:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:02 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:35:03.026 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-26T08:35:03.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:35:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:35:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:04 smithi043 ceph-mon[32384]: pgmap v542: 129 pgs: 129 active+clean; 125 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.1 MiB/s wr, 256 op/s 2024-07-26T08:35:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:04 smithi133 ceph-mon[37053]: pgmap v542: 129 pgs: 129 active+clean; 125 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.1 MiB/s wr, 256 op/s 2024-07-26T08:35:04.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:04 smithi063 ceph-mon[36747]: pgmap v542: 129 pgs: 129 active+clean; 125 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.1 MiB/s wr, 256 op/s 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.393+0000 7f3457e00640 1 -- 172.21.15.43:0/2956341836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3458075b30 msgr2=0x7f345810f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.393+0000 7f3457e00640 1 --2- 172.21.15.43:0/2956341836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3458075b30 0x7f345810f400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3444009900 tx=0x7f344402a3f0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 -- 172.21.15.43:0/2956341836 shutdown_connections 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 --2- 172.21.15.43:0/2956341836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3458075b30 0x7f345810f400 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 --2- 172.21.15.43:0/2956341836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345810f940 0x7f3458111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 --2- 172.21.15.43:0/2956341836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f34580755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 -- 172.21.15.43:0/2956341836 >> 172.21.15.43:0/2956341836 conn(0x7f34580fee70 msgr2=0x7f34581012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 -- 172.21.15.43:0/2956341836 shutdown_connections 2024-07-26T08:35:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.394+0000 7f3457e00640 1 -- 172.21.15.43:0/2956341836 wait complete. 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.395+0000 7f3457e00640 1 Processor -- start 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.395+0000 7f3457e00640 1 -- start start 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f345819c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3458075b30 0x7f345819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f345810f940 0x7f34581a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3458115660 con 0x7f3458075b30 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34581154e0 con 0x7f34580751e0 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f34581157e0 con 0x7f345810f940 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f345819c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f345819c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:54998/0 (socket says 172.21.15.43:54998) 2024-07-26T08:35:06.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 -- 172.21.15.43:0/2524058329 learned_addr learned my addr 172.21.15.43:0/2524058329 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:06.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456000640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3458075b30 0x7f345819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:06.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3457400640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f345810f940 0x7f34581a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:06.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 -- 172.21.15.43:0/2524058329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f345810f940 msgr2=0x7f34581a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:06.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f345810f940 0x7f34581a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 -- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3458075b30 msgr2=0x7f345819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:06.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3458075b30 0x7f345819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456a00640 1 -- 172.21.15.43:0/2524058329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34581a2020 con 0x7f34580751e0 2024-07-26T08:35:06.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.396+0000 7f3456000640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3458075b30 0x7f345819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:35:06.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.397+0000 7f3456a00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f345819c0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f344800e9f0 tx=0x7f344800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:06.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.397+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344800cd80 con 0x7f34580751e0 2024-07-26T08:35:06.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.397+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34480054f0 con 0x7f34580751e0 2024-07-26T08:35:06.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.397+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34581a2310 con 0x7f34580751e0 2024-07-26T08:35:06.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.397+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448010690 con 0x7f34580751e0 2024-07-26T08:35:06.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.397+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a8a70 con 0x7f34580751e0 2024-07-26T08:35:06.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.398+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34580755f0 con 0x7f34580751e0 2024-07-26T08:35:06.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.401+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f34480046c0 con 0x7f34580751e0 2024-07-26T08:35:06.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.402+0000 7f345ca00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f343c0b3dc0 0x7f343c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:06.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.402+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f34480e4860 con 0x7f34580751e0 2024-07-26T08:35:06.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.402+0000 7f3456000640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f343c0b3dc0 0x7f343c0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:06.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.403+0000 7f3456000640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f343c0b3dc0 0x7f343c0b62d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3444006010 tx=0x7f3444005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:06.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.406+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f34480ab770 con 0x7f34580751e0 2024-07-26T08:35:06.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.654+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34581a8d50 con 0x7f34580751e0 2024-07-26T08:35:06.656 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:06 smithi043 ceph-mon[32384]: pgmap v543: 129 pgs: 129 active+clean; 141 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 340 op/s 2024-07-26T08:35:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.655+0000 7f345ca00640 1 -- 172.21.15.43:0/2524058329 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11898 (secure 0 0 0) 0x7f34480ab070 con 0x7f34580751e0 2024-07-26T08:35:06.657 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:35:06.657 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"btime":"2024-07-26T08:34:56:415248+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:34:56.145255+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24733,"mds_1":24710,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"g","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/2240411764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2240411764},{"type":"v1","addr":"172.21.15.43:6839","nonce":2240411764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24710":{"gid":24710,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":28,"addr":"172.21.15.63:6839/3045590383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":3045590383},{"type":"v1","addr":"172.21.15.63:6839","nonce":3045590383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24733":{"gid":24733,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6841/445875183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":445875183},{"type":"v1","addr":"172.21.15.43:6841","nonce":445875183}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24733,"qdb_cluster":[24733,24710,24709]},"id":1}]} 2024-07-26T08:35:06.657 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-07-26T08:35:06.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f343c0b3dc0 msgr2=0x7f343c0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f343c0b3dc0 0x7f343c0b62d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3444006010 tx=0x7f3444005a20 comp rx=0 tx=0).stop 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 msgr2=0x7f345819c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f345819c0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f344800e9f0 tx=0x7f344800edf0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 shutdown_connections 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f343c0b3dc0 0x7f343c0b62d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f345810f940 0x7f34581a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3458075b30 0x7f345819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 --2- 172.21.15.43:0/2524058329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34580751e0 0x7f345819c0b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 >> 172.21.15.43:0/2524058329 conn(0x7f34580fee70 msgr2=0x7f3458109470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.658+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 shutdown_connections 2024-07-26T08:35:06.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:06.659+0000 7f3457e00640 1 -- 172.21.15.43:0/2524058329 wait complete. 2024-07-26T08:35:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:06 smithi133 ceph-mon[37053]: pgmap v543: 129 pgs: 129 active+clean; 141 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 340 op/s 2024-07-26T08:35:06.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:06 smithi063 ceph-mon[36747]: pgmap v543: 129 pgs: 129 active+clean; 141 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 340 op/s 2024-07-26T08:35:07.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:07 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2524058329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:35:07.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:07 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2524058329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:35:07.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-07-26T08:35:07.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:07 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2524058329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:35:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:35:08.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:08 smithi043 ceph-mon[32384]: pgmap v544: 129 pgs: 129 active+clean; 141 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 340 op/s 2024-07-26T08:35:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:08 smithi133 ceph-mon[37053]: pgmap v544: 129 pgs: 129 active+clean; 141 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 340 op/s 2024-07-26T08:35:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:08 smithi063 ceph-mon[36747]: pgmap v544: 129 pgs: 129 active+clean; 141 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 340 op/s 2024-07-26T08:35:10.518 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:10 smithi043 ceph-mon[32384]: pgmap v545: 129 pgs: 129 active+clean; 148 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 382 op/s 2024-07-26T08:35:10.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:10 smithi133 ceph-mon[37053]: pgmap v545: 129 pgs: 129 active+clean; 148 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 382 op/s 2024-07-26T08:35:10.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:10 smithi063 ceph-mon[36747]: pgmap v545: 129 pgs: 129 active+clean; 148 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 382 op/s 2024-07-26T08:35:10.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 -- 172.21.15.43:0/2403984941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c1057e0 msgr2=0x7faf1c105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 --2- 172.21.15.43:0/2403984941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c1057e0 0x7faf1c105bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009860 tx=0x7faf0c02a360 comp rx=0 tx=0).stop 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 -- 172.21.15.43:0/2403984941 shutdown_connections 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 --2- 172.21.15.43:0/2403984941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c10ba70 0x7faf1c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 --2- 172.21.15.43:0/2403984941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c10b120 0x7faf1c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 --2- 172.21.15.43:0/2403984941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c1057e0 0x7faf1c105bf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 -- 172.21.15.43:0/2403984941 >> 172.21.15.43:0/2403984941 conn(0x7faf1c1011f0 msgr2=0x7faf1c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 -- 172.21.15.43:0/2403984941 shutdown_connections 2024-07-26T08:35:10.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.941+0000 7faf22600640 1 -- 172.21.15.43:0/2403984941 wait complete. 2024-07-26T08:35:10.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.944+0000 7faf22600640 1 Processor -- start 2024-07-26T08:35:10.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.944+0000 7faf22600640 1 -- start start 2024-07-26T08:35:10.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.945+0000 7faf22600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 0x7faf1c19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.945+0000 7faf22600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c10b120 0x7faf1c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf22600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c10ba70 0x7faf1c1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf22600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1158a0 con 0x7faf1c10ba70 2024-07-26T08:35:10.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf22600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c115720 con 0x7faf1c1057e0 2024-07-26T08:35:10.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf22600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c115a20 con 0x7faf1c10b120 2024-07-26T08:35:10.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf1b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 0x7faf1c19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf1b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 0x7faf1c19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55020/0 (socket says 172.21.15.43:55020) 2024-07-26T08:35:10.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf1b400640 1 -- 172.21.15.43:0/3499318116 learned_addr learned my addr 172.21.15.43:0/3499318116 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:10.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.946+0000 7faf1be00640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c10ba70 0x7faf1c1a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1aa00640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c10b120 0x7faf1c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1b400640 1 -- 172.21.15.43:0/3499318116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c10b120 msgr2=0x7faf1c19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1b400640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c10b120 0x7faf1c19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1b400640 1 -- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c10ba70 msgr2=0x7faf1c1a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1b400640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c10ba70 0x7faf1c1a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1b400640 1 -- 172.21.15.43:0/3499318116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c1a2220 con 0x7faf1c1057e0 2024-07-26T08:35:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.947+0000 7faf1b400640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 0x7faf1c19c2b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf0c02a950 tx=0x7faf0c032650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.949+0000 7faf13e00640 1 -- 172.21.15.43:0/3499318116 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c03f020 con 0x7faf1c1057e0 2024-07-26T08:35:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.949+0000 7faf13e00640 1 -- 172.21.15.43:0/3499318116 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf0c032cc0 con 0x7faf1c1057e0 2024-07-26T08:35:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.949+0000 7faf13e00640 1 -- 172.21.15.43:0/3499318116 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c037040 con 0x7faf1c1057e0 2024-07-26T08:35:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.949+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1c1a24b0 con 0x7faf1c1057e0 2024-07-26T08:35:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.949+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1c1a8c70 con 0x7faf1c1057e0 2024-07-26T08:35:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.957+0000 7faf2929e740 1 Processor -- start 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.959+0000 7faf13e00640 1 -- 172.21.15.43:0/3499318116 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7faf0c042020 con 0x7faf1c1057e0 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.959+0000 7faf2929e740 1 -- start start 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.960+0000 7faf2929e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a445070 0x55e79a7e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.960+0000 7faf2929e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7ea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.960+0000 7faf2929e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 0x55e79a7ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.960+0000 7faf2929e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e79a760bd0 con 0x55e79a41c1b0 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.960+0000 7faf2929e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e79a7500d0 con 0x55e79a445070 2024-07-26T08:35:10.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.960+0000 7faf2929e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e79a754110 con 0x55e79a424390 2024-07-26T08:35:10.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.961+0000 7faf1aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 0x55e79a7ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.961+0000 7faf1aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 0x55e79a7ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44866/0 (socket says 172.21.15.43:44866) 2024-07-26T08:35:10.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.961+0000 7faf1aa00640 1 -- 172.21.15.43:0/1882759600 learned_addr learned my addr 172.21.15.43:0/1882759600 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:10.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.961+0000 7faf1b400640 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.962+0000 7faf1be00640 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a445070 0x55e79a7e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.963+0000 7faf1b400640 1 -- 172.21.15.43:0/1882759600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 msgr2=0x55e79a7ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:10.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.963+0000 7faf1b400640 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 0x55e79a7ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.963+0000 7faf1b400640 1 -- 172.21.15.43:0/1882759600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a445070 msgr2=0x55e79a7e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:10.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.963+0000 7faf1b400640 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a445070 0x55e79a7e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.963+0000 7faf1b400640 1 -- 172.21.15.43:0/1882759600 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79a4b0650 con 0x55e79a41c1b0 2024-07-26T08:35:10.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.963+0000 7faf1aa00640 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 0x55e79a7ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:35:10.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.965+0000 7faf1b400640 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7ea370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf0c101570 tx=0x7faf0c10c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a619fdc6d062a672 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:10.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.966+0000 7faf10c00640 1 -- 172.21.15.43:0/1882759600 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c10ca70 con 0x55e79a41c1b0 2024-07-26T08:35:10.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.966+0000 7faf10c00640 1 -- 172.21.15.43:0/1882759600 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf0c111030 con 0x55e79a41c1b0 2024-07-26T08:35:10.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.966+0000 7faf10c00640 1 -- 172.21.15.43:0/1882759600 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c115630 con 0x55e79a41c1b0 2024-07-26T08:35:10.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.968+0000 7faf2929e740 1 -- 172.21.15.43:0/1882759600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 msgr2=0x55e79a7ea370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:10.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.968+0000 7faf2929e740 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7ea370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf0c101570 tx=0x7faf0c10c270 comp rx=0 tx=0).stop 2024-07-26T08:35:10.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.969+0000 7faf13e00640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf000b3ed0 0x7faf000b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.969+0000 7faf2929e740 1 -- 172.21.15.43:0/1882759600 shutdown_connections 2024-07-26T08:35:10.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.969+0000 7faf2929e740 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a424390 0x55e79a7ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.970+0000 7faf2929e740 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7ea370 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.970+0000 7faf2929e740 1 --2- 172.21.15.43:0/1882759600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a445070 0x55e79a7e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.970+0000 7faf2929e740 1 -- 172.21.15.43:0/1882759600 >> 172.21.15.43:0/1882759600 conn(0x55e79a439460 msgr2=0x55e79a7e7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:10.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.971+0000 7faf2929e740 1 -- 172.21.15.43:0/1882759600 shutdown_connections 2024-07-26T08:35:10.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.971+0000 7faf13e00640 1 -- 172.21.15.43:0/3499318116 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7faf0c1040e0 con 0x7faf1c1057e0 2024-07-26T08:35:10.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.971+0000 7faf1be00640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf000b3ed0 0x7faf000b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.972+0000 7faf2929e740 1 -- 172.21.15.43:0/1882759600 wait complete. 2024-07-26T08:35:10.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.973+0000 7faf2929e740 1 -- start start 2024-07-26T08:35:10.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.973+0000 7faf2929e740 1 Processor -- start 2024-07-26T08:35:10.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.974+0000 7faf1be00640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf000b3ed0 0x7faf000b63e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faf14005fd0 tx=0x7faf14009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:10.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a7f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a8000b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e79a5b3700 con 0x55e79a41c1b0 2024-07-26T08:35:10.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e79a6ec6a0 con 0x55e79a424390 2024-07-26T08:35:10.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e79a7f02a0 con 0x55e79a445070 2024-07-26T08:35:10.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.975+0000 7faf2929e740 10 client.0 _ll_register_callbacks cb 0x55e79a6fc150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:10.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.976+0000 7faf1aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a7f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.976+0000 7faf1b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.976+0000 7faf1aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a7f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55036/0 (socket says 172.21.15.43:55036) 2024-07-26T08:35:10.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.976+0000 7faf1aa00640 1 -- 172.21.15.43:0/1803267896 learned_addr learned my addr 172.21.15.43:0/1803267896 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:10.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.976+0000 7faf1be00640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a8000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.977+0000 7faf1be00640 1 -- 172.21.15.43:0/1803267896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 msgr2=0x55e79a7f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:10.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.977+0000 7faf1be00640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a7f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.978+0000 7faf1be00640 1 -- 172.21.15.43:0/1803267896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 msgr2=0x55e79a7f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:10.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.978+0000 7faf1be00640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.978+0000 7faf1be00640 1 -- 172.21.15.43:0/1803267896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e79a703840 con 0x55e79a445070 2024-07-26T08:35:10.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.978+0000 7faf1b400640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:35:10.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.981+0000 7faf1be00640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a8000b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf14012750 tx=0x7faf14004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5872009ae744df20 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:10.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.982+0000 7faf05600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:10.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.983+0000 7faf05600640 1 -- 172.21.15.43:0/1803267896 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14004d20 con 0x55e79a445070 2024-07-26T08:35:10.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.983+0000 7faf05600640 1 -- 172.21.15.43:0/1803267896 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7faf140108e0 con 0x55e79a445070 2024-07-26T08:35:10.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.984+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf0c111030 con 0x55e79a445070 2024-07-26T08:35:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.984+0000 7faf05600640 1 -- 172.21.15.43:0/1803267896 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faf14010ae0 con 0x55e79a445070 2024-07-26T08:35:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.985+0000 7faf2929e740 10 client.25702 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.985+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e79a815030 con 0x55e79a445070 2024-07-26T08:35:10.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf05600640 1 -- 172.21.15.43:0/1803267896 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf0c111030 con 0x55e79a445070 2024-07-26T08:35:10.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf05600640 1 -- 172.21.15.43:0/1803267896 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faf14024070 con 0x55e79a445070 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf2929e740 10 client.25702 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf2929e740 10 client.25702 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf2929e740 20 client.25702 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf2929e740 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a4039f0 0x55e79a8183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf2929e740 4 client.25702 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.986+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e79a762b20 con 0x55e79a4039f0 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.987+0000 7faf1b400640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a4039f0 0x55e79a8183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.987+0000 7faf1b400640 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a4039f0 0x55e79a8183c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a38a4bd30ac998ef server_cookie=b81cd00b76cccfde in_seq=0 out_seq=0 2024-07-26T08:35:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.989+0000 7faf05600640 10 client.25702 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:35:10.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.989+0000 7faf05600640 1 -- 172.21.15.43:0/1803267896 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e79a762b20 con 0x55e79a4039f0 2024-07-26T08:35:10.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.989+0000 7faf05600640 10 client.25702 handle_command_reply: tid=0 2024-07-26T08:35:10.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.989+0000 7faf2929e740 1 client.25702 shutdown 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 msgr2=0x55e79a8000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a8000b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf14012750 tx=0x7faf14004a40 comp rx=0 tx=0).stop 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 shutdown_connections 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a4039f0 0x55e79a8183c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a8000b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a7f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 --2- 172.21.15.43:0/1803267896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 >> 172.21.15.43:0/1803267896 conn(0x55e79a439460 msgr2=0x55e79a7ecf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf05600640 0 client.25702 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 shutdown_connections 2024-07-26T08:35:10.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.990+0000 7faf2929e740 1 -- 172.21.15.43:0/1803267896 wait complete. 2024-07-26T08:35:10.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:10.991+0000 7faf2929e740 20 client.25702 trim_cache size 0 max 16384 2024-07-26T08:35:11.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.026+0000 7faf2929e740 1 Processor -- start 2024-07-26T08:35:11.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.026+0000 7faf2929e740 1 -- start start 2024-07-26T08:35:11.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.027+0000 7faf2929e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.027+0000 7faf2929e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a81db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.027+0000 7faf2929e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a81e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.027+0000 7faf2929e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1b11d0 con 0x55e79a41c1b0 2024-07-26T08:35:11.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.027+0000 7faf2929e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1aeaa0 con 0x55e79a424390 2024-07-26T08:35:11.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.027+0000 7faf2929e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1ac950 con 0x55e79a445070 2024-07-26T08:35:11.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.028+0000 7faf1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a81e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:11.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.028+0000 7faf1be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a81e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44880/0 (socket says 172.21.15.43:44880) 2024-07-26T08:35:11.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.028+0000 7faf1be00640 1 -- 172.21.15.43:0/1293082992 learned_addr learned my addr 172.21.15.43:0/1293082992 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:11.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.028+0000 7faf1aa00640 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a81db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.028+0000 7faf1b400640 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.029+0000 7faf1be00640 1 -- 172.21.15.43:0/1293082992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 msgr2=0x55e79a81db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.029+0000 7faf1be00640 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a81db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.029+0000 7faf1be00640 1 -- 172.21.15.43:0/1293082992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 msgr2=0x55e79a7f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.029+0000 7faf1be00640 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.029+0000 7faf1be00640 1 -- 172.21.15.43:0/1293082992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e79a7fb0c0 con 0x55e79a445070 2024-07-26T08:35:11.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.030+0000 7faf1be00640 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a81e0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf14005ab0 tx=0x7faf14010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499dfc0a1fa54b00 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:11.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.031+0000 7faf07e00640 1 -- 172.21.15.43:0/1293082992 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1402f630 con 0x55e79a445070 2024-07-26T08:35:11.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.031+0000 7faf07e00640 1 -- 172.21.15.43:0/1293082992 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf14034070 con 0x55e79a445070 2024-07-26T08:35:11.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.031+0000 7faf07e00640 1 -- 172.21.15.43:0/1293082992 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1401bb20 con 0x55e79a445070 2024-07-26T08:35:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.032+0000 7faf2929e740 1 -- 172.21.15.43:0/1293082992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 msgr2=0x55e79a81e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.032+0000 7faf2929e740 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a81e0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf14005ab0 tx=0x7faf14010a70 comp rx=0 tx=0).stop 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.033+0000 7faf2929e740 1 -- 172.21.15.43:0/1293082992 shutdown_connections 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.033+0000 7faf2929e740 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a81e0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.033+0000 7faf2929e740 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a81db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.033+0000 7faf2929e740 1 --2- 172.21.15.43:0/1293082992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a7f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.033+0000 7faf2929e740 1 -- 172.21.15.43:0/1293082992 >> 172.21.15.43:0/1293082992 conn(0x55e79a439460 msgr2=0x55e79a7f3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.033+0000 7faf2929e740 1 -- 172.21.15.43:0/1293082992 shutdown_connections 2024-07-26T08:35:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.034+0000 7faf2929e740 1 -- 172.21.15.43:0/1293082992 wait complete. 2024-07-26T08:35:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.035+0000 7faf2929e740 1 -- start start 2024-07-26T08:35:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.035+0000 7faf2929e740 1 Processor -- start 2024-07-26T08:35:11.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.036+0000 7faf2929e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a827240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.036+0000 7faf2929e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a827820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.036+0000 7faf2929e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a877970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.036+0000 7faf2929e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1acfa0 con 0x55e79a41c1b0 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.036+0000 7faf2929e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1ae3d0 con 0x55e79a424390 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.037+0000 7faf2929e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c1ad630 con 0x55e79a445070 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.037+0000 7faf2929e740 10 client.0 _ll_register_callbacks cb 0x7faf14012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.037+0000 7faf1b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a827240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.037+0000 7faf1b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a827240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49192/0 (socket says 172.21.15.43:49192) 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.037+0000 7faf1b400640 1 -- 172.21.15.43:0/420689236 learned_addr learned my addr 172.21.15.43:0/420689236 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.039+0000 7faf1b400640 1 -- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 msgr2=0x55e79a877970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:35:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.039+0000 7faf1b400640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a877970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.039+0000 7faf1b400640 1 -- 172.21.15.43:0/420689236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 msgr2=0x55e79a827820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.039+0000 7faf1aa00640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a827820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.040+0000 7faf1b400640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a827820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.040+0000 7faf1b400640 1 -- 172.21.15.43:0/420689236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e79a877fe0 con 0x55e79a41c1b0 2024-07-26T08:35:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.040+0000 7faf1aa00640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a827820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.041+0000 7faf1b400640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a827240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faf0c10c8c0 tx=0x7faf0c02a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79604cda5d2bcb68 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.041+0000 7faf05600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:35:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.042+0000 7faf05600640 1 -- 172.21.15.43:0/420689236 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0c69e0 con 0x55e79a41c1b0 2024-07-26T08:35:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.042+0000 7faf05600640 1 -- 172.21.15.43:0/420689236 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7faf0c0c6db0 con 0x55e79a41c1b0 2024-07-26T08:35:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.042+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf14034070 con 0x55e79a41c1b0 2024-07-26T08:35:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.043+0000 7faf05600640 1 -- 172.21.15.43:0/420689236 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faf0c0c62b0 con 0x55e79a41c1b0 2024-07-26T08:35:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.043+0000 7faf2929e740 10 client.15561 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.043+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e79a891510 con 0x55e79a41c1b0 2024-07-26T08:35:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.044+0000 7faf05600640 1 -- 172.21.15.43:0/420689236 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf14034070 con 0x55e79a41c1b0 2024-07-26T08:35:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.044+0000 7faf05600640 1 -- 172.21.15.43:0/420689236 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faf0c104ce0 con 0x55e79a41c1b0 2024-07-26T08:35:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.044+0000 7faf2929e740 10 client.15561 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.044+0000 7faf2929e740 10 client.15561 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:35:11.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.045+0000 7faf2929e740 20 client.15561 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:11.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.045+0000 7faf2929e740 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a3d8da0 0x55e79a893a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:11.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.045+0000 7faf2929e740 4 client.15561 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:35:11.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.045+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e79a75e5c0 con 0x55e79a3d8da0 2024-07-26T08:35:11.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.046+0000 7faf1aa00640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a3d8da0 0x55e79a893a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.048+0000 7faf1aa00640 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a3d8da0 0x55e79a893a60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6331e916b6b591ff server_cookie=426914fdf81f5624 in_seq=0 out_seq=0 2024-07-26T08:35:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.048+0000 7faf05600640 10 client.15561 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:35:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.048+0000 7faf05600640 1 -- 172.21.15.43:0/420689236 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e79a75e5c0 con 0x55e79a3d8da0 2024-07-26T08:35:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.048+0000 7faf05600640 10 client.15561 handle_command_reply: tid=0 2024-07-26T08:35:11.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.048+0000 7faf2929e740 1 client.15561 shutdown 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 msgr2=0x55e79a827240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a827240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faf0c10c8c0 tx=0x7faf0c02a360 comp rx=0 tx=0).stop 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 shutdown_connections 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x55e79a3d8da0 0x55e79a893a60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e79a445070 0x55e79a877970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e79a424390 0x55e79a827820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 --2- 172.21.15.43:0/420689236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e79a41c1b0 0x55e79a827240 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 >> 172.21.15.43:0/420689236 conn(0x55e79a439460 msgr2=0x55e79a7f0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:11.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.049+0000 7faf05600640 0 client.15561 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:35:11.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.050+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 shutdown_connections 2024-07-26T08:35:11.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.050+0000 7faf2929e740 1 -- 172.21.15.43:0/420689236 wait complete. 2024-07-26T08:35:11.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.050+0000 7faf2929e740 20 client.15561 trim_cache size 0 max 16384 2024-07-26T08:35:11.052 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:35:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.051+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf000b3ed0 msgr2=0x7faf000b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.051+0000 7faf22600640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf000b3ed0 0x7faf000b63e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faf14005fd0 tx=0x7faf14009500 comp rx=0 tx=0).stop 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.051+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 msgr2=0x7faf1c19c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.051+0000 7faf22600640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 0x7faf1c19c2b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf0c02a950 tx=0x7faf0c032650 comp rx=0 tx=0).stop 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 shutdown_connections 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7faf000b3ed0 0x7faf000b63e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c10b120 0x7faf1c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf1c10ba70 0x7faf1c1a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 --2- 172.21.15.43:0/3499318116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf1c1057e0 0x7faf1c19c2b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 >> 172.21.15.43:0/3499318116 conn(0x7faf1c1011f0 msgr2=0x7faf1c1098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 shutdown_connections 2024-07-26T08:35:11.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:11.052+0000 7faf22600640 1 -- 172.21.15.43:0/3499318116 wait complete. 2024-07-26T08:35:12.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-07-26T08:35:12.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:12 smithi043 ceph-mon[32384]: pgmap v546: 129 pgs: 129 active+clean; 153 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 425 op/s 2024-07-26T08:35:12.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:12 smithi133 ceph-mon[37053]: pgmap v546: 129 pgs: 129 active+clean; 153 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 425 op/s 2024-07-26T08:35:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:12 smithi063 ceph-mon[36747]: pgmap v546: 129 pgs: 129 active+clean; 153 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 425 op/s 2024-07-26T08:35:12.937 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:35:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:14 smithi133 ceph-mon[37053]: pgmap v547: 129 pgs: 129 active+clean; 155 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 398 op/s 2024-07-26T08:35:14.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:14 smithi063 ceph-mon[36747]: pgmap v547: 129 pgs: 129 active+clean; 155 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 398 op/s 2024-07-26T08:35:14.871 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:14 smithi043 ceph-mon[32384]: pgmap v547: 129 pgs: 129 active+clean; 155 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 398 op/s 2024-07-26T08:35:15.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 -- 172.21.15.43:0/1616775514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f810fa40 msgr2=0x7fd3f8111e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1616775514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f810fa40 0x7fd3f8111e60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009ca0 tx=0x7fd3f002a950 comp rx=0 tx=0).stop 2024-07-26T08:35:15.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 -- 172.21.15.43:0/1616775514 shutdown_connections 2024-07-26T08:35:15.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1616775514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f81027e0 0x7fd3f810f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1616775514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f810fa40 0x7fd3f8111e60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1616775514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f8101e90 0x7fd3f81022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 -- 172.21.15.43:0/1616775514 >> 172.21.15.43:0/1616775514 conn(0x7fd3f80fdcf0 msgr2=0x7fd3f8100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:15.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 -- 172.21.15.43:0/1616775514 shutdown_connections 2024-07-26T08:35:15.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.409+0000 7fd3f7200640 1 -- 172.21.15.43:0/1616775514 wait complete. 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.410+0000 7fd3f7200640 1 Processor -- start 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.410+0000 7fd3f7200640 1 -- start start 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 0x7fd3f819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f81027e0 0x7fd3f819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f810fa40 0x7fd3f81a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8115620 con 0x7fd3f810fa40 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81154a0 con 0x7fd3f81027e0 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81157a0 con 0x7fd3f8101e90 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 0x7fd3f819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 0x7fd3f819bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57576/0 (socket says 172.21.15.43:57576) 2024-07-26T08:35:15.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f5e00640 1 -- 172.21.15.43:0/1946037849 learned_addr learned my addr 172.21.15.43:0/1946037849 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:15.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f5400640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f81027e0 0x7fd3f819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.411+0000 7fd3f6800640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f810fa40 0x7fd3f81a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.412+0000 7fd3f5e00640 1 -- 172.21.15.43:0/1946037849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f81027e0 msgr2=0x7fd3f819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.412+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f81027e0 0x7fd3f819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.412+0000 7fd3f5e00640 1 -- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f810fa40 msgr2=0x7fd3f81a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.412+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f810fa40 0x7fd3f81a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.412+0000 7fd3f5e00640 1 -- 172.21.15.43:0/1946037849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f81a1ea0 con 0x7fd3f8101e90 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.412+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 0x7fd3f819bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800e9f0 tx=0x7fd3e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.413+0000 7fd3eea00640 1 -- 172.21.15.43:0/1946037849 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800cd80 con 0x7fd3f8101e90 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.413+0000 7fd3eea00640 1 -- 172.21.15.43:0/1946037849 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3e8010900 con 0x7fd3f8101e90 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.413+0000 7fd3eea00640 1 -- 172.21.15.43:0/1946037849 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8018920 con 0x7fd3f8101e90 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.413+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f81a2190 con 0x7fd3f8101e90 2024-07-26T08:35:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.413+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f81a88f0 con 0x7fd3f8101e90 2024-07-26T08:35:15.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.416+0000 7fd403c5c740 1 Processor -- start 2024-07-26T08:35:15.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.416+0000 7fd403c5c740 1 -- start start 2024-07-26T08:35:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be788c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be788c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 0x564be788cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd403c5c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564be7802bd0 con 0x564be74c6390 2024-07-26T08:35:15.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd403c5c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564be77f20d0 con 0x564be74be1b0 2024-07-26T08:35:15.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd403c5c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564be77f6110 con 0x564be74e7070 2024-07-26T08:35:15.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd3f5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 0x564be788cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd3f5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 0x564be788cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40916/0 (socket says 172.21.15.43:40916) 2024-07-26T08:35:15.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be788c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.417+0000 7fd3f5400640 1 -- 172.21.15.43:0/1339067935 learned_addr learned my addr 172.21.15.43:0/1339067935 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3eea00640 1 -- 172.21.15.43:0/1946037849 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd3e8010ab0 con 0x7fd3f8101e90 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3f5400640 1 -- 172.21.15.43:0/1339067935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 msgr2=0x564be788c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3f5400640 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be788c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3f5400640 1 -- 172.21.15.43:0/1339067935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 msgr2=0x564be788c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3f5400640 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be788c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3f5400640 1 -- 172.21.15.43:0/1339067935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be7552650 con 0x564be74c6390 2024-07-26T08:35:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.418+0000 7fd3f5400640 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 0x564be788cc80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009ca0 tx=0x7fd3e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d6e01818cde5f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:15.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.419+0000 7fd3e3400640 1 -- 172.21.15.43:0/1339067935 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401e070 con 0x564be74c6390 2024-07-26T08:35:15.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.419+0000 7fd3e3400640 1 -- 172.21.15.43:0/1339067935 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3e4019b00 con 0x564be74c6390 2024-07-26T08:35:15.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.419+0000 7fd3e3400640 1 -- 172.21.15.43:0/1339067935 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400eab0 con 0x564be74c6390 2024-07-26T08:35:15.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.420+0000 7fd3eea00640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3dc0b3dc0 0x7fd3dc0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.420+0000 7fd3eea00640 1 -- 172.21.15.43:0/1946037849 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fd3e80e4710 con 0x7fd3f8101e90 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.420+0000 7fd3f6800640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3dc0b3dc0 0x7fd3dc0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.420+0000 7fd403c5c740 1 -- 172.21.15.43:0/1339067935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 msgr2=0x564be788cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.420+0000 7fd403c5c740 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 0x564be788cc80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009ca0 tx=0x7fd3e4011810 comp rx=0 tx=0).stop 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 -- 172.21.15.43:0/1339067935 shutdown_connections 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74c6390 0x564be788cc80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be788c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 --2- 172.21.15.43:0/1339067935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be788c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 -- 172.21.15.43:0/1339067935 >> 172.21.15.43:0/1339067935 conn(0x564be74db460 msgr2=0x564be788a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:15.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd3f6800640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3dc0b3dc0 0x7fd3dc0b62d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006010 tx=0x7fd3f0005d80 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:15.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 -- 172.21.15.43:0/1339067935 shutdown_connections 2024-07-26T08:35:15.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.421+0000 7fd403c5c740 1 -- 172.21.15.43:0/1339067935 wait complete. 2024-07-26T08:35:15.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.422+0000 7fd403c5c740 1 -- start start 2024-07-26T08:35:15.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.422+0000 7fd403c5c740 1 Processor -- start 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be7897820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74c6390 0x564be7897d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be78982c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564be7655700 con 0x564be74e7070 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564be778e6a0 con 0x564be74be1b0 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564be789aa30 con 0x564be74c6390 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd403c5c740 10 client.0 _ll_register_callbacks cb 0x564be779e150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be7897820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be7897820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:44660/0 (socket says 172.21.15.43:44660) 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd3f5e00640 1 -- 172.21.15.43:0/429275213 learned_addr learned my addr 172.21.15.43:0/429275213 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd3f5400640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74c6390 0x564be7897d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.423+0000 7fd3f6800640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be78982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f5400640 1 -- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 msgr2=0x564be7897820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f5400640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be7897820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f5400640 1 -- 172.21.15.43:0/429275213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 msgr2=0x564be78982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f5400640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be78982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f5400640 1 -- 172.21.15.43:0/429275213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be77a5840 con 0x564be74c6390 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f6800640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be78982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3f5400640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74c6390 0x564be7897d60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009870 tx=0x7fd3e4019a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=983bb3208dedd097 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.424+0000 7fd3d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd3d7e00640 1 -- 172.21.15.43:0/429275213 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401e070 con 0x564be74c6390 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd3d7e00640 1 -- 172.21.15.43:0/429275213 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fd3e4005030 con 0x564be74c6390 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3e4019b00 con 0x564be74c6390 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd3d7e00640 1 -- 172.21.15.43:0/429275213 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd3e4030050 con 0x564be74c6390 2024-07-26T08:35:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd403c5c740 10 client.25717 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:15.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564be78a66e0 con 0x564be74c6390 2024-07-26T08:35:15.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.425+0000 7fd3d7e00640 1 -- 172.21.15.43:0/429275213 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3e4019b00 con 0x564be74c6390 2024-07-26T08:35:15.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd3d7e00640 1 -- 172.21.15.43:0/429275213 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd3e40046c0 con 0x564be74c6390 2024-07-26T08:35:15.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd403c5c740 10 client.25717 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:15.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd403c5c740 10 client.25717 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd403c5c740 20 client.25717 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd403c5c740 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be74a59f0 0x564be78a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd403c5c740 4 client.25717 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564be7804b20 con 0x564be74a59f0 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.426+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be74a59f0 0x564be78a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.427+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be74a59f0 0x564be78a9af0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a22d95d234e6c76 server_cookie=bd90487da0d03e0f in_seq=0 out_seq=0 2024-07-26T08:35:15.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.427+0000 7fd3d7e00640 10 client.25717 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd3d7e00640 1 -- 172.21.15.43:0/429275213 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564be7804b20 con 0x564be74a59f0 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd3d7e00640 10 client.25717 handle_command_reply: tid=0 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 client.25717 shutdown 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74c6390 msgr2=0x564be7897d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74c6390 0x564be7897d60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009870 tx=0x7fd3e4019a90 comp rx=0 tx=0).stop 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 shutdown_connections 2024-07-26T08:35:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74c6390 0x564be7897d60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be74a59f0 0x564be78a9af0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be78982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 --2- 172.21.15.43:0/429275213 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74be1b0 0x564be7897820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd3d7e00640 0 client.25717 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.428+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 >> 172.21.15.43:0/429275213 conn(0x564be74db460 msgr2=0x564be788f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.429+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 shutdown_connections 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.429+0000 7fd403c5c740 1 -- 172.21.15.43:0/429275213 wait complete. 2024-07-26T08:35:15.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.429+0000 7fd403c5c740 20 client.25717 trim_cache size 0 max 16384 2024-07-26T08:35:15.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.444+0000 7fd403c5c740 1 Processor -- start 2024-07-26T08:35:15.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.444+0000 7fd403c5c740 1 -- start start 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74be1b0 0x564be788dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be7888730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be7899450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd403c5c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b5310 con 0x564be74e7070 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd403c5c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b2be0 con 0x564be74c6390 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd403c5c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b0a30 con 0x564be74be1b0 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74be1b0 0x564be788dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74be1b0 0x564be788dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57612/0 (socket says 172.21.15.43:57612) 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd3f5e00640 1 -- 172.21.15.43:0/3927229226 learned_addr learned my addr 172.21.15.43:0/3927229226 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd3f6800640 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be7899450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.445+0000 7fd3f5400640 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be7888730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.446+0000 7fd3f5400640 1 -- 172.21.15.43:0/3927229226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74be1b0 msgr2=0x564be788dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.446+0000 7fd3f5400640 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74be1b0 0x564be788dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.446+0000 7fd3f5400640 1 -- 172.21.15.43:0/3927229226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 msgr2=0x564be7899450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.446+0000 7fd3f5400640 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be7899450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.446+0000 7fd3f5400640 1 -- 172.21.15.43:0/3927229226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be7895d20 con 0x564be74c6390 2024-07-26T08:35:15.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.446+0000 7fd3f5400640 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be7888730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400e5e0 tx=0x7fd3e4009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895dd24bb7bdc4c5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:15.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.447+0000 7fd3e2a00640 1 -- 172.21.15.43:0/3927229226 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401e070 con 0x564be74c6390 2024-07-26T08:35:15.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.447+0000 7fd3e2a00640 1 -- 172.21.15.43:0/3927229226 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3e401f040 con 0x564be74c6390 2024-07-26T08:35:15.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.447+0000 7fd3e2a00640 1 -- 172.21.15.43:0/3927229226 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40043c0 con 0x564be74c6390 2024-07-26T08:35:15.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 -- 172.21.15.43:0/3927229226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 msgr2=0x564be7888730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be7888730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400e5e0 tx=0x7fd3e4009f10 comp rx=0 tx=0).stop 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 -- 172.21.15.43:0/3927229226 shutdown_connections 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74e7070 0x564be7899450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be7888730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 --2- 172.21.15.43:0/3927229226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74be1b0 0x564be788dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 -- 172.21.15.43:0/3927229226 >> 172.21.15.43:0/3927229226 conn(0x564be74db460 msgr2=0x564be7898d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 -- 172.21.15.43:0/3927229226 shutdown_connections 2024-07-26T08:35:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.448+0000 7fd403c5c740 1 -- 172.21.15.43:0/3927229226 wait complete. 2024-07-26T08:35:15.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.449+0000 7fd403c5c740 1 -- start start 2024-07-26T08:35:15.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.449+0000 7fd403c5c740 1 Processor -- start 2024-07-26T08:35:15.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74be1b0 0x564be789d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be789dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be790a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b10a0 con 0x564be74be1b0 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b2510 con 0x564be74c6390 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b1770 con 0x564be74e7070 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd403c5c740 10 client.0 _ll_register_callbacks cb 0x7fd3e4009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd3f5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be789dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd3f5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be789dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:44684/0 (socket says 172.21.15.43:44684) 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74be1b0 0x564be789d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.450+0000 7fd3f5400640 1 -- 172.21.15.43:0/813176890 learned_addr learned my addr 172.21.15.43:0/813176890 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.451+0000 7fd3f6800640 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be790a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.451+0000 7fd3f5400640 1 -- 172.21.15.43:0/813176890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 msgr2=0x564be790a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.451+0000 7fd3f5400640 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be790a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.451+0000 7fd3f5400640 1 -- 172.21.15.43:0/813176890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74be1b0 msgr2=0x564be789d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.451+0000 7fd3f5400640 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74be1b0 0x564be789d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.451+0000 7fd3f5400640 1 -- 172.21.15.43:0/813176890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be790a950 con 0x564be74c6390 2024-07-26T08:35:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.452+0000 7fd3f5400640 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be789dd50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009bc0 tx=0x7fd3e4005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665174e6c25f6f53 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.452+0000 7fd3d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:35:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.452+0000 7fd3d7e00640 1 -- 172.21.15.43:0/813176890 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4043060 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.452+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3e401f040 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.452+0000 7fd3d7e00640 1 -- 172.21.15.43:0/813176890 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7fd3e4028040 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd3d7e00640 1 -- 172.21.15.43:0/813176890 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd3e404a050 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd403c5c740 10 client.25697 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564be7911d40 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd3d7e00640 1 -- 172.21.15.43:0/813176890 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3e401f040 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd3d7e00640 1 -- 172.21.15.43:0/813176890 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd3e400ec50 con 0x564be74c6390 2024-07-26T08:35:15.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd403c5c740 10 client.25697 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.453+0000 7fd403c5c740 10 client.25697 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.454+0000 7fd403c5c740 20 client.25697 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.454+0000 7fd403c5c740 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be747ada0 0x564be7914450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.454+0000 7fd403c5c740 4 client.25697 mds_command: new command op to 24710 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.454+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 --> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564be78005c0 con 0x564be747ada0 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.454+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be747ada0 0x564be7914450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.455+0000 7fd3f5e00640 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be747ada0 0x564be7914450 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=134607606804d8d1 server_cookie=f4fa0782c222024a in_seq=0 out_seq=0 2024-07-26T08:35:15.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.455+0000 7fd3d7e00640 10 client.25697 ms_handle_connect on v2:172.21.15.63:6838/3045590383 2024-07-26T08:35:15.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.455+0000 7fd3d7e00640 1 -- 172.21.15.43:0/813176890 <== mds.1 v2:172.21.15.63:6838/3045590383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564be78005c0 con 0x564be747ada0 2024-07-26T08:35:15.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.455+0000 7fd3d7e00640 10 client.25697 handle_command_reply: tid=0 2024-07-26T08:35:15.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.455+0000 7fd403c5c740 1 client.25697 shutdown 2024-07-26T08:35:15.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 msgr2=0x564be789dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be789dd50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009bc0 tx=0x7fd3e4005df0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 shutdown_connections 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564be74e7070 0x564be790a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:6838/3045590383,v1:172.21.15.63:6839/3045590383] conn(0x564be747ada0 0x564be7914450 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564be74c6390 0x564be789dd50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 --2- 172.21.15.43:0/813176890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564be74be1b0 0x564be789d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 >> 172.21.15.43:0/813176890 conn(0x564be74db460 msgr2=0x564be788d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd3d7e00640 0 client.25697 ms_handle_reset on v2:172.21.15.63:6838/3045590383 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 shutdown_connections 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 1 -- 172.21.15.43:0/813176890 wait complete. 2024-07-26T08:35:15.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.456+0000 7fd403c5c740 20 client.25697 trim_cache size 0 max 16384 2024-07-26T08:35:15.459 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.458+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3dc0b3dc0 msgr2=0x7fd3dc0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.458+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3dc0b3dc0 0x7fd3dc0b62d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006010 tx=0x7fd3f0005d80 comp rx=0 tx=0).stop 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.458+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 msgr2=0x7fd3f819bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.458+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 0x7fd3f819bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800e9f0 tx=0x7fd3e800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 shutdown_connections 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd3dc0b3dc0 0x7fd3dc0b62d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f810fa40 0x7fd3f81a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3f81027e0 0x7fd3f819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 --2- 172.21.15.43:0/1946037849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3f8101e90 0x7fd3f819bf30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:15.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 >> 172.21.15.43:0/1946037849 conn(0x7fd3f80fdcf0 msgr2=0x7fd3f81094e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:15.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 shutdown_connections 2024-07-26T08:35:15.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:15.459+0000 7fd3f7200640 1 -- 172.21.15.43:0/1946037849 wait complete. 2024-07-26T08:35:16.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-26T08:35:16.755 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:16 smithi043 ceph-mon[32384]: pgmap v548: 129 pgs: 129 active+clean; 161 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2024-07-26T08:35:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:16 smithi133 ceph-mon[37053]: pgmap v548: 129 pgs: 129 active+clean; 161 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2024-07-26T08:35:16.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:16 smithi063 ceph-mon[36747]: pgmap v548: 129 pgs: 129 active+clean; 161 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2024-07-26T08:35:17.240 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:35:18.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:18 smithi133 ceph-mon[37053]: pgmap v549: 129 pgs: 129 active+clean; 161 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-07-26T08:35:18.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:18 smithi063 ceph-mon[36747]: pgmap v549: 129 pgs: 129 active+clean; 161 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-07-26T08:35:18.979 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:18 smithi043 ceph-mon[32384]: pgmap v549: 129 pgs: 129 active+clean; 161 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-07-26T08:35:20.620 INFO:tasks.workunit.client.0.smithi043.stderr:+ sync 2024-07-26T08:35:20.639 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:20 smithi043 ceph-mon[32384]: pgmap v550: 129 pgs: 129 active+clean; 165 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-07-26T08:35:20.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.622+0000 7f891e600640 1 -- 172.21.15.43:0/1972187252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918106420 msgr2=0x7f891810feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.622+0000 7f891e600640 1 --2- 172.21.15.43:0/1972187252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918106420 0x7f891810feb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8910009890 tx=0x7f891002a3b0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 -- 172.21.15.43:0/1972187252 shutdown_connections 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 --2- 172.21.15.43:0/1972187252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918106420 0x7f891810feb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 --2- 172.21.15.43:0/1972187252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8918105ad0 0x7f8918105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 --2- 172.21.15.43:0/1972187252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918101880 0x7f8918101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 -- 172.21.15.43:0/1972187252 >> 172.21.15.43:0/1972187252 conn(0x7f89180774d0 msgr2=0x7f8918077910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 -- 172.21.15.43:0/1972187252 shutdown_connections 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.623+0000 7f891e600640 1 -- 172.21.15.43:0/1972187252 wait complete. 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 Processor -- start 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 -- start start 2024-07-26T08:35:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918101880 0x7f8918118b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8918105ad0 0x7f8918111de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918106420 0x7f8918112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8918119aa0 con 0x7f8918105ad0 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8918119920 con 0x7f8918106420 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.625+0000 7f891e600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8918119c20 con 0x7f8918101880 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.626+0000 7f891d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918101880 0x7f8918118b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.626+0000 7f891d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918101880 0x7f8918118b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57640/0 (socket says 172.21.15.43:57640) 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.627+0000 7f891d200640 1 -- 172.21.15.43:0/998980507 learned_addr learned my addr 172.21.15.43:0/998980507 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.628+0000 7f891dc00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918106420 0x7f8918112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.629+0000 7f8917e00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8918105ad0 0x7f8918111de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.629+0000 7f891dc00640 1 -- 172.21.15.43:0/998980507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918101880 msgr2=0x7f8918118b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.629+0000 7f891dc00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918101880 0x7f8918118b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.629+0000 7f891dc00640 1 -- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8918105ad0 msgr2=0x7f8918111de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.629+0000 7f891dc00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8918105ad0 0x7f8918111de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.629+0000 7f891dc00640 1 -- 172.21.15.43:0/998980507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8918112b20 con 0x7f8918106420 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.630+0000 7f891dc00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918106420 0x7f8918112320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89100057c0 tx=0x7f8910033d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.631+0000 7f8915600640 1 -- 172.21.15.43:0/998980507 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891003f020 con 0x7f8918106420 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.631+0000 7f8915600640 1 -- 172.21.15.43:0/998980507 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8910030550 con 0x7f8918106420 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.631+0000 7f8915600640 1 -- 172.21.15.43:0/998980507 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891003f020 con 0x7f8918106420 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.631+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8918117780 con 0x7f8918106420 2024-07-26T08:35:20.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.631+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8918117bd0 con 0x7f8918106420 2024-07-26T08:35:20.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.641+0000 7f8926826740 1 Processor -- start 2024-07-26T08:35:20.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.643+0000 7f8915600640 1 -- 172.21.15.43:0/998980507 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8910042020 con 0x7f8918106420 2024-07-26T08:35:20.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.646+0000 7f8915600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88f80b3ff0 0x7f88f80b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 -- start start 2024-07-26T08:35:20.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da44020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d6761b0 0x56399da44560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d67e390 0x56399da44aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56399d9babf0 con 0x56399d69f070 2024-07-26T08:35:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56399d9aa0f0 con 0x56399d67e390 2024-07-26T08:35:20.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.647+0000 7f8926826740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56399d9ae130 con 0x56399d6761b0 2024-07-26T08:35:20.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.651+0000 7f891d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da44020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.652+0000 7f8917e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d6761b0 0x56399da44560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.653+0000 7f8917e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d6761b0 0x56399da44560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57654/0 (socket says 172.21.15.43:57654) 2024-07-26T08:35:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.653+0000 7f8917e00640 1 -- 172.21.15.43:0/2140005595 learned_addr learned my addr 172.21.15.43:0/2140005595 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.654+0000 7f8915600640 1 -- 172.21.15.43:0/998980507 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f8910104190 con 0x7f8918106420 2024-07-26T08:35:20.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.654+0000 7f891dc00640 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d67e390 0x56399da44aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.656+0000 7f891dc00640 1 -- 172.21.15.43:0/2140005595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d6761b0 msgr2=0x56399da44560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.656+0000 7f891dc00640 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d6761b0 0x56399da44560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.656+0000 7f891dc00640 1 -- 172.21.15.43:0/2140005595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 msgr2=0x56399da44020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.656+0000 7f891dc00640 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da44020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.656+0000 7f891dc00640 1 -- 172.21.15.43:0/2140005595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56399d70a650 con 0x56399d67e390 2024-07-26T08:35:20.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.658+0000 7f891d200640 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da44020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:35:20.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.658+0000 7f891dc00640 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d67e390 0x56399da44aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8910101650 tx=0x7f89100cb4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c16fc0fa9a114ed1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:20.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.659+0000 7f890e000640 1 -- 172.21.15.43:0/2140005595 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910037070 con 0x56399d67e390 2024-07-26T08:35:20.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.659+0000 7f890e000640 1 -- 172.21.15.43:0/2140005595 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f89100cb5f0 con 0x56399d67e390 2024-07-26T08:35:20.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.659+0000 7f8917e00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88f80b3ff0 0x7f88f80b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.662+0000 7f890e000640 1 -- 172.21.15.43:0/2140005595 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89101017c0 con 0x56399d67e390 2024-07-26T08:35:20.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.663+0000 7f8926826740 1 -- 172.21.15.43:0/2140005595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d67e390 msgr2=0x56399da44aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.663+0000 7f8917e00640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88f80b3ff0 0x7f88f80b6500 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56399da42ca0 tx=0x7f8900006b20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:20.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.663+0000 7f8926826740 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d67e390 0x56399da44aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8910101650 tx=0x7f89100cb4f0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.663+0000 7f8926826740 1 -- 172.21.15.43:0/2140005595 shutdown_connections 2024-07-26T08:35:20.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.663+0000 7f8926826740 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d6761b0 0x56399da44560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.664+0000 7f8926826740 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d67e390 0x56399da44aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.664+0000 7f8926826740 1 --2- 172.21.15.43:0/2140005595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da44020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.665+0000 7f8926826740 1 -- 172.21.15.43:0/2140005595 >> 172.21.15.43:0/2140005595 conn(0x56399d693460 msgr2=0x56399da41f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:20.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.665+0000 7f8926826740 1 -- 172.21.15.43:0/2140005595 shutdown_connections 2024-07-26T08:35:20.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.667+0000 7f8926826740 1 -- 172.21.15.43:0/2140005595 wait complete. 2024-07-26T08:35:20.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.668+0000 7f8926826740 1 -- start start 2024-07-26T08:35:20.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.668+0000 7f8926826740 1 Processor -- start 2024-07-26T08:35:20.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.671+0000 7f8926826740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da4f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.672+0000 7f8926826740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 0x56399da4faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.672+0000 7f8926826740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da4ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f891dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da4ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f8917e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 0x56399da4faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f8917e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 0x56399da4faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57656/0 (socket says 172.21.15.43:57656) 2024-07-26T08:35:20.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f8926826740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56399d80d700 con 0x56399d69f070 2024-07-26T08:35:20.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f8926826740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56399d9466c0 con 0x56399d6761b0 2024-07-26T08:35:20.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f8926826740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56399da525c0 con 0x56399d67e390 2024-07-26T08:35:20.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.673+0000 7f8926826740 10 client.0 _ll_register_callbacks cb 0x56399d956170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:20.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.674+0000 7f8917e00640 1 -- 172.21.15.43:0/3287097984 learned_addr learned my addr 172.21.15.43:0/3287097984 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:20.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.675+0000 7f891d200640 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da4f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.675+0000 7f8917e00640 1 -- 172.21.15.43:0/3287097984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 msgr2=0x56399da4f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.675+0000 7f8917e00640 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da4f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.675+0000 7f8917e00640 1 -- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 msgr2=0x56399da4ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.675+0000 7f8917e00640 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da4ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.676+0000 7f8917e00640 1 -- 172.21.15.43:0/3287097984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56399d95d860 con 0x56399d67e390 2024-07-26T08:35:20.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.677+0000 7f8917e00640 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 0x56399da4faa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8900019700 tx=0x7f89000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbfde742c4bef064 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:20.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.679+0000 7f8906a00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:20.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.679+0000 7f8906a00640 1 -- 172.21.15.43:0/3287097984 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900027060 con 0x56399d67e390 2024-07-26T08:35:20.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.679+0000 7f8906a00640 1 -- 172.21.15.43:0/3287097984 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f8900016500 con 0x56399d67e390 2024-07-26T08:35:20.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.679+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89100cb5f0 con 0x56399d67e390 2024-07-26T08:35:20.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.680+0000 7f8906a00640 1 -- 172.21.15.43:0/3287097984 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f890000f040 con 0x56399d67e390 2024-07-26T08:35:20.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.680+0000 7f8926826740 10 client.25735 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:20.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.680+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56399da5e1e0 con 0x56399d67e390 2024-07-26T08:35:20.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.680+0000 7f8906a00640 1 -- 172.21.15.43:0/3287097984 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f89100cb5f0 con 0x56399d67e390 2024-07-26T08:35:20.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.681+0000 7f8906a00640 1 -- 172.21.15.43:0/3287097984 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f89000178b0 con 0x56399d67e390 2024-07-26T08:35:20.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.685+0000 7f8926826740 10 client.25735 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:20.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.685+0000 7f8926826740 10 client.25735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:20.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.685+0000 7f8926826740 20 client.25735 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:20.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.685+0000 7f8926826740 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d65d9f0 0x56399da616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.685+0000 7f8926826740 4 client.25735 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:35:20.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.685+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56399d9bcb40 con 0x56399d65d9f0 2024-07-26T08:35:20.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.686+0000 7f891d200640 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d65d9f0 0x56399da616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.687+0000 7f891d200640 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d65d9f0 0x56399da616a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=470318e71ca4b736 server_cookie=7ac24138638889ff in_seq=0 out_seq=0 2024-07-26T08:35:20.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.687+0000 7f8906a00640 10 client.25735 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.692+0000 7f8906a00640 1 -- 172.21.15.43:0/3287097984 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56399d9bcb40 con 0x56399d65d9f0 2024-07-26T08:35:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.692+0000 7f8906a00640 10 client.25735 handle_command_reply: tid=0 2024-07-26T08:35:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.693+0000 7f8926826740 1 client.25735 shutdown 2024-07-26T08:35:20.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 msgr2=0x56399da4faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 0x56399da4faa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8900019700 tx=0x7f89000046c0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 shutdown_connections 2024-07-26T08:35:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d65d9f0 0x56399da616a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d67e390 0x56399da4faa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d69f070 0x56399da4ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 --2- 172.21.15.43:0/3287097984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da4f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.694+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 >> 172.21.15.43:0/3287097984 conn(0x56399d693460 msgr2=0x56399da471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.695+0000 7f8906a00640 0 client.25735 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.696+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 shutdown_connections 2024-07-26T08:35:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.696+0000 7f8926826740 1 -- 172.21.15.43:0/3287097984 wait complete. 2024-07-26T08:35:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.699+0000 7f8926826740 20 client.25735 trim_cache size 0 max 16384 2024-07-26T08:35:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.733+0000 7f8926826740 1 Processor -- start 2024-07-26T08:35:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.733+0000 7f8926826740 1 -- start start 2024-07-26T08:35:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.734+0000 7f8926826740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399da45a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.734+0000 7f8926826740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da40ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.734+0000 7f8926826740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da66ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f8926826740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88f4012940 con 0x56399d67e390 2024-07-26T08:35:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f8926826740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88f4010210 con 0x56399d6761b0 2024-07-26T08:35:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f8926826740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f88f400e060 con 0x56399d693460 2024-07-26T08:35:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f8917e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da40ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f891dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da66ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f891dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da66ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41002/0 (socket says 172.21.15.43:41002) 2024-07-26T08:35:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.735+0000 7f891dc00640 1 -- 172.21.15.43:0/1808583674 learned_addr learned my addr 172.21.15.43:0/1808583674 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.736+0000 7f891d200640 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399da45a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.737+0000 7f8917e00640 1 -- 172.21.15.43:0/1808583674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 msgr2=0x56399da45a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.737+0000 7f8917e00640 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399da45a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.737+0000 7f8917e00640 1 -- 172.21.15.43:0/1808583674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 msgr2=0x56399da66ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.737+0000 7f8917e00640 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da66ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.737+0000 7f8917e00640 1 -- 172.21.15.43:0/1808583674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56399da50820 con 0x56399d6761b0 2024-07-26T08:35:20.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.738+0000 7f8917e00640 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da40ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8900017cb0 tx=0x7f890000c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef2ef1bc2948dbd2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.739+0000 7f890d600640 1 -- 172.21.15.43:0/1808583674 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900031080 con 0x56399d6761b0 2024-07-26T08:35:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.739+0000 7f890d600640 1 -- 172.21.15.43:0/1808583674 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8900022410 con 0x56399d6761b0 2024-07-26T08:35:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.739+0000 7f890d600640 1 -- 172.21.15.43:0/1808583674 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900022da0 con 0x56399d6761b0 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 -- 172.21.15.43:0/1808583674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 msgr2=0x56399da40ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da40ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8900017cb0 tx=0x7f890000c410 comp rx=0 tx=0).stop 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 -- 172.21.15.43:0/1808583674 shutdown_connections 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da66ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da40ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 --2- 172.21.15.43:0/1808583674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399da45a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.741+0000 7f8926826740 1 -- 172.21.15.43:0/1808583674 >> 172.21.15.43:0/1808583674 conn(0x56399da50110 msgr2=0x56399da407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.744+0000 7f8926826740 1 -- 172.21.15.43:0/1808583674 shutdown_connections 2024-07-26T08:35:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.744+0000 7f8926826740 1 -- 172.21.15.43:0/1808583674 wait complete. 2024-07-26T08:35:20.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.745+0000 7f8926826740 1 -- start start 2024-07-26T08:35:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.746+0000 7f8926826740 1 Processor -- start 2024-07-26T08:35:20.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.747+0000 7f8926826740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.747+0000 7f8926826740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.748+0000 7f891d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.748+0000 7f8926826740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399dac0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.748+0000 7f891d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:44744/0 (socket says 172.21.15.43:44744) 2024-07-26T08:35:20.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.748+0000 7f8917e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.748+0000 7f891d200640 1 -- 172.21.15.43:0/2476894159 learned_addr learned my addr 172.21.15.43:0/2476894159 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:20.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.748+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88f400e6d0 con 0x56399d67e390 2024-07-26T08:35:20.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.749+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88f400fb40 con 0x56399d6761b0 2024-07-26T08:35:20.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.749+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f88f400eda0 con 0x56399d693460 2024-07-26T08:35:20.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.749+0000 7f891dc00640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399dac0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.749+0000 7f8926826740 10 client.0 _ll_register_callbacks cb 0x7f8900011be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:20.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.750+0000 7f891d200640 1 -- 172.21.15.43:0/2476894159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 msgr2=0x56399dac0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.750+0000 7f891d200640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399dac0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.750+0000 7f891d200640 1 -- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 msgr2=0x56399da55880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.750+0000 7f891d200640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da55880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.750+0000 7f891d200640 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56399dac1560 con 0x56399d6761b0 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.751+0000 7f891d200640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da552e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x56399da61e90 tx=0x7f890800b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e2db0ac7ad6124 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.751+0000 7f8906a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.752+0000 7f8906a00640 1 -- 172.21.15.43:0/2476894159 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908004b20 con 0x56399d6761b0 2024-07-26T08:35:20.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.752+0000 7f8906a00640 1 -- 172.21.15.43:0/2476894159 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f8908020040 con 0x56399d6761b0 2024-07-26T08:35:20.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.752+0000 7f8917e00640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da55880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:20.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.752+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8900022410 con 0x56399d6761b0 2024-07-26T08:35:20.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.753+0000 7f8906a00640 1 -- 172.21.15.43:0/2476894159 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8908004cc0 con 0x56399d6761b0 2024-07-26T08:35:20.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.754+0000 7f8926826740 10 client.25712 fetch_fsmap learned FSMap version 27 2024-07-26T08:35:20.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.754+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56399dac9a70 con 0x56399d6761b0 2024-07-26T08:35:20.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.754+0000 7f8906a00640 1 -- 172.21.15.43:0/2476894159 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8900022410 con 0x56399d6761b0 2024-07-26T08:35:20.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.755+0000 7f8906a00640 1 -- 172.21.15.43:0/2476894159 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8908024a60 con 0x56399d6761b0 2024-07-26T08:35:20.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.755+0000 7f8926826740 10 client.25712 fetch_fsmap finished waiting for FSMap version 27 2024-07-26T08:35:20.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.756+0000 7f8926826740 10 client.25712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:20.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.756+0000 7f8926826740 20 client.25712 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:20.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.756+0000 7f8926826740 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d69f070 0x56399dacc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:20.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.756+0000 7f8926826740 4 client.25712 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:35:20.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.757+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56399d9b85e0 con 0x56399d69f070 2024-07-26T08:35:20.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.758+0000 7f8917e00640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d69f070 0x56399dacc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:20.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.761+0000 7f8917e00640 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d69f070 0x56399dacc270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f45dc6d4a002f12 server_cookie=b06bc76926352181 in_seq=0 out_seq=0 2024-07-26T08:35:20.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.761+0000 7f8906a00640 10 client.25712 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:20 smithi133 ceph-mon[37053]: pgmap v550: 129 pgs: 129 active+clean; 165 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-07-26T08:35:20.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.771+0000 7f8906a00640 1 -- 172.21.15.43:0/2476894159 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56399d9b85e0 con 0x56399d69f070 2024-07-26T08:35:20.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.771+0000 7f8906a00640 10 client.25712 handle_command_reply: tid=0 2024-07-26T08:35:20.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.772+0000 7f8926826740 1 client.25712 shutdown 2024-07-26T08:35:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.772+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 msgr2=0x56399da552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.772+0000 7f8926826740 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da552e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x56399da61e90 tx=0x7f890800b9b0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.773+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 shutdown_connections 2024-07-26T08:35:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.773+0000 7f8926826740 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x56399d69f070 0x56399dacc270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.773+0000 7f8926826740 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56399d693460 0x56399dac0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.773+0000 7f8926826740 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56399d67e390 0x56399da55880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.773+0000 7f8926826740 1 --2- 172.21.15.43:0/2476894159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56399d6761b0 0x56399da552e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.773+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 >> 172.21.15.43:0/2476894159 conn(0x56399da50110 msgr2=0x56399da45790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.774+0000 7f8906a00640 0 client.25712 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.775+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 shutdown_connections 2024-07-26T08:35:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.776+0000 7f8926826740 1 -- 172.21.15.43:0/2476894159 wait complete. 2024-07-26T08:35:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.776+0000 7f8926826740 20 client.25712 trim_cache size 0 max 16384 2024-07-26T08:35:20.779 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:35:20.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88f80b3ff0 msgr2=0x7f88f80b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88f80b3ff0 0x7f88f80b6500 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56399da42ca0 tx=0x7f8900006b20 comp rx=0 tx=0).stop 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918106420 msgr2=0x7f8918112320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918106420 0x7f8918112320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89100057c0 tx=0x7f8910033d00 comp rx=0 tx=0).stop 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 shutdown_connections 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f88f80b3ff0 0x7f88f80b6500 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56399da42ca0 tx=0x7f8900006b20 comp rx=0 tx=0).stop 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8918106420 0x7f8918112320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8918105ad0 0x7f8918111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 --2- 172.21.15.43:0/998980507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8918101880 0x7f8918118b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.778+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 >> 172.21.15.43:0/998980507 conn(0x7f89180774d0 msgr2=0x7f8918106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:20.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.780+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 shutdown_connections 2024-07-26T08:35:20.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:20.781+0000 7f891e600640 1 -- 172.21.15.43:0/998980507 wait complete. 2024-07-26T08:35:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:20 smithi063 ceph-mon[36747]: pgmap v550: 129 pgs: 129 active+clean; 165 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-07-26T08:35:22.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:22 smithi043 ceph-mon[32384]: pgmap v551: 129 pgs: 129 active+clean; 171 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-07-26T08:35:22.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:22 smithi133 ceph-mon[37053]: pgmap v551: 129 pgs: 129 active+clean; 171 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-07-26T08:35:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:22 smithi063 ceph-mon[36747]: pgmap v551: 129 pgs: 129 active+clean; 171 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-07-26T08:35:23.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:23 smithi043 ceph-mon[32384]: pgmap v552: 129 pgs: 129 active+clean; 185 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 396 op/s 2024-07-26T08:35:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:23 smithi063 ceph-mon[36747]: pgmap v552: 129 pgs: 129 active+clean; 185 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 396 op/s 2024-07-26T08:35:24.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:23 smithi133 ceph-mon[37053]: pgmap v552: 129 pgs: 129 active+clean; 185 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 396 op/s 2024-07-26T08:35:25.146 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar c linux-4.0.5 2024-07-26T08:35:26.041 INFO:tasks.workunit.client.0.smithi043.stderr:+ rm -rf linux-4.0.5 2024-07-26T08:35:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:25 smithi043 ceph-mon[32384]: pgmap v553: 129 pgs: 129 active+clean; 195 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2024-07-26T08:35:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:25 smithi133 ceph-mon[37053]: pgmap v553: 129 pgs: 129 active+clean; 195 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2024-07-26T08:35:26.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:25 smithi063 ceph-mon[36747]: pgmap v553: 129 pgs: 129 active+clean; 195 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2024-07-26T08:35:26.953 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-26T08:35:26.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-26T08:35:27.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:26 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:27.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:26 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:35:27.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:26 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:28.162 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:27 smithi043 ceph-mon[32384]: pgmap v554: 129 pgs: 129 active+clean; 198 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 474 op/s 2024-07-26T08:35:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:27 smithi133 ceph-mon[37053]: pgmap v554: 129 pgs: 129 active+clean; 198 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 474 op/s 2024-07-26T08:35:28.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:27 smithi063 ceph-mon[36747]: pgmap v554: 129 pgs: 129 active+clean; 198 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 474 op/s 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 -- 172.21.15.43:0/2239125110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a68102060 msgr2=0x7f0a68102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/2239125110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a68102060 0x7f0a68102470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009900 tx=0x7f0a5802a480 comp rx=0 tx=0).stop 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 -- 172.21.15.43:0/2239125110 shutdown_connections 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/2239125110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a6810fc10 0x7f0a68112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/2239125110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a681029b0 0x7f0a6810f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/2239125110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a68102060 0x7f0a68102470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.036+0000 7f0a6ec00640 1 -- 172.21.15.43:0/2239125110 >> 172.21.15.43:0/2239125110 conn(0x7f0a68079160 msgr2=0x7f0a68079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.037+0000 7f0a6ec00640 1 -- 172.21.15.43:0/2239125110 shutdown_connections 2024-07-26T08:35:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.037+0000 7f0a6ec00640 1 -- 172.21.15.43:0/2239125110 wait complete. 2024-07-26T08:35:30.040 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:30 smithi043 ceph-mon[32384]: pgmap v555: 129 pgs: 129 active+clean; 208 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 486 op/s 2024-07-26T08:35:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.038+0000 7f0a6ec00640 1 Processor -- start 2024-07-26T08:35:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.038+0000 7f0a6ec00640 1 -- start start 2024-07-26T08:35:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a6ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 0x7f0a681075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a6ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a681029b0 0x7f0a68107b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a6ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a6810fc10 0x7f0a68108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a6ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681157f0 con 0x7f0a681029b0 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a6ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68115670 con 0x7f0a6810fc10 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a6ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68115970 con 0x7f0a68102060 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 0x7f0a681075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 0x7f0a681075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:40986/0 (socket says 172.21.15.43:40986) 2024-07-26T08:35:30.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.039+0000 7f0a67e00640 1 -- 172.21.15.43:0/3528116527 learned_addr learned my addr 172.21.15.43:0/3528116527 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:30.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.040+0000 7f0a67e00640 1 -- 172.21.15.43:0/3528116527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a6810fc10 msgr2=0x7f0a68108060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-26T08:35:30.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.040+0000 7f0a67e00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a6810fc10 0x7f0a68108060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.040+0000 7f0a67e00640 1 -- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a681029b0 msgr2=0x7f0a68107b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.040+0000 7f0a67400640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a681029b0 0x7f0a68107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.040+0000 7f0a67e00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a681029b0 0x7f0a68107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.040+0000 7f0a67e00640 1 -- 172.21.15.43:0/3528116527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a681ac630 con 0x7f0a68102060 2024-07-26T08:35:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.041+0000 7f0a67e00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 0x7f0a681075e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a5802a9f0 tx=0x7f0a58003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.041+0000 7f0a64c00640 1 -- 172.21.15.43:0/3528116527 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5803f070 con 0x7f0a68102060 2024-07-26T08:35:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.041+0000 7f0a64c00640 1 -- 172.21.15.43:0/3528116527 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a58031be0 con 0x7f0a68102060 2024-07-26T08:35:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.041+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a681ac8c0 con 0x7f0a68102060 2024-07-26T08:35:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.041+0000 7f0a64c00640 1 -- 172.21.15.43:0/3528116527 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58035030 con 0x7f0a68102060 2024-07-26T08:35:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.041+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a681acda0 con 0x7f0a68102060 2024-07-26T08:35:30.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.049+0000 7f0a758cb740 1 Processor -- start 2024-07-26T08:35:30.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.049+0000 7f0a64c00640 1 -- 172.21.15.43:0/3528116527 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0a58042070 con 0x7f0a68102060 2024-07-26T08:35:30.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.049+0000 7f0a758cb740 1 -- start start 2024-07-26T08:35:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea2bd350 0x558fea661d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 0x558fea6622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea29c670 0x558fea662810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a758cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558fea5d8bf0 con 0x558fea2bd350 2024-07-26T08:35:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a758cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558fea5c80f0 con 0x558fea294490 2024-07-26T08:35:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a758cb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558fea5cc130 con 0x558fea29c670 2024-07-26T08:35:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 0x558fea6622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 0x558fea6622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55822/0 (socket says 172.21.15.43:55822) 2024-07-26T08:35:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.050+0000 7f0a67e00640 1 -- 172.21.15.43:0/1646264447 learned_addr learned my addr 172.21.15.43:0/1646264447 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a67e00640 1 -- 172.21.15.43:0/1646264447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea29c670 msgr2=0x558fea662810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea29c670 0x558fea662810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a67e00640 1 -- 172.21.15.43:0/1646264447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea2bd350 msgr2=0x558fea661d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea2bd350 0x558fea661d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a67e00640 1 -- 172.21.15.43:0/1646264447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fea328930 con 0x558fea294490 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 0x558fea6622d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a580092a0 tx=0x7f0a58108b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533a3d895c548237 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.051+0000 7f0a64c00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0a4c0b3d70 0x7f0a4c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.052+0000 7f0a5d200640 1 -- 172.21.15.43:0/1646264447 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a580c8680 con 0x558fea294490 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.052+0000 7f0a5d200640 1 -- 172.21.15.43:0/1646264447 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a580cc730 con 0x558fea294490 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.052+0000 7f0a5d200640 1 -- 172.21.15.43:0/1646264447 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a580cb7a0 con 0x558fea294490 2024-07-26T08:35:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.052+0000 7f0a64c00640 1 -- 172.21.15.43:0/3528116527 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f0a58031d90 con 0x7f0a68102060 2024-07-26T08:35:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.053+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0a4c0b3d70 0x7f0a4c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.055+0000 7f0a758cb740 1 -- 172.21.15.43:0/1646264447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 msgr2=0x558fea6622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.055+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 0x558fea6622d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a580092a0 tx=0x7f0a58108b60 comp rx=0 tx=0).stop 2024-07-26T08:35:30.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.057+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0a4c0b3d70 0x7f0a4c0b6280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0a60005fd0 tx=0x7f0a60009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:30.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.057+0000 7f0a758cb740 1 -- 172.21.15.43:0/1646264447 shutdown_connections 2024-07-26T08:35:30.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.057+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea29c670 0x558fea662810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.057+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea294490 0x558fea6622d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.057+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1646264447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea2bd350 0x558fea661d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.057+0000 7f0a758cb740 1 -- 172.21.15.43:0/1646264447 >> 172.21.15.43:0/1646264447 conn(0x558fea2b1740 msgr2=0x558fea65fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:30.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.058+0000 7f0a758cb740 1 -- 172.21.15.43:0/1646264447 shutdown_connections 2024-07-26T08:35:30.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.058+0000 7f0a758cb740 1 -- 172.21.15.43:0/1646264447 wait complete. 2024-07-26T08:35:30.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.059+0000 7f0a758cb740 1 -- start start 2024-07-26T08:35:30.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.059+0000 7f0a758cb740 1 Processor -- start 2024-07-26T08:35:30.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea66d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a67400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a67400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55838/0 (socket says 172.21.15.43:55838) 2024-07-26T08:35:30.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a6cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.061+0000 7f0a6cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41000/0 (socket says 172.21.15.43:41000) 2024-07-26T08:35:30.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.062+0000 7f0a67400640 1 -- 172.21.15.43:0/2968794271 learned_addr learned my addr 172.21.15.43:0/2968794271 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:30.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.062+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558fea42b890 con 0x558fea294490 2024-07-26T08:35:30.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.062+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558fea564330 con 0x558fea29c670 2024-07-26T08:35:30.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.062+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558fea670330 con 0x558fea2bd350 2024-07-26T08:35:30.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.062+0000 7f0a67e00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea66d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.063+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2968794271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 msgr2=0x558fea66d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:30.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.063+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.063+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 msgr2=0x558fea66d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:30.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.063+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea66d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.063+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fea66e1e0 con 0x558fea2bd350 2024-07-26T08:35:30.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.064+0000 7f0a67e00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea66d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:35:30.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.065+0000 7f0a758cb740 10 client.0 _ll_register_callbacks cb 0x558fea590010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:30.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.065+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0a600106b0 tx=0x7f0a60004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e6304a694174c5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:30.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.065+0000 7f0a51600640 10 client.25750 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:30.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.065+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a580cc730 con 0x558fea2bd350 2024-07-26T08:35:30.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.066+0000 7f0a51600640 1 -- 172.21.15.43:0/2968794271 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6002b050 con 0x558fea2bd350 2024-07-26T08:35:30.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.066+0000 7f0a51600640 1 -- 172.21.15.43:0/2968794271 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f0a6001c690 con 0x558fea2bd350 2024-07-26T08:35:30.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.066+0000 7f0a51600640 1 -- 172.21.15.43:0/2968794271 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a60021070 con 0x558fea2bd350 2024-07-26T08:35:30.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.066+0000 7f0a758cb740 10 client.25750 fetch_fsmap learned FSMap version 28 2024-07-26T08:35:30.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.066+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558fea67bfe0 con 0x558fea2bd350 2024-07-26T08:35:30.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a51600640 1 -- 172.21.15.43:0/2968794271 <== mon.1 v2:172.21.15.133:3300/0 4 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f0a6001c8d0 con 0x558fea2bd350 2024-07-26T08:35:30.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a758cb740 10 client.25750 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T08:35:30.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a758cb740 10 client.25750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:30.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a758cb740 20 client.25750 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:30.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea27bcd0 0x558fea67f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a758cb740 4 client.25750 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:35:30.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.067+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fea5dab40 con 0x558fea27bcd0 2024-07-26T08:35:30.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.068+0000 7f0a67e00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea27bcd0 0x558fea67f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.069+0000 7f0a67e00640 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea27bcd0 0x558fea67f500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b53810e612e79d8 server_cookie=a99245455dbd51b8 in_seq=0 out_seq=0 2024-07-26T08:35:30.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.069+0000 7f0a51600640 10 client.25750 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:30.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.071+0000 7f0a51600640 1 -- 172.21.15.43:0/2968794271 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fea5dab40 con 0x558fea27bcd0 2024-07-26T08:35:30.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.071+0000 7f0a51600640 10 client.25750 handle_command_reply: tid=0 2024-07-26T08:35:30.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.072+0000 7f0a758cb740 1 client.25750 shutdown 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.072+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 msgr2=0x558fea679590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.072+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0a600106b0 tx=0x7f0a60004ab0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 shutdown_connections 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea27bcd0 0x558fea67f500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679590 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2968794271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea66d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 >> 172.21.15.43:0/2968794271 conn(0x558fea2b1740 msgr2=0x558fea664f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a51600640 0 client.25750 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 shutdown_connections 2024-07-26T08:35:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.073+0000 7f0a758cb740 1 -- 172.21.15.43:0/2968794271 wait complete. 2024-07-26T08:35:30.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.074+0000 7f0a758cb740 20 client.25750 trim_cache size 0 max 16384 2024-07-26T08:35:30.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.099+0000 7f0a758cb740 1 Processor -- start 2024-07-26T08:35:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.100+0000 7f0a758cb740 1 -- start start 2024-07-26T08:35:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.100+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea668c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.100+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a758cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681c2120 con 0x558fea294490 2024-07-26T08:35:30.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a758cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681bf9c0 con 0x558fea29c670 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a758cb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681088e0 con 0x558fea2bd350 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a6cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a6cc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41008/0 (socket says 172.21.15.43:41008) 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2916422917 learned_addr learned my addr 172.21.15.43:0/2916422917 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a67400640 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2916422917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 msgr2=0x558fea66f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.101+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2916422917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 msgr2=0x558fea668c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:35:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.103+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea668c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.103+0000 7f0a6cc00640 1 -- 172.21.15.43:0/2916422917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fea65a960 con 0x558fea2bd350 2024-07-26T08:35:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.103+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0a60005fa0 tx=0x7f0a6001e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc8e29f140cf503 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.104+0000 7f0a53e00640 1 -- 172.21.15.43:0/2916422917 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6002b030 con 0x558fea2bd350 2024-07-26T08:35:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.104+0000 7f0a53e00640 1 -- 172.21.15.43:0/2916422917 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a580cc730 con 0x558fea2bd350 2024-07-26T08:35:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.104+0000 7f0a53e00640 1 -- 172.21.15.43:0/2916422917 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6001d930 con 0x558fea2bd350 2024-07-26T08:35:30.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 -- 172.21.15.43:0/2916422917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 msgr2=0x558fea679380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0a60005fa0 tx=0x7f0a6001e000 comp rx=0 tx=0).stop 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 -- 172.21.15.43:0/2916422917 shutdown_connections 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea2bd350 0x558fea679380 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea29c670 0x558fea66f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 --2- 172.21.15.43:0/2916422917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea294490 0x558fea668c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 -- 172.21.15.43:0/2916422917 >> 172.21.15.43:0/2916422917 conn(0x558fea2b1740 msgr2=0x558fea66c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.105+0000 7f0a758cb740 1 -- 172.21.15.43:0/2916422917 shutdown_connections 2024-07-26T08:35:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.106+0000 7f0a758cb740 1 -- 172.21.15.43:0/2916422917 wait complete. 2024-07-26T08:35:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.106+0000 7f0a758cb740 1 -- start start 2024-07-26T08:35:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.107+0000 7f0a758cb740 1 Processor -- start 2024-07-26T08:35:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea294490 0x558fea6715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea29c670 0x558fea671af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a758cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 0x558fea672030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a758cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681bdfb0 con 0x558fea29c670 2024-07-26T08:35:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a6cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 0x558fea672030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a6cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 0x558fea672030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55860/0 (socket says 172.21.15.43:55860) 2024-07-26T08:35:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.108+0000 7f0a6cc00640 1 -- 172.21.15.43:0/1170604297 learned_addr learned my addr 172.21.15.43:0/1170604297 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.109+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681bf2f0 con 0x558fea2bd350 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.109+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681be550 con 0x558fea294490 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.109+0000 7f0a758cb740 10 client.0 _ll_register_callbacks cb 0x7f0a60014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.109+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea294490 0x558fea6715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.109+0000 7f0a6cc00640 1 -- 172.21.15.43:0/1170604297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea294490 msgr2=0x558fea6715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.110+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea294490 0x558fea6715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.110+0000 7f0a6cc00640 1 -- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea29c670 msgr2=0x558fea671af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.110+0000 7f0a67400640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea29c670 0x558fea671af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.110+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea29c670 0x558fea671af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.110+0000 7f0a6cc00640 1 -- 172.21.15.43:0/1170604297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fea6e6ee0 con 0x558fea2bd350 2024-07-26T08:35:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.110+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea294490 0x558fea6715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.111+0000 7f0a6cc00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 0x558fea672030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a6001d480 tx=0x7f0a6001c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f1003c08cc345c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.111+0000 7f0a67400640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea29c670 0x558fea671af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.111+0000 7f0a51600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.111+0000 7f0a51600640 1 -- 172.21.15.43:0/1170604297 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60004be0 con 0x558fea2bd350 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.111+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a580cc730 con 0x558fea2bd350 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.111+0000 7f0a51600640 1 -- 172.21.15.43:0/1170604297 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f0a60004d80 con 0x558fea2bd350 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.112+0000 7f0a51600640 1 -- 172.21.15.43:0/1170604297 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a6001d6d0 con 0x558fea2bd350 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.112+0000 7f0a758cb740 10 client.25727 fetch_fsmap learned FSMap version 28 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.112+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558fea6e81a0 con 0x558fea2bd350 2024-07-26T08:35:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.112+0000 7f0a51600640 1 -- 172.21.15.43:0/1170604297 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a580cc730 con 0x558fea2bd350 2024-07-26T08:35:30.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.112+0000 7f0a51600640 1 -- 172.21.15.43:0/1170604297 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f0a600053e0 con 0x558fea2bd350 2024-07-26T08:35:30.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.113+0000 7f0a758cb740 10 client.25727 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T08:35:30.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.113+0000 7f0a758cb740 10 client.25727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:30.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.113+0000 7f0a758cb740 20 client.25727 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.113+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea251080 0x558fea6ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.113+0000 7f0a758cb740 4 client.25727 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-26T08:35:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.113+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558fea5d65e0 con 0x558fea251080 2024-07-26T08:35:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.114+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea251080 0x558fea6ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.115+0000 7f0a67e00640 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea251080 0x558fea6ea7c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e36712677a3a03d0 server_cookie=9b35a55bd1224b58 in_seq=0 out_seq=0 2024-07-26T08:35:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.115+0000 7f0a51600640 10 client.25727 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:30.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.117+0000 7f0a51600640 1 -- 172.21.15.43:0/1170604297 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558fea5d65e0 con 0x558fea251080 2024-07-26T08:35:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.117+0000 7f0a51600640 10 client.25727 handle_command_reply: tid=0 2024-07-26T08:35:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.117+0000 7f0a758cb740 1 client.25727 shutdown 2024-07-26T08:35:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.117+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 msgr2=0x558fea672030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.117+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 0x558fea672030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a6001d480 tx=0x7f0a6001c720 comp rx=0 tx=0).stop 2024-07-26T08:35:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 shutdown_connections 2024-07-26T08:35:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x558fea251080 0x558fea6ea7c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fea2bd350 0x558fea672030 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fea29c670 0x558fea671af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a758cb740 1 --2- 172.21.15.43:0/1170604297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558fea294490 0x558fea6715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 >> 172.21.15.43:0/1170604297 conn(0x558fea2b1740 msgr2=0x558fea66ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.118+0000 7f0a51600640 0 client.25727 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.119+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 shutdown_connections 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.119+0000 7f0a758cb740 1 -- 172.21.15.43:0/1170604297 wait complete. 2024-07-26T08:35:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.119+0000 7f0a758cb740 20 client.25727 trim_cache size 0 max 16384 2024-07-26T08:35:30.123 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:35:30.123 INFO:teuthology.orchestra.run.smithi043.stdout: "return_code": 0, 2024-07-26T08:35:30.123 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_tag": "88568fe4-25cd-4f97-838a-86769759d8d0", 2024-07-26T08:35:30.123 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": "asynchronous" 2024-07-26T08:35:30.123 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:35:30.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.120+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0a4c0b3d70 msgr2=0x7f0a4c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.120+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0a4c0b3d70 0x7f0a4c0b6280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0a60005fd0 tx=0x7f0a60009500 comp rx=0 tx=0).stop 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.120+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 msgr2=0x7f0a681075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.120+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 0x7f0a681075e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a5802a9f0 tx=0x7f0a58003b90 comp rx=0 tx=0).stop 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 shutdown_connections 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0a4c0b3d70 0x7f0a4c0b6280 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a6810fc10 0x7f0a68108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a681029b0 0x7f0a68107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 --2- 172.21.15.43:0/3528116527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68102060 0x7f0a681075e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 >> 172.21.15.43:0/3528116527 conn(0x7f0a68079160 msgr2=0x7f0a68100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 shutdown_connections 2024-07-26T08:35:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:30.121+0000 7f0a6ec00640 1 -- 172.21.15.43:0/3528116527 wait complete. 2024-07-26T08:35:30.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:30 smithi133 ceph-mon[37053]: pgmap v555: 129 pgs: 129 active+clean; 208 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 486 op/s 2024-07-26T08:35:30.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:30 smithi063 ceph-mon[36747]: pgmap v555: 129 pgs: 129 active+clean; 208 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 486 op/s 2024-07-26T08:35:31.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:35:31.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:31 smithi133 ceph-mon[37053]: scrub queued for path: / 2024-07-26T08:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:31 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:31 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:31 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:31 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:31 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:31.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:31 smithi063 ceph-mon[36747]: scrub queued for path: / 2024-07-26T08:35:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:31 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:31 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:35:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:31 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:35:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:31 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:35:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:31 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:31.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:31 smithi043 ceph-mon[32384]: scrub queued for path: / 2024-07-26T08:35:31.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:31 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:31.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:31 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:35:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:31 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:35:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:31 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:35:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:31 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:31.598 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:35:32.278 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:32 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:32.279 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:32 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:32.279 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:32 smithi043 ceph-mon[32384]: pgmap v556: 129 pgs: 129 active+clean; 207 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 476 op/s 2024-07-26T08:35:32.279 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:32 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:32.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:32 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:32 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:32 smithi063 ceph-mon[36747]: pgmap v556: 129 pgs: 129 active+clean; 207 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 476 op/s 2024-07-26T08:35:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:32 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:32 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:32 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:35:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:32 smithi133 ceph-mon[37053]: pgmap v556: 129 pgs: 129 active+clean; 207 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 476 op/s 2024-07-26T08:35:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:32 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:34.150 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:34 smithi043 ceph-mon[32384]: pgmap v557: 129 pgs: 129 active+clean; 213 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 482 op/s 2024-07-26T08:35:34.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 -- 172.21.15.43:0/1586589264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 msgr2=0x7f9ea8105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 --2- 172.21.15.43:0/1586589264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea8105bd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009900 tx=0x7f9e9802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 -- 172.21.15.43:0/1586589264 shutdown_connections 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 --2- 172.21.15.43:0/1586589264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea810b100 0x7f9ea810b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 --2- 172.21.15.43:0/1586589264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ea810ba50 0x7f9ea8112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 --2- 172.21.15.43:0/1586589264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea8105bd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 -- 172.21.15.43:0/1586589264 >> 172.21.15.43:0/1586589264 conn(0x7f9ea8101290 msgr2=0x7f9ea81036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 -- 172.21.15.43:0/1586589264 shutdown_connections 2024-07-26T08:35:34.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.281+0000 7f9ead400640 1 -- 172.21.15.43:0/1586589264 wait complete. 2024-07-26T08:35:34.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.283+0000 7f9ead400640 1 Processor -- start 2024-07-26T08:35:34.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.283+0000 7f9ead400640 1 -- start start 2024-07-26T08:35:34.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.283+0000 7f9ead400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.283+0000 7f9ead400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ea810b100 0x7f9ea819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ead400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea810ba50 0x7f9ea81a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ead400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8115850 con 0x7f9ea810b100 2024-07-26T08:35:34.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ead400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81156d0 con 0x7f9ea81057c0 2024-07-26T08:35:34.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ead400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81159d0 con 0x7f9ea810ba50 2024-07-26T08:35:34.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9e9de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ea810b100 0x7f9ea819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea819c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55882/0 (socket says 172.21.15.43:55882) 2024-07-26T08:35:34.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 -- 172.21.15.43:0/3659832017 learned_addr learned my addr 172.21.15.43:0/3659832017 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:34.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea7200640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea810ba50 0x7f9ea81a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 -- 172.21.15.43:0/3659832017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea810ba50 msgr2=0x7f9ea81a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea810ba50 0x7f9ea81a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 -- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ea810b100 msgr2=0x7f9ea819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ea810b100 0x7f9ea819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.284+0000 7f9ea6800640 1 -- 172.21.15.43:0/3659832017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea81a2250 con 0x7f9ea81057c0 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.285+0000 7f9ea6800640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea819c2e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e98005ab0 tx=0x7f9e980040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.285+0000 7f9e9fe00640 1 -- 172.21.15.43:0/3659832017 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9803f030 con 0x7f9ea81057c0 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.285+0000 7f9e9fe00640 1 -- 172.21.15.43:0/3659832017 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e98003ac0 con 0x7f9ea81057c0 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.285+0000 7f9e9fe00640 1 -- 172.21.15.43:0/3659832017 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98035070 con 0x7f9ea81057c0 2024-07-26T08:35:34.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.285+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea81a24e0 con 0x7f9ea81057c0 2024-07-26T08:35:34.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.285+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea81a8ca0 con 0x7f9ea81057c0 2024-07-26T08:35:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.289+0000 7f9eb41c3740 1 Processor -- start 2024-07-26T08:35:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.289+0000 7f9eb41c3740 1 -- start start 2024-07-26T08:35:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.289+0000 7f9e9fe00640 1 -- 172.21.15.43:0/3659832017 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f9e98042030 con 0x7f9ea81057c0 2024-07-26T08:35:34.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561276243bc0 con 0x561275eff1b0 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5612762330c0 con 0x561275f28070 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x561276237100 con 0x561275f07390 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55886/0 (socket says 172.21.15.43:55886) 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 -- 172.21.15.43:0/860771855 learned_addr learned my addr 172.21.15.43:0/860771855 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea6800640 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9e9de00640 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 -- 172.21.15.43:0/860771855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 msgr2=0x5612762cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 -- 172.21.15.43:0/860771855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 msgr2=0x5612762cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.290+0000 7f9ea7200640 1 -- 172.21.15.43:0/860771855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561275f93650 con 0x561275f28070 2024-07-26T08:35:34.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.291+0000 7f9e9de00640 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.291+0000 7f9ea7200640 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762cce20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009f50 tx=0x7f9ea00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f67f81b88040b7d0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.291+0000 7f9e97400640 1 -- 172.21.15.43:0/860771855 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0004b20 con 0x561275f28070 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.291+0000 7f9e97400640 1 -- 172.21.15.43:0/860771855 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ea0004cc0 con 0x561275f28070 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.291+0000 7f9e97400640 1 -- 172.21.15.43:0/860771855 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0005020 con 0x561275f28070 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.292+0000 7f9e9fe00640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9e8c0b3dc0 0x7f9e8c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.292+0000 7f9e9fe00640 1 -- 172.21.15.43:0/3659832017 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f9e98104a50 con 0x7f9ea81057c0 2024-07-26T08:35:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.292+0000 7f9ea6800640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9e8c0b3dc0 0x7f9e8c0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 -- 172.21.15.43:0/860771855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 msgr2=0x5612762cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762cce20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009f50 tx=0x7f9ea00118d0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 -- 172.21.15.43:0/860771855 shutdown_connections 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/860771855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762cce20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 -- 172.21.15.43:0/860771855 >> 172.21.15.43:0/860771855 conn(0x561275f1c460 msgr2=0x5612762cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 -- 172.21.15.43:0/860771855 shutdown_connections 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.293+0000 7f9eb41c3740 1 -- 172.21.15.43:0/860771855 wait complete. 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.294+0000 7f9ea6800640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9e8c0b3dc0 0x7f9e8c0b62d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5612762cbaa0 tx=0x7f9e9802a3f0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:34.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.294+0000 7f9eb41c3740 1 -- start start 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.294+0000 7f9eb41c3740 1 Processor -- start 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762d8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762d89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762d8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561276096700 con 0x561275f07390 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5612761cf690 con 0x561275eff1b0 2024-07-26T08:35:34.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5612762db600 con 0x561275f28070 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.295+0000 7f9eb41c3740 10 client.0 _ll_register_callbacks cb 0x5612761df140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762d8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762d8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55902/0 (socket says 172.21.15.43:55902) 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 -- 172.21.15.43:0/3316690071 learned_addr learned my addr 172.21.15.43:0/3316690071 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9e9de00640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762d89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762d8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 -- 172.21.15.43:0/3316690071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 msgr2=0x5612762d8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762d8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 -- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 msgr2=0x5612762d89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762d89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.296+0000 7f9ea7200640 1 -- 172.21.15.43:0/3316690071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612761e6830 con 0x561275eff1b0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9ea7200640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762d8460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0004550 tx=0x7f9ea0004f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0864019399e147c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9e8be00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9e8be00640 1 -- 172.21.15.43:0/3316690071 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea002b020 con 0x561275eff1b0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea0004cc0 con 0x561275eff1b0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9e8be00640 1 -- 172.21.15.43:0/3316690071 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f9ea00040c0 con 0x561275eff1b0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9e8be00640 1 -- 172.21.15.43:0/3316690071 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9ea0005000 con 0x561275eff1b0 2024-07-26T08:35:34.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9eb41c3740 10 client.25739 fetch_fsmap learned FSMap version 29 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.297+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5612762e72b0 con 0x561275eff1b0 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9e8be00640 1 -- 172.21.15.43:0/3316690071 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ea0004cc0 con 0x561275eff1b0 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9e8be00640 1 -- 172.21.15.43:0/3316690071 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9ea00276e0 con 0x561275eff1b0 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9eb41c3740 10 client.25739 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9eb41c3740 10 client.25739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9eb41c3740 20 client.25739 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ee69f0 0x5612762ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9eb41c3740 4 client.25739 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.298+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561276245b10 con 0x561275ee69f0 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.299+0000 7f9e9de00640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ee69f0 0x5612762ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.299+0000 7f9e9de00640 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ee69f0 0x5612762ea610 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a23d287c33cb36 server_cookie=5820cc42c202b55d in_seq=0 out_seq=0 2024-07-26T08:35:34.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.299+0000 7f9e8be00640 10 client.25739 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:34.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.300+0000 7f9e8be00640 1 -- 172.21.15.43:0/3316690071 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561276245b10 con 0x561275ee69f0 2024-07-26T08:35:34.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.300+0000 7f9e8be00640 10 client.25739 handle_command_reply: tid=0 2024-07-26T08:35:34.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.300+0000 7f9eb41c3740 1 client.25739 shutdown 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 msgr2=0x5612762d8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762d8460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0004550 tx=0x7f9ea0004f30 comp rx=0 tx=0).stop 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 shutdown_connections 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ee69f0 0x5612762ea610 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762d8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762d89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/3316690071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762d8460 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9e8be00640 0 client.25739 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 >> 172.21.15.43:0/3316690071 conn(0x561275f1c460 msgr2=0x5612762cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 shutdown_connections 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 1 -- 172.21.15.43:0/3316690071 wait complete. 2024-07-26T08:35:34.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.301+0000 7f9eb41c3740 20 client.25739 trim_cache size 0 max 16384 2024-07-26T08:35:34.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:34 smithi063 ceph-mon[36747]: pgmap v557: 129 pgs: 129 active+clean; 213 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 482 op/s 2024-07-26T08:35:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 Processor -- start 2024-07-26T08:35:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 -- start start 2024-07-26T08:35:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762d8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762d9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81b55f0 con 0x561275eff1b0 2024-07-26T08:35:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81b2e60 con 0x561275f28070 2024-07-26T08:35:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.322+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81b0cb0 con 0x561275f07390 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.323+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.323+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57910/0 (socket says 172.21.15.43:57910) 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.323+0000 7f9ea7200640 1 -- 172.21.15.43:0/971106418 learned_addr learned my addr 172.21.15.43:0/971106418 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.323+0000 7f9e9de00640 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762d8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.323+0000 7f9ea7200640 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e9de00640 1 -- 172.21.15.43:0/971106418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 msgr2=0x5612762d9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e9de00640 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762d9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e9de00640 1 -- 172.21.15.43:0/971106418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 msgr2=0x5612762ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e9de00640 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e9de00640 1 -- 172.21.15.43:0/971106418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612762cfc80 con 0x561275f07390 2024-07-26T08:35:34.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9ea7200640 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:35:34.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e9de00640 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762d8ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5612762eab80 tx=0x7f9e90005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66ab56235ad52d0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:34.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e96a00640 1 -- 172.21.15.43:0/971106418 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90004030 con 0x561275f07390 2024-07-26T08:35:34.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e96a00640 1 -- 172.21.15.43:0/971106418 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e900041d0 con 0x561275f07390 2024-07-26T08:35:34.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.324+0000 7f9e96a00640 1 -- 172.21.15.43:0/971106418 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9001e780 con 0x561275f07390 2024-07-26T08:35:34.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.325+0000 7f9eb41c3740 1 -- 172.21.15.43:0/971106418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 msgr2=0x5612762d8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.325+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762d8ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5612762eab80 tx=0x7f9e90005f90 comp rx=0 tx=0).stop 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 -- 172.21.15.43:0/971106418 shutdown_connections 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f07390 0x5612762d8ae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275f28070 0x5612762d9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/971106418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275eff1b0 0x5612762ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 -- 172.21.15.43:0/971106418 >> 172.21.15.43:0/971106418 conn(0x561275f1c460 msgr2=0x5612762d83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 -- 172.21.15.43:0/971106418 shutdown_connections 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 -- 172.21.15.43:0/971106418 wait complete. 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.326+0000 7f9eb41c3740 1 -- start start 2024-07-26T08:35:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.327+0000 7f9eb41c3740 1 Processor -- start 2024-07-26T08:35:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762dc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81b1320 con 0x561275f07390 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81b2790 con 0x561275eff1b0 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea81b19f0 con 0x561275f28070 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9eb41c3740 10 client.0 _ll_register_callbacks cb 0x7f9ea0003a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762e0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55924/0 (socket says 172.21.15.43:55924) 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9e9de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762dc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9ea7200640 1 -- 172.21.15.43:0/1270749081 learned_addr learned my addr 172.21.15.43:0/1270749081 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:35:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.328+0000 7f9ea7200640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9ea7200640 1 -- 172.21.15.43:0/1270749081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 msgr2=0x5612762e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9ea7200640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9ea7200640 1 -- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 msgr2=0x5612762dc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9ea7200640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762dc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9ea7200640 1 -- 172.21.15.43:0/1270749081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612762dcc40 con 0x561275f28070 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9e9de00640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762dc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9ea7200640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762dc700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009d40 tx=0x7f9ea00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7217a03b91d480f9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.329+0000 7f9e8be00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.330+0000 7f9e8be00640 1 -- 172.21.15.43:0/1270749081 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea002b040 con 0x561275f28070 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.330+0000 7f9e8be00640 1 -- 172.21.15.43:0/1270749081 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9452+0+0 (secure 0 0 0) 0x7f9ea0027470 con 0x561275f28070 2024-07-26T08:35:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.330+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e900041d0 con 0x561275f28070 2024-07-26T08:35:34.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.331+0000 7f9e8be00640 1 -- 172.21.15.43:0/1270749081 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9ea0027670 con 0x561275f28070 2024-07-26T08:35:34.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.331+0000 7f9eb41c3740 10 client.25771 fetch_fsmap learned FSMap version 29 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.331+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561276352870 con 0x561275f28070 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.331+0000 7f9e8be00640 1 -- 172.21.15.43:0/1270749081 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ea0027810 con 0x561275f28070 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.331+0000 7f9e8be00640 1 -- 172.21.15.43:0/1270749081 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9ea000f4f0 con 0x561275f28070 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9eb41c3740 10 client.25771 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9eb41c3740 10 client.25771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9eb41c3740 20 client.25771 populate_metadata read hostname 'smithi043' 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ebbda0 0x561276355000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9eb41c3740 4 client.25771 mds_command: new command op to 24733 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 --> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9e900041d0 con 0x561275ebbda0 2024-07-26T08:35:34.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.332+0000 7f9e9de00640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ebbda0 0x561276355000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9e9de00640 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ebbda0 0x561276355000 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85421ef4daf66468 server_cookie=24f59195d87c3eec in_seq=0 out_seq=0 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9e8be00640 10 client.25771 ms_handle_connect on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9e8be00640 1 -- 172.21.15.43:0/1270749081 <== mds.0 v2:172.21.15.43:6840/445875183 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f9e900041d0 con 0x561275ebbda0 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9e8be00640 10 client.25771 handle_command_reply: tid=0 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9eb41c3740 1 client.25771 shutdown 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 msgr2=0x5612762dc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.333+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762dc700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009d40 tx=0x7f9ea00118d0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 shutdown_connections 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:6840/445875183,v1:172.21.15.43:6841/445875183] conn(0x561275ebbda0 0x561276355000 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561275f28070 0x5612762dc700 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561275f07390 0x5612762dc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 --2- 172.21.15.43:0/1270749081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561275eff1b0 0x5612762e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9e8be00640 0 client.25771 ms_handle_reset on v2:172.21.15.43:6840/445875183 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 >> 172.21.15.43:0/1270749081 conn(0x561275f1c460 msgr2=0x5612762d8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 shutdown_connections 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.334+0000 7f9eb41c3740 1 -- 172.21.15.43:0/1270749081 wait complete. 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.335+0000 7f9eb41c3740 20 client.25771 trim_cache size 0 max 16384 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:35:34.337 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: "88568fe4-25cd-4f97-838a-86769759d8d0": { 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "88568fe4-25cd-4f97-838a-86769759d8d0", 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:35:34.338 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9e8c0b3dc0 msgr2=0x7f9e8c0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9e8c0b3dc0 0x7f9e8c0b62d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5612762cbaa0 tx=0x7f9e9802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 msgr2=0x7f9ea819c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea819c2e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e98005ab0 tx=0x7f9e980040c0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 shutdown_connections 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f9e8c0b3dc0 0x7f9e8c0b62d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea810ba50 0x7f9ea81a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ea810b100 0x7f9ea819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 --2- 172.21.15.43:0/3659832017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ea81057c0 0x7f9ea819c2e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:35:34.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.337+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 >> 172.21.15.43:0/3659832017 conn(0x7f9ea8101290 msgr2=0x7f9ea810a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:35:34.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.338+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 shutdown_connections 2024-07-26T08:35:34.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:35:34.338+0000 7f9ead400640 1 -- 172.21.15.43:0/3659832017 wait complete. 2024-07-26T08:35:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:34 smithi133 ceph-mon[37053]: pgmap v557: 129 pgs: 129 active+clean; 213 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 482 op/s 2024-07-26T08:35:35.425 INFO:tasks.cephfs.filesystem:scrub status for tag:88568fe4-25cd-4f97-838a-86769759d8d0 - {'path': '/', 'tag': '88568fe4-25cd-4f97-838a-86769759d8d0', 'options': 'recursive,force'} 2024-07-26T08:35:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:36 smithi063 ceph-mon[36747]: pgmap v558: 129 pgs: 129 active+clean; 212 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-07-26T08:35:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:36 smithi043 ceph-mon[32384]: pgmap v558: 129 pgs: 129 active+clean; 212 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-07-26T08:35:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:36 smithi133 ceph-mon[37053]: pgmap v558: 129 pgs: 129 active+clean; 212 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-07-26T08:35:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:37 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:35:37.393 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:37 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:35:37.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:37 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:35:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:37 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:35:37.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:37 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:35:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:37 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:35:38.301 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-mon[36747]: scrub summary: idle 2024-07-26T08:35:38.301 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-mon[36747]: pgmap v559: 129 pgs: 129 active+clean; 211 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2024-07-26T08:35:38.301 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: *** Caught signal (Aborted) ** 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: in thread 7ff8bd2bb640 thread_name:ms_dispatch 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff8c26926f0] 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff8c26df94c] 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 3: raise() 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 4: abort() 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff8c267c71b] 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 6: /lib64/libc.so.6(+0x37386) [0x7ff8c268b386] 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558c052936b9] 2024-07-26T08:35:38.302 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558c0545180c] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558c053912ca] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558c05361753] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558c05362a1b] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558c05346752] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558c05294a56] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558c05298637] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558c05298f5e] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558c0527c03a] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff8c2f5f407] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 18: (DispatchQueue::entry()+0x60f) [0x7ff8c2f5fcf9] 2024-07-26T08:35:38.303 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff8c303c5a1] 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 20: (Thread::entry_wrapper()+0x43) [0x7ff8c2de9cdd] 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff8c2de9cf9] 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff8c26ddc02] 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff8c2762c40] 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.272+0000 7ff8bd2bb640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: in thread 7ff8bd2bb640 thread_name:ms_dispatch 2024-07-26T08:35:38.304 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff8c26926f0] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff8c26df94c] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 3: raise() 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 4: abort() 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff8c267c71b] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 6: /lib64/libc.so.6(+0x37386) [0x7ff8c268b386] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558c052936b9] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558c0545180c] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558c053912ca] 2024-07-26T08:35:38.305 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558c05361753] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558c05362a1b] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558c05346752] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558c05294a56] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558c05298637] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558c05298f5e] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558c0527c03a] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff8c2f5f407] 2024-07-26T08:35:38.306 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 18: (DispatchQueue::entry()+0x60f) [0x7ff8c2f5fcf9] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff8c303c5a1] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 20: (Thread::entry_wrapper()+0x43) [0x7ff8c2de9cdd] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff8c2de9cf9] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff8c26ddc02] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff8c2762c40] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 0> 2024-07-26T08:35:38.272+0000 7ff8bd2bb640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: in thread 7ff8bd2bb640 thread_name:ms_dispatch 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff8c26926f0] 2024-07-26T08:35:38.307 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff8c26df94c] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 3: raise() 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 4: abort() 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff8c267c71b] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 6: /lib64/libc.so.6(+0x37386) [0x7ff8c268b386] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558c052936b9] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558c0545180c] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558c053912ca] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558c05361753] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558c05362a1b] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558c05346752] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558c05294a56] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558c05298637] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558c05298f5e] 2024-07-26T08:35:38.308 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558c0527c03a] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff8c2f5f407] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 18: (DispatchQueue::entry()+0x60f) [0x7ff8c2f5fcf9] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff8c303c5a1] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 20: (Thread::entry_wrapper()+0x43) [0x7ff8c2de9cdd] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff8c2de9cf9] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff8c26ddc02] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff8c2762c40] 2024-07-26T08:35:38.309 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 0> 2024-07-26T08:35:38.272+0000 7ff8bd2bb640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: in thread 7ff8bd2bb640 thread_name:ms_dispatch 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff8c26926f0] 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff8c26df94c] 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 3: raise() 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 4: abort() 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff8c267c71b] 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 6: /lib64/libc.so.6(+0x37386) [0x7ff8c268b386] 2024-07-26T08:35:38.310 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558c052936b9] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558c0545180c] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558c053912ca] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558c05361753] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558c05362a1b] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558c05346752] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558c05294a56] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558c05298637] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558c05298f5e] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558c0527c03a] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff8c2f5f407] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 18: (DispatchQueue::entry()+0x60f) [0x7ff8c2f5fcf9] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff8c303c5a1] 2024-07-26T08:35:38.311 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 20: (Thread::entry_wrapper()+0x43) [0x7ff8c2de9cdd] 2024-07-26T08:35:38.312 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff8c2de9cf9] 2024-07-26T08:35:38.312 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff8c26ddc02] 2024-07-26T08:35:38.312 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff8c2762c40] 2024-07-26T08:35:38.312 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:38.312 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[68351]: 2024-07-26T08:35:38.315 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-mon[32384]: scrub summary: idle 2024-07-26T08:35:38.315 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-mon[32384]: pgmap v559: 129 pgs: 129 active+clean; 211 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: *** Caught signal (Aborted) ** 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: in thread 7f9184c00640 thread_name:ms_dispatch 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f918ae3e6f0] 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f918ae8b94c] 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 3: raise() 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 4: abort() 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 5: /lib64/libc.so.6(+0x2871b) [0x7f918ae2871b] 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 6: /lib64/libc.so.6(+0x37386) [0x7f918ae37386] 2024-07-26T08:35:38.318 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563a7bbea6b9] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563a7bda880c] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563a7bce82ca] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563a7bcb8753] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563a7bcb9a1b] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563a7bc9d752] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563a7bbeba56] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563a7bbef637] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563a7bbeff5e] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563a7bbd303a] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f918b99b407] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 18: (DispatchQueue::entry()+0x60f) [0x7f918b99bcf9] 2024-07-26T08:35:38.319 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f918ba785a1] 2024-07-26T08:35:38.321 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 20: (Thread::entry_wrapper()+0x43) [0x7f918b825cdd] 2024-07-26T08:35:38.321 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 21: (Thread::_entry_func(void*)+0xd) [0x7f918b825cf9] 2024-07-26T08:35:38.321 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 22: /lib64/libc.so.6(+0x89c02) [0x7f918ae89c02] 2024-07-26T08:35:38.321 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f918af0ec40] 2024-07-26T08:35:38.321 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.276+0000 7f9184c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: in thread 7f9184c00640 thread_name:ms_dispatch 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f918ae3e6f0] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f918ae8b94c] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 3: raise() 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 4: abort() 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 5: /lib64/libc.so.6(+0x2871b) [0x7f918ae2871b] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 6: /lib64/libc.so.6(+0x37386) [0x7f918ae37386] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563a7bbea6b9] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563a7bda880c] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563a7bce82ca] 2024-07-26T08:35:38.322 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563a7bcb8753] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563a7bcb9a1b] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563a7bc9d752] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563a7bbeba56] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563a7bbef637] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563a7bbeff5e] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563a7bbd303a] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f918b99b407] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 18: (DispatchQueue::entry()+0x60f) [0x7f918b99bcf9] 2024-07-26T08:35:38.323 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f918ba785a1] 2024-07-26T08:35:38.326 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 20: (Thread::entry_wrapper()+0x43) [0x7f918b825cdd] 2024-07-26T08:35:38.326 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 21: (Thread::_entry_func(void*)+0xd) [0x7f918b825cf9] 2024-07-26T08:35:38.326 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 22: /lib64/libc.so.6(+0x89c02) [0x7f918ae89c02] 2024-07-26T08:35:38.326 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f918af0ec40] 2024-07-26T08:35:38.326 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:38.326 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:38 smithi133 ceph-mon[37053]: scrub summary: idle 2024-07-26T08:35:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:38 smithi133 ceph-mon[37053]: pgmap v559: 129 pgs: 129 active+clean; 211 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2024-07-26T08:35:38.568 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:38 smithi063 podman[70875]: 2024-07-26 08:35:38.332083582 +0000 UTC m=+0.019525061 container died 6ae92b5bc47520975b3a9b7c7b670c61747b95ec594c64624f19f4b2856c7a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T08:35:38.734 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 0> 2024-07-26T08:35:38.276+0000 7f9184c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: in thread 7f9184c00640 thread_name:ms_dispatch 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f918ae3e6f0] 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f918ae8b94c] 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 3: raise() 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 4: abort() 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 5: /lib64/libc.so.6(+0x2871b) [0x7f918ae2871b] 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 6: /lib64/libc.so.6(+0x37386) [0x7f918ae37386] 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563a7bbea6b9] 2024-07-26T08:35:38.735 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563a7bda880c] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563a7bce82ca] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563a7bcb8753] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563a7bcb9a1b] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563a7bc9d752] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563a7bbeba56] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563a7bbef637] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563a7bbeff5e] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563a7bbd303a] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f918b99b407] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 18: (DispatchQueue::entry()+0x60f) [0x7f918b99bcf9] 2024-07-26T08:35:38.736 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f918ba785a1] 2024-07-26T08:35:38.737 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 20: (Thread::entry_wrapper()+0x43) [0x7f918b825cdd] 2024-07-26T08:35:38.737 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 21: (Thread::_entry_func(void*)+0xd) [0x7f918b825cf9] 2024-07-26T08:35:38.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 22: /lib64/libc.so.6(+0x89c02) [0x7f918ae89c02] 2024-07-26T08:35:38.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f918af0ec40] 2024-07-26T08:35:38.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:38.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: -20> 2024-07-26T08:35:38.276+0000 7f9184c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:38.738 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: in thread 7f9184c00640 thread_name:ms_dispatch 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f918ae3e6f0] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f918ae8b94c] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 3: raise() 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 4: abort() 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 5: /lib64/libc.so.6(+0x2871b) [0x7f918ae2871b] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 6: /lib64/libc.so.6(+0x37386) [0x7f918ae37386] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563a7bbea6b9] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563a7bda880c] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563a7bce82ca] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563a7bcb8753] 2024-07-26T08:35:38.739 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563a7bcb9a1b] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563a7bc9d752] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563a7bbeba56] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563a7bbef637] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563a7bbeff5e] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563a7bbd303a] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f918b99b407] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 18: (DispatchQueue::entry()+0x60f) [0x7f918b99bcf9] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f918ba785a1] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 20: (Thread::entry_wrapper()+0x43) [0x7f918b825cdd] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 21: (Thread::_entry_func(void*)+0xd) [0x7f918b825cf9] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 22: /lib64/libc.so.6(+0x89c02) [0x7f918ae89c02] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f918af0ec40] 2024-07-26T08:35:38.740 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:38.741 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[78816]: 2024-07-26T08:35:38.741 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:38 smithi043 podman[101095]: 2024-07-26 08:35:38.454778046 +0000 UTC m=+0.036824007 container died fc56a7adad442c02393fcfea071c32f583fa5b534eccd6daf317e86e68981e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-07-26T08:35:39.475 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:39 smithi063 podman[70875]: 2024-07-26 08:35:39.21467418 +0000 UTC m=+0.902115649 container remove 6ae92b5bc47520975b3a9b7c7b670c61747b95ec594c64624f19f4b2856c7a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True) 2024-07-26T08:35:39.475 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:39 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:35:39.659 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:39 smithi043 podman[101095]: 2024-07-26 08:35:39.338052286 +0000 UTC m=+0.920098318 container remove fc56a7adad442c02393fcfea071c32f583fa5b534eccd6daf317e86e68981e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:35:39.659 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:39 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:35:39.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:39 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T08:35:39.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:39 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 17.723s CPU time. 2024-07-26T08:35:40.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:39 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T08:35:40.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:39 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service: Consumed 45.895s CPU time. 2024-07-26T08:35:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:40 smithi043 ceph-mon[32384]: pgmap v560: 129 pgs: 129 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 251 op/s 2024-07-26T08:35:40.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:40 smithi063 ceph-mon[36747]: pgmap v560: 129 pgs: 129 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 251 op/s 2024-07-26T08:35:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:40 smithi133 ceph-mon[37053]: pgmap v560: 129 pgs: 129 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 251 op/s 2024-07-26T08:35:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:42 smithi043 ceph-mon[32384]: pgmap v561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 244 op/s 2024-07-26T08:35:42.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:42 smithi063 ceph-mon[36747]: pgmap v561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 244 op/s 2024-07-26T08:35:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:42 smithi133 ceph-mon[37053]: pgmap v561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 244 op/s 2024-07-26T08:35:44.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:44 smithi043 ceph-mon[32384]: pgmap v562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2024-07-26T08:35:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:35:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:44 smithi063 ceph-mon[36747]: pgmap v562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2024-07-26T08:35:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:35:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:44 smithi133 ceph-mon[37053]: pgmap v562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2024-07-26T08:35:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:35:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:35:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:35:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:35:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:35:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:35:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:35:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:35:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:35:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:46 smithi063 ceph-mon[36747]: pgmap v563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 811 KiB/s wr, 162 op/s 2024-07-26T08:35:46.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:46 smithi043 ceph-mon[32384]: pgmap v563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 811 KiB/s wr, 162 op/s 2024-07-26T08:35:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:46 smithi133 ceph-mon[37053]: pgmap v563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 811 KiB/s wr, 162 op/s 2024-07-26T08:35:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:48 smithi063 ceph-mon[36747]: pgmap v564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 764 KiB/s wr, 118 op/s 2024-07-26T08:35:48.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:48 smithi043 ceph-mon[32384]: pgmap v564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 764 KiB/s wr, 118 op/s 2024-07-26T08:35:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:48 smithi133 ceph-mon[37053]: pgmap v564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 764 KiB/s wr, 118 op/s 2024-07-26T08:35:49.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:49 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:35:49.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:49 smithi063 systemd[1]: Stopped Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:35:49.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:49 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 17.723s CPU time. 2024-07-26T08:35:49.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:49 smithi063 systemd[1]: Starting Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:35:49.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:49 smithi063 podman[71097]: 2024-07-26 08:35:49.710641433 +0000 UTC m=+0.017868801 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:35:49.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:49 smithi063 podman[71097]: 2024-07-26 08:35:49.824089797 +0000 UTC m=+0.131317142 container create b89d5ebe5a1085d6aaa6fdb9c7da8026417eb0190385e808fca4db034d9549ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-07-26T08:35:50.097 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:50 smithi063 podman[71097]: 2024-07-26 08:35:50.060430742 +0000 UTC m=+0.367658088 container init b89d5ebe5a1085d6aaa6fdb9c7da8026417eb0190385e808fca4db034d9549ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-26T08:35:50.098 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:50 smithi063 podman[71097]: 2024-07-26 08:35:50.063409479 +0000 UTC m=+0.370636836 container start b89d5ebe5a1085d6aaa6fdb9c7da8026417eb0190385e808fca4db034d9549ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:35:50.310 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:49 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:35:50.310 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:49 smithi043 systemd[1]: Stopped Ceph mds.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:35:50.310 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:49 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service: Consumed 45.895s CPU time. 2024-07-26T08:35:50.310 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:50 smithi043 systemd[1]: Starting Ceph mds.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mds[71116]: -- 172.21.15.63:0/2406321091 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb2e4ad860 con 0x55cb3264f600 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: starting mds.b at 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:50 smithi063 bash[71097]: b89d5ebe5a1085d6aaa6fdb9c7da8026417eb0190385e808fca4db034d9549ec 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:35:50 smithi063 systemd[1]: Started Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: pgmap v565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 752 KiB/s wr, 97 op/s 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: Replacing daemon mds.a as rank 0 with standby daemon mds.c 2024-07-26T08:35:50.425 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-07-26T08:35:50.426 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:35:50.426 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: osdmap e91: 12 total, 12 up, 12 in 2024-07-26T08:35:50.426 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:replay,1=b=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:35:50.426 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: daemon mds.b restarted 2024-07-26T08:35:50.426 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: osdmap e92: 12 total, 12 up, 12 in 2024-07-26T08:35:50.426 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:boot 2024-07-26T08:35:50.427 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:35:50.427 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:35:50.427 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:35:50.427 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:50 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:replay,1=g=up:replay,2=i=up:active} 1 up:standby-replay 7 up:standby 2024-07-26T08:35:50.607 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:50 smithi043 podman[101315]: 2024-07-26 08:35:50.286125041 +0000 UTC m=+0.033315598 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:35:50.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: pgmap v565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 752 KiB/s wr, 97 op/s 2024-07-26T08:35:50.607 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: Replacing daemon mds.a as rank 0 with standby daemon mds.c 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: osdmap e91: 12 total, 12 up, 12 in 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:replay,1=b=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: daemon mds.b restarted 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: osdmap e92: 12 total, 12 up, 12 in 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:boot 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:35:50.608 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:50 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:replay,1=g=up:replay,2=i=up:active} 1 up:standby-replay 7 up:standby 2024-07-26T08:35:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: pgmap v565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 752 KiB/s wr, 97 op/s 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: Replacing daemon mds.a as rank 0 with standby daemon mds.c 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: osdmap e91: 12 total, 12 up, 12 in 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:replay,1=b=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: daemon mds.b restarted 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: osdmap e92: 12 total, 12 up, 12 in 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:boot 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:35:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:35:50.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:35:50.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:50 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:replay,1=g=up:replay,2=i=up:active} 1 up:standby-replay 7 up:standby 2024-07-26T08:35:50.929 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:50 smithi043 podman[101315]: 2024-07-26 08:35:50.605851129 +0000 UTC m=+0.353041705 container create 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724) 2024-07-26T08:35:51.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:50 smithi043 podman[101315]: 2024-07-26 08:35:50.928024564 +0000 UTC m=+0.675215193 container init 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:35:51.234 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:50 smithi043 podman[101315]: 2024-07-26 08:35:50.938813094 +0000 UTC m=+0.686003673 container start 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:35:51.234 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:51 smithi043 bash[101315]: 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 2024-07-26T08:35:51.234 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:51 smithi043 systemd[1]: Started Ceph mds.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:35:51.234 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:51 smithi043 ceph-mds[101334]: -- 172.21.15.43:0/2344630290 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ac92d7860 con 0x555acd479a80 2024-07-26T08:35:51.234 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 08:35:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[101330]: starting mds.a at 2024-07-26T08:35:52.577 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:52 smithi043 ceph-mon[32384]: pgmap v568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-07-26T08:35:52.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T08:35:52.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:52 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:resolve 2024-07-26T08:35:52.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:52 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:resolve 2024-07-26T08:35:52.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:52 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6840/3085651024,v1:172.21.15.43:6841/3085651024] up:boot 2024-07-26T08:35:52.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:52 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:resolve,1=g=up:resolve,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:52 smithi133 ceph-mon[37053]: pgmap v568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-07-26T08:35:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T08:35:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:52 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:resolve 2024-07-26T08:35:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:52 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:resolve 2024-07-26T08:35:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:52 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6840/3085651024,v1:172.21.15.43:6841/3085651024] up:boot 2024-07-26T08:35:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:52 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:resolve,1=g=up:resolve,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:52 smithi063 ceph-mon[36747]: pgmap v568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-07-26T08:35:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T08:35:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:52 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:resolve 2024-07-26T08:35:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:52 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:resolve 2024-07-26T08:35:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:52 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6840/3085651024,v1:172.21.15.43:6841/3085651024] up:boot 2024-07-26T08:35:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:52 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:resolve,1=g=up:resolve,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:53.614 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199996 2024-07-26T08:35:53.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399995 2024-07-26T08:35:53.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:reconnect 2024-07-26T08:35:53.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:reconnect 2024-07-26T08:35:53.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:reconnect,1=g=up:reconnect,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:53.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0839984 2024-07-26T08:35:53.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:53 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0939988 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199996 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399995 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:reconnect 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:reconnect 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:reconnect,1=g=up:reconnect,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0839984 2024-07-26T08:35:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:53 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0939988 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199996 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399995 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:reconnect 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:reconnect 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:reconnect,1=g=up:reconnect,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0839984 2024-07-26T08:35:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:53 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0939988 2024-07-26T08:35:54.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: *** Caught signal (Aborted) ** 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: in thread 7f79da200640 thread_name:ms_dispatch 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f79e043e6f0] 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f79e048b94c] 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 3: raise() 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 4: abort() 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 5: /lib64/libc.so.6(+0x2871b) [0x7f79e042871b] 2024-07-26T08:35:54.622 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 6: /lib64/libc.so.6(+0x37386) [0x7f79e0437386] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5609c4d006b9] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5609c4ebe80c] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5609c4dfe2ca] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5609c4dce753] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5609c4dcfa1b] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5609c4db3752] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5609c4d01a56] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5609c4d05637] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5609c4d05f5e] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5609c4ce903a] 2024-07-26T08:35:54.623 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f79e0f9b407] 2024-07-26T08:35:54.624 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 18: (DispatchQueue::entry()+0x60f) [0x7f79e0f9bcf9] 2024-07-26T08:35:54.624 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f79e10785a1] 2024-07-26T08:35:54.624 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-mon[32384]: pgmap v569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-07-26T08:35:54.624 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:rejoin 2024-07-26T08:35:54.624 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:rejoin 2024-07-26T08:35:54.624 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:rejoin,1=g=up:rejoin,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:54.625 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-mon[32384]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:35:54.625 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 20: (Thread::entry_wrapper()+0x43) [0x7f79e0e25cdd] 2024-07-26T08:35:54.625 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 21: (Thread::_entry_func(void*)+0xd) [0x7f79e0e25cf9] 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 22: /lib64/libc.so.6(+0x89c02) [0x7f79e0489c02] 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f79e050ec40] 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.386+0000 7f79da200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: in thread 7f79da200640 thread_name:ms_dispatch 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f79e043e6f0] 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f79e048b94c] 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 3: raise() 2024-07-26T08:35:54.626 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 4: abort() 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 5: /lib64/libc.so.6(+0x2871b) [0x7f79e042871b] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 6: /lib64/libc.so.6(+0x37386) [0x7f79e0437386] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5609c4d006b9] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5609c4ebe80c] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5609c4dfe2ca] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5609c4dce753] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5609c4dcfa1b] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5609c4db3752] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5609c4d01a56] 2024-07-26T08:35:54.627 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5609c4d05637] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5609c4d05f5e] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5609c4ce903a] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f79e0f9b407] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 18: (DispatchQueue::entry()+0x60f) [0x7f79e0f9bcf9] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f79e10785a1] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 20: (Thread::entry_wrapper()+0x43) [0x7f79e0e25cdd] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 21: (Thread::_entry_func(void*)+0xd) [0x7f79e0e25cf9] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 22: /lib64/libc.so.6(+0x89c02) [0x7f79e0489c02] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f79e050ec40] 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:54.628 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 0> 2024-07-26T08:35:54.386+0000 7f79da200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: in thread 7f79da200640 thread_name:ms_dispatch 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f79e043e6f0] 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f79e048b94c] 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 3: raise() 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 4: abort() 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 5: /lib64/libc.so.6(+0x2871b) [0x7f79e042871b] 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 6: /lib64/libc.so.6(+0x37386) [0x7f79e0437386] 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5609c4d006b9] 2024-07-26T08:35:54.629 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5609c4ebe80c] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5609c4dfe2ca] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5609c4dce753] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5609c4dcfa1b] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5609c4db3752] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5609c4d01a56] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5609c4d05637] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5609c4d05f5e] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5609c4ce903a] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f79e0f9b407] 2024-07-26T08:35:54.630 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 18: (DispatchQueue::entry()+0x60f) [0x7f79e0f9bcf9] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f79e10785a1] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 20: (Thread::entry_wrapper()+0x43) [0x7f79e0e25cdd] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 21: (Thread::_entry_func(void*)+0xd) [0x7f79e0e25cf9] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 22: /lib64/libc.so.6(+0x89c02) [0x7f79e0489c02] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f79e050ec40] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 0> 2024-07-26T08:35:54.386+0000 7f79da200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: in thread 7f79da200640 thread_name:ms_dispatch 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f79e043e6f0] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f79e048b94c] 2024-07-26T08:35:54.631 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 3: raise() 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 4: abort() 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 5: /lib64/libc.so.6(+0x2871b) [0x7f79e042871b] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 6: /lib64/libc.so.6(+0x37386) [0x7f79e0437386] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5609c4d006b9] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5609c4ebe80c] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5609c4dfe2ca] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5609c4dce753] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5609c4dcfa1b] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5609c4db3752] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5609c4d01a56] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5609c4d05637] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5609c4d05f5e] 2024-07-26T08:35:54.632 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5609c4ce903a] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f79e0f9b407] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 18: (DispatchQueue::entry()+0x60f) [0x7f79e0f9bcf9] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f79e10785a1] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 20: (Thread::entry_wrapper()+0x43) [0x7f79e0e25cdd] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 21: (Thread::_entry_func(void*)+0xd) [0x7f79e0e25cf9] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 22: /lib64/libc.so.6(+0x89c02) [0x7f79e0489c02] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f79e050ec40] 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[78452]: 2024-07-26T08:35:54.633 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:54 smithi043 podman[101366]: 2024-07-26 08:35:54.619096485 +0000 UTC m=+0.068496802 container died b63d4833ceb2db4c8fead9ce87c81981149a4e4ef904658a5942fef4e8834ee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:35:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:54 smithi133 ceph-mon[37053]: pgmap v569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-07-26T08:35:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:54 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:rejoin 2024-07-26T08:35:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:54 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:rejoin 2024-07-26T08:35:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:54 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:rejoin,1=g=up:rejoin,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:54 smithi133 ceph-mon[37053]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:35:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:54 smithi063 ceph-mon[36747]: pgmap v569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-07-26T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:54 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:rejoin 2024-07-26T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:54 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:rejoin 2024-07-26T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:54 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:rejoin,1=g=up:rejoin,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:54 smithi063 ceph-mon[36747]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:clientreplay 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:active 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:clientreplay,1=g=up:active,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: daemon mds.c is now active in filesystem cephfs as rank 0 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:35:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:55.749 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:clientreplay 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:active 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:clientreplay,1=g=up:active,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: daemon mds.c is now active in filesystem cephfs as rank 0 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:35:55.750 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:clientreplay 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/2240411764,v1:172.21.15.43:6839/2240411764] up:active 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:clientreplay,1=g=up:active,2=i=up:active} 1 up:standby-replay 8 up:standby 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: daemon mds.c is now active in filesystem cephfs as rank 0 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:35:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:35:56.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:35:55.747+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-26T08:35:56.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:35:55.747+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:35:56.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:35:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:35:55.747+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-07-26T08:35:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:56 smithi043 ceph-mon[32384]: pgmap v570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.2 KiB/s wr, 23 op/s 2024-07-26T08:35:56.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:56 smithi043 podman[101366]: 2024-07-26 08:35:56.208362854 +0000 UTC m=+1.657763209 container remove b63d4833ceb2db4c8fead9ce87c81981149a4e4ef904658a5942fef4e8834ee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:35:56.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:35:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:56 smithi133 ceph-mon[37053]: pgmap v570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.2 KiB/s wr, 23 op/s 2024-07-26T08:35:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:56 smithi063 ceph-mon[36747]: pgmap v570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.2 KiB/s wr, 23 op/s 2024-07-26T08:35:56.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:35:56.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:35:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 5.490s CPU time. 2024-07-26T08:35:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:35:58 smithi043 ceph-mon[32384]: pgmap v571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 KiB/s wr, 32 op/s 2024-07-26T08:35:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:35:58 smithi133 ceph-mon[37053]: pgmap v571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 KiB/s wr, 32 op/s 2024-07-26T08:35:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:35:58 smithi063 ceph-mon[36747]: pgmap v571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 KiB/s wr, 32 op/s 2024-07-26T08:36:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:00 smithi043 ceph-mon[32384]: pgmap v572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 109 KiB/s wr, 64 op/s 2024-07-26T08:36:00.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:00 smithi133 ceph-mon[37053]: pgmap v572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 109 KiB/s wr, 64 op/s 2024-07-26T08:36:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:00 smithi063 ceph-mon[36747]: pgmap v572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 109 KiB/s wr, 64 op/s 2024-07-26T08:36:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:02 smithi043 ceph-mon[32384]: pgmap v573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 92 KiB/s wr, 66 op/s 2024-07-26T08:36:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:02 smithi133 ceph-mon[37053]: pgmap v573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 92 KiB/s wr, 66 op/s 2024-07-26T08:36:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:02 smithi063 ceph-mon[36747]: pgmap v573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 92 KiB/s wr, 66 op/s 2024-07-26T08:36:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:04 smithi043 ceph-mon[32384]: pgmap v574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 97 KiB/s wr, 61 op/s 2024-07-26T08:36:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:04 smithi133 ceph-mon[37053]: pgmap v574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 97 KiB/s wr, 61 op/s 2024-07-26T08:36:04.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:04 smithi063 ceph-mon[36747]: pgmap v574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 97 KiB/s wr, 61 op/s 2024-07-26T08:36:05.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:36:05.897 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:06.697 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:06 smithi043 ceph-mon[32384]: pgmap v575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 104 KiB/s wr, 60 op/s 2024-07-26T08:36:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:06 smithi133 ceph-mon[37053]: pgmap v575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 104 KiB/s wr, 60 op/s 2024-07-26T08:36:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:06 smithi063 ceph-mon[36747]: pgmap v575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 104 KiB/s wr, 60 op/s 2024-07-26T08:36:07.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:06 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:36:07.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:06 smithi043 systemd[1]: Stopped Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:07.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:06 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 5.490s CPU time. 2024-07-26T08:36:07.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:07 smithi043 systemd[1]: Starting Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:36:08.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:08 smithi043 ceph-mon[32384]: pgmap v576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 103 KiB/s wr, 53 op/s 2024-07-26T08:36:08.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 podman[101584]: 2024-07-26 08:36:08.145227092 +0000 UTC m=+0.279678086 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:36:08.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 podman[101584]: 2024-07-26 08:36:08.314562463 +0000 UTC m=+0.449013440 container create eda477700ae123b6a32afa758498b8e12d2c19ab85d6082d92fd96cf4299c730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2) 2024-07-26T08:36:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:08 smithi133 ceph-mon[37053]: pgmap v576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 103 KiB/s wr, 53 op/s 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 -- 172.21.15.43:0/1391414026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3414102000 msgr2=0x7f3414102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 --2- 172.21.15.43:0/1391414026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3414102000 0x7f3414102410 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3404009900 tx=0x7f340402a480 comp rx=0 tx=0).stop 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 -- 172.21.15.43:0/1391414026 shutdown_connections 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 --2- 172.21.15.43:0/1391414026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341410fbb0 0x7f3414111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 --2- 172.21.15.43:0/1391414026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 0x7f341410f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 --2- 172.21.15.43:0/1391414026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3414102000 0x7f3414102410 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 -- 172.21.15.43:0/1391414026 >> 172.21.15.43:0/1391414026 conn(0x7f3414079160 msgr2=0x7f3414079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 -- 172.21.15.43:0/1391414026 shutdown_connections 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.780+0000 7f3419c00640 1 -- 172.21.15.43:0/1391414026 wait complete. 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.782+0000 7f3419c00640 1 Processor -- start 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.782+0000 7f3419c00640 1 -- start start 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3419c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414102000 0x7f341419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3419c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 0x7f341419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3419c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f341410fbb0 0x7f34141a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3419c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34141157d0 con 0x7f341410fbb0 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3419c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3414115650 con 0x7f3414102950 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3419c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3414115950 con 0x7f3414102000 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3413400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f341410fbb0 0x7f34141a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3412a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414102000 0x7f341419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3413400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f341410fbb0 0x7f34141a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43894/0 (socket says 172.21.15.43:43894) 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f3413400640 1 -- 172.21.15.43:0/1908654289 learned_addr learned my addr 172.21.15.43:0/1908654289 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.783+0000 7f340be00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 0x7f341419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f3412a00640 1 -- 172.21.15.43:0/1908654289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 msgr2=0x7f341419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f3412a00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 0x7f341419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f3412a00640 1 -- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f341410fbb0 msgr2=0x7f34141a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f3412a00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f341410fbb0 0x7f34141a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f3412a00640 1 -- 172.21.15.43:0/1908654289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34141a20b0 con 0x7f3414102000 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f340be00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 0x7f341419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:36:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.784+0000 7f3412a00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414102000 0x7f341419c140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f340402aa70 tx=0x7f3404003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.785+0000 7f340b400640 1 -- 172.21.15.43:0/1908654289 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340403f070 con 0x7f3414102000 2024-07-26T08:36:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.785+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34141a2340 con 0x7f3414102000 2024-07-26T08:36:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.785+0000 7f340b400640 1 -- 172.21.15.43:0/1908654289 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3404031be0 con 0x7f3414102000 2024-07-26T08:36:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.785+0000 7f340b400640 1 -- 172.21.15.43:0/1908654289 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404035030 con 0x7f3414102000 2024-07-26T08:36:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.785+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34141a8b00 con 0x7f3414102000 2024-07-26T08:36:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.788+0000 7f342088d740 1 Processor -- start 2024-07-26T08:36:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.788+0000 7f342088d740 1 -- start start 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f342088d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f342088d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f342088d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f342088d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5587ac046bc0 con 0x5587abd2b070 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f342088d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5587ac0360c0 con 0x5587abd021b0 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f342088d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5587ac03a100 con 0x5587abd0a390 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f340b400640 1 -- 172.21.15.43:0/1908654289 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3404042070 con 0x7f3414102000 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f3413400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f3413400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43902/0 (socket says 172.21.15.43:43902) 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f340be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.789+0000 7f3413400640 1 -- 172.21.15.43:0/1116064367 learned_addr learned my addr 172.21.15.43:0/1116064367 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.790+0000 7f3412a00640 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.790+0000 7f3413400640 1 -- 172.21.15.43:0/1116064367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 msgr2=0x5587ac0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.790+0000 7f3413400640 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.790+0000 7f3413400640 1 -- 172.21.15.43:0/1116064367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 msgr2=0x5587ac0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.790+0000 7f3413400640 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.790+0000 7f3413400640 1 -- 172.21.15.43:0/1116064367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587abd96650 con 0x5587abd2b070 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.791+0000 7f3413400640 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0cfe20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f340c011570 tx=0x7f340c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6728c94bb0f16c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.791+0000 7f3403e00640 1 -- 172.21.15.43:0/1116064367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c004b20 con 0x5587abd2b070 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.791+0000 7f3403e00640 1 -- 172.21.15.43:0/1116064367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f340c004cc0 con 0x5587abd2b070 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.791+0000 7f3403e00640 1 -- 172.21.15.43:0/1116064367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c0054e0 con 0x5587abd2b070 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f340b400640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33f80b3d40 0x7f33f80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f340b400640 1 -- 172.21.15.43:0/1908654289 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9624+0+0 (secure 0 0 0) 0x7f3404104700 con 0x7f3414102000 2024-07-26T08:36:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f3412a00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33f80b3d40 0x7f33f80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 -- 172.21.15.43:0/1116064367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 msgr2=0x5587ac0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0cfe20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f340c011570 tx=0x7f340c011a30 comp rx=0 tx=0).stop 2024-07-26T08:36:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 -- 172.21.15.43:0/1116064367 shutdown_connections 2024-07-26T08:36:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 --2- 172.21.15.43:0/1116064367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0cfe20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.792+0000 7f342088d740 1 -- 172.21.15.43:0/1116064367 >> 172.21.15.43:0/1116064367 conn(0x5587abd1f460 msgr2=0x5587ac0cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.793+0000 7f3412a00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33f80b3d40 0x7f33f80b6250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5587ac0ceaa0 tx=0x7f3404005d50 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.793+0000 7f342088d740 1 -- 172.21.15.43:0/1116064367 shutdown_connections 2024-07-26T08:36:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.793+0000 7f342088d740 1 -- 172.21.15.43:0/1116064367 wait complete. 2024-07-26T08:36:08.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.794+0000 7f342088d740 1 -- start start 2024-07-26T08:36:08.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.794+0000 7f342088d740 1 Processor -- start 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0db300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0db840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5587abe99700 con 0x5587abd2b070 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5587abfd2690 con 0x5587abd021b0 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5587ac0de600 con 0x5587abd0a390 2024-07-26T08:36:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f342088d740 10 client.0 _ll_register_callbacks cb 0x5587abfe2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f3413400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0db300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f3413400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0db300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:51040/0 (socket says 172.21.15.43:51040) 2024-07-26T08:36:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f3413400640 1 -- 172.21.15.43:0/131807371 learned_addr learned my addr 172.21.15.43:0/131807371 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f3413400640 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.795+0000 7f340be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0db840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f340be00640 1 -- 172.21.15.43:0/131807371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 msgr2=0x5587ac0db300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f340be00640 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0db300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f340be00640 1 -- 172.21.15.43:0/131807371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 msgr2=0x5587ac0dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f340be00640 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0dbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.796+0000 7f340be00640 1 -- 172.21.15.43:0/131807371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587abfe9830 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.797+0000 7f340be00640 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0db840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0126d0 tx=0x7f33fc012ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca683915d77d860 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.797+0000 7f3400c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.797+0000 7f3400c00640 1 -- 172.21.15.43:0/131807371 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004020 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.797+0000 7f3400c00640 1 -- 172.21.15.43:0/131807371 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9624+0+0 (secure 0 0 0) 0x7f33fc0041c0 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.797+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f340c004cc0 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.797+0000 7f3400c00640 1 -- 172.21.15.43:0/131807371 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f33fc025050 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 10 client.25795 fetch_fsmap learned FSMap version 37 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5587ac0ea1e0 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f3400c00640 1 -- 172.21.15.43:0/131807371 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f340c004cc0 con 0x5587abd0a390 2024-07-26T08:36:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f3400c00640 1 -- 172.21.15.43:0/131807371 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f33fc003ac0 con 0x5587abd0a390 2024-07-26T08:36:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 10 client.25795 fetch_fsmap finished waiting for FSMap version 37 2024-07-26T08:36:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 10 client.25795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 20 client.25795 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abce99f0 0x5587ac0ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 4 client.25795 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:36:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.798+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587ac048b10 con 0x5587abce99f0 2024-07-26T08:36:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.799+0000 7f3413400640 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abce99f0 0x5587ac0ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.799+0000 7f3413400640 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abce99f0 0x5587ac0ed7b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8d23e4bc2aa54dd server_cookie=36802a0fd69313d4 in_seq=0 out_seq=0 2024-07-26T08:36:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.799+0000 7f3400c00640 10 client.25795 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.800+0000 7f3400c00640 1 -- 172.21.15.43:0/131807371 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587ac048b10 con 0x5587abce99f0 2024-07-26T08:36:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.800+0000 7f3400c00640 10 client.25795 handle_command_reply: tid=0 2024-07-26T08:36:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.800+0000 7f342088d740 1 client.25795 shutdown 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 msgr2=0x5587ac0db840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0db840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0126d0 tx=0x7f33fc012ad0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 shutdown_connections 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abce99f0 0x5587ac0ed7b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0db840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 --2- 172.21.15.43:0/131807371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0db300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f3400c00640 0 client.25795 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 >> 172.21.15.43:0/131807371 conn(0x5587abd1f460 msgr2=0x5587ac0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 shutdown_connections 2024-07-26T08:36:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.801+0000 7f342088d740 1 -- 172.21.15.43:0/131807371 wait complete. 2024-07-26T08:36:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.802+0000 7f342088d740 20 client.25795 trim_cache size 0 max 16384 2024-07-26T08:36:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:08 smithi063 ceph-mon[36747]: pgmap v576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 103 KiB/s wr, 53 op/s 2024-07-26T08:36:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.833+0000 7f342088d740 1 Processor -- start 2024-07-26T08:36:08.835 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 podman[101584]: 2024-07-26 08:36:08.69516691 +0000 UTC m=+0.829617890 container init eda477700ae123b6a32afa758498b8e12d2c19ab85d6082d92fd96cf4299c730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:36:08.835 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 podman[101584]: 2024-07-26 08:36:08.705293974 +0000 UTC m=+0.839744957 container start eda477700ae123b6a32afa758498b8e12d2c19ab85d6082d92fd96cf4299c730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.build-date=20240724, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.833+0000 7f342088d740 1 -- start start 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f342088d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd021b0 0x5587ac0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f342088d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 0x5587ac0dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f342088d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f342088d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34141b5630 con 0x5587abd2b070 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f342088d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34141b2ea0 con 0x5587abd0a390 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f342088d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f34141b0cf0 con 0x5587abd021b0 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f340be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 0x5587ac0dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f3413400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd021b0 0x5587ac0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f340be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 0x5587ac0dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:51056/0 (socket says 172.21.15.43:51056) 2024-07-26T08:36:08.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f340be00640 1 -- 172.21.15.43:0/1549683145 learned_addr learned my addr 172.21.15.43:0/1549683145 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:08.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.834+0000 7f3413400640 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f340be00640 1 -- 172.21.15.43:0/1549683145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd021b0 msgr2=0x5587ac0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f340be00640 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd021b0 0x5587ac0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f340be00640 1 -- 172.21.15.43:0/1549683145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 msgr2=0x5587ac0e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f340be00640 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f340be00640 1 -- 172.21.15.43:0/1549683145 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ac0dc5c0 con 0x5587abd0a390 2024-07-26T08:36:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f340be00640 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 0x5587ac0dd1e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009740 tx=0x7f33fc011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e6da365064e9d1e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.835+0000 7f3403400640 1 -- 172.21.15.43:0/1549683145 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc02f070 con 0x5587abd0a390 2024-07-26T08:36:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.836+0000 7f3403400640 1 -- 172.21.15.43:0/1549683145 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f33fc01c6c0 con 0x5587abd0a390 2024-07-26T08:36:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.836+0000 7f3403400640 1 -- 172.21.15.43:0/1549683145 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0119e0 con 0x5587abd0a390 2024-07-26T08:36:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 -- 172.21.15.43:0/1549683145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 msgr2=0x5587ac0dd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 0x5587ac0dd1e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009740 tx=0x7f33fc011440 comp rx=0 tx=0).stop 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 -- 172.21.15.43:0/1549683145 shutdown_connections 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd0a390 0x5587ac0dd1e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 --2- 172.21.15.43:0/1549683145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd021b0 0x5587ac0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 -- 172.21.15.43:0/1549683145 >> 172.21.15.43:0/1549683145 conn(0x5587abd1f460 msgr2=0x5587ac0db270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 -- 172.21.15.43:0/1549683145 shutdown_connections 2024-07-26T08:36:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.837+0000 7f342088d740 1 -- 172.21.15.43:0/1549683145 wait complete. 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.838+0000 7f342088d740 1 -- start start 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.838+0000 7f342088d740 1 Processor -- start 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.838+0000 7f342088d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0df910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.838+0000 7f342088d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f342088d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f342088d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34141b1360 con 0x5587abd2b070 2024-07-26T08:36:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f342088d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34141b27d0 con 0x5587abd021b0 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f342088d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f34141b1a30 con 0x5587abd0a390 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f342088d740 10 client.0 _ll_register_callbacks cb 0x5587abfe2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0dfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57318/0 (socket says 172.21.15.43:57318) 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 -- 172.21.15.43:0/3268221378 learned_addr learned my addr 172.21.15.43:0/3268221378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f3413400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f3413400640 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 -- 172.21.15.43:0/3268221378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 msgr2=0x5587ac0df910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0df910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 -- 172.21.15.43:0/3268221378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 msgr2=0x5587ac0e0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.839+0000 7f340be00640 1 -- 172.21.15.43:0/3268221378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587ac1550d0 con 0x5587abd0a390 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f340be00640 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0dfe50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33fc003f10 tx=0x7f33fc0041f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95afbe6033743fc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f3400c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f3400c00640 1 -- 172.21.15.43:0/3268221378 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc038060 con 0x5587abd0a390 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33fc01c6c0 con 0x5587abd0a390 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f3400c00640 1 -- 172.21.15.43:0/3268221378 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9624+0+0 (secure 0 0 0) 0x7f33fc01c9e0 con 0x5587abd0a390 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f3400c00640 1 -- 172.21.15.43:0/3268221378 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f33fc03f050 con 0x5587abd0a390 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f342088d740 10 client.25804 fetch_fsmap learned FSMap version 37 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.840+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5587ac156340 con 0x5587abd0a390 2024-07-26T08:36:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f3400c00640 1 -- 172.21.15.43:0/3268221378 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f33fc01c6c0 con 0x5587abd0a390 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f3400c00640 1 -- 172.21.15.43:0/3268221378 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f33fc032030 con 0x5587abd0a390 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f342088d740 10 client.25804 fetch_fsmap finished waiting for FSMap version 37 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f342088d740 10 client.25804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f342088d740 20 client.25804 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f342088d740 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abcbeda0 0x5587ac1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f342088d740 4 client.25804 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:36:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.841+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587ac0445b0 con 0x5587abcbeda0 2024-07-26T08:36:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.842+0000 7f3413400640 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abcbeda0 0x5587ac1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.842+0000 7f3413400640 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abcbeda0 0x5587ac1589a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64486e660d6f890 server_cookie=6a3c68c79f161562 in_seq=0 out_seq=0 2024-07-26T08:36:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.842+0000 7f3400c00640 10 client.25804 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.842+0000 7f3400c00640 1 -- 172.21.15.43:0/3268221378 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5587ac0445b0 con 0x5587abcbeda0 2024-07-26T08:36:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.842+0000 7f3400c00640 10 client.25804 handle_command_reply: tid=0 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.842+0000 7f342088d740 1 client.25804 shutdown 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 msgr2=0x5587ac0dfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0dfe50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33fc003f10 tx=0x7f33fc0041f0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 shutdown_connections 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5587abcbeda0 0x5587ac1589a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5587abd0a390 0x5587ac0dfe50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587abd2b070 0x5587ac0e0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 --2- 172.21.15.43:0/3268221378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5587abd021b0 0x5587ac0df910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 >> 172.21.15.43:0/3268221378 conn(0x5587abd1f460 msgr2=0x5587ac0dcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f3400c00640 0 client.25804 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 shutdown_connections 2024-07-26T08:36:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.843+0000 7f342088d740 1 -- 172.21.15.43:0/3268221378 wait complete. 2024-07-26T08:36:08.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f342088d740 20 client.25804 trim_cache size 0 max 16384 2024-07-26T08:36:08.847 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:36:08.847 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "no active scrubs running", 2024-07-26T08:36:08.847 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": {} 2024-07-26T08:36:08.847 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33f80b3d40 msgr2=0x7f33f80b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33f80b3d40 0x7f33f80b6250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5587ac0ceaa0 tx=0x7f3404005d50 comp rx=0 tx=0).stop 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414102000 msgr2=0x7f341419c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414102000 0x7f341419c140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f340402aa70 tx=0x7f3404003b90 comp rx=0 tx=0).stop 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 shutdown_connections 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f33f80b3d40 0x7f33f80b6250 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f341410fbb0 0x7f34141a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3414102950 0x7f341419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 --2- 172.21.15.43:0/1908654289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414102000 0x7f341419c140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.844+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 >> 172.21.15.43:0/1908654289 conn(0x7f3414079160 msgr2=0x7f34141096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:08.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.845+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 shutdown_connections 2024-07-26T08:36:08.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:08.845+0000 7f3419c00640 1 -- 172.21.15.43:0/1908654289 wait complete. 2024-07-26T08:36:09.233 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 ceph-mds[101611]: -- 172.21.15.43:0/2570106757 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645d43cb860 con 0x5645d856d180 2024-07-26T08:36:09.233 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: starting mds.g at 2024-07-26T08:36:09.233 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 bash[101584]: eda477700ae123b6a32afa758498b8e12d2c19ab85d6082d92fd96cf4299c730 2024-07-26T08:36:09.233 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:36:08 smithi043 systemd[1]: Started Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: daemon mds.g restarted 2024-07-26T08:36:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: osdmap e93: 12 total, 12 up, 12 in 2024-07-26T08:36:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:boot 2024-07-26T08:36:09.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:36:09.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:09.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:36:09.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:09 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:09.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: daemon mds.g restarted 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: osdmap e93: 12 total, 12 up, 12 in 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:boot 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:36:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:09 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: daemon mds.g restarted 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: osdmap e93: 12 total, 12 up, 12 in 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:boot 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:36:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:09 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:09.892 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-26T08:36:09.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T08:36:10.412 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:10 smithi043 ceph-mon[32384]: pgmap v578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 25 KiB/s wr, 22 op/s 2024-07-26T08:36:10.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:10 smithi133 ceph-mon[37053]: pgmap v578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 25 KiB/s wr, 22 op/s 2024-07-26T08:36:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:10 smithi063 ceph-mon[36747]: pgmap v578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 25 KiB/s wr, 22 op/s 2024-07-26T08:36:11.668 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:11 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:resolve 2024-07-26T08:36:11.668 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:11 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:11.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:11 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:resolve 2024-07-26T08:36:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:11 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:11.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:11 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:resolve 2024-07-26T08:36:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:11 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:12.629 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:12 smithi043 ceph-mon[32384]: pgmap v579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-07-26T08:36:12.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:reconnect 2024-07-26T08:36:12.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:12 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:12.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:12 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00799992 2024-07-26T08:36:12.630 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:12 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:12.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:12 smithi133 ceph-mon[37053]: pgmap v579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-07-26T08:36:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:reconnect 2024-07-26T08:36:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:12 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:12 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00799992 2024-07-26T08:36:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:12 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:12 smithi063 ceph-mon[36747]: pgmap v579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-07-26T08:36:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:reconnect 2024-07-26T08:36:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:12 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:12 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00799992 2024-07-26T08:36:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:12 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:13.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 -- 172.21.15.43:0/1379357095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410b880 msgr2=0x7fbf741120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:13.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 --2- 172.21.15.43:0/1379357095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410b880 0x7fbf741120b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009900 tx=0x7fbf6c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 -- 172.21.15.43:0/1379357095 shutdown_connections 2024-07-26T08:36:13.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 --2- 172.21.15.43:0/1379357095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410b880 0x7fbf741120b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 --2- 172.21.15.43:0/1379357095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410af30 0x7fbf7410b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 --2- 172.21.15.43:0/1379357095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 0x7fbf74105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 -- 172.21.15.43:0/1379357095 >> 172.21.15.43:0/1379357095 conn(0x7fbf74101060 msgr2=0x7fbf741034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:13.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 -- 172.21.15.43:0/1379357095 shutdown_connections 2024-07-26T08:36:13.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.274+0000 7fbf79400640 1 -- 172.21.15.43:0/1379357095 wait complete. 2024-07-26T08:36:13.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.276+0000 7fbf79400640 1 Processor -- start 2024-07-26T08:36:13.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.276+0000 7fbf79400640 1 -- start start 2024-07-26T08:36:13.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf79400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 0x7fbf7419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:13.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf79400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 0x7fbf7419c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:13.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf79400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410b880 0x7fbf741a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf79400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf741156d0 con 0x7fbf7410af30 2024-07-26T08:36:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf79400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74115550 con 0x7fbf7410b880 2024-07-26T08:36:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf79400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74115850 con 0x7fbf741055f0 2024-07-26T08:36:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf73400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 0x7fbf7419c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf73400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 0x7fbf7419c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43982/0 (socket says 172.21.15.43:43982) 2024-07-26T08:36:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf78a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410b880 0x7fbf741a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf73400640 1 -- 172.21.15.43:0/1360273774 learned_addr learned my addr 172.21.15.43:0/1360273774 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.277+0000 7fbf73e00640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 0x7fbf7419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73400640 1 -- 172.21.15.43:0/1360273774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 msgr2=0x7fbf7419bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 0x7fbf7419bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73400640 1 -- 172.21.15.43:0/1360273774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410b880 msgr2=0x7fbf741a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410b880 0x7fbf741a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73400640 1 -- 172.21.15.43:0/1360273774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf741a1f30 con 0x7fbf7410af30 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73e00640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 0x7fbf7419bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf78a00640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410b880 0x7fbf741a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.278+0000 7fbf73400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 0x7fbf7419c560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00e9f0 tx=0x7fbf5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.279+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00ccc0 con 0x7fbf7410af30 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.279+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741a2220 con 0x7fbf7410af30 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.279+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf5c010900 con 0x7fbf7410af30 2024-07-26T08:36:13.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.279+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c018900 con 0x7fbf7410af30 2024-07-26T08:36:13.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.279+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a8980 con 0x7fbf7410af30 2024-07-26T08:36:13.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.280+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74105a00 con 0x7fbf7410af30 2024-07-26T08:36:13.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.283+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbf5c010ab0 con 0x7fbf7410af30 2024-07-26T08:36:13.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.284+0000 7fbf70c00640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbf580b3dc0 0x7fbf580b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:13.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.284+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7fbf5c0e4e40 con 0x7fbf7410af30 2024-07-26T08:36:13.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.285+0000 7fbf73e00640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbf580b3dc0 0x7fbf580b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:13.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.285+0000 7fbf73e00640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbf580b3dc0 0x7fbf580b62d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf64005fd0 tx=0x7fbf64009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:13.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.287+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbf5c026070 con 0x7fbf7410af30 2024-07-26T08:36:13.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:13 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:rejoin 2024-07-26T08:36:13.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:13 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:13.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:13 smithi043 ceph-mon[32384]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:36:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.535+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf7419d0f0 con 0x7fbf7410af30 2024-07-26T08:36:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.537+0000 7fbf70c00640 1 -- 172.21.15.43:0/1360273774 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11904 (secure 0 0 0) 0x7fbf7419d0f0 con 0x7fbf7410af30 2024-07-26T08:36:13.540 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T08:36:13.540 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":44,"btime":"2024-07-26T08:36:13:466428+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3989413214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3989413214},{"type":"v1","addr":"172.21.15.43:6835","nonce":3989413214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":15642,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/1379895152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1379895152},{"type":"v1","addr":"172.21.15.43:6839","nonce":1379895152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/10975952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":10975952},{"type":"v1","addr":"172.21.15.63:6833","nonce":10975952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/737804035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":737804035},{"type":"v1","addr":"172.21.15.43:6837","nonce":737804035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24640,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1827419050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1827419050},{"type":"v1","addr":"172.21.15.133:6833","nonce":1827419050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/302781783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":302781783},{"type":"v1","addr":"172.21.15.63:6835","nonce":302781783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:36:13.466368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24697,"mds_1":25751,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6837/185000899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":185000899},{"type":"v1","addr":"172.21.15.63:6837","nonce":185000899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":139,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":32,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25751":{"gid":25751,"name":"b","rank":1,"incarnation":39,"state":"up:active","state_seq":9,"addr":"172.21.15.63:6839/1532671211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":1532671211},{"type":"v1","addr":"172.21.15.63:6839","nonce":1532671211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25757":{"gid":25757,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/3085651024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3085651024},{"type":"v1","addr":"172.21.15.43:6841","nonce":3085651024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24697,"qdb_cluster":[25751,24709,24697]},"id":1}]} 2024-07-26T08:36:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 44 2024-07-26T08:36:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.539+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbf580b3dc0 msgr2=0x7fbf580b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.539+0000 7fbf79400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbf580b3dc0 0x7fbf580b62d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf64005fd0 tx=0x7fbf64009500 comp rx=0 tx=0).stop 2024-07-26T08:36:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.539+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 msgr2=0x7fbf7419c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.539+0000 7fbf79400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 0x7fbf7419c560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00e9f0 tx=0x7fbf5c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 shutdown_connections 2024-07-26T08:36:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbf580b3dc0 0x7fbf580b62d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf7410b880 0x7fbf741a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf7410af30 0x7fbf7419c560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 --2- 172.21.15.43:0/1360273774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf741055f0 0x7fbf7419bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 >> 172.21.15.43:0/1360273774 conn(0x7fbf74101060 msgr2=0x7fbf7410a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 shutdown_connections 2024-07-26T08:36:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:13.540+0000 7fbf79400640 1 -- 172.21.15.43:0/1360273774 wait complete. 2024-07-26T08:36:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:13 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:rejoin 2024-07-26T08:36:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:13 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:13 smithi133 ceph-mon[37053]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:36:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:rejoin 2024-07-26T08:36:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-mon[36747]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:36:13.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: *** Caught signal (Aborted) ** 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: in thread 7fd20ebd0640 thread_name:ms_dispatch 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd213fa76f0] 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd213ff494c] 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 3: raise() 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 4: abort() 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd213f9171b] 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 6: /lib64/libc.so.6(+0x37386) [0x7fd213fa0386] 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cb2d4316b9] 2024-07-26T08:36:13.819 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cb2d5ef80c] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cb2d52f2ca] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cb2d4ff753] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cb2d500a1b] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cb2d4e4752] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cb2d432a56] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cb2d436637] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cb2d436f5e] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cb2d41a03a] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd214874407] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 18: (DispatchQueue::entry()+0x60f) [0x7fd214874cf9] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2149515a1] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2146fecdd] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2146fecf9] 2024-07-26T08:36:13.820 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd213ff2c02] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd214077c40] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.467+0000 7fd20ebd0640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: in thread 7fd20ebd0640 thread_name:ms_dispatch 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd213fa76f0] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd213ff494c] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 3: raise() 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 4: abort() 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd213f9171b] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 6: /lib64/libc.so.6(+0x37386) [0x7fd213fa0386] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cb2d4316b9] 2024-07-26T08:36:13.821 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cb2d5ef80c] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cb2d52f2ca] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cb2d4ff753] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cb2d500a1b] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cb2d4e4752] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cb2d432a56] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cb2d436637] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cb2d436f5e] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cb2d41a03a] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd214874407] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 18: (DispatchQueue::entry()+0x60f) [0x7fd214874cf9] 2024-07-26T08:36:13.822 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2149515a1] 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2146fecdd] 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2146fecf9] 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd213ff2c02] 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd214077c40] 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 0> 2024-07-26T08:36:13.467+0000 7fd20ebd0640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:13.823 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: in thread 7fd20ebd0640 thread_name:ms_dispatch 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd213fa76f0] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd213ff494c] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 3: raise() 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 4: abort() 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd213f9171b] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 6: /lib64/libc.so.6(+0x37386) [0x7fd213fa0386] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cb2d4316b9] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cb2d5ef80c] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cb2d52f2ca] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cb2d4ff753] 2024-07-26T08:36:13.824 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cb2d500a1b] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cb2d4e4752] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cb2d432a56] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cb2d436637] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cb2d436f5e] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cb2d41a03a] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd214874407] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 18: (DispatchQueue::entry()+0x60f) [0x7fd214874cf9] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2149515a1] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2146fecdd] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2146fecf9] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd213ff2c02] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd214077c40] 2024-07-26T08:36:13.825 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 0> 2024-07-26T08:36:13.467+0000 7fd20ebd0640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: in thread 7fd20ebd0640 thread_name:ms_dispatch 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd213fa76f0] 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd213ff494c] 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 3: raise() 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 4: abort() 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd213f9171b] 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 6: /lib64/libc.so.6(+0x37386) [0x7fd213fa0386] 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cb2d4316b9] 2024-07-26T08:36:13.826 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cb2d5ef80c] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cb2d52f2ca] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cb2d4ff753] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cb2d500a1b] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cb2d4e4752] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cb2d432a56] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cb2d436637] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cb2d436f5e] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cb2d41a03a] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd214874407] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 18: (DispatchQueue::entry()+0x60f) [0x7fd214874cf9] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2149515a1] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2146fecdd] 2024-07-26T08:36:13.827 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2146fecf9] 2024-07-26T08:36:13.828 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd213ff2c02] 2024-07-26T08:36:13.828 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd214077c40] 2024-07-26T08:36:13.828 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:13.828 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71112]: 2024-07-26T08:36:13.828 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:13 smithi063 podman[71175]: 2024-07-26 08:36:13.531856772 +0000 UTC m=+0.021415869 container died b89d5ebe5a1085d6aaa6fdb9c7da8026417eb0190385e808fca4db034d9549ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-26T08:36:14.404 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:14 smithi063 podman[71175]: 2024-07-26 08:36:14.149466212 +0000 UTC m=+0.639025297 container remove b89d5ebe5a1085d6aaa6fdb9c7da8026417eb0190385e808fca4db034d9549ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-07-26T08:36:14.405 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:14 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:36:14.584 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-26T08:36:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: pgmap v580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2024-07-26T08:36:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:36:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:active 2024-07-26T08:36:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:14.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:14 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1360273774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: pgmap v580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:active 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:14 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1360273774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:36:14.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:14 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T08:36:14.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:14 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 1.959s CPU time. 2024-07-26T08:36:14.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: pgmap v580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2024-07-26T08:36:14.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:14.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:36:14.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/1532671211,v1:172.21.15.63:6839/1532671211] up:active 2024-07-26T08:36:14.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:14.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:14.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:14 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1360273774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T08:36:15.109 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:15 smithi043 ceph-mon[32384]: pgmap v581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 614 B/s wr, 8 op/s 2024-07-26T08:36:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:15 smithi133 ceph-mon[37053]: pgmap v581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 614 B/s wr, 8 op/s 2024-07-26T08:36:16.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:15 smithi063 ceph-mon[36747]: pgmap v581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 614 B/s wr, 8 op/s 2024-07-26T08:36:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 -- 172.21.15.43:0/1020804058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 msgr2=0x7f8b9010fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 --2- 172.21.15.43:0/1020804058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b9010fe80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009ca0 tx=0x7f8b8802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 -- 172.21.15.43:0/1020804058 shutdown_connections 2024-07-26T08:36:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 --2- 172.21.15.43:0/1020804058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b9010fe80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 --2- 172.21.15.43:0/1020804058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b90108d00 0x7f8b90109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 --2- 172.21.15.43:0/1020804058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b901033c0 0x7f8b901037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 -- 172.21.15.43:0/1020804058 >> 172.21.15.43:0/1020804058 conn(0x7f8b900fee10 msgr2=0x7f8b90101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.675+0000 7f8b96800640 1 -- 172.21.15.43:0/1020804058 shutdown_connections 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.676+0000 7f8b96800640 1 -- 172.21.15.43:0/1020804058 wait complete. 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 Processor -- start 2024-07-26T08:36:17.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 -- start start 2024-07-26T08:36:17.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b901033c0 0x7f8b90075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b90108d00 0x7f8b90075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b90075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901134a0 con 0x7f8b901033c0 2024-07-26T08:36:17.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b90113320 con 0x7f8b90109650 2024-07-26T08:36:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.677+0000 7f8b96800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8b90113620 con 0x7f8b90108d00 2024-07-26T08:36:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b901033c0 0x7f8b90075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b90108d00 0x7f8b90075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b90108d00 0x7f8b90075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41406/0 (socket says 172.21.15.43:41406) 2024-07-26T08:36:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b94a00640 1 -- 172.21.15.43:0/1212496922 learned_addr learned my addr 172.21.15.43:0/1212496922 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95e00640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b90075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95400640 1 -- 172.21.15.43:0/1212496922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b90108d00 msgr2=0x7f8b90075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95400640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b90108d00 0x7f8b90075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95400640 1 -- 172.21.15.43:0/1212496922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 msgr2=0x7f8b90075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95400640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b90075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95400640 1 -- 172.21.15.43:0/1212496922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b901a8090 con 0x7f8b901033c0 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.678+0000 7f8b95e00640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b90075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.679+0000 7f8b95400640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b901033c0 0x7f8b90075140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400e9f0 tx=0x7f8b8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.679+0000 7f8b8e000640 1 -- 172.21.15.43:0/1212496922 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400ccc0 con 0x7f8b901033c0 2024-07-26T08:36:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.679+0000 7f8b8e000640 1 -- 172.21.15.43:0/1212496922 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b84005020 con 0x7f8b901033c0 2024-07-26T08:36:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.679+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b901a8380 con 0x7f8b901033c0 2024-07-26T08:36:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.679+0000 7f8b8e000640 1 -- 172.21.15.43:0/1212496922 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b840049c0 con 0x7f8b901033c0 2024-07-26T08:36:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.679+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b901a88c0 con 0x7f8b901033c0 2024-07-26T08:36:17.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.684+0000 7f8b9ec35740 1 Processor -- start 2024-07-26T08:36:17.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.684+0000 7f8b9ec35740 1 -- start start 2024-07-26T08:36:17.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca4a5070 0x5596ca84a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca47c1b0 0x5596ca84a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 0x5596ca84aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596ca7c0bf0 con 0x5596ca4a5070 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5596ca7b00f0 con 0x5596ca47c1b0 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5596ca7b4130 con 0x5596ca484390 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca4a5070 0x5596ca84a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 0x5596ca84aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b8e000640 1 -- 172.21.15.43:0/1212496922 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8b840051d0 con 0x7f8b901033c0 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 0x5596ca84aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41416/0 (socket says 172.21.15.43:41416) 2024-07-26T08:36:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.685+0000 7f8b94a00640 1 -- 172.21.15.43:0/3439705769 learned_addr learned my addr 172.21.15.43:0/3439705769 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b95400640 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca47c1b0 0x5596ca84a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b94a00640 1 -- 172.21.15.43:0/3439705769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca47c1b0 msgr2=0x5596ca84a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b94a00640 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca47c1b0 0x5596ca84a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b94a00640 1 -- 172.21.15.43:0/3439705769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca4a5070 msgr2=0x5596ca84a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b94a00640 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca4a5070 0x5596ca84a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b94a00640 1 -- 172.21.15.43:0/3439705769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ca510650 con 0x5596ca484390 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b95400640 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca47c1b0 0x5596ca84a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.686+0000 7f8b94a00640 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 0x5596ca84aab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009d00 tx=0x7f8b7c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c39a53468356658 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.687+0000 7f8b82600640 1 -- 172.21.15.43:0/3439705769 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01e070 con 0x5596ca484390 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.687+0000 7f8b82600640 1 -- 172.21.15.43:0/3439705769 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b7c019b00 con 0x5596ca484390 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.687+0000 7f8b82600640 1 -- 172.21.15.43:0/3439705769 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00ea00 con 0x5596ca484390 2024-07-26T08:36:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.687+0000 7f8b8e000640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8b780b3dc0 0x7f8b780b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.687+0000 7f8b8e000640 1 -- 172.21.15.43:0/1212496922 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7f8b840e4470 con 0x7f8b901033c0 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b95e00640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8b780b3dc0 0x7f8b780b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3439705769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 msgr2=0x5596ca84aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 0x5596ca84aab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009d00 tx=0x7f8b7c011810 comp rx=0 tx=0).stop 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3439705769 shutdown_connections 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca484390 0x5596ca84aab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca47c1b0 0x5596ca84a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3439705769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca4a5070 0x5596ca84a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3439705769 >> 172.21.15.43:0/3439705769 conn(0x5596ca499460 msgr2=0x5596ca847f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3439705769 shutdown_connections 2024-07-26T08:36:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.688+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3439705769 wait complete. 2024-07-26T08:36:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.689+0000 7f8b95e00640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8b780b3dc0 0x7f8b780b62d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006010 tx=0x7f8b88005d80 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.689+0000 7f8b9ec35740 1 -- start start 2024-07-26T08:36:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.689+0000 7f8b9ec35740 1 Processor -- start 2024-07-26T08:36:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 0x5596ca8554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 0x5596ca855a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca4a5070 0x5596ca855f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596ca613700 con 0x5596ca47c1b0 2024-07-26T08:36:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5596ca74c6c0 con 0x5596ca484390 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5596ca858810 con 0x5596ca4a5070 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b9ec35740 10 client.0 _ll_register_callbacks cb 0x5596ca75c170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b95400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 0x5596ca8554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 0x5596ca855a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b95400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 0x5596ca8554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51156/0 (socket says 172.21.15.43:51156) 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 0x5596ca855a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52148/0 (socket says 172.21.15.43:52148) 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.690+0000 7f8b95400640 1 -- 172.21.15.43:0/3381306575 learned_addr learned my addr 172.21.15.43:0/3381306575 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b95e00640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca4a5070 0x5596ca855f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b94a00640 1 -- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca4a5070 msgr2=0x5596ca855f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b94a00640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca4a5070 0x5596ca855f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b94a00640 1 -- 172.21.15.43:0/3381306575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 msgr2=0x5596ca8554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b94a00640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 0x5596ca8554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b94a00640 1 -- 172.21.15.43:0/3381306575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ca763860 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b95e00640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca4a5070 0x5596ca855f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b95400640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 0x5596ca8554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b94a00640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 0x5596ca855a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c000c00 tx=0x7f8b7c00e420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22372c231f895183 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.691+0000 7f8b76a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b76a00640 1 -- 172.21.15.43:0/3381306575 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c027020 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7c019b00 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b76a00640 1 -- 172.21.15.43:0/3381306575 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7f8b7c019430 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b76a00640 1 -- 172.21.15.43:0/3381306575 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c01e040 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b9ec35740 10 client.25796 fetch_fsmap learned FSMap version 44 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5596ca864290 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.692+0000 7f8b76a00640 1 -- 172.21.15.43:0/3381306575 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b7c019b00 con 0x5596ca484390 2024-07-26T08:36:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b76a00640 1 -- 172.21.15.43:0/3381306575 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f8b7c00e700 con 0x5596ca484390 2024-07-26T08:36:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b9ec35740 10 client.25796 fetch_fsmap finished waiting for FSMap version 44 2024-07-26T08:36:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b9ec35740 10 client.25796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b9ec35740 20 client.25796 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca4639f0 0x5596ca8675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b9ec35740 4 client.25796 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:36:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596ca7c2b40 con 0x5596ca4639f0 2024-07-26T08:36:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.693+0000 7f8b95400640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca4639f0 0x5596ca8675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.694+0000 7f8b95400640 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca4639f0 0x5596ca8675f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6176b531ecfbdf server_cookie=50d8f7ab6575b39a in_seq=0 out_seq=0 2024-07-26T08:36:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.694+0000 7f8b76a00640 10 client.25796 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b76a00640 1 -- 172.21.15.43:0/3381306575 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596ca7c2b40 con 0x5596ca4639f0 2024-07-26T08:36:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b76a00640 10 client.25796 handle_command_reply: tid=0 2024-07-26T08:36:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 client.25796 shutdown 2024-07-26T08:36:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 msgr2=0x5596ca855a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 0x5596ca855a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c000c00 tx=0x7f8b7c00e420 comp rx=0 tx=0).stop 2024-07-26T08:36:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 shutdown_connections 2024-07-26T08:36:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca4639f0 0x5596ca8675f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca4a5070 0x5596ca855f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca484390 0x5596ca855a30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b76a00640 0 client.25796 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/3381306575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca47c1b0 0x5596ca8554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 >> 172.21.15.43:0/3381306575 conn(0x5596ca499460 msgr2=0x5596ca84d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 shutdown_connections 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.695+0000 7f8b9ec35740 1 -- 172.21.15.43:0/3381306575 wait complete. 2024-07-26T08:36:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.696+0000 7f8b9ec35740 20 client.25796 trim_cache size 0 max 16384 2024-07-26T08:36:17.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.710+0000 7f8b9ec35740 1 Processor -- start 2024-07-26T08:36:17.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.710+0000 7f8b9ec35740 1 -- start start 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca8573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca855460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca84b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901b55e0 con 0x5596ca484390 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901b2e50 con 0x5596ca4a5070 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901b0ca0 con 0x5596ca47c1b0 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca855460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca855460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51158/0 (socket says 172.21.15.43:51158) 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 -- 172.21.15.43:0/2031335191 learned_addr learned my addr 172.21.15.43:0/2031335191 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b95400640 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca8573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b95e00640 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca84b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 -- 172.21.15.43:0/2031335191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 msgr2=0x5596ca8573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca8573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 -- 172.21.15.43:0/2031335191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 msgr2=0x5596ca84b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca84b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.711+0000 7f8b94a00640 1 -- 172.21.15.43:0/2031335191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596ca858020 con 0x5596ca484390 2024-07-26T08:36:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.712+0000 7f8b94a00640 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca855460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00eb70 tx=0x7f8b7c011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7070ad402966636 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.712+0000 7f8b81c00640 1 -- 172.21.15.43:0/2031335191 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c03b070 con 0x5596ca484390 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.712+0000 7f8b81c00640 1 -- 172.21.15.43:0/2031335191 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b7c00e670 con 0x5596ca484390 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.712+0000 7f8b81c00640 1 -- 172.21.15.43:0/2031335191 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c027040 con 0x5596ca484390 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 -- 172.21.15.43:0/2031335191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 msgr2=0x5596ca855460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca855460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00eb70 tx=0x7f8b7c011e40 comp rx=0 tx=0).stop 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 -- 172.21.15.43:0/2031335191 shutdown_connections 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca84b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca855460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/2031335191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca8573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 -- 172.21.15.43:0/2031335191 >> 172.21.15.43:0/2031335191 conn(0x5596ca499460 msgr2=0x5596ca84b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 -- 172.21.15.43:0/2031335191 shutdown_connections 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.713+0000 7f8b9ec35740 1 -- 172.21.15.43:0/2031335191 wait complete. 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.714+0000 7f8b9ec35740 1 -- start start 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.714+0000 7f8b9ec35740 1 Processor -- start 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.714+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca85b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.714+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca85ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.714+0000 7f8b9ec35740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca8c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901b1310 con 0x5596ca484390 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901b2780 con 0x5596ca4a5070 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b9ec35740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8b901b19e0 con 0x5596ca47c1b0 2024-07-26T08:36:17.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b9ec35740 10 client.0 _ll_register_callbacks cb 0x7f8b84005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca85ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca85b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b94a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca85ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51174/0 (socket says 172.21.15.43:51174) 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b94a00640 1 -- 172.21.15.43:0/792183961 learned_addr learned my addr 172.21.15.43:0/792183961 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95e00640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca8c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95400640 1 -- 172.21.15.43:0/792183961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 msgr2=0x5596ca8c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95400640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca8c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95400640 1 -- 172.21.15.43:0/792183961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 msgr2=0x5596ca85ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95400640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca85ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b95400640 1 -- 172.21.15.43:0/792183961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596ca8c7290 con 0x5596ca47c1b0 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.715+0000 7f8b94a00640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca85ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b95e00640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca8c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b95400640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca85b440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8b8401e000 tx=0x7f8b840054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d05894938dcb85b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b76a00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b76a00640 1 -- 172.21.15.43:0/792183961 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8401c040 con 0x5596ca47c1b0 2024-07-26T08:36:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b76a00640 1 -- 172.21.15.43:0/792183961 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7f8b840e1940 con 0x5596ca47c1b0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7c00e670 con 0x5596ca47c1b0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b76a00640 1 -- 172.21.15.43:0/792183961 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8b840e1b40 con 0x5596ca47c1b0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b9ec35740 10 client.25831 fetch_fsmap learned FSMap version 44 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.716+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5596ca8cf7f0 con 0x5596ca47c1b0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b76a00640 1 -- 172.21.15.43:0/792183961 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b7c00e670 con 0x5596ca47c1b0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b76a00640 1 -- 172.21.15.43:0/792183961 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f8b840aade0 con 0x5596ca47c1b0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b9ec35740 10 client.25831 fetch_fsmap finished waiting for FSMap version 44 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b9ec35740 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b9ec35740 20 client.25831 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca438da0 0x5596ca8d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b9ec35740 4 client.25831 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596ca7be5e0 con 0x5596ca438da0 2024-07-26T08:36:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.717+0000 7f8b94a00640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca438da0 0x5596ca8d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b94a00640 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca438da0 0x5596ca8d1f60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45dfc047b2137970 server_cookie=e86fc12b602ad9a2 in_seq=0 out_seq=0 2024-07-26T08:36:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b76a00640 10 client.25831 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b76a00640 1 -- 172.21.15.43:0/792183961 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596ca7be5e0 con 0x5596ca438da0 2024-07-26T08:36:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b76a00640 10 client.25831 handle_command_reply: tid=0 2024-07-26T08:36:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b9ec35740 1 client.25831 shutdown 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 msgr2=0x5596ca85b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca85b440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8b8401e000 tx=0x7f8b840054f0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 shutdown_connections 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.718+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5596ca438da0 0x5596ca8d1f60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5596ca4a5070 0x5596ca8c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596ca484390 0x5596ca85ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 1 --2- 172.21.15.43:0/792183961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5596ca47c1b0 0x5596ca85b440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b76a00640 0 client.25831 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 >> 172.21.15.43:0/792183961 conn(0x5596ca499460 msgr2=0x5596ca8570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 shutdown_connections 2024-07-26T08:36:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 1 -- 172.21.15.43:0/792183961 wait complete. 2024-07-26T08:36:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b9ec35740 20 client.25831 trim_cache size 0 max 16384 2024-07-26T08:36:17.725 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:36:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8b780b3dc0 msgr2=0x7f8b780b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.719+0000 7f8b96800640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8b780b3dc0 0x7f8b780b62d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006010 tx=0x7f8b88005d80 comp rx=0 tx=0).stop 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b901033c0 msgr2=0x7f8b90075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b901033c0 0x7f8b90075140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400e9f0 tx=0x7f8b8400eeb0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 shutdown_connections 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8b780b3dc0 0x7f8b780b62d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b90108d00 0x7f8b90075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b90109650 0x7f8b90075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 --2- 172.21.15.43:0/1212496922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b901033c0 0x7f8b90075140 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 >> 172.21.15.43:0/1212496922 conn(0x7f8b900fee10 msgr2=0x7f8b90106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 shutdown_connections 2024-07-26T08:36:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:17.720+0000 7f8b96800640 1 -- 172.21.15.43:0/1212496922 wait complete. 2024-07-26T08:36:18.251 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:17 smithi043 ceph-mon[32384]: pgmap v582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 716 B/s wr, 9 op/s 2024-07-26T08:36:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:17 smithi133 ceph-mon[37053]: pgmap v582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 716 B/s wr, 9 op/s 2024-07-26T08:36:18.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:17 smithi063 ceph-mon[36747]: pgmap v582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 716 B/s wr, 9 op/s 2024-07-26T08:36:18.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-07-26T08:36:19.338 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:20 smithi043 ceph-mon[32384]: pgmap v583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-07-26T08:36:20.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:20 smithi133 ceph-mon[37053]: pgmap v583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-07-26T08:36:20.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:20 smithi063 ceph-mon[36747]: pgmap v583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-07-26T08:36:21.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 -- 172.21.15.43:0/3196845550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f686810af30 msgr2=0x7f686810b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 --2- 172.21.15.43:0/3196845550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f686810af30 0x7f686810b340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6854009900 tx=0x7f685402a410 comp rx=0 tx=0).stop 2024-07-26T08:36:21.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 -- 172.21.15.43:0/3196845550 shutdown_connections 2024-07-26T08:36:21.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 --2- 172.21.15.43:0/3196845550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686810b880 0x7f68681120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 --2- 172.21.15.43:0/3196845550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f686810af30 0x7f686810b340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 --2- 172.21.15.43:0/3196845550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68681055f0 0x7f6868105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 -- 172.21.15.43:0/3196845550 >> 172.21.15.43:0/3196845550 conn(0x7f6868101060 msgr2=0x7f68681034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:21.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 -- 172.21.15.43:0/3196845550 shutdown_connections 2024-07-26T08:36:21.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.827+0000 7f6867200640 1 -- 172.21.15.43:0/3196845550 wait complete. 2024-07-26T08:36:21.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.829+0000 7f6867200640 1 Processor -- start 2024-07-26T08:36:21.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.829+0000 7f6867200640 1 -- start start 2024-07-26T08:36:21.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6867200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68681055f0 0x7f686819bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6867200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686810af30 0x7f686819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6867200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686810b880 0x7f68681a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6867200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f68681156b0 con 0x7f686810b880 2024-07-26T08:36:21.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6867200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6868115530 con 0x7f68681055f0 2024-07-26T08:36:21.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6867200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6868115830 con 0x7f686810af30 2024-07-26T08:36:21.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6865e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68681055f0 0x7f686819bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6865e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68681055f0 0x7f686819bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52178/0 (socket says 172.21.15.43:52178) 2024-07-26T08:36:21.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6865e00640 1 -- 172.21.15.43:0/1130158258 learned_addr learned my addr 172.21.15.43:0/1130158258 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:21.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6865400640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686810af30 0x7f686819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.830+0000 7f6866800640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686810b880 0x7f68681a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.831+0000 7f6865400640 1 -- 172.21.15.43:0/1130158258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68681055f0 msgr2=0x7f686819bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.831+0000 7f6865400640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68681055f0 0x7f686819bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.831+0000 7f6865400640 1 -- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686810b880 msgr2=0x7f68681a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.831+0000 7f6865400640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686810b880 0x7f68681a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.831+0000 7f6865400640 1 -- 172.21.15.43:0/1130158258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68681a1f50 con 0x7f686810af30 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.831+0000 7f6865400640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686810af30 0x7f686819c580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6854009230 tx=0x7f6854003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.832+0000 7f685ea00640 1 -- 172.21.15.43:0/1130158258 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685403f070 con 0x7f686810af30 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.832+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68681a21e0 con 0x7f686810af30 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.832+0000 7f685ea00640 1 -- 172.21.15.43:0/1130158258 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6854031be0 con 0x7f686810af30 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.832+0000 7f685ea00640 1 -- 172.21.15.43:0/1130158258 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854035030 con 0x7f686810af30 2024-07-26T08:36:21.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.832+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681a89a0 con 0x7f686810af30 2024-07-26T08:36:21.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.835+0000 7f6873e0a740 1 Processor -- start 2024-07-26T08:36:21.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.835+0000 7f6873e0a740 1 -- start start 2024-07-26T08:36:21.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea587030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1b91b0 0x559dea587570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1c1390 0x559dea587ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6873e0a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559dea4fdbf0 con 0x559dea1e2070 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6873e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559dea4ed0f0 con 0x559dea1b91b0 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6873e0a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559dea4f1130 con 0x559dea1c1390 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6866800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea587030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f685ea00640 1 -- 172.21.15.43:0/1130158258 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6854042070 con 0x7f686810af30 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6866800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea587030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51204/0 (socket says 172.21.15.43:51204) 2024-07-26T08:36:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6866800640 1 -- 172.21.15.43:0/1769317289 learned_addr learned my addr 172.21.15.43:0/1769317289 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:21.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.836+0000 7f6865e00640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1b91b0 0x559dea587570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865400640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1c1390 0x559dea587ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865e00640 1 -- 172.21.15.43:0/1769317289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1c1390 msgr2=0x559dea587ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865e00640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1c1390 0x559dea587ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865e00640 1 -- 172.21.15.43:0/1769317289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 msgr2=0x559dea587030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865e00640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea587030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865e00640 1 -- 172.21.15.43:0/1769317289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dea24d650 con 0x559dea1b91b0 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6866800640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea587030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865400640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1c1390 0x559dea587ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.837+0000 7f6865e00640 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1b91b0 0x559dea587570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6858009cf0 tx=0x7f6858011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f49ed76e7e2b9e7f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.838+0000 7f6853400640 1 -- 172.21.15.43:0/1769317289 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858005220 con 0x559dea1b91b0 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.838+0000 7f6853400640 1 -- 172.21.15.43:0/1769317289 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6858004c70 con 0x559dea1b91b0 2024-07-26T08:36:21.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.838+0000 7f6853400640 1 -- 172.21.15.43:0/1769317289 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68580198d0 con 0x559dea1b91b0 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.838+0000 7f685ea00640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f684c0b3d40 0x7f684c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.838+0000 7f685ea00640 1 -- 172.21.15.43:0/1130158258 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7f68541049e0 con 0x7f686810af30 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.838+0000 7f6866800640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f684c0b3d40 0x7f684c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 -- 172.21.15.43:0/1769317289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1b91b0 msgr2=0x559dea587570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1b91b0 0x559dea587570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6858009cf0 tx=0x7f6858011810 comp rx=0 tx=0).stop 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 -- 172.21.15.43:0/1769317289 shutdown_connections 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1c1390 0x559dea587ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1b91b0 0x559dea587570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 --2- 172.21.15.43:0/1769317289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea587030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 -- 172.21.15.43:0/1769317289 >> 172.21.15.43:0/1769317289 conn(0x559dea1d6460 msgr2=0x559dea584f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 -- 172.21.15.43:0/1769317289 shutdown_connections 2024-07-26T08:36:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6873e0a740 1 -- 172.21.15.43:0/1769317289 wait complete. 2024-07-26T08:36:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.839+0000 7f6866800640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f684c0b3d40 0x7f684c0b6250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f68600117b0 tx=0x7f6860009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.840+0000 7f6873e0a740 1 -- start start 2024-07-26T08:36:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.840+0000 7f6873e0a740 1 Processor -- start 2024-07-26T08:36:21.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea5926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea592c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea593180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559dea350700 con 0x559dea1e2070 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559dea4896c0 con 0x559dea1c1390 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559dea595810 con 0x559dea1b91b0 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6873e0a740 10 client.0 _ll_register_callbacks cb 0x559dea499170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea592c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6866800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea593180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea592c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52194/0 (socket says 172.21.15.43:52194) 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea5926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 -- 172.21.15.43:0/4146469810 learned_addr learned my addr 172.21.15.43:0/4146469810 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6866800640 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea593180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51208/0 (socket says 172.21.15.43:51208) 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 -- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 msgr2=0x559dea5926c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea5926c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 -- 172.21.15.43:0/4146469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 msgr2=0x559dea593180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.841+0000 7f6865400640 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea593180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.842+0000 7f6865400640 1 -- 172.21.15.43:0/4146469810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dea4a0860 con 0x559dea1c1390 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.842+0000 7f6865400640 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea592c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68540c7220 tx=0x7f6854003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82b003d858daf608 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.842+0000 7f6847e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:36:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.842+0000 7f6847e00640 1 -- 172.21.15.43:0/4146469810 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854049070 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.842+0000 7f6847e00640 1 -- 172.21.15.43:0/4146469810 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7f6854101eb0 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.842+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6858004c70 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6847e00640 1 -- 172.21.15.43:0/4146469810 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f68541020b0 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 10 client.25814 fetch_fsmap learned FSMap version 44 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559dea5a1420 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6847e00640 1 -- 172.21.15.43:0/4146469810 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6858004c70 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6847e00640 1 -- 172.21.15.43:0/4146469810 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f68540d3d10 con 0x559dea1c1390 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 10 client.25814 fetch_fsmap finished waiting for FSMap version 44 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 10 client.25814 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 20 client.25814 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea1a09f0 0x559dea5a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 4 client.25814 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.843+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dea4ffb40 con 0x559dea1a09f0 2024-07-26T08:36:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.844+0000 7f6865e00640 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea1a09f0 0x559dea5a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.844+0000 7f6865e00640 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea1a09f0 0x559dea5a4ad0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51d8f34e2d389919 server_cookie=9b6a96d378003e99 in_seq=0 out_seq=0 2024-07-26T08:36:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.844+0000 7f6847e00640 10 client.25814 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:36:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.845+0000 7f6847e00640 1 -- 172.21.15.43:0/4146469810 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559dea4ffb40 con 0x559dea1a09f0 2024-07-26T08:36:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.845+0000 7f6847e00640 10 client.25814 handle_command_reply: tid=0 2024-07-26T08:36:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.845+0000 7f6873e0a740 1 client.25814 shutdown 2024-07-26T08:36:21.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 msgr2=0x559dea592c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea592c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68540c7220 tx=0x7f6854003f90 comp rx=0 tx=0).stop 2024-07-26T08:36:21.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 shutdown_connections 2024-07-26T08:36:21.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea1a09f0 0x559dea5a4ad0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea593180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea592c00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 --2- 172.21.15.43:0/4146469810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea5926c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 >> 172.21.15.43:0/4146469810 conn(0x559dea1d6460 msgr2=0x559dea58a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6847e00640 0 client.25814 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 shutdown_connections 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 1 -- 172.21.15.43:0/4146469810 wait complete. 2024-07-26T08:36:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.846+0000 7f6873e0a740 20 client.25814 trim_cache size 0 max 16384 2024-07-26T08:36:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.861+0000 7f6873e0a740 1 Processor -- start 2024-07-26T08:36:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.861+0000 7f6873e0a740 1 -- start start 2024-07-26T08:36:21.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.861+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea583f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.861+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea5942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea5aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6873e0a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f68681b53a0 con 0x559dea1e2070 2024-07-26T08:36:21.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6873e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f68681b2c10 con 0x559dea1c1390 2024-07-26T08:36:21.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6873e0a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f68681b0a60 con 0x559dea1b91b0 2024-07-26T08:36:21.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea583f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea583f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41488/0 (socket says 172.21.15.43:41488) 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865e00640 1 -- 172.21.15.43:0/3055758375 learned_addr learned my addr 172.21.15.43:0/3055758375 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865400640 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea5942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6866800640 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea5aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865400640 1 -- 172.21.15.43:0/3055758375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 msgr2=0x559dea583f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865400640 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea583f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865400640 1 -- 172.21.15.43:0/3055758375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 msgr2=0x559dea5aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865400640 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea5aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6865400640 1 -- 172.21.15.43:0/3055758375 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dea59e8f0 con 0x559dea1c1390 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.862+0000 7f6866800640 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea5aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:36:21.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.863+0000 7f6865400640 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea5942f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f685402a930 tx=0x7f685403b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328e6ef2fff32266 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:21.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.863+0000 7f6852a00640 1 -- 172.21.15.43:0/3055758375 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540ca910 con 0x559dea1c1390 2024-07-26T08:36:21.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.863+0000 7f6852a00640 1 -- 172.21.15.43:0/3055758375 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68540cf6f0 con 0x559dea1c1390 2024-07-26T08:36:21.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.863+0000 7f6852a00640 1 -- 172.21.15.43:0/3055758375 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540317b0 con 0x559dea1c1390 2024-07-26T08:36:21.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 -- 172.21.15.43:0/3055758375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 msgr2=0x559dea5942f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea5942f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f685402a930 tx=0x7f685403b670 comp rx=0 tx=0).stop 2024-07-26T08:36:21.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 -- 172.21.15.43:0/3055758375 shutdown_connections 2024-07-26T08:36:21.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1e2070 0x559dea5aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1c1390 0x559dea5942f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 --2- 172.21.15.43:0/3055758375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea583f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.864+0000 7f6873e0a740 1 -- 172.21.15.43:0/3055758375 >> 172.21.15.43:0/3055758375 conn(0x559dea1d6460 msgr2=0x559dea593be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:21.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.865+0000 7f6873e0a740 1 -- 172.21.15.43:0/3055758375 shutdown_connections 2024-07-26T08:36:21.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.865+0000 7f6873e0a740 1 -- 172.21.15.43:0/3055758375 wait complete. 2024-07-26T08:36:21.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.865+0000 7f6873e0a740 1 -- start start 2024-07-26T08:36:21.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.865+0000 7f6873e0a740 1 Processor -- start 2024-07-26T08:36:21.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea596ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 0x559dea5970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1e2070 0x559dea60c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f68681b10d0 con 0x559dea1c1390 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f68681b2540 con 0x559dea1e2070 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f68681b17a0 con 0x559dea1b91b0 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6873e0a740 10 client.0 _ll_register_callbacks cb 0x7f68540caf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6865400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 0x559dea5970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6865400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 0x559dea5970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51228/0 (socket says 172.21.15.43:51228) 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.866+0000 7f6865400640 1 -- 172.21.15.43:0/960362399 learned_addr learned my addr 172.21.15.43:0/960362399 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865e00640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea596ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6866800640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1e2070 0x559dea60c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865400640 1 -- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 msgr2=0x559dea596ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865400640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea596ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865400640 1 -- 172.21.15.43:0/960362399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1e2070 msgr2=0x559dea60c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:21.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865400640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1e2070 0x559dea60c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865400640 1 -- 172.21.15.43:0/960362399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dea5978f0 con 0x559dea1c1390 2024-07-26T08:36:21.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865e00640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea596ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:21.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6865400640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 0x559dea5970e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68540cae50 tx=0x7f68540d3f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8c53f7238a5a38 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:21.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.867+0000 7f6847e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:36:21.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6847e00640 1 -- 172.21.15.43:0/960362399 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540ca910 con 0x559dea1c1390 2024-07-26T08:36:21.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6847e00640 1 -- 172.21.15.43:0/960362399 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9710+0+0 (secure 0 0 0) 0x7f68540c7790 con 0x559dea1c1390 2024-07-26T08:36:21.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68540cf6f0 con 0x559dea1c1390 2024-07-26T08:36:21.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6847e00640 1 -- 172.21.15.43:0/960362399 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f68540d41a0 con 0x559dea1c1390 2024-07-26T08:36:21.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6873e0a740 10 client.15684 fetch_fsmap learned FSMap version 44 2024-07-26T08:36:21.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559dea5978f0 con 0x559dea1c1390 2024-07-26T08:36:21.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.868+0000 7f6847e00640 1 -- 172.21.15.43:0/960362399 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68540cf6f0 con 0x559dea1c1390 2024-07-26T08:36:21.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6847e00640 1 -- 172.21.15.43:0/960362399 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f68540c6b10 con 0x559dea1c1390 2024-07-26T08:36:21.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6873e0a740 10 client.15684 fetch_fsmap finished waiting for FSMap version 44 2024-07-26T08:36:21.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6873e0a740 10 client.15684 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-07-26T08:36:21.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6873e0a740 20 client.15684 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:21.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6873e0a740 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea175da0 0x559dea60fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:21.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6873e0a740 4 client.15684 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:36:21.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 --> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559dea4fb5e0 con 0x559dea175da0 2024-07-26T08:36:21.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.869+0000 7f6865e00640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea175da0 0x559dea60fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.870+0000 7f6865e00640 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea175da0 0x559dea60fa60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4cfca17e07ab7dfd server_cookie=43d245a1346acfb4 in_seq=0 out_seq=0 2024-07-26T08:36:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.870+0000 7f6847e00640 10 client.15684 ms_handle_connect on v2:172.21.15.133:6838/475376324 2024-07-26T08:36:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.870+0000 7f6847e00640 1 -- 172.21.15.43:0/960362399 <== mds.2 v2:172.21.15.133:6838/475376324 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559dea4fb5e0 con 0x559dea175da0 2024-07-26T08:36:21.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.870+0000 7f6847e00640 10 client.15684 handle_command_reply: tid=0 2024-07-26T08:36:21.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.870+0000 7f6873e0a740 1 client.15684 shutdown 2024-07-26T08:36:21.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 msgr2=0x559dea5970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 0x559dea5970e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68540cae50 tx=0x7f68540d3f40 comp rx=0 tx=0).stop 2024-07-26T08:36:21.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 shutdown_connections 2024-07-26T08:36:21.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] conn(0x559dea175da0 0x559dea60fa60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559dea1e2070 0x559dea60c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559dea1c1390 0x559dea5970e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 --2- 172.21.15.43:0/960362399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559dea1b91b0 0x559dea596ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 >> 172.21.15.43:0/960362399 conn(0x559dea1d6460 msgr2=0x559dea583cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:21.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6847e00640 0 client.15684 ms_handle_reset on v2:172.21.15.133:6838/475376324 2024-07-26T08:36:21.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 shutdown_connections 2024-07-26T08:36:21.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 1 -- 172.21.15.43:0/960362399 wait complete. 2024-07-26T08:36:21.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.871+0000 7f6873e0a740 20 client.15684 trim_cache size 0 max 16384 2024-07-26T08:36:21.882 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:36:21.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f684c0b3d40 msgr2=0x7f684c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f684c0b3d40 0x7f684c0b6250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f68600117b0 tx=0x7f6860009500 comp rx=0 tx=0).stop 2024-07-26T08:36:21.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686810af30 msgr2=0x7f686819c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:21.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686810af30 0x7f686819c580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6854009230 tx=0x7f6854003b90 comp rx=0 tx=0).stop 2024-07-26T08:36:21.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 shutdown_connections 2024-07-26T08:36:21.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f684c0b3d40 0x7f684c0b6250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686810af30 0x7f686819c580 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686810b880 0x7f68681a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 --2- 172.21.15.43:0/1130158258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68681055f0 0x7f686819bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:21.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 >> 172.21.15.43:0/1130158258 conn(0x7f6868101060 msgr2=0x7f686810a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:21.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.872+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 shutdown_connections 2024-07-26T08:36:21.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:21.873+0000 7f6867200640 1 -- 172.21.15.43:0/1130158258 wait complete. 2024-07-26T08:36:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:22 smithi043 ceph-mon[32384]: pgmap v584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-07-26T08:36:22.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:22 smithi133 ceph-mon[37053]: pgmap v584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-07-26T08:36:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:22 smithi063 ceph-mon[36747]: pgmap v584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-07-26T08:36:22.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-07-26T08:36:23.385 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:24.186 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:24 smithi043 ceph-mon[32384]: pgmap v585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-07-26T08:36:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:24 smithi133 ceph-mon[37053]: pgmap v585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-07-26T08:36:24.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:24 smithi063 ceph-mon[36747]: pgmap v585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-07-26T08:36:24.940 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:24 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:36:24.941 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:24 smithi063 systemd[1]: Stopped Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:24.941 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:24 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 1.959s CPU time. 2024-07-26T08:36:24.941 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:24 smithi063 systemd[1]: Starting Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:36:24.941 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:24 smithi063 podman[71266]: 2024-07-26 08:36:24.711912846 +0000 UTC m=+0.018582774 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:36:24.941 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:24 smithi063 podman[71266]: 2024-07-26 08:36:24.81721578 +0000 UTC m=+0.123885710 container create fb53233a80946e5e16bc4cdc3de135df58cd6279af794d26d0587965a55c7a75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:36:25.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:25 smithi063 podman[71266]: 2024-07-26 08:36:25.045032606 +0000 UTC m=+0.351702552 container init fb53233a80946e5e16bc4cdc3de135df58cd6279af794d26d0587965a55c7a75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:36:25.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:25 smithi063 podman[71266]: 2024-07-26 08:36:25.047682063 +0000 UTC m=+0.354351990 container start fb53233a80946e5e16bc4cdc3de135df58cd6279af794d26d0587965a55c7a75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-07-26T08:36:25.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:25 smithi063 ceph-mds[71284]: -- 172.21.15.63:0/2762022941 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650e4ed5860 con 0x5650e9077a80 2024-07-26T08:36:25.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:25 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: starting mds.b at 2024-07-26T08:36:25.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:25 smithi063 bash[71266]: fb53233a80946e5e16bc4cdc3de135df58cd6279af794d26d0587965a55c7a75 2024-07-26T08:36:25.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:25 smithi063 systemd[1]: Started Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:26.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 -- 172.21.15.43:0/783144931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 msgr2=0x7fb75010b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 --2- 172.21.15.43:0/783144931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 0x7fb75010b510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb738009900 tx=0x7fb73802a410 comp rx=0 tx=0).stop 2024-07-26T08:36:26.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 -- 172.21.15.43:0/783144931 shutdown_connections 2024-07-26T08:36:26.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 --2- 172.21.15.43:0/783144931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb75010ba50 0x7fb750112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 --2- 172.21.15.43:0/783144931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 0x7fb75010b510 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 --2- 172.21.15.43:0/783144931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7501057c0 0x7fb750105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 -- 172.21.15.43:0/783144931 >> 172.21.15.43:0/783144931 conn(0x7fb750101210 msgr2=0x7fb750103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:26.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 -- 172.21.15.43:0/783144931 shutdown_connections 2024-07-26T08:36:26.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.059+0000 7fb757200640 1 -- 172.21.15.43:0/783144931 wait complete. 2024-07-26T08:36:26.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 Processor -- start 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 -- start start 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 0x7fb75019c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 0x7fb75019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb75010ba50 0x7fb7501a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb750115830 con 0x7fb75010b100 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501156b0 con 0x7fb7501057c0 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.061+0000 7fb757200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501159b0 con 0x7fb75010ba50 2024-07-26T08:36:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 0x7fb75019c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 0x7fb75019c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59902/0 (socket says 172.21.15.43:59902) 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 -- 172.21.15.43:0/3440276378 learned_addr learned my addr 172.21.15.43:0/3440276378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb747e00640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 0x7fb75019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb755200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb75010ba50 0x7fb7501a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 -- 172.21.15.43:0/3440276378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb75010ba50 msgr2=0x7fb7501a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb75010ba50 0x7fb7501a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 -- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 msgr2=0x7fb75019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 0x7fb75019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.062+0000 7fb74fe00640 1 -- 172.21.15.43:0/3440276378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7501a2130 con 0x7fb7501057c0 2024-07-26T08:36:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.063+0000 7fb74fe00640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 0x7fb75019c1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb74000e9f0 tx=0x7fb74000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.063+0000 7fb74d600640 1 -- 172.21.15.43:0/3440276378 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74000cd80 con 0x7fb7501057c0 2024-07-26T08:36:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.063+0000 7fb74d600640 1 -- 172.21.15.43:0/3440276378 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb740010900 con 0x7fb7501057c0 2024-07-26T08:36:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.063+0000 7fb74d600640 1 -- 172.21.15.43:0/3440276378 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740018920 con 0x7fb7501057c0 2024-07-26T08:36:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.063+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7501a2420 con 0x7fb7501057c0 2024-07-26T08:36:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.063+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7501a8b80 con 0x7fb7501057c0 2024-07-26T08:36:26.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 Processor -- start 2024-07-26T08:36:26.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 -- start start 2024-07-26T08:36:26.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4c9e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4c9eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cac4c14bf0 con 0x55cac48f9070 2024-07-26T08:36:26.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cac4c040f0 con 0x55cac48d8390 2024-07-26T08:36:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb75de4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cac4c08130 con 0x55cac48d01b0 2024-07-26T08:36:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.067+0000 7fb74d600640 1 -- 172.21.15.43:0/3440276378 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb740010ab0 con 0x7fb7501057c0 2024-07-26T08:36:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb755200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4c9e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4c9eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4c9eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59916/0 (socket says 172.21.15.43:59916) 2024-07-26T08:36:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb755200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4c9e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42820/0 (socket says 172.21.15.43:42820) 2024-07-26T08:36:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 -- 172.21.15.43:0/1540353135 learned_addr learned my addr 172.21.15.43:0/1540353135 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 -- 172.21.15.43:0/1540353135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 msgr2=0x55cac4c9e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 -- 172.21.15.43:0/1540353135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 msgr2=0x55cac4c9e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4c9e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.068+0000 7fb747e00640 1 -- 172.21.15.43:0/1540353135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cac4964650 con 0x55cac48d8390 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.069+0000 7fb747e00640 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4c9eac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7380314b0 tx=0x7fb738005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c324d49441806db server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.069+0000 7fb745600640 1 -- 172.21.15.43:0/1540353135 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738040070 con 0x55cac48d8390 2024-07-26T08:36:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.069+0000 7fb745600640 1 -- 172.21.15.43:0/1540353135 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb738004020 con 0x55cac48d8390 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.069+0000 7fb745600640 1 -- 172.21.15.43:0/1540353135 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738035040 con 0x55cac48d8390 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.069+0000 7fb74d600640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb7340b3e40 0x7fb7340b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb74d600640 1 -- 172.21.15.43:0/3440276378 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7fb7400e4850 con 0x7fb7501057c0 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 -- 172.21.15.43:0/1540353135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 msgr2=0x55cac4c9eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4c9eac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7380314b0 tx=0x7fb738005e60 comp rx=0 tx=0).stop 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb755200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb7340b3e40 0x7fb7340b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 -- 172.21.15.43:0/1540353135 shutdown_connections 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4c9eac0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1540353135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4c9e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 -- 172.21.15.43:0/1540353135 >> 172.21.15.43:0/1540353135 conn(0x55cac48ed460 msgr2=0x55cac4c9bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 -- 172.21.15.43:0/1540353135 shutdown_connections 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.070+0000 7fb75de4e740 1 -- 172.21.15.43:0/1540353135 wait complete. 2024-07-26T08:36:26.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.071+0000 7fb755200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb7340b3e40 0x7fb7340b6350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb748005fd0 tx=0x7fb748009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.071+0000 7fb75de4e740 1 -- start start 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.071+0000 7fb75de4e740 1 Processor -- start 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4ca9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4ca9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4caa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cac4a67700 con 0x55cac48f9070 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cac4ba06c0 con 0x55cac48d8390 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cac4cac7c0 con 0x55cac48d01b0 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb75de4e740 10 client.0 _ll_register_callbacks cb 0x55cac4bb0170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4ca9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb755200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4caa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4ca9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44712/0 (socket says 172.21.15.43:44712) 2024-07-26T08:36:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb74fe00640 1 -- 172.21.15.43:0/2812669481 learned_addr learned my addr 172.21.15.43:0/2812669481 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.072+0000 7fb747e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4ca9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb74fe00640 1 -- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 msgr2=0x55cac4ca9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb74fe00640 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4ca9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb74fe00640 1 -- 172.21.15.43:0/2812669481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 msgr2=0x55cac4caa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb74fe00640 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4caa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb74fe00640 1 -- 172.21.15.43:0/2812669481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cac4bb7860 con 0x55cac48d01b0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb74fe00640 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4ca9650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7400aacb0 tx=0x7fb7400a7500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70e1660ff88d396 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb73e000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb73e000640 1 -- 172.21.15.43:0/2812669481 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400aa900 con 0x55cac48d01b0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb73e000640 1 -- 172.21.15.43:0/2812669481 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7fb740010640 con 0x55cac48d01b0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb738004020 con 0x55cac48d01b0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb73e000640 1 -- 172.21.15.43:0/2812669481 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fb7400aa720 con 0x55cac48d01b0 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb75de4e740 10 client.25861 fetch_fsmap learned FSMap version 46 2024-07-26T08:36:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.073+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55cac4cb83d0 con 0x55cac48d01b0 2024-07-26T08:36:26.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb73e000640 1 -- 172.21.15.43:0/2812669481 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb738004020 con 0x55cac48d01b0 2024-07-26T08:36:26.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb73e000640 1 -- 172.21.15.43:0/2812669481 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 46) ==== 8366+0+0 (secure 0 0 0) 0x7fb7400a6920 con 0x55cac48d01b0 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb75de4e740 10 client.25861 fetch_fsmap finished waiting for FSMap version 46 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb75de4e740 10 client.25861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb75de4e740 20 client.25861 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb75de4e740 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48b79f0 0x55cac4cbb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb75de4e740 4 client.25861 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.074+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 --> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cac4c16b40 con 0x55cac48b79f0 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.075+0000 7fb747e00640 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48b79f0 0x55cac4cbb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.076+0000 7fb747e00640 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48b79f0 0x55cac4cbb910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc9ad266fe6ef98c server_cookie=bc2ade1b540f14a7 in_seq=0 out_seq=0 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.076+0000 7fb73e000640 10 client.25861 ms_handle_connect on v2:172.21.15.63:6836/185000899 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.076+0000 7fb73e000640 1 -- 172.21.15.43:0/2812669481 <== mds.1 v2:172.21.15.63:6836/185000899 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cac4c16b40 con 0x55cac48b79f0 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.076+0000 7fb73e000640 10 client.25861 handle_command_reply: tid=0 2024-07-26T08:36:26.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 client.25861 shutdown 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 msgr2=0x55cac4ca9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4ca9650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7400aacb0 tx=0x7fb7400a7500 comp rx=0 tx=0).stop 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 shutdown_connections 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48b79f0 0x55cac4cbb910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48f9070 0x55cac4caa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4ca9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb73e000640 0 client.25861 ms_handle_reset on v2:172.21.15.63:6836/185000899 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 --2- 172.21.15.43:0/2812669481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4ca9650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 >> 172.21.15.43:0/2812669481 conn(0x55cac48ed460 msgr2=0x55cac4ca1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 shutdown_connections 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 1 -- 172.21.15.43:0/2812669481 wait complete. 2024-07-26T08:36:26.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.077+0000 7fb75de4e740 20 client.25861 trim_cache size 0 max 16384 2024-07-26T08:36:26.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 Processor -- start 2024-07-26T08:36:26.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 -- start start 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 0x55cac4cab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4cb4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501b36d0 con 0x55cac48ed460 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501b0e50 con 0x55cac48d8390 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb75de4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501b3000 con 0x55cac48d01b0 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.093+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 0x55cac4cab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 0x55cac4cab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42828/0 (socket says 172.21.15.43:42828) 2024-07-26T08:36:26.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 -- 172.21.15.43:0/1949767512 learned_addr learned my addr 172.21.15.43:0/1949767512 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:26.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb747e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb755200640 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4cb4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 -- 172.21.15.43:0/1949767512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 msgr2=0x55cac4c9f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 -- 172.21.15.43:0/1949767512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 msgr2=0x55cac4cb4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4cb4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 -- 172.21.15.43:0/1949767512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cac4c9ee50 con 0x55cac48ed460 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb755200640 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4cb4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.094+0000 7fb74fe00640 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 0x55cac4cab530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb7400a6c90 tx=0x7fb74000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90587fad0318a88 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.095+0000 7fb744c00640 1 -- 172.21.15.43:0/1949767512 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400aa900 con 0x55cac48ed460 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.095+0000 7fb744c00640 1 -- 172.21.15.43:0/1949767512 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb7400c9030 con 0x55cac48ed460 2024-07-26T08:36:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.095+0000 7fb744c00640 1 -- 172.21.15.43:0/1949767512 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400a6920 con 0x55cac48ed460 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 -- 172.21.15.43:0/1949767512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 msgr2=0x55cac4cab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 0x55cac4cab530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb7400a6c90 tx=0x7fb74000c7d0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 -- 172.21.15.43:0/1949767512 shutdown_connections 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4c9f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48d8390 0x55cac4cb4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1949767512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48ed460 0x55cac4cab530 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 -- 172.21.15.43:0/1949767512 >> 172.21.15.43:0/1949767512 conn(0x55cac4caa200 msgr2=0x55cac4cb48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:26.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 -- 172.21.15.43:0/1949767512 shutdown_connections 2024-07-26T08:36:26.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.096+0000 7fb75de4e740 1 -- 172.21.15.43:0/1949767512 wait complete. 2024-07-26T08:36:26.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 -- start start 2024-07-26T08:36:26.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 Processor -- start 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4cb21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48d8390 0x55cac4cad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48ed460 0x55cac4cadcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501b2930 con 0x55cac48d8390 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501b14c0 con 0x55cac48ed460 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501b1b90 con 0x55cac48d01b0 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.097+0000 7fb75de4e740 10 client.0 _ll_register_callbacks cb 0x7fb7400a7450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb747e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48d8390 0x55cac4cad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4cb21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4cb21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44740/0 (socket says 172.21.15.43:44740) 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 -- 172.21.15.43:0/1141803750 learned_addr learned my addr 172.21.15.43:0/1141803750 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb755200640 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48ed460 0x55cac4cadcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 -- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48ed460 msgr2=0x55cac4cadcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48ed460 0x55cac4cadcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 -- 172.21.15.43:0/1141803750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48d8390 msgr2=0x55cac4cad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48d8390 0x55cac4cad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 -- 172.21.15.43:0/1141803750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cac4cae460 con 0x55cac48d01b0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb74fe00640 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4cb21f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7400aaf40 tx=0x7fb7400ab0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e9e83753718ea97 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.098+0000 7fb73e000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb73e000640 1 -- 172.21.15.43:0/1141803750 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400aa900 con 0x55cac48d01b0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb73e000640 1 -- 172.21.15.43:0/1141803750 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7fb7400ea4b0 con 0x55cac48d01b0 2024-07-26T08:36:26.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7400c9030 con 0x55cac48d01b0 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb73e000640 1 -- 172.21.15.43:0/1141803750 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fb7400ab490 con 0x55cac48d01b0 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb75de4e740 10 client.25867 fetch_fsmap learned FSMap version 46 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55cac4d240b0 con 0x55cac48d01b0 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.099+0000 7fb73e000640 1 -- 172.21.15.43:0/1141803750 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb7400c9030 con 0x55cac48d01b0 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb73e000640 1 -- 172.21.15.43:0/1141803750 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 46) ==== 8366+0+0 (secure 0 0 0) 0x7fb740018ae0 con 0x55cac48d01b0 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb75de4e740 10 client.25867 fetch_fsmap finished waiting for FSMap version 46 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb75de4e740 10 client.25867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb75de4e740 20 client.25867 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48f9070 0x55cac4d26530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb75de4e740 4 client.25867 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-26T08:36:26.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 --> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cac4c125e0 con 0x55cac48f9070 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.100+0000 7fb747e00640 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48f9070 0x55cac4d26530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb747e00640 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48f9070 0x55cac4d26530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3860aff1c6303c2 server_cookie=b4461ca8fcf189f5 in_seq=0 out_seq=0 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb73e000640 10 client.25867 ms_handle_connect on v2:172.21.15.63:6836/185000899 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb73e000640 1 -- 172.21.15.43:0/1141803750 <== mds.1 v2:172.21.15.63:6836/185000899 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cac4c125e0 con 0x55cac48f9070 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb73e000640 10 client.25867 handle_command_reply: tid=0 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 client.25867 shutdown 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 msgr2=0x55cac4cb21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4cb21f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7400aaf40 tx=0x7fb7400ab0c0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 shutdown_connections 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] conn(0x55cac48f9070 0x55cac4d26530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cac48ed460 0x55cac4cadcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cac48d8390 0x55cac4cad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 --2- 172.21.15.43:0/1141803750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cac48d01b0 0x55cac4cb21f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 >> 172.21.15.43:0/1141803750 conn(0x55cac4caa200 msgr2=0x55cac4cb48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb73e000640 0 client.25867 ms_handle_reset on v2:172.21.15.63:6836/185000899 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 shutdown_connections 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.101+0000 7fb75de4e740 1 -- 172.21.15.43:0/1141803750 wait complete. 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb75de4e740 20 client.25867 trim_cache size 0 max 16384 2024-07-26T08:36:26.106 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb7340b3e40 msgr2=0x7fb7340b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb7340b3e40 0x7fb7340b6350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb748005fd0 tx=0x7fb748009500 comp rx=0 tx=0).stop 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 msgr2=0x7fb75019c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 0x7fb75019c1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb74000e9f0 tx=0x7fb74000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 shutdown_connections 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb7340b3e40 0x7fb7340b6350 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb75010ba50 0x7fb7501a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb75010b100 0x7fb75019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 --2- 172.21.15.43:0/3440276378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7501057c0 0x7fb75019c1c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:26.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.102+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 >> 172.21.15.43:0/3440276378 conn(0x7fb750101210 msgr2=0x7fb750103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:26.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.103+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 shutdown_connections 2024-07-26T08:36:26.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:26.103+0000 7fb757200640 1 -- 172.21.15.43:0/3440276378 wait complete. 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: pgmap v586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: daemon mds.b restarted 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: osdmap e94: 12 total, 12 up, 12 in 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:boot 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:26 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: pgmap v586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-07-26T08:36:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: daemon mds.b restarted 2024-07-26T08:36:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:36:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: osdmap e94: 12 total, 12 up, 12 in 2024-07-26T08:36:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:boot 2024-07-26T08:36:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:36:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:26 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: pgmap v586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: daemon mds.b restarted 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: osdmap e94: 12 total, 12 up, 12 in 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:boot 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:26 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:27.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:27 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:resolve 2024-07-26T08:36:27.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:27 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:27.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:27 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:resolve 2024-07-26T08:36:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:27 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:27.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:27 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:resolve 2024-07-26T08:36:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:27 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:28.146 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-26T08:36:28.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-26T08:36:28.416 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:28 smithi133 ceph-mon[37053]: pgmap v588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-07-26T08:36:28.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:28 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:reconnect 2024-07-26T08:36:28.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:28 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:28.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:28 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:36:28.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:28 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:36:28.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:28 smithi043 ceph-mon[32384]: pgmap v588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-07-26T08:36:28.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:28 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:reconnect 2024-07-26T08:36:28.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:28 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:28 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:36:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:28 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:28 smithi063 ceph-mon[36747]: pgmap v588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-07-26T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:28 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:reconnect 2024-07-26T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:28 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:28 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:28 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:36:28.645 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:29 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:rejoin 2024-07-26T08:36:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:29 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:29 smithi043 ceph-mon[32384]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:36:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:29 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:rejoin 2024-07-26T08:36:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:29 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:29 smithi133 ceph-mon[37053]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:36:29.550 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:rejoin 2024-07-26T08:36:29.551 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:29.551 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-mon[36747]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:36:29.551 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:36:29.551 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: *** Caught signal (Aborted) ** 2024-07-26T08:36:29.551 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: in thread 7fd446261640 thread_name:ms_dispatch 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd44b6386f0] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd44b68594c] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 3: raise() 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 4: abort() 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd44b62271b] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 6: /lib64/libc.so.6(+0x37386) [0x7fd44b631386] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56106cbc66b9] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56106cd8480c] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56106ccc42ca] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56106cc94753] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56106cc95a1b] 2024-07-26T08:36:29.552 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56106cc79752] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56106cbc7a56] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56106cbcb637] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56106cbcbf5e] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56106cbaf03a] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd44bf05407] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 18: (DispatchQueue::entry()+0x60f) [0x7fd44bf05cf9] 2024-07-26T08:36:29.553 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd44bfe25a1] 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 20: (Thread::entry_wrapper()+0x43) [0x7fd44bd8fcdd] 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd44bd8fcf9] 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd44b683c02] 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd44b708c40] 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.156+0000 7fd446261640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: in thread 7fd446261640 thread_name:ms_dispatch 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.554 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd44b6386f0] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd44b68594c] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 3: raise() 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 4: abort() 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd44b62271b] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 6: /lib64/libc.so.6(+0x37386) [0x7fd44b631386] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56106cbc66b9] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56106cd8480c] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56106ccc42ca] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56106cc94753] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56106cc95a1b] 2024-07-26T08:36:29.555 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56106cc79752] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56106cbc7a56] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56106cbcb637] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56106cbcbf5e] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56106cbaf03a] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd44bf05407] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 18: (DispatchQueue::entry()+0x60f) [0x7fd44bf05cf9] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd44bfe25a1] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 20: (Thread::entry_wrapper()+0x43) [0x7fd44bd8fcdd] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd44bd8fcf9] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd44b683c02] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd44b708c40] 2024-07-26T08:36:29.556 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 0> 2024-07-26T08:36:29.156+0000 7fd446261640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: in thread 7fd446261640 thread_name:ms_dispatch 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd44b6386f0] 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd44b68594c] 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 3: raise() 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 4: abort() 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd44b62271b] 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 6: /lib64/libc.so.6(+0x37386) [0x7fd44b631386] 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56106cbc66b9] 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56106cd8480c] 2024-07-26T08:36:29.557 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56106ccc42ca] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56106cc94753] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56106cc95a1b] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56106cc79752] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56106cbc7a56] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56106cbcb637] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56106cbcbf5e] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56106cbaf03a] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd44bf05407] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 18: (DispatchQueue::entry()+0x60f) [0x7fd44bf05cf9] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd44bfe25a1] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 20: (Thread::entry_wrapper()+0x43) [0x7fd44bd8fcdd] 2024-07-26T08:36:29.558 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd44bd8fcf9] 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd44b683c02] 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd44b708c40] 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 0> 2024-07-26T08:36:29.156+0000 7fd446261640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: in thread 7fd446261640 thread_name:ms_dispatch 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd44b6386f0] 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd44b68594c] 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 3: raise() 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 4: abort() 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd44b62271b] 2024-07-26T08:36:29.559 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 6: /lib64/libc.so.6(+0x37386) [0x7fd44b631386] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56106cbc66b9] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56106cd8480c] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56106ccc42ca] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56106cc94753] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56106cc95a1b] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56106cc79752] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56106cbc7a56] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56106cbcb637] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56106cbcbf5e] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56106cbaf03a] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd44bf05407] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 18: (DispatchQueue::entry()+0x60f) [0x7fd44bf05cf9] 2024-07-26T08:36:29.560 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd44bfe25a1] 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 20: (Thread::entry_wrapper()+0x43) [0x7fd44bd8fcdd] 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd44bd8fcf9] 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd44b683c02] 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd44b708c40] 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[68048]: 2024-07-26T08:36:29.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 podman[71318]: 2024-07-26 08:36:29.229256877 +0000 UTC m=+0.023847949 container died b1ba0b1075a8fbb2d8f0ac010afc61acb1f9a8534b727644dcd20f87aeac557d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-07-26T08:36:30.110 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 podman[71318]: 2024-07-26 08:36:29.852240185 +0000 UTC m=+0.646831231 container remove b1ba0b1075a8fbb2d8f0ac010afc61acb1f9a8534b727644dcd20f87aeac557d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:36:30.110 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:29 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:36:30.442 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:30 smithi043 ceph-mon[32384]: pgmap v589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:36:30.442 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:30 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:30.442 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:30 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:36:30.442 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:30 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:active 2024-07-26T08:36:30.442 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:30 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:30.442 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:30 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:30 smithi133 ceph-mon[37053]: pgmap v589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:36:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:30 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:30 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:36:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:30 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:active 2024-07-26T08:36:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:30 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:30 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:30.567 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:30 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:30 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 2.125s CPU time. 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:30 smithi063 ceph-mon[36747]: pgmap v589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:30 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:30 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:30 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/185000899,v1:172.21.15.63:6837/185000899] up:active 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:30 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:30 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:31.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.042+0000 7f01f7600640 1 -- 172.21.15.43:0/1868586730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0103590 msgr2=0x7f01f01039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.042+0000 7f01f7600640 1 --2- 172.21.15.43:0/1868586730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0103590 0x7f01f01039a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009ca0 tx=0x7f01e002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 -- 172.21.15.43:0/1868586730 shutdown_connections 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 --2- 172.21.15.43:0/1868586730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0109820 0x7f01f0110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 --2- 172.21.15.43:0/1868586730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0108ed0 0x7f01f01092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 --2- 172.21.15.43:0/1868586730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0103590 0x7f01f01039a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 -- 172.21.15.43:0/1868586730 >> 172.21.15.43:0/1868586730 conn(0x7f01f007b280 msgr2=0x7f01f007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 -- 172.21.15.43:0/1868586730 shutdown_connections 2024-07-26T08:36:31.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.043+0000 7f01f7600640 1 -- 172.21.15.43:0/1868586730 wait complete. 2024-07-26T08:36:31.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.044+0000 7f01f7600640 1 Processor -- start 2024-07-26T08:36:31.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.045+0000 7f01f7600640 1 -- start start 2024-07-26T08:36:31.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.045+0000 7f01f7600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 0x7f01f019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.045+0000 7f01f7600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0108ed0 0x7f01f019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.045+0000 7f01f7600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0109820 0x7f01f01a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f7600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0113620 con 0x7f01f0103590 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f7600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01134a0 con 0x7f01f0109820 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f7600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01137a0 con 0x7f01f0108ed0 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 0x7f01f019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 0x7f01f019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42850/0 (socket says 172.21.15.43:42850) 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01efe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0108ed0 0x7f01f019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f4c00640 1 -- 172.21.15.43:0/3419951572 learned_addr learned my addr 172.21.15.43:0/3419951572 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:31.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.046+0000 7f01f5600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0109820 0x7f01f01a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f5600640 1 -- 172.21.15.43:0/3419951572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0108ed0 msgr2=0x7f01f019c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f5600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0108ed0 0x7f01f019c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f5600640 1 -- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 msgr2=0x7f01f019c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f5600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 0x7f01f019c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f5600640 1 -- 172.21.15.43:0/3419951572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f01a20e0 con 0x7f01f0109820 2024-07-26T08:36:31.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01efe00640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0108ed0 0x7f01f019c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:31.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 0x7f01f019c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:31.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f5600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0109820 0x7f01f01a19b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01e800e970 tx=0x7f01e800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:31.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01ed600640 1 -- 172.21.15.43:0/3419951572 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e800ccc0 con 0x7f01f0109820 2024-07-26T08:36:31.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01ed600640 1 -- 172.21.15.43:0/3419951572 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01e8005020 con 0x7f01f0109820 2024-07-26T08:36:31.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01ed600640 1 -- 172.21.15.43:0/3419951572 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004a00 con 0x7f01f0109820 2024-07-26T08:36:31.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.047+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f01a23d0 con 0x7f01f0109820 2024-07-26T08:36:31.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.048+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f01a8b30 con 0x7f01f0109820 2024-07-26T08:36:31.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.051+0000 7f01fe272740 1 Processor -- start 2024-07-26T08:36:31.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01ed600640 1 -- 172.21.15.43:0/3419951572 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f01e80051d0 con 0x7f01f0109820 2024-07-26T08:36:31.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 -- start start 2024-07-26T08:36:31.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f0b5350 0x55eb4f459d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f45a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f094670 0x55eb4f45a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f3d0be0 con 0x55eb4f0b5350 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f3c00e0 con 0x55eb4f08c490 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.052+0000 7f01fe272740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f3c4120 con 0x55eb4f094670 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01efe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f0b5350 0x55eb4f459d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f45a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f45a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59952/0 (socket says 172.21.15.43:59952) 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01efe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f0b5350 0x55eb4f459d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42856/0 (socket says 172.21.15.43:42856) 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 -- 172.21.15.43:0/3806803195 learned_addr learned my addr 172.21.15.43:0/3806803195 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01efe00640 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f094670 0x55eb4f45a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 -- 172.21.15.43:0/3806803195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f094670 msgr2=0x55eb4f45a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f094670 0x55eb4f45a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 -- 172.21.15.43:0/3806803195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f0b5350 msgr2=0x55eb4f459d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f0b5350 0x55eb4f459d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01f4c00640 1 -- 172.21.15.43:0/3806803195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4f120930 con 0x55eb4f08c490 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01efe00640 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f094670 0x55eb4f45a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.053+0000 7f01ed600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01d40b3dc0 0x7f01d40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.054+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f45a2c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01e002f3d0 tx=0x7f01e002f400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7189d8485b875b2a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.054+0000 7f01ed600640 1 -- 172.21.15.43:0/3419951572 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7f01e80e4460 con 0x7f01f0109820 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.054+0000 7f01efe00640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01d40b3dc0 0x7f01d40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.054+0000 7f01e5c00640 1 -- 172.21.15.43:0/3806803195 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0003b70 con 0x55eb4f08c490 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.054+0000 7f01e5c00640 1 -- 172.21.15.43:0/3806803195 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01e0036040 con 0x55eb4f08c490 2024-07-26T08:36:31.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.054+0000 7f01e5c00640 1 -- 172.21.15.43:0/3806803195 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00046a0 con 0x55eb4f08c490 2024-07-26T08:36:31.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 -- 172.21.15.43:0/3806803195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 msgr2=0x55eb4f45a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01efe00640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01d40b3dc0 0x7f01d40b62d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0097e0 tx=0x7f01dc015040 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:31.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f45a2c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01e002f3d0 tx=0x7f01e002f400 comp rx=0 tx=0).stop 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 -- 172.21.15.43:0/3806803195 shutdown_connections 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f094670 0x55eb4f45a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f45a2c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 --2- 172.21.15.43:0/3806803195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f0b5350 0x55eb4f459d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 -- 172.21.15.43:0/3806803195 >> 172.21.15.43:0/3806803195 conn(0x55eb4f0a9740 msgr2=0x55eb4f457c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 -- 172.21.15.43:0/3806803195 shutdown_connections 2024-07-26T08:36:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.055+0000 7f01fe272740 1 -- 172.21.15.43:0/3806803195 wait complete. 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.056+0000 7f01fe272740 1 -- start start 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.056+0000 7f01fe272740 1 Processor -- start 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 0x55eb4f4653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f0b5350 0x55eb4f465e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f223890 con 0x55eb4f094670 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f35c320 con 0x55eb4f0b5350 2024-07-26T08:36:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eb4f468380 con 0x55eb4f08c490 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01fe272740 10 client.0 _ll_register_callbacks cb 0x55eb4f388000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 0x55eb4f4653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01efe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 0x55eb4f4653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44776/0 (socket says 172.21.15.43:44776) 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01f4c00640 1 -- 172.21.15.43:0/911050475 learned_addr learned my addr 172.21.15.43:0/911050475 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.057+0000 7f01f5600640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f0b5350 0x55eb4f465e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f5600640 1 -- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 msgr2=0x55eb4f4653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f5600640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 0x55eb4f4653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f5600640 1 -- 172.21.15.43:0/911050475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 msgr2=0x55eb4f465920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f5600640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f5600640 1 -- 172.21.15.43:0/911050475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb4f4718a0 con 0x55eb4f0b5350 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f4c00640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 0x55eb4f4653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01f5600640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f0b5350 0x55eb4f465e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f01e80e1650 tx=0x7f01e80aa760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8112858849b18140 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01da000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01da000640 1 -- 172.21.15.43:0/911050475 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e801c040 con 0x55eb4f0b5350 2024-07-26T08:36:31.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01da000640 1 -- 172.21.15.43:0/911050475 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7f01e8092110 con 0x55eb4f0b5350 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.058+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e0036040 con 0x55eb4f0b5350 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01da000640 1 -- 172.21.15.43:0/911050475 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f01e80af110 con 0x55eb4f0b5350 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 10 client.25856 fetch_fsmap learned FSMap version 51 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55eb4f474230 con 0x55eb4f0b5350 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01da000640 1 -- 172.21.15.43:0/911050475 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01e0036040 con 0x55eb4f0b5350 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01da000640 1 -- 172.21.15.43:0/911050475 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f01e8090bb0 con 0x55eb4f0b5350 2024-07-26T08:36:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 10 client.25856 fetch_fsmap finished waiting for FSMap version 51 2024-07-26T08:36:31.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 10 client.25856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:31.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 20 client.25856 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:31.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f073cd0 0x55eb4f4776e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 4 client.25856 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:36:31.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.059+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb4f3d2b30 con 0x55eb4f073cd0 2024-07-26T08:36:31.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.060+0000 7f01f4c00640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f073cd0 0x55eb4f4776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.060+0000 7f01f4c00640 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f073cd0 0x55eb4f4776e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=347f146d3430a94d server_cookie=463009135e88a715 in_seq=0 out_seq=0 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.060+0000 7f01da000640 10 client.25856 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.061+0000 7f01da000640 1 -- 172.21.15.43:0/911050475 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb4f3d2b30 con 0x55eb4f073cd0 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.061+0000 7f01da000640 10 client.25856 handle_command_reply: tid=0 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.061+0000 7f01fe272740 1 client.25856 shutdown 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f0b5350 msgr2=0x55eb4f465e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f0b5350 0x55eb4f465e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f01e80e1650 tx=0x7f01e80aa760 comp rx=0 tx=0).stop 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 shutdown_connections 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f073cd0 0x55eb4f4776e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f0b5350 0x55eb4f465e60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 --2- 172.21.15.43:0/911050475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f08c490 0x55eb4f4653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 >> 172.21.15.43:0/911050475 conn(0x55eb4f0a9740 msgr2=0x55eb4f45cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:31.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01da000640 0 client.25856 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:31.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 shutdown_connections 2024-07-26T08:36:31.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 1 -- 172.21.15.43:0/911050475 wait complete. 2024-07-26T08:36:31.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.062+0000 7f01fe272740 20 client.25856 trim_cache size 0 max 16384 2024-07-26T08:36:31.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.082+0000 7f01fe272740 1 Processor -- start 2024-07-26T08:36:31.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.082+0000 7f01fe272740 1 -- start start 2024-07-26T08:36:31.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.082+0000 7f01fe272740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f460bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01fe272740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01fe272740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f47cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01fe272740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01b5720 con 0x55eb4f094670 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01fe272740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01b2f90 con 0x55eb4f08c490 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01fe272740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01b0de0 con 0x55eb4f0b5350 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f460bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f460bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:59972/0 (socket says 172.21.15.43:59972) 2024-07-26T08:36:31.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f4c00640 1 -- 172.21.15.43:0/926632974 learned_addr learned my addr 172.21.15.43:0/926632974 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:31.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f5600640 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f47cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f4c00640 1 -- 172.21.15.43:0/926632974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 msgr2=0x55eb4f47cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f4c00640 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f47cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01f4c00640 1 -- 172.21.15.43:0/926632974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 msgr2=0x55eb4f465d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.083+0000 7f01efe00640 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.084+0000 7f01f4c00640 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.084+0000 7f01f4c00640 1 -- 172.21.15.43:0/926632974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4f45ab90 con 0x55eb4f08c490 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.084+0000 7f01efe00640 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.084+0000 7f01f4c00640 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f460bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f01e00094e0 tx=0x7f01e00095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1749f95095f69c4f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.084+0000 7f01e5200640 1 -- 172.21.15.43:0/926632974 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e005e070 con 0x55eb4f08c490 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.084+0000 7f01e5200640 1 -- 172.21.15.43:0/926632974 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01e0036040 con 0x55eb4f08c490 2024-07-26T08:36:31.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.085+0000 7f01e5200640 1 -- 172.21.15.43:0/926632974 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0003fa0 con 0x55eb4f08c490 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.085+0000 7f01fe272740 1 -- 172.21.15.43:0/926632974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 msgr2=0x55eb4f460bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.085+0000 7f01fe272740 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f460bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f01e00094e0 tx=0x7f01e00095c0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 -- 172.21.15.43:0/926632974 shutdown_connections 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f47cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f094670 0x55eb4f465d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 --2- 172.21.15.43:0/926632974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f08c490 0x55eb4f460bc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 -- 172.21.15.43:0/926632974 >> 172.21.15.43:0/926632974 conn(0x55eb4f0a9740 msgr2=0x55eb4f4568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:31.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 -- 172.21.15.43:0/926632974 shutdown_connections 2024-07-26T08:36:31.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 -- 172.21.15.43:0/926632974 wait complete. 2024-07-26T08:36:31.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 -- start start 2024-07-26T08:36:31.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.086+0000 7f01fe272740 1 Processor -- start 2024-07-26T08:36:31.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 0x55eb4f4697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f094670 0x55eb4f469ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f46a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01b1450 con 0x55eb4f08c490 2024-07-26T08:36:31.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01b28c0 con 0x55eb4f094670 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01b1b20 con 0x55eb4f0b5350 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.087+0000 7f01fe272740 10 client.0 _ll_register_callbacks cb 0x7f01e80a6a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 0x55eb4f4697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01efe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f094670 0x55eb4f469ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 0x55eb4f4697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42884/0 (socket says 172.21.15.43:42884) 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 -- 172.21.15.43:0/3708765125 learned_addr learned my addr 172.21.15.43:0/3708765125 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f5600640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f46a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 -- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 msgr2=0x55eb4f46a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f46a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 -- 172.21.15.43:0/3708765125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f094670 msgr2=0x55eb4f469ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f094670 0x55eb4f469ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f4c00640 1 -- 172.21.15.43:0/3708765125 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb4f4df0c0 con 0x55eb4f08c490 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01f5600640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f46a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.088+0000 7f01efe00640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f094670 0x55eb4f469ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01f4c00640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 0x55eb4f4697a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01e002f3a0 tx=0x7f01e002f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcddeb17679a138 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01da000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01da000640 1 -- 172.21.15.43:0/3708765125 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0068060 con 0x55eb4f08c490 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e0036040 con 0x55eb4f08c490 2024-07-26T08:36:31.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01da000640 1 -- 172.21.15.43:0/3708765125 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7f01e0003d20 con 0x55eb4f08c490 2024-07-26T08:36:31.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01da000640 1 -- 172.21.15.43:0/3708765125 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f01e005e070 con 0x55eb4f08c490 2024-07-26T08:36:31.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01fe272740 10 client.15717 fetch_fsmap learned FSMap version 51 2024-07-26T08:36:31.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.089+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55eb4f4e02f0 con 0x55eb4f08c490 2024-07-26T08:36:31.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01da000640 1 -- 172.21.15.43:0/3708765125 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01e0036040 con 0x55eb4f08c490 2024-07-26T08:36:31.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01da000640 1 -- 172.21.15.43:0/3708765125 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f01e0044070 con 0x55eb4f08c490 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01fe272740 10 client.15717 fetch_fsmap finished waiting for FSMap version 51 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01fe272740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01fe272740 20 client.15717 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01fe272740 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f049080 0x55eb4f4e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01fe272740 4 client.15717 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.090+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55eb4f3ce5d0 con 0x55eb4f049080 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.091+0000 7f01efe00640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f049080 0x55eb4f4e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.091+0000 7f01efe00640 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f049080 0x55eb4f4e2770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7a0264607e7c63 server_cookie=97dd8d0cc53ad414 in_seq=0 out_seq=0 2024-07-26T08:36:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.091+0000 7f01da000640 10 client.15717 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01da000640 1 -- 172.21.15.43:0/3708765125 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55eb4f3ce5d0 con 0x55eb4f049080 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01da000640 10 client.15717 handle_command_reply: tid=0 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01fe272740 1 client.15717 shutdown 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 msgr2=0x55eb4f4697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01fe272740 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 0x55eb4f4697a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01e002f3a0 tx=0x7f01e002f3d0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 shutdown_connections 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01fe272740 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eb4f049080 0x55eb4f4e2770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.093+0000 7f01fe272740 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb4f0b5350 0x55eb4f46a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01fe272740 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eb4f094670 0x55eb4f469ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01fe272740 1 --2- 172.21.15.43:0/3708765125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb4f08c490 0x55eb4f4697a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 >> 172.21.15.43:0/3708765125 conn(0x55eb4f0a9740 msgr2=0x55eb4f466850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:31.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01da000640 0 client.15717 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 shutdown_connections 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01fe272740 1 -- 172.21.15.43:0/3708765125 wait complete. 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.094+0000 7f01fe272740 20 client.15717 trim_cache size 0 max 16384 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stdout: "return_code": 0, 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": "asynchronous" 2024-07-26T08:36:31.097 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:36:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.095+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01d40b3dc0 msgr2=0x7f01d40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.095+0000 7f01f7600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01d40b3dc0 0x7f01d40b62d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0097e0 tx=0x7f01dc015040 comp rx=0 tx=0).stop 2024-07-26T08:36:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.095+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0109820 msgr2=0x7f01f01a19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.095+0000 7f01f7600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0109820 0x7f01f01a19b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01e800e970 tx=0x7f01e800ee30 comp rx=0 tx=0).stop 2024-07-26T08:36:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 shutdown_connections 2024-07-26T08:36:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f01d40b3dc0 0x7f01d40b62d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01f0108ed0 0x7f01f019c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01f0109820 0x7f01f01a19b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 --2- 172.21.15.43:0/3419951572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f0103590 0x7f01f019c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 >> 172.21.15.43:0/3419951572 conn(0x7f01f007b280 msgr2=0x7f01f0106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 shutdown_connections 2024-07-26T08:36:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:31.096+0000 7f01f7600640 1 -- 172.21.15.43:0/3419951572 wait complete. 2024-07-26T08:36:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:31 smithi043 ceph-mon[32384]: scrub queued for path: / 2024-07-26T08:36:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:31 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:36:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:31 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:36:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:31 smithi133 ceph-mon[37053]: scrub queued for path: / 2024-07-26T08:36:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:31 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:36:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:31 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:36:31.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:31 smithi063 ceph-mon[36747]: scrub queued for path: / 2024-07-26T08:36:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:31 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:36:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:31 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:36:32.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:36:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:32 smithi043 ceph-mon[32384]: pgmap v590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:36:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:32 smithi043 ceph-mon[32384]: scrub summary: active paths [/] 2024-07-26T08:36:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:32 smithi133 ceph-mon[37053]: pgmap v590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:36:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:32 smithi133 ceph-mon[37053]: scrub summary: active paths [/] 2024-07-26T08:36:32.551 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:36:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:32 smithi063 ceph-mon[36747]: pgmap v590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:36:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:32 smithi063 ceph-mon[36747]: scrub summary: active paths [/] 2024-07-26T08:36:34.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:34 smithi043 ceph-mon[32384]: pgmap v591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-07-26T08:36:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:34 smithi133 ceph-mon[37053]: pgmap v591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-07-26T08:36:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:34 smithi063 ceph-mon[36747]: pgmap v591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-07-26T08:36:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 -- 172.21.15.43:0/2748245961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c076db0 msgr2=0x7fd50c0751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 --2- 172.21.15.43:0/2748245961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c076db0 0x7fd50c0751e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009ca0 tx=0x7fd4fc02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 -- 172.21.15.43:0/2748245961 shutdown_connections 2024-07-26T08:36:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 --2- 172.21.15.43:0/2748245961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c113e60 0x7fd50c116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 --2- 172.21.15.43:0/2748245961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd50c075800 0x7fd50c075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 --2- 172.21.15.43:0/2748245961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c076db0 0x7fd50c0751e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 -- 172.21.15.43:0/2748245961 >> 172.21.15.43:0/2748245961 conn(0x7fd50c07b280 msgr2=0x7fd50c07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 -- 172.21.15.43:0/2748245961 shutdown_connections 2024-07-26T08:36:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.033+0000 7fd511800640 1 -- 172.21.15.43:0/2748245961 wait complete. 2024-07-26T08:36:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.035+0000 7fd511800640 1 Processor -- start 2024-07-26T08:36:35.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.035+0000 7fd511800640 1 -- start start 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd511800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 0x7fd50c1a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd511800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd50c076db0 0x7fd50c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd511800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c113e60 0x7fd50c1a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd511800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c119c10 con 0x7fd50c076db0 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd511800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c119a90 con 0x7fd50c075800 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd511800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c119d90 con 0x7fd50c113e60 2024-07-26T08:36:35.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 0x7fd50c1a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd50c076db0 0x7fd50c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 0x7fd50c1a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:42766/0 (socket says 172.21.15.43:42766) 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 -- 172.21.15.43:0/1070571911 learned_addr learned my addr 172.21.15.43:0/1070571911 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50b400640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c113e60 0x7fd50c1a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 -- 172.21.15.43:0/1070571911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c113e60 msgr2=0x7fd50c1a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c113e60 0x7fd50c1a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 -- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd50c076db0 msgr2=0x7fd50c1a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd50c076db0 0x7fd50c1a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.036+0000 7fd50aa00640 1 -- 172.21.15.43:0/1070571911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c1a64b0 con 0x7fd50c075800 2024-07-26T08:36:35.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.037+0000 7fd50aa00640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 0x7fd50c1a0540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc004af0 tx=0x7fd4fc003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.037+0000 7fd503400640 1 -- 172.21.15.43:0/1070571911 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc031650 con 0x7fd50c075800 2024-07-26T08:36:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.037+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c1a6740 con 0x7fd50c075800 2024-07-26T08:36:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.037+0000 7fd503400640 1 -- 172.21.15.43:0/1070571911 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd4fc0317f0 con 0x7fd50c075800 2024-07-26T08:36:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.037+0000 7fd503400640 1 -- 172.21.15.43:0/1070571911 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc02f9e0 con 0x7fd50c075800 2024-07-26T08:36:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.037+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c1acf00 con 0x7fd50c075800 2024-07-26T08:36:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.042+0000 7fd5183bc740 1 Processor -- start 2024-07-26T08:36:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.042+0000 7fd5183bc740 1 -- start start 2024-07-26T08:36:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9acb2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acb2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd5183bc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ba9ac28bc0 con 0x55ba9a90d070 2024-07-26T08:36:35.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd5183bc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ba9ac180c0 con 0x55ba9a8ec390 2024-07-26T08:36:35.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd5183bc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ba9ac1c100 con 0x55ba9a8e41b0 2024-07-26T08:36:35.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd503400640 1 -- 172.21.15.43:0/1070571911 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd4fc02fba0 con 0x7fd50c075800 2024-07-26T08:36:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd50b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9acb2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd50b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9acb2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41410/0 (socket says 172.21.15.43:41410) 2024-07-26T08:36:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.043+0000 7fd50b400640 1 -- 172.21.15.43:0/532545202 learned_addr learned my addr 172.21.15.43:0/532545202 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50aa00640 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50a000640 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acb2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50b400640 1 -- 172.21.15.43:0/532545202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 msgr2=0x55ba9acb2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50b400640 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50b400640 1 -- 172.21.15.43:0/532545202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 msgr2=0x55ba9acb2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50b400640 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acb2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50b400640 1 -- 172.21.15.43:0/532545202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9a978650 con 0x55ba9a90d070 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.044+0000 7fd50b400640 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9acb2010 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd504009ca0 tx=0x7fd504011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78540903c8e96ad4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.045+0000 7fd4fbe00640 1 -- 172.21.15.43:0/532545202 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50401e070 con 0x55ba9a90d070 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.045+0000 7fd4fbe00640 1 -- 172.21.15.43:0/532545202 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd504009e50 con 0x55ba9a90d070 2024-07-26T08:36:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.045+0000 7fd4fbe00640 1 -- 172.21.15.43:0/532545202 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50400ea40 con 0x55ba9a90d070 2024-07-26T08:36:35.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.045+0000 7fd503400640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd4f00b3dc0 0x7fd4f00b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd503400640 1 -- 172.21.15.43:0/1070571911 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7fd4fc1057f0 con 0x7fd50c075800 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd50aa00640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd4f00b3dc0 0x7fd4f00b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 -- 172.21.15.43:0/532545202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 msgr2=0x55ba9acb2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9acb2010 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd504009ca0 tx=0x7fd504011810 comp rx=0 tx=0).stop 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 -- 172.21.15.43:0/532545202 shutdown_connections 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acb2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 --2- 172.21.15.43:0/532545202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9acb2010 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 -- 172.21.15.43:0/532545202 >> 172.21.15.43:0/532545202 conn(0x55ba9a901460 msgr2=0x55ba9acaff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 -- 172.21.15.43:0/532545202 shutdown_connections 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.046+0000 7fd5183bc740 1 -- 172.21.15.43:0/532545202 wait complete. 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.047+0000 7fd50aa00640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd4f00b3dc0 0x7fd4f00b62d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc102c00 tx=0x7fd4fc02a8c0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.047+0000 7fd5183bc740 1 -- start start 2024-07-26T08:36:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.047+0000 7fd5183bc740 1 Processor -- start 2024-07-26T08:36:35.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acbd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ba9aa7b700 con 0x55ba9a8ec390 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ba9abb4690 con 0x55ba9a90d070 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ba9acc07f0 con 0x55ba9a8e41b0 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd5183bc740 10 client.0 _ll_register_callbacks cb 0x55ba9abc4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd50b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acbd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd50b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acbd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:32924/0 (socket says 172.21.15.43:32924) 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd50b400640 1 -- 172.21.15.43:0/442824029 learned_addr learned my addr 172.21.15.43:0/442824029 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd50b400640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.048+0000 7fd50a000640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50b400640 1 -- 172.21.15.43:0/442824029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 msgr2=0x55ba9acbe060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50b400640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbe060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50b400640 1 -- 172.21.15.43:0/442824029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 msgr2=0x55ba9acbdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50b400640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50b400640 1 -- 172.21.15.43:0/442824029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba9abcb830 con 0x55ba9a8e41b0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50a000640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd50b400640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acbd5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e740 tx=0x7fd50400e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8f203408ddc141 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.049+0000 7fd4f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd4f8c00640 1 -- 172.21.15.43:0/442824029 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50402d060 con 0x55ba9a8e41b0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd504009e50 con 0x55ba9a8e41b0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd4f8c00640 1 -- 172.21.15.43:0/442824029 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7fd504004050 con 0x55ba9a8e41b0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd4f8c00640 1 -- 172.21.15.43:0/442824029 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd504034050 con 0x55ba9a8e41b0 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd5183bc740 10 client.25897 fetch_fsmap learned FSMap version 51 2024-07-26T08:36:35.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55ba9accc420 con 0x55ba9a8e41b0 2024-07-26T08:36:35.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.050+0000 7fd4f8c00640 1 -- 172.21.15.43:0/442824029 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd504009e50 con 0x55ba9a8e41b0 2024-07-26T08:36:35.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd4f8c00640 1 -- 172.21.15.43:0/442824029 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fd5040035f0 con 0x55ba9a8e41b0 2024-07-26T08:36:35.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd5183bc740 10 client.25897 fetch_fsmap finished waiting for FSMap version 51 2024-07-26T08:36:35.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd5183bc740 10 client.25897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd5183bc740 20 client.25897 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd5183bc740 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8cb9f0 0x55ba9accf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd5183bc740 4 client.25897 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba9ac2ab10 con 0x55ba9a8cb9f0 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.051+0000 7fd50a000640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8cb9f0 0x55ba9accf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.052+0000 7fd50a000640 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8cb9f0 0x55ba9accf840 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7235838065ff7d3 server_cookie=cf1f3e95dc123e4e in_seq=0 out_seq=0 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.052+0000 7fd4f8c00640 10 client.25897 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.053+0000 7fd4f8c00640 1 -- 172.21.15.43:0/442824029 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba9ac2ab10 con 0x55ba9a8cb9f0 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.053+0000 7fd4f8c00640 10 client.25897 handle_command_reply: tid=0 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.053+0000 7fd5183bc740 1 client.25897 shutdown 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.053+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 msgr2=0x55ba9acbd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.053+0000 7fd5183bc740 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acbd5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e740 tx=0x7fd50400e640 comp rx=0 tx=0).stop 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 shutdown_connections 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8cb9f0 0x55ba9accf840 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 --2- 172.21.15.43:0/442824029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acbd5e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd4f8c00640 0 client.25897 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 >> 172.21.15.43:0/442824029 conn(0x55ba9a901460 msgr2=0x55ba9acb51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 shutdown_connections 2024-07-26T08:36:35.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 1 -- 172.21.15.43:0/442824029 wait complete. 2024-07-26T08:36:35.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.054+0000 7fd5183bc740 20 client.25897 trim_cache size 0 max 16384 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.073+0000 7fd5183bc740 1 Processor -- start 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.073+0000 7fd5183bc740 1 -- start start 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd5183bc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1b9b60 con 0x55ba9a8ec390 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd5183bc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1b73d0 con 0x55ba9a90d070 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd5183bc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1b5220 con 0x55ba9a8e41b0 2024-07-26T08:36:35.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd50a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd50a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41434/0 (socket says 172.21.15.43:41434) 2024-07-26T08:36:35.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd50a000640 1 -- 172.21.15.43:0/660995124 learned_addr learned my addr 172.21.15.43:0/660995124 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:35.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.074+0000 7fd50b400640 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50b400640 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50a000640 1 -- 172.21.15.43:0/660995124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 msgr2=0x55ba9acb3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50a000640 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50a000640 1 -- 172.21.15.43:0/660995124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 msgr2=0x55ba9acbdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50a000640 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50a000640 1 -- 172.21.15.43:0/660995124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9acbe8a0 con 0x55ba9a8ec390 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.075+0000 7fd50a000640 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbf4c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009af0 tx=0x7fd4f4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4f466af3f3cebb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.076+0000 7fd4fb400640 1 -- 172.21.15.43:0/660995124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4022070 con 0x55ba9a8ec390 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.076+0000 7fd4fb400640 1 -- 172.21.15.43:0/660995124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd4f40047a0 con 0x55ba9a8ec390 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.076+0000 7fd4fb400640 1 -- 172.21.15.43:0/660995124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f401e6c0 con 0x55ba9a8ec390 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 -- 172.21.15.43:0/660995124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 msgr2=0x55ba9acbf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbf4c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009af0 tx=0x7fd4f4005f90 comp rx=0 tx=0).stop 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 -- 172.21.15.43:0/660995124 shutdown_connections 2024-07-26T08:36:35.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a90d070 0x55ba9acbdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a8ec390 0x55ba9acbf4c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 --2- 172.21.15.43:0/660995124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acb3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 -- 172.21.15.43:0/660995124 >> 172.21.15.43:0/660995124 conn(0x55ba9a901460 msgr2=0x55ba9acbd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 -- 172.21.15.43:0/660995124 shutdown_connections 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 -- 172.21.15.43:0/660995124 wait complete. 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.077+0000 7fd5183bc740 1 -- start start 2024-07-26T08:36:35.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 Processor -- start 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acc1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acc18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9ad2ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1b5890 con 0x55ba9a90d070 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1b6d00 con 0x55ba9a8ec390 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1b5f60 con 0x55ba9a8e41b0 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd5183bc740 10 client.0 _ll_register_callbacks cb 0x7fd504005680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.078+0000 7fd50b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9ad2ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acc1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acc18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acc1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:32954/0 (socket says 172.21.15.43:32954) 2024-07-26T08:36:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 -- 172.21.15.43:0/2374545700 learned_addr learned my addr 172.21.15.43:0/2374545700 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 -- 172.21.15.43:0/2374545700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 msgr2=0x55ba9acc18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acc18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 -- 172.21.15.43:0/2374545700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 msgr2=0x55ba9ad2ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9ad2ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 -- 172.21.15.43:0/2374545700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba9ad305b0 con 0x55ba9a8e41b0 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50a000640 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acc18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd50b400640 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acc1310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e610 tx=0x7fd504000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=489be774c482d640 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.079+0000 7fd4f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.080+0000 7fd4f8c00640 1 -- 172.21.15.43:0/2374545700 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50402d040 con 0x55ba9a8e41b0 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.080+0000 7fd4f8c00640 1 -- 172.21.15.43:0/2374545700 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9796+0+0 (secure 0 0 0) 0x7fd504003f60 con 0x55ba9a8e41b0 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.080+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4f40047a0 con 0x55ba9a8e41b0 2024-07-26T08:36:35.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.080+0000 7fd4f8c00640 1 -- 172.21.15.43:0/2374545700 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd50401e070 con 0x55ba9a8e41b0 2024-07-26T08:36:35.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.080+0000 7fd5183bc740 10 client.25903 fetch_fsmap learned FSMap version 51 2024-07-26T08:36:35.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.080+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55ba9ad378e0 con 0x55ba9a8e41b0 2024-07-26T08:36:35.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd4f8c00640 1 -- 172.21.15.43:0/2374545700 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd4f40047a0 con 0x55ba9a8e41b0 2024-07-26T08:36:35.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd4f8c00640 1 -- 172.21.15.43:0/2374545700 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fd504019900 con 0x55ba9a8e41b0 2024-07-26T08:36:35.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd5183bc740 10 client.25903 fetch_fsmap finished waiting for FSMap version 51 2024-07-26T08:36:35.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd5183bc740 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:36:35.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd5183bc740 20 client.25903 populate_metadata read hostname 'smithi043' 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd5183bc740 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8a0da0 0x55ba9ad39ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd5183bc740 4 client.25903 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba9ac265b0 con 0x55ba9a8a0da0 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.081+0000 7fd50a000640 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8a0da0 0x55ba9ad39ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd50a000640 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8a0da0 0x55ba9ad39ef0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f092ce9f2a2edfdd server_cookie=ccd9daaeb1e3e48e in_seq=0 out_seq=0 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd4f8c00640 10 client.25903 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd4f8c00640 1 -- 172.21.15.43:0/2374545700 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55ba9ac265b0 con 0x55ba9a8a0da0 2024-07-26T08:36:35.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd4f8c00640 10 client.25903 handle_command_reply: tid=0 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 client.25903 shutdown 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 msgr2=0x55ba9acc1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acc1310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e610 tx=0x7fd504000bc0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 shutdown_connections 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55ba9a8a0da0 0x55ba9ad39ef0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba9a90d070 0x55ba9ad2ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ba9a8ec390 0x55ba9acc18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd5183bc740 1 --2- 172.21.15.43:0/2374545700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba9a8e41b0 0x55ba9acc1310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.082+0000 7fd4f8c00640 0 client.25903 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.083+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 >> 172.21.15.43:0/2374545700 conn(0x55ba9a901460 msgr2=0x55ba9acbf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.083+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 shutdown_connections 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.083+0000 7fd5183bc740 1 -- 172.21.15.43:0/2374545700 wait complete. 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.083+0000 7fd5183bc740 20 client.25903 trim_cache size 0 max 16384 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:36:35.089 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (2 inodes in the stack)", 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:36:35.090 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd4f00b3dc0 msgr2=0x7fd4f00b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd4f00b3dc0 0x7fd4f00b62d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc102c00 tx=0x7fd4fc02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 msgr2=0x7fd50c1a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 0x7fd50c1a0540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc004af0 tx=0x7fd4fc003d80 comp rx=0 tx=0).stop 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 shutdown_connections 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd4f00b3dc0 0x7fd4f00b62d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c113e60 0x7fd50c1a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd50c076db0 0x7fd50c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 --2- 172.21.15.43:0/1070571911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd50c075800 0x7fd50c1a0540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:36:35.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 >> 172.21.15.43:0/1070571911 conn(0x7fd50c07b280 msgr2=0x7fd50c112730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:36:35.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 shutdown_connections 2024-07-26T08:36:35.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:36:35.084+0000 7fd511800640 1 -- 172.21.15.43:0/1070571911 wait complete. 2024-07-26T08:36:36.108 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:36:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:36 smithi043 ceph-mon[32384]: pgmap v592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-07-26T08:36:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:36 smithi133 ceph-mon[37053]: pgmap v592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-07-26T08:36:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:36 smithi063 ceph-mon[36747]: pgmap v592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-07-26T08:36:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:38 smithi043 ceph-mon[32384]: pgmap v593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-07-26T08:36:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:38 smithi133 ceph-mon[37053]: pgmap v593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-07-26T08:36:38.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:38 smithi063 ceph-mon[36747]: pgmap v593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-07-26T08:36:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:40 smithi043 ceph-mon[32384]: pgmap v594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-07-26T08:36:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:40 smithi133 ceph-mon[37053]: pgmap v594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-07-26T08:36:40.560 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:40 smithi063 ceph-mon[36747]: pgmap v594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-07-26T08:36:40.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:36:40.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 systemd[1]: Stopped Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:40.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 2.125s CPU time. 2024-07-26T08:36:40.561 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 systemd[1]: Starting Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:36:40.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 podman[71414]: 2024-07-26 08:36:40.463099857 +0000 UTC m=+0.018120261 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:36:40.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 podman[71414]: 2024-07-26 08:36:40.562133181 +0000 UTC m=+0.117153569 container create ecb4dd343e2ae8f07745ec9747c496ae334a80482147b468c7d238e3025b397e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-07-26T08:36:41.193 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 podman[71414]: 2024-07-26 08:36:40.873946548 +0000 UTC m=+0.428966937 container init ecb4dd343e2ae8f07745ec9747c496ae334a80482147b468c7d238e3025b397e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:36:41.193 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 podman[71414]: 2024-07-26 08:36:40.8768044 +0000 UTC m=+0.431824790 container start ecb4dd343e2ae8f07745ec9747c496ae334a80482147b468c7d238e3025b397e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:36:41.193 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 ceph-mds[71434]: -- 172.21.15.63:0/4111582675 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fdc99a5860 con 0x55fdcdb47600 2024-07-26T08:36:41.193 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: starting mds.h at 2024-07-26T08:36:41.193 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 bash[71414]: ecb4dd343e2ae8f07745ec9747c496ae334a80482147b468c7d238e3025b397e 2024-07-26T08:36:41.194 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:40 smithi063 systemd[1]: Started Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: daemon mds.h restarted 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: osdmap e95: 12 total, 12 up, 12 in 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:boot 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:41 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: daemon mds.h restarted 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: osdmap e95: 12 total, 12 up, 12 in 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:boot 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:41 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:41.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: daemon mds.h restarted 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: osdmap e95: 12 total, 12 up, 12 in 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:boot 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:41 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:42 smithi043 ceph-mon[32384]: pgmap v596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-07-26T08:36:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:42 smithi133 ceph-mon[37053]: pgmap v596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-07-26T08:36:42.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:42 smithi063 ceph-mon[36747]: pgmap v596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-07-26T08:36:43.472 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:43 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:resolve 2024-07-26T08:36:43.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:43 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:43.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:43 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:resolve 2024-07-26T08:36:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:43 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:43.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:43 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:resolve 2024-07-26T08:36:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:43 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:44 smithi043 ceph-mon[32384]: pgmap v597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6 op/s 2024-07-26T08:36:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:44 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:36:44.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:44 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:reconnect 2024-07-26T08:36:44.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:44 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:44.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:44 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:44 smithi133 ceph-mon[37053]: pgmap v597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6 op/s 2024-07-26T08:36:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:44 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:36:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:44 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:reconnect 2024-07-26T08:36:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:44 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:44 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-mon[36747]: pgmap v597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6 op/s 2024-07-26T08:36:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:36:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:reconnect 2024-07-26T08:36:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:45.205 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:36:45.205 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: *** Caught signal (Aborted) ** 2024-07-26T08:36:45.205 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: in thread 7f2f93647640 thread_name:ms_dispatch 2024-07-26T08:36:45.205 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:45.205 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f98a1e6f0] 2024-07-26T08:36:45.205 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f98a6b94c] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 3: raise() 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 4: abort() 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f98a0871b] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f98a17386] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650e3a656b9] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650e3c2380c] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650e3b632ca] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650e3b33753] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650e3b34a1b] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650e3b18752] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650e3a66a56] 2024-07-26T08:36:45.206 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650e3a6a637] 2024-07-26T08:36:45.207 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650e3a6af5e] 2024-07-26T08:36:45.207 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650e3a4e03a] 2024-07-26T08:36:45.207 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f992eb407] 2024-07-26T08:36:45.207 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f992ebcf9] 2024-07-26T08:36:45.207 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f993c85a1] 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f99175cdd] 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f99175cf9] 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f98a69c02] 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f98aeec40] 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:44.839+0000 7f2f93647640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: in thread 7f2f93647640 thread_name:ms_dispatch 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f98a1e6f0] 2024-07-26T08:36:45.208 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f98a6b94c] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 3: raise() 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 4: abort() 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f98a0871b] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f98a17386] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650e3a656b9] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650e3c2380c] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650e3b632ca] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650e3b33753] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650e3b34a1b] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650e3b18752] 2024-07-26T08:36:45.209 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650e3a66a56] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650e3a6a637] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650e3a6af5e] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650e3a4e03a] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f992eb407] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f992ebcf9] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f993c85a1] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f99175cdd] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f99175cf9] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f98a69c02] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f98aeec40] 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:45.210 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 0> 2024-07-26T08:36:44.839+0000 7f2f93647640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: in thread 7f2f93647640 thread_name:ms_dispatch 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f98a1e6f0] 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f98a6b94c] 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 3: raise() 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 4: abort() 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f98a0871b] 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f98a17386] 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650e3a656b9] 2024-07-26T08:36:45.211 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650e3c2380c] 2024-07-26T08:36:45.212 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650e3b632ca] 2024-07-26T08:36:45.212 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650e3b33753] 2024-07-26T08:36:45.212 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650e3b34a1b] 2024-07-26T08:36:45.212 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650e3b18752] 2024-07-26T08:36:45.213 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650e3a66a56] 2024-07-26T08:36:45.213 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650e3a6a637] 2024-07-26T08:36:45.213 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650e3a6af5e] 2024-07-26T08:36:45.213 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650e3a4e03a] 2024-07-26T08:36:45.213 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f992eb407] 2024-07-26T08:36:45.214 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f992ebcf9] 2024-07-26T08:36:45.214 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f993c85a1] 2024-07-26T08:36:45.214 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f99175cdd] 2024-07-26T08:36:45.214 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f99175cf9] 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f98a69c02] 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f98aeec40] 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 0> 2024-07-26T08:36:44.839+0000 7f2f93647640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: in thread 7f2f93647640 thread_name:ms_dispatch 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f98a1e6f0] 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f98a6b94c] 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 3: raise() 2024-07-26T08:36:45.215 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 4: abort() 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f98a0871b] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f98a17386] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650e3a656b9] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650e3c2380c] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650e3b632ca] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650e3b33753] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650e3b34a1b] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650e3b18752] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650e3a66a56] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650e3a6a637] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650e3a6af5e] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650e3a4e03a] 2024-07-26T08:36:45.216 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f992eb407] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f992ebcf9] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f993c85a1] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f99175cdd] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f99175cf9] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f98a69c02] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f98aeec40] 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71280]: 2024-07-26T08:36:45.217 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:44 smithi063 podman[71551]: 2024-07-26 08:36:44.923154939 +0000 UTC m=+0.031069497 container died fb53233a80946e5e16bc4cdc3de135df58cd6279af794d26d0587965a55c7a75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:rejoin 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:active 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.556 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:rejoin 2024-07-26T08:36:45.556 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:45.556 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:active 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.558 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:rejoin 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2003000329,v1:172.21.15.63:6839/2003000329] up:active 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.561 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:36:45.807 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:45 smithi063 podman[71551]: 2024-07-26 08:36:45.555259563 +0000 UTC m=+0.663174177 container remove fb53233a80946e5e16bc4cdc3de135df58cd6279af794d26d0587965a55c7a75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T08:36:45.808 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:36:46.015 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:36:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:36:45.751+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:36:46.067 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T08:36:46.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 1.990s CPU time. 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: pgmap v598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:36:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: pgmap v598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:36:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:36:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: pgmap v598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:36:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:36:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:36:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:36:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:36:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:36:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:36:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:36:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:48 smithi133 ceph-mon[37053]: pgmap v599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:36:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:48 smithi063 ceph-mon[36747]: pgmap v599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:36:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:48 smithi043 ceph-mon[32384]: pgmap v599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:36:50.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:50 smithi133 ceph-mon[37053]: pgmap v600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-07-26T08:36:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:50 smithi063 ceph-mon[36747]: pgmap v600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-07-26T08:36:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:50 smithi043 ceph-mon[32384]: pgmap v600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-07-26T08:36:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:52 smithi133 ceph-mon[37053]: pgmap v601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-07-26T08:36:52.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:52 smithi043 ceph-mon[32384]: pgmap v601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-07-26T08:36:52.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:52 smithi063 ceph-mon[36747]: pgmap v601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-07-26T08:36:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:54 smithi133 ceph-mon[37053]: pgmap v602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-07-26T08:36:54.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:54 smithi063 ceph-mon[36747]: pgmap v602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-07-26T08:36:54.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:54 smithi043 ceph-mon[32384]: pgmap v602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-07-26T08:36:56.263 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:36:56.263 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:55 smithi063 systemd[1]: Stopped Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:56.264 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 1.990s CPU time. 2024-07-26T08:36:56.264 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:55 smithi063 systemd[1]: Starting Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:36:56.264 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 podman[71702]: 2024-07-26 08:36:56.039511369 +0000 UTC m=+0.097992176 container create ebd2e533b4c5b8bff4b06fd6bb633f006c8472894b83474e8117bca1a8fa0eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-07-26T08:36:56.264 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 podman[71702]: 2024-07-26 08:36:55.959630736 +0000 UTC m=+0.018111559 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:36:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:56 smithi133 ceph-mon[37053]: pgmap v603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-07-26T08:36:56.535 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:56 smithi063 ceph-mon[36747]: pgmap v603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-07-26T08:36:56.535 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 podman[71702]: 2024-07-26 08:36:56.442228709 +0000 UTC m=+0.500709531 container init ebd2e533b4c5b8bff4b06fd6bb633f006c8472894b83474e8117bca1a8fa0eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T08:36:56.535 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 podman[71702]: 2024-07-26 08:36:56.44490719 +0000 UTC m=+0.503388006 container start ebd2e533b4c5b8bff4b06fd6bb633f006c8472894b83474e8117bca1a8fa0eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-07-26T08:36:56.535 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 ceph-mds[71720]: -- 172.21.15.63:0/3457081309 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55896dcfb860 con 0x558971e9d600 2024-07-26T08:36:56.535 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: starting mds.b at 2024-07-26T08:36:56.535 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 bash[71702]: ebd2e533b4c5b8bff4b06fd6bb633f006c8472894b83474e8117bca1a8fa0eb4 2024-07-26T08:36:56.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:56 smithi043 ceph-mon[32384]: pgmap v603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-07-26T08:36:56.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:36:56 smithi063 systemd[1]: Started Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: daemon mds.b restarted 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: osdmap e96: 12 total, 12 up, 12 in 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:boot 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:57 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: daemon mds.b restarted 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: osdmap e96: 12 total, 12 up, 12 in 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:boot 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:36:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:57.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:57 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:57.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: daemon mds.b restarted 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: osdmap e96: 12 total, 12 up, 12 in 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:boot 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:36:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:57 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:58.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:58 smithi043 ceph-mon[32384]: pgmap v605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-07-26T08:36:58.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:58 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:resolve 2024-07-26T08:36:58.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:58 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:58 smithi063 ceph-mon[36747]: pgmap v605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-07-26T08:36:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:58 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:resolve 2024-07-26T08:36:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:58 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:58 smithi133 ceph-mon[37053]: pgmap v605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-07-26T08:36:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:58 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:resolve 2024-07-26T08:36:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:58 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:36:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:reconnect 2024-07-26T08:36:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-mon[36747]: pgmap v606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-07-26T08:36:59.841 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:59 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:36:59.841 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:59 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:reconnect 2024-07-26T08:36:59.841 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:59 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:36:59.841 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:59 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:36:59.841 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:36:59 smithi043 ceph-mon[32384]: pgmap v606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-07-26T08:37:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:59 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:37:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:59 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:reconnect 2024-07-26T08:37:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:59 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:59 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:37:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:36:59 smithi133 ceph-mon[37053]: pgmap v606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-07-26T08:37:00.318 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: *** Caught signal (Aborted) ** 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: in thread 7f6686508640 thread_name:ms_dispatch 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f668b8df6f0] 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f668b92c94c] 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 3: raise() 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 4: abort() 2024-07-26T08:37:00.319 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 5: /lib64/libc.so.6(+0x2871b) [0x7f668b8c971b] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 6: /lib64/libc.so.6(+0x37386) [0x7f668b8d8386] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55fdc7de16b9] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55fdc7f9f80c] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55fdc7edf2ca] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55fdc7eaf753] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55fdc7eb0a1b] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55fdc7e94752] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55fdc7de2a56] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55fdc7de6637] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55fdc7de6f5e] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55fdc7dca03a] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f668c1ac407] 2024-07-26T08:37:00.320 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 18: (DispatchQueue::entry()+0x60f) [0x7f668c1accf9] 2024-07-26T08:37:00.321 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f668c2895a1] 2024-07-26T08:37:00.321 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 20: (Thread::entry_wrapper()+0x43) [0x7f668c036cdd] 2024-07-26T08:37:00.321 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 21: (Thread::_entry_func(void*)+0xd) [0x7f668c036cf9] 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 22: /lib64/libc.so.6(+0x89c02) [0x7f668b92ac02] 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f668b9afc40] 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:36:59.845+0000 7f6686508640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: in thread 7f6686508640 thread_name:ms_dispatch 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f668b8df6f0] 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f668b92c94c] 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 3: raise() 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 4: abort() 2024-07-26T08:37:00.322 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 5: /lib64/libc.so.6(+0x2871b) [0x7f668b8c971b] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 6: /lib64/libc.so.6(+0x37386) [0x7f668b8d8386] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55fdc7de16b9] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55fdc7f9f80c] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55fdc7edf2ca] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55fdc7eaf753] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55fdc7eb0a1b] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55fdc7e94752] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55fdc7de2a56] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55fdc7de6637] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55fdc7de6f5e] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55fdc7dca03a] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f668c1ac407] 2024-07-26T08:37:00.323 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 18: (DispatchQueue::entry()+0x60f) [0x7f668c1accf9] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f668c2895a1] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 20: (Thread::entry_wrapper()+0x43) [0x7f668c036cdd] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 21: (Thread::_entry_func(void*)+0xd) [0x7f668c036cf9] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 22: /lib64/libc.so.6(+0x89c02) [0x7f668b92ac02] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f668b9afc40] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 0> 2024-07-26T08:36:59.845+0000 7f6686508640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: in thread 7f6686508640 thread_name:ms_dispatch 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f668b8df6f0] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f668b92c94c] 2024-07-26T08:37:00.324 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 3: raise() 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 4: abort() 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 5: /lib64/libc.so.6(+0x2871b) [0x7f668b8c971b] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 6: /lib64/libc.so.6(+0x37386) [0x7f668b8d8386] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55fdc7de16b9] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55fdc7f9f80c] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55fdc7edf2ca] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55fdc7eaf753] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55fdc7eb0a1b] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55fdc7e94752] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55fdc7de2a56] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55fdc7de6637] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55fdc7de6f5e] 2024-07-26T08:37:00.325 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55fdc7dca03a] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f668c1ac407] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 18: (DispatchQueue::entry()+0x60f) [0x7f668c1accf9] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f668c2895a1] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 20: (Thread::entry_wrapper()+0x43) [0x7f668c036cdd] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 21: (Thread::_entry_func(void*)+0xd) [0x7f668c036cf9] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 22: /lib64/libc.so.6(+0x89c02) [0x7f668b92ac02] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f668b9afc40] 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 0> 2024-07-26T08:36:59.845+0000 7f6686508640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: in thread 7f6686508640 thread_name:ms_dispatch 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:37:00.326 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f668b8df6f0] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f668b92c94c] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 3: raise() 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 4: abort() 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 5: /lib64/libc.so.6(+0x2871b) [0x7f668b8c971b] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 6: /lib64/libc.so.6(+0x37386) [0x7f668b8d8386] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55fdc7de16b9] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55fdc7f9f80c] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55fdc7edf2ca] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55fdc7eaf753] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55fdc7eb0a1b] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55fdc7e94752] 2024-07-26T08:37:00.327 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55fdc7de2a56] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55fdc7de6637] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55fdc7de6f5e] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55fdc7dca03a] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f668c1ac407] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 18: (DispatchQueue::entry()+0x60f) [0x7f668c1accf9] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f668c2895a1] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 20: (Thread::entry_wrapper()+0x43) [0x7f668c036cdd] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 21: (Thread::_entry_func(void*)+0xd) [0x7f668c036cf9] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 22: /lib64/libc.so.6(+0x89c02) [0x7f668b92ac02] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f668b9afc40] 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71429]: 2024-07-26T08:37:00.328 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:36:59 smithi063 podman[71754]: 2024-07-26 08:36:59.912931434 +0000 UTC m=+0.020687733 container died ecb4dd343e2ae8f07745ec9747c496ae334a80482147b468c7d238e3025b397e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True) 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:rejoin 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:active 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:00 smithi063 ceph-mon[36747]: scrub summary: idle+waiting paths [/] 2024-07-26T08:37:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:rejoin 2024-07-26T08:37:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:37:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:37:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:active 2024-07-26T08:37:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:00 smithi043 ceph-mon[32384]: scrub summary: idle+waiting paths [/] 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:37:00.752+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:rejoin 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:37:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/1305832455,v1:172.21.15.63:6837/1305832455] up:active 2024-07-26T08:37:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:00 smithi133 ceph-mon[37053]: scrub summary: idle+waiting paths [/] 2024-07-26T08:37:01.663 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:01 smithi063 ceph-mon[36747]: pgmap v607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:37:01.664 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:01 smithi063 podman[71754]: 2024-07-26 08:37:01.406259565 +0000 UTC m=+1.514015908 container remove ecb4dd343e2ae8f07745ec9747c496ae334a80482147b468c7d238e3025b397e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0) 2024-07-26T08:37:01.664 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:01 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:37:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:01 smithi043 ceph-mon[32384]: pgmap v607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:37:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:01 smithi133 ceph-mon[37053]: pgmap v607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:37:02.067 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:01 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:37:02.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:01 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 1.977s CPU time. 2024-07-26T08:37:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:04 smithi063 ceph-mon[36747]: pgmap v608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-07-26T08:37:04.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:04 smithi043 ceph-mon[32384]: pgmap v608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-07-26T08:37:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:04 smithi133 ceph-mon[37053]: pgmap v608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-07-26T08:37:06.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:37:06.193 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:05 smithi043 ceph-mon[32384]: pgmap v609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-07-26T08:37:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:05 smithi133 ceph-mon[37053]: pgmap v609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-07-26T08:37:06.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:05 smithi063 ceph-mon[36747]: pgmap v609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-07-26T08:37:06.591 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:37:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:08 smithi043 ceph-mon[32384]: pgmap v610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-07-26T08:37:08.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:08 smithi063 ceph-mon[36747]: pgmap v610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-07-26T08:37:08.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:08 smithi133 ceph-mon[37053]: pgmap v610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-07-26T08:37:09.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.481+0000 7f1073200640 1 -- 172.21.15.43:0/1388795295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107410fc80 msgr2=0x7f10741164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.481+0000 7f1073200640 1 --2- 172.21.15.43:0/1388795295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107410fc80 0x7f10741164b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f106c009860 tx=0x7f106c02a340 comp rx=0 tx=0).stop 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 -- 172.21.15.43:0/1388795295 shutdown_connections 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 --2- 172.21.15.43:0/1388795295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107410fc80 0x7f10741164b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 --2- 172.21.15.43:0/1388795295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f107410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 --2- 172.21.15.43:0/1388795295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10741099f0 0x7f1074109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 -- 172.21.15.43:0/1388795295 >> 172.21.15.43:0/1388795295 conn(0x7f1074078ff0 msgr2=0x7f1074107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 -- 172.21.15.43:0/1388795295 shutdown_connections 2024-07-26T08:37:09.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.482+0000 7f1073200640 1 -- 172.21.15.43:0/1388795295 wait complete. 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.483+0000 7f1073200640 1 Processor -- start 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.483+0000 7f1073200640 1 -- start start 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.483+0000 7f1073200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 0x7f10741a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.483+0000 7f1073200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f10741a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1073200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107410fc80 0x7f10741a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1073200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1074119a60 con 0x7f107410f330 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1073200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10741198e0 con 0x7f107410fc80 2024-07-26T08:37:09.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1073200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1074119be0 con 0x7f10741099f0 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f10741a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 0x7f10741a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 0x7f10741a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:55754/0 (socket says 172.21.15.43:55754) 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f10741a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48582/0 (socket says 172.21.15.43:48582) 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 -- 172.21.15.43:0/1161731357 learned_addr learned my addr 172.21.15.43:0/1161731357 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1072800640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107410fc80 0x7f10741a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 -- 172.21.15.43:0/1161731357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107410fc80 msgr2=0x7f10741a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107410fc80 0x7f10741a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 -- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 msgr2=0x7f10741a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.484+0000 7f1071e00640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f10741a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f1071e00640 1 -- 172.21.15.43:0/1161731357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10741a6300 con 0x7f10741099f0 2024-07-26T08:37:09.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f1071400640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f10741a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:37:09.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f1071e00640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 0x7f10741a0390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f105c00e9f0 tx=0x7f105c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:09.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f106aa00640 1 -- 172.21.15.43:0/1161731357 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c00cd80 con 0x7f10741099f0 2024-07-26T08:37:09.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10741a65f0 con 0x7f10741099f0 2024-07-26T08:37:09.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f106aa00640 1 -- 172.21.15.43:0/1161731357 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f105c010900 con 0x7f10741099f0 2024-07-26T08:37:09.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.485+0000 7f106aa00640 1 -- 172.21.15.43:0/1161731357 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0188d0 con 0x7f10741099f0 2024-07-26T08:37:09.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.486+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10741acd50 con 0x7f10741099f0 2024-07-26T08:37:09.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.489+0000 7f107fde3740 1 Processor -- start 2024-07-26T08:37:09.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.489+0000 7f107fde3740 1 -- start start 2024-07-26T08:37:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f106aa00640 1 -- 172.21.15.43:0/1161731357 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f105c010ab0 con 0x7f10741099f0 2024-07-26T08:37:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f107fde3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb73070 0x55b8ccf18000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f107fde3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf18540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f107fde3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf18a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f107fde3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8cce8ebc0 con 0x55b8ccb52390 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f107fde3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b8cce7e0c0 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f107fde3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b8cce82100 con 0x55b8ccb73070 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f1071e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf18540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf18a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf18a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48596/0 (socket says 172.21.15.43:48596) 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f1071400640 1 -- 172.21.15.43:0/906133334 learned_addr learned my addr 172.21.15.43:0/906133334 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.490+0000 7f1072800640 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb73070 0x55b8ccf18000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1071400640 1 -- 172.21.15.43:0/906133334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb73070 msgr2=0x55b8ccf18000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1071400640 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb73070 0x55b8ccf18000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1071400640 1 -- 172.21.15.43:0/906133334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb4a1b0 msgr2=0x55b8ccf18540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1071400640 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf18540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1071400640 1 -- 172.21.15.43:0/906133334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ccbde650 con 0x55b8ccb52390 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1072800640 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb73070 0x55b8ccf18000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.491+0000 7f1071400640 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf18a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1064009a40 tx=0x7f106400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a4afd6ef979e2b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.492+0000 7f106aa00640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10580b3d40 0x7f10580b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.492+0000 7f1063400640 1 -- 172.21.15.43:0/906133334 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106400cd60 con 0x55b8ccb52390 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.492+0000 7f106aa00640 1 -- 172.21.15.43:0/1161731357 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9968+0+0 (secure 0 0 0) 0x7f105c0e4920 con 0x7f10741099f0 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.492+0000 7f1063400640 1 -- 172.21.15.43:0/906133334 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f106401d070 con 0x55b8ccb52390 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.492+0000 7f1063400640 1 -- 172.21.15.43:0/906133334 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106400b5c0 con 0x55b8ccb52390 2024-07-26T08:37:09.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.492+0000 7f1072800640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10580b3d40 0x7f10580b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 -- 172.21.15.43:0/906133334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 msgr2=0x55b8ccf18a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf18a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1064009a40 tx=0x7f106400ec30 comp rx=0 tx=0).stop 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f1072800640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10580b3d40 0x7f10580b6250 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f106c0057c0 tx=0x7f106c005710 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 -- 172.21.15.43:0/906133334 shutdown_connections 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf18a80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf18540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 --2- 172.21.15.43:0/906133334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb73070 0x55b8ccf18000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 -- 172.21.15.43:0/906133334 >> 172.21.15.43:0/906133334 conn(0x55b8ccb67460 msgr2=0x55b8ccf15ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 -- 172.21.15.43:0/906133334 shutdown_connections 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.493+0000 7f107fde3740 1 -- 172.21.15.43:0/906133334 wait complete. 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.494+0000 7f107fde3740 1 -- start start 2024-07-26T08:37:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.494+0000 7f107fde3740 1 Processor -- start 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf23610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf23b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8ccce1700 con 0x55b8ccb52390 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b8cce1a690 con 0x55b8ccb73070 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b8ccf267e0 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f107fde3740 10 client.0 _ll_register_callbacks cb 0x55b8cce2a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:37:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf23b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf23b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48604/0 (socket says 172.21.15.43:48604) 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f1071400640 1 -- 172.21.15.43:0/4221653215 learned_addr learned my addr 172.21.15.43:0/4221653215 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.495+0000 7f1071e00640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf23610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1072800640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071400640 1 -- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 msgr2=0x55b8ccf23610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071400640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf23610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071400640 1 -- 172.21.15.43:0/4221653215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 msgr2=0x55b8ccf240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071400640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071400640 1 -- 172.21.15.43:0/4221653215 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8cce31830 con 0x55b8ccb52390 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071e00640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf23610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1071400640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf23b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1064000f80 tx=0x7f1064004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb8ef94100eadf4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.496+0000 7f1057e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:37:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f1057e00640 1 -- 172.21.15.43:0/4221653215 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1064026070 con 0x55b8ccb52390 2024-07-26T08:37:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f1057e00640 1 -- 172.21.15.43:0/4221653215 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9968+0+0 (secure 0 0 0) 0x7f1064003b70 con 0x55b8ccb52390 2024-07-26T08:37:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f106401d070 con 0x55b8ccb52390 2024-07-26T08:37:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f1057e00640 1 -- 172.21.15.43:0/4221653215 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f1064032050 con 0x55b8ccb52390 2024-07-26T08:37:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f107fde3740 10 client.15747 fetch_fsmap learned FSMap version 63 2024-07-26T08:37:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55b8ccf32460 con 0x55b8ccb52390 2024-07-26T08:37:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.497+0000 7f1057e00640 1 -- 172.21.15.43:0/4221653215 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f106401d070 con 0x55b8ccb52390 2024-07-26T08:37:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f1057e00640 1 -- 172.21.15.43:0/4221653215 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 63) ==== 8362+0+0 (secure 0 0 0) 0x7f106400b040 con 0x55b8ccb52390 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f107fde3740 10 client.15747 fetch_fsmap finished waiting for FSMap version 63 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f107fde3740 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f107fde3740 20 client.15747 populate_metadata read hostname 'smithi043' 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f107fde3740 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb319f0 0x55b8ccf35820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f107fde3740 4 client.15747 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8cce90b10 con 0x55b8ccb319f0 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.498+0000 7f1071e00640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb319f0 0x55b8ccf35820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.499+0000 7f1071e00640 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb319f0 0x55b8ccf35820 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea2aac0786615300 server_cookie=535c9d937d69633e in_seq=0 out_seq=0 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.499+0000 7f1057e00640 10 client.15747 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f1057e00640 1 -- 172.21.15.43:0/4221653215 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8cce90b10 con 0x55b8ccb319f0 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f1057e00640 10 client.15747 handle_command_reply: tid=0 2024-07-26T08:37:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 client.15747 shutdown 2024-07-26T08:37:09.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 msgr2=0x55b8ccf23b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf23b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1064000f80 tx=0x7f1064004c70 comp rx=0 tx=0).stop 2024-07-26T08:37:09.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 shutdown_connections 2024-07-26T08:37:09.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb319f0 0x55b8ccf35820 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf23b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 --2- 172.21.15.43:0/4221653215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf23610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.500+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 >> 172.21.15.43:0/4221653215 conn(0x55b8ccb67460 msgr2=0x55b8ccf1b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.501+0000 7f1057e00640 0 client.15747 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.501+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 shutdown_connections 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.501+0000 7f107fde3740 1 -- 172.21.15.43:0/4221653215 wait complete. 2024-07-26T08:37:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.501+0000 7f107fde3740 20 client.15747 trim_cache size 0 max 16384 2024-07-26T08:37:09.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.520+0000 7f107fde3740 1 Processor -- start 2024-07-26T08:37:09.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.520+0000 7f107fde3740 1 -- start start 2024-07-26T08:37:09.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f107fde3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf14ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f107fde3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb52390 0x55b8ccf19740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f107fde3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf20800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f107fde3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f10741b9b30 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f107fde3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10741b7400 con 0x55b8ccb73070 2024-07-26T08:37:09.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f107fde3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f10741b5230 con 0x55b8ccb52390 2024-07-26T08:37:09.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f1071e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf14ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f1071e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf14ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48612/0 (socket says 172.21.15.43:48612) 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f1071e00640 1 -- 172.21.15.43:0/1440811863 learned_addr learned my addr 172.21.15.43:0/1440811863 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f1072800640 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf20800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.521+0000 7f1071400640 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb52390 0x55b8ccf19740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1072800640 1 -- 172.21.15.43:0/1440811863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb52390 msgr2=0x55b8ccf19740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1072800640 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb52390 0x55b8ccf19740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1072800640 1 -- 172.21.15.43:0/1440811863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb4a1b0 msgr2=0x55b8ccf14ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1072800640 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf14ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1072800640 1 -- 172.21.15.43:0/1440811863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ccf3ba00 con 0x55b8ccb73070 2024-07-26T08:37:09.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1072800640 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf20800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f106c02a860 tx=0x7f106c03d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5cdc54e99759ffd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:09.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.522+0000 7f1062a00640 1 -- 172.21.15.43:0/1440811863 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c04d070 con 0x55b8ccb73070 2024-07-26T08:37:09.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f1062a00640 1 -- 172.21.15.43:0/1440811863 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f106c043070 con 0x55b8ccb73070 2024-07-26T08:37:09.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f1062a00640 1 -- 172.21.15.43:0/1440811863 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c037040 con 0x55b8ccb73070 2024-07-26T08:37:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f107fde3740 1 -- 172.21.15.43:0/1440811863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 msgr2=0x55b8ccf20800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f107fde3740 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf20800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f106c02a860 tx=0x7f106c03d000 comp rx=0 tx=0).stop 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f107fde3740 1 -- 172.21.15.43:0/1440811863 shutdown_connections 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f107fde3740 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb52390 0x55b8ccf19740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f107fde3740 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf20800 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.523+0000 7f107fde3740 1 --2- 172.21.15.43:0/1440811863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf14ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.524+0000 7f107fde3740 1 -- 172.21.15.43:0/1440811863 >> 172.21.15.43:0/1440811863 conn(0x55b8ccb67460 msgr2=0x55b8ccf19030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.524+0000 7f107fde3740 1 -- 172.21.15.43:0/1440811863 shutdown_connections 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.524+0000 7f107fde3740 1 -- 172.21.15.43:0/1440811863 wait complete. 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.524+0000 7f107fde3740 1 -- start start 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.524+0000 7f107fde3740 1 Processor -- start 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf37ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf38400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf9bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f10741b58c0 con 0x55b8ccb52390 2024-07-26T08:37:09.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10741b6d30 con 0x55b8ccb73070 2024-07-26T08:37:09.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f10741b5f90 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f107fde3740 10 client.0 _ll_register_callbacks cb 0x7f1064009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:37:09.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf38400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f1071e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf37ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f1071400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf38400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48618/0 (socket says 172.21.15.43:48618) 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.525+0000 7f1071400640 1 -- 172.21.15.43:0/2499871062 learned_addr learned my addr 172.21.15.43:0/2499871062 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1072800640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf9bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071e00640 1 -- 172.21.15.43:0/2499871062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 msgr2=0x55b8ccf9bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071e00640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf9bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071e00640 1 -- 172.21.15.43:0/2499871062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 msgr2=0x55b8ccf38400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071e00640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf38400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071e00640 1 -- 172.21.15.43:0/2499871062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ccf9c2b0 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071400640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf38400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1071e00640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf37ec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f105c0a82b0 tx=0x7f105c0e1aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4bd9c7fc5e88a2e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1057e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.526+0000 7f1057e00640 1 -- 172.21.15.43:0/2499871062 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0aa7b0 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f1057e00640 1 -- 172.21.15.43:0/2499871062 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9968+0+0 (secure 0 0 0) 0x7f105c0aa4b0 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f106c043070 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f1057e00640 1 -- 172.21.15.43:0/2499871062 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f105c010e20 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 10 client.25930 fetch_fsmap learned FSMap version 63 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55b8ccf9d580 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f1057e00640 1 -- 172.21.15.43:0/2499871062 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f106c043070 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f1057e00640 1 -- 172.21.15.43:0/2499871062 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 63) ==== 8362+0+0 (secure 0 0 0) 0x7f105c0c0240 con 0x55b8ccb4a1b0 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 10 client.25930 fetch_fsmap finished waiting for FSMap version 63 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 10 client.25930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:37:09.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 20 client.25930 populate_metadata read hostname 'smithi043' 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb06da0 0x55b8ccf9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 4 client.25930 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.527+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b8cce8c5b0 con 0x55b8ccb06da0 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.528+0000 7f1071400640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb06da0 0x55b8ccf9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.528+0000 7f1071400640 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb06da0 0x55b8ccf9fd90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf33478c027223c8 server_cookie=583d9ae288120e15 in_seq=0 out_seq=0 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.528+0000 7f1057e00640 10 client.25930 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.528+0000 7f1057e00640 1 -- 172.21.15.43:0/2499871062 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55b8cce8c5b0 con 0x55b8ccb06da0 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.528+0000 7f1057e00640 10 client.25930 handle_command_reply: tid=0 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.528+0000 7f107fde3740 1 client.25930 shutdown 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 msgr2=0x55b8ccf37ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf37ec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f105c0a82b0 tx=0x7f105c0e1aa0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 shutdown_connections 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b8ccb06da0 0x55b8ccf9fd90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b8ccb73070 0x55b8ccf9bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8ccb52390 0x55b8ccf38400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 --2- 172.21.15.43:0/2499871062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8ccb4a1b0 0x55b8ccf37ec0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f1057e00640 0 client.25930 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 >> 172.21.15.43:0/2499871062 conn(0x55b8ccb67460 msgr2=0x55b8ccf14cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 shutdown_connections 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 1 -- 172.21.15.43:0/2499871062 wait complete. 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.529+0000 7f107fde3740 20 client.25930 trim_cache size 0 max 16384 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:37:09.534 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:37:09.535 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:37:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10580b3d40 msgr2=0x7f10580b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10580b3d40 0x7f10580b6250 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f106c0057c0 tx=0x7f106c005710 comp rx=0 tx=0).stop 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 msgr2=0x7f10741a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 0x7f10741a0390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f105c00e9f0 tx=0x7f105c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 shutdown_connections 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f10580b3d40 0x7f10580b6250 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f107410fc80 0x7f10741a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f107410f330 0x7f10741a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 --2- 172.21.15.43:0/1161731357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10741099f0 0x7f10741a0390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 >> 172.21.15.43:0/1161731357 conn(0x7f1074078ff0 msgr2=0x7f1074079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.530+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 shutdown_connections 2024-07-26T08:37:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:09.531+0000 7f1073200640 1 -- 172.21.15.43:0/1161731357 wait complete. 2024-07-26T08:37:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:10 smithi063 ceph-mon[36747]: pgmap v611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-07-26T08:37:10.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:10 smithi043 ceph-mon[32384]: pgmap v611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-07-26T08:37:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:10 smithi133 ceph-mon[37053]: pgmap v611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-07-26T08:37:10.675 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:37:12.195 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:12 smithi063 ceph-mon[36747]: pgmap v612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-07-26T08:37:12.196 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:11 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:37:12.196 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:11 smithi063 systemd[1]: Stopped Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:37:12.196 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:11 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 1.977s CPU time. 2024-07-26T08:37:12.196 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:11 smithi063 systemd[1]: Starting Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:37:12.196 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 podman[71843]: 2024-07-26 08:37:11.958041911 +0000 UTC m=+0.019177990 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:37:12.196 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 podman[71843]: 2024-07-26 08:37:12.057052537 +0000 UTC m=+0.118188609 container create a810ea93f38fe6fbf27172c66624c593a4bc1a2d6431d29febe8c20a2673e8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:37:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:12 smithi043 ceph-mon[32384]: pgmap v612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-07-26T08:37:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:12 smithi133 ceph-mon[37053]: pgmap v612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-07-26T08:37:12.567 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 podman[71843]: 2024-07-26 08:37:12.309862848 +0000 UTC m=+0.370998928 container init a810ea93f38fe6fbf27172c66624c593a4bc1a2d6431d29febe8c20a2673e8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True) 2024-07-26T08:37:12.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 podman[71843]: 2024-07-26 08:37:12.312758898 +0000 UTC m=+0.373894977 container start a810ea93f38fe6fbf27172c66624c593a4bc1a2d6431d29febe8c20a2673e8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-07-26T08:37:12.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 ceph-mds[71862]: -- 172.21.15.63:0/1319097762 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564007f4f860 con 0x56400c0f1600 2024-07-26T08:37:12.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: starting mds.h at 2024-07-26T08:37:12.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 bash[71843]: a810ea93f38fe6fbf27172c66624c593a4bc1a2d6431d29febe8c20a2673e8fc 2024-07-26T08:37:12.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:12 smithi063 systemd[1]: Started Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: daemon mds.h restarted 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: osdmap e97: 12 total, 12 up, 12 in 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:boot 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:13 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: daemon mds.h restarted 2024-07-26T08:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: osdmap e97: 12 total, 12 up, 12 in 2024-07-26T08:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:boot 2024-07-26T08:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:37:13.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:13.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:13 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:13.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: daemon mds.h restarted 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: osdmap e97: 12 total, 12 up, 12 in 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:boot 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:13 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:14.644 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:14 smithi043 ceph-mon[32384]: pgmap v614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:37:14.644 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:14 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:resolve 2024-07-26T08:37:14.644 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:14 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:14 smithi133 ceph-mon[37053]: pgmap v614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:37:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:14 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:resolve 2024-07-26T08:37:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:14 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:14 smithi063 ceph-mon[36747]: pgmap v614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:37:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:14 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:resolve 2024-07-26T08:37:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:14 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:15 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:37:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:15 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:reconnect 2024-07-26T08:37:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:15 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:15 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:15 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:37:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:15 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:reconnect 2024-07-26T08:37:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:15 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:15 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:15 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:37:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:15 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:reconnect 2024-07-26T08:37:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:15 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:15 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:16.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-mon[36747]: pgmap v615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:37:16.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:rejoin 2024-07-26T08:37:16.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:16.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-mon[36747]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:37:16.719 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:37:16.719 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: *** Caught signal (Aborted) ** 2024-07-26T08:37:16.719 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: in thread 7f2d1d696640 thread_name:ms_dispatch 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d22a6d6f0] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2d22aba94c] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 3: raise() 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 4: abort() 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2d22a5771b] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 6: /lib64/libc.so.6(+0x37386) [0x7f2d22a66386] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896cd5b6b9] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896cf1980c] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896ce592ca] 2024-07-26T08:37:16.720 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896ce29753] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896ce2aa1b] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896ce0e752] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896cd5ca56] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896cd60637] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896cd60f5e] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896cd4403a] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2d2333a407] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 18: (DispatchQueue::entry()+0x60f) [0x7f2d2333acf9] 2024-07-26T08:37:16.721 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2d234175a1] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 20: (Thread::entry_wrapper()+0x43) [0x7f2d231c4cdd] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2d231c4cf9] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2d22ab8c02] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2d22b3dc40] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.443+0000 7f2d1d696640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: in thread 7f2d1d696640 thread_name:ms_dispatch 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d22a6d6f0] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2d22aba94c] 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 3: raise() 2024-07-26T08:37:16.722 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 4: abort() 2024-07-26T08:37:16.723 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2d22a5771b] 2024-07-26T08:37:16.723 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 6: /lib64/libc.so.6(+0x37386) [0x7f2d22a66386] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896cd5b6b9] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896cf1980c] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896ce592ca] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896ce29753] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896ce2aa1b] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896ce0e752] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896cd5ca56] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896cd60637] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896cd60f5e] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896cd4403a] 2024-07-26T08:37:16.726 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2d2333a407] 2024-07-26T08:37:16.727 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 18: (DispatchQueue::entry()+0x60f) [0x7f2d2333acf9] 2024-07-26T08:37:16.727 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2d234175a1] 2024-07-26T08:37:16.727 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 20: (Thread::entry_wrapper()+0x43) [0x7f2d231c4cdd] 2024-07-26T08:37:16.727 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2d231c4cf9] 2024-07-26T08:37:16.727 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2d22ab8c02] 2024-07-26T08:37:16.727 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2d22b3dc40] 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 0> 2024-07-26T08:37:16.443+0000 7f2d1d696640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: in thread 7f2d1d696640 thread_name:ms_dispatch 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d22a6d6f0] 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2d22aba94c] 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 3: raise() 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 4: abort() 2024-07-26T08:37:16.728 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2d22a5771b] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 6: /lib64/libc.so.6(+0x37386) [0x7f2d22a66386] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896cd5b6b9] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896cf1980c] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896ce592ca] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896ce29753] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896ce2aa1b] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896ce0e752] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896cd5ca56] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896cd60637] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896cd60f5e] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896cd4403a] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2d2333a407] 2024-07-26T08:37:16.729 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 18: (DispatchQueue::entry()+0x60f) [0x7f2d2333acf9] 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2d234175a1] 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 20: (Thread::entry_wrapper()+0x43) [0x7f2d231c4cdd] 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2d231c4cf9] 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2d22ab8c02] 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2d22b3dc40] 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 0> 2024-07-26T08:37:16.443+0000 7f2d1d696640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: in thread 7f2d1d696640 thread_name:ms_dispatch 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:16.730 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d22a6d6f0] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2d22aba94c] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 3: raise() 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 4: abort() 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2d22a5771b] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 6: /lib64/libc.so.6(+0x37386) [0x7f2d22a66386] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896cd5b6b9] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896cf1980c] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896ce592ca] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896ce29753] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896ce2aa1b] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896ce0e752] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896cd5ca56] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896cd60637] 2024-07-26T08:37:16.731 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896cd60f5e] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896cd4403a] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2d2333a407] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 18: (DispatchQueue::entry()+0x60f) [0x7f2d2333acf9] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2d234175a1] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 20: (Thread::entry_wrapper()+0x43) [0x7f2d231c4cdd] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2d231c4cf9] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2d22ab8c02] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2d22b3dc40] 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[71716]: 2024-07-26T08:37:16.732 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:16 smithi063 podman[71896]: 2024-07-26 08:37:16.515759028 +0000 UTC m=+0.026534705 container died ebd2e533b4c5b8bff4b06fd6bb633f006c8472894b83474e8117bca1a8fa0eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T08:37:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:16 smithi043 ceph-mon[32384]: pgmap v615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:37:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:16 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:rejoin 2024-07-26T08:37:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:16 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:16 smithi043 ceph-mon[32384]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:37:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:16 smithi133 ceph-mon[37053]: pgmap v615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:37:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:16 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:rejoin 2024-07-26T08:37:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:16 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:16 smithi133 ceph-mon[37053]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:37:17.651 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:17 smithi063 podman[71896]: 2024-07-26 08:37:17.391209424 +0000 UTC m=+0.901985145 container remove ebd2e533b4c5b8bff4b06fd6bb633f006c8472894b83474e8117bca1a8fa0eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240724) 2024-07-26T08:37:17.652 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:17 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:37:17.652 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:17 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:17.652 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:17 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:37:17.652 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:17 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:active 2024-07-26T08:37:17.652 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:17 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:17.652 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:17 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:17 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:17 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:37:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:17 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:active 2024-07-26T08:37:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:17 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:17 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:17.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:17 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:17.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:17 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:37:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:17 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2669403450,v1:172.21.15.63:6839/2669403450] up:active 2024-07-26T08:37:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:17 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:17 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:18.067 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:17 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T08:37:18.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:17 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 2.119s CPU time. 2024-07-26T08:37:18.469 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:18 smithi043 ceph-mon[32384]: pgmap v616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-07-26T08:37:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:18 smithi133 ceph-mon[37053]: pgmap v616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-07-26T08:37:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:18 smithi063 ceph-mon[36747]: pgmap v616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 204 B/s wr, 6 op/s 2024-07-26T08:37:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:20 smithi043 ceph-mon[32384]: pgmap v617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-07-26T08:37:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:20 smithi133 ceph-mon[37053]: pgmap v617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-07-26T08:37:20.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:20 smithi063 ceph-mon[36747]: pgmap v617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-07-26T08:37:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:22 smithi043 ceph-mon[32384]: pgmap v618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-07-26T08:37:22.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:22 smithi133 ceph-mon[37053]: pgmap v618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-07-26T08:37:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:22 smithi063 ceph-mon[36747]: pgmap v618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-07-26T08:37:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:24 smithi043 ceph-mon[32384]: pgmap v619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-07-26T08:37:24.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:24 smithi133 ceph-mon[37053]: pgmap v619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-07-26T08:37:24.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:24 smithi063 ceph-mon[36747]: pgmap v619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-07-26T08:37:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:26 smithi043 ceph-mon[32384]: pgmap v620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T08:37:26.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:26 smithi133 ceph-mon[37053]: pgmap v620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T08:37:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:26 smithi063 ceph-mon[36747]: pgmap v620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T08:37:28.083 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:27 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:37:28.083 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:27 smithi063 systemd[1]: Stopped Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:37:28.083 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:27 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 2.119s CPU time. 2024-07-26T08:37:28.084 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:27 smithi063 systemd[1]: Starting Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:37:28.084 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 podman[71988]: 2024-07-26 08:37:27.959761421 +0000 UTC m=+0.018180525 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:37:28.084 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 podman[71988]: 2024-07-26 08:37:28.082844987 +0000 UTC m=+0.141264079 container create a10ad3e7222480ad74f2ff776a38042beff1c7f99604401fbf4177a4f441a78d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:37:28.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:28 smithi043 ceph-mon[32384]: pgmap v621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T08:37:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:28 smithi133 ceph-mon[37053]: pgmap v621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T08:37:28.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:28 smithi063 ceph-mon[36747]: pgmap v621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T08:37:28.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 podman[71988]: 2024-07-26 08:37:28.451860475 +0000 UTC m=+0.510279567 container init a10ad3e7222480ad74f2ff776a38042beff1c7f99604401fbf4177a4f441a78d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:37:28.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 podman[71988]: 2024-07-26 08:37:28.454766438 +0000 UTC m=+0.513185540 container start a10ad3e7222480ad74f2ff776a38042beff1c7f99604401fbf4177a4f441a78d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-07-26T08:37:28.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: starting mds.b at 2024-07-26T08:37:28.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 bash[71988]: a10ad3e7222480ad74f2ff776a38042beff1c7f99604401fbf4177a4f441a78d 2024-07-26T08:37:28.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:28 smithi063 systemd[1]: Started Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: daemon mds.b restarted 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: osdmap e98: 12 total, 12 up, 12 in 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:boot 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:29 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:29.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: daemon mds.b restarted 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: osdmap e98: 12 total, 12 up, 12 in 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:boot 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:29 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: daemon mds.b restarted 2024-07-26T08:37:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T08:37:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: osdmap e98: 12 total, 12 up, 12 in 2024-07-26T08:37:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:boot 2024-07-26T08:37:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:37:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:29.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:29 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:30.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:30 smithi043 ceph-mon[32384]: pgmap v623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8 op/s 2024-07-26T08:37:30.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:30 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:resolve 2024-07-26T08:37:30.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:30 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:30 smithi063 ceph-mon[36747]: pgmap v623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8 op/s 2024-07-26T08:37:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:30 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:resolve 2024-07-26T08:37:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:30 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:30 smithi133 ceph-mon[37053]: pgmap v623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8 op/s 2024-07-26T08:37:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:30 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:resolve 2024-07-26T08:37:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:30 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:31 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:37:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:31 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:reconnect 2024-07-26T08:37:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:31 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:31 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:31 smithi063 ceph-mon[36747]: pgmap v624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-07-26T08:37:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:31 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:37:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:31 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:reconnect 2024-07-26T08:37:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:31 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:31 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:31 smithi043 ceph-mon[32384]: pgmap v624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-07-26T08:37:32.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:31 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:37:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:31 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:reconnect 2024-07-26T08:37:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:31 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:31 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:31 smithi133 ceph-mon[37053]: pgmap v624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-07-26T08:37:32.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:rejoin 2024-07-26T08:37:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-mon[36747]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:37:32.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:37:32.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: *** Caught signal (Aborted) ** 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: in thread 7f2037547640 thread_name:ms_dispatch 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f203c91e6f0] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f203c96b94c] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 3: raise() 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 4: abort() 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 5: /lib64/libc.so.6(+0x2871b) [0x7f203c90871b] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 6: /lib64/libc.so.6(+0x37386) [0x7f203c917386] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x564005f806b9] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56400613e80c] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56400607e2ca] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56400604e753] 2024-07-26T08:37:32.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56400604fa1b] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x564006033752] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x564005f81a56] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x564005f85637] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x564005f85f5e] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x564005f6903a] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f203d1eb407] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 18: (DispatchQueue::entry()+0x60f) [0x7f203d1ebcf9] 2024-07-26T08:37:32.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f203d2c85a1] 2024-07-26T08:37:32.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 20: (Thread::entry_wrapper()+0x43) [0x7f203d075cdd] 2024-07-26T08:37:32.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 21: (Thread::_entry_func(void*)+0xd) [0x7f203d075cf9] 2024-07-26T08:37:32.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 22: /lib64/libc.so.6(+0x89c02) [0x7f203c969c02] 2024-07-26T08:37:32.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f203c9eec40] 2024-07-26T08:37:32.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.581+0000 7f2037547640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: in thread 7f2037547640 thread_name:ms_dispatch 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f203c91e6f0] 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f203c96b94c] 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 3: raise() 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 4: abort() 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 5: /lib64/libc.so.6(+0x2871b) [0x7f203c90871b] 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 6: /lib64/libc.so.6(+0x37386) [0x7f203c917386] 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x564005f806b9] 2024-07-26T08:37:32.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56400613e80c] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56400607e2ca] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56400604e753] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56400604fa1b] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x564006033752] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x564005f81a56] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x564005f85637] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x564005f85f5e] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x564005f6903a] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f203d1eb407] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 18: (DispatchQueue::entry()+0x60f) [0x7f203d1ebcf9] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f203d2c85a1] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 20: (Thread::entry_wrapper()+0x43) [0x7f203d075cdd] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 21: (Thread::_entry_func(void*)+0xd) [0x7f203d075cf9] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 22: /lib64/libc.so.6(+0x89c02) [0x7f203c969c02] 2024-07-26T08:37:32.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f203c9eec40] 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 0> 2024-07-26T08:37:32.581+0000 7f2037547640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: in thread 7f2037547640 thread_name:ms_dispatch 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f203c91e6f0] 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f203c96b94c] 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 3: raise() 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 4: abort() 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 5: /lib64/libc.so.6(+0x2871b) [0x7f203c90871b] 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 6: /lib64/libc.so.6(+0x37386) [0x7f203c917386] 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x564005f806b9] 2024-07-26T08:37:32.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56400613e80c] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56400607e2ca] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56400604e753] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56400604fa1b] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x564006033752] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x564005f81a56] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x564005f85637] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x564005f85f5e] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x564005f6903a] 2024-07-26T08:37:32.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f203d1eb407] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 18: (DispatchQueue::entry()+0x60f) [0x7f203d1ebcf9] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f203d2c85a1] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 20: (Thread::entry_wrapper()+0x43) [0x7f203d075cdd] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 21: (Thread::_entry_func(void*)+0xd) [0x7f203d075cf9] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 22: /lib64/libc.so.6(+0x89c02) [0x7f203c969c02] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f203c9eec40] 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 0> 2024-07-26T08:37:32.581+0000 7f2037547640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: in thread 7f2037547640 thread_name:ms_dispatch 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f203c91e6f0] 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f203c96b94c] 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 3: raise() 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 4: abort() 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 5: /lib64/libc.so.6(+0x2871b) [0x7f203c90871b] 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 6: /lib64/libc.so.6(+0x37386) [0x7f203c917386] 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x564005f806b9] 2024-07-26T08:37:32.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56400613e80c] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56400607e2ca] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56400604e753] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56400604fa1b] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x564006033752] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x564005f81a56] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x564005f85637] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x564005f85f5e] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x564005f6903a] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f203d1eb407] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 18: (DispatchQueue::entry()+0x60f) [0x7f203d1ebcf9] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f203d2c85a1] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 20: (Thread::entry_wrapper()+0x43) [0x7f203d075cdd] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 21: (Thread::_entry_func(void*)+0xd) [0x7f203d075cf9] 2024-07-26T08:37:32.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 22: /lib64/libc.so.6(+0x89c02) [0x7f203c969c02] 2024-07-26T08:37:32.829 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f203c9eec40] 2024-07-26T08:37:32.829 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:32.829 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[71858]: 2024-07-26T08:37:32.829 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:32 smithi063 podman[72041]: 2024-07-26 08:37:32.656504328 +0000 UTC m=+0.026601445 container died a810ea93f38fe6fbf27172c66624c593a4bc1a2d6431d29febe8c20a2673e8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-26T08:37:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:32 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:rejoin 2024-07-26T08:37:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:32 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:32 smithi043 ceph-mon[32384]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:37:33.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:32 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:rejoin 2024-07-26T08:37:33.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:32 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:32 smithi133 ceph-mon[37053]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:37:33.741 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:33 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:33 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:33 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:active 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:33 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:33 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:33 smithi063 ceph-mon[36747]: pgmap v625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:33 smithi063 podman[72041]: 2024-07-26 08:37:33.482599523 +0000 UTC m=+0.852696670 container remove a810ea93f38fe6fbf27172c66624c593a4bc1a2d6431d29febe8c20a2673e8fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-07-26T08:37:33.742 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:33 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:37:33.858 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:33 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:33.858 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:33 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:37:33.858 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:33 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:active 2024-07-26T08:37:33.858 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:33 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:33.858 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:33 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:33.858 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:33 smithi043 ceph-mon[32384]: pgmap v625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:37:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:33 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:33 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:37:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:33 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2043430794,v1:172.21.15.63:6837/2043430794] up:active 2024-07-26T08:37:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:33 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:33 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:33 smithi133 ceph-mon[37053]: pgmap v625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:37:34.067 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:33 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:37:34.067 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:33 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 1.981s CPU time. 2024-07-26T08:37:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:36 smithi043 ceph-mon[32384]: pgmap v626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:36 smithi063 ceph-mon[36747]: pgmap v626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:36 smithi133 ceph-mon[37053]: pgmap v626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:38.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:38 smithi063 ceph-mon[36747]: pgmap v627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:37:38.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:38 smithi043 ceph-mon[32384]: pgmap v627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:37:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:38 smithi133 ceph-mon[37053]: pgmap v627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:37:40.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:40 smithi063 ceph-mon[36747]: pgmap v628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 195 B/s wr, 10 op/s 2024-07-26T08:37:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:40 smithi043 ceph-mon[32384]: pgmap v628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 195 B/s wr, 10 op/s 2024-07-26T08:37:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:40 smithi133 ceph-mon[37053]: pgmap v628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 195 B/s wr, 10 op/s 2024-07-26T08:37:40.676 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:37:41.182 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:37:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:42 smithi063 ceph-mon[36747]: pgmap v629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:37:42.387 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:42 smithi043 ceph-mon[32384]: pgmap v629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:37:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:42 smithi133 ceph-mon[37053]: pgmap v629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 -- 172.21.15.43:0/1203554148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 msgr2=0x7f75f4104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 --2- 172.21.15.43:0/1203554148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4104600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009ca0 tx=0x7f75e402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 -- 172.21.15.43:0/1203554148 shutdown_connections 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 --2- 172.21.15.43:0/1203554148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f410d650 0x7f75f410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 --2- 172.21.15.43:0/1203554148 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f4104b40 0x7f75f410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 --2- 172.21.15.43:0/1203554148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4104600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 -- 172.21.15.43:0/1203554148 >> 172.21.15.43:0/1203554148 conn(0x7f75f40fdcf0 msgr2=0x7f75f4100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:43.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 -- 172.21.15.43:0/1203554148 shutdown_connections 2024-07-26T08:37:43.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.787+0000 7f75f8a00640 1 -- 172.21.15.43:0/1203554148 wait complete. 2024-07-26T08:37:43.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 Processor -- start 2024-07-26T08:37:43.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 -- start start 2024-07-26T08:37:43.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 0x7f75f419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f410d650 0x7f75f419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41133f0 con 0x7f75f410d650 2024-07-26T08:37:43.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75f4113270 con 0x7f75f41041f0 2024-07-26T08:37:43.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.789+0000 7f75f8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f75f4113570 con 0x7f75f4104b40 2024-07-26T08:37:43.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 0x7f75f419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:35178/0 (socket says 172.21.15.43:35178) 2024-07-26T08:37:43.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 -- 172.21.15.43:0/2721931374 learned_addr learned my addr 172.21.15.43:0/2721931374 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:43.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 0x7f75f419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35070/0 (socket says 172.21.15.43:35070) 2024-07-26T08:37:43.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f3200640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f410d650 0x7f75f419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 -- 172.21.15.43:0/2721931374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 msgr2=0x7f75f419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 0x7f75f419a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 -- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f410d650 msgr2=0x7f75f419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.790+0000 7f75f2800640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f410d650 0x7f75f419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75f2800640 1 -- 172.21.15.43:0/2721931374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f419fd90 con 0x7f75f41041f0 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75e9e00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 0x7f75f419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:37:43.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75f2800640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4199e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f75e4006010 tx=0x7f75e4003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:43.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75ebe00640 1 -- 172.21.15.43:0/2721931374 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4031650 con 0x7f75f41041f0 2024-07-26T08:37:43.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75ebe00640 1 -- 172.21.15.43:0/2721931374 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75e40317f0 con 0x7f75f41041f0 2024-07-26T08:37:43.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f41a0020 con 0x7f75f41041f0 2024-07-26T08:37:43.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75ebe00640 1 -- 172.21.15.43:0/2721931374 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e402fa90 con 0x7f75f41041f0 2024-07-26T08:37:43.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.791+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f41a67e0 con 0x7f75f41041f0 2024-07-26T08:37:43.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 Processor -- start 2024-07-26T08:37:43.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 -- start start 2024-07-26T08:37:43.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f75ebe00640 1 -- 172.21.15.43:0/2721931374 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f75e402fcb0 con 0x7f75f41041f0 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 0x559e49c12000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c12540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4984c390 0x559e49c12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559e49b88bc0 con 0x559e498441b0 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.795+0000 7f760008a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559e49b780c0 con 0x559e4984c390 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f760008a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559e49b7c100 con 0x559e4986d070 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 0x559e49c12000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 0x559e49c12000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35080/0 (socket says 172.21.15.43:35080) 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 -- 172.21.15.43:0/4040805878 learned_addr learned my addr 172.21.15.43:0/4040805878 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75e9e00640 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4984c390 0x559e49c12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f2800640 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c12540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 -- 172.21.15.43:0/4040805878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4984c390 msgr2=0x559e49c12a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4984c390 0x559e49c12a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 -- 172.21.15.43:0/4040805878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 msgr2=0x559e49c12540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c12540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.796+0000 7f75f3200640 1 -- 172.21.15.43:0/4040805878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e498d8650 con 0x559e4986d070 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.797+0000 7f75f3200640 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 0x559e49c12000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009c20 tx=0x7f75ec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17e6f4c21802603f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.797+0000 7f75e3400640 1 -- 172.21.15.43:0/4040805878 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec01e070 con 0x559e4986d070 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.797+0000 7f75e3400640 1 -- 172.21.15.43:0/4040805878 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75ec019b00 con 0x559e4986d070 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.797+0000 7f75e3400640 1 -- 172.21.15.43:0/4040805878 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00eab0 con 0x559e4986d070 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.797+0000 7f75ebe00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f75d80b3dc0 0x7f75d80b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f75ebe00640 1 -- 172.21.15.43:0/2721931374 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 10140+0+0 (secure 0 0 0) 0x7f75e4105ab0 con 0x7f75f41041f0 2024-07-26T08:37:43.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f75f2800640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f75d80b3dc0 0x7f75d80b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 -- 172.21.15.43:0/4040805878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 msgr2=0x559e49c12000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 0x559e49c12000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009c20 tx=0x7f75ec011810 comp rx=0 tx=0).stop 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 -- 172.21.15.43:0/4040805878 shutdown_connections 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4984c390 0x559e49c12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c12540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 --2- 172.21.15.43:0/4040805878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4986d070 0x559e49c12000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.798+0000 7f760008a740 1 -- 172.21.15.43:0/4040805878 >> 172.21.15.43:0/4040805878 conn(0x559e49861460 msgr2=0x559e49c0fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.799+0000 7f760008a740 1 -- 172.21.15.43:0/4040805878 shutdown_connections 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.799+0000 7f760008a740 1 -- 172.21.15.43:0/4040805878 wait complete. 2024-07-26T08:37:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.799+0000 7f75f2800640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f75d80b3dc0 0x7f75d80b62d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75e4102d70 tx=0x7f75e4004920 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:43.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.799+0000 7f760008a740 1 -- start start 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 Processor -- start 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e498441b0 0x559e49c21980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 0x559e49c21ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c22400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559e499db700 con 0x559e4984c390 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559e49b14690 con 0x559e4986d070 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559e49c24b40 con 0x559e498441b0 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.800+0000 7f760008a740 10 client.0 _ll_register_callbacks cb 0x559e49b24140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 0x559e49c21ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 0x559e49c21ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53010/0 (socket says 172.21.15.43:53010) 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 -- 172.21.15.43:0/3327324780 learned_addr learned my addr 172.21.15.43:0/3327324780 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75f3200640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c22400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75f3200640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e498441b0 0x559e49c21980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 -- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e498441b0 msgr2=0x559e49c21980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e498441b0 0x559e49c21980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 -- 172.21.15.43:0/3327324780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 msgr2=0x559e49c22400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c22400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 -- 172.21.15.43:0/3327324780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e49b2b830 con 0x559e4984c390 2024-07-26T08:37:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.801+0000 7f75e9e00640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 0x559e49c21ec0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f75dc011800 tx=0x7f75dc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18eed9bd6e774481 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f75d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:37:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f75d7e00640 1 -- 172.21.15.43:0/3327324780 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc010c60 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f75d7e00640 1 -- 172.21.15.43:0/3327324780 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 10140+0+0 (secure 0 0 0) 0x7f75dc010e00 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ec019b00 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f75d7e00640 1 -- 172.21.15.43:0/3327324780 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f75dc025050 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f760008a740 10 client.15765 fetch_fsmap learned FSMap version 77 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.802+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x559e49c30760 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f75d7e00640 1 -- 172.21.15.43:0/3327324780 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75ec019b00 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f75d7e00640 1 -- 172.21.15.43:0/3327324780 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 77) ==== 8362+0+0 (secure 0 0 0) 0x7f75dc00f620 con 0x559e4984c390 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f760008a740 10 client.15765 fetch_fsmap finished waiting for FSMap version 77 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f760008a740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:37:43.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f760008a740 20 client.15765 populate_metadata read hostname 'smithi043' 2024-07-26T08:37:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f760008a740 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e4982b9f0 0x559e49c33d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f760008a740 4 client.15765 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:37:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e49b8ab10 con 0x559e4982b9f0 2024-07-26T08:37:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.803+0000 7f75f3200640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e4982b9f0 0x559e49c33d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.804+0000 7f75f3200640 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e4982b9f0 0x559e49c33d70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43dda1b2080990f server_cookie=fe89d53a1bf869b in_seq=0 out_seq=0 2024-07-26T08:37:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.804+0000 7f75d7e00640 10 client.15765 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f75d7e00640 1 -- 172.21.15.43:0/3327324780 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e49b8ab10 con 0x559e4982b9f0 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f75d7e00640 10 client.15765 handle_command_reply: tid=0 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 client.15765 shutdown 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 msgr2=0x559e49c21ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 0x559e49c21ec0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f75dc011800 tx=0x7f75dc011cc0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 shutdown_connections 2024-07-26T08:37:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e4982b9f0 0x559e49c33d70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c22400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e4984c390 0x559e49c21ec0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 --2- 172.21.15.43:0/3327324780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e498441b0 0x559e49c21980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f75d7e00640 0 client.15765 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 >> 172.21.15.43:0/3327324780 conn(0x559e49861460 msgr2=0x559e49c139f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.805+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 shutdown_connections 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.806+0000 7f760008a740 1 -- 172.21.15.43:0/3327324780 wait complete. 2024-07-26T08:37:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.806+0000 7f760008a740 20 client.15765 trim_cache size 0 max 16384 2024-07-26T08:37:43.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.825+0000 7f760008a740 1 Processor -- start 2024-07-26T08:37:43.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.825+0000 7f760008a740 1 -- start start 2024-07-26T08:37:43.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f760008a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c13740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f760008a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c39530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f760008a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c39a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f760008a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41b1580 con 0x559e498441b0 2024-07-26T08:37:43.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f760008a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41aee50 con 0x559e4986d070 2024-07-26T08:37:43.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f760008a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41acca0 con 0x559e4984c390 2024-07-26T08:37:43.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f75f3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c13740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c39530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c39530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35100/0 (socket says 172.21.15.43:35100) 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f75e9e00640 1 -- 172.21.15.43:0/226212099 learned_addr learned my addr 172.21.15.43:0/226212099 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.826+0000 7f75f3200640 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c39a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75e9e00640 1 -- 172.21.15.43:0/226212099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 msgr2=0x559e49c39a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75e9e00640 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c39a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75e9e00640 1 -- 172.21.15.43:0/226212099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 msgr2=0x559e49c13740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75e9e00640 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c13740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75e9e00640 1 -- 172.21.15.43:0/226212099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e49c240c0 con 0x559e4984c390 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75f3200640 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c39a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:37:43.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.827+0000 7f75e9e00640 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c39530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75dc006010 tx=0x7f75dc00ff60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c266ee4eddbedc8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:43.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.828+0000 7f75e2a00640 1 -- 172.21.15.43:0/226212099 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc010c60 con 0x559e4984c390 2024-07-26T08:37:43.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.828+0000 7f75e2a00640 1 -- 172.21.15.43:0/226212099 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75dc010e00 con 0x559e4984c390 2024-07-26T08:37:43.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.828+0000 7f75e2a00640 1 -- 172.21.15.43:0/226212099 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0048e0 con 0x559e4984c390 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 -- 172.21.15.43:0/226212099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 msgr2=0x559e49c39530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c39530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75dc006010 tx=0x7f75dc00ff60 comp rx=0 tx=0).stop 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 -- 172.21.15.43:0/226212099 shutdown_connections 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c39530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c39a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 --2- 172.21.15.43:0/226212099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c13740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 -- 172.21.15.43:0/226212099 >> 172.21.15.43:0/226212099 conn(0x559e49861460 msgr2=0x559e49c13030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.829+0000 7f760008a740 1 -- 172.21.15.43:0/226212099 shutdown_connections 2024-07-26T08:37:43.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.830+0000 7f760008a740 1 -- 172.21.15.43:0/226212099 wait complete. 2024-07-26T08:37:43.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.830+0000 7f760008a740 1 -- start start 2024-07-26T08:37:43.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.830+0000 7f760008a740 1 Processor -- start 2024-07-26T08:37:43.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c1b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c1ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c1bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41ad310 con 0x559e498441b0 2024-07-26T08:37:43.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41ae780 con 0x559e4986d070 2024-07-26T08:37:43.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f75f41ad9e0 con 0x559e4984c390 2024-07-26T08:37:43.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.831+0000 7f760008a740 10 client.0 _ll_register_callbacks cb 0x7f75dc011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:37:43.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c1b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c1ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c1b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53034/0 (socket says 172.21.15.43:53034) 2024-07-26T08:37:43.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 -- 172.21.15.43:0/2863634503 learned_addr learned my addr 172.21.15.43:0/2863634503 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c1bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 -- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 msgr2=0x559e49c1ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c1ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 -- 172.21.15.43:0/2863634503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 msgr2=0x559e49c1bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c1bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.832+0000 7f75f3200640 1 -- 172.21.15.43:0/2863634503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e49c28ed0 con 0x559e498441b0 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.833+0000 7f75f3200640 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c1b4f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0098a0 tx=0x7f75ec00e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624cb03da85c175a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.833+0000 7f75d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.833+0000 7f75d7e00640 1 -- 172.21.15.43:0/2863634503 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec01e030 con 0x559e498441b0 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.833+0000 7f75d7e00640 1 -- 172.21.15.43:0/2863634503 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 10140+0+0 (secure 0 0 0) 0x7f75ec0052c0 con 0x559e498441b0 2024-07-26T08:37:43.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.833+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75dc010e00 con 0x559e498441b0 2024-07-26T08:37:43.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.833+0000 7f75d7e00640 1 -- 172.21.15.43:0/2863634503 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f75ec0054c0 con 0x559e498441b0 2024-07-26T08:37:43.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 10 client.15771 fetch_fsmap learned FSMap version 77 2024-07-26T08:37:43.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x559e49c2a160 con 0x559e498441b0 2024-07-26T08:37:43.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f75d7e00640 1 -- 172.21.15.43:0/2863634503 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75dc010e00 con 0x559e498441b0 2024-07-26T08:37:43.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f75d7e00640 1 -- 172.21.15.43:0/2863634503 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 77) ==== 8362+0+0 (secure 0 0 0) 0x7f75ec0037d0 con 0x559e498441b0 2024-07-26T08:37:43.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 10 client.15771 fetch_fsmap finished waiting for FSMap version 77 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 20 client.15771 populate_metadata read hostname 'smithi043' 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e49800da0 0x559e49ca2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 4 client.15771 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.834+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e49b865b0 con 0x559e49800da0 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.835+0000 7f75e9e00640 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e49800da0 0x559e49ca2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.835+0000 7f75e9e00640 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e49800da0 0x559e49ca2d00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43854533b6f0a73e server_cookie=5224b21505bd93ed in_seq=0 out_seq=0 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.835+0000 7f75d7e00640 10 client.15771 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f75d7e00640 1 -- 172.21.15.43:0/2863634503 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x559e49b865b0 con 0x559e49800da0 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f75d7e00640 10 client.15771 handle_command_reply: tid=0 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 client.15771 shutdown 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 msgr2=0x559e49c1b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c1b4f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0098a0 tx=0x7f75ec00e610 comp rx=0 tx=0).stop 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 shutdown_connections 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559e49800da0 0x559e49ca2d00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559e4984c390 0x559e49c1ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e4986d070 0x559e49c1bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 --2- 172.21.15.43:0/2863634503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e498441b0 0x559e49c1b4f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f75d7e00640 0 client.15771 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 >> 172.21.15.43:0/2863634503 conn(0x559e49861460 msgr2=0x559e49c139f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.836+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 shutdown_connections 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.837+0000 7f760008a740 1 -- 172.21.15.43:0/2863634503 wait complete. 2024-07-26T08:37:43.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.837+0000 7f760008a740 20 client.15771 trim_cache size 0 max 16384 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:37:43.841 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.837+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f75d80b3dc0 msgr2=0x7f75d80b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.837+0000 7f75f8a00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f75d80b3dc0 0x7f75d80b62d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75e4102d70 tx=0x7f75e4004920 comp rx=0 tx=0).stop 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.837+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 msgr2=0x7f75f4199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.837+0000 7f75f8a00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4199e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f75e4006010 tx=0x7f75e4003ce0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 shutdown_connections 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f75d80b3dc0 0x7f75d80b62d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75f4104b40 0x7f75f419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f410d650 0x7f75f419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 --2- 172.21.15.43:0/2721931374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75f41041f0 0x7f75f4199e20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:37:43.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 >> 172.21.15.43:0/2721931374 conn(0x7f75f40fdcf0 msgr2=0x7f75f4107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:37:43.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 shutdown_connections 2024-07-26T08:37:43.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:37:43.838+0000 7f75f8a00640 1 -- 172.21.15.43:0/2721931374 wait complete. 2024-07-26T08:37:44.137 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:44 smithi063 ceph-mon[36747]: pgmap v630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:37:44.138 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:43 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:37:44.138 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:43 smithi063 systemd[1]: Stopped Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:37:44.138 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:43 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 1.981s CPU time. 2024-07-26T08:37:44.138 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:43 smithi063 systemd[1]: Starting Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:37:44.138 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 podman[72130]: 2024-07-26 08:37:43.955389454 +0000 UTC m=+0.018433190 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:37:44.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:44 smithi043 ceph-mon[32384]: pgmap v630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:37:44.503 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 podman[72130]: 2024-07-26 08:37:44.137173824 +0000 UTC m=+0.200217545 container create d96ae4ff3890393f8aa0f4f4ad92aecb0499362e08fb4ecd9344cae0323b2fd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:37:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:44 smithi133 ceph-mon[37053]: pgmap v630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:37:44.815 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:37:44.817 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 podman[72130]: 2024-07-26 08:37:44.502559721 +0000 UTC m=+0.565603443 container init d96ae4ff3890393f8aa0f4f4ad92aecb0499362e08fb4ecd9344cae0323b2fd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724) 2024-07-26T08:37:44.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 podman[72130]: 2024-07-26 08:37:44.505400764 +0000 UTC m=+0.568444492 container start d96ae4ff3890393f8aa0f4f4ad92aecb0499362e08fb4ecd9344cae0323b2fd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, ceph=True) 2024-07-26T08:37:44.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 ceph-mds[72149]: -- 172.21.15.63:0/83935626 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56443261d860 con 0x5644367bf600 2024-07-26T08:37:44.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: starting mds.h at 2024-07-26T08:37:44.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 bash[72130]: d96ae4ff3890393f8aa0f4f4ad92aecb0499362e08fb4ecd9344cae0323b2fd2 2024-07-26T08:37:44.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:37:44 smithi063 systemd[1]: Started Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: daemon mds.h restarted 2024-07-26T08:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: osdmap e99: 12 total, 12 up, 12 in 2024-07-26T08:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:boot 2024-07-26T08:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:37:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:45 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: daemon mds.h restarted 2024-07-26T08:37:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:37:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: osdmap e99: 12 total, 12 up, 12 in 2024-07-26T08:37:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:boot 2024-07-26T08:37:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:37:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:45.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:45 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: daemon mds.h restarted 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: osdmap e99: 12 total, 12 up, 12 in 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:boot 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: Standby daemon mds.b assigned to filesystem cephfs as rank 1 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-07-26T08:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:45 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:replay,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:46.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:46 smithi063 ceph-mon[36747]: pgmap v632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:46.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:37:46.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:46 smithi043 ceph-mon[32384]: pgmap v632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:37:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:46 smithi133 ceph-mon[37053]: pgmap v632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:37:47.245 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:47 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:resolve 2024-07-26T08:37:47.245 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:47 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:47.245 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:37:47.245 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:37:47.245 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:37:47.343 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:47 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:resolve 2024-07-26T08:37:47.344 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:47 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:47.344 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:37:47.344 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:37:47.344 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:37:47.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:47 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:resolve 2024-07-26T08:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:47 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:resolve,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:37:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:48 smithi043 ceph-mon[32384]: pgmap v633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:37:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:48 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:37:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:48 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:reconnect 2024-07-26T08:37:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:48 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:48 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:48 smithi133 ceph-mon[37053]: pgmap v633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:37:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:48 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:37:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:48 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:reconnect 2024-07-26T08:37:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:48 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:48 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:48 smithi063 ceph-mon[36747]: pgmap v633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:48 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:48 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:reconnect 2024-07-26T08:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:48 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:reconnect,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:48 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:37:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:49 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:rejoin 2024-07-26T08:37:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:49 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:49 smithi043 ceph-mon[32384]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:37:49.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:49 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:rejoin 2024-07-26T08:37:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:49 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:49 smithi133 ceph-mon[37053]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:37:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:rejoin 2024-07-26T08:37:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=b=up:rejoin,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-mon[36747]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-07-26T08:37:49.569 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:37:49.569 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: *** Caught signal (Aborted) ** 2024-07-26T08:37:49.569 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: in thread 7f8f39d97640 thread_name:ms_dispatch 2024-07-26T08:37:49.569 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:49.569 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f3f16e6f0] 2024-07-26T08:37:49.569 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8f3f1bb94c] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 3: raise() 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 4: abort() 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8f3f15871b] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 6: /lib64/libc.so.6(+0x37386) [0x7f8f3f167386] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562655bb66b9] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562655d7480c] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562655cb42ca] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562655c84753] 2024-07-26T08:37:49.570 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562655c85a1b] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562655c69752] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562655bb7a56] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562655bbb637] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562655bbbf5e] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562655b9f03a] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8f3fa3b407] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 18: (DispatchQueue::entry()+0x60f) [0x7f8f3fa3bcf9] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8f3fb185a1] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 20: (Thread::entry_wrapper()+0x43) [0x7f8f3f8c5cdd] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8f3f8c5cf9] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8f3f1b9c02] 2024-07-26T08:37:49.571 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8f3f23ec40] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.140+0000 7f8f39d97640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: in thread 7f8f39d97640 thread_name:ms_dispatch 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f3f16e6f0] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8f3f1bb94c] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 3: raise() 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 4: abort() 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8f3f15871b] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 6: /lib64/libc.so.6(+0x37386) [0x7f8f3f167386] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562655bb66b9] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562655d7480c] 2024-07-26T08:37:49.572 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562655cb42ca] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562655c84753] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562655c85a1b] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562655c69752] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562655bb7a56] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562655bbb637] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562655bbbf5e] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562655b9f03a] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8f3fa3b407] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 18: (DispatchQueue::entry()+0x60f) [0x7f8f3fa3bcf9] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8f3fb185a1] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 20: (Thread::entry_wrapper()+0x43) [0x7f8f3f8c5cdd] 2024-07-26T08:37:49.573 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8f3f8c5cf9] 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8f3f1b9c02] 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8f3f23ec40] 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 0> 2024-07-26T08:37:49.140+0000 7f8f39d97640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: in thread 7f8f39d97640 thread_name:ms_dispatch 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f3f16e6f0] 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8f3f1bb94c] 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 3: raise() 2024-07-26T08:37:49.574 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 4: abort() 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8f3f15871b] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 6: /lib64/libc.so.6(+0x37386) [0x7f8f3f167386] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562655bb66b9] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562655d7480c] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562655cb42ca] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562655c84753] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562655c85a1b] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562655c69752] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562655bb7a56] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562655bbb637] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562655bbbf5e] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562655b9f03a] 2024-07-26T08:37:49.575 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8f3fa3b407] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 18: (DispatchQueue::entry()+0x60f) [0x7f8f3fa3bcf9] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8f3fb185a1] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 20: (Thread::entry_wrapper()+0x43) [0x7f8f3f8c5cdd] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8f3f8c5cf9] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8f3f1b9c02] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8f3f23ec40] 2024-07-26T08:37:49.576 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 0> 2024-07-26T08:37:49.140+0000 7f8f39d97640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: in thread 7f8f39d97640 thread_name:ms_dispatch 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f3f16e6f0] 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8f3f1bb94c] 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 3: raise() 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 4: abort() 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8f3f15871b] 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 6: /lib64/libc.so.6(+0x37386) [0x7f8f3f167386] 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562655bb66b9] 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562655d7480c] 2024-07-26T08:37:49.577 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562655cb42ca] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562655c84753] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562655c85a1b] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562655c69752] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562655bb7a56] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562655bbb637] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562655bbbf5e] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562655b9f03a] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8f3fa3b407] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 18: (DispatchQueue::entry()+0x60f) [0x7f8f3fa3bcf9] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8f3fb185a1] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 20: (Thread::entry_wrapper()+0x43) [0x7f8f3f8c5cdd] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8f3f8c5cf9] 2024-07-26T08:37:49.578 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8f3f1b9c02] 2024-07-26T08:37:49.579 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8f3f23ec40] 2024-07-26T08:37:49.579 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:37:49.579 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b[72003]: 2024-07-26T08:37:49.579 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:49 smithi063 podman[72324]: 2024-07-26 08:37:49.21220297 +0000 UTC m=+0.024523211 container died a10ad3e7222480ad74f2ff776a38042beff1c7f99604401fbf4177a4f441a78d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True) 2024-07-26T08:37:50.317 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:50 smithi063 podman[72324]: 2024-07-26 08:37:50.06650769 +0000 UTC m=+0.878827918 container remove a10ad3e7222480ad74f2ff776a38042beff1c7f99604401fbf4177a4f441a78d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T08:37:50.318 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:50 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:37:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:50 smithi063 ceph-mon[36747]: pgmap v634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:37:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:50 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:50 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:37:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:50 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:active 2024-07-26T08:37:50.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:50 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:50.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:50 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:50 smithi043 ceph-mon[32384]: pgmap v634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:37:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:50 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:50 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:37:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:50 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:active 2024-07-26T08:37:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:50 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:50 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:50.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:50 smithi133 ceph-mon[37053]: pgmap v634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:37:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:50 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:37:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:50 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:37:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:50 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6838/2678612487,v1:172.21.15.63:6839/2678612487] up:active 2024-07-26T08:37:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:50 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-07-26T08:37:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:50 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:50.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:50 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T08:37:50.818 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:37:50 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 2.023s CPU time. 2024-07-26T08:37:52.261 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:52 smithi043 ceph-mon[32384]: pgmap v635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:52 smithi133 ceph-mon[37053]: pgmap v635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:52.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:52 smithi063 ceph-mon[36747]: pgmap v635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:37:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:54 smithi043 ceph-mon[32384]: pgmap v636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:37:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:54 smithi133 ceph-mon[37053]: pgmap v636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:37:54.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:54 smithi063 ceph-mon[36747]: pgmap v636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:37:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:56 smithi043 ceph-mon[32384]: pgmap v637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 196 B/s wr, 10 op/s 2024-07-26T08:37:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:56 smithi133 ceph-mon[37053]: pgmap v637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 196 B/s wr, 10 op/s 2024-07-26T08:37:56.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:56 smithi063 ceph-mon[36747]: pgmap v637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 196 B/s wr, 10 op/s 2024-07-26T08:37:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:57 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:57.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:57 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:57 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=b=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-07-26T08:37:58.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:37:58 smithi133 ceph-mon[37053]: pgmap v638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:37:58.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:37:58 smithi043 ceph-mon[32384]: pgmap v638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:37:58.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:37:58 smithi063 ceph-mon[36747]: pgmap v638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:00 smithi043 ceph-mon[32384]: pgmap v639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:00.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:00 smithi133 ceph-mon[37053]: pgmap v639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:00 smithi063 ceph-mon[36747]: pgmap v639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:01.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:38:00 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:38:01.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:38:00 smithi063 systemd[1]: Stopped Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:01.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:38:00 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Consumed 2.023s CPU time. 2024-07-26T08:38:01.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:38:00 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Start request repeated too quickly. 2024-07-26T08:38:01.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:38:00 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T08:38:01.068 INFO:journalctl@ceph.mds.b.smithi063.stdout:Jul 26 08:38:00 smithi063 systemd[1]: Failed to start Ceph mds.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:02 smithi043 ceph-mon[32384]: pgmap v640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:02.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:02 smithi133 ceph-mon[37053]: pgmap v640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:02 smithi063 ceph-mon[36747]: pgmap v640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:04 smithi043 ceph-mon[32384]: pgmap v641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:38:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:04 smithi133 ceph-mon[37053]: pgmap v641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:38:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:04 smithi063 ceph-mon[36747]: pgmap v641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:38:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:05 smithi043 ceph-mon[32384]: Replacing daemon mds.b as rank 1 with standby daemon mds.h 2024-07-26T08:38:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:05 smithi043 ceph-mon[32384]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T08:38:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:05 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:05 smithi043 ceph-mon[32384]: osdmap e100: 12 total, 12 up, 12 in 2024-07-26T08:38:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:05 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:05.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:05 smithi133 ceph-mon[37053]: Replacing daemon mds.b as rank 1 with standby daemon mds.h 2024-07-26T08:38:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:05 smithi133 ceph-mon[37053]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T08:38:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:05 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:05 smithi133 ceph-mon[37053]: osdmap e100: 12 total, 12 up, 12 in 2024-07-26T08:38:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:05 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:05 smithi063 ceph-mon[36747]: Replacing daemon mds.b as rank 1 with standby daemon mds.h 2024-07-26T08:38:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:05 smithi063 ceph-mon[36747]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T08:38:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:05 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:05 smithi063 ceph-mon[36747]: osdmap e100: 12 total, 12 up, 12 in 2024-07-26T08:38:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:05 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:06.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:06 smithi043 ceph-mon[32384]: pgmap v643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:06.627 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:06 smithi063 ceph-mon[36747]: pgmap v643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:06.627 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:06 smithi133 ceph-mon[37053]: pgmap v643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:07.461 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:resolve 2024-07-26T08:38:07.461 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:07 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:07.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:resolve 2024-07-26T08:38:07.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:07 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:resolve 2024-07-26T08:38:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:07 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:08 smithi043 ceph-mon[32384]: pgmap v644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:08 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:38:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:08 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:reconnect 2024-07-26T08:38:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:08 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:08 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:08.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:08 smithi133 ceph-mon[37053]: pgmap v644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:08 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:38:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:08 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:reconnect 2024-07-26T08:38:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:08 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:08 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:08 smithi063 ceph-mon[36747]: pgmap v644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:08 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:38:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:08 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:reconnect 2024-07-26T08:38:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:08 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:08 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:09 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:rejoin 2024-07-26T08:38:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:09 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:09 smithi133 ceph-mon[37053]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:38:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:rejoin 2024-07-26T08:38:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-mon[36747]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:38:09.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:38:09.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: *** Caught signal (Aborted) ** 2024-07-26T08:38:09.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: in thread 7f7807c24640 thread_name:ms_dispatch 2024-07-26T08:38:09.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:09.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f780cffb6f0] 2024-07-26T08:38:09.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f780d04894c] 2024-07-26T08:38:09.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 3: raise() 2024-07-26T08:38:09.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 4: abort() 2024-07-26T08:38:09.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 5: /lib64/libc.so.6(+0x2871b) [0x7f780cfe571b] 2024-07-26T08:38:09.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 6: /lib64/libc.so.6(+0x37386) [0x7f780cff4386] 2024-07-26T08:38:09.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56442fb3a6b9] 2024-07-26T08:38:09.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56442fcf880c] 2024-07-26T08:38:09.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56442fc382ca] 2024-07-26T08:38:09.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56442fc08753] 2024-07-26T08:38:09.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56442fc09a1b] 2024-07-26T08:38:09.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56442fbed752] 2024-07-26T08:38:09.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56442fb3ba56] 2024-07-26T08:38:09.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56442fb3f637] 2024-07-26T08:38:09.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56442fb3ff5e] 2024-07-26T08:38:09.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56442fb2303a] 2024-07-26T08:38:09.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f780d8c8407] 2024-07-26T08:38:09.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 18: (DispatchQueue::entry()+0x60f) [0x7f780d8c8cf9] 2024-07-26T08:38:09.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f780d9a55a1] 2024-07-26T08:38:09.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 20: (Thread::entry_wrapper()+0x43) [0x7f780d752cdd] 2024-07-26T08:38:09.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 21: (Thread::_entry_func(void*)+0xd) [0x7f780d752cf9] 2024-07-26T08:38:09.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 22: /lib64/libc.so.6(+0x89c02) [0x7f780d046c02] 2024-07-26T08:38:09.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f780d0cbc40] 2024-07-26T08:38:09.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.245+0000 7f7807c24640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:09.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: in thread 7f7807c24640 thread_name:ms_dispatch 2024-07-26T08:38:09.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:09.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f780cffb6f0] 2024-07-26T08:38:09.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f780d04894c] 2024-07-26T08:38:09.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 3: raise() 2024-07-26T08:38:09.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 4: abort() 2024-07-26T08:38:09.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 5: /lib64/libc.so.6(+0x2871b) [0x7f780cfe571b] 2024-07-26T08:38:09.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 6: /lib64/libc.so.6(+0x37386) [0x7f780cff4386] 2024-07-26T08:38:09.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56442fb3a6b9] 2024-07-26T08:38:09.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56442fcf880c] 2024-07-26T08:38:09.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56442fc382ca] 2024-07-26T08:38:09.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56442fc08753] 2024-07-26T08:38:09.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56442fc09a1b] 2024-07-26T08:38:09.579 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56442fbed752] 2024-07-26T08:38:09.579 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56442fb3ba56] 2024-07-26T08:38:09.579 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56442fb3f637] 2024-07-26T08:38:09.579 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56442fb3ff5e] 2024-07-26T08:38:09.579 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56442fb2303a] 2024-07-26T08:38:09.580 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f780d8c8407] 2024-07-26T08:38:09.580 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 18: (DispatchQueue::entry()+0x60f) [0x7f780d8c8cf9] 2024-07-26T08:38:09.580 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f780d9a55a1] 2024-07-26T08:38:09.580 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 20: (Thread::entry_wrapper()+0x43) [0x7f780d752cdd] 2024-07-26T08:38:09.580 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 21: (Thread::_entry_func(void*)+0xd) [0x7f780d752cf9] 2024-07-26T08:38:09.581 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 22: /lib64/libc.so.6(+0x89c02) [0x7f780d046c02] 2024-07-26T08:38:09.581 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f780d0cbc40] 2024-07-26T08:38:09.581 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:09.581 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.581 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 0> 2024-07-26T08:38:09.245+0000 7f7807c24640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:09.582 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: in thread 7f7807c24640 thread_name:ms_dispatch 2024-07-26T08:38:09.582 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.582 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:09.582 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f780cffb6f0] 2024-07-26T08:38:09.582 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f780d04894c] 2024-07-26T08:38:09.582 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 3: raise() 2024-07-26T08:38:09.583 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 4: abort() 2024-07-26T08:38:09.583 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 5: /lib64/libc.so.6(+0x2871b) [0x7f780cfe571b] 2024-07-26T08:38:09.583 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 6: /lib64/libc.so.6(+0x37386) [0x7f780cff4386] 2024-07-26T08:38:09.583 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56442fb3a6b9] 2024-07-26T08:38:09.583 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56442fcf880c] 2024-07-26T08:38:09.584 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56442fc382ca] 2024-07-26T08:38:09.584 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56442fc08753] 2024-07-26T08:38:09.584 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56442fc09a1b] 2024-07-26T08:38:09.584 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56442fbed752] 2024-07-26T08:38:09.584 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56442fb3ba56] 2024-07-26T08:38:09.585 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56442fb3f637] 2024-07-26T08:38:09.585 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56442fb3ff5e] 2024-07-26T08:38:09.585 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56442fb2303a] 2024-07-26T08:38:09.585 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f780d8c8407] 2024-07-26T08:38:09.585 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 18: (DispatchQueue::entry()+0x60f) [0x7f780d8c8cf9] 2024-07-26T08:38:09.586 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f780d9a55a1] 2024-07-26T08:38:09.586 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 20: (Thread::entry_wrapper()+0x43) [0x7f780d752cdd] 2024-07-26T08:38:09.586 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 21: (Thread::_entry_func(void*)+0xd) [0x7f780d752cf9] 2024-07-26T08:38:09.586 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 22: /lib64/libc.so.6(+0x89c02) [0x7f780d046c02] 2024-07-26T08:38:09.586 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f780d0cbc40] 2024-07-26T08:38:09.587 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:09.587 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.587 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: -1> 2024-07-26T08:38:09.245+0000 7f7807c24640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:09.587 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: in thread 7f7807c24640 thread_name:ms_dispatch 2024-07-26T08:38:09.587 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.587 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:09.588 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f780cffb6f0] 2024-07-26T08:38:09.588 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f780d04894c] 2024-07-26T08:38:09.588 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 3: raise() 2024-07-26T08:38:09.588 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 4: abort() 2024-07-26T08:38:09.588 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 5: /lib64/libc.so.6(+0x2871b) [0x7f780cfe571b] 2024-07-26T08:38:09.589 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 6: /lib64/libc.so.6(+0x37386) [0x7f780cff4386] 2024-07-26T08:38:09.589 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56442fb3a6b9] 2024-07-26T08:38:09.589 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56442fcf880c] 2024-07-26T08:38:09.589 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56442fc382ca] 2024-07-26T08:38:09.589 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56442fc08753] 2024-07-26T08:38:09.590 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56442fc09a1b] 2024-07-26T08:38:09.590 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56442fbed752] 2024-07-26T08:38:09.590 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56442fb3ba56] 2024-07-26T08:38:09.590 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56442fb3f637] 2024-07-26T08:38:09.590 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56442fb3ff5e] 2024-07-26T08:38:09.591 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56442fb2303a] 2024-07-26T08:38:09.591 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f780d8c8407] 2024-07-26T08:38:09.591 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 18: (DispatchQueue::entry()+0x60f) [0x7f780d8c8cf9] 2024-07-26T08:38:09.591 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f780d9a55a1] 2024-07-26T08:38:09.591 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 20: (Thread::entry_wrapper()+0x43) [0x7f780d752cdd] 2024-07-26T08:38:09.592 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 21: (Thread::_entry_func(void*)+0xd) [0x7f780d752cf9] 2024-07-26T08:38:09.592 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 22: /lib64/libc.so.6(+0x89c02) [0x7f780d046c02] 2024-07-26T08:38:09.592 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f780d0cbc40] 2024-07-26T08:38:09.592 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:09.592 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72145]: 2024-07-26T08:38:09.592 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:09 smithi063 podman[72381]: 2024-07-26 08:38:09.321845938 +0000 UTC m=+0.022704883 container died d96ae4ff3890393f8aa0f4f4ad92aecb0499362e08fb4ecd9344cae0323b2fd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240724) 2024-07-26T08:38:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:09 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:rejoin 2024-07-26T08:38:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:09 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:09 smithi043 ceph-mon[32384]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:38:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:10 smithi133 ceph-mon[37053]: pgmap v645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:38:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:10 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:10 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:38:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:active 2024-07-26T08:38:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:10 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:10 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:10 smithi063 ceph-mon[36747]: pgmap v645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:10 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:10 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:active 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:10 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:10 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:10 smithi063 podman[72381]: 2024-07-26 08:38:10.096414767 +0000 UTC m=+0.797273714 container remove d96ae4ff3890393f8aa0f4f4ad92aecb0499362e08fb4ecd9344cae0323b2fd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True) 2024-07-26T08:38:10.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:10 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:38:10.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:10 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:38:10.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:10 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 2.029s CPU time. 2024-07-26T08:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:10 smithi043 ceph-mon[32384]: pgmap v645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:10 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:10 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/4138037593,v1:172.21.15.63:6837/4138037593] up:active 2024-07-26T08:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:10 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:10 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:12 smithi133 ceph-mon[37053]: pgmap v646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:38:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:12 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:12 smithi063 ceph-mon[36747]: pgmap v646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:38:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:12 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:12 smithi043 ceph-mon[32384]: pgmap v646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:38:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:12 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:14.278 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:14 smithi043 ceph-mon[32384]: pgmap v647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:14 smithi133 ceph-mon[37053]: pgmap v647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:14.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:14 smithi063 ceph-mon[36747]: pgmap v647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:14.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:38:15.309 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:38:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:16 smithi133 ceph-mon[37053]: pgmap v648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 201 B/s wr, 10 op/s 2024-07-26T08:38:16.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:16 smithi063 ceph-mon[36747]: pgmap v648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 201 B/s wr, 10 op/s 2024-07-26T08:38:16.602 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:16 smithi043 ceph-mon[32384]: pgmap v648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 201 B/s wr, 10 op/s 2024-07-26T08:38:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 -- 172.21.15.43:0/2008034291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc075800 msgr2=0x7fcdcc075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 --2- 172.21.15.43:0/2008034291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc075800 0x7fcdcc075c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009860 tx=0x7fcdb402a340 comp rx=0 tx=0).stop 2024-07-26T08:38:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 -- 172.21.15.43:0/2008034291 shutdown_connections 2024-07-26T08:38:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 --2- 172.21.15.43:0/2008034291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc113e70 0x7fcdcc116340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 --2- 172.21.15.43:0/2008034291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc075800 0x7fcdcc075c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 --2- 172.21.15.43:0/2008034291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdcc076db0 0x7fcdcc0751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 -- 172.21.15.43:0/2008034291 >> 172.21.15.43:0/2008034291 conn(0x7fcdcc0ff010 msgr2=0x7fcdcc101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 -- 172.21.15.43:0/2008034291 shutdown_connections 2024-07-26T08:38:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.136+0000 7fcdd3000640 1 -- 172.21.15.43:0/2008034291 wait complete. 2024-07-26T08:38:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 Processor -- start 2024-07-26T08:38:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 -- start start 2024-07-26T08:38:18.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc075800 0x7fcdcc1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 0x7fcdcc1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdcc113e70 0x7fcdcc1a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc119bd0 con 0x7fcdcc113e70 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc119a50 con 0x7fcdcc076db0 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.138+0000 7fcdd3000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc119d50 con 0x7fcdcc075800 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 0x7fcdcc1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 0x7fcdcc1a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38430/0 (socket says 172.21.15.43:38430) 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 -- 172.21.15.43:0/349855464 learned_addr learned my addr 172.21.15.43:0/349855464 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdd1000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdcc113e70 0x7fcdcc1a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc075800 0x7fcdcc1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 -- 172.21.15.43:0/349855464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc075800 msgr2=0x7fcdcc1a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc075800 0x7fcdcc1a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 -- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdcc113e70 msgr2=0x7fcdcc1a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdcc113e70 0x7fcdcc1a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.139+0000 7fcdc3e00640 1 -- 172.21.15.43:0/349855464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc1a64f0 con 0x7fcdcc076db0 2024-07-26T08:38:18.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.140+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 0x7fcdcc1a0b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4000c00 tx=0x7fcdb402aea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:18.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.140+0000 7fcdc9600640 1 -- 172.21.15.43:0/349855464 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403f020 con 0x7fcdcc076db0 2024-07-26T08:38:18.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.140+0000 7fcdc9600640 1 -- 172.21.15.43:0/349855464 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdb4033dd0 con 0x7fcdcc076db0 2024-07-26T08:38:18.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.140+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc1a6780 con 0x7fcdcc076db0 2024-07-26T08:38:18.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.140+0000 7fcdc9600640 1 -- 172.21.15.43:0/349855464 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4037040 con 0x7fcdcc076db0 2024-07-26T08:38:18.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.140+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc1acf40 con 0x7fcdcc076db0 2024-07-26T08:38:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 Processor -- start 2024-07-26T08:38:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 -- start start 2024-07-26T08:38:18.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdc9600640 1 -- 172.21.15.43:0/349855464 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fcdb4042020 con 0x7fcdcc076db0 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3e2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cbcb358bc0 con 0x55cbcb0141b0 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cbcb3480c0 con 0x55cbcb03d070 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.144+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cbcb34c100 con 0x55cbcb01c390 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38434/0 (socket says 172.21.15.43:38434) 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 -- 172.21.15.43:0/763341315 learned_addr learned my addr 172.21.15.43:0/763341315 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 -- 172.21.15.43:0/763341315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 msgr2=0x55cbcb3e28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3e28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 -- 172.21.15.43:0/763341315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 msgr2=0x55cbcb3e2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3e2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdd1000640 1 -- 172.21.15.43:0/763341315 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcb0a8650 con 0x55cbcb03d070 2024-07-26T08:38:18.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.145+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:38:18.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.146+0000 7fcdd1000640 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e1e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009fd0 tx=0x7fcdc40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd0d6ab703b35bb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:18.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.146+0000 7fcdc1600640 1 -- 172.21.15.43:0/763341315 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4004d20 con 0x55cbcb03d070 2024-07-26T08:38:18.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.146+0000 7fcdc1600640 1 -- 172.21.15.43:0/763341315 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdc4004050 con 0x55cbcb03d070 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.146+0000 7fcdc1600640 1 -- 172.21.15.43:0/763341315 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4005220 con 0x55cbcb03d070 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.146+0000 7fcdc9600640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcdb00b3d40 0x7fcdb00b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdc9600640 1 -- 172.21.15.43:0/349855464 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 10312+0+0 (secure 0 0 0) 0x7fcdb41043a0 con 0x7fcdcc076db0 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcdb00b3d40 0x7fcdb00b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 -- 172.21.15.43:0/763341315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 msgr2=0x55cbcb3e1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e1e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009fd0 tx=0x7fcdc40118d0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 -- 172.21.15.43:0/763341315 shutdown_connections 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/763341315 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e1e20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 -- 172.21.15.43:0/763341315 >> 172.21.15.43:0/763341315 conn(0x55cbcb031460 msgr2=0x55cbcb3dfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:18.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.147+0000 7fcdd9beb740 1 -- 172.21.15.43:0/763341315 shutdown_connections 2024-07-26T08:38:18.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.148+0000 7fcdd9beb740 1 -- 172.21.15.43:0/763341315 wait complete. 2024-07-26T08:38:18.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.148+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcdb00b3d40 0x7fcdb00b6250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cbcb3e0aa0 tx=0x7fcdbc009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:18.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.148+0000 7fcdd9beb740 1 -- start start 2024-07-26T08:38:18.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.148+0000 7fcdd9beb740 1 Processor -- start 2024-07-26T08:38:18.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ed470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cbcb1ab700 con 0x55cbcb0141b0 2024-07-26T08:38:18.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cbcb2e4690 con 0x55cbcb03d070 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cbcb3f0600 con 0x55cbcb01c390 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.149+0000 7fcdd9beb740 10 client.0 _ll_register_callbacks cb 0x55cbcb2f4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3edef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38440/0 (socket says 172.21.15.43:38440) 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 -- 172.21.15.43:0/3584468829 learned_addr learned my addr 172.21.15.43:0/3584468829 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 -- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 msgr2=0x55cbcb3ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 -- 172.21.15.43:0/3584468829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 msgr2=0x55cbcb3ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 -- 172.21.15.43:0/3584468829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcb2fb830 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.150+0000 7fcdd1000640 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3edef0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009fa0 tx=0x7fcdc4004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb7e3b486aee770 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdba000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdba000640 1 -- 172.21.15.43:0/3584468829 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4028020 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc4004050 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdba000640 1 -- 172.21.15.43:0/3584468829 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 10312+0+0 (secure 0 0 0) 0x7fcdc4004410 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdba000640 1 -- 172.21.15.43:0/3584468829 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4033050 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdd9beb740 10 client.25958 fetch_fsmap learned FSMap version 92 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.151+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) -- 0x55cbcb3fc1d0 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdba000640 1 -- 172.21.15.43:0/3584468829 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdc4004050 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdba000640 1 -- 172.21.15.43:0/3584468829 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 92) ==== 7749+0+0 (secure 0 0 0) 0x7fcdc400f4e0 con 0x55cbcb03d070 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdd9beb740 10 client.25958 fetch_fsmap finished waiting for FSMap version 92 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdd9beb740 10 client.25958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:38:18.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdd9beb740 20 client.25958 populate_metadata read hostname 'smithi043' 2024-07-26T08:38:18.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcaffb9f0 0x55cbcb3ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdd9beb740 4 client.25958 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:38:18.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbcb35ab10 con 0x55cbcaffb9f0 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.152+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcaffb9f0 0x55cbcb3ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.153+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcaffb9f0 0x55cbcb3ff5f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd21ea6786ddafc server_cookie=bbbb2bb60b7b925d in_seq=0 out_seq=0 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.153+0000 7fcdba000640 10 client.25958 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdba000640 1 -- 172.21.15.43:0/3584468829 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbcb35ab10 con 0x55cbcaffb9f0 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdba000640 10 client.25958 handle_command_reply: tid=0 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 client.25958 shutdown 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 msgr2=0x55cbcb3edef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3edef0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009fa0 tx=0x7fcdc4004c70 comp rx=0 tx=0).stop 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 shutdown_connections 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcaffb9f0 0x55cbcb3ff5f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3edef0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3584468829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 >> 172.21.15.43:0/3584468829 conn(0x55cbcb031460 msgr2=0x55cbcb3e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdba000640 0 client.25958 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 shutdown_connections 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.154+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3584468829 wait complete. 2024-07-26T08:38:18.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.155+0000 7fcdd9beb740 20 client.25958 trim_cache size 0 max 16384 2024-07-26T08:38:18.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 Processor -- start 2024-07-26T08:38:18.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 -- start start 2024-07-26T08:38:18.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb01c390 0x55cbcb3ef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b9240 con 0x55cbcb01c390 2024-07-26T08:38:18.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b9910 con 0x55cbcb03d070 2024-07-26T08:38:18.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.174+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b7220 con 0x55cbcb0141b0 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ecd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:54334/0 (socket says 172.21.15.43:54334) 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38450/0 (socket says 172.21.15.43:38450) 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 -- 172.21.15.43:0/3985995835 learned_addr learned my addr 172.21.15.43:0/3985995835 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb01c390 0x55cbcb3ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 -- 172.21.15.43:0/3985995835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 msgr2=0x55cbcb3e2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 -- 172.21.15.43:0/3985995835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb01c390 msgr2=0x55cbcb3ef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb01c390 0x55cbcb3ef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 -- 172.21.15.43:0/3985995835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcb3e0ad0 con 0x55cbcb0141b0 2024-07-26T08:38:18.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb01c390 0x55cbcb3ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:38:18.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.175+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ecd00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0042d0 tx=0x7fcdbc021040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a36ad0b8e5d518d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.176+0000 7fcdc0c00640 1 -- 172.21.15.43:0/3985995835 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc003de0 con 0x55cbcb0141b0 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.176+0000 7fcdc0c00640 1 -- 172.21.15.43:0/3985995835 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdbc003f80 con 0x55cbcb0141b0 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.176+0000 7fcdc0c00640 1 -- 172.21.15.43:0/3985995835 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc01eb10 con 0x55cbcb0141b0 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3985995835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 msgr2=0x55cbcb3ecd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ecd00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0042d0 tx=0x7fcdbc021040 comp rx=0 tx=0).stop 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3985995835 shutdown_connections 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb03d070 0x55cbcb3e2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb01c390 0x55cbcb3ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/3985995835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb0141b0 0x55cbcb3ecd00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3985995835 >> 172.21.15.43:0/3985995835 conn(0x55cbcb031460 msgr2=0x55cbcb3ed3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3985995835 shutdown_connections 2024-07-26T08:38:18.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 -- 172.21.15.43:0/3985995835 wait complete. 2024-07-26T08:38:18.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.177+0000 7fcdd9beb740 1 -- start start 2024-07-26T08:38:18.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 Processor -- start 2024-07-26T08:38:18.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb0141b0 0x55cbcb3f2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 0x55cbcb3f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b6b50 con 0x55cbcb03d070 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b5740 con 0x55cbcb0141b0 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b5db0 con 0x55cbcb01c390 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd9beb740 10 client.0 _ll_register_callbacks cb 0x7fcdc4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 0x55cbcb3f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb0141b0 0x55cbcb3f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb0141b0 0x55cbcb3f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38452/0 (socket says 172.21.15.43:38452) 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdcbe00640 1 -- 172.21.15.43:0/468782247 learned_addr learned my addr 172.21.15.43:0/468782247 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.178+0000 7fcdd1000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 0x55cbcb3f33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34896/0 (socket says 172.21.15.43:34896) 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 -- 172.21.15.43:0/468782247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb0141b0 msgr2=0x55cbcb3f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb0141b0 0x55cbcb3f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 -- 172.21.15.43:0/468782247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 msgr2=0x55cbcb3f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 0x55cbcb3f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 -- 172.21.15.43:0/468782247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcb465fb0 con 0x55cbcb01c390 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdd1000640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 0x55cbcb3f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdc3e00640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3f2e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcdb41014a0 tx=0x7fcdb4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07d144ec58fb22f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.179+0000 7fcdba000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdba000640 1 -- 172.21.15.43:0/468782247 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40ebe60 con 0x55cbcb01c390 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdbc003f80 con 0x55cbcb01c390 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdba000640 1 -- 172.21.15.43:0/468782247 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 10312+0+0 (secure 0 0 0) 0x7fcdb4030460 con 0x55cbcb01c390 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdba000640 1 -- 172.21.15.43:0/468782247 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fcdb40ca340 con 0x55cbcb01c390 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdd9beb740 10 client.25975 fetch_fsmap learned FSMap version 92 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) -- 0x55cbcb467240 con 0x55cbcb01c390 2024-07-26T08:38:18.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdba000640 1 -- 172.21.15.43:0/468782247 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdbc003f80 con 0x55cbcb01c390 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.180+0000 7fcdba000640 1 -- 172.21.15.43:0/468782247 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) ==== 7749+0+0 (secure 0 0 0) 0x7fcdb403a030 con 0x55cbcb01c390 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdd9beb740 10 client.25975 fetch_fsmap finished waiting for FSMap version 92 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdd9beb740 10 client.25975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdd9beb740 20 client.25975 populate_metadata read hostname 'smithi043' 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcafd0da0 0x55cbcb469980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdd9beb740 4 client.25975 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cbcb3565b0 con 0x55cbcafd0da0 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.181+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcafd0da0 0x55cbcb469980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdcbe00640 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcafd0da0 0x55cbcb469980 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3e6b99ef1b0ba46 server_cookie=f2d8cc89a359477b in_seq=0 out_seq=0 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdba000640 10 client.25975 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdba000640 1 -- 172.21.15.43:0/468782247 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55cbcb3565b0 con 0x55cbcafd0da0 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdba000640 10 client.25975 handle_command_reply: tid=0 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 client.25975 shutdown 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 msgr2=0x55cbcb3f2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3f2e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcdb41014a0 tx=0x7fcdb4005f90 comp rx=0 tx=0).stop 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 shutdown_connections 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cbcafd0da0 0x55cbcb469980 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cbcb01c390 0x55cbcb3f2e90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cbcb03d070 0x55cbcb3f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdba000640 0 client.25975 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:18.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 --2- 172.21.15.43:0/468782247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cbcb0141b0 0x55cbcb3f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 >> 172.21.15.43:0/468782247 conn(0x55cbcb031460 msgr2=0x55cbcb3e2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.182+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 shutdown_connections 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.183+0000 7fcdd9beb740 1 -- 172.21.15.43:0/468782247 wait complete. 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.183+0000 7fcdd9beb740 20 client.25975 trim_cache size 0 max 16384 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:38:18.187 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:38:18.188 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:38:18.188 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:38:18.188 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:38:18.188 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:38:18.188 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.183+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcdb00b3d40 msgr2=0x7fcdb00b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.183+0000 7fcdd3000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcdb00b3d40 0x7fcdb00b6250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cbcb3e0aa0 tx=0x7fcdbc009260 comp rx=0 tx=0).stop 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 msgr2=0x7fcdcc1a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 0x7fcdcc1a0b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4000c00 tx=0x7fcdb402aea0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 shutdown_connections 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fcdb00b3d40 0x7fcdb00b6250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdcc113e70 0x7fcdcc1a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdcc076db0 0x7fcdcc1a0b20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 --2- 172.21.15.43:0/349855464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc075800 0x7fcdcc1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 >> 172.21.15.43:0/349855464 conn(0x7fcdcc0ff010 msgr2=0x7fcdcc10fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 shutdown_connections 2024-07-26T08:38:18.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:18.184+0000 7fcdd3000640 1 -- 172.21.15.43:0/349855464 wait complete. 2024-07-26T08:38:18.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:18 smithi043 ceph-mon[32384]: pgmap v649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:18.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:18 smithi063 ceph-mon[36747]: pgmap v649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:18.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:18 smithi133 ceph-mon[37053]: pgmap v649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:19.237 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:38:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:20 smithi063 ceph-mon[36747]: pgmap v650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:20 smithi043 ceph-mon[32384]: pgmap v650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:20 smithi133 ceph-mon[37053]: pgmap v650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:20.948 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:20 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:38:20.948 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:20 smithi063 systemd[1]: Stopped Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:20.948 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:20 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 2.029s CPU time. 2024-07-26T08:38:20.948 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:20 smithi063 systemd[1]: Starting Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:38:20.948 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:20 smithi063 podman[72470]: 2024-07-26 08:38:20.710865834 +0000 UTC m=+0.018192061 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:38:20.948 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:20 smithi063 podman[72470]: 2024-07-26 08:38:20.947366004 +0000 UTC m=+0.254692215 container create 3de644b1ced579c7bff751934763847ecf571f5c378089d69c737b553639d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux ) 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:21 smithi063 ceph-mon[36747]: daemon mds.h restarted 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:21 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:21 smithi063 podman[72470]: 2024-07-26 08:38:21.225141851 +0000 UTC m=+0.532468065 container init 3de644b1ced579c7bff751934763847ecf571f5c378089d69c737b553639d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724) 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:21 smithi063 podman[72470]: 2024-07-26 08:38:21.228186298 +0000 UTC m=+0.535512528 container start 3de644b1ced579c7bff751934763847ecf571f5c378089d69c737b553639d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:21 smithi063 ceph-mds[72489]: -- 172.21.15.63:0/266577696 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d395641860 con 0x55d3997e3180 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:21 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: starting mds.h at 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:21 smithi063 bash[72470]: 3de644b1ced579c7bff751934763847ecf571f5c378089d69c737b553639d56b 2024-07-26T08:38:21.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:21 smithi063 systemd[1]: Started Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:21.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:21 smithi043 ceph-mon[32384]: daemon mds.h restarted 2024-07-26T08:38:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:21 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:21.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:21 smithi133 ceph-mon[37053]: daemon mds.h restarted 2024-07-26T08:38:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:21 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: pgmap v651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: osdmap e101: 12 total, 12 up, 12 in 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:boot 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:22 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:22.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: pgmap v651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:22.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:38:22.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: osdmap e101: 12 total, 12 up, 12 in 2024-07-26T08:38:22.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:boot 2024-07-26T08:38:22.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:38:22.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:22.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:22 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: pgmap v651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: osdmap e101: 12 total, 12 up, 12 in 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:boot 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:22 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:23.580 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:23 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:resolve 2024-07-26T08:38:23.580 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:23 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:23.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:23 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:resolve 2024-07-26T08:38:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:23 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:23.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:23 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:resolve 2024-07-26T08:38:23.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:23 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:24.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:24 smithi043 ceph-mon[32384]: pgmap v653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:38:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:24 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:38:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:24 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:reconnect 2024-07-26T08:38:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:24 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:24 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:24.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:24 smithi133 ceph-mon[37053]: pgmap v653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:38:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:24 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:38:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:24 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:reconnect 2024-07-26T08:38:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:24 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:24 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:24.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-mon[36747]: pgmap v653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:38:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:38:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:reconnect 2024-07-26T08:38:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: *** Caught signal (Aborted) ** 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: in thread 7fe62aaa4640 thread_name:ms_dispatch 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe62fe7b6f0] 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe62fec894c] 2024-07-26T08:38:25.264 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 3: raise() 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 4: abort() 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe62fe6571b] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 6: /lib64/libc.so.6(+0x37386) [0x7fe62fe74386] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5648c7c986b9] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5648c7e5680c] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5648c7d962ca] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5648c7d66753] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5648c7d67a1b] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5648c7d4b752] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5648c7c99a56] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5648c7c9d637] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5648c7c9df5e] 2024-07-26T08:38:25.265 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5648c7c8103a] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe630748407] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 18: (DispatchQueue::entry()+0x60f) [0x7fe630748cf9] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6308255a1] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6305d2cdd] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6305d2cf9] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe62fec6c02] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe62ff4bc40] 2024-07-26T08:38:25.266 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:24.886+0000 7fe62aaa4640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: in thread 7fe62aaa4640 thread_name:ms_dispatch 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe62fe7b6f0] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe62fec894c] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 3: raise() 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 4: abort() 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe62fe6571b] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 6: /lib64/libc.so.6(+0x37386) [0x7fe62fe74386] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5648c7c986b9] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5648c7e5680c] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5648c7d962ca] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5648c7d66753] 2024-07-26T08:38:25.267 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5648c7d67a1b] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5648c7d4b752] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5648c7c99a56] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5648c7c9d637] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5648c7c9df5e] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5648c7c8103a] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe630748407] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 18: (DispatchQueue::entry()+0x60f) [0x7fe630748cf9] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6308255a1] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6305d2cdd] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6305d2cf9] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe62fec6c02] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe62ff4bc40] 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:25.268 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 0> 2024-07-26T08:38:24.886+0000 7fe62aaa4640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: in thread 7fe62aaa4640 thread_name:ms_dispatch 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe62fe7b6f0] 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe62fec894c] 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 3: raise() 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 4: abort() 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe62fe6571b] 2024-07-26T08:38:25.269 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 6: /lib64/libc.so.6(+0x37386) [0x7fe62fe74386] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5648c7c986b9] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5648c7e5680c] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5648c7d962ca] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5648c7d66753] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5648c7d67a1b] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5648c7d4b752] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5648c7c99a56] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5648c7c9d637] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5648c7c9df5e] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5648c7c8103a] 2024-07-26T08:38:25.270 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe630748407] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 18: (DispatchQueue::entry()+0x60f) [0x7fe630748cf9] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6308255a1] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6305d2cdd] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6305d2cf9] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe62fec6c02] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe62ff4bc40] 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:25.271 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 0> 2024-07-26T08:38:24.886+0000 7fe62aaa4640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: in thread 7fe62aaa4640 thread_name:ms_dispatch 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe62fe7b6f0] 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe62fec894c] 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 3: raise() 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 4: abort() 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe62fe6571b] 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 6: /lib64/libc.so.6(+0x37386) [0x7fe62fe74386] 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5648c7c986b9] 2024-07-26T08:38:25.272 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5648c7e5680c] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5648c7d962ca] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5648c7d66753] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5648c7d67a1b] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5648c7d4b752] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5648c7c99a56] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5648c7c9d637] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5648c7c9df5e] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5648c7c8103a] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe630748407] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 18: (DispatchQueue::entry()+0x60f) [0x7fe630748cf9] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6308255a1] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6305d2cdd] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6305d2cf9] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe62fec6c02] 2024-07-26T08:38:25.273 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe62ff4bc40] 2024-07-26T08:38:25.274 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:25.274 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[67746]: 2024-07-26T08:38:25.274 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:24 smithi063 podman[72523]: 2024-07-26 08:38:24.970237098 +0000 UTC m=+0.019831214 container died 54c1bf4eb7eb671d252b468f1d1510326c24fef8e8b13f14e33235062c3735d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-07-26T08:38:25.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:rejoin 2024-07-26T08:38:25.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:25.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:38:25.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:25.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: Cluster is now healthy 2024-07-26T08:38:25.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:active 2024-07-26T08:38:25.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:25 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:rejoin 2024-07-26T08:38:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:38:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: Cluster is now healthy 2024-07-26T08:38:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:active 2024-07-26T08:38:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:25 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:25.760 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:rejoin 2024-07-26T08:38:25.760 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:25.760 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:38:25.760 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:25.761 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: Cluster is now healthy 2024-07-26T08:38:25.761 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/302781783,v1:172.21.15.63:6835/302781783] up:active 2024-07-26T08:38:25.761 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:26.015 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:38:25 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:38:25.759+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:38:26.318 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:25 smithi063 podman[72523]: 2024-07-26 08:38:25.822434407 +0000 UTC m=+0.872028511 container remove 54c1bf4eb7eb671d252b468f1d1510326c24fef8e8b13f14e33235062c3735d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T08:38:26.318 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:25 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:38:26.318 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:26 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:38:26.318 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:26 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 2.157s CPU time. 2024-07-26T08:38:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:26 smithi043 ceph-mon[32384]: pgmap v654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:38:26.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:26 smithi133 ceph-mon[37053]: pgmap v654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:38:26.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:26 smithi063 ceph-mon[36747]: pgmap v654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:38:28.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:28 smithi043 ceph-mon[32384]: pgmap v655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:38:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:28 smithi133 ceph-mon[37053]: pgmap v655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:38:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:28 smithi063 ceph-mon[36747]: pgmap v655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:38:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:30 smithi043 ceph-mon[32384]: pgmap v656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:38:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:30 smithi133 ceph-mon[37053]: pgmap v656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:38:30.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:30 smithi063 ceph-mon[36747]: pgmap v656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:38:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:32 smithi043 ceph-mon[32384]: pgmap v657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:32 smithi133 ceph-mon[37053]: pgmap v657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:32.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:32 smithi063 ceph-mon[36747]: pgmap v657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:34 smithi043 ceph-mon[32384]: pgmap v658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 174 B/s wr, 10 op/s 2024-07-26T08:38:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:34 smithi133 ceph-mon[37053]: pgmap v658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 174 B/s wr, 10 op/s 2024-07-26T08:38:34.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:34 smithi063 ceph-mon[36747]: pgmap v658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 174 B/s wr, 10 op/s 2024-07-26T08:38:36.384 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:38:36.384 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 systemd[1]: Stopped Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:36.384 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 2.157s CPU time. 2024-07-26T08:38:36.384 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 systemd[1]: Starting Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:38:36.385 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 podman[72616]: 2024-07-26 08:38:36.208888753 +0000 UTC m=+0.018111739 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:38:36.726 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:36 smithi063 ceph-mon[36747]: pgmap v659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:36.727 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 podman[72616]: 2024-07-26 08:38:36.49053773 +0000 UTC m=+0.299760741 container create b1b960bdd55df94037a29f255bf6b53ae667c3d932e623295e25715d79a774b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-07-26T08:38:36.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:36 smithi043 ceph-mon[32384]: pgmap v659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:36 smithi133 ceph-mon[37053]: pgmap v659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:37.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 podman[72616]: 2024-07-26 08:38:36.726297393 +0000 UTC m=+0.535520365 container init b1b960bdd55df94037a29f255bf6b53ae667c3d932e623295e25715d79a774b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-07-26T08:38:37.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 podman[72616]: 2024-07-26 08:38:36.729088433 +0000 UTC m=+0.538311406 container start b1b960bdd55df94037a29f255bf6b53ae667c3d932e623295e25715d79a774b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-07-26T08:38:37.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 ceph-mds[72635]: -- 172.21.15.63:0/389129489 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646bc2e5860 con 0x5646c0487600 2024-07-26T08:38:37.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: starting mds.e at 2024-07-26T08:38:37.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 bash[72616]: b1b960bdd55df94037a29f255bf6b53ae667c3d932e623295e25715d79a774b7 2024-07-26T08:38:37.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:36 smithi063 systemd[1]: Started Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: daemon mds.e restarted 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: osdmap e102: 12 total, 12 up, 12 in 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:boot 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:37.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:37 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:37.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: daemon mds.e restarted 2024-07-26T08:38:37.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: osdmap e102: 12 total, 12 up, 12 in 2024-07-26T08:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:boot 2024-07-26T08:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:37 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: daemon mds.e restarted 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: osdmap e102: 12 total, 12 up, 12 in 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:boot 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:37.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:37 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:38 smithi043 ceph-mon[32384]: pgmap v661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 9 op/s 2024-07-26T08:38:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:38 smithi133 ceph-mon[37053]: pgmap v661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 9 op/s 2024-07-26T08:38:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:38 smithi063 ceph-mon[36747]: pgmap v661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 9 op/s 2024-07-26T08:38:39.668 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:39 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:resolve 2024-07-26T08:38:39.668 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:39 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:39.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:39 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:resolve 2024-07-26T08:38:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:39 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:39.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:39 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:resolve 2024-07-26T08:38:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:39 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:40 smithi043 ceph-mon[32384]: pgmap v662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:38:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:reconnect 2024-07-26T08:38:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:40 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:40 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:40 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:38:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:40 smithi133 ceph-mon[37053]: pgmap v662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:38:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:reconnect 2024-07-26T08:38:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:40 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:40 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:40 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:38:40.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:40 smithi063 ceph-mon[36747]: pgmap v662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:38:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:reconnect 2024-07-26T08:38:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:40 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:40 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:38:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:40 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:38:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:41 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:rejoin 2024-07-26T08:38:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:41 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:41 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 182.194956 secs 2024-07-26T08:38:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:41 smithi043 ceph-mon[32384]: slow request 182.194956 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:38:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:41 smithi043 ceph-mon[32384]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:38:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:41 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:rejoin 2024-07-26T08:38:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:41 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:41 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 182.194956 secs 2024-07-26T08:38:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:41 smithi133 ceph-mon[37053]: slow request 182.194956 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:38:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:41 smithi133 ceph-mon[37053]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:38:41.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:rejoin 2024-07-26T08:38:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 182.194956 secs 2024-07-26T08:38:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-mon[36747]: slow request 182.194956 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:38:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-mon[36747]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:38:41.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:38:41.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: *** Caught signal (Aborted) ** 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: in thread 7f17d44e6640 thread_name:ms_dispatch 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17d98bd6f0] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17d990a94c] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 3: raise() 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 4: abort() 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17d98a771b] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 6: /lib64/libc.so.6(+0x37386) [0x7f17d98b6386] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d3943586b9] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d39451680c] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d3944562ca] 2024-07-26T08:38:41.819 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d394426753] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d394427a1b] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d39440b752] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d394359a56] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d39435d637] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d39435df5e] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d39434103a] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17da18a407] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 18: (DispatchQueue::entry()+0x60f) [0x7f17da18acf9] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17da2675a1] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 20: (Thread::entry_wrapper()+0x43) [0x7f17da014cdd] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17da014cf9] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17d9908c02] 2024-07-26T08:38:41.820 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17d998dc40] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.460+0000 7f17d44e6640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: in thread 7f17d44e6640 thread_name:ms_dispatch 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17d98bd6f0] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17d990a94c] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 3: raise() 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 4: abort() 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17d98a771b] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 6: /lib64/libc.so.6(+0x37386) [0x7f17d98b6386] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d3943586b9] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d39451680c] 2024-07-26T08:38:41.821 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d3944562ca] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d394426753] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d394427a1b] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d39440b752] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d394359a56] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d39435d637] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d39435df5e] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d39434103a] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17da18a407] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 18: (DispatchQueue::entry()+0x60f) [0x7f17da18acf9] 2024-07-26T08:38:41.822 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17da2675a1] 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 20: (Thread::entry_wrapper()+0x43) [0x7f17da014cdd] 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17da014cf9] 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17d9908c02] 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17d998dc40] 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 0> 2024-07-26T08:38:41.460+0000 7f17d44e6640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: in thread 7f17d44e6640 thread_name:ms_dispatch 2024-07-26T08:38:41.823 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17d98bd6f0] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17d990a94c] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 3: raise() 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 4: abort() 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17d98a771b] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 6: /lib64/libc.so.6(+0x37386) [0x7f17d98b6386] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d3943586b9] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d39451680c] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d3944562ca] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d394426753] 2024-07-26T08:38:41.824 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d394427a1b] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d39440b752] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d394359a56] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d39435d637] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d39435df5e] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d39434103a] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17da18a407] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 18: (DispatchQueue::entry()+0x60f) [0x7f17da18acf9] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17da2675a1] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 20: (Thread::entry_wrapper()+0x43) [0x7f17da014cdd] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17da014cf9] 2024-07-26T08:38:41.825 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17d9908c02] 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17d998dc40] 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 0> 2024-07-26T08:38:41.460+0000 7f17d44e6640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: in thread 7f17d44e6640 thread_name:ms_dispatch 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17d98bd6f0] 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17d990a94c] 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 3: raise() 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 4: abort() 2024-07-26T08:38:41.826 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17d98a771b] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 6: /lib64/libc.so.6(+0x37386) [0x7f17d98b6386] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d3943586b9] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d39451680c] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d3944562ca] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d394426753] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d394427a1b] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d39440b752] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d394359a56] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d39435d637] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d39435df5e] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d39434103a] 2024-07-26T08:38:41.827 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17da18a407] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 18: (DispatchQueue::entry()+0x60f) [0x7f17da18acf9] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17da2675a1] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 20: (Thread::entry_wrapper()+0x43) [0x7f17da014cdd] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17da014cf9] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17d9908c02] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17d998dc40] 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72485]: 2024-07-26T08:38:41.828 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:41 smithi063 podman[72669]: 2024-07-26 08:38:41.539645921 +0000 UTC m=+0.030647015 container died 3de644b1ced579c7bff751934763847ecf571f5c378089d69c737b553639d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:38:42.697 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: pgmap v663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:active 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:active 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:42 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:42 smithi063 podman[72669]: 2024-07-26 08:38:42.465050372 +0000 UTC m=+0.956051448 container remove 3de644b1ced579c7bff751934763847ecf571f5c378089d69c737b553639d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-07-26T08:38:42.698 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:42 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: pgmap v663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:active 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:active 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:42 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: pgmap v663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:38:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T08:38:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/2786607239,v1:172.21.15.63:6837/2786607239] up:active 2024-07-26T08:38:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6838/475376324,v1:172.21.15.133:6839/475376324] up:active 2024-07-26T08:38:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:42 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:43.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:42 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:38:43.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:42 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 2.125s CPU time. 2024-07-26T08:38:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:44 smithi043 ceph-mon[32384]: pgmap v664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:38:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:44 smithi133 ceph-mon[37053]: pgmap v664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:38:44.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:44 smithi063 ceph-mon[36747]: pgmap v664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:38:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:46 smithi043 ceph-mon[32384]: pgmap v665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 187.195037 secs 2024-07-26T08:38:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:46 smithi133 ceph-mon[37053]: pgmap v665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 187.195037 secs 2024-07-26T08:38:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:46 smithi063 ceph-mon[36747]: pgmap v665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:38:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 187.195037 secs 2024-07-26T08:38:47.557 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:38:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:38:47.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:38:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:48 smithi043 ceph-mon[32384]: pgmap v666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 199 B/s wr, 10 op/s 2024-07-26T08:38:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:48 smithi133 ceph-mon[37053]: pgmap v666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 199 B/s wr, 10 op/s 2024-07-26T08:38:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:48 smithi063 ceph-mon[36747]: pgmap v666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 199 B/s wr, 10 op/s 2024-07-26T08:38:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:49.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:38:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:38:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:38:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:49.763 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:38:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:38:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:38:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:49.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:38:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:38:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:38:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:50 smithi043 ceph-mon[32384]: pgmap v667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:50 smithi133 ceph-mon[37053]: pgmap v667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:50 smithi063 ceph-mon[36747]: pgmap v667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:38:51.691 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 192.195160 secs 2024-07-26T08:38:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 192.195160 secs 2024-07-26T08:38:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 192.195160 secs 2024-07-26T08:38:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 -- 172.21.15.43:0/1629267656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e681022a0 msgr2=0x7f0e681026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 --2- 172.21.15.43:0/1629267656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e681022a0 0x7f0e681026b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009860 tx=0x7f0e5c02a340 comp rx=0 tx=0).stop 2024-07-26T08:38:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 -- 172.21.15.43:0/1629267656 shutdown_connections 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 --2- 172.21.15.43:0/1629267656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e68107be0 0x7f0e68107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 --2- 172.21.15.43:0/1629267656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 0x7f0e6810ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 --2- 172.21.15.43:0/1629267656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e681022a0 0x7f0e681026b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 -- 172.21.15.43:0/1629267656 >> 172.21.15.43:0/1629267656 conn(0x7f0e680fdcf0 msgr2=0x7f0e68100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 -- 172.21.15.43:0/1629267656 shutdown_connections 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.290+0000 7f0e6f200640 1 -- 172.21.15.43:0/1629267656 wait complete. 2024-07-26T08:38:52.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.292+0000 7f0e6f200640 1 Processor -- start 2024-07-26T08:38:52.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.292+0000 7f0e6f200640 1 -- start start 2024-07-26T08:38:52.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e681022a0 0x7f0e6819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 0x7f0e6819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 0x7f0e681a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68112330 con 0x7f0e68108530 2024-07-26T08:38:52.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681121b0 con 0x7f0e68107be0 2024-07-26T08:38:52.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681124b0 con 0x7f0e681022a0 2024-07-26T08:38:52.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 0x7f0e6819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 0x7f0e681a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 0x7f0e6819c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55478/0 (socket says 172.21.15.43:55478) 2024-07-26T08:38:52.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6d400640 1 -- 172.21.15.43:0/3527490822 learned_addr learned my addr 172.21.15.43:0/3527490822 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.293+0000 7f0e6de00640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e681022a0 0x7f0e6819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6d400640 1 -- 172.21.15.43:0/3527490822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e681022a0 msgr2=0x7f0e6819c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6d400640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e681022a0 0x7f0e6819c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6d400640 1 -- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 msgr2=0x7f0e681a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6d400640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 0x7f0e681a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6d400640 1 -- 172.21.15.43:0/3527490822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e681a1fa0 con 0x7f0e68107be0 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6e800640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 0x7f0e681a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.294+0000 7f0e6d400640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 0x7f0e6819c5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800e9c0 tx=0x7f0e5800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.295+0000 7f0e62a00640 1 -- 172.21.15.43:0/3527490822 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800ccc0 con 0x7f0e68107be0 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.295+0000 7f0e62a00640 1 -- 172.21.15.43:0/3527490822 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e580054f0 con 0x7f0e68107be0 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.295+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e681a2290 con 0x7f0e68107be0 2024-07-26T08:38:52.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.295+0000 7f0e62a00640 1 -- 172.21.15.43:0/3527490822 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58010430 con 0x7f0e68107be0 2024-07-26T08:38:52.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.295+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e681a89f0 con 0x7f0e68107be0 2024-07-26T08:38:52.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 Processor -- start 2024-07-26T08:38:52.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 -- start start 2024-07-26T08:38:52.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e62a00640 1 -- 172.21.15.43:0/3527490822 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0e580046c0 con 0x7f0e68107be0 2024-07-26T08:38:52.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cedb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 0x56192cedb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb15390 0x56192cedba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56192ce51bc0 con 0x56192cb15390 2024-07-26T08:38:52.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56192ce410c0 con 0x56192cb0d1b0 2024-07-26T08:38:52.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.299+0000 7f0e774a1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56192ce45100 con 0x56192cb36070 2024-07-26T08:38:52.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 0x56192cedb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cedb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 0x56192cedb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55494/0 (socket says 172.21.15.43:55494) 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 -- 172.21.15.43:0/2273878813 learned_addr learned my addr 172.21.15.43:0/2273878813 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6d400640 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb15390 0x56192cedba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 -- 172.21.15.43:0/2273878813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 msgr2=0x56192cedb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cedb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 -- 172.21.15.43:0/2273878813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb15390 msgr2=0x56192cedba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb15390 0x56192cedba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6de00640 1 -- 172.21.15.43:0/2273878813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192cba1650 con 0x56192cb0d1b0 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.300+0000 7f0e6e800640 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cedb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e6de00640 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 0x56192cedb540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c02a860 tx=0x7f0e5c009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd89d0a18f9ca890 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e57000640 1 -- 172.21.15.43:0/2273878813 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c037040 con 0x56192cb0d1b0 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e62a00640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e500b3d40 0x7f0e500b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e57000640 1 -- 172.21.15.43:0/2273878813 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e5c030de0 con 0x56192cb0d1b0 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e57000640 1 -- 172.21.15.43:0/2273878813 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c0035f0 con 0x56192cb0d1b0 2024-07-26T08:38:52.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e62a00640 1 -- 172.21.15.43:0/3527490822 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 10484+0+0 (secure 0 0 0) 0x7f0e580e4be0 con 0x7f0e68107be0 2024-07-26T08:38:52.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.301+0000 7f0e6e800640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e500b3d40 0x7f0e500b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 -- 172.21.15.43:0/2273878813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 msgr2=0x56192cedb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 0x56192cedb540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c02a860 tx=0x7f0e5c009510 comp rx=0 tx=0).stop 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e6e800640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e500b3d40 0x7f0e500b6250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e64005fd0 tx=0x7f0e64011040 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 -- 172.21.15.43:0/2273878813 shutdown_connections 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb15390 0x56192cedba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb0d1b0 0x56192cedb540 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 --2- 172.21.15.43:0/2273878813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cedb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.302+0000 7f0e774a1740 1 -- 172.21.15.43:0/2273878813 >> 172.21.15.43:0/2273878813 conn(0x56192cb2a460 msgr2=0x56192ced8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.303+0000 7f0e774a1740 1 -- 172.21.15.43:0/2273878813 shutdown_connections 2024-07-26T08:38:52.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.303+0000 7f0e774a1740 1 -- 172.21.15.43:0/2273878813 wait complete. 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.303+0000 7f0e774a1740 1 -- start start 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.303+0000 7f0e774a1740 1 Processor -- start 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cee6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cee70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56192cca4700 con 0x56192cb0d1b0 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56192cddd690 con 0x56192cb15390 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56192cee9780 con 0x56192cb36070 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e774a1740 10 client.0 _ll_register_callbacks cb 0x56192cded140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:38:52.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e6de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cee6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.304+0000 7f0e6de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cee6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56920/0 (socket says 172.21.15.43:56920) 2024-07-26T08:38:52.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 -- 172.21.15.43:0/1804074084 learned_addr learned my addr 172.21.15.43:0/1804074084 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6d400640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6e800640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cee70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 -- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 msgr2=0x56192cee70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cee70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 -- 172.21.15.43:0/1804074084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 msgr2=0x56192cee6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 -- 172.21.15.43:0/1804074084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56192cdf4830 con 0x56192cb0d1b0 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6d400640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:38:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.305+0000 7f0e6de00640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cee6630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009830 tx=0x7f0e5c030740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c53b3b2c5299ad server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e4b400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e4b400640 1 -- 172.21.15.43:0/1804074084 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c04b020 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e4b400640 1 -- 172.21.15.43:0/1804074084 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 10484+0+0 (secure 0 0 0) 0x7f0e5c004040 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e5c030de0 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e4b400640 1 -- 172.21.15.43:0/1804074084 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) ==== 24+0+0 (secure 0 0 0) 0x7f0e5c056050 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e774a1740 10 client.15801 fetch_fsmap learned FSMap version 105 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.306+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) -- 0x56192cef5420 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e4b400640 1 -- 172.21.15.43:0/1804074084 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e5c030de0 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e4b400640 1 -- 172.21.15.43:0/1804074084 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 105) ==== 7749+0+0 (secure 0 0 0) 0x7f0e5c0324d0 con 0x56192cb0d1b0 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e774a1740 10 client.15801 fetch_fsmap finished waiting for FSMap version 105 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e774a1740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:38:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e774a1740 20 client.15801 populate_metadata read hostname 'smithi043' 2024-07-26T08:38:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e774a1740 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192caf49f0 0x56192cef8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e774a1740 4 client.15801 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:38:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.307+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56192ce53b10 con 0x56192caf49f0 2024-07-26T08:38:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.308+0000 7f0e6d400640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192caf49f0 0x56192cef8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.308+0000 7f0e6d400640 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192caf49f0 0x56192cef8780 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ba81855830d346c server_cookie=ba0733caf598a5b0 in_seq=0 out_seq=0 2024-07-26T08:38:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.308+0000 7f0e4b400640 10 client.15801 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:52.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e4b400640 1 -- 172.21.15.43:0/1804074084 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56192ce53b10 con 0x56192caf49f0 2024-07-26T08:38:52.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e4b400640 10 client.15801 handle_command_reply: tid=0 2024-07-26T08:38:52.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e774a1740 1 client.15801 shutdown 2024-07-26T08:38:52.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 msgr2=0x56192cee6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e774a1740 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cee6630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009830 tx=0x7f0e5c030740 comp rx=0 tx=0).stop 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 shutdown_connections 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.309+0000 7f0e774a1740 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192caf49f0 0x56192cef8780 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb36070 0x56192cee70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 1 --2- 172.21.15.43:0/1804074084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cee6630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 >> 172.21.15.43:0/1804074084 conn(0x56192cb2a460 msgr2=0x56192cede190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e4b400640 0 client.15801 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 shutdown_connections 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 1 -- 172.21.15.43:0/1804074084 wait complete. 2024-07-26T08:38:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.310+0000 7f0e774a1740 20 client.15801 trim_cache size 0 max 16384 2024-07-26T08:38:52.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.329+0000 7f0e774a1740 1 Processor -- start 2024-07-26T08:38:52.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.329+0000 7f0e774a1740 1 -- start start 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb0d1b0 0x56192cef24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb36070 0x56192cee3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e774a1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681b4e10 con 0x56192cb36070 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e774a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681b54e0 con 0x56192cb15390 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e774a1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681b2df0 con 0x56192cb0d1b0 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e6d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e6de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb0d1b0 0x56192cef24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e6d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55512/0 (socket says 172.21.15.43:55512) 2024-07-26T08:38:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e6d400640 1 -- 172.21.15.43:0/366037755 learned_addr learned my addr 172.21.15.43:0/366037755 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.330+0000 7f0e6e800640 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb36070 0x56192cee3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6d400640 1 -- 172.21.15.43:0/366037755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb0d1b0 msgr2=0x56192cef24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6d400640 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb0d1b0 0x56192cef24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6d400640 1 -- 172.21.15.43:0/366037755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb36070 msgr2=0x56192cee3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6d400640 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb36070 0x56192cee3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6d400640 1 -- 172.21.15.43:0/366037755 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192cee78f0 con 0x56192cb15390 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6e800640 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb36070 0x56192cee3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e6d400640 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee5ec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0e580a7580 tx=0x7f0e580e8690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7039eac713e36de2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e56600640 1 -- 172.21.15.43:0/366037755 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580aa930 con 0x56192cb15390 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e56600640 1 -- 172.21.15.43:0/366037755 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e580aaaf0 con 0x56192cb15390 2024-07-26T08:38:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.331+0000 7f0e56600640 1 -- 172.21.15.43:0/366037755 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580aa750 con 0x56192cb15390 2024-07-26T08:38:52.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.332+0000 7f0e774a1740 1 -- 172.21.15.43:0/366037755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 msgr2=0x56192cee5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.332+0000 7f0e774a1740 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee5ec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0e580a7580 tx=0x7f0e580e8690 comp rx=0 tx=0).stop 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 -- 172.21.15.43:0/366037755 shutdown_connections 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb36070 0x56192cee3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb15390 0x56192cee5ec0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 --2- 172.21.15.43:0/366037755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb0d1b0 0x56192cef24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 -- 172.21.15.43:0/366037755 >> 172.21.15.43:0/366037755 conn(0x56192cb2a460 msgr2=0x56192cedc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 -- 172.21.15.43:0/366037755 shutdown_connections 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 -- 172.21.15.43:0/366037755 wait complete. 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.333+0000 7f0e774a1740 1 -- start start 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 Processor -- start 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cef89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 0x56192cef8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb36070 0x56192cf5ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681b2720 con 0x56192cb0d1b0 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681b1310 con 0x56192cb36070 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0e681b1980 con 0x56192cb15390 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.334+0000 7f0e774a1740 10 client.0 _ll_register_callbacks cb 0x7f0e58005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 0x56192cef8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cef89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 0x56192cef8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:56140/0 (socket says 172.21.15.43:56140) 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 -- 172.21.15.43:0/480708051 learned_addr learned my addr 172.21.15.43:0/480708051 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6e800640 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb36070 0x56192cf5ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 -- 172.21.15.43:0/480708051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb36070 msgr2=0x56192cf5ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb36070 0x56192cf5ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 -- 172.21.15.43:0/480708051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 msgr2=0x56192cef89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cef89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.335+0000 7f0e6d400640 1 -- 172.21.15.43:0/480708051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56192cef97c0 con 0x56192cb15390 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e6d400640 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 0x56192cef8ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c6a0 tx=0x7f0e580aa880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627ab24e40b721ce server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e4b400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e4b400640 1 -- 172.21.15.43:0/480708051 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5808e070 con 0x56192cb15390 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e580aaaf0 con 0x56192cb15390 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e4b400640 1 -- 172.21.15.43:0/480708051 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 10484+0+0 (secure 0 0 0) 0x7f0e580b3c00 con 0x56192cb15390 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e4b400640 1 -- 172.21.15.43:0/480708051 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) ==== 24+0+0 (secure 0 0 0) 0x7f0e580e1fb0 con 0x56192cb15390 2024-07-26T08:38:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e774a1740 10 client.26002 fetch_fsmap learned FSMap version 105 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) -- 0x56192cf602c0 con 0x56192cb15390 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.336+0000 7f0e4b400640 1 -- 172.21.15.43:0/480708051 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e580aaaf0 con 0x56192cb15390 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e4b400640 1 -- 172.21.15.43:0/480708051 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 105) ==== 7749+0+0 (secure 0 0 0) 0x7f0e580c5b20 con 0x56192cb15390 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e774a1740 10 client.26002 fetch_fsmap finished waiting for FSMap version 105 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e774a1740 10 client.26002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e774a1740 20 client.26002 populate_metadata read hostname 'smithi043' 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e774a1740 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192cac9da0 0x56192cf62990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e774a1740 4 client.26002 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56192ce4f5b0 con 0x56192cac9da0 2024-07-26T08:38:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.337+0000 7f0e6de00640 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192cac9da0 0x56192cf62990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:38:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e6de00640 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192cac9da0 0x56192cf62990 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75de5f26dcfa376c server_cookie=bc7356cefec5d354 in_seq=0 out_seq=0 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e4b400640 10 client.26002 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e4b400640 1 -- 172.21.15.43:0/480708051 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x56192ce4f5b0 con 0x56192cac9da0 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e4b400640 10 client.26002 handle_command_reply: tid=0 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e774a1740 1 client.26002 shutdown 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 msgr2=0x56192cef8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.338+0000 7f0e774a1740 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 0x56192cef8ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c6a0 tx=0x7f0e580aa880 comp rx=0 tx=0).stop 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 shutdown_connections 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56192cac9da0 0x56192cf62990 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56192cb15390 0x56192cef8ef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56192cb36070 0x56192cf5ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e4b400640 0 client.26002 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 --2- 172.21.15.43:0/480708051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192cb0d1b0 0x56192cef89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 >> 172.21.15.43:0/480708051 conn(0x56192cb2a460 msgr2=0x56192cedc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 shutdown_connections 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 1 -- 172.21.15.43:0/480708051 wait complete. 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.339+0000 7f0e774a1740 20 client.26002 trim_cache size 0 max 16384 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:38:52.344 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:38:52.345 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:38:52.345 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:38:52.345 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:38:52.345 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:38:52.345 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:38:52.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e500b3d40 msgr2=0x7f0e500b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e500b3d40 0x7f0e500b6250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e64005fd0 tx=0x7f0e64011040 comp rx=0 tx=0).stop 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 msgr2=0x7f0e6819c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 0x7f0e6819c5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800e9c0 tx=0x7f0e5800ee80 comp rx=0 tx=0).stop 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 shutdown_connections 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e500b3d40 0x7f0e500b6250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e68108530 0x7f0e681a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e68107be0 0x7f0e6819c5d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 --2- 172.21.15.43:0/3527490822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e681022a0 0x7f0e6819c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.340+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 >> 172.21.15.43:0/3527490822 conn(0x7f0e680fdcf0 msgr2=0x7f0e681071f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.341+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 shutdown_connections 2024-07-26T08:38:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:38:52.341+0000 7f0e6f200640 1 -- 172.21.15.43:0/3527490822 wait complete. 2024-07-26T08:38:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:52 smithi133 ceph-mon[37053]: pgmap v668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:52 smithi063 ceph-mon[36747]: pgmap v668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:52.926 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:52 smithi043 ceph-mon[32384]: pgmap v668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:38:53.158 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:52 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:38:53.158 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:52 smithi063 systemd[1]: Stopped Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:53.158 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:52 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 2.125s CPU time. 2024-07-26T08:38:53.158 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:52 smithi063 systemd[1]: Starting Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:38:53.159 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 podman[72891]: 2024-07-26 08:38:52.961772458 +0000 UTC m=+0.018614357 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:38:53.159 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 podman[72891]: 2024-07-26 08:38:53.157536337 +0000 UTC m=+0.214378237 container create 0e86eae0d58a42e3efbb76975fa53975e548e73d5462e81c4984c50b1f7775b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:38:53.371 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:38:53.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 podman[72891]: 2024-07-26 08:38:53.668770077 +0000 UTC m=+0.725611979 container init 0e86eae0d58a42e3efbb76975fa53975e548e73d5462e81c4984c50b1f7775b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-07-26T08:38:53.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 podman[72891]: 2024-07-26 08:38:53.671580348 +0000 UTC m=+0.728422257 container start 0e86eae0d58a42e3efbb76975fa53975e548e73d5462e81c4984c50b1f7775b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-26T08:38:53.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 ceph-mds[72910]: -- 172.21.15.63:0/3788912423 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e3e87b860 con 0x561e42a1d600 2024-07-26T08:38:53.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: starting mds.h at 2024-07-26T08:38:53.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 bash[72891]: 0e86eae0d58a42e3efbb76975fa53975e548e73d5462e81c4984c50b1f7775b5 2024-07-26T08:38:53.818 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:38:53 smithi063 systemd[1]: Started Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: pgmap v669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: daemon mds.h restarted 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: osdmap e103: 12 total, 12 up, 12 in 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:boot 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:38:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:54 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: pgmap v669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: daemon mds.h restarted 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: osdmap e103: 12 total, 12 up, 12 in 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:boot 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:38:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:54 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: pgmap v669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:38:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: daemon mds.h restarted 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: osdmap e103: 12 total, 12 up, 12 in 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:boot 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T08:38:54.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:54 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:55.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:resolve 2024-07-26T08:38:55.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:55 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:55.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:55 smithi043 ceph-mon[32384]: pgmap v671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-07-26T08:38:55.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:55 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 181.707851 secs 2024-07-26T08:38:55.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:55 smithi043 ceph-mon[32384]: slow request 181.707850 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:38:55.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 197.195275 secs 2024-07-26T08:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:resolve 2024-07-26T08:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:55 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:55 smithi133 ceph-mon[37053]: pgmap v671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-07-26T08:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:55 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 181.707851 secs 2024-07-26T08:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:55 smithi133 ceph-mon[37053]: slow request 181.707850 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 197.195275 secs 2024-07-26T08:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:resolve 2024-07-26T08:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:55 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:55 smithi063 ceph-mon[36747]: pgmap v671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-07-26T08:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:55 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 181.707851 secs 2024-07-26T08:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:55 smithi063 ceph-mon[36747]: slow request 181.707850 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 197.195275 secs 2024-07-26T08:38:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:56 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399996 2024-07-26T08:38:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:56 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:reconnect 2024-07-26T08:38:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:56 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:56 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:38:57.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:56 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399996 2024-07-26T08:38:57.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:56 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:reconnect 2024-07-26T08:38:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:56 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:56 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:38:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:56 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399996 2024-07-26T08:38:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:56 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:reconnect 2024-07-26T08:38:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:56 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:56 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:38:58.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:57 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:rejoin 2024-07-26T08:38:58.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:57 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:58.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:57 smithi043 ceph-mon[32384]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:38:58.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:57 smithi043 ceph-mon[32384]: pgmap v672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:58.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:rejoin 2024-07-26T08:38:58.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-mon[36747]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:38:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-mon[36747]: pgmap v672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:58.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:38:58.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: *** Caught signal (Aborted) ** 2024-07-26T08:38:58.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: in thread 7ff0f8791640 thread_name:ms_dispatch 2024-07-26T08:38:58.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0fdb686f0] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff0fdbb594c] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 3: raise() 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 4: abort() 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff0fdb5271b] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 6: /lib64/libc.so.6(+0x37386) [0x7ff0fdb61386] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5646b96ae6b9] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5646b986c80c] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5646b97ac2ca] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5646b977c753] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5646b977da1b] 2024-07-26T08:38:58.069 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5646b9761752] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5646b96afa56] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5646b96b3637] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5646b96b3f5e] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5646b969703a] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff0fe435407] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 18: (DispatchQueue::entry()+0x60f) [0x7ff0fe435cf9] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff0fe5125a1] 2024-07-26T08:38:58.070 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 20: (Thread::entry_wrapper()+0x43) [0x7ff0fe2bfcdd] 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff0fe2bfcf9] 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff0fdbb3c02] 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff0fdc38c40] 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:57.783+0000 7ff0f8791640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: in thread 7ff0f8791640 thread_name:ms_dispatch 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0fdb686f0] 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff0fdbb594c] 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 3: raise() 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 4: abort() 2024-07-26T08:38:58.071 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff0fdb5271b] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 6: /lib64/libc.so.6(+0x37386) [0x7ff0fdb61386] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5646b96ae6b9] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5646b986c80c] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5646b97ac2ca] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5646b977c753] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5646b977da1b] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5646b9761752] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5646b96afa56] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5646b96b3637] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5646b96b3f5e] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5646b969703a] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff0fe435407] 2024-07-26T08:38:58.072 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 18: (DispatchQueue::entry()+0x60f) [0x7ff0fe435cf9] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff0fe5125a1] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 20: (Thread::entry_wrapper()+0x43) [0x7ff0fe2bfcdd] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff0fe2bfcf9] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff0fdbb3c02] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff0fdc38c40] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 0> 2024-07-26T08:38:57.783+0000 7ff0f8791640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: in thread 7ff0f8791640 thread_name:ms_dispatch 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0fdb686f0] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff0fdbb594c] 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 3: raise() 2024-07-26T08:38:58.073 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 4: abort() 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff0fdb5271b] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 6: /lib64/libc.so.6(+0x37386) [0x7ff0fdb61386] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5646b96ae6b9] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5646b986c80c] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5646b97ac2ca] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5646b977c753] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5646b977da1b] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5646b9761752] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5646b96afa56] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5646b96b3637] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5646b96b3f5e] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5646b969703a] 2024-07-26T08:38:58.074 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff0fe435407] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 18: (DispatchQueue::entry()+0x60f) [0x7ff0fe435cf9] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff0fe5125a1] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 20: (Thread::entry_wrapper()+0x43) [0x7ff0fe2bfcdd] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff0fe2bfcf9] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff0fdbb3c02] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff0fdc38c40] 2024-07-26T08:38:58.075 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 0> 2024-07-26T08:38:57.783+0000 7ff0f8791640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: in thread 7ff0f8791640 thread_name:ms_dispatch 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0fdb686f0] 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff0fdbb594c] 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 3: raise() 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 4: abort() 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff0fdb5271b] 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 6: /lib64/libc.so.6(+0x37386) [0x7ff0fdb61386] 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5646b96ae6b9] 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5646b986c80c] 2024-07-26T08:38:58.076 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5646b97ac2ca] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5646b977c753] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5646b977da1b] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5646b9761752] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5646b96afa56] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5646b96b3637] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5646b96b3f5e] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5646b969703a] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff0fe435407] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 18: (DispatchQueue::entry()+0x60f) [0x7ff0fe435cf9] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff0fe5125a1] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 20: (Thread::entry_wrapper()+0x43) [0x7ff0fe2bfcdd] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff0fe2bfcf9] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff0fdbb3c02] 2024-07-26T08:38:58.077 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff0fdc38c40] 2024-07-26T08:38:58.078 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:38:58.078 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[72631]: 2024-07-26T08:38:58.078 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:57 smithi063 podman[72956]: 2024-07-26 08:38:57.856773819 +0000 UTC m=+0.024028371 container died b1b960bdd55df94037a29f255bf6b53ae667c3d932e623295e25715d79a774b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:38:58.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:57 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:rejoin 2024-07-26T08:38:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:57 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:57 smithi133 ceph-mon[37053]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:38:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:57 smithi133 ceph-mon[37053]: pgmap v672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:38:58.903 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:58 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:58.903 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:58 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:active 2024-07-26T08:38:58.903 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:58 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:58.904 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:58 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:58.904 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:58 smithi063 podman[72956]: 2024-07-26 08:38:58.649046069 +0000 UTC m=+0.816300619 container remove b1b960bdd55df94037a29f255bf6b53ae667c3d932e623295e25715d79a774b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True) 2024-07-26T08:38:58.904 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:58 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:38:59.166 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:58 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:59.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:58 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:active 2024-07-26T08:38:59.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:58 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:59.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:58 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:58 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:38:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:58 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/763173638,v1:172.21.15.63:6835/763173638] up:active 2024-07-26T08:38:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:58 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:38:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:58 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:38:59.317 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:58 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:38:59.317 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:38:58 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 1.995s CPU time. 2024-07-26T08:39:00.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:59 smithi063 ceph-mon[36747]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T08:39:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:59 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:59 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:38:59 smithi063 ceph-mon[36747]: pgmap v673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:39:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:59 smithi043 ceph-mon[32384]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T08:39:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:59 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:59 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:38:59 smithi043 ceph-mon[32384]: pgmap v673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:39:00.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:59 smithi133 ceph-mon[37053]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T08:39:00.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:59 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:59 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:38:59 smithi133 ceph-mon[37053]: pgmap v673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:39:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 186.707982 secs 2024-07-26T08:39:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 202.195374 secs 2024-07-26T08:39:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 186.707982 secs 2024-07-26T08:39:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 202.195374 secs 2024-07-26T08:39:01.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 186.707982 secs 2024-07-26T08:39:01.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 202.195374 secs 2024-07-26T08:39:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:01 smithi063 ceph-mon[36747]: pgmap v674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:39:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:01 smithi043 ceph-mon[32384]: pgmap v674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:39:02.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:01 smithi133 ceph-mon[37053]: pgmap v674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:39:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:04 smithi043 ceph-mon[32384]: pgmap v675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:04.485 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:04 smithi063 ceph-mon[36747]: pgmap v675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:04 smithi133 ceph-mon[37053]: pgmap v675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:05 smithi043 ceph-mon[32384]: pgmap v676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 9 op/s 2024-07-26T08:39:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:05 smithi043 ceph-mon[32384]: 2 slow requests, 1 included below; oldest blocked for > 191.708144 secs 2024-07-26T08:39:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:05 smithi043 ceph-mon[32384]: slow request 184.401157 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:39:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 207.195440 secs 2024-07-26T08:39:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:05 smithi133 ceph-mon[37053]: pgmap v676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 9 op/s 2024-07-26T08:39:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:05 smithi133 ceph-mon[37053]: 2 slow requests, 1 included below; oldest blocked for > 191.708144 secs 2024-07-26T08:39:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:05 smithi133 ceph-mon[37053]: slow request 184.401157 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:39:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 207.195440 secs 2024-07-26T08:39:06.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:05 smithi063 ceph-mon[36747]: pgmap v676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 9 op/s 2024-07-26T08:39:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:05 smithi063 ceph-mon[36747]: 2 slow requests, 1 included below; oldest blocked for > 191.708144 secs 2024-07-26T08:39:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:05 smithi063 ceph-mon[36747]: slow request 184.401157 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:39:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 207.195440 secs 2024-07-26T08:39:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:07 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:07 smithi043 ceph-mon[32384]: pgmap v677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:07 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:07 smithi133 ceph-mon[37053]: pgmap v677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:08.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:07 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:07 smithi063 ceph-mon[36747]: pgmap v677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:09.430 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:39:09.431 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 systemd[1]: Stopped Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:39:09.431 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 1.995s CPU time. 2024-07-26T08:39:09.431 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 systemd[1]: Starting Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:39:09.431 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 podman[73048]: 2024-07-26 08:39:09.209700114 +0000 UTC m=+0.018416893 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:39:09.431 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 podman[73048]: 2024-07-26 08:39:09.31667367 +0000 UTC m=+0.125390481 container create 92ab2f14e8b4e53af764b51544b563cb683f67172870a11ef51382cb533f9b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-07-26T08:39:10.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 podman[73048]: 2024-07-26 08:39:09.669458943 +0000 UTC m=+0.478175712 container init 92ab2f14e8b4e53af764b51544b563cb683f67172870a11ef51382cb533f9b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:39:10.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 podman[73048]: 2024-07-26 08:39:09.672695861 +0000 UTC m=+0.481412638 container start 92ab2f14e8b4e53af764b51544b563cb683f67172870a11ef51382cb533f9b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:39:10.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 ceph-mds[73067]: -- 172.21.15.63:0/2808176919 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640ad075860 con 0x5640b1217180 2024-07-26T08:39:10.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: starting mds.e at 2024-07-26T08:39:10.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 bash[73048]: 92ab2f14e8b4e53af764b51544b563cb683f67172870a11ef51382cb533f9b78 2024-07-26T08:39:10.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:09 smithi063 systemd[1]: Started Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:39:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: pgmap v678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: daemon mds.e restarted 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: osdmap e104: 12 total, 12 up, 12 in 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:boot 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:39:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:10 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: pgmap v678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: daemon mds.e restarted 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: osdmap e104: 12 total, 12 up, 12 in 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:boot 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:39:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:10 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: pgmap v678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: daemon mds.e restarted 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: osdmap e104: 12 total, 12 up, 12 in 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:boot 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-07-26T08:39:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:10 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:replay,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:11 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 196.708266 secs 2024-07-26T08:39:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 212.195593 secs 2024-07-26T08:39:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:11 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 196.708266 secs 2024-07-26T08:39:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 212.195593 secs 2024-07-26T08:39:11.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:11 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 196.708266 secs 2024-07-26T08:39:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 212.195593 secs 2024-07-26T08:39:12.376 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:12 smithi043 ceph-mon[32384]: pgmap v680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:39:12.376 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:resolve 2024-07-26T08:39:12.376 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:12 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:12 smithi133 ceph-mon[37053]: pgmap v680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:39:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:resolve 2024-07-26T08:39:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:12 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:12 smithi063 ceph-mon[36747]: pgmap v680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:39:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:resolve 2024-07-26T08:39:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:12 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:resolve,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:13 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:39:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:13 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:reconnect 2024-07-26T08:39:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:13 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:13 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:39:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:13 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:39:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:13 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:reconnect 2024-07-26T08:39:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:13 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:13 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:39:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:13 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:39:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:13 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:reconnect 2024-07-26T08:39:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:13 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:reconnect,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:13 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:39:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:14 smithi043 ceph-mon[32384]: pgmap v681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:39:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:14 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:rejoin 2024-07-26T08:39:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:14 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:14 smithi043 ceph-mon[32384]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:39:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:14 smithi133 ceph-mon[37053]: pgmap v681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:39:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:14 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:rejoin 2024-07-26T08:39:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:14 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:14 smithi133 ceph-mon[37053]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:39:14.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-mon[36747]: pgmap v681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:39:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:rejoin 2024-07-26T08:39:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=h=up:rejoin,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-mon[36747]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T08:39:14.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: *** Caught signal (Aborted) ** 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: in thread 7f8af1e7d640 thread_name:ms_dispatch 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8af72546f0] 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8af72a194c] 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 3: raise() 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 4: abort() 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8af723e71b] 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 6: /lib64/libc.so.6(+0x37386) [0x7f8af724d386] 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561e3c1d96b9] 2024-07-26T08:39:14.569 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561e3c39780c] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561e3c2d72ca] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561e3c2a7753] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561e3c2a8a1b] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561e3c28c752] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561e3c1daa56] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561e3c1de637] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561e3c1def5e] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561e3c1c203a] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8af7b21407] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 18: (DispatchQueue::entry()+0x60f) [0x7f8af7b21cf9] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8af7bfe5a1] 2024-07-26T08:39:14.570 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 20: (Thread::entry_wrapper()+0x43) [0x7f8af79abcdd] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8af79abcf9] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8af729fc02] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8af7324c40] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.160+0000 7f8af1e7d640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: in thread 7f8af1e7d640 thread_name:ms_dispatch 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8af72546f0] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8af72a194c] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 3: raise() 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 4: abort() 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8af723e71b] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 6: /lib64/libc.so.6(+0x37386) [0x7f8af724d386] 2024-07-26T08:39:14.571 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561e3c1d96b9] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561e3c39780c] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561e3c2d72ca] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561e3c2a7753] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561e3c2a8a1b] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561e3c28c752] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561e3c1daa56] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561e3c1de637] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561e3c1def5e] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561e3c1c203a] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8af7b21407] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 18: (DispatchQueue::entry()+0x60f) [0x7f8af7b21cf9] 2024-07-26T08:39:14.572 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8af7bfe5a1] 2024-07-26T08:39:14.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 20: (Thread::entry_wrapper()+0x43) [0x7f8af79abcdd] 2024-07-26T08:39:14.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8af79abcf9] 2024-07-26T08:39:14.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8af729fc02] 2024-07-26T08:39:14.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8af7324c40] 2024-07-26T08:39:14.573 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 0> 2024-07-26T08:39:14.160+0000 7f8af1e7d640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: in thread 7f8af1e7d640 thread_name:ms_dispatch 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8af72546f0] 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8af72a194c] 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 3: raise() 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 4: abort() 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8af723e71b] 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 6: /lib64/libc.so.6(+0x37386) [0x7f8af724d386] 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561e3c1d96b9] 2024-07-26T08:39:14.574 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561e3c39780c] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561e3c2d72ca] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561e3c2a7753] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561e3c2a8a1b] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561e3c28c752] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561e3c1daa56] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561e3c1de637] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561e3c1def5e] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561e3c1c203a] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8af7b21407] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 18: (DispatchQueue::entry()+0x60f) [0x7f8af7b21cf9] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8af7bfe5a1] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 20: (Thread::entry_wrapper()+0x43) [0x7f8af79abcdd] 2024-07-26T08:39:14.575 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8af79abcf9] 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8af729fc02] 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8af7324c40] 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 0> 2024-07-26T08:39:14.160+0000 7f8af1e7d640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: in thread 7f8af1e7d640 thread_name:ms_dispatch 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8af72546f0] 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f8af72a194c] 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 3: raise() 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 4: abort() 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 5: /lib64/libc.so.6(+0x2871b) [0x7f8af723e71b] 2024-07-26T08:39:14.576 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 6: /lib64/libc.so.6(+0x37386) [0x7f8af724d386] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561e3c1d96b9] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561e3c39780c] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561e3c2d72ca] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561e3c2a7753] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561e3c2a8a1b] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561e3c28c752] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561e3c1daa56] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561e3c1de637] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561e3c1def5e] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561e3c1c203a] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f8af7b21407] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 18: (DispatchQueue::entry()+0x60f) [0x7f8af7b21cf9] 2024-07-26T08:39:14.577 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f8af7bfe5a1] 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 20: (Thread::entry_wrapper()+0x43) [0x7f8af79abcdd] 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 21: (Thread::_entry_func(void*)+0xd) [0x7f8af79abcf9] 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 22: /lib64/libc.so.6(+0x89c02) [0x7f8af729fc02] 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f8af7324c40] 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h[72906]: 2024-07-26T08:39:14.578 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:14 smithi063 podman[73101]: 2024-07-26 08:39:14.223284892 +0000 UTC m=+0.020713209 container died 0e86eae0d58a42e3efbb76975fa53975e548e73d5462e81c4984c50b1f7775b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-07-26T08:39:15.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:15 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:15.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:15 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:active 2024-07-26T08:39:15.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:15 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:15.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:15 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:15.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:15 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 201.708384 secs 2024-07-26T08:39:15.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:15 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:15 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:active 2024-07-26T08:39:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:15 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:15 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:15 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 201.708384 secs 2024-07-26T08:39:15.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:15 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:15 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6836/3374136004,v1:172.21.15.63:6837/3374136004] up:active 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:15 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 6 up:standby 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:15 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:15 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 201.708384 secs 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:15 smithi063 podman[73101]: 2024-07-26 08:39:15.141610462 +0000 UTC m=+0.939038772 container remove 0e86eae0d58a42e3efbb76975fa53975e548e73d5462e81c4984c50b1f7775b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-h, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:15 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:15 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:39:15.568 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:15 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 1.972s CPU time. 2024-07-26T08:39:16.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:16 smithi063 ceph-mon[36747]: pgmap v682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:39:16.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 217.195683 secs 2024-07-26T08:39:16.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:16 smithi043 ceph-mon[32384]: pgmap v682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:39:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 217.195683 secs 2024-07-26T08:39:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:16 smithi133 ceph-mon[37053]: pgmap v682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:39:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 217.195683 secs 2024-07-26T08:39:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:18 smithi043 ceph-mon[32384]: pgmap v683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:18 smithi133 ceph-mon[37053]: pgmap v683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:18.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:18 smithi063 ceph-mon[36747]: pgmap v683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:20 smithi043 ceph-mon[32384]: pgmap v684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:20 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 206.708504 secs 2024-07-26T08:39:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:20 smithi133 ceph-mon[37053]: pgmap v684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:20 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 206.708504 secs 2024-07-26T08:39:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:20 smithi063 ceph-mon[36747]: pgmap v684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:20 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 206.708504 secs 2024-07-26T08:39:21.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 222.195837 secs 2024-07-26T08:39:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 222.195837 secs 2024-07-26T08:39:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 222.195837 secs 2024-07-26T08:39:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:22 smithi043 ceph-mon[32384]: pgmap v685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 10 op/s 2024-07-26T08:39:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:22 smithi133 ceph-mon[37053]: pgmap v685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 10 op/s 2024-07-26T08:39:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:22 smithi063 ceph-mon[36747]: pgmap v685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 10 op/s 2024-07-26T08:39:23.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:39:23.878 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:39:24.284 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:24 smithi043 ceph-mon[32384]: pgmap v686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:24 smithi133 ceph-mon[37053]: pgmap v686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:24 smithi063 ceph-mon[36747]: pgmap v686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:25 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 211.708621 secs 2024-07-26T08:39:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:25 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 211.708621 secs 2024-07-26T08:39:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:25 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 211.708621 secs 2024-07-26T08:39:26.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:25 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:39:26.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:25 smithi063 systemd[1]: Stopped Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:39:26.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:25 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Consumed 1.972s CPU time. 2024-07-26T08:39:26.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:25 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Start request repeated too quickly. 2024-07-26T08:39:26.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:25 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-07-26T08:39:26.068 INFO:journalctl@ceph.mds.h.smithi063.stdout:Jul 26 08:39:25 smithi063 systemd[1]: Failed to start Ceph mds.h for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:39:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:26 smithi043 ceph-mon[32384]: pgmap v687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 227.195902 secs 2024-07-26T08:39:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:26 smithi133 ceph-mon[37053]: pgmap v687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 227.195902 secs 2024-07-26T08:39:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:26 smithi063 ceph-mon[36747]: pgmap v687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 227.195902 secs 2024-07-26T08:39:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 -- 172.21.15.43:0/2571040171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 msgr2=0x7fe50c1122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 --2- 172.21.15.43:0/2571040171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 0x7fe50c1122a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe504009ca0 tx=0x7fe50402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 -- 172.21.15.43:0/2571040171 shutdown_connections 2024-07-26T08:39:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 --2- 172.21.15.43:0/2571040171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 0x7fe50c1122a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 --2- 172.21.15.43:0/2571040171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c10b120 0x7fe50c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 --2- 172.21.15.43:0/2571040171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c1057e0 0x7fe50c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 -- 172.21.15.43:0/2571040171 >> 172.21.15.43:0/2571040171 conn(0x7fe50c101210 msgr2=0x7fe50c103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:39:26.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 -- 172.21.15.43:0/2571040171 shutdown_connections 2024-07-26T08:39:26.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.806+0000 7fe511000640 1 -- 172.21.15.43:0/2571040171 wait complete. 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.807+0000 7fe511000640 1 Processor -- start 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.807+0000 7fe511000640 1 -- start start 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe511000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 0x7fe50c19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe511000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c10b120 0x7fe50c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe511000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 0x7fe50c1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe511000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c115850 con 0x7fe50c10ba70 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe511000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1156d0 con 0x7fe50c1057e0 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe511000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1159d0 con 0x7fe50c10b120 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe509e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 0x7fe50c19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe509e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 0x7fe50c19c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:51972/0 (socket says 172.21.15.43:51972) 2024-07-26T08:39:26.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe509e00640 1 -- 172.21.15.43:0/539440151 learned_addr learned my addr 172.21.15.43:0/539440151 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:39:26.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.808+0000 7fe50a800640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 0x7fe50c1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509400640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c10b120 0x7fe50c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509e00640 1 -- 172.21.15.43:0/539440151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c10b120 msgr2=0x7fe50c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509e00640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c10b120 0x7fe50c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509e00640 1 -- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 msgr2=0x7fe50c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509e00640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 0x7fe50c1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509e00640 1 -- 172.21.15.43:0/539440151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c1a2170 con 0x7fe50c1057e0 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509400640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c10b120 0x7fe50c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.809+0000 7fe509e00640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 0x7fe50c19c200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e9f0 tx=0x7fe4fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.810+0000 7fe502a00640 1 -- 172.21.15.43:0/539440151 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00cd80 con 0x7fe50c1057e0 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.810+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c1a2460 con 0x7fe50c1057e0 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.810+0000 7fe502a00640 1 -- 172.21.15.43:0/539440151 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4fc010900 con 0x7fe50c1057e0 2024-07-26T08:39:26.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.810+0000 7fe502a00640 1 -- 172.21.15.43:0/539440151 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0188d0 con 0x7fe50c1057e0 2024-07-26T08:39:26.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.810+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c1a8bc0 con 0x7fe50c1057e0 2024-07-26T08:39:26.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.813+0000 7fe517ca4740 1 Processor -- start 2024-07-26T08:39:26.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.813+0000 7fe517ca4740 1 -- start start 2024-07-26T08:39:26.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 0x561cf83d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf80041b0 0x561cf83d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe517ca4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561cf8348b90 con 0x561cf80041b0 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe517ca4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x561cf8338090 con 0x561cf802d070 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe517ca4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x561cf833c0d0 con 0x561cf800c390 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe502a00640 1 -- 172.21.15.43:0/539440151 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe4fc010ab0 con 0x7fe50c1057e0 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe50a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 0x561cf83d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe50a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 0x561cf83d1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:51982/0 (socket says 172.21.15.43:51982) 2024-07-26T08:39:26.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe50a800640 1 -- 172.21.15.43:0/4150636851 learned_addr learned my addr 172.21.15.43:0/4150636851 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:39:26.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.814+0000 7fe509400640 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe509e00640 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf80041b0 0x561cf83d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe50a800640 1 -- 172.21.15.43:0/4150636851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 msgr2=0x561cf83d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe50a800640 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe50a800640 1 -- 172.21.15.43:0/4150636851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf80041b0 msgr2=0x561cf83d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe50a800640 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf80041b0 0x561cf83d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe50a800640 1 -- 172.21.15.43:0/4150636851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf8098650 con 0x561cf802d070 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe509400640 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.815+0000 7fe50a800640 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 0x561cf83d1df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe50402f410 tx=0x7fe50402f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b195e1fb07fa0a4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.816+0000 7fe4f7400640 1 -- 172.21.15.43:0/4150636851 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504031d40 con 0x561cf802d070 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.816+0000 7fe4f7400640 1 -- 172.21.15.43:0/4150636851 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe504036030 con 0x561cf802d070 2024-07-26T08:39:26.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.816+0000 7fe4f7400640 1 -- 172.21.15.43:0/4150636851 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5040042a0 con 0x561cf802d070 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe502a00640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe4f00b3dc0 0x7fe4f00b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 -- 172.21.15.43:0/4150636851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 msgr2=0x561cf83d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 0x561cf83d1df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe50402f410 tx=0x7fe50402f440 comp rx=0 tx=0).stop 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe509e00640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe4f00b3dc0 0x7fe4f00b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe502a00640 1 -- 172.21.15.43:0/539440151 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 10656+0+0 (secure 0 0 0) 0x7fe4fc0e4b90 con 0x7fe50c1057e0 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 -- 172.21.15.43:0/4150636851 shutdown_connections 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf80041b0 0x561cf83d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4150636851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf802d070 0x561cf83d1df0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 -- 172.21.15.43:0/4150636851 >> 172.21.15.43:0/4150636851 conn(0x561cf8021460 msgr2=0x561cf83cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 -- 172.21.15.43:0/4150636851 shutdown_connections 2024-07-26T08:39:26.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.817+0000 7fe517ca4740 1 -- 172.21.15.43:0/4150636851 wait complete. 2024-07-26T08:39:26.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.818+0000 7fe509e00640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe4f00b3dc0 0x7fe4f00b62d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x561cf83d0a70 tx=0x7fe4fc0e4e10 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:39:26.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.818+0000 7fe517ca4740 1 -- start start 2024-07-26T08:39:26.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.818+0000 7fe517ca4740 1 Processor -- start 2024-07-26T08:39:26.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 0x561cf83dd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf802d070 0x561cf83dde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561cf819b700 con 0x561cf800c390 2024-07-26T08:39:26.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x561cf82d4660 con 0x561cf80041b0 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x561cf83e03f0 con 0x561cf802d070 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe517ca4740 10 client.0 _ll_register_callbacks cb 0x561cf82e4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe509400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 0x561cf83dd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe509400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 0x561cf83dd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34568/0 (socket says 172.21.15.43:34568) 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe509400640 1 -- 172.21.15.43:0/53145864 learned_addr learned my addr 172.21.15.43:0/53145864 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe50a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.819+0000 7fe50a800640 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf802d070 0x561cf83dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe509400640 1 -- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf802d070 msgr2=0x561cf83dde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe509400640 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf802d070 0x561cf83dde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe509400640 1 -- 172.21.15.43:0/53145864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 msgr2=0x561cf83dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe509400640 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe509400640 1 -- 172.21.15.43:0/53145864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf82eb800 con 0x561cf800c390 2024-07-26T08:39:26.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe509400640 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 0x561cf83dd920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8012d20 tx=0x7fe4f800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404e6275330b9d61 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe4ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.820+0000 7fe4ebe00640 1 -- 172.21.15.43:0/53145864 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80120d0 con 0x561cf800c390 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.821+0000 7fe4ebe00640 1 -- 172.21.15.43:0/53145864 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 10656+0+0 (secure 0 0 0) 0x7fe4f8004030 con 0x561cf800c390 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.821+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe504036030 con 0x561cf800c390 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.821+0000 7fe4ebe00640 1 -- 172.21.15.43:0/53145864 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7fe4f8025050 con 0x561cf800c390 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.821+0000 7fe517ca4740 10 client.15819 fetch_fsmap learned FSMap version 121 2024-07-26T08:39:26.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.821+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=4+}) -- 0x561cf83ebfe0 con 0x561cf800c390 2024-07-26T08:39:26.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.821+0000 7fe4ebe00640 1 -- 172.21.15.43:0/53145864 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe504036030 con 0x561cf800c390 2024-07-26T08:39:26.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe4ebe00640 1 -- 172.21.15.43:0/53145864 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 121) ==== 7749+0+0 (secure 0 0 0) 0x7fe4f801c460 con 0x561cf800c390 2024-07-26T08:39:26.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe517ca4740 10 client.15819 fetch_fsmap finished waiting for FSMap version 121 2024-07-26T08:39:26.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe517ca4740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:39:26.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe517ca4740 20 client.15819 populate_metadata read hostname 'smithi043' 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe517ca4740 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7feb9f0 0x561cf83ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe517ca4740 4 client.15819 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cf834aae0 con 0x561cf7feb9f0 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.822+0000 7fe50a800640 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7feb9f0 0x561cf83ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.823+0000 7fe50a800640 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7feb9f0 0x561cf83ef4a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd5a3da269cac91 server_cookie=7a9a39f8dc40f2fb in_seq=0 out_seq=0 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.823+0000 7fe4ebe00640 10 client.15819 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe4ebe00640 1 -- 172.21.15.43:0/53145864 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cf834aae0 con 0x561cf7feb9f0 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe4ebe00640 10 client.15819 handle_command_reply: tid=0 2024-07-26T08:39:26.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 client.15819 shutdown 2024-07-26T08:39:26.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 msgr2=0x561cf83dd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 0x561cf83dd920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8012d20 tx=0x7fe4f800f790 comp rx=0 tx=0).stop 2024-07-26T08:39:26.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 shutdown_connections 2024-07-26T08:39:26.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7feb9f0 0x561cf83ef4a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf802d070 0x561cf83dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf800c390 0x561cf83dd920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 --2- 172.21.15.43:0/53145864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe4ebe00640 0 client.15819 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:39:26.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.824+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 >> 172.21.15.43:0/53145864 conn(0x561cf8021460 msgr2=0x561cf83d4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:39:26.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.825+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 shutdown_connections 2024-07-26T08:39:26.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.825+0000 7fe517ca4740 1 -- 172.21.15.43:0/53145864 wait complete. 2024-07-26T08:39:26.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.825+0000 7fe517ca4740 20 client.15819 trim_cache size 0 max 16384 2024-07-26T08:39:26.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.844+0000 7fe517ca4740 1 Processor -- start 2024-07-26T08:39:26.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 -- start start 2024-07-26T08:39:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf80041b0 0x561cf83df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf800c390 0x561cf83f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1b5260 con 0x561cf802d070 2024-07-26T08:39:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1b5930 con 0x561cf800c390 2024-07-26T08:39:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.845+0000 7fe517ca4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1b3240 con 0x561cf80041b0 2024-07-26T08:39:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe50a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf80041b0 0x561cf83df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf800c390 0x561cf83f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe50a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf80041b0 0x561cf83df3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44814/0 (socket says 172.21.15.43:44814) 2024-07-26T08:39:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe50a800640 1 -- 172.21.15.43:0/2437394361 learned_addr learned my addr 172.21.15.43:0/2437394361 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:39:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe50a800640 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 -- 172.21.15.43:0/2437394361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf80041b0 msgr2=0x561cf83df3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf80041b0 0x561cf83df3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 -- 172.21.15.43:0/2437394361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 msgr2=0x561cf83f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 -- 172.21.15.43:0/2437394361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf83d4c50 con 0x561cf800c390 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.846+0000 7fe509400640 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf800c390 0x561cf83f4c80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8012cf0 tx=0x7fe4f8005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1df4da17f461b351 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.847+0000 7fe4f6a00640 1 -- 172.21.15.43:0/2437394361 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f802e070 con 0x561cf800c390 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.847+0000 7fe4f6a00640 1 -- 172.21.15.43:0/2437394361 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4f801c460 con 0x561cf800c390 2024-07-26T08:39:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.847+0000 7fe4f6a00640 1 -- 172.21.15.43:0/2437394361 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f801ca70 con 0x561cf800c390 2024-07-26T08:39:26.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 -- 172.21.15.43:0/2437394361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf800c390 msgr2=0x561cf83f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf800c390 0x561cf83f4c80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8012cf0 tx=0x7fe4f8005db0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 -- 172.21.15.43:0/2437394361 shutdown_connections 2024-07-26T08:39:26.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf800c390 0x561cf83f4c80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 --2- 172.21.15.43:0/2437394361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf80041b0 0x561cf83df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 -- 172.21.15.43:0/2437394361 >> 172.21.15.43:0/2437394361 conn(0x561cf8021460 msgr2=0x561cf83d8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 -- 172.21.15.43:0/2437394361 shutdown_connections 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.848+0000 7fe517ca4740 1 -- 172.21.15.43:0/2437394361 wait complete. 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.849+0000 7fe517ca4740 1 -- start start 2024-07-26T08:39:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.849+0000 7fe517ca4740 1 Processor -- start 2024-07-26T08:39:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83e1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83e1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1b2b70 con 0x561cf802d070 2024-07-26T08:39:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1b1740 con 0x561cf80041b0 2024-07-26T08:39:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c1b1dd0 con 0x561cf800c390 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe517ca4740 10 client.0 _ll_register_callbacks cb 0x7fe4f8012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe509400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe509400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83e1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44824/0 (socket says 172.21.15.43:44824) 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe509400640 1 -- 172.21.15.43:0/4184482463 learned_addr learned my addr 172.21.15.43:0/4184482463 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe50a800640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.850+0000 7fe50a800640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe509400640 1 -- 172.21.15.43:0/4184482463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 msgr2=0x561cf83e1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe509400640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83e1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe509400640 1 -- 172.21.15.43:0/4184482463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 msgr2=0x561cf83e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:39:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe509400640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe509400640 1 -- 172.21.15.43:0/4184482463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf8456c80 con 0x561cf800c390 2024-07-26T08:39:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe509400640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83e1a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80059f0 tx=0x7fe4f801cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a256a83f4541bb1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:39:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe4ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:39:26.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe4ebe00640 1 -- 172.21.15.43:0/4184482463 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f802e070 con 0x561cf800c390 2024-07-26T08:39:26.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4f801c460 con 0x561cf800c390 2024-07-26T08:39:26.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.851+0000 7fe4ebe00640 1 -- 172.21.15.43:0/4184482463 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 10656+0+0 (secure 0 0 0) 0x7fe4f8012250 con 0x561cf800c390 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe4ebe00640 1 -- 172.21.15.43:0/4184482463 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7fe4f801c610 con 0x561cf800c390 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 10 client.26020 fetch_fsmap learned FSMap version 121 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=4+}) -- 0x561cf8457ef0 con 0x561cf800c390 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe4ebe00640 1 -- 172.21.15.43:0/4184482463 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4f801c460 con 0x561cf800c390 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe4ebe00640 1 -- 172.21.15.43:0/4184482463 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 121) ==== 7749+0+0 (secure 0 0 0) 0x7fe4f8003c80 con 0x561cf800c390 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 10 client.26020 fetch_fsmap finished waiting for FSMap version 121 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 10 client.26020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 20 client.26020 populate_metadata read hostname 'smithi043' 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7fc0da0 0x561cf845a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 4 client.26020 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.852+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561cf8346580 con 0x561cf7fc0da0 2024-07-26T08:39:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.853+0000 7fe50a800640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7fc0da0 0x561cf845a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.853+0000 7fe50a800640 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7fc0da0 0x561cf845a5b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a7eee17bc8ca93 server_cookie=ab1c39b567b34bac in_seq=0 out_seq=0 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.853+0000 7fe4ebe00640 10 client.26020 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe4ebe00640 1 -- 172.21.15.43:0/4184482463 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x561cf8346580 con 0x561cf7fc0da0 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe4ebe00640 10 client.26020 handle_command_reply: tid=0 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 client.26020 shutdown 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 msgr2=0x561cf83e1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83e1a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80059f0 tx=0x7fe4f801cc20 comp rx=0 tx=0).stop 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 shutdown_connections 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x561cf7fc0da0 0x561cf845a5b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cf800c390 0x561cf83e1a90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561cf802d070 0x561cf83e1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe4ebe00640 0 client.26020 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:39:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 --2- 172.21.15.43:0/4184482463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561cf80041b0 0x561cf83e1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 >> 172.21.15.43:0/4184482463 conn(0x561cf8021460 msgr2=0x561cf83e84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:39:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 shutdown_connections 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 1 -- 172.21.15.43:0/4184482463 wait complete. 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.854+0000 7fe517ca4740 20 client.26020 trim_cache size 0 max 16384 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:39:26.861 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:39:26.862 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:39:26.862 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:39:26.862 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:39:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe4f00b3dc0 msgr2=0x7fe4f00b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe4f00b3dc0 0x7fe4f00b62d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x561cf83d0a70 tx=0x7fe4fc0e4e10 comp rx=0 tx=0).stop 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 msgr2=0x7fe50c19c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 0x7fe50c19c200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e9f0 tx=0x7fe4fc00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 shutdown_connections 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe4f00b3dc0 0x7fe4f00b62d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50c10b120 0x7fe50c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe50c10ba70 0x7fe50c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 --2- 172.21.15.43:0/539440151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1057e0 0x7fe50c19c200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.855+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 >> 172.21.15.43:0/539440151 conn(0x7fe50c101210 msgr2=0x7fe50c108640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.856+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 shutdown_connections 2024-07-26T08:39:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:39:26.856+0000 7fe511000640 1 -- 172.21.15.43:0/539440151 wait complete. 2024-07-26T08:39:27.812 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:39:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:28 smithi043 ceph-mon[32384]: pgmap v688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:39:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:28 smithi133 ceph-mon[37053]: pgmap v688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:39:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:28 smithi063 ceph-mon[36747]: pgmap v688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: pgmap v689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: Replacing daemon mds.h as rank 1 with standby daemon mds.e 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: osdmap e105: 12 total, 12 up, 12 in 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:30 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 216.708745 secs 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: pgmap v689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: Replacing daemon mds.h as rank 1 with standby daemon mds.e 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: osdmap e105: 12 total, 12 up, 12 in 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:30 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 216.708745 secs 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: pgmap v689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: Replacing daemon mds.h as rank 1 with standby daemon mds.e 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: osdmap e105: 12 total, 12 up, 12 in 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:30 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 216.708745 secs 2024-07-26T08:39:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 232.196024 secs 2024-07-26T08:39:31.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 232.196024 secs 2024-07-26T08:39:31.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 232.196024 secs 2024-07-26T08:39:32.501 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:32 smithi043 ceph-mon[32384]: pgmap v691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:39:32.501 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:32 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:resolve 2024-07-26T08:39:32.501 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:32 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:32 smithi133 ceph-mon[37053]: pgmap v691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:39:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:32 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:resolve 2024-07-26T08:39:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:32 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:32.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:32 smithi063 ceph-mon[36747]: pgmap v691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:39:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:32 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:resolve 2024-07-26T08:39:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:32 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:33 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:39:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:33 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:reconnect 2024-07-26T08:39:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:33 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:33 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:39:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:33 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:39:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:33 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:reconnect 2024-07-26T08:39:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:33 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:33 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:39:33.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:33 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:39:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:33 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:reconnect 2024-07-26T08:39:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:33 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:33 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:39:34.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-mon[36747]: pgmap v692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:39:34.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:rejoin 2024-07-26T08:39:34.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:34.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-mon[36747]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: *** Caught signal (Aborted) ** 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: in thread 7fc6f4ab1640 thread_name:ms_dispatch 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc6f9e886f0] 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc6f9ed594c] 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 3: raise() 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 4: abort() 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc6f9e7271b] 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fc6f9e81386] 2024-07-26T08:39:34.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5640abbb36b9] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5640abd7180c] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5640abcb12ca] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5640abc81753] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5640abc82a1b] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5640abc66752] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5640abbb4a56] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5640abbb8637] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5640abbb8f5e] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5640abb9c03a] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc6fa755407] 2024-07-26T08:39:34.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fc6fa755cf9] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6fa8325a1] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fc6fa5dfcdd] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc6fa5dfcf9] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc6f9ed3c02] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc6f9f58c40] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.289+0000 7fc6f4ab1640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: in thread 7fc6f4ab1640 thread_name:ms_dispatch 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc6f9e886f0] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc6f9ed594c] 2024-07-26T08:39:34.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 3: raise() 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 4: abort() 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc6f9e7271b] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fc6f9e81386] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5640abbb36b9] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5640abd7180c] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5640abcb12ca] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5640abc81753] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5640abc82a1b] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5640abc66752] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5640abbb4a56] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5640abbb8637] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5640abbb8f5e] 2024-07-26T08:39:34.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5640abb9c03a] 2024-07-26T08:39:34.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc6fa755407] 2024-07-26T08:39:34.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fc6fa755cf9] 2024-07-26T08:39:34.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6fa8325a1] 2024-07-26T08:39:34.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fc6fa5dfcdd] 2024-07-26T08:39:34.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc6fa5dfcf9] 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc6f9ed3c02] 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc6f9f58c40] 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 0> 2024-07-26T08:39:34.289+0000 7fc6f4ab1640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: in thread 7fc6f4ab1640 thread_name:ms_dispatch 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:34.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc6f9e886f0] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc6f9ed594c] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 3: raise() 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 4: abort() 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc6f9e7271b] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fc6f9e81386] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5640abbb36b9] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5640abd7180c] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5640abcb12ca] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5640abc81753] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5640abc82a1b] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5640abc66752] 2024-07-26T08:39:34.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5640abbb4a56] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5640abbb8637] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5640abbb8f5e] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5640abb9c03a] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc6fa755407] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fc6fa755cf9] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6fa8325a1] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fc6fa5dfcdd] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc6fa5dfcf9] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc6f9ed3c02] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc6f9f58c40] 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.329 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 0> 2024-07-26T08:39:34.289+0000 7fc6f4ab1640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:34.330 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: in thread 7fc6f4ab1640 thread_name:ms_dispatch 2024-07-26T08:39:34.330 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.334 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:34.334 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc6f9e886f0] 2024-07-26T08:39:34.334 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc6f9ed594c] 2024-07-26T08:39:34.334 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 3: raise() 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 4: abort() 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc6f9e7271b] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fc6f9e81386] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5640abbb36b9] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5640abd7180c] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5640abcb12ca] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5640abc81753] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5640abc82a1b] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5640abc66752] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5640abbb4a56] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5640abbb8637] 2024-07-26T08:39:34.335 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5640abbb8f5e] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5640abb9c03a] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc6fa755407] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fc6fa755cf9] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6fa8325a1] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fc6fa5dfcdd] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc6fa5dfcf9] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc6f9ed3c02] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc6f9f58c40] 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:34.336 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73063]: 2024-07-26T08:39:34.567 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:34 smithi063 podman[73147]: 2024-07-26 08:39:34.352250838 +0000 UTC m=+0.021085862 container died 92ab2f14e8b4e53af764b51544b563cb683f67172870a11ef51382cb533f9b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-07-26T08:39:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:34 smithi043 ceph-mon[32384]: pgmap v692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:39:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:34 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:rejoin 2024-07-26T08:39:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:34 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:34 smithi043 ceph-mon[32384]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:39:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:34 smithi133 ceph-mon[37053]: pgmap v692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:39:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:34 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:rejoin 2024-07-26T08:39:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:34 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:34 smithi133 ceph-mon[37053]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:39:35.340 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:35 smithi063 podman[73147]: 2024-07-26 08:39:35.089261923 +0000 UTC m=+0.758096920 container remove 92ab2f14e8b4e53af764b51544b563cb683f67172870a11ef51382cb533f9b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD) 2024-07-26T08:39:35.341 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:35 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:39:35.341 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:35 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:35.341 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:35 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:active 2024-07-26T08:39:35.341 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:35 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:35.341 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:35 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:39:35.341 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:35 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 221.708842 secs 2024-07-26T08:39:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:35 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:35 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:active 2024-07-26T08:39:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:35 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:35 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:39:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:35 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 221.708842 secs 2024-07-26T08:39:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:35 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:35 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/2899086135,v1:172.21.15.63:6835/2899086135] up:active 2024-07-26T08:39:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:35 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:35 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:39:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:35 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 221.708842 secs 2024-07-26T08:39:35.818 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:35 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:39:35.818 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:35 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 1.974s CPU time. 2024-07-26T08:39:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:36 smithi063 ceph-mon[36747]: pgmap v693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:39:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 237.196168 secs 2024-07-26T08:39:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:36 smithi043 ceph-mon[32384]: pgmap v693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:39:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 237.196168 secs 2024-07-26T08:39:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:36 smithi133 ceph-mon[37053]: pgmap v693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:39:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 237.196168 secs 2024-07-26T08:39:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:38 smithi063 ceph-mon[36747]: pgmap v694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:38 smithi043 ceph-mon[32384]: pgmap v694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:38 smithi133 ceph-mon[37053]: pgmap v694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:40 smithi043 ceph-mon[32384]: pgmap v695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:40 smithi043 ceph-mon[32384]: 2 slow requests, 0 included below; oldest blocked for > 226.708964 secs 2024-07-26T08:39:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:40 smithi133 ceph-mon[37053]: pgmap v695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:40 smithi133 ceph-mon[37053]: 2 slow requests, 0 included below; oldest blocked for > 226.708964 secs 2024-07-26T08:39:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:40 smithi063 ceph-mon[36747]: pgmap v695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:39:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:40 smithi063 ceph-mon[36747]: 2 slow requests, 0 included below; oldest blocked for > 226.708964 secs 2024-07-26T08:39:41.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 242.196261 secs 2024-07-26T08:39:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 242.196261 secs 2024-07-26T08:39:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 242.196261 secs 2024-07-26T08:39:42.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:42 smithi043 ceph-mon[32384]: pgmap v696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 183 B/s wr, 10 op/s 2024-07-26T08:39:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:42 smithi133 ceph-mon[37053]: pgmap v696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 183 B/s wr, 10 op/s 2024-07-26T08:39:42.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:42 smithi063 ceph-mon[36747]: pgmap v696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 183 B/s wr, 10 op/s 2024-07-26T08:39:44.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:44 smithi043 ceph-mon[32384]: pgmap v697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:44.787 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:44 smithi133 ceph-mon[37053]: pgmap v697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:44 smithi063 ceph-mon[36747]: pgmap v697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:39:45.626 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:45 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 231.709123 secs 2024-07-26T08:39:45.626 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:45 smithi043 ceph-mon[32384]: slow request 180.218820 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:39:45.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:45 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 231.709123 secs 2024-07-26T08:39:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:45 smithi133 ceph-mon[37053]: slow request 180.218820 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:39:45.806 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:45 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 231.709123 secs 2024-07-26T08:39:45.806 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:45 smithi063 ceph-mon[36747]: slow request 180.218820 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:39:45.806 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:39:45.807 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:45 smithi063 systemd[1]: Stopped Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:39:45.807 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 1.974s CPU time. 2024-07-26T08:39:45.807 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:45 smithi063 systemd[1]: Starting Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:39:46.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:45 smithi063 podman[73242]: 2024-07-26 08:39:45.708016816 +0000 UTC m=+0.018522326 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:39:46.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:45 smithi063 podman[73242]: 2024-07-26 08:39:45.838230561 +0000 UTC m=+0.148736101 container create d4fab6c2bd26c77687878b55d10a8b851e233ee267b85b7ab6d07496a4caebac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-07-26T08:39:46.354 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:46 smithi063 podman[73242]: 2024-07-26 08:39:46.082411058 +0000 UTC m=+0.392916554 container init d4fab6c2bd26c77687878b55d10a8b851e233ee267b85b7ab6d07496a4caebac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-26T08:39:46.354 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:46 smithi063 podman[73242]: 2024-07-26 08:39:46.085402394 +0000 UTC m=+0.395907897 container start d4fab6c2bd26c77687878b55d10a8b851e233ee267b85b7ab6d07496a4caebac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, io.buildah.version=1.36.0) 2024-07-26T08:39:46.354 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mds[73261]: -- 172.21.15.63:0/1082809594 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56386e1cd860 con 0x56387236fa80 2024-07-26T08:39:46.354 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: starting mds.e at 2024-07-26T08:39:46.354 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:46 smithi063 bash[73242]: d4fab6c2bd26c77687878b55d10a8b851e233ee267b85b7ab6d07496a4caebac 2024-07-26T08:39:46.354 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:39:46 smithi063 systemd[1]: Started Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: pgmap v698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 247.196387 secs 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: daemon mds.e restarted 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: osdmap e106: 12 total, 12 up, 12 in 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:boot 2024-07-26T08:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:39:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:39:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:46 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: pgmap v698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 247.196387 secs 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: daemon mds.e restarted 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: osdmap e106: 12 total, 12 up, 12 in 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:boot 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:46 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: pgmap v698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 247.196387 secs 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: daemon mds.e restarted 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: osdmap e106: 12 total, 12 up, 12 in 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:boot 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:39:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:46 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:48.622 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:48 smithi043 ceph-mon[32384]: pgmap v700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:48.622 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:48 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:48.622 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:48 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:resolve 2024-07-26T08:39:48.622 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:48 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:48 smithi133 ceph-mon[37053]: pgmap v700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:48 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:48 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:resolve 2024-07-26T08:39:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:48 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:48 smithi063 ceph-mon[36747]: pgmap v700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:39:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:48 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] up:active 2024-07-26T08:39:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:48 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:resolve 2024-07-26T08:39:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:48 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:49 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:39:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:49 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:reconnect 2024-07-26T08:39:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:49 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:49 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999981 2024-07-26T08:39:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:39:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:39:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:reconnect 2024-07-26T08:39:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999981 2024-07-26T08:39:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:39:49.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:49 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:39:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:49 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:reconnect 2024-07-26T08:39:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:49 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:49 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999981 2024-07-26T08:39:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:39:50.218 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:39:50.218 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: *** Caught signal (Aborted) ** 2024-07-26T08:39:50.218 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: in thread 7f5d267ae640 thread_name:ms_dispatch 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5d2bb856f0] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5d2bbd294c] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 3: raise() 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 4: abort() 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5d2bb6f71b] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 6: /lib64/libc.so.6(+0x37386) [0x7f5d2bb7e386] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55642abdd6b9] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55642ad9b80c] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55642acdb2ca] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55642acab753] 2024-07-26T08:39:50.219 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55642acaca1b] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55642ac90752] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55642abdea56] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55642abe2637] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55642abe2f5e] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55642abc603a] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5d2c452407] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 18: (DispatchQueue::entry()+0x60f) [0x7f5d2c452cf9] 2024-07-26T08:39:50.220 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5d2c52f5a1] 2024-07-26T08:39:50.221 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 20: (Thread::entry_wrapper()+0x43) [0x7f5d2c2dccdd] 2024-07-26T08:39:50.221 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5d2c2dccf9] 2024-07-26T08:39:50.221 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5d2bbd0c02] 2024-07-26T08:39:50.221 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5d2bc55c40] 2024-07-26T08:39:50.221 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:49.930+0000 7f5d267ae640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:50.221 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: in thread 7f5d267ae640 thread_name:ms_dispatch 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5d2bb856f0] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5d2bbd294c] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 3: raise() 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 4: abort() 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5d2bb6f71b] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 6: /lib64/libc.so.6(+0x37386) [0x7f5d2bb7e386] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55642abdd6b9] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55642ad9b80c] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55642acdb2ca] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55642acab753] 2024-07-26T08:39:50.222 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55642acaca1b] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55642ac90752] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55642abdea56] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55642abe2637] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55642abe2f5e] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55642abc603a] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5d2c452407] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 18: (DispatchQueue::entry()+0x60f) [0x7f5d2c452cf9] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5d2c52f5a1] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 20: (Thread::entry_wrapper()+0x43) [0x7f5d2c2dccdd] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5d2c2dccf9] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5d2bbd0c02] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5d2bc55c40] 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:50.223 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 0> 2024-07-26T08:39:49.930+0000 7f5d267ae640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: in thread 7f5d267ae640 thread_name:ms_dispatch 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5d2bb856f0] 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5d2bbd294c] 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 3: raise() 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 4: abort() 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5d2bb6f71b] 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 6: /lib64/libc.so.6(+0x37386) [0x7f5d2bb7e386] 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55642abdd6b9] 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55642ad9b80c] 2024-07-26T08:39:50.224 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55642acdb2ca] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55642acab753] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55642acaca1b] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55642ac90752] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55642abdea56] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55642abe2637] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55642abe2f5e] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55642abc603a] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5d2c452407] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 18: (DispatchQueue::entry()+0x60f) [0x7f5d2c452cf9] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5d2c52f5a1] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 20: (Thread::entry_wrapper()+0x43) [0x7f5d2c2dccdd] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5d2c2dccf9] 2024-07-26T08:39:50.225 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5d2bbd0c02] 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5d2bc55c40] 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 0> 2024-07-26T08:39:49.930+0000 7f5d267ae640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: in thread 7f5d267ae640 thread_name:ms_dispatch 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5d2bb856f0] 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5d2bbd294c] 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 3: raise() 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 4: abort() 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5d2bb6f71b] 2024-07-26T08:39:50.226 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 6: /lib64/libc.so.6(+0x37386) [0x7f5d2bb7e386] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55642abdd6b9] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55642ad9b80c] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55642acdb2ca] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55642acab753] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55642acaca1b] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55642ac90752] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55642abdea56] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55642abe2637] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55642abe2f5e] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55642abc603a] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5d2c452407] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 18: (DispatchQueue::entry()+0x60f) [0x7f5d2c452cf9] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5d2c52f5a1] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 20: (Thread::entry_wrapper()+0x43) [0x7f5d2c2dccdd] 2024-07-26T08:39:50.227 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5d2c2dccf9] 2024-07-26T08:39:50.228 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5d2bbd0c02] 2024-07-26T08:39:50.228 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5d2bc55c40] 2024-07-26T08:39:50.228 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:39:50.228 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[68114]: 2024-07-26T08:39:50.228 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:50 smithi133 podman[72453]: 2024-07-26 08:39:50.216746806 +0000 UTC m=+0.248682428 container died d9e83c5a987858b1871a6317b4d796132b6f0b57268ee4ab65331db9464b4548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: pgmap v701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6 op/s 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:rejoin 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:50.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:active 2024-07-26T08:39:50.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:39:50.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 236.709166 secs 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: pgmap v701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6 op/s 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:rejoin 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:active 2024-07-26T08:39:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:39:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 236.709166 secs 2024-07-26T08:39:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: pgmap v701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6 op/s 2024-07-26T08:39:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:rejoin 2024-07-26T08:39:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1827419050,v1:172.21.15.133:6833/1827419050] up:active 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:39:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 236.709166 secs 2024-07-26T08:39:50.968 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:39:50 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:39:50.765+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:39:51.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:50 smithi133 podman[72453]: 2024-07-26 08:39:50.967839139 +0000 UTC m=+0.999774802 container remove d9e83c5a987858b1871a6317b4d796132b6f0b57268ee4ab65331db9464b4548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T08:39:51.266 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:50 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:39:51.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 252.196503 secs 2024-07-26T08:39:51.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:51.765 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:51 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:39:51.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:39:51 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 2.087s CPU time. 2024-07-26T08:39:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 252.196503 secs 2024-07-26T08:39:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 252.196503 secs 2024-07-26T08:39:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:52 smithi043 ceph-mon[32384]: pgmap v702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:39:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:52 smithi133 ceph-mon[37053]: pgmap v702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:39:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:52 smithi063 ceph-mon[36747]: pgmap v702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:39:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:53.605 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:39:53.605 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:39:53.605 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:53.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:39:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:39:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:39:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:39:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:39:54.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:54 smithi043 ceph-mon[32384]: pgmap v703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 B/s wr, 9 op/s 2024-07-26T08:39:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:54 smithi043 ceph-mon[32384]: Health check failed: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T08:39:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:54 smithi133 ceph-mon[37053]: pgmap v703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 B/s wr, 9 op/s 2024-07-26T08:39:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:54 smithi133 ceph-mon[37053]: Health check failed: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T08:39:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:54 smithi063 ceph-mon[36747]: pgmap v703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 B/s wr, 9 op/s 2024-07-26T08:39:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:54 smithi063 ceph-mon[36747]: Health check failed: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T08:39:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 241.709248 secs 2024-07-26T08:39:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 241.709248 secs 2024-07-26T08:39:55.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 241.709248 secs 2024-07-26T08:39:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:56 smithi043 ceph-mon[32384]: pgmap v704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 B/s wr, 11 op/s 2024-07-26T08:39:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 257.196647 secs 2024-07-26T08:39:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:56 smithi133 ceph-mon[37053]: pgmap v704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 B/s wr, 11 op/s 2024-07-26T08:39:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 257.196647 secs 2024-07-26T08:39:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:56 smithi063 ceph-mon[36747]: pgmap v704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 B/s wr, 11 op/s 2024-07-26T08:39:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 257.196647 secs 2024-07-26T08:39:57.813 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:39:58.303 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:39:58.710 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:39:58 smithi043 ceph-mon[32384]: pgmap v705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 190 B/s wr, 10 op/s 2024-07-26T08:39:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:39:58 smithi133 ceph-mon[37053]: pgmap v705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 190 B/s wr, 10 op/s 2024-07-26T08:39:58.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:39:58 smithi063 ceph-mon[36747]: pgmap v705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 190 B/s wr, 10 op/s 2024-07-26T08:40:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: pgmap v706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 173 B/s wr, 11 op/s 2024-07-26T08:40:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: Health detail: HEALTH_WARN 3 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: daemon mds.h on smithi063 is in error state 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: daemon mds.b on smithi063 is in error state 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: daemon mds.l on smithi133 is in unknown state 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: mds.c(mds.0): 3 slow requests are blocked > 180 secs 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: mds.i(mds.2): 1 slow requests are blocked > 180 secs 2024-07-26T08:40:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 246.709360 secs 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: pgmap v706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 173 B/s wr, 11 op/s 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: Health detail: HEALTH_WARN 3 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: daemon mds.h on smithi063 is in error state 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: daemon mds.b on smithi063 is in error state 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: daemon mds.l on smithi133 is in unknown state 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: mds.c(mds.0): 3 slow requests are blocked > 180 secs 2024-07-26T08:40:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: mds.i(mds.2): 1 slow requests are blocked > 180 secs 2024-07-26T08:40:00.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 246.709360 secs 2024-07-26T08:40:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: pgmap v706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 173 B/s wr, 11 op/s 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: Health detail: HEALTH_WARN 3 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: daemon mds.h on smithi063 is in error state 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: daemon mds.b on smithi063 is in error state 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: daemon mds.l on smithi133 is in unknown state 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: mds.c(mds.0): 3 slow requests are blocked > 180 secs 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: mds.i(mds.2): 1 slow requests are blocked > 180 secs 2024-07-26T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 246.709360 secs 2024-07-26T08:40:00.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 -- 172.21.15.43:0/3033492245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410b860 msgr2=0x7fbbb4112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3033492245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410b860 0x7fbbb4112090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009ca0 tx=0x7fbbac02a8c0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 -- 172.21.15.43:0/3033492245 shutdown_connections 2024-07-26T08:40:00.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3033492245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410b860 0x7fbbb4112090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3033492245 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbb410af10 0x7fbbb410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3033492245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbb41055d0 0x7fbbb41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 -- 172.21.15.43:0/3033492245 >> 172.21.15.43:0/3033492245 conn(0x7fbbb4101040 msgr2=0x7fbbb4103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 -- 172.21.15.43:0/3033492245 shutdown_connections 2024-07-26T08:40:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.869+0000 7fbbbae00640 1 -- 172.21.15.43:0/3033492245 wait complete. 2024-07-26T08:40:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.870+0000 7fbbbae00640 1 Processor -- start 2024-07-26T08:40:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 -- start start 2024-07-26T08:40:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbb41055d0 0x7fbbb419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 0x7fbbb419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbb410b860 0x7fbbb41a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4115640 con 0x7fbbb41055d0 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41154c0 con 0x7fbbb410b860 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbbae00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41157c0 con 0x7fbbb410af10 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 0x7fbbb419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbb9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbb41055d0 0x7fbbb419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 0x7fbbb419c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:43658/0 (socket says 172.21.15.43:43658) 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.871+0000 7fbbb9000640 1 -- 172.21.15.43:0/3394925035 learned_addr learned my addr 172.21.15.43:0/3394925035 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbba400640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbb410b860 0x7fbbb41a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb9000640 1 -- 172.21.15.43:0/3394925035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbb410b860 msgr2=0x7fbbb41a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb9000640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbb410b860 0x7fbbb41a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb9000640 1 -- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbb41055d0 msgr2=0x7fbbb419bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb9000640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbb41055d0 0x7fbbb419bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb9000640 1 -- 172.21.15.43:0/3394925035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb41a1f20 con 0x7fbbb410af10 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb9000640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 0x7fbbb419c550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbba000e9f0 tx=0x7fbba000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb2000640 1 -- 172.21.15.43:0/3394925035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba000ccc0 con 0x7fbbb410af10 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbb2000640 1 -- 172.21.15.43:0/3394925035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbba0010900 con 0x7fbbb410af10 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.872+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb41a2210 con 0x7fbbb410af10 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.873+0000 7fbbb2000640 1 -- 172.21.15.43:0/3394925035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0018900 con 0x7fbbb410af10 2024-07-26T08:40:00.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.873+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41a8970 con 0x7fbbb410af10 2024-07-26T08:40:00.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.876+0000 7fbbc31eb740 1 Processor -- start 2024-07-26T08:40:00.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.876+0000 7fbbc31eb740 1 -- start start 2024-07-26T08:40:00.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbb2000640 1 -- 172.21.15.43:0/3394925035 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbba0010ab0 con 0x7fbbb410af10 2024-07-26T08:40:00.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3901000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c3901540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3901a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f4c3877bc0 con 0x55f4c35331b0 2024-07-26T08:40:00.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f4c38670c0 con 0x55f4c355c070 2024-07-26T08:40:00.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55f4c386b100 con 0x55f4c353b390 2024-07-26T08:40:00.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbb9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c3901540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3901a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbb9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c3901540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45198/0 (socket says 172.21.15.43:45198) 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbb9a00640 1 -- 172.21.15.43:0/1563423631 learned_addr learned my addr 172.21.15.43:0/1563423631 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.877+0000 7fbbba400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3901000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.878+0000 7fbbba400640 1 -- 172.21.15.43:0/1563423631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 msgr2=0x55f4c3901a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.878+0000 7fbbba400640 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3901a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.878+0000 7fbbba400640 1 -- 172.21.15.43:0/1563423631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 msgr2=0x55f4c3901540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.878+0000 7fbbba400640 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c3901540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.878+0000 7fbbba400640 1 -- 172.21.15.43:0/1563423631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c35c7650 con 0x55f4c355c070 2024-07-26T08:40:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.878+0000 7fbbba400640 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3901000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbbac005e30 tx=0x7fbbac02f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d3a8eeb4a3343b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:00.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.879+0000 7fbba6a00640 1 -- 172.21.15.43:0/1563423631 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac031d40 con 0x55f4c355c070 2024-07-26T08:40:00.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.879+0000 7fbba6a00640 1 -- 172.21.15.43:0/1563423631 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbbac036030 con 0x55f4c355c070 2024-07-26T08:40:00.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.879+0000 7fbba6a00640 1 -- 172.21.15.43:0/1563423631 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac004040 con 0x55f4c355c070 2024-07-26T08:40:00.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.879+0000 7fbbb2000640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbb9c0b3d40 0x7fbb9c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.879+0000 7fbbb2000640 1 -- 172.21.15.43:0/3394925035 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 10828+0+0 (secure 0 0 0) 0x7fbba00e4c50 con 0x7fbbb410af10 2024-07-26T08:40:00.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbb9c0b3d40 0x7fbb9c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1563423631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 msgr2=0x55f4c3901000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3901000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbbac005e30 tx=0x7fbbac02f410 comp rx=0 tx=0).stop 2024-07-26T08:40:00.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1563423631 shutdown_connections 2024-07-26T08:40:00.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3901a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c3901540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1563423631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3901000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1563423631 >> 172.21.15.43:0/1563423631 conn(0x55f4c3550460 msgr2=0x55f4c38feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1563423631 shutdown_connections 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbb9c0b3d40 0x7fbb9c0b6250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55f4c38ffc80 tx=0x7fbba8005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.880+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1563423631 wait complete. 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.881+0000 7fbbc31eb740 1 -- start start 2024-07-26T08:40:00.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.881+0000 7fbbc31eb740 1 Processor -- start 2024-07-26T08:40:00.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 0x55f4c39154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c353b390 0x55f4c3915a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c355c070 0x55f4c391aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f4c36ca700 con 0x55f4c355c070 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f4c3803690 con 0x55f4c353b390 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55f4c390f600 con 0x55f4c35331b0 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbc31eb740 10 client.0 _ll_register_callbacks cb 0x55f4c3813140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbb9a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 0x55f4c39154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c353b390 0x55f4c3915a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbb9a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 0x55f4c39154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:43680/0 (socket says 172.21.15.43:43680) 2024-07-26T08:40:00.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbb9a00640 1 -- 172.21.15.43:0/2447801685 learned_addr learned my addr 172.21.15.43:0/2447801685 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.882+0000 7fbbba400640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c355c070 0x55f4c391aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9000640 1 -- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 msgr2=0x55f4c39154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9000640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 0x55f4c39154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9000640 1 -- 172.21.15.43:0/2447801685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c355c070 msgr2=0x55f4c391aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9000640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c355c070 0x55f4c391aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9000640 1 -- 172.21.15.43:0/2447801685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c381a830 con 0x55f4c353b390 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 0x55f4c39154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbba400640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c355c070 0x55f4c391aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbbb9000640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c353b390 0x55f4c3915a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbba00e1a40 tx=0x7fbba00e1fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d660bbca7812546c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.883+0000 7fbb9b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:40:00.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.884+0000 7fbb9b400640 1 -- 172.21.15.43:0/2447801685 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba000ce60 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.884+0000 7fbb9b400640 1 -- 172.21.15.43:0/2447801685 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 10828+0+0 (secure 0 0 0) 0x7fbba00aa420 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.884+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbac036030 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.884+0000 7fbb9b400640 1 -- 172.21.15.43:0/2447801685 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fbba0010e20 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.884+0000 7fbbc31eb740 10 client.26042 fetch_fsmap learned FSMap version 133 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.884+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=4+}) -- 0x55f4c39239f0 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbb9b400640 1 -- 172.21.15.43:0/2447801685 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbbac036030 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbb9b400640 1 -- 172.21.15.43:0/2447801685 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 133) ==== 7144+0+0 (secure 0 0 0) 0x7fbba00eb060 con 0x55f4c353b390 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbc31eb740 10 client.26042 fetch_fsmap finished waiting for FSMap version 133 2024-07-26T08:40:00.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbc31eb740 10 client.26042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbc31eb740 20 client.26042 populate_metadata read hostname 'smithi043' 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c351a9f0 0x55f4c3926ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbc31eb740 4 client.26042 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4c3879b10 con 0x55f4c351a9f0 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.885+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c351a9f0 0x55f4c3926ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.886+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c351a9f0 0x55f4c3926ff0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3845eaad0b4d1a07 server_cookie=d69ac4ed3b85e1c6 in_seq=0 out_seq=0 2024-07-26T08:40:00.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.886+0000 7fbb9b400640 10 client.26042 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:00.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbb9b400640 1 -- 172.21.15.43:0/2447801685 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4c3879b10 con 0x55f4c351a9f0 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbb9b400640 10 client.26042 handle_command_reply: tid=0 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 client.26042 shutdown 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c353b390 msgr2=0x55f4c3915a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c353b390 0x55f4c3915a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbba00e1a40 tx=0x7fbba00e1fc0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 shutdown_connections 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c351a9f0 0x55f4c3926ff0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c355c070 0x55f4c391aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c353b390 0x55f4c3915a80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/2447801685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c35331b0 0x55f4c39154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbb9b400640 0 client.26042 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:00.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 >> 172.21.15.43:0/2447801685 conn(0x55f4c3550460 msgr2=0x55f4c39041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:00.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.887+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 shutdown_connections 2024-07-26T08:40:00.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.888+0000 7fbbc31eb740 1 -- 172.21.15.43:0/2447801685 wait complete. 2024-07-26T08:40:00.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.888+0000 7fbbc31eb740 20 client.26042 trim_cache size 0 max 16384 2024-07-26T08:40:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.907+0000 7fbbc31eb740 1 Processor -- start 2024-07-26T08:40:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.907+0000 7fbbc31eb740 1 -- start start 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c39029f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3921890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3910820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41afef0 con 0x55f4c35331b0 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41b05c0 con 0x55f4c355c070 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41b0c90 con 0x55f4c353b390 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3921890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3921890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:43690/0 (socket says 172.21.15.43:43690) 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbb9000640 1 -- 172.21.15.43:0/1829658542 learned_addr learned my addr 172.21.15.43:0/1829658542 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbba400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3910820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.908+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c39029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbbba400640 1 -- 172.21.15.43:0/1829658542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 msgr2=0x55f4c3921890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbbba400640 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3921890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbbba400640 1 -- 172.21.15.43:0/1829658542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 msgr2=0x55f4c39029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbbba400640 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c39029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbbba400640 1 -- 172.21.15.43:0/1829658542 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c38ff7e0 con 0x55f4c355c070 2024-07-26T08:40:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbbba400640 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3910820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbbac02a900 tx=0x7fbbac02b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235a35b66190502b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.909+0000 7fbba6000640 1 -- 172.21.15.43:0/1829658542 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac054020 con 0x55f4c355c070 2024-07-26T08:40:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.910+0000 7fbba6000640 1 -- 172.21.15.43:0/1829658542 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbbac036040 con 0x55f4c355c070 2024-07-26T08:40:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.910+0000 7fbba6000640 1 -- 172.21.15.43:0/1829658542 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac04a040 con 0x55f4c355c070 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.910+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1829658542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 msgr2=0x55f4c3910820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.910+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3910820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbbac02a900 tx=0x7fbbac02b040 comp rx=0 tx=0).stop 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.910+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1829658542 shutdown_connections 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.910+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c3921890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c3910820 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/1829658542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c39029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1829658542 >> 172.21.15.43:0/1829658542 conn(0x55f4c3550460 msgr2=0x55f4c39167c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1829658542 shutdown_connections 2024-07-26T08:40:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 -- 172.21.15.43:0/1829658542 wait complete. 2024-07-26T08:40:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 -- start start 2024-07-26T08:40:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.911+0000 7fbbc31eb740 1 Processor -- start 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c392c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c392c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c392cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41ad1d0 con 0x55f4c35331b0 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41ae5e0 con 0x55f4c355c070 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41ad840 con 0x55f4c353b390 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbc31eb740 10 client.0 _ll_register_callbacks cb 0x7fbba00a6e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:40:00.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c392c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbb9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c392c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c392c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:43698/0 (socket says 172.21.15.43:43698) 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbb9000640 1 -- 172.21.15.43:0/3867027285 learned_addr learned my addr 172.21.15.43:0/3867027285 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.912+0000 7fbbba400640 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c392cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbb9000640 1 -- 172.21.15.43:0/3867027285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 msgr2=0x55f4c392cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbb9000640 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c392cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbb9000640 1 -- 172.21.15.43:0/3867027285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 msgr2=0x55f4c392c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbb9000640 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c392c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbb9000640 1 -- 172.21.15.43:0/3867027285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c398d9e0 con 0x55f4c353b390 2024-07-26T08:40:00.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbb9000640 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c392c590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbba00a7030 tx=0x7fbba00aa650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa6308c5ee209733 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbb9b400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbb9b400640 1 -- 172.21.15.43:0/3867027285 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba000ce60 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbb9b400640 1 -- 172.21.15.43:0/3867027285 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 10828+0+0 (secure 0 0 0) 0x7fbba00a9e90 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.913+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbac036040 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbb9b400640 1 -- 172.21.15.43:0/3867027285 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fbba00aa900 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 10 client.26041 fetch_fsmap learned FSMap version 133 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=4+}) -- 0x55f4c398ec70 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbb9b400640 1 -- 172.21.15.43:0/3867027285 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbbac036040 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbb9b400640 1 -- 172.21.15.43:0/3867027285 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 133) ==== 7144+0+0 (secure 0 0 0) 0x7fbba00eb070 con 0x55f4c353b390 2024-07-26T08:40:00.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 10 client.26041 fetch_fsmap finished waiting for FSMap version 133 2024-07-26T08:40:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 10 client.26041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:40:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 20 client.26041 populate_metadata read hostname 'smithi043' 2024-07-26T08:40:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c34efda0 0x55f4c3991370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 4 client.26041 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:40:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f4c38755b0 con 0x55f4c34efda0 2024-07-26T08:40:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.914+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c34efda0 0x55f4c3991370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.915+0000 7fbbb9a00640 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c34efda0 0x55f4c3991370 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc640b6ae6dd119 server_cookie=2c21702fde13ae71 in_seq=0 out_seq=0 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.915+0000 7fbb9b400640 10 client.26041 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.915+0000 7fbb9b400640 1 -- 172.21.15.43:0/3867027285 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55f4c38755b0 con 0x55f4c34efda0 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.915+0000 7fbb9b400640 10 client.26041 handle_command_reply: tid=0 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.915+0000 7fbbc31eb740 1 client.26041 shutdown 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.915+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 msgr2=0x55f4c392c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c392c590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbba00a7030 tx=0x7fbba00aa650 comp rx=0 tx=0).stop 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 shutdown_connections 2024-07-26T08:40:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55f4c34efda0 0x55f4c3991370 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4c353b390 0x55f4c392c590 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f4c355c070 0x55f4c392cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 --2- 172.21.15.43:0/3867027285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4c35331b0 0x55f4c392c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbb9b400640 0 client.26041 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 >> 172.21.15.43:0/3867027285 conn(0x55f4c3550460 msgr2=0x55f4c3904890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 shutdown_connections 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 1 -- 172.21.15.43:0/3867027285 wait complete. 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.916+0000 7fbbc31eb740 20 client.26041 trim_cache size 0 max 16384 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:40:00.922 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:40:00.923 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbb9c0b3d40 msgr2=0x7fbb9c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbb9c0b3d40 0x7fbb9c0b6250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55f4c38ffc80 tx=0x7fbba8005f90 comp rx=0 tx=0).stop 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 msgr2=0x7fbbb419c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 0x7fbbb419c550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbba000e9f0 tx=0x7fbba000eeb0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 shutdown_connections 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fbb9c0b3d40 0x7fbb9c0b6250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb410af10 0x7fbbb419c550 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbb410b860 0x7fbbb41a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 --2- 172.21.15.43:0/3394925035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbb41055d0 0x7fbbb419bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 >> 172.21.15.43:0/3394925035 conn(0x7fbbb4101040 msgr2=0x7fbbb4109510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 shutdown_connections 2024-07-26T08:40:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:00.917+0000 7fbbbae00640 1 -- 172.21.15.43:0/3394925035 wait complete. 2024-07-26T08:40:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 262.196764 secs 2024-07-26T08:40:01.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 262.196764 secs 2024-07-26T08:40:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 262.196764 secs 2024-07-26T08:40:01.946 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:40:02.038 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:01 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:40:02.038 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:01 smithi133 systemd[1]: Stopped Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:02.038 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:01 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 2.087s CPU time. 2024-07-26T08:40:02.038 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:01 smithi133 systemd[1]: Starting Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:40:02.039 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:01 smithi133 podman[72889]: 2024-07-26 08:40:01.895097939 +0000 UTC m=+0.017208542 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:40:02.039 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 podman[72889]: 2024-07-26 08:40:02.037851285 +0000 UTC m=+0.159961874 container create 39d9fed90aa836e2cb63054e8215922e9c8b53bb454849463dc46ae036ca33d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-07-26T08:40:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: pgmap v707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 173 B/s wr, 9 op/s 2024-07-26T08:40:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: daemon mds.l restarted 2024-07-26T08:40:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:40:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: osdmap e107: 12 total, 12 up, 12 in 2024-07-26T08:40:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:boot 2024-07-26T08:40:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:40:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:02 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 podman[72889]: 2024-07-26 08:40:02.315721396 +0000 UTC m=+0.437831985 container init 39d9fed90aa836e2cb63054e8215922e9c8b53bb454849463dc46ae036ca33d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 podman[72889]: 2024-07-26 08:40:02.318297321 +0000 UTC m=+0.440407921 container start 39d9fed90aa836e2cb63054e8215922e9c8b53bb454849463dc46ae036ca33d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mds[72908]: -- 172.21.15.133:0/2901903393 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56157cd47860 con 0x561580ee9180 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: starting mds.l at 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 bash[72889]: 39d9fed90aa836e2cb63054e8215922e9c8b53bb454849463dc46ae036ca33d1 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:02 smithi133 systemd[1]: Started Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: pgmap v707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 173 B/s wr, 9 op/s 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: daemon mds.l restarted 2024-07-26T08:40:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:40:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: osdmap e107: 12 total, 12 up, 12 in 2024-07-26T08:40:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:boot 2024-07-26T08:40:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:40:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:02 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: pgmap v707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 173 B/s wr, 9 op/s 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: daemon mds.l restarted 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: osdmap e107: 12 total, 12 up, 12 in 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:boot 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:02 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:04.740 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:04 smithi043 ceph-mon[32384]: pgmap v709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-07-26T08:40:04.741 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:04 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:resolve 2024-07-26T08:40:04.741 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:04 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:04 smithi133 ceph-mon[37053]: pgmap v709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-07-26T08:40:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:04 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:resolve 2024-07-26T08:40:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:04 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:04.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:04 smithi063 ceph-mon[36747]: pgmap v709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-07-26T08:40:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:04 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:resolve 2024-07-26T08:40:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:04 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:05 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00099999 2024-07-26T08:40:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:05 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:reconnect 2024-07-26T08:40:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:05 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:05 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00799992 2024-07-26T08:40:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 251.709500 secs 2024-07-26T08:40:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:05 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00099999 2024-07-26T08:40:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:05 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:reconnect 2024-07-26T08:40:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:05 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:05 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00799992 2024-07-26T08:40:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 251.709500 secs 2024-07-26T08:40:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:05 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00099999 2024-07-26T08:40:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:05 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:reconnect 2024-07-26T08:40:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:05 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:05 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00799992 2024-07-26T08:40:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 251.709500 secs 2024-07-26T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-mon[36747]: pgmap v710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 267.196871 secs 2024-07-26T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:rejoin 2024-07-26T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-mon[36747]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: *** Caught signal (Aborted) ** 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: in thread 7f53e0454640 thread_name:ms_dispatch 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53e582b6f0] 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f53e587894c] 2024-07-26T08:40:06.819 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 3: raise() 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 4: abort() 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 5: /lib64/libc.so.6(+0x2871b) [0x7f53e581571b] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 6: /lib64/libc.so.6(+0x37386) [0x7f53e5824386] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56386c51d6b9] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56386c6db80c] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56386c61b2ca] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56386c5eb753] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56386c5eca1b] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56386c5d0752] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56386c51ea56] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56386c522637] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56386c522f5e] 2024-07-26T08:40:06.820 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56386c50603a] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f53e60f8407] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 18: (DispatchQueue::entry()+0x60f) [0x7f53e60f8cf9] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f53e61d55a1] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 20: (Thread::entry_wrapper()+0x43) [0x7f53e5f82cdd] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 21: (Thread::_entry_func(void*)+0xd) [0x7f53e5f82cf9] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 22: /lib64/libc.so.6(+0x89c02) [0x7f53e5876c02] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f53e58fbc40] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.540+0000 7f53e0454640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: in thread 7f53e0454640 thread_name:ms_dispatch 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53e582b6f0] 2024-07-26T08:40:06.821 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f53e587894c] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 3: raise() 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 4: abort() 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 5: /lib64/libc.so.6(+0x2871b) [0x7f53e581571b] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 6: /lib64/libc.so.6(+0x37386) [0x7f53e5824386] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56386c51d6b9] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56386c6db80c] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56386c61b2ca] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56386c5eb753] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56386c5eca1b] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56386c5d0752] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56386c51ea56] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56386c522637] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56386c522f5e] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56386c50603a] 2024-07-26T08:40:06.822 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f53e60f8407] 2024-07-26T08:40:06.823 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 18: (DispatchQueue::entry()+0x60f) [0x7f53e60f8cf9] 2024-07-26T08:40:06.823 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f53e61d55a1] 2024-07-26T08:40:06.823 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 20: (Thread::entry_wrapper()+0x43) [0x7f53e5f82cdd] 2024-07-26T08:40:06.823 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 21: (Thread::_entry_func(void*)+0xd) [0x7f53e5f82cf9] 2024-07-26T08:40:06.823 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 22: /lib64/libc.so.6(+0x89c02) [0x7f53e5876c02] 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f53e58fbc40] 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 0> 2024-07-26T08:40:06.540+0000 7f53e0454640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: in thread 7f53e0454640 thread_name:ms_dispatch 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53e582b6f0] 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f53e587894c] 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 3: raise() 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 4: abort() 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 5: /lib64/libc.so.6(+0x2871b) [0x7f53e581571b] 2024-07-26T08:40:06.824 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 6: /lib64/libc.so.6(+0x37386) [0x7f53e5824386] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56386c51d6b9] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56386c6db80c] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56386c61b2ca] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56386c5eb753] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56386c5eca1b] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56386c5d0752] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56386c51ea56] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56386c522637] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56386c522f5e] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56386c50603a] 2024-07-26T08:40:06.825 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f53e60f8407] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 18: (DispatchQueue::entry()+0x60f) [0x7f53e60f8cf9] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f53e61d55a1] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 20: (Thread::entry_wrapper()+0x43) [0x7f53e5f82cdd] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 21: (Thread::_entry_func(void*)+0xd) [0x7f53e5f82cf9] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 22: /lib64/libc.so.6(+0x89c02) [0x7f53e5876c02] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f53e58fbc40] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 0> 2024-07-26T08:40:06.540+0000 7f53e0454640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: in thread 7f53e0454640 thread_name:ms_dispatch 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53e582b6f0] 2024-07-26T08:40:06.826 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f53e587894c] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 3: raise() 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 4: abort() 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 5: /lib64/libc.so.6(+0x2871b) [0x7f53e581571b] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 6: /lib64/libc.so.6(+0x37386) [0x7f53e5824386] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56386c51d6b9] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56386c6db80c] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56386c61b2ca] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56386c5eb753] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56386c5eca1b] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56386c5d0752] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56386c51ea56] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56386c522637] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56386c522f5e] 2024-07-26T08:40:06.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56386c50603a] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f53e60f8407] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 18: (DispatchQueue::entry()+0x60f) [0x7f53e60f8cf9] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f53e61d55a1] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 20: (Thread::entry_wrapper()+0x43) [0x7f53e5f82cdd] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 21: (Thread::_entry_func(void*)+0xd) [0x7f53e5f82cf9] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 22: /lib64/libc.so.6(+0x89c02) [0x7f53e5876c02] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f53e58fbc40] 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73257]: 2024-07-26T08:40:06.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:06 smithi063 podman[73875]: 2024-07-26 08:40:06.601456705 +0000 UTC m=+0.020354272 container died d4fab6c2bd26c77687878b55d10a8b851e233ee267b85b7ab6d07496a4caebac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T08:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:06 smithi043 ceph-mon[32384]: pgmap v710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 267.196871 secs 2024-07-26T08:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:06 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:rejoin 2024-07-26T08:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:06 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:06 smithi043 ceph-mon[32384]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:40:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:06 smithi133 ceph-mon[37053]: pgmap v710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 267.196871 secs 2024-07-26T08:40:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:06 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:rejoin 2024-07-26T08:40:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:06 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:06 smithi133 ceph-mon[37053]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:40:07.556 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:07 smithi063 podman[73875]: 2024-07-26 08:40:07.292632189 +0000 UTC m=+0.711529784 container remove d4fab6c2bd26c77687878b55d10a8b851e233ee267b85b7ab6d07496a4caebac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724) 2024-07-26T08:40:07.556 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:07 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:40:07.556 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:07 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:07.556 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:active 2024-07-26T08:40:07.556 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:07 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:07.557 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:07 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:07.818 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:07 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:40:07.818 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:07 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 2.056s CPU time. 2024-07-26T08:40:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:07 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:active 2024-07-26T08:40:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:07 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:07 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:07 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/847478222,v1:172.21.15.63:6835/847478222] up:active 2024-07-26T08:40:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:07 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:07 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:08 smithi063 ceph-mon[36747]: pgmap v711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:08 smithi043 ceph-mon[32384]: pgmap v711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:08 smithi133 ceph-mon[37053]: pgmap v711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:10 smithi063 ceph-mon[36747]: pgmap v712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 256.709620 secs 2024-07-26T08:40:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 272.196958 secs 2024-07-26T08:40:10.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:10 smithi043 ceph-mon[32384]: pgmap v712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:10.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 256.709620 secs 2024-07-26T08:40:10.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 272.196958 secs 2024-07-26T08:40:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:10 smithi133 ceph-mon[37053]: pgmap v712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 256.709620 secs 2024-07-26T08:40:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 272.196958 secs 2024-07-26T08:40:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:12 smithi063 ceph-mon[36747]: pgmap v713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:12.925 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:12 smithi043 ceph-mon[32384]: pgmap v713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:12 smithi133 ceph-mon[37053]: pgmap v713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:14 smithi063 ceph-mon[36747]: pgmap v714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 194 B/s wr, 11 op/s 2024-07-26T08:40:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:14 smithi043 ceph-mon[32384]: pgmap v714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 194 B/s wr, 11 op/s 2024-07-26T08:40:15.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:14 smithi133 ceph-mon[37053]: pgmap v714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 194 B/s wr, 11 op/s 2024-07-26T08:40:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 261.709753 secs 2024-07-26T08:40:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 277.197054 secs 2024-07-26T08:40:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 261.709753 secs 2024-07-26T08:40:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 277.197054 secs 2024-07-26T08:40:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 261.709753 secs 2024-07-26T08:40:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 277.197054 secs 2024-07-26T08:40:16.893 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:16 smithi043 ceph-mon[32384]: pgmap v715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:16 smithi133 ceph-mon[37053]: pgmap v715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:17.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:16 smithi063 ceph-mon[36747]: pgmap v715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:17.827 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:17 smithi063 ceph-mon[36747]: pgmap v716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:17.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:17 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:40:17.827 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:17 smithi063 systemd[1]: Stopped Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:17.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:17 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 2.056s CPU time. 2024-07-26T08:40:17.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:17 smithi063 systemd[1]: Starting Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:40:17.828 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:17 smithi063 podman[73968]: 2024-07-26 08:40:17.718055534 +0000 UTC m=+0.018390873 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:40:17.926 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:17 smithi043 ceph-mon[32384]: pgmap v716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:17 smithi133 ceph-mon[37053]: pgmap v716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:18.088 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:17 smithi063 podman[73968]: 2024-07-26 08:40:17.826756575 +0000 UTC m=+0.127091894 container create b7f1ebd1d2d08f3195e3bb9a258232da7aaec03a505e68f2bc6ed4066c32c71f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-07-26T08:40:18.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:18 smithi063 podman[73968]: 2024-07-26 08:40:18.088035356 +0000 UTC m=+0.388370697 container init b7f1ebd1d2d08f3195e3bb9a258232da7aaec03a505e68f2bc6ed4066c32c71f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:40:18.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:18 smithi063 podman[73968]: 2024-07-26 08:40:18.091182663 +0000 UTC m=+0.391517984 container start b7f1ebd1d2d08f3195e3bb9a258232da7aaec03a505e68f2bc6ed4066c32c71f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-07-26T08:40:18.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mds[73995]: -- 172.21.15.63:0/3411926986 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b008c1860 con 0x560b04a63180 2024-07-26T08:40:18.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: starting mds.e at 2024-07-26T08:40:18.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:18 smithi063 bash[73968]: b7f1ebd1d2d08f3195e3bb9a258232da7aaec03a505e68f2bc6ed4066c32c71f 2024-07-26T08:40:18.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:18 smithi063 systemd[1]: Started Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: daemon mds.e restarted 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: osdmap e108: 12 total, 12 up, 12 in 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:boot 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:18.851 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:18 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: daemon mds.e restarted 2024-07-26T08:40:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: osdmap e108: 12 total, 12 up, 12 in 2024-07-26T08:40:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:boot 2024-07-26T08:40:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:40:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:40:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:18 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:19.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: daemon mds.e restarted 2024-07-26T08:40:19.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: osdmap e108: 12 total, 12 up, 12 in 2024-07-26T08:40:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:boot 2024-07-26T08:40:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:40:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:40:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:18 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:20.405 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:20 smithi043 ceph-mon[32384]: pgmap v718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:20.406 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:20 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:resolve 2024-07-26T08:40:20.406 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:20 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:20 smithi133 ceph-mon[37053]: pgmap v718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:20 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:resolve 2024-07-26T08:40:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:20 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:20 smithi063 ceph-mon[36747]: pgmap v718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:20 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:resolve 2024-07-26T08:40:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:20 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 266.709894 secs 2024-07-26T08:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:21 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:21 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:reconnect 2024-07-26T08:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:21 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:21 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999982 2024-07-26T08:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 282.197150 secs 2024-07-26T08:40:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 266.709894 secs 2024-07-26T08:40:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:21 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:40:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:21 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:reconnect 2024-07-26T08:40:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:21 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:21 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999982 2024-07-26T08:40:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 282.197150 secs 2024-07-26T08:40:21.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 266.709894 secs 2024-07-26T08:40:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:21 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:40:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:21 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:reconnect 2024-07-26T08:40:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:21 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:21 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999982 2024-07-26T08:40:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 282.197150 secs 2024-07-26T08:40:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:22 smithi043 ceph-mon[32384]: pgmap v719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:22 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:rejoin 2024-07-26T08:40:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:22 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:22 smithi043 ceph-mon[32384]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:40:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-mon[37053]: pgmap v719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:rejoin 2024-07-26T08:40:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-mon[37053]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:40:22.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:40:22.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: *** Caught signal (Aborted) ** 2024-07-26T08:40:22.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: in thread 7f0802761640 thread_name:ms_dispatch 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0807b386f0] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f0807b8594c] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 3: raise() 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 4: abort() 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 5: /lib64/libc.so.6(+0x2871b) [0x7f0807b2271b] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 6: /lib64/libc.so.6(+0x37386) [0x7f0807b31386] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56157bb086b9] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56157bcc680c] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56157bc062ca] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56157bbd6753] 2024-07-26T08:40:22.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56157bbd7a1b] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56157bbbb752] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56157bb09a56] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56157bb0d637] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56157bb0df5e] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56157baf103a] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f0808405407] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 18: (DispatchQueue::entry()+0x60f) [0x7f0808405cf9] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f08084e25a1] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 20: (Thread::entry_wrapper()+0x43) [0x7f080828fcdd] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 21: (Thread::_entry_func(void*)+0xd) [0x7f080828fcf9] 2024-07-26T08:40:22.518 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 22: /lib64/libc.so.6(+0x89c02) [0x7f0807b83c02] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f0807c08c40] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.193+0000 7f0802761640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: in thread 7f0802761640 thread_name:ms_dispatch 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0807b386f0] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f0807b8594c] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 3: raise() 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 4: abort() 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 5: /lib64/libc.so.6(+0x2871b) [0x7f0807b2271b] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 6: /lib64/libc.so.6(+0x37386) [0x7f0807b31386] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56157bb086b9] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56157bcc680c] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56157bc062ca] 2024-07-26T08:40:22.519 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56157bbd6753] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56157bbd7a1b] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56157bbbb752] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56157bb09a56] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56157bb0d637] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56157bb0df5e] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56157baf103a] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f0808405407] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 18: (DispatchQueue::entry()+0x60f) [0x7f0808405cf9] 2024-07-26T08:40:22.520 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f08084e25a1] 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 20: (Thread::entry_wrapper()+0x43) [0x7f080828fcdd] 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 21: (Thread::_entry_func(void*)+0xd) [0x7f080828fcf9] 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 22: /lib64/libc.so.6(+0x89c02) [0x7f0807b83c02] 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f0807c08c40] 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 0> 2024-07-26T08:40:22.193+0000 7f0802761640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: in thread 7f0802761640 thread_name:ms_dispatch 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:22.521 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0807b386f0] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f0807b8594c] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 3: raise() 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 4: abort() 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 5: /lib64/libc.so.6(+0x2871b) [0x7f0807b2271b] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 6: /lib64/libc.so.6(+0x37386) [0x7f0807b31386] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56157bb086b9] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56157bcc680c] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56157bc062ca] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56157bbd6753] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56157bbd7a1b] 2024-07-26T08:40:22.522 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56157bbbb752] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56157bb09a56] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56157bb0d637] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56157bb0df5e] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56157baf103a] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f0808405407] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 18: (DispatchQueue::entry()+0x60f) [0x7f0808405cf9] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f08084e25a1] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 20: (Thread::entry_wrapper()+0x43) [0x7f080828fcdd] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 21: (Thread::_entry_func(void*)+0xd) [0x7f080828fcf9] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 22: /lib64/libc.so.6(+0x89c02) [0x7f0807b83c02] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f0807c08c40] 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 0> 2024-07-26T08:40:22.193+0000 7f0802761640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: in thread 7f0802761640 thread_name:ms_dispatch 2024-07-26T08:40:22.523 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0807b386f0] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f0807b8594c] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 3: raise() 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 4: abort() 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 5: /lib64/libc.so.6(+0x2871b) [0x7f0807b2271b] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 6: /lib64/libc.so.6(+0x37386) [0x7f0807b31386] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56157bb086b9] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56157bcc680c] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56157bc062ca] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56157bbd6753] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56157bbd7a1b] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56157bbbb752] 2024-07-26T08:40:22.524 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56157bb09a56] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56157bb0d637] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56157bb0df5e] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56157baf103a] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f0808405407] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 18: (DispatchQueue::entry()+0x60f) [0x7f0808405cf9] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f08084e25a1] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 20: (Thread::entry_wrapper()+0x43) [0x7f080828fcdd] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 21: (Thread::_entry_func(void*)+0xd) [0x7f080828fcf9] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 22: /lib64/libc.so.6(+0x89c02) [0x7f0807b83c02] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f0807c08c40] 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[72904]: 2024-07-26T08:40:22.525 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 podman[72943]: 2024-07-26 08:40:22.253906923 +0000 UTC m=+0.018536476 container died 39d9fed90aa836e2cb63054e8215922e9c8b53bb454849463dc46ae036ca33d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-07-26T08:40:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:22 smithi063 ceph-mon[36747]: pgmap v719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:40:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:22 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:rejoin 2024-07-26T08:40:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:22 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:22 smithi063 ceph-mon[36747]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:40:23.154 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 podman[72943]: 2024-07-26 08:40:22.902837185 +0000 UTC m=+0.667466739 container remove 39d9fed90aa836e2cb63054e8215922e9c8b53bb454849463dc46ae036ca33d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-07-26T08:40:23.155 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:22 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:40:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:23 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:23 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:active 2024-07-26T08:40:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:23 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:23 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:23.515 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:23 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:40:23.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:23 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.862s CPU time. 2024-07-26T08:40:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:23 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:23 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:active 2024-07-26T08:40:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:23 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:23 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:23.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:23 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:23 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4203458458,v1:172.21.15.133:6833/4203458458] up:active 2024-07-26T08:40:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:23 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:23 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:24 smithi043 ceph-mon[32384]: pgmap v720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:24 smithi133 ceph-mon[37053]: pgmap v720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:24.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:24 smithi063 ceph-mon[36747]: pgmap v720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:40:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 271.710032 secs 2024-07-26T08:40:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 271.710032 secs 2024-07-26T08:40:25.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 271.710032 secs 2024-07-26T08:40:26.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:26 smithi043 ceph-mon[32384]: pgmap v721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:40:26.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 287.197251 secs 2024-07-26T08:40:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:26 smithi133 ceph-mon[37053]: pgmap v721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:40:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 287.197251 secs 2024-07-26T08:40:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:26 smithi063 ceph-mon[36747]: pgmap v721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:40:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 287.197251 secs 2024-07-26T08:40:28.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:28 smithi043 ceph-mon[32384]: pgmap v722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:28 smithi133 ceph-mon[37053]: pgmap v722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:28 smithi063 ceph-mon[36747]: pgmap v722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:30 smithi133 ceph-mon[37053]: pgmap v723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 190 B/s wr, 10 op/s 2024-07-26T08:40:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 276.710179 secs 2024-07-26T08:40:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:30 smithi063 ceph-mon[36747]: pgmap v723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 190 B/s wr, 10 op/s 2024-07-26T08:40:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 276.710179 secs 2024-07-26T08:40:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:30 smithi043 ceph-mon[32384]: pgmap v723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 190 B/s wr, 10 op/s 2024-07-26T08:40:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 276.710179 secs 2024-07-26T08:40:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 292.197340 secs 2024-07-26T08:40:31.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 292.197340 secs 2024-07-26T08:40:31.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 292.197340 secs 2024-07-26T08:40:31.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:40:32.470 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:40:32.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:32 smithi043 ceph-mon[32384]: pgmap v724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:32 smithi133 ceph-mon[37053]: pgmap v724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:32 smithi063 ceph-mon[36747]: pgmap v724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:33.546 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:40:33.547 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 systemd[1]: Stopped Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:33.547 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.862s CPU time. 2024-07-26T08:40:33.547 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 systemd[1]: Starting Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:40:33.547 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 podman[73048]: 2024-07-26 08:40:33.402720364 +0000 UTC m=+0.018384051 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:40:33.547 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 podman[73048]: 2024-07-26 08:40:33.545457795 +0000 UTC m=+0.161121469 container create 6e922748fc345cf303c723cbd799f8de9eab726d279ca7029a2e4b574815b5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T08:40:33.808 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 podman[73048]: 2024-07-26 08:40:33.77336761 +0000 UTC m=+0.389031283 container init 6e922748fc345cf303c723cbd799f8de9eab726d279ca7029a2e4b574815b5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=) 2024-07-26T08:40:33.808 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 podman[73048]: 2024-07-26 08:40:33.776140231 +0000 UTC m=+0.391803918 container start 6e922748fc345cf303c723cbd799f8de9eab726d279ca7029a2e4b574815b5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:40:34.255 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 ceph-mds[73067]: -- 172.21.15.133:0/2307388069 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557262dd1860 con 0x557266f73a80 2024-07-26T08:40:34.255 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: starting mds.l at 2024-07-26T08:40:34.255 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 bash[73048]: 6e922748fc345cf303c723cbd799f8de9eab726d279ca7029a2e4b574815b5ce 2024-07-26T08:40:34.255 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:33 smithi133 systemd[1]: Started Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: pgmap v725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:40:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: daemon mds.l restarted 2024-07-26T08:40:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:40:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: osdmap e109: 12 total, 12 up, 12 in 2024-07-26T08:40:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:boot 2024-07-26T08:40:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:40:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:34 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: pgmap v725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:40:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: daemon mds.l restarted 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: osdmap e109: 12 total, 12 up, 12 in 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:boot 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:34 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:34.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: pgmap v725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:40:34.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: daemon mds.l restarted 2024-07-26T08:40:34.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:34.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:40:34.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: osdmap e109: 12 total, 12 up, 12 in 2024-07-26T08:40:34.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:boot 2024-07-26T08:40:34.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:40:34.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:34.571 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:34 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3894218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c1057e0 msgr2=0x7fe79c105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3894218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c1057e0 0x7fe79c105bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009900 tx=0x7fe78c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3894218043 shutdown_connections 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3894218043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c10b120 0x7fe79c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3894218043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe79c10ba70 0x7fe79c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3894218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c1057e0 0x7fe79c105bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3894218043 >> 172.21.15.43:0/3894218043 conn(0x7fe79c1011f0 msgr2=0x7fe79c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3894218043 shutdown_connections 2024-07-26T08:40:35.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.240+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3894218043 wait complete. 2024-07-26T08:40:35.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.241+0000 7fe7a2c00640 1 Processor -- start 2024-07-26T08:40:35.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 -- start start 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c10b120 0x7fe79c19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 0x7fe79c19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe79c1a1ba0 0x7fe79c1a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c115870 con 0x7fe79c10ba70 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1156f0 con 0x7fe79c1a1ba0 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.242+0000 7fe7a2c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1159f0 con 0x7fe79c10b120 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 0x7fe79c19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 0x7fe79c19c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40334/0 (socket says 172.21.15.43:40334) 2024-07-26T08:40:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 -- 172.21.15.43:0/3794750097 learned_addr learned my addr 172.21.15.43:0/3794750097 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79be00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c10b120 0x7fe79c19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe79c1a1ba0 0x7fe79c1a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 -- 172.21.15.43:0/3794750097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c10b120 msgr2=0x7fe79c19c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c10b120 0x7fe79c19c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 -- 172.21.15.43:0/3794750097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe79c1a1ba0 msgr2=0x7fe79c1a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe79c1a1ba0 0x7fe79c1a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.243+0000 7fe79b400640 1 -- 172.21.15.43:0/3794750097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c1a2780 con 0x7fe79c10ba70 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.244+0000 7fe79b400640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 0x7fe79c19c9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe78800e9c0 tx=0x7fe78800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.244+0000 7fe798c00640 1 -- 172.21.15.43:0/3794750097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78800ccc0 con 0x7fe79c10ba70 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.244+0000 7fe798c00640 1 -- 172.21.15.43:0/3794750097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7880054f0 con 0x7fe79c10ba70 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.244+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c1a8d20 con 0x7fe79c10ba70 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.244+0000 7fe798c00640 1 -- 172.21.15.43:0/3794750097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788010430 con 0x7fe79c10ba70 2024-07-26T08:40:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.244+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a9120 con 0x7fe79c10ba70 2024-07-26T08:40:35.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.248+0000 7fe7a9879740 1 Processor -- start 2024-07-26T08:40:35.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.248+0000 7fe7a9879740 1 -- start start 2024-07-26T08:40:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a1ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 0x555c63a1d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a1d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a9879740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c63993bc0 con 0x555c6364f1b0 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a9879740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555c639830c0 con 0x555c63657390 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a9879740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x555c63987100 con 0x555c63678070 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 0x555c63a1d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 0x555c63a1d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40346/0 (socket says 172.21.15.43:40346) 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 -- 172.21.15.43:0/1755849267 learned_addr learned my addr 172.21.15.43:0/1755849267 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a1ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe798c00640 1 -- 172.21.15.43:0/3794750097 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe7880046c0 con 0x7fe79c10ba70 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 -- 172.21.15.43:0/1755849267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 msgr2=0x555c63a1ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a1ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 -- 172.21.15.43:0/1755849267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 msgr2=0x555c63a1d8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.249+0000 7fe79be00640 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a1d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.250+0000 7fe79be00640 1 -- 172.21.15.43:0/1755849267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c636e3650 con 0x555c6364f1b0 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.250+0000 7fe79be00640 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 0x555c63a1d360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009230 tx=0x7fe78c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a77e4e6c0cb1f0c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.250+0000 7fe791200640 1 -- 172.21.15.43:0/1755849267 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c040070 con 0x555c6364f1b0 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.250+0000 7fe791200640 1 -- 172.21.15.43:0/1755849267 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe78c031e40 con 0x555c6364f1b0 2024-07-26T08:40:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.250+0000 7fe791200640 1 -- 172.21.15.43:0/1755849267 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c035040 con 0x555c6364f1b0 2024-07-26T08:40:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.251+0000 7fe798c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe7800b3d40 0x7fe7800b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.251+0000 7fe7a9879740 1 -- 172.21.15.43:0/1755849267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 msgr2=0x555c63a1d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.251+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 0x555c63a1d360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009230 tx=0x7fe78c005e80 comp rx=0 tx=0).stop 2024-07-26T08:40:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe798c00640 1 -- 172.21.15.43:0/3794750097 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 11086+0+0 (secure 0 0 0) 0x7fe7880e4d40 con 0x7fe79c10ba70 2024-07-26T08:40:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 -- 172.21.15.43:0/1755849267 shutdown_connections 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a1d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c6364f1b0 0x555c63a1d360 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1755849267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a1ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 -- 172.21.15.43:0/1755849267 >> 172.21.15.43:0/1755849267 conn(0x555c6366c460 msgr2=0x555c63a1ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe7800b3d40 0x7fe7800b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 -- 172.21.15.43:0/1755849267 shutdown_connections 2024-07-26T08:40:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.252+0000 7fe7a9879740 1 -- 172.21.15.43:0/1755849267 wait complete. 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 -- start start 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe7800b3d40 0x7fe7800b6250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe794005fd0 tx=0x7fe794009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 Processor -- start 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a31410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63678070 0x555c63a36a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c637e6700 con 0x555c63657390 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555c6391f690 con 0x555c63678070 2024-07-26T08:40:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.253+0000 7fe7a9879740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x555c63a2b5a0 con 0x555c6364f1b0 2024-07-26T08:40:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a9879740 10 client.0 _ll_register_callbacks cb 0x555c6392f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe79b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe79be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a31410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a0c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63678070 0x555c63a36a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe79b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40362/0 (socket says 172.21.15.43:40362) 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe79b400640 1 -- 172.21.15.43:0/1205585955 learned_addr learned my addr 172.21.15.43:0/1205585955 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a0c00640 1 -- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 msgr2=0x555c63a31410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a31410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a0c00640 1 -- 172.21.15.43:0/1205585955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 msgr2=0x555c63a319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.254+0000 7fe7a0c00640 1 -- 172.21.15.43:0/1205585955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c63936830 con 0x555c63678070 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63678070 0x555c63a36a10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe794011db0 tx=0x7fe794004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baee0e27da115c7f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe785600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:40:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe785600640 1 -- 172.21.15.43:0/1205585955 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794004b20 con 0x555c63678070 2024-07-26T08:40:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c63995b10 con 0x555c63678070 2024-07-26T08:40:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe785600640 1 -- 172.21.15.43:0/1205585955 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 11086+0+0 (secure 0 0 0) 0x7fe794004cc0 con 0x555c63678070 2024-07-26T08:40:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe785600640 1 -- 172.21.15.43:0/1205585955 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7fe79400f810 con 0x555c63678070 2024-07-26T08:40:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe7a9879740 10 client.26066 fetch_fsmap learned FSMap version 150 2024-07-26T08:40:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.255+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=4+}) -- 0x555c63a3fa10 con 0x555c63678070 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe785600640 1 -- 172.21.15.43:0/1205585955 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x555c63995b10 con 0x555c63678070 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe785600640 1 -- 172.21.15.43:0/1205585955 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 150) ==== 7148+0+0 (secure 0 0 0) 0x7fe794026070 con 0x555c63678070 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe7a9879740 10 client.26066 fetch_fsmap finished waiting for FSMap version 150 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe7a9879740 10 client.26066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe7a9879740 20 client.26066 populate_metadata read hostname 'smithi043' 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c636369f0 0x555c63a431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe7a9879740 4 client.26066 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.256+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c639915b0 con 0x555c636369f0 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.257+0000 7fe79be00640 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c636369f0 0x555c63a431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.257+0000 7fe79be00640 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c636369f0 0x555c63a431e0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153a730b8bc47b40 server_cookie=6511e78ae0aa7d73 in_seq=0 out_seq=0 2024-07-26T08:40:35.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.257+0000 7fe785600640 10 client.26066 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.258+0000 7fe785600640 1 -- 172.21.15.43:0/1205585955 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c639915b0 con 0x555c636369f0 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.258+0000 7fe785600640 10 client.26066 handle_command_reply: tid=0 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.258+0000 7fe7a9879740 1 client.26066 shutdown 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63678070 msgr2=0x555c63a36a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63678070 0x555c63a36a10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe794011db0 tx=0x7fe794004ab0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 shutdown_connections 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c636369f0 0x555c63a431e0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63678070 0x555c63a36a10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 --2- 172.21.15.43:0/1205585955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a31410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe785600640 0 client.26066 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 >> 172.21.15.43:0/1205585955 conn(0x555c6366c460 msgr2=0x555c63a1ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 shutdown_connections 2024-07-26T08:40:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 1 -- 172.21.15.43:0/1205585955 wait complete. 2024-07-26T08:40:35.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.259+0000 7fe7a9879740 20 client.26066 trim_cache size 0 max 16384 2024-07-26T08:40:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.278+0000 7fe7a9879740 1 Processor -- start 2024-07-26T08:40:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.278+0000 7fe7a9879740 1 -- start start 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 0x555c63a2c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a3d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a32e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a9879740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b1010 con 0x555c63657390 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a9879740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b16e0 con 0x555c6364f1b0 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a9879740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1af6e0 con 0x555c63678070 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe79b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a3d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe79be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 0x555c63a2c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe79be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 0x555c63a2c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46324/0 (socket says 172.21.15.43:46324) 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe79be00640 1 -- 172.21.15.43:0/3495033938 learned_addr learned my addr 172.21.15.43:0/3495033938 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe79b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a3d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40368/0 (socket says 172.21.15.43:40368) 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.279+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a32e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe79be00640 1 -- 172.21.15.43:0/3495033938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 msgr2=0x555c63a32e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe79be00640 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a32e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe79be00640 1 -- 172.21.15.43:0/3495033938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 msgr2=0x555c63a3d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe79be00640 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a3d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe79be00640 1 -- 172.21.15.43:0/3495033938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c63a1f110 con 0x555c6364f1b0 2024-07-26T08:40:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe79be00640 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 0x555c63a2c7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009900 tx=0x7fe78c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6290058db07ab0bf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.280+0000 7fe787e00640 1 -- 172.21.15.43:0/3495033938 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c040040 con 0x555c6364f1b0 2024-07-26T08:40:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.281+0000 7fe787e00640 1 -- 172.21.15.43:0/3495033938 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe78c0055b0 con 0x555c6364f1b0 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.281+0000 7fe787e00640 1 -- 172.21.15.43:0/3495033938 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c035040 con 0x555c6364f1b0 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.281+0000 7fe7a9879740 1 -- 172.21.15.43:0/3495033938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 msgr2=0x555c63a2c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.281+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 0x555c63a2c7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009900 tx=0x7fe78c009260 comp rx=0 tx=0).stop 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 -- 172.21.15.43:0/3495033938 shutdown_connections 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c63678070 0x555c63a32e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63657390 0x555c63a3d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3495033938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c6364f1b0 0x555c63a2c7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 -- 172.21.15.43:0/3495033938 >> 172.21.15.43:0/3495033938 conn(0x555c6366c460 msgr2=0x555c63a32730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 -- 172.21.15.43:0/3495033938 shutdown_connections 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 -- 172.21.15.43:0/3495033938 wait complete. 2024-07-26T08:40:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 -- start start 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.282+0000 7fe7a9879740 1 Processor -- start 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a35e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63678070 0x555c63a3b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1af010 con 0x555c63678070 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1adc60 con 0x555c63657390 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1ae2b0 con 0x555c6364f1b0 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.283+0000 7fe7a9879740 10 client.0 _ll_register_callbacks cb 0x7fe794003e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a35e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46340/0 (socket says 172.21.15.43:46340) 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a35e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:37068/0 (socket says 172.21.15.43:37068) 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 -- 172.21.15.43:0/3158918282 learned_addr learned my addr 172.21.15.43:0/3158918282 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63678070 0x555c63a3b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 -- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 msgr2=0x555c63a35e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a35e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 -- 172.21.15.43:0/3158918282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63678070 msgr2=0x555c63a3b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63678070 0x555c63a3b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79b400640 1 -- 172.21.15.43:0/3158918282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c63a3b980 con 0x555c63657390 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe79be00640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a35e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.284+0000 7fe7a0c00640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63678070 0x555c63a3b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe79b400640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a363d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7880aac50 tx=0x7fe7880aa6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21b97f592bca009e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:40:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe785600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe785600640 1 -- 172.21.15.43:0/3158918282 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7880c9020 con 0x555c63657390 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe785600640 1 -- 172.21.15.43:0/3158918282 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 11086+0+0 (secure 0 0 0) 0x7fe7880b3d80 con 0x555c63657390 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78c0055b0 con 0x555c63657390 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe785600640 1 -- 172.21.15.43:0/3158918282 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7fe7880ab650 con 0x555c63657390 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe7a9879740 10 client.26072 fetch_fsmap learned FSMap version 150 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.285+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=4+}) -- 0x555c63a3cd80 con 0x555c63657390 2024-07-26T08:40:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe785600640 1 -- 172.21.15.43:0/3158918282 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe78c0055b0 con 0x555c63657390 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe785600640 1 -- 172.21.15.43:0/3158918282 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 150) ==== 7148+0+0 (secure 0 0 0) 0x7fe7880a68c0 con 0x555c63657390 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe7a9879740 10 client.26072 fetch_fsmap finished waiting for FSMap version 150 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe7a9879740 10 client.26072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe7a9879740 20 client.26072 populate_metadata read hostname 'smithi043' 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c6360bda0 0x555c63a3d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe7a9879740 4 client.26072 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c6398ecf0 con 0x555c6360bda0 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.286+0000 7fe79be00640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c6360bda0 0x555c63a3d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.287+0000 7fe785600640 10 client.26072 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.287+0000 7fe79be00640 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c6360bda0 0x555c63a3d530 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c35c0ee29442f08 server_cookie=a5e9783e6e0774f1 in_seq=0 out_seq=0 2024-07-26T08:40:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.287+0000 7fe785600640 1 -- 172.21.15.43:0/3158918282 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x555c6398ecf0 con 0x555c6360bda0 2024-07-26T08:40:35.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.287+0000 7fe785600640 10 client.26072 handle_command_reply: tid=0 2024-07-26T08:40:35.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.287+0000 7fe7a9879740 1 client.26072 shutdown 2024-07-26T08:40:35.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 msgr2=0x555c63a363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a363d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7880aac50 tx=0x7fe7880aa6c0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 shutdown_connections 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555c6360bda0 0x555c63a3d530 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c63678070 0x555c63a3b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555c63657390 0x555c63a363d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 --2- 172.21.15.43:0/3158918282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555c6364f1b0 0x555c63a35e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 >> 172.21.15.43:0/3158918282 conn(0x555c6366c460 msgr2=0x555c63a325e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe785600640 0 client.26072 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 shutdown_connections 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 1 -- 172.21.15.43:0/3158918282 wait complete. 2024-07-26T08:40:35.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.288+0000 7fe7a9879740 20 client.26072 trim_cache size 0 max 16384 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:40:35.293 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe7800b3d40 msgr2=0x7fe7800b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe7800b3d40 0x7fe7800b6250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe794005fd0 tx=0x7fe794009500 comp rx=0 tx=0).stop 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 msgr2=0x7fe79c19c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 0x7fe79c19c9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe78800e9c0 tx=0x7fe78800ee80 comp rx=0 tx=0).stop 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 shutdown_connections 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe7800b3d40 0x7fe7800b6250 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe79c1a1ba0 0x7fe79c1a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe79c10ba70 0x7fe79c19c9c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 --2- 172.21.15.43:0/3794750097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c10b120 0x7fe79c19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:40:35.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.289+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 >> 172.21.15.43:0/3794750097 conn(0x7fe79c1011f0 msgr2=0x7fe79c1098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:40:35.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.290+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 shutdown_connections 2024-07-26T08:40:35.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:40:35.290+0000 7fe7a2c00640 1 -- 172.21.15.43:0/3794750097 wait complete. 2024-07-26T08:40:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:35 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:resolve 2024-07-26T08:40:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:35 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:35 smithi043 ceph-mon[32384]: pgmap v727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:40:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 281.710274 secs 2024-07-26T08:40:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 297.197491 secs 2024-07-26T08:40:36.238 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:40:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:35 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:resolve 2024-07-26T08:40:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:35 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:35 smithi133 ceph-mon[37053]: pgmap v727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:40:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 281.710274 secs 2024-07-26T08:40:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 297.197491 secs 2024-07-26T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:35 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:resolve 2024-07-26T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:35 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:35 smithi063 ceph-mon[36747]: pgmap v727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 281.710274 secs 2024-07-26T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 297.197491 secs 2024-07-26T08:40:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:36 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:40:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:36 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:40:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:36 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:reconnect 2024-07-26T08:40:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:36 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:37.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:36 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:40:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:36 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:40:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:36 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:reconnect 2024-07-26T08:40:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:36 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:36 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299997 2024-07-26T08:40:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:36 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:40:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:36 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:reconnect 2024-07-26T08:40:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:36 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:37 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:rejoin 2024-07-26T08:40:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:37 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:37 smithi043 ceph-mon[32384]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:40:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:37 smithi043 ceph-mon[32384]: pgmap v728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:40:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:37 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:rejoin 2024-07-26T08:40:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:37 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:37 smithi133 ceph-mon[37053]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:40:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:37 smithi133 ceph-mon[37053]: pgmap v728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:40:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:rejoin 2024-07-26T08:40:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-mon[36747]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:40:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-mon[36747]: pgmap v728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: *** Caught signal (Aborted) ** 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: in thread 7f29fa93e640 thread_name:ms_dispatch 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29ffd156f0] 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29ffd6294c] 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 3: raise() 2024-07-26T08:40:38.319 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 4: abort() 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29ffcff71b] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 6: /lib64/libc.so.6(+0x37386) [0x7f29ffd0e386] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560afefcc6b9] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560aff18a80c] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560aff0ca2ca] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560aff09a753] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560aff09ba1b] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560aff07f752] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560afefcda56] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560afefd1637] 2024-07-26T08:40:38.320 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560afefd1f5e] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560afefb503a] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a005e2407] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a005e2cf9] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a006bf5a1] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a0046ccdd] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a0046ccf9] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29ffd60c02] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29ffde5c40] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:37.898+0000 7f29fa93e640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: in thread 7f29fa93e640 thread_name:ms_dispatch 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29ffd156f0] 2024-07-26T08:40:38.321 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29ffd6294c] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 3: raise() 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 4: abort() 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29ffcff71b] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 6: /lib64/libc.so.6(+0x37386) [0x7f29ffd0e386] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560afefcc6b9] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560aff18a80c] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560aff0ca2ca] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560aff09a753] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560aff09ba1b] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560aff07f752] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560afefcda56] 2024-07-26T08:40:38.322 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560afefd1637] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560afefd1f5e] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560afefb503a] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a005e2407] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a005e2cf9] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a006bf5a1] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a0046ccdd] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a0046ccf9] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29ffd60c02] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29ffde5c40] 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 0> 2024-07-26T08:40:37.898+0000 7f29fa93e640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: in thread 7f29fa93e640 thread_name:ms_dispatch 2024-07-26T08:40:38.323 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29ffd156f0] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29ffd6294c] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 3: raise() 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 4: abort() 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29ffcff71b] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 6: /lib64/libc.so.6(+0x37386) [0x7f29ffd0e386] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560afefcc6b9] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560aff18a80c] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560aff0ca2ca] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560aff09a753] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560aff09ba1b] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560aff07f752] 2024-07-26T08:40:38.324 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560afefcda56] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560afefd1637] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560afefd1f5e] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560afefb503a] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a005e2407] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a005e2cf9] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a006bf5a1] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a0046ccdd] 2024-07-26T08:40:38.325 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a0046ccf9] 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29ffd60c02] 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29ffde5c40] 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 0> 2024-07-26T08:40:37.898+0000 7f29fa93e640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: in thread 7f29fa93e640 thread_name:ms_dispatch 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29ffd156f0] 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29ffd6294c] 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 3: raise() 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 4: abort() 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29ffcff71b] 2024-07-26T08:40:38.326 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 6: /lib64/libc.so.6(+0x37386) [0x7f29ffd0e386] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560afefcc6b9] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560aff18a80c] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560aff0ca2ca] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560aff09a753] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560aff09ba1b] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560aff07f752] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560afefcda56] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560afefd1637] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560afefd1f5e] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560afefb503a] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a005e2407] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a005e2cf9] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a006bf5a1] 2024-07-26T08:40:38.327 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a0046ccdd] 2024-07-26T08:40:38.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a0046ccf9] 2024-07-26T08:40:38.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29ffd60c02] 2024-07-26T08:40:38.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29ffde5c40] 2024-07-26T08:40:38.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:38.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[73985]: 2024-07-26T08:40:38.328 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:37 smithi063 podman[74032]: 2024-07-26 08:40:37.959783779 +0000 UTC m=+0.020044428 container died b7f1ebd1d2d08f3195e3bb9a258232da7aaec03a505e68f2bc6ed4066c32c71f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-07-26T08:40:39.139 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:38 smithi063 podman[74032]: 2024-07-26 08:40:38.885129029 +0000 UTC m=+0.945389680 container remove b7f1ebd1d2d08f3195e3bb9a258232da7aaec03a505e68f2bc6ed4066c32c71f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:40:39.140 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:38 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:40:39.140 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:38 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:39.140 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:38 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:active 2024-07-26T08:40:39.140 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:38 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:39.140 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:38 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:38 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:38 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:active 2024-07-26T08:40:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:38 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:38 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:38 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:38 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3210906292,v1:172.21.15.63:6835/3210906292] up:active 2024-07-26T08:40:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:38 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:38 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:39.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:39 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:40:39.568 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:39 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 2.000s CPU time. 2024-07-26T08:40:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:39 smithi043 ceph-mon[32384]: pgmap v729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:40:40.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:39 smithi133 ceph-mon[37053]: pgmap v729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:40:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:39 smithi063 ceph-mon[36747]: pgmap v729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:40:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 286.710425 secs 2024-07-26T08:40:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 302.197606 secs 2024-07-26T08:40:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 286.710425 secs 2024-07-26T08:40:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 302.197606 secs 2024-07-26T08:40:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 286.710425 secs 2024-07-26T08:40:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 302.197606 secs 2024-07-26T08:40:42.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:41 smithi043 ceph-mon[32384]: pgmap v730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:40:42.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:41 smithi133 ceph-mon[37053]: pgmap v730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:40:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:41 smithi063 ceph-mon[36747]: pgmap v730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:40:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:43 smithi043 ceph-mon[32384]: pgmap v731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:44.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:43 smithi133 ceph-mon[37053]: pgmap v731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:43 smithi063 ceph-mon[36747]: pgmap v731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:40:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:45 smithi043 ceph-mon[32384]: pgmap v732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:40:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 291.710509 secs 2024-07-26T08:40:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 307.197745 secs 2024-07-26T08:40:46.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:45 smithi133 ceph-mon[37053]: pgmap v732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:40:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 291.710509 secs 2024-07-26T08:40:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 307.197745 secs 2024-07-26T08:40:46.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:45 smithi063 ceph-mon[36747]: pgmap v732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:40:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 291.710509 secs 2024-07-26T08:40:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 307.197745 secs 2024-07-26T08:40:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:47 smithi043 ceph-mon[32384]: pgmap v733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:47 smithi133 ceph-mon[37053]: pgmap v733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:48.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:47 smithi063 ceph-mon[36747]: pgmap v733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:40:49.690 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:40:49.691 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 systemd[1]: Stopped Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:49.691 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 2.000s CPU time. 2024-07-26T08:40:49.691 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 systemd[1]: Starting Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:40:49.691 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 podman[74126]: 2024-07-26 08:40:49.459941439 +0000 UTC m=+0.018215540 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:40:49.691 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 podman[74126]: 2024-07-26 08:40:49.561146304 +0000 UTC m=+0.119420433 container create 7ac2f66f3a99639e6c3f7f6d858b5bbeb03bfee46dcdd7400fd5f126aa1d8a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-07-26T08:40:49.985 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 podman[74126]: 2024-07-26 08:40:49.830234077 +0000 UTC m=+0.388508179 container init 7ac2f66f3a99639e6c3f7f6d858b5bbeb03bfee46dcdd7400fd5f126aa1d8a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T08:40:49.985 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 podman[74126]: 2024-07-26 08:40:49.832960661 +0000 UTC m=+0.391234745 container start 7ac2f66f3a99639e6c3f7f6d858b5bbeb03bfee46dcdd7400fd5f126aa1d8a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-07-26T08:40:49.985 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mds[74145]: -- 172.21.15.63:0/325744062 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557fc2619860 con 0x557fc67bb180 2024-07-26T08:40:49.986 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: starting mds.e at 2024-07-26T08:40:49.986 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 bash[74126]: 7ac2f66f3a99639e6c3f7f6d858b5bbeb03bfee46dcdd7400fd5f126aa1d8a3d 2024-07-26T08:40:49.986 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:40:49 smithi063 systemd[1]: Started Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:40:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: pgmap v734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:40:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: daemon mds.e restarted 2024-07-26T08:40:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:40:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: osdmap e110: 12 total, 12 up, 12 in 2024-07-26T08:40:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:boot 2024-07-26T08:40:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:40:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:49 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: pgmap v734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: daemon mds.e restarted 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: osdmap e110: 12 total, 12 up, 12 in 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:boot 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:49 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:50.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: pgmap v734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:40:50.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: daemon mds.e restarted 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: osdmap e110: 12 total, 12 up, 12 in 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:boot 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:49 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:51.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 296.710592 secs 2024-07-26T08:40:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 312.197807 secs 2024-07-26T08:40:51.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 296.710592 secs 2024-07-26T08:40:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 312.197807 secs 2024-07-26T08:40:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 296.710592 secs 2024-07-26T08:40:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 312.197807 secs 2024-07-26T08:40:52.252 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:51 smithi043 ceph-mon[32384]: pgmap v736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:40:52.252 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:51 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:resolve 2024-07-26T08:40:52.252 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:51 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:52.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:51 smithi133 ceph-mon[37053]: pgmap v736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:40:52.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:51 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:resolve 2024-07-26T08:40:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:51 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:52.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:51 smithi063 ceph-mon[36747]: pgmap v736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:40:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:51 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:resolve 2024-07-26T08:40:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:51 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:53 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:40:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:reconnect 2024-07-26T08:40:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:53 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:53 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899983 2024-07-26T08:40:53.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:53 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:40:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:reconnect 2024-07-26T08:40:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:53 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:53 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899983 2024-07-26T08:40:53.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:53 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:40:53.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:reconnect 2024-07-26T08:40:53.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:53 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:53 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899983 2024-07-26T08:40:54.275 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:54 smithi043 ceph-mon[32384]: pgmap v737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:40:54.276 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:54 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:rejoin 2024-07-26T08:40:54.276 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:54 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:54.276 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:54 smithi043 ceph-mon[32384]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:40:54.276 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:40:54.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:54 smithi063 ceph-mon[36747]: pgmap v737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:40:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:54 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:rejoin 2024-07-26T08:40:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:54 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:54 smithi063 ceph-mon[36747]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:40:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:40:54.393 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-mon[37053]: pgmap v737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:40:54.393 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:rejoin 2024-07-26T08:40:54.393 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:54.393 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-mon[37053]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:40:54.393 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:40:54.394 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:40:54.394 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: *** Caught signal (Aborted) ** 2024-07-26T08:40:54.394 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: in thread 7fd892509640 thread_name:ms_dispatch 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8978e06f0] 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd89792d94c] 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 3: raise() 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 4: abort() 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8978ca71b] 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8978d9386] 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55726120c6b9] 2024-07-26T08:40:54.398 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5572613ca80c] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55726130a2ca] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5572612da753] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5572612dba1b] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5572612bf752] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55726120da56] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557261211637] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557261211f5e] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5572611f503a] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8981ad407] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8981adcf9] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd89828a5a1] 2024-07-26T08:40:54.399 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fd898037cdd] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd898037cf9] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd89792bc02] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8979b0c40] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.045+0000 7fd892509640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: in thread 7fd892509640 thread_name:ms_dispatch 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8978e06f0] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd89792d94c] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 3: raise() 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 4: abort() 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8978ca71b] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8978d9386] 2024-07-26T08:40:54.400 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55726120c6b9] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5572613ca80c] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55726130a2ca] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5572612da753] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5572612dba1b] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5572612bf752] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55726120da56] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557261211637] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557261211f5e] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5572611f503a] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8981ad407] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8981adcf9] 2024-07-26T08:40:54.401 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd89828a5a1] 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fd898037cdd] 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd898037cf9] 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd89792bc02] 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8979b0c40] 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.402 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 0> 2024-07-26T08:40:54.045+0000 7fd892509640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: in thread 7fd892509640 thread_name:ms_dispatch 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8978e06f0] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd89792d94c] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 3: raise() 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 4: abort() 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8978ca71b] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8978d9386] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55726120c6b9] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5572613ca80c] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55726130a2ca] 2024-07-26T08:40:54.403 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5572612da753] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5572612dba1b] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5572612bf752] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55726120da56] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557261211637] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557261211f5e] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5572611f503a] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8981ad407] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8981adcf9] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd89828a5a1] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fd898037cdd] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd898037cf9] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd89792bc02] 2024-07-26T08:40:54.404 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8979b0c40] 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 0> 2024-07-26T08:40:54.045+0000 7fd892509640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: in thread 7fd892509640 thread_name:ms_dispatch 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8978e06f0] 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd89792d94c] 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 3: raise() 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 4: abort() 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8978ca71b] 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8978d9386] 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55726120c6b9] 2024-07-26T08:40:54.405 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5572613ca80c] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55726130a2ca] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5572612da753] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5572612dba1b] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5572612bf752] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55726120da56] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557261211637] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557261211f5e] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5572611f503a] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8981ad407] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8981adcf9] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd89828a5a1] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 20: (Thread::entry_wrapper()+0x43) [0x7fd898037cdd] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd898037cf9] 2024-07-26T08:40:54.406 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd89792bc02] 2024-07-26T08:40:54.407 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8979b0c40] 2024-07-26T08:40:54.407 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:40:54.407 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73063]: 2024-07-26T08:40:54.407 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 podman[73198]: 2024-07-26 08:40:54.105613798 +0000 UTC m=+0.018684331 container died 6e922748fc345cf303c723cbd799f8de9eab726d279ca7029a2e4b574815b5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:40:55.015 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 podman[73198]: 2024-07-26 08:40:54.727136108 +0000 UTC m=+0.640206630 container remove 6e922748fc345cf303c723cbd799f8de9eab726d279ca7029a2e4b574815b5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-07-26T08:40:55.016 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:40:55.016 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:40:55.016 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:40:54 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.927s CPU time. 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:active 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: pgmap v738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6 op/s 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: pgmap v739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7 op/s 2024-07-26T08:40:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:active 2024-07-26T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:40:55.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: pgmap v738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6 op/s 2024-07-26T08:40:55.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: pgmap v739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7 op/s 2024-07-26T08:40:55.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/641002587,v1:172.21.15.133:6833/641002587] up:active 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: pgmap v738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6 op/s 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: pgmap v739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7 op/s 2024-07-26T08:40:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:40:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 301.710654 secs 2024-07-26T08:40:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 317.197927 secs 2024-07-26T08:40:56.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 301.710654 secs 2024-07-26T08:40:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 317.197927 secs 2024-07-26T08:40:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 301.710654 secs 2024-07-26T08:40:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 317.197927 secs 2024-07-26T08:40:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:57 smithi063 ceph-mon[36747]: pgmap v740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 141 B/s wr, 9 op/s 2024-07-26T08:40:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:57 smithi043 ceph-mon[32384]: pgmap v740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 141 B/s wr, 9 op/s 2024-07-26T08:40:57.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:57 smithi133 ceph-mon[37053]: pgmap v740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 141 B/s wr, 9 op/s 2024-07-26T08:40:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:40:59 smithi043 ceph-mon[32384]: pgmap v741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 246 B/s wr, 12 op/s 2024-07-26T08:40:59.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:40:59 smithi133 ceph-mon[37053]: pgmap v741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 246 B/s wr, 12 op/s 2024-07-26T08:40:59.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:40:59 smithi063 ceph-mon[36747]: pgmap v741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 246 B/s wr, 12 op/s 2024-07-26T08:41:00.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 306.710795 secs 2024-07-26T08:41:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 306.710795 secs 2024-07-26T08:41:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 306.710795 secs 2024-07-26T08:41:01.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:01 smithi133 ceph-mon[37053]: pgmap v742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 221 B/s wr, 10 op/s 2024-07-26T08:41:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 322.198016 secs 2024-07-26T08:41:01.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:01 smithi063 ceph-mon[36747]: pgmap v742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 221 B/s wr, 10 op/s 2024-07-26T08:41:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 322.198016 secs 2024-07-26T08:41:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:01 smithi043 ceph-mon[32384]: pgmap v742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 221 B/s wr, 10 op/s 2024-07-26T08:41:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 322.198016 secs 2024-07-26T08:41:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:03 smithi133 ceph-mon[37053]: pgmap v743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 221 B/s wr, 9 op/s 2024-07-26T08:41:03.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:03 smithi063 ceph-mon[36747]: pgmap v743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 221 B/s wr, 9 op/s 2024-07-26T08:41:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:03 smithi043 ceph-mon[32384]: pgmap v743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 221 B/s wr, 9 op/s 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:05 smithi133 ceph-mon[37053]: pgmap v744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 311.710867 secs 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 systemd[1]: Stopped Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.927s CPU time. 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 systemd[1]: Starting Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:41:05.287 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 podman[73320]: 2024-07-26 08:41:05.151150512 +0000 UTC m=+0.017637535 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:41:05.288 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 podman[73320]: 2024-07-26 08:41:05.286102451 +0000 UTC m=+0.152589513 container create 91bb80599d10964a39d38f2643579c4b6bc9c5f20f182b69cdde12cf2468f994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-07-26T08:41:05.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:05 smithi063 ceph-mon[36747]: pgmap v744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 311.710867 secs 2024-07-26T08:41:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:05 smithi043 ceph-mon[32384]: pgmap v744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 311.710867 secs 2024-07-26T08:41:05.815 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 podman[73320]: 2024-07-26 08:41:05.53863014 +0000 UTC m=+0.405117148 container init 91bb80599d10964a39d38f2643579c4b6bc9c5f20f182b69cdde12cf2468f994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, ceph=True, org.label-schema.license=GPLv2) 2024-07-26T08:41:05.816 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 podman[73320]: 2024-07-26 08:41:05.541440492 +0000 UTC m=+0.407927498 container start 91bb80599d10964a39d38f2643579c4b6bc9c5f20f182b69cdde12cf2468f994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:41:05.816 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 ceph-mds[73339]: -- 172.21.15.133:0/3146189365 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a333103c20 con 0x55a3372a5600 2024-07-26T08:41:05.816 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: starting mds.l at 2024-07-26T08:41:05.816 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 bash[73320]: 91bb80599d10964a39d38f2643579c4b6bc9c5f20f182b69cdde12cf2468f994 2024-07-26T08:41:05.816 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:05 smithi133 systemd[1]: Started Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:06.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 327.198081 secs 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: daemon mds.l restarted 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: osdmap e111: 12 total, 12 up, 12 in 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:boot 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:41:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:06 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 327.198081 secs 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: daemon mds.l restarted 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: osdmap e111: 12 total, 12 up, 12 in 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:boot 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:06 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:06.717 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:41:06.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 327.198081 secs 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: daemon mds.l restarted 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: osdmap e111: 12 total, 12 up, 12 in 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:boot 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T08:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:06 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:replay,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:07 smithi063 ceph-mon[36747]: pgmap v746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:resolve 2024-07-26T08:41:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:07 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:07.620 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:07 smithi043 ceph-mon[32384]: pgmap v746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:07.620 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:resolve 2024-07-26T08:41:07.620 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:07 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:07.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:07 smithi133 ceph-mon[37053]: pgmap v746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:resolve 2024-07-26T08:41:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:07 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:resolve,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:08.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:08 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399996 2024-07-26T08:41:08.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:08 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:reconnect 2024-07-26T08:41:08.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:08 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:08.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:08 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:41:08.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:08 smithi043 ceph-mon[32384]: pgmap v747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:41:09.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:08 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399996 2024-07-26T08:41:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:08 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:reconnect 2024-07-26T08:41:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:08 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:08 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:41:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:08 smithi133 ceph-mon[37053]: pgmap v747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:41:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:08 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399996 2024-07-26T08:41:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:08 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:reconnect 2024-07-26T08:41:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:08 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:reconnect,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:08 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:41:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:08 smithi063 ceph-mon[36747]: pgmap v747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 -- 172.21.15.43:0/898023023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 msgr2=0x7fde3c1122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 --2- 172.21.15.43:0/898023023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1122a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fde34009ca0 tx=0x7fde3402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 -- 172.21.15.43:0/898023023 shutdown_connections 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 --2- 172.21.15.43:0/898023023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1122a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 --2- 172.21.15.43:0/898023023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 0x7fde3c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 --2- 172.21.15.43:0/898023023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3c1057e0 0x7fde3c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 -- 172.21.15.43:0/898023023 >> 172.21.15.43:0/898023023 conn(0x7fde3c1011f0 msgr2=0x7fde3c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 -- 172.21.15.43:0/898023023 shutdown_connections 2024-07-26T08:41:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.495+0000 7fde40e00640 1 -- 172.21.15.43:0/898023023 wait complete. 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 Processor -- start 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 -- start start 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3c1057e0 0x7fde3c19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 0x7fde3c19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c115850 con 0x7fde3c10b120 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1156d0 con 0x7fde3c10ba70 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.497+0000 7fde40e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1159d0 con 0x7fde3c1057e0 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde33e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 0x7fde3c19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde39e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3c1057e0 0x7fde3c19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:41916/0 (socket says 172.21.15.43:41916) 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 -- 172.21.15.43:0/2359742666 learned_addr learned my addr 172.21.15.43:0/2359742666 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 -- 172.21.15.43:0/2359742666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3c1057e0 msgr2=0x7fde3c19c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3c1057e0 0x7fde3c19c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 -- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 msgr2=0x7fde3c19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 0x7fde3c19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde3a800640 1 -- 172.21.15.43:0/2359742666 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3c1a20f0 con 0x7fde3c10ba70 2024-07-26T08:41:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.498+0000 7fde33e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 0x7fde3c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:41:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.499+0000 7fde3a800640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1a19c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fde34033040 tx=0x7fde34003c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.499+0000 7fde32a00640 1 -- 172.21.15.43:0/2359742666 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34031650 con 0x7fde3c10ba70 2024-07-26T08:41:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.499+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3c1a2380 con 0x7fde3c10ba70 2024-07-26T08:41:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.499+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3c1a8b40 con 0x7fde3c10ba70 2024-07-26T08:41:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.499+0000 7fde32a00640 1 -- 172.21.15.43:0/2359742666 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde340317f0 con 0x7fde3c10ba70 2024-07-26T08:41:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.499+0000 7fde32a00640 1 -- 172.21.15.43:0/2359742666 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3402fa80 con 0x7fde3c10ba70 2024-07-26T08:41:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.503+0000 7fde47bfc740 1 Processor -- start 2024-07-26T08:41:09.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.503+0000 7fde32a00640 1 -- 172.21.15.43:0/2359742666 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fde3402fc20 con 0x7fde3c10ba70 2024-07-26T08:41:09.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 -- start start 2024-07-26T08:41:09.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa303c070 0x560fa33e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33e18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560fa3357bc0 con 0x560fa301b390 2024-07-26T08:41:09.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560fa33470c0 con 0x560fa30131b0 2024-07-26T08:41:09.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde47bfc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560fa334b100 con 0x560fa303c070 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde39e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde39e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:41928/0 (socket says 172.21.15.43:41928) 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.504+0000 7fde39e00640 1 -- 172.21.15.43:0/2336069124 learned_addr learned my addr 172.21.15.43:0/2336069124 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde33e00640 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa303c070 0x560fa33e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde33e00640 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33e18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde39e00640 1 -- 172.21.15.43:0/2336069124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa303c070 msgr2=0x560fa33e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde39e00640 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa303c070 0x560fa33e0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde39e00640 1 -- 172.21.15.43:0/2336069124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 msgr2=0x560fa33e18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde39e00640 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33e18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde39e00640 1 -- 172.21.15.43:0/2336069124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa30a7650 con 0x560fa30131b0 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde33e00640 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa303c070 0x560fa33e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde32a00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde200b3d40 0x7fde200b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.505+0000 7fde39e00640 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e1360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009cf0 tx=0x7fde2c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4136fac1fc370b92 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.506+0000 7fde32a00640 1 -- 172.21.15.43:0/2359742666 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 11258+0+0 (secure 0 0 0) 0x7fde34105d40 con 0x7fde3c10ba70 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.506+0000 7fde2b400640 1 -- 172.21.15.43:0/2336069124 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c004230 con 0x560fa30131b0 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.506+0000 7fde33e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde200b3d40 0x7fde200b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.506+0000 7fde2b400640 1 -- 172.21.15.43:0/2336069124 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde2c0043d0 con 0x560fa30131b0 2024-07-26T08:41:09.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.506+0000 7fde2b400640 1 -- 172.21.15.43:0/2336069124 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c019980 con 0x560fa30131b0 2024-07-26T08:41:09.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 -- 172.21.15.43:0/2336069124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 msgr2=0x560fa33e1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e1360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009cf0 tx=0x7fde2c011810 comp rx=0 tx=0).stop 2024-07-26T08:41:09.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde33e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde200b3d40 0x7fde200b6250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fde3c1039c0 tx=0x7fde24004730 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:09.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 -- 172.21.15.43:0/2336069124 shutdown_connections 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33e18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e1360 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 --2- 172.21.15.43:0/2336069124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa303c070 0x560fa33e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 -- 172.21.15.43:0/2336069124 >> 172.21.15.43:0/2336069124 conn(0x560fa3030460 msgr2=0x560fa33ded10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 -- 172.21.15.43:0/2336069124 shutdown_connections 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 -- 172.21.15.43:0/2336069124 wait complete. 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.507+0000 7fde47bfc740 1 -- start start 2024-07-26T08:41:09.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 Processor -- start 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa301b390 0x560fa33ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa303c070 0x560fa33ece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560fa31aa700 con 0x560fa303c070 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560fa32e3690 con 0x560fa30131b0 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.508+0000 7fde47bfc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560fa33ef600 con 0x560fa301b390 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde47bfc740 10 client.0 _ll_register_callbacks cb 0x560fa32f3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde3a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa303c070 0x560fa33ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde33e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa301b390 0x560fa33ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33ec3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:41938/0 (socket says 172.21.15.43:41938) 2024-07-26T08:41:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 -- 172.21.15.43:0/3289540590 learned_addr learned my addr 172.21.15.43:0/3289540590 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 -- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa301b390 msgr2=0x560fa33ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa301b390 0x560fa33ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 -- 172.21.15.43:0/3289540590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa303c070 msgr2=0x560fa33ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa303c070 0x560fa33ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.509+0000 7fde39e00640 1 -- 172.21.15.43:0/3289540590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa32fa830 con 0x560fa30131b0 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.510+0000 7fde39e00640 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33ec3b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde2c019500 tx=0x7fde2c005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a35e5600ff4a140e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.510+0000 7fde1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.510+0000 7fde1fe00640 1 -- 172.21.15.43:0/3289540590 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c027070 con 0x560fa30131b0 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.510+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde2c0043d0 con 0x560fa30131b0 2024-07-26T08:41:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.510+0000 7fde1fe00640 1 -- 172.21.15.43:0/3289540590 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 11258+0+0 (secure 0 0 0) 0x7fde2c0037f0 con 0x560fa30131b0 2024-07-26T08:41:09.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde1fe00640 1 -- 172.21.15.43:0/3289540590 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7fde2c009ea0 con 0x560fa30131b0 2024-07-26T08:41:09.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 10 client.26096 fetch_fsmap learned FSMap version 166 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=166,monmap=4+}) -- 0x560fa33fb210 con 0x560fa30131b0 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde1fe00640 1 -- 172.21.15.43:0/3289540590 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde2c0043d0 con 0x560fa30131b0 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde1fe00640 1 -- 172.21.15.43:0/3289540590 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 166) ==== 7148+0+0 (secure 0 0 0) 0x7fde2c003b10 con 0x560fa30131b0 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 10 client.26096 fetch_fsmap finished waiting for FSMap version 166 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 10 client.26096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 20 client.26096 populate_metadata read hostname 'smithi043' 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa2ffa9f0 0x560fa33fe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 4 client.26096 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.511+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fa3359b10 con 0x560fa2ffa9f0 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.512+0000 7fde33e00640 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa2ffa9f0 0x560fa33fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.513+0000 7fde33e00640 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa2ffa9f0 0x560fa33fe630 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=584ee3b765561ab9 server_cookie=a49a4c6109b26d12 in_seq=0 out_seq=0 2024-07-26T08:41:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.513+0000 7fde1fe00640 10 client.26096 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:09.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.513+0000 7fde1fe00640 1 -- 172.21.15.43:0/3289540590 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fa3359b10 con 0x560fa2ffa9f0 2024-07-26T08:41:09.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde1fe00640 10 client.26096 handle_command_reply: tid=0 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 client.26096 shutdown 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 msgr2=0x560fa33ec3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33ec3b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde2c019500 tx=0x7fde2c005270 comp rx=0 tx=0).stop 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 shutdown_connections 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa2ffa9f0 0x560fa33fe630 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa301b390 0x560fa33ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa303c070 0x560fa33ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde1fe00640 0 client.26096 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3289540590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33ec3b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 >> 172.21.15.43:0/3289540590 conn(0x560fa3030460 msgr2=0x560fa33e3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 shutdown_connections 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 1 -- 172.21.15.43:0/3289540590 wait complete. 2024-07-26T08:41:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.514+0000 7fde47bfc740 20 client.26096 trim_cache size 0 max 16384 2024-07-26T08:41:09.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 Processor -- start 2024-07-26T08:41:09.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 -- start start 2024-07-26T08:41:09.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa33ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa3403df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1b4ea0 con 0x560fa301b390 2024-07-26T08:41:09.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1b5570 con 0x560fa30131b0 2024-07-26T08:41:09.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.534+0000 7fde47bfc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1b3570 con 0x560fa3030460 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde39e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa33ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde3a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa3403df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde39e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa33ebc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:60662/0 (socket says 172.21.15.43:60662) 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde39e00640 1 -- 172.21.15.43:0/3779842992 learned_addr learned my addr 172.21.15.43:0/3779842992 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 -- 172.21.15.43:0/3779842992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 msgr2=0x560fa33ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa33ebc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 -- 172.21.15.43:0/3779842992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 msgr2=0x560fa3403df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa3403df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 -- 172.21.15.43:0/3779842992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa33df600 con 0x560fa30131b0 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde39e00640 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa33ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:41:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.535+0000 7fde33e00640 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e26f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x560fa33fed90 tx=0x7fde24019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f3cdc5eac5cb228 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.536+0000 7fde2aa00640 1 -- 172.21.15.43:0/3779842992 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2400fa20 con 0x560fa30131b0 2024-07-26T08:41:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.536+0000 7fde2aa00640 1 -- 172.21.15.43:0/3779842992 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde2400fbc0 con 0x560fa30131b0 2024-07-26T08:41:09.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.536+0000 7fde2aa00640 1 -- 172.21.15.43:0/3779842992 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2402b6c0 con 0x560fa30131b0 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 -- 172.21.15.43:0/3779842992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 msgr2=0x560fa33e26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e26f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x560fa33fed90 tx=0x7fde24019000 comp rx=0 tx=0).stop 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 -- 172.21.15.43:0/3779842992 shutdown_connections 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa3403df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33e26f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3779842992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa33ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 -- 172.21.15.43:0/3779842992 >> 172.21.15.43:0/3779842992 conn(0x560fa33ecf60 msgr2=0x560fa33ee290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 -- 172.21.15.43:0/3779842992 shutdown_connections 2024-07-26T08:41:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.537+0000 7fde47bfc740 1 -- 172.21.15.43:0/3779842992 wait complete. 2024-07-26T08:41:09.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 -- start start 2024-07-26T08:41:09.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 Processor -- start 2024-07-26T08:41:09.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33efe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa3464db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1b2ea0 con 0x560fa301b390 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1b1a90 con 0x560fa30131b0 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c1b2100 con 0x560fa3030460 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.538+0000 7fde47bfc740 10 client.0 _ll_register_callbacks cb 0x7fde2c004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49602/0 (socket says 172.21.15.43:49602) 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 -- 172.21.15.43:0/3949541198 learned_addr learned my addr 172.21.15.43:0/3949541198 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde39e00640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde3a800640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa3464db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 -- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 msgr2=0x560fa3464db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa3464db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 -- 172.21.15.43:0/3949541198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 msgr2=0x560fa33efe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33efe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.539+0000 7fde33e00640 1 -- 172.21.15.43:0/3949541198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa34652f0 con 0x560fa301b390 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.540+0000 7fde33e00640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33f03b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde24005e00 tx=0x7fde240104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc44b9cad72b6c3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.540+0000 7fde1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.540+0000 7fde1fe00640 1 -- 172.21.15.43:0/3949541198 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2400fd70 con 0x560fa301b390 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.540+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde2400fbc0 con 0x560fa301b390 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.540+0000 7fde1fe00640 1 -- 172.21.15.43:0/3949541198 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 11258+0+0 (secure 0 0 0) 0x7fde24005020 con 0x560fa301b390 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.540+0000 7fde1fe00640 1 -- 172.21.15.43:0/3949541198 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7fde24046050 con 0x560fa301b390 2024-07-26T08:41:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 10 client.15879 fetch_fsmap learned FSMap version 166 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=166,monmap=4+}) -- 0x560fa3466580 con 0x560fa301b390 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde1fe00640 1 -- 172.21.15.43:0/3949541198 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde2400fbc0 con 0x560fa301b390 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde1fe00640 1 -- 172.21.15.43:0/3949541198 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 166) ==== 7148+0+0 (secure 0 0 0) 0x7fde240048c0 con 0x560fa301b390 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 10 client.15879 fetch_fsmap finished waiting for FSMap version 166 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 20 client.15879 populate_metadata read hostname 'smithi043' 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa303c070 0x560fa3468cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 4 client.15879 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:41:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.541+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560fa33555b0 con 0x560fa303c070 2024-07-26T08:41:09.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.542+0000 7fde39e00640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa303c070 0x560fa3468cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:09.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.542+0000 7fde39e00640 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa303c070 0x560fa3468cc0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93354e2ad46afbf9 server_cookie=eab189c230d3daf3 in_seq=0 out_seq=0 2024-07-26T08:41:09.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.542+0000 7fde1fe00640 10 client.15879 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde1fe00640 1 -- 172.21.15.43:0/3949541198 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x560fa33555b0 con 0x560fa303c070 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde1fe00640 10 client.15879 handle_command_reply: tid=0 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 client.15879 shutdown 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 msgr2=0x560fa33f03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33f03b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde24005e00 tx=0x7fde240104b0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 shutdown_connections 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x560fa303c070 0x560fa3468cc0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560fa3030460 0x560fa3464db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560fa301b390 0x560fa33f03b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 --2- 172.21.15.43:0/3949541198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa30131b0 0x560fa33efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 >> 172.21.15.43:0/3949541198 conn(0x560fa33ecf60 msgr2=0x560fa33e7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde1fe00640 0 client.15879 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 shutdown_connections 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 1 -- 172.21.15.43:0/3949541198 wait complete. 2024-07-26T08:41:09.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.543+0000 7fde47bfc740 20 client.15879 trim_cache size 0 max 16384 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:41:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde200b3d40 msgr2=0x7fde200b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde200b3d40 0x7fde200b6250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fde3c1039c0 tx=0x7fde24004730 comp rx=0 tx=0).stop 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 msgr2=0x7fde3c1a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1a19c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fde34033040 tx=0x7fde34003c90 comp rx=0 tx=0).stop 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 shutdown_connections 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fde200b3d40 0x7fde200b6250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3c10ba70 0x7fde3c1a19c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde3c10b120 0x7fde3c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 --2- 172.21.15.43:0/2359742666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3c1057e0 0x7fde3c19c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 >> 172.21.15.43:0/2359742666 conn(0x7fde3c1011f0 msgr2=0x7fde3c1085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 shutdown_connections 2024-07-26T08:41:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:09.544+0000 7fde40e00640 1 -- 172.21.15.43:0/2359742666 wait complete. 2024-07-26T08:41:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:09 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:rejoin 2024-07-26T08:41:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:09 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:09 smithi043 ceph-mon[32384]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:41:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:09 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:rejoin 2024-07-26T08:41:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:09 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:09 smithi133 ceph-mon[37053]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:41:10.018 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:rejoin 2024-07-26T08:41:10.018 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=e=up:rejoin,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:10.018 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-mon[36747]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: *** Caught signal (Aborted) ** 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: in thread 7fd4a0561640 thread_name:ms_dispatch 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd4a59386f0] 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd4a598594c] 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 3: raise() 2024-07-26T08:41:10.019 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 4: abort() 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd4a592271b] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 6: /lib64/libc.so.6(+0x37386) [0x7fd4a5931386] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557fc148b6b9] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557fc164980c] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557fc15892ca] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557fc1559753] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557fc155aa1b] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557fc153e752] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557fc148ca56] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557fc1490637] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557fc1490f5e] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557fc147403a] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd4a6205407] 2024-07-26T08:41:10.020 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 18: (DispatchQueue::entry()+0x60f) [0x7fd4a6205cf9] 2024-07-26T08:41:10.021 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd4a62e25a1] 2024-07-26T08:41:10.021 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 20: (Thread::entry_wrapper()+0x43) [0x7fd4a608fcdd] 2024-07-26T08:41:10.021 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd4a608fcf9] 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd4a5983c02] 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd4a5a08c40] 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:09.635+0000 7fd4a0561640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: in thread 7fd4a0561640 thread_name:ms_dispatch 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd4a59386f0] 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd4a598594c] 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 3: raise() 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 4: abort() 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd4a592271b] 2024-07-26T08:41:10.022 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 6: /lib64/libc.so.6(+0x37386) [0x7fd4a5931386] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557fc148b6b9] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557fc164980c] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557fc15892ca] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557fc1559753] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557fc155aa1b] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557fc153e752] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557fc148ca56] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557fc1490637] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557fc1490f5e] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557fc147403a] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd4a6205407] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 18: (DispatchQueue::entry()+0x60f) [0x7fd4a6205cf9] 2024-07-26T08:41:10.023 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd4a62e25a1] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 20: (Thread::entry_wrapper()+0x43) [0x7fd4a608fcdd] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd4a608fcf9] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd4a5983c02] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd4a5a08c40] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 0> 2024-07-26T08:41:09.635+0000 7fd4a0561640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: in thread 7fd4a0561640 thread_name:ms_dispatch 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd4a59386f0] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd4a598594c] 2024-07-26T08:41:10.024 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 3: raise() 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 4: abort() 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd4a592271b] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 6: /lib64/libc.so.6(+0x37386) [0x7fd4a5931386] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557fc148b6b9] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557fc164980c] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557fc15892ca] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557fc1559753] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557fc155aa1b] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557fc153e752] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557fc148ca56] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557fc1490637] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557fc1490f5e] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557fc147403a] 2024-07-26T08:41:10.025 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd4a6205407] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 18: (DispatchQueue::entry()+0x60f) [0x7fd4a6205cf9] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd4a62e25a1] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 20: (Thread::entry_wrapper()+0x43) [0x7fd4a608fcdd] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd4a608fcf9] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd4a5983c02] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd4a5a08c40] 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 0> 2024-07-26T08:41:09.635+0000 7fd4a0561640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: in thread 7fd4a0561640 thread_name:ms_dispatch 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:10.026 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd4a59386f0] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd4a598594c] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 3: raise() 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 4: abort() 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd4a592271b] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 6: /lib64/libc.so.6(+0x37386) [0x7fd4a5931386] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557fc148b6b9] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557fc164980c] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557fc15892ca] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557fc1559753] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557fc155aa1b] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557fc153e752] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557fc148ca56] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557fc1490637] 2024-07-26T08:41:10.027 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557fc1490f5e] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557fc147403a] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd4a6205407] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 18: (DispatchQueue::entry()+0x60f) [0x7fd4a6205cf9] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd4a62e25a1] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 20: (Thread::entry_wrapper()+0x43) [0x7fd4a608fcdd] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd4a608fcf9] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd4a5983c02] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd4a5a08c40] 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e[74141]: 2024-07-26T08:41:10.028 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:09 smithi063 podman[74309]: 2024-07-26 08:41:09.701341768 +0000 UTC m=+0.020607745 container died 7ac2f66f3a99639e6c3f7f6d858b5bbeb03bfee46dcdd7400fd5f126aa1d8a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:41:10.502 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:41:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:active 2024-07-26T08:41:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:41:10.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 316.710961 secs 2024-07-26T08:41:10.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: pgmap v748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:41:10.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 332.198173 secs 2024-07-26T08:41:10.744 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:10 smithi063 podman[74309]: 2024-07-26 08:41:10.477410868 +0000 UTC m=+0.796676890 container remove 7ac2f66f3a99639e6c3f7f6d858b5bbeb03bfee46dcdd7400fd5f126aa1d8a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:41:10.744 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:10 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:41:10.744 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:10.745 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:active 2024-07-26T08:41:10.745 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:10.745 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:41:10.745 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 316.710961 secs 2024-07-26T08:41:10.745 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: pgmap v748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:41:10.745 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 332.198173 secs 2024-07-26T08:41:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6834/3551536194,v1:172.21.15.63:6835/3551536194] up:active 2024-07-26T08:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 2 up:standby-replay 5 up:standby 2024-07-26T08:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=e=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby 2024-07-26T08:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 316.710961 secs 2024-07-26T08:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: pgmap v748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 332.198173 secs 2024-07-26T08:41:11.067 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:10 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:41:11.068 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:10 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 1.997s CPU time. 2024-07-26T08:41:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:13 smithi133 ceph-mon[37053]: pgmap v749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:41:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:13 smithi063 ceph-mon[36747]: pgmap v749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:41:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:13 smithi043 ceph-mon[32384]: pgmap v749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:41:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:15 smithi133 ceph-mon[37053]: pgmap v750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:41:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 321.711042 secs 2024-07-26T08:41:15.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:15 smithi063 ceph-mon[36747]: pgmap v750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:41:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 321.711042 secs 2024-07-26T08:41:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:15 smithi043 ceph-mon[32384]: pgmap v750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:41:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 321.711042 secs 2024-07-26T08:41:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 337.198274 secs 2024-07-26T08:41:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 337.198274 secs 2024-07-26T08:41:16.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 337.198274 secs 2024-07-26T08:41:17.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:17 smithi133 ceph-mon[37053]: pgmap v751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 193 B/s wr, 10 op/s 2024-07-26T08:41:17.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:17 smithi063 ceph-mon[36747]: pgmap v751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 193 B/s wr, 10 op/s 2024-07-26T08:41:17.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:17 smithi043 ceph-mon[32384]: pgmap v751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 193 B/s wr, 10 op/s 2024-07-26T08:41:19.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:19 smithi063 ceph-mon[36747]: pgmap v752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:19 smithi043 ceph-mon[32384]: pgmap v752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:19.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:19 smithi133 ceph-mon[37053]: pgmap v752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 326.711192 secs 2024-07-26T08:41:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 326.711192 secs 2024-07-26T08:41:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 326.711192 secs 2024-07-26T08:41:21.286 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:20 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:41:21.286 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:20 smithi063 systemd[1]: Stopped Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:21.286 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:20 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Consumed 1.997s CPU time. 2024-07-26T08:41:21.286 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:20 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Start request repeated too quickly. 2024-07-26T08:41:21.286 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:20 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T08:41:21.286 INFO:journalctl@ceph.mds.e.smithi063.stdout:Jul 26 08:41:20 smithi063 systemd[1]: Failed to start Ceph mds.e for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:21 smithi063 ceph-mon[36747]: pgmap v753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:41:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 342.198418 secs 2024-07-26T08:41:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:21 smithi043 ceph-mon[32384]: pgmap v753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:41:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 342.198418 secs 2024-07-26T08:41:21.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:21 smithi133 ceph-mon[37053]: pgmap v753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:41:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 342.198418 secs 2024-07-26T08:41:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:23 smithi063 ceph-mon[36747]: pgmap v754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:41:23.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:23 smithi043 ceph-mon[32384]: pgmap v754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:41:23.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:23 smithi133 ceph-mon[37053]: pgmap v754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: pgmap v755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: Replacing daemon mds.e as rank 1 with standby daemon mds.l 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: osdmap e112: 12 total, 12 up, 12 in 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 331.711316 secs 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: pgmap v755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: Replacing daemon mds.e as rank 1 with standby daemon mds.l 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: osdmap e112: 12 total, 12 up, 12 in 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 331.711316 secs 2024-07-26T08:41:25.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: pgmap v755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:41:25.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: Replacing daemon mds.e as rank 1 with standby daemon mds.l 2024-07-26T08:41:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-07-26T08:41:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: osdmap e112: 12 total, 12 up, 12 in 2024-07-26T08:41:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 331.711316 secs 2024-07-26T08:41:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 347.198542 secs 2024-07-26T08:41:26.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 347.198542 secs 2024-07-26T08:41:26.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 347.198542 secs 2024-07-26T08:41:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:27 smithi063 ceph-mon[36747]: pgmap v757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:41:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:27 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:resolve 2024-07-26T08:41:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:27 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:27.571 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:27 smithi043 ceph-mon[32384]: pgmap v757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:41:27.571 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:27 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:resolve 2024-07-26T08:41:27.571 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:27 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:27 smithi133 ceph-mon[37053]: pgmap v757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:41:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:27 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:resolve 2024-07-26T08:41:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:27 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:28 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:reconnect 2024-07-26T08:41:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:28 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:28 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00899983 2024-07-26T08:41:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:28 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999982 2024-07-26T08:41:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:28 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:reconnect 2024-07-26T08:41:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:28 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:28 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00899983 2024-07-26T08:41:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:28 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999982 2024-07-26T08:41:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:28 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:reconnect 2024-07-26T08:41:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:28 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:28 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00899983 2024-07-26T08:41:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:28 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999982 2024-07-26T08:41:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:29 smithi043 ceph-mon[32384]: pgmap v758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:41:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:29 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:rejoin 2024-07-26T08:41:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:29 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:29 smithi043 ceph-mon[32384]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:41:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-mon[37053]: pgmap v758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:41:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:rejoin 2024-07-26T08:41:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-mon[37053]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:41:29.766 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: *** Caught signal (Aborted) ** 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: in thread 7f04f982e640 thread_name:ms_dispatch 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04fec056f0] 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f04fec5294c] 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 3: raise() 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 4: abort() 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 5: /lib64/libc.so.6(+0x2871b) [0x7f04febef71b] 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 6: /lib64/libc.so.6(+0x37386) [0x7f04febfe386] 2024-07-26T08:41:29.767 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a3305556b9] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a33071380c] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a3306532ca] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a330623753] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a330624a1b] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a330608752] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a330556a56] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a33055a637] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a33055af5e] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a33053e03a] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f04ff4d2407] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 18: (DispatchQueue::entry()+0x60f) [0x7f04ff4d2cf9] 2024-07-26T08:41:29.768 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f04ff5af5a1] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 20: (Thread::entry_wrapper()+0x43) [0x7f04ff35ccdd] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 21: (Thread::_entry_func(void*)+0xd) [0x7f04ff35ccf9] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 22: /lib64/libc.so.6(+0x89c02) [0x7f04fec50c02] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f04fecd5c40] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.353+0000 7f04f982e640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: in thread 7f04f982e640 thread_name:ms_dispatch 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04fec056f0] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f04fec5294c] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 3: raise() 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 4: abort() 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 5: /lib64/libc.so.6(+0x2871b) [0x7f04febef71b] 2024-07-26T08:41:29.769 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 6: /lib64/libc.so.6(+0x37386) [0x7f04febfe386] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a3305556b9] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a33071380c] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a3306532ca] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a330623753] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a330624a1b] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a330608752] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a330556a56] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a33055a637] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a33055af5e] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a33053e03a] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f04ff4d2407] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 18: (DispatchQueue::entry()+0x60f) [0x7f04ff4d2cf9] 2024-07-26T08:41:29.770 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f04ff5af5a1] 2024-07-26T08:41:29.774 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 20: (Thread::entry_wrapper()+0x43) [0x7f04ff35ccdd] 2024-07-26T08:41:29.774 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 21: (Thread::_entry_func(void*)+0xd) [0x7f04ff35ccf9] 2024-07-26T08:41:29.774 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 22: /lib64/libc.so.6(+0x89c02) [0x7f04fec50c02] 2024-07-26T08:41:29.774 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f04fecd5c40] 2024-07-26T08:41:29.774 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:29.774 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 0> 2024-07-26T08:41:29.353+0000 7f04f982e640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: in thread 7f04f982e640 thread_name:ms_dispatch 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04fec056f0] 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f04fec5294c] 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 3: raise() 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 4: abort() 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 5: /lib64/libc.so.6(+0x2871b) [0x7f04febef71b] 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 6: /lib64/libc.so.6(+0x37386) [0x7f04febfe386] 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a3305556b9] 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a33071380c] 2024-07-26T08:41:29.775 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a3306532ca] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a330623753] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a330624a1b] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a330608752] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a330556a56] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a33055a637] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a33055af5e] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a33053e03a] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f04ff4d2407] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 18: (DispatchQueue::entry()+0x60f) [0x7f04ff4d2cf9] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f04ff5af5a1] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 20: (Thread::entry_wrapper()+0x43) [0x7f04ff35ccdd] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 21: (Thread::_entry_func(void*)+0xd) [0x7f04ff35ccf9] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 22: /lib64/libc.so.6(+0x89c02) [0x7f04fec50c02] 2024-07-26T08:41:29.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f04fecd5c40] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 0> 2024-07-26T08:41:29.353+0000 7f04f982e640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: in thread 7f04f982e640 thread_name:ms_dispatch 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04fec056f0] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f04fec5294c] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 3: raise() 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 4: abort() 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 5: /lib64/libc.so.6(+0x2871b) [0x7f04febef71b] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 6: /lib64/libc.so.6(+0x37386) [0x7f04febfe386] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a3305556b9] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a33071380c] 2024-07-26T08:41:29.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a3306532ca] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a330623753] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a330624a1b] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a330608752] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a330556a56] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a33055a637] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a33055af5e] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a33053e03a] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f04ff4d2407] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 18: (DispatchQueue::entry()+0x60f) [0x7f04ff4d2cf9] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f04ff5af5a1] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 20: (Thread::entry_wrapper()+0x43) [0x7f04ff35ccdd] 2024-07-26T08:41:29.778 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 21: (Thread::_entry_func(void*)+0xd) [0x7f04ff35ccf9] 2024-07-26T08:41:29.779 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 22: /lib64/libc.so.6(+0x89c02) [0x7f04fec50c02] 2024-07-26T08:41:29.779 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f04fecd5c40] 2024-07-26T08:41:29.779 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:29.779 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73335]: 2024-07-26T08:41:29.779 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:29 smithi133 podman[73385]: 2024-07-26 08:41:29.417644251 +0000 UTC m=+0.021404180 container died 91bb80599d10964a39d38f2643579c4b6bc9c5f20f182b69cdde12cf2468f994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_CLEAN=True) 2024-07-26T08:41:29.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:29 smithi063 ceph-mon[36747]: pgmap v758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:41:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:29 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:rejoin 2024-07-26T08:41:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:29 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:29 smithi063 ceph-mon[36747]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:30 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:30 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:active 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:30 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:30 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 336.711383 secs 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:30 smithi133 podman[73385]: 2024-07-26 08:41:30.125863665 +0000 UTC m=+0.729623627 container remove 91bb80599d10964a39d38f2643579c4b6bc9c5f20f182b69cdde12cf2468f994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:30 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:41:30.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:30 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:41:30.517 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:30 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.879s CPU time. 2024-07-26T08:41:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:30 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:30 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:active 2024-07-26T08:41:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:30 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:30 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:41:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 336.711383 secs 2024-07-26T08:41:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:30 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:30 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/3876188029,v1:172.21.15.133:6833/3876188029] up:active 2024-07-26T08:41:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:30 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:30 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:41:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 336.711383 secs 2024-07-26T08:41:31.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:31 smithi043 ceph-mon[32384]: pgmap v759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8 op/s 2024-07-26T08:41:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 352.198656 secs 2024-07-26T08:41:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:31 smithi133 ceph-mon[37053]: pgmap v759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8 op/s 2024-07-26T08:41:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 352.198656 secs 2024-07-26T08:41:31.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:31 smithi063 ceph-mon[36747]: pgmap v759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8 op/s 2024-07-26T08:41:31.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 352.198656 secs 2024-07-26T08:41:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:33 smithi043 ceph-mon[32384]: pgmap v760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:33 smithi133 ceph-mon[37053]: pgmap v760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:33 smithi063 ceph-mon[36747]: pgmap v760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:35 smithi043 ceph-mon[32384]: pgmap v761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 341.711497 secs 2024-07-26T08:41:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:35 smithi133 ceph-mon[37053]: pgmap v761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 341.711497 secs 2024-07-26T08:41:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:35 smithi063 ceph-mon[36747]: pgmap v761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 341.711497 secs 2024-07-26T08:41:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 357.198774 secs 2024-07-26T08:41:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 357.198774 secs 2024-07-26T08:41:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 357.198774 secs 2024-07-26T08:41:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:37 smithi043 ceph-mon[32384]: pgmap v762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:41:37.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:37 smithi133 ceph-mon[37053]: pgmap v762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:41:37.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:37 smithi063 ceph-mon[36747]: pgmap v762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:41:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:39 smithi043 ceph-mon[32384]: pgmap v763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:39.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:39 smithi133 ceph-mon[37053]: pgmap v763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:39.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:39 smithi063 ceph-mon[36747]: pgmap v763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:40.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:41:40.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 346.711614 secs 2024-07-26T08:41:40.751 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 346.711614 secs 2024-07-26T08:41:40.751 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:40 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:41:40.751 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:40 smithi133 systemd[1]: Stopped Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:40.751 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:40 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.879s CPU time. 2024-07-26T08:41:40.751 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:40 smithi133 systemd[1]: Starting Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:41:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 346.711614 secs 2024-07-26T08:41:41.015 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:40 smithi133 podman[73480]: 2024-07-26 08:41:40.653104672 +0000 UTC m=+0.017939676 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:41:41.016 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:40 smithi133 podman[73480]: 2024-07-26 08:41:40.768391647 +0000 UTC m=+0.133226684 container create c452042e8cf7a4776f89be81f20f91edbd4d2d365e0759869515763f453cd5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-07-26T08:41:41.020 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:41:41.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:41 smithi133 podman[73480]: 2024-07-26 08:41:41.021008418 +0000 UTC m=+0.385843411 container init c452042e8cf7a4776f89be81f20f91edbd4d2d365e0759869515763f453cd5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-07-26T08:41:41.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:41 smithi133 podman[73480]: 2024-07-26 08:41:41.023636599 +0000 UTC m=+0.388471599 container start c452042e8cf7a4776f89be81f20f91edbd4d2d365e0759869515763f453cd5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-07-26T08:41:41.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mds[73499]: -- 172.21.15.133:0/2924186253 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56062201d860 con 0x5606261bfa80 2024-07-26T08:41:41.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: starting mds.l at 2024-07-26T08:41:41.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:41 smithi133 bash[73480]: c452042e8cf7a4776f89be81f20f91edbd4d2d365e0759869515763f453cd5d2 2024-07-26T08:41:41.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:41:41 smithi133 systemd[1]: Started Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:41.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: pgmap v764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:41:41.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 362.198895 secs 2024-07-26T08:41:41.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: slow request 362.198894 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:41:41.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: daemon mds.l restarted 2024-07-26T08:41:41.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:41.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:41:41.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: osdmap e113: 12 total, 12 up, 12 in 2024-07-26T08:41:41.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:boot 2024-07-26T08:41:41.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:41:41.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:41:41.421 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:41 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: pgmap v764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 362.198895 secs 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: slow request 362.198894 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: daemon mds.l restarted 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: osdmap e113: 12 total, 12 up, 12 in 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:boot 2024-07-26T08:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:41:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:41:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:41 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: pgmap v764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:41:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 362.198895 secs 2024-07-26T08:41:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: slow request 362.198894 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: daemon mds.l restarted 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: osdmap e113: 12 total, 12 up, 12 in 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:boot 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:41:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:41:41.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:41 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:43.344 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:43 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:resolve 2024-07-26T08:41:43.344 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:43 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:43.345 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:43 smithi043 ceph-mon[32384]: pgmap v766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:43 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:resolve 2024-07-26T08:41:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:43 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:43 smithi133 ceph-mon[37053]: pgmap v766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:43.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:43 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:resolve 2024-07-26T08:41:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:43 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:43 smithi063 ceph-mon[36747]: pgmap v766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:41:43.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 -- 172.21.15.43:0/1509214580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810b860 msgr2=0x7efca8112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 --2- 172.21.15.43:0/1509214580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810b860 0x7efca8112090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efca0009be0 tx=0x7efca002a6c0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 -- 172.21.15.43:0/1509214580 shutdown_connections 2024-07-26T08:41:43.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 --2- 172.21.15.43:0/1509214580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810b860 0x7efca8112090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 --2- 172.21.15.43:0/1509214580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810af10 0x7efca810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 --2- 172.21.15.43:0/1509214580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efca81055d0 0x7efca81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 -- 172.21.15.43:0/1509214580 >> 172.21.15.43:0/1509214580 conn(0x7efca8101040 msgr2=0x7efca8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:43.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 -- 172.21.15.43:0/1509214580 shutdown_connections 2024-07-26T08:41:43.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.856+0000 7efcade00640 1 -- 172.21.15.43:0/1509214580 wait complete. 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.858+0000 7efcade00640 1 Processor -- start 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.858+0000 7efcade00640 1 -- start start 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcade00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efca81055d0 0x7efca819bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcade00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810af10 0x7efca819c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcade00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 0x7efca81a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcade00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efca8115660 con 0x7efca81055d0 2024-07-26T08:41:43.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcade00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efca81154e0 con 0x7efca810b860 2024-07-26T08:41:43.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcade00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efca81157e0 con 0x7efca810af10 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcad400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 0x7efca81a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcad400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 0x7efca81a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:50448/0 (socket says 172.21.15.43:50448) 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcaca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efca81055d0 0x7efca819bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efcad400640 1 -- 172.21.15.43:0/438763426 learned_addr learned my addr 172.21.15.43:0/438763426 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.859+0000 7efca7e00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810af10 0x7efca819c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efcad400640 1 -- 172.21.15.43:0/438763426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810af10 msgr2=0x7efca819c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efcad400640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810af10 0x7efca819c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efcad400640 1 -- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efca81055d0 msgr2=0x7efca819bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efcad400640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efca81055d0 0x7efca819bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efcad400640 1 -- 172.21.15.43:0/438763426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca81a1f40 con 0x7efca810b860 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efcad400640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 0x7efca81a1810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efca0004af0 tx=0x7efca0032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efca5600640 1 -- 172.21.15.43:0/438763426 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0041020 con 0x7efca810b860 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efca5600640 1 -- 172.21.15.43:0/438763426 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efca0030e90 con 0x7efca810b860 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.860+0000 7efca5600640 1 -- 172.21.15.43:0/438763426 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0036040 con 0x7efca810b860 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.861+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca81a21d0 con 0x7efca810b860 2024-07-26T08:41:43.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.861+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca81a8990 con 0x7efca810b860 2024-07-26T08:41:43.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.864+0000 7efcb621e740 1 Processor -- start 2024-07-26T08:41:43.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efca5600640 1 -- 172.21.15.43:0/438763426 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7efca0044020 con 0x7efca810b860 2024-07-26T08:41:43.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 -- start start 2024-07-26T08:41:43.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e169e070 0x55b9e1a431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 0x55b9e1a43700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a43c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b9e19b9b90 con 0x55b9e167d390 2024-07-26T08:41:43.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b9e19a9090 con 0x55b9e169e070 2024-07-26T08:41:43.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.865+0000 7efcb621e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b9e19ad0d0 con 0x55b9e16751b0 2024-07-26T08:41:43.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 0x55b9e1a43700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 0x55b9e1a43700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:39630/0 (socket says 172.21.15.43:39630) 2024-07-26T08:41:43.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 -- 172.21.15.43:0/1400780634 learned_addr learned my addr 172.21.15.43:0/1400780634 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:43.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efca7e00640 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e169e070 0x55b9e1a431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efca7e00640 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a43c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 -- 172.21.15.43:0/1400780634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e169e070 msgr2=0x55b9e1a431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e169e070 0x55b9e1a431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 -- 172.21.15.43:0/1400780634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 msgr2=0x55b9e1a43c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a43c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efcaca00640 1 -- 172.21.15.43:0/1400780634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e1709650 con 0x55b9e16751b0 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.866+0000 7efca7e00640 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a43c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.867+0000 7efcaca00640 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 0x55b9e1a43700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009cc0 tx=0x7efc9c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b6347d4f87582c9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:43.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.867+0000 7efc99c00640 1 -- 172.21.15.43:0/1400780634 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c005220 con 0x55b9e16751b0 2024-07-26T08:41:43.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.867+0000 7efc99c00640 1 -- 172.21.15.43:0/1400780634 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc9c004c70 con 0x55b9e16751b0 2024-07-26T08:41:43.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.867+0000 7efc99c00640 1 -- 172.21.15.43:0/1400780634 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0197f0 con 0x55b9e16751b0 2024-07-26T08:41:43.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efca5600640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efc900b3d40 0x7efc900b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efca5600640 1 -- 172.21.15.43:0/438763426 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 11430+0+0 (secure 0 0 0) 0x7efca0105730 con 0x7efca810b860 2024-07-26T08:41:43.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efca7e00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efc900b3d40 0x7efc900b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efcb621e740 1 -- 172.21.15.43:0/1400780634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 msgr2=0x55b9e1a43700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efcb621e740 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 0x55b9e1a43700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009cc0 tx=0x7efc9c011810 comp rx=0 tx=0).stop 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efcb621e740 1 -- 172.21.15.43:0/1400780634 shutdown_connections 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efcb621e740 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e16751b0 0x55b9e1a43700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efcb621e740 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a43c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.868+0000 7efcb621e740 1 --2- 172.21.15.43:0/1400780634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e169e070 0x55b9e1a431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.869+0000 7efcb621e740 1 -- 172.21.15.43:0/1400780634 >> 172.21.15.43:0/1400780634 conn(0x55b9e1692460 msgr2=0x55b9e1a410b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.869+0000 7efcb621e740 1 -- 172.21.15.43:0/1400780634 shutdown_connections 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.869+0000 7efcb621e740 1 -- 172.21.15.43:0/1400780634 wait complete. 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.869+0000 7efca7e00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efc900b3d40 0x7efc900b6250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efca8104890 tx=0x7efc94013040 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 -- start start 2024-07-26T08:41:43.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 Processor -- start 2024-07-26T08:41:43.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a4e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a4ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a4f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b9e180c700 con 0x55b9e167d390 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b9e1945660 con 0x55b9e16751b0 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.870+0000 7efcb621e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b9e1a519a0 con 0x55b9e169e070 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efcb621e740 10 client.0 _ll_register_callbacks cb 0x55b9e1955110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a4ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a4ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37130/0 (socket says 172.21.15.43:37130) 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 -- 172.21.15.43:0/4271120914 learned_addr learned my addr 172.21.15.43:0/4271120914 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efcaca00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a4e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efcad400640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a4f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 -- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 msgr2=0x55b9e1a4f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a4f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 -- 172.21.15.43:0/4271120914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 msgr2=0x55b9e1a4e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a4e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efca7e00640 1 -- 172.21.15.43:0/4271120914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e195c800 con 0x55b9e167d390 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.871+0000 7efcaca00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a4e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.872+0000 7efca7e00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a4ec60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc94009690 tx=0x7efc940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d27fb12434d0e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.872+0000 7efc8e000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.872+0000 7efc8e000640 1 -- 172.21.15.43:0/4271120914 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940209d0 con 0x55b9e167d390 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.872+0000 7efc8e000640 1 -- 172.21.15.43:0/4271120914 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 11430+0+0 (secure 0 0 0) 0x7efc9401a070 con 0x55b9e167d390 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.872+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9c004c70 con 0x55b9e167d390 2024-07-26T08:41:43.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efc8e000640 1 -- 172.21.15.43:0/4271120914 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=178) ==== 24+0+0 (secure 0 0 0) 0x7efc94033050 con 0x55b9e167d390 2024-07-26T08:41:43.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 10 client.15891 fetch_fsmap learned FSMap version 178 2024-07-26T08:41:43.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=178,monmap=4+}) -- 0x55b9e1a5d5b0 con 0x55b9e167d390 2024-07-26T08:41:43.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efc8e000640 1 -- 172.21.15.43:0/4271120914 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc9c004c70 con 0x55b9e167d390 2024-07-26T08:41:43.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efc8e000640 1 -- 172.21.15.43:0/4271120914 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 178) ==== 6543+0+0 (secure 0 0 0) 0x7efc94028400 con 0x55b9e167d390 2024-07-26T08:41:43.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 10 client.15891 fetch_fsmap finished waiting for FSMap version 178 2024-07-26T08:41:43.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 20 client.15891 populate_metadata read hostname 'smithi043' 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e165c9f0 0x55b9e1a60e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 4 client.15891 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.873+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9e19bbae0 con 0x55b9e165c9f0 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.874+0000 7efcaca00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e165c9f0 0x55b9e1a60e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.874+0000 7efcaca00640 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e165c9f0 0x55b9e1a60e20 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c1410d642813f0 server_cookie=f559fd7bf8bd87a6 in_seq=0 out_seq=0 2024-07-26T08:41:43.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.874+0000 7efc8e000640 10 client.15891 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:43.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.875+0000 7efc8e000640 1 -- 172.21.15.43:0/4271120914 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9e19bbae0 con 0x55b9e165c9f0 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.875+0000 7efc8e000640 10 client.15891 handle_command_reply: tid=0 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.875+0000 7efcb621e740 1 client.15891 shutdown 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 msgr2=0x55b9e1a4ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a4ec60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc94009690 tx=0x7efc940046c0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 shutdown_connections 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e165c9f0 0x55b9e1a60e20 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a4f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e167d390 0x55b9e1a4ec60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 --2- 172.21.15.43:0/4271120914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a4e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 >> 172.21.15.43:0/4271120914 conn(0x55b9e1692460 msgr2=0x55b9e1a463a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efc8e000640 0 client.15891 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 shutdown_connections 2024-07-26T08:41:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 1 -- 172.21.15.43:0/4271120914 wait complete. 2024-07-26T08:41:43.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.876+0000 7efcb621e740 20 client.15891 trim_cache size 0 max 16384 2024-07-26T08:41:43.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 Processor -- start 2024-07-26T08:41:43.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 -- start start 2024-07-26T08:41:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e16751b0 0x55b9e1a401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 0x55b9e1a4f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a44900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b58f0 con 0x55b9e16751b0 2024-07-26T08:41:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b4b50 con 0x55b9e167d390 2024-07-26T08:41:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.896+0000 7efcb621e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b5220 con 0x55b9e169e070 2024-07-26T08:41:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 0x55b9e1a4f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 0x55b9e1a4f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:50476/0 (socket says 172.21.15.43:50476) 2024-07-26T08:41:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 -- 172.21.15.43:0/2817653663 learned_addr learned my addr 172.21.15.43:0/2817653663 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efcad400640 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a44900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efcaca00640 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e16751b0 0x55b9e1a401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 -- 172.21.15.43:0/2817653663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 msgr2=0x55b9e1a44900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a44900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 -- 172.21.15.43:0/2817653663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e16751b0 msgr2=0x55b9e1a401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.897+0000 7efca7e00640 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e16751b0 0x55b9e1a401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.898+0000 7efca7e00640 1 -- 172.21.15.43:0/2817653663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e1a4f7c0 con 0x55b9e167d390 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.898+0000 7efca7e00640 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 0x55b9e1a4f050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc9400a010 tx=0x7efc94009aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ebfe69636781c9c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.898+0000 7efc99200640 1 -- 172.21.15.43:0/2817653663 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9403c070 con 0x55b9e167d390 2024-07-26T08:41:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.899+0000 7efc99200640 1 -- 172.21.15.43:0/2817653663 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc94028600 con 0x55b9e167d390 2024-07-26T08:41:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.899+0000 7efc99200640 1 -- 172.21.15.43:0/2817653663 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94028e60 con 0x55b9e167d390 2024-07-26T08:41:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 -- 172.21.15.43:0/2817653663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 msgr2=0x55b9e1a4f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 0x55b9e1a4f050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc9400a010 tx=0x7efc94009aa0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 -- 172.21.15.43:0/2817653663 shutdown_connections 2024-07-26T08:41:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e169e070 0x55b9e1a44900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e167d390 0x55b9e1a4f050 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 --2- 172.21.15.43:0/2817653663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e16751b0 0x55b9e1a401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 -- 172.21.15.43:0/2817653663 >> 172.21.15.43:0/2817653663 conn(0x55b9e1692460 msgr2=0x55b9e1a441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 -- 172.21.15.43:0/2817653663 shutdown_connections 2024-07-26T08:41:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.900+0000 7efcb621e740 1 -- 172.21.15.43:0/2817653663 wait complete. 2024-07-26T08:41:43.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.901+0000 7efcb621e740 1 -- start start 2024-07-26T08:41:43.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.901+0000 7efcb621e740 1 Processor -- start 2024-07-26T08:41:43.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.901+0000 7efcb621e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a54670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.901+0000 7efcb621e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e169e070 0x55b9e1a54c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcb621e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e1631da0 0x55b9e1ac17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcb621e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b1e50 con 0x55b9e169e070 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcb621e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b3260 con 0x55b9e16751b0 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcb621e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b24c0 con 0x55b9e1631da0 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcb621e740 10 client.0 _ll_register_callbacks cb 0x7efc940044d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a54670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a54670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:50486/0 (socket says 172.21.15.43:50486) 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 -- 172.21.15.43:0/615589216 learned_addr learned my addr 172.21.15.43:0/615589216 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcad400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e1631da0 0x55b9e1ac17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efca7e00640 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e169e070 0x55b9e1a54c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 -- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e1631da0 msgr2=0x55b9e1ac17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e1631da0 0x55b9e1ac17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 -- 172.21.15.43:0/615589216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e169e070 msgr2=0x55b9e1a54c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:41:43.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e169e070 0x55b9e1a54c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.902+0000 7efcaca00640 1 -- 172.21.15.43:0/615589216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e1ac1e20 con 0x55b9e16751b0 2024-07-26T08:41:43.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.903+0000 7efcaca00640 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a54670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009c90 tx=0x7efc9c011e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8451d60820304995 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:41:43.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.903+0000 7efc8e000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:41:43.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.903+0000 7efc8e000640 1 -- 172.21.15.43:0/615589216 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c032070 con 0x55b9e16751b0 2024-07-26T08:41:43.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.903+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc94028600 con 0x55b9e16751b0 2024-07-26T08:41:43.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.903+0000 7efc8e000640 1 -- 172.21.15.43:0/615589216 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 11430+0+0 (secure 0 0 0) 0x7efc9c004220 con 0x55b9e16751b0 2024-07-26T08:41:43.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efc8e000640 1 -- 172.21.15.43:0/615589216 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=178) ==== 24+0+0 (secure 0 0 0) 0x7efc9c004420 con 0x55b9e16751b0 2024-07-26T08:41:43.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efcb621e740 10 client.26123 fetch_fsmap learned FSMap version 178 2024-07-26T08:41:43.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=178,monmap=4+}) -- 0x55b9e1ac9220 con 0x55b9e16751b0 2024-07-26T08:41:43.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efc8e000640 1 -- 172.21.15.43:0/615589216 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc94028600 con 0x55b9e16751b0 2024-07-26T08:41:43.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efc8e000640 1 -- 172.21.15.43:0/615589216 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 178) ==== 6543+0+0 (secure 0 0 0) 0x7efc9c035070 con 0x55b9e16751b0 2024-07-26T08:41:43.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efcb621e740 10 client.26123 fetch_fsmap finished waiting for FSMap version 178 2024-07-26T08:41:43.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efcb621e740 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:41:43.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.904+0000 7efcb621e740 20 client.26123 populate_metadata read hostname 'smithi043' 2024-07-26T08:41:43.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.905+0000 7efcb621e740 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e1ac9930 0x55b9e1acbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:41:43.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.905+0000 7efcb621e740 4 client.26123 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:41:43.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.905+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b9e19b7580 con 0x55b9e1ac9930 2024-07-26T08:41:43.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.905+0000 7efca7e00640 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e1ac9930 0x55b9e1acbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efca7e00640 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e1ac9930 0x55b9e1acbd50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f857dc3cc1fdf5 server_cookie=b69e197230bbbb1c in_seq=0 out_seq=0 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efc8e000640 10 client.26123 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efc8e000640 1 -- 172.21.15.43:0/615589216 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55b9e19b7580 con 0x55b9e1ac9930 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efc8e000640 10 client.26123 handle_command_reply: tid=0 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 client.26123 shutdown 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 msgr2=0x55b9e1a54670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a54670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009c90 tx=0x7efc9c011e50 comp rx=0 tx=0).stop 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 shutdown_connections 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55b9e1ac9930 0x55b9e1acbd50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b9e1631da0 0x55b9e1ac17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9e169e070 0x55b9e1a54c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 --2- 172.21.15.43:0/615589216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b9e16751b0 0x55b9e1a54670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efc8e000640 0 client.26123 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.906+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 >> 172.21.15.43:0/615589216 conn(0x55b9e1692460 msgr2=0x55b9e1a4ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.907+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 shutdown_connections 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.907+0000 7efcb621e740 1 -- 172.21.15.43:0/615589216 wait complete. 2024-07-26T08:41:43.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.907+0000 7efcb621e740 20 client.26123 trim_cache size 0 max 16384 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:41:43.914 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:41:43.915 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:41:43.915 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:41:43.915 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:41:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.907+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efc900b3d40 msgr2=0x7efc900b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.907+0000 7efcade00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efc900b3d40 0x7efc900b6250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efca8104890 tx=0x7efc94013040 comp rx=0 tx=0).stop 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 msgr2=0x7efca81a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 0x7efca81a1810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efca0004af0 tx=0x7efca0032f90 comp rx=0 tx=0).stop 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 shutdown_connections 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7efc900b3d40 0x7efc900b6250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efca810af10 0x7efca819c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efca810b860 0x7efca81a1810 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 --2- 172.21.15.43:0/438763426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efca81055d0 0x7efca819bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 >> 172.21.15.43:0/438763426 conn(0x7efca8101040 msgr2=0x7efca810a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 shutdown_connections 2024-07-26T08:41:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:41:43.908+0000 7efcade00640 1 -- 172.21.15.43:0/438763426 wait complete. 2024-07-26T08:41:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:44 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:41:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:44 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:41:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:44 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:reconnect 2024-07-26T08:41:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:44 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:44 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:41:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:44 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:41:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:44 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:reconnect 2024-07-26T08:41:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:44 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:44.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:44 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:41:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:44 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:41:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:44 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:reconnect 2024-07-26T08:41:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:44 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:44.800 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:41:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:rejoin 2024-07-26T08:41:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:41:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: pgmap v767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:41:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:active 2024-07-26T08:41:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:41:45.484 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:41:45.484 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: *** Caught signal (Aborted) ** 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: in thread 7f17c3a00640 thread_name:ms_dispatch 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17c9c3e6f0] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17c9c8b94c] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 3: raise() 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 4: abort() 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17c9c2871b] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 6: /lib64/libc.so.6(+0x37386) [0x7f17c9c37386] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5643fd0436b9] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5643fd20180c] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5643fd1412ca] 2024-07-26T08:41:45.485 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5643fd111753] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5643fd112a1b] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5643fd0f6752] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5643fd044a56] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5643fd048637] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5643fd048f5e] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5643fd02c03a] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17ca79b407] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 18: (DispatchQueue::entry()+0x60f) [0x7f17ca79bcf9] 2024-07-26T08:41:45.486 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17ca8785a1] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 20: (Thread::entry_wrapper()+0x43) [0x7f17ca625cdd] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17ca625cf9] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17c9c89c02] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17c9d0ec40] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.007+0000 7f17c3a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: in thread 7f17c3a00640 thread_name:ms_dispatch 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17c9c3e6f0] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17c9c8b94c] 2024-07-26T08:41:45.487 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 3: raise() 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 4: abort() 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17c9c2871b] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 6: /lib64/libc.so.6(+0x37386) [0x7f17c9c37386] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5643fd0436b9] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5643fd20180c] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5643fd1412ca] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5643fd111753] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5643fd112a1b] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5643fd0f6752] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5643fd044a56] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5643fd048637] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5643fd048f5e] 2024-07-26T08:41:45.488 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5643fd02c03a] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17ca79b407] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 18: (DispatchQueue::entry()+0x60f) [0x7f17ca79bcf9] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17ca8785a1] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 20: (Thread::entry_wrapper()+0x43) [0x7f17ca625cdd] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17ca625cf9] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17c9c89c02] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17c9d0ec40] 2024-07-26T08:41:45.489 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 0> 2024-07-26T08:41:45.007+0000 7f17c3a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: in thread 7f17c3a00640 thread_name:ms_dispatch 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17c9c3e6f0] 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17c9c8b94c] 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 3: raise() 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 4: abort() 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17c9c2871b] 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 6: /lib64/libc.so.6(+0x37386) [0x7f17c9c37386] 2024-07-26T08:41:45.490 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5643fd0436b9] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5643fd20180c] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5643fd1412ca] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5643fd111753] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5643fd112a1b] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5643fd0f6752] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5643fd044a56] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5643fd048637] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5643fd048f5e] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5643fd02c03a] 2024-07-26T08:41:45.491 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17ca79b407] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 18: (DispatchQueue::entry()+0x60f) [0x7f17ca79bcf9] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17ca8785a1] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 20: (Thread::entry_wrapper()+0x43) [0x7f17ca625cdd] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17ca625cf9] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17c9c89c02] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17c9d0ec40] 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.492 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: -1> 2024-07-26T08:41:45.007+0000 7f17c3a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: in thread 7f17c3a00640 thread_name:ms_dispatch 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17c9c3e6f0] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f17c9c8b94c] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 3: raise() 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 4: abort() 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 5: /lib64/libc.so.6(+0x2871b) [0x7f17c9c2871b] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 6: /lib64/libc.so.6(+0x37386) [0x7f17c9c37386] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5643fd0436b9] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5643fd20180c] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5643fd1412ca] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5643fd111753] 2024-07-26T08:41:45.493 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5643fd112a1b] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5643fd0f6752] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5643fd044a56] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5643fd048637] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5643fd048f5e] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5643fd02c03a] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f17ca79b407] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 18: (DispatchQueue::entry()+0x60f) [0x7f17ca79bcf9] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f17ca8785a1] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 20: (Thread::entry_wrapper()+0x43) [0x7f17ca625cdd] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 21: (Thread::_entry_func(void*)+0xd) [0x7f17ca625cf9] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 22: /lib64/libc.so.6(+0x89c02) [0x7f17c9c89c02] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f17c9d0ec40] 2024-07-26T08:41:45.494 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:41:45.495 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[77649]: 2024-07-26T08:41:45.495 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:45 smithi043 podman[105560]: 2024-07-26 08:41:45.177292618 +0000 UTC m=+0.036714997 container died 705d87625700188f90b0017c5a0e9ee766283352b745b0bcc070c432353aedd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-07-26T08:41:45.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:rejoin 2024-07-26T08:41:45.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:45.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:41:45.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: pgmap v767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:41:45.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:45.519 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:active 2024-07-26T08:41:45.519 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:rejoin 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: pgmap v767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/737804035,v1:172.21.15.43:6837/737804035] up:active 2024-07-26T08:41:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:45 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:41:46.118 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:41:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:41:45.774+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:41:46.364 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 351.711676 secs 2024-07-26T08:41:46.364 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 367.198987 secs 2024-07-26T08:41:46.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 351.711676 secs 2024-07-26T08:41:46.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 367.198987 secs 2024-07-26T08:41:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 351.711676 secs 2024-07-26T08:41:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 367.198987 secs 2024-07-26T08:41:46.732 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:46 smithi043 podman[105560]: 2024-07-26 08:41:46.362634367 +0000 UTC m=+1.222056770 container remove 705d87625700188f90b0017c5a0e9ee766283352b745b0bcc070c432353aedd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-07-26T08:41:46.732 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:46 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:41:47.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:46 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:41:47.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:46 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.829s CPU time. 2024-07-26T08:41:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:47 smithi043 ceph-mon[32384]: pgmap v768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:41:47.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:47 smithi133 ceph-mon[37053]: pgmap v768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:41:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:47 smithi063 ceph-mon[36747]: pgmap v768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:41:49.315 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:49 smithi043 ceph-mon[32384]: pgmap v769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:41:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:49 smithi063 ceph-mon[36747]: pgmap v769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:41:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:49 smithi133 ceph-mon[37053]: pgmap v769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:41:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 356.711799 secs 2024-07-26T08:41:50.697 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 356.711799 secs 2024-07-26T08:41:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 356.711799 secs 2024-07-26T08:41:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:51 smithi043 ceph-mon[32384]: pgmap v770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 372.199129 secs 2024-07-26T08:41:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:51 smithi063 ceph-mon[36747]: pgmap v770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 372.199129 secs 2024-07-26T08:41:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:51 smithi133 ceph-mon[37053]: pgmap v770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:41:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 372.199129 secs 2024-07-26T08:41:53.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:53 smithi063 ceph-mon[36747]: pgmap v771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 183 B/s wr, 9 op/s 2024-07-26T08:41:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:53 smithi043 ceph-mon[32384]: pgmap v771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 183 B/s wr, 9 op/s 2024-07-26T08:41:53.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:53 smithi133 ceph-mon[37053]: pgmap v771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 183 B/s wr, 9 op/s 2024-07-26T08:41:55.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:55 smithi063 ceph-mon[36747]: pgmap v772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:41:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:55 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 361.711923 secs 2024-07-26T08:41:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:55 smithi063 ceph-mon[36747]: slow request 361.711923 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:41:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:55 smithi043 ceph-mon[32384]: pgmap v772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:41:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:55 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 361.711923 secs 2024-07-26T08:41:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:55 smithi043 ceph-mon[32384]: slow request 361.711923 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:41:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:55 smithi133 ceph-mon[37053]: pgmap v772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:41:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:41:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:55 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 361.711923 secs 2024-07-26T08:41:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:55 smithi133 ceph-mon[37053]: slow request 361.711923 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:56 smithi063 ceph-mon[36747]: pgmap v773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:56 smithi063 ceph-mon[36747]: pgmap v774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 110 B/s wr, 10 op/s 2024-07-26T08:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 377.199253 secs 2024-07-26T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:56 smithi043 ceph-mon[32384]: pgmap v773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:56 smithi043 ceph-mon[32384]: pgmap v774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 110 B/s wr, 10 op/s 2024-07-26T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 377.199253 secs 2024-07-26T08:41:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:56 smithi133 ceph-mon[37053]: pgmap v773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:56 smithi133 ceph-mon[37053]: pgmap v774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 110 B/s wr, 10 op/s 2024-07-26T08:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 377.199253 secs 2024-07-26T08:41:57.232 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:41:57.232 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:56 smithi043 systemd[1]: Stopped Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:57.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.829s CPU time. 2024-07-26T08:41:57.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 systemd[1]: Starting Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:41:57.650 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 podman[105796]: 2024-07-26 08:41:57.30357546 +0000 UTC m=+0.043315296 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:41:57.651 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 podman[105796]: 2024-07-26 08:41:57.439168196 +0000 UTC m=+0.178908036 container create d9459020c75cf0467863eb8fd354e59b3363ac343a10d3816842ca51fa12a6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-26T08:41:58.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 podman[105796]: 2024-07-26 08:41:57.754208218 +0000 UTC m=+0.493948095 container init d9459020c75cf0467863eb8fd354e59b3363ac343a10d3816842ca51fa12a6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:41:58.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 podman[105796]: 2024-07-26 08:41:57.766300091 +0000 UTC m=+0.506039954 container start d9459020c75cf0467863eb8fd354e59b3363ac343a10d3816842ca51fa12a6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:41:58.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 ceph-mds[105815]: -- 172.21.15.43:0/2172593118 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4a6fef860 con 0x55e4ab191600 2024-07-26T08:41:58.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: starting mds.d at 2024-07-26T08:41:58.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 bash[105796]: d9459020c75cf0467863eb8fd354e59b3363ac343a10d3816842ca51fa12a6ab 2024-07-26T08:41:58.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:41:57 smithi043 systemd[1]: Started Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: pgmap v775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: daemon mds.d restarted 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: osdmap e114: 12 total, 12 up, 12 in 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:boot 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:41:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:41:58.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:41:58.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:41:58 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: pgmap v775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: daemon mds.d restarted 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: osdmap e114: 12 total, 12 up, 12 in 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:boot 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:41:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:41:58.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:41:58.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:41:58 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:41:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: pgmap v775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-07-26T08:41:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: daemon mds.d restarted 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: osdmap e114: 12 total, 12 up, 12 in 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:boot 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:41:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:41:58 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:00 smithi133 ceph-mon[37053]: pgmap v777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-07-26T08:42:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:00 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:resolve 2024-07-26T08:42:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:00 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 366.712065 secs 2024-07-26T08:42:00.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:00 smithi043 ceph-mon[32384]: pgmap v777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-07-26T08:42:00.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:00 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:resolve 2024-07-26T08:42:00.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:00 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:00.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 366.712065 secs 2024-07-26T08:42:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:00 smithi063 ceph-mon[36747]: pgmap v777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-07-26T08:42:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:00 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:resolve 2024-07-26T08:42:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:00 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 366.712065 secs 2024-07-26T08:42:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 382.199394 secs 2024-07-26T08:42:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:01 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:42:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:01 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:reconnect 2024-07-26T08:42:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:01 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:01 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999981 2024-07-26T08:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 382.199394 secs 2024-07-26T08:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:01 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:01 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:reconnect 2024-07-26T08:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:01 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:01 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999981 2024-07-26T08:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 382.199394 secs 2024-07-26T08:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:01 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:01 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:reconnect 2024-07-26T08:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:01 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:01 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999981 2024-07-26T08:42:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:02 smithi063 ceph-mon[36747]: pgmap v778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-07-26T08:42:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:02 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:rejoin 2024-07-26T08:42:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:02 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:02 smithi063 ceph-mon[36747]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:42:02.925 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-mon[37053]: pgmap v778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-07-26T08:42:02.925 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:rejoin 2024-07-26T08:42:02.925 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:02.925 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-mon[37053]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: *** Caught signal (Aborted) ** 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: in thread 7f2109d09640 thread_name:ms_dispatch 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f210f0e06f0] 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f210f12d94c] 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 3: raise() 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 4: abort() 2024-07-26T08:42:02.926 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 5: /lib64/libc.so.6(+0x2871b) [0x7f210f0ca71b] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 6: /lib64/libc.so.6(+0x37386) [0x7f210f0d9386] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56061fa4e6b9] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56061fc0c80c] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56061fb4c2ca] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56061fb1c753] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56061fb1da1b] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56061fb01752] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56061fa4fa56] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56061fa53637] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56061fa53f5e] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56061fa3703a] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f210f9ad407] 2024-07-26T08:42:02.927 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 18: (DispatchQueue::entry()+0x60f) [0x7f210f9adcf9] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f210fa8a5a1] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 20: (Thread::entry_wrapper()+0x43) [0x7f210f837cdd] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 21: (Thread::_entry_func(void*)+0xd) [0x7f210f837cf9] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 22: /lib64/libc.so.6(+0x89c02) [0x7f210f12bc02] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f210f1b0c40] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.569+0000 7f2109d09640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: in thread 7f2109d09640 thread_name:ms_dispatch 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f210f0e06f0] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f210f12d94c] 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 3: raise() 2024-07-26T08:42:02.928 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 4: abort() 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 5: /lib64/libc.so.6(+0x2871b) [0x7f210f0ca71b] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 6: /lib64/libc.so.6(+0x37386) [0x7f210f0d9386] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56061fa4e6b9] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56061fc0c80c] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56061fb4c2ca] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56061fb1c753] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56061fb1da1b] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56061fb01752] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56061fa4fa56] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56061fa53637] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56061fa53f5e] 2024-07-26T08:42:02.929 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56061fa3703a] 2024-07-26T08:42:02.930 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f210f9ad407] 2024-07-26T08:42:02.930 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 18: (DispatchQueue::entry()+0x60f) [0x7f210f9adcf9] 2024-07-26T08:42:02.930 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f210fa8a5a1] 2024-07-26T08:42:02.930 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 20: (Thread::entry_wrapper()+0x43) [0x7f210f837cdd] 2024-07-26T08:42:02.930 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 21: (Thread::_entry_func(void*)+0xd) [0x7f210f837cf9] 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 22: /lib64/libc.so.6(+0x89c02) [0x7f210f12bc02] 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f210f1b0c40] 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 0> 2024-07-26T08:42:02.569+0000 7f2109d09640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: in thread 7f2109d09640 thread_name:ms_dispatch 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f210f0e06f0] 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f210f12d94c] 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 3: raise() 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 4: abort() 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 5: /lib64/libc.so.6(+0x2871b) [0x7f210f0ca71b] 2024-07-26T08:42:02.931 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 6: /lib64/libc.so.6(+0x37386) [0x7f210f0d9386] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56061fa4e6b9] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56061fc0c80c] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56061fb4c2ca] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56061fb1c753] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56061fb1da1b] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56061fb01752] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56061fa4fa56] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56061fa53637] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56061fa53f5e] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56061fa3703a] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f210f9ad407] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 18: (DispatchQueue::entry()+0x60f) [0x7f210f9adcf9] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f210fa8a5a1] 2024-07-26T08:42:02.932 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 20: (Thread::entry_wrapper()+0x43) [0x7f210f837cdd] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 21: (Thread::_entry_func(void*)+0xd) [0x7f210f837cf9] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 22: /lib64/libc.so.6(+0x89c02) [0x7f210f12bc02] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f210f1b0c40] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 0> 2024-07-26T08:42:02.569+0000 7f2109d09640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: in thread 7f2109d09640 thread_name:ms_dispatch 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f210f0e06f0] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f210f12d94c] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 3: raise() 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 4: abort() 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 5: /lib64/libc.so.6(+0x2871b) [0x7f210f0ca71b] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 6: /lib64/libc.so.6(+0x37386) [0x7f210f0d9386] 2024-07-26T08:42:02.933 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56061fa4e6b9] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56061fc0c80c] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56061fb4c2ca] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56061fb1c753] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56061fb1da1b] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56061fb01752] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56061fa4fa56] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56061fa53637] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56061fa53f5e] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56061fa3703a] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f210f9ad407] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 18: (DispatchQueue::entry()+0x60f) [0x7f210f9adcf9] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f210fa8a5a1] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 20: (Thread::entry_wrapper()+0x43) [0x7f210f837cdd] 2024-07-26T08:42:02.934 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 21: (Thread::_entry_func(void*)+0xd) [0x7f210f837cf9] 2024-07-26T08:42:02.935 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 22: /lib64/libc.so.6(+0x89c02) [0x7f210f12bc02] 2024-07-26T08:42:02.935 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f210f1b0c40] 2024-07-26T08:42:02.935 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:02.935 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73495]: 2024-07-26T08:42:02.935 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:02 smithi133 podman[73661]: 2024-07-26 08:42:02.630702516 +0000 UTC m=+0.019993686 container died c452042e8cf7a4776f89be81f20f91edbd4d2d365e0759869515763f453cd5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T08:42:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:02 smithi043 ceph-mon[32384]: pgmap v778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-07-26T08:42:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:02 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:rejoin 2024-07-26T08:42:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:02 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:02 smithi043 ceph-mon[32384]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:42:03.515 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:03 smithi133 podman[73661]: 2024-07-26 08:42:03.258514307 +0000 UTC m=+0.647805480 container remove c452042e8cf7a4776f89be81f20f91edbd4d2d365e0759869515763f453cd5d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T08:42:03.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:03 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:42:03.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:03 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:42:03.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:03 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.865s CPU time. 2024-07-26T08:42:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:03 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:03 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:active 2024-07-26T08:42:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:03 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:03 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:03 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:03 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:active 2024-07-26T08:42:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:03 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:03 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:03 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:03 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/1169720192,v1:172.21.15.133:6833/1169720192] up:active 2024-07-26T08:42:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:03 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:03 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:04 smithi043 ceph-mon[32384]: pgmap v779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 127 B/s wr, 7 op/s 2024-07-26T08:42:05.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:04 smithi133 ceph-mon[37053]: pgmap v779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 127 B/s wr, 7 op/s 2024-07-26T08:42:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:04 smithi063 ceph-mon[36747]: pgmap v779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 127 B/s wr, 7 op/s 2024-07-26T08:42:06.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:06 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 371.712209 secs 2024-07-26T08:42:06.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:06 smithi043 ceph-mon[32384]: slow request 364.405221 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:42:06.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:06 smithi043 ceph-mon[32384]: pgmap v780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:06.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 387.199540 secs 2024-07-26T08:42:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:06 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 371.712209 secs 2024-07-26T08:42:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:06 smithi133 ceph-mon[37053]: slow request 364.405221 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:42:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:06 smithi133 ceph-mon[37053]: pgmap v780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 387.199540 secs 2024-07-26T08:42:06.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:06 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 371.712209 secs 2024-07-26T08:42:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:06 smithi063 ceph-mon[36747]: slow request 364.405221 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:42:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:06 smithi063 ceph-mon[36747]: pgmap v780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 387.199540 secs 2024-07-26T08:42:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:08 smithi133 ceph-mon[37053]: pgmap v781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:42:08.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:08 smithi063 ceph-mon[36747]: pgmap v781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:42:08.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:08 smithi043 ceph-mon[32384]: pgmap v781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:42:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:10 smithi133 ceph-mon[37053]: pgmap v782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 177 B/s wr, 10 op/s 2024-07-26T08:42:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 376.712326 secs 2024-07-26T08:42:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:10 smithi063 ceph-mon[36747]: pgmap v782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 177 B/s wr, 10 op/s 2024-07-26T08:42:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 376.712326 secs 2024-07-26T08:42:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:10 smithi043 ceph-mon[32384]: pgmap v782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 177 B/s wr, 10 op/s 2024-07-26T08:42:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 376.712326 secs 2024-07-26T08:42:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 392.199677 secs 2024-07-26T08:42:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 392.199677 secs 2024-07-26T08:42:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 392.199677 secs 2024-07-26T08:42:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:12 smithi063 ceph-mon[36747]: pgmap v783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:12 smithi043 ceph-mon[32384]: pgmap v783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:12 smithi133 ceph-mon[37053]: pgmap v783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:13.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:13 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:42:13.776 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:13 smithi133 systemd[1]: Stopped Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:42:13.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:13 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.865s CPU time. 2024-07-26T08:42:13.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:13 smithi133 systemd[1]: Starting Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:42:13.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:13 smithi133 podman[73750]: 2024-07-26 08:42:13.650986748 +0000 UTC m=+0.017747201 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:42:13.777 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:13 smithi133 podman[73750]: 2024-07-26 08:42:13.775879508 +0000 UTC m=+0.142639988 container create 1981fdefbf599af6fae00ad91c0eef555e283cb4b3de67cc44f2c65ae8e15251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:42:14.307 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:14 smithi133 podman[73750]: 2024-07-26 08:42:14.036848555 +0000 UTC m=+0.403609000 container init 1981fdefbf599af6fae00ad91c0eef555e283cb4b3de67cc44f2c65ae8e15251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.build-date=20240724, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-07-26T08:42:14.307 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:14 smithi133 podman[73750]: 2024-07-26 08:42:14.039645584 +0000 UTC m=+0.406406023 container start 1981fdefbf599af6fae00ad91c0eef555e283cb4b3de67cc44f2c65ae8e15251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724) 2024-07-26T08:42:14.307 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mds[73769]: -- 172.21.15.133:0/348621214 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9d0d6d860 con 0x55c9d4f0f180 2024-07-26T08:42:14.307 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: starting mds.l at 2024-07-26T08:42:14.308 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:14 smithi133 bash[73750]: 1981fdefbf599af6fae00ad91c0eef555e283cb4b3de67cc44f2c65ae8e15251 2024-07-26T08:42:14.308 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:14 smithi133 systemd[1]: Started Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: pgmap v784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: daemon mds.l restarted 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: osdmap e115: 12 total, 12 up, 12 in 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:boot 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:42:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:42:14.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:14 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:14.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: pgmap v784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: daemon mds.l restarted 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: osdmap e115: 12 total, 12 up, 12 in 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:boot 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:42:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:14 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:14.889 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: pgmap v784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:14.889 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: daemon mds.l restarted 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: osdmap e115: 12 total, 12 up, 12 in 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:boot 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:42:14.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:14 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:15.349 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:42:16.329 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 381.712388 secs 2024-07-26T08:42:16.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:16 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:resolve 2024-07-26T08:42:16.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:16 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:16.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:16 smithi043 ceph-mon[32384]: pgmap v786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:42:16.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 397.199761 secs 2024-07-26T08:42:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 381.712388 secs 2024-07-26T08:42:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:16 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:resolve 2024-07-26T08:42:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:16 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:16 smithi133 ceph-mon[37053]: pgmap v786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:42:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 397.199761 secs 2024-07-26T08:42:16.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 381.712388 secs 2024-07-26T08:42:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:16 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:resolve 2024-07-26T08:42:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:16 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:16 smithi063 ceph-mon[36747]: pgmap v786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:42:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 397.199761 secs 2024-07-26T08:42:17.362 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:17 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:42:17.362 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:17 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:reconnect 2024-07-26T08:42:17.363 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:17 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:17.363 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:17 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:42:17.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:17 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:42:17.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:17 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:reconnect 2024-07-26T08:42:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:17 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:17 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:42:17.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:17 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:42:17.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:17 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:reconnect 2024-07-26T08:42:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:17 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:17 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.932+0000 7fe077200640 1 -- 172.21.15.43:0/3161873535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 msgr2=0x7fe0781164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.932+0000 7fe077200640 1 --2- 172.21.15.43:0/3161873535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 0x7fe0781164b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe070009ca0 tx=0x7fe07002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 -- 172.21.15.43:0/3161873535 shutdown_connections 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 --2- 172.21.15.43:0/3161873535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07810f330 0x7fe07810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 --2- 172.21.15.43:0/3161873535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 0x7fe0781164b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 --2- 172.21.15.43:0/3161873535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0781099f0 0x7fe078109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 -- 172.21.15.43:0/3161873535 >> 172.21.15.43:0/3161873535 conn(0x7fe078078ff0 msgr2=0x7fe078107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 -- 172.21.15.43:0/3161873535 shutdown_connections 2024-07-26T08:42:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.933+0000 7fe077200640 1 -- 172.21.15.43:0/3161873535 wait complete. 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.934+0000 7fe077200640 1 Processor -- start 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.934+0000 7fe077200640 1 -- start start 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe077200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 0x7fe0781a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe077200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07810f330 0x7fe0781a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe077200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 0x7fe0781a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe077200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe078119ad0 con 0x7fe07810fc80 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe077200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe078119950 con 0x7fe07810f330 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe077200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe078119c50 con 0x7fe0781099f0 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe075e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 0x7fe0781a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe075e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 0x7fe0781a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:59374/0 (socket says 172.21.15.43:59374) 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe075e00640 1 -- 172.21.15.43:0/3382607068 learned_addr learned my addr 172.21.15.43:0/3382607068 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe076800640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 0x7fe0781a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.935+0000 7fe075400640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07810f330 0x7fe0781a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe075e00640 1 -- 172.21.15.43:0/3382607068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07810f330 msgr2=0x7fe0781a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe075e00640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07810f330 0x7fe0781a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe075e00640 1 -- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 msgr2=0x7fe0781a5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe075e00640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 0x7fe0781a5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe075e00640 1 -- 172.21.15.43:0/3382607068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0781a6330 con 0x7fe0781099f0 2024-07-26T08:42:17.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe075e00640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 0x7fe0781a03c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d950 tx=0x7fe06800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:17.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe06ea00640 1 -- 172.21.15.43:0/3382607068 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068017070 con 0x7fe0781099f0 2024-07-26T08:42:17.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe06ea00640 1 -- 172.21.15.43:0/3382607068 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe068009c30 con 0x7fe0781099f0 2024-07-26T08:42:17.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe06ea00640 1 -- 172.21.15.43:0/3382607068 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06800f6b0 con 0x7fe0781099f0 2024-07-26T08:42:17.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0781a6620 con 0x7fe0781099f0 2024-07-26T08:42:17.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.936+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0781acd80 con 0x7fe0781099f0 2024-07-26T08:42:17.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 Processor -- start 2024-07-26T08:42:17.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 -- start start 2024-07-26T08:42:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f63000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f63540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f63a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556aa9ed9bc0 con 0x556aa9b951b0 2024-07-26T08:42:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556aa9ec90c0 con 0x556aa9b9d390 2024-07-26T08:42:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.940+0000 7fe083a3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556aa9ecd100 con 0x556aa9bbe070 2024-07-26T08:42:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe06ea00640 1 -- 172.21.15.43:0/3382607068 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe0680109c0 con 0x7fe0781099f0 2024-07-26T08:42:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe076800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f63000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe076800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f63000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:59390/0 (socket says 172.21.15.43:59390) 2024-07-26T08:42:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe076800640 1 -- 172.21.15.43:0/1493801430 learned_addr learned my addr 172.21.15.43:0/1493801430 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075400640 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f63a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075e00640 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f63540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075400640 1 -- 172.21.15.43:0/1493801430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 msgr2=0x556aa9f63000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075400640 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f63000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075400640 1 -- 172.21.15.43:0/1493801430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 msgr2=0x556aa9f63540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075400640 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f63540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075400640 1 -- 172.21.15.43:0/1493801430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa9c29650 con 0x556aa9b9d390 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.941+0000 7fe075e00640 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f63540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.942+0000 7fe075400640 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f63a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe07806bfe0 tx=0x7fe064011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861a6adfc8559834 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.942+0000 7fe063400640 1 -- 172.21.15.43:0/1493801430 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064004250 con 0x556aa9b9d390 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.942+0000 7fe063400640 1 -- 172.21.15.43:0/1493801430 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe064009e10 con 0x556aa9b9d390 2024-07-26T08:42:17.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.942+0000 7fe063400640 1 -- 172.21.15.43:0/1493801430 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064004e00 con 0x556aa9b9d390 2024-07-26T08:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe06ea00640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe05c0b3d40 0x7fe05c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe06ea00640 1 -- 172.21.15.43:0/3382607068 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 11602+0+0 (secure 0 0 0) 0x7fe0680e4820 con 0x7fe0781099f0 2024-07-26T08:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe076800640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe05c0b3d40 0x7fe05c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 -- 172.21.15.43:0/1493801430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 msgr2=0x556aa9f63a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f63a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe07806bfe0 tx=0x7fe064011810 comp rx=0 tx=0).stop 2024-07-26T08:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 -- 172.21.15.43:0/1493801430 shutdown_connections 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f63a80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f63540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 --2- 172.21.15.43:0/1493801430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f63000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 -- 172.21.15.43:0/1493801430 >> 172.21.15.43:0/1493801430 conn(0x556aa9bb2460 msgr2=0x556aa9f60ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.943+0000 7fe083a3d740 1 -- 172.21.15.43:0/1493801430 shutdown_connections 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.944+0000 7fe083a3d740 1 -- 172.21.15.43:0/1493801430 wait complete. 2024-07-26T08:42:17.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.944+0000 7fe076800640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe05c0b3d40 0x7fe05c0b6250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe070009a60 tx=0x7fe070005d80 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.944+0000 7fe083a3d740 1 -- start start 2024-07-26T08:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 Processor -- start 2024-07-26T08:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f6e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f6eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f6f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556aa9d2c700 con 0x556aa9b9d390 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556aa9e65690 con 0x556aa9bbe070 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556aa9f717e0 con 0x556aa9b951b0 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe083a3d740 10 client.0 _ll_register_callbacks cb 0x556aa9e75140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.945+0000 7fe075400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f6eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f6e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe076800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f6f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f6e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:59394/0 (socket says 172.21.15.43:59394) 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 -- 172.21.15.43:0/642829327 learned_addr learned my addr 172.21.15.43:0/642829327 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f6eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43426/0 (socket says 172.21.15.43:43426) 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 -- 172.21.15.43:0/642829327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 msgr2=0x556aa9f6f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f6f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 -- 172.21.15.43:0/642829327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 msgr2=0x556aa9f6eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f6eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 -- 172.21.15.43:0/642829327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aa9e7c830 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe075e00640 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f6e5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe068000c00 tx=0x7fe0680aa770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb884bebf4438a5d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.946+0000 7fe057e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe057e00640 1 -- 172.21.15.43:0/642829327 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068020030 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe057e00640 1 -- 172.21.15.43:0/642829327 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 11602+0+0 (secure 0 0 0) 0x7fe0680a6e60 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe064009e10 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe057e00640 1 -- 172.21.15.43:0/642829327 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=192) ==== 24+0+0 (secure 0 0 0) 0x7fe0680bfe60 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe083a3d740 10 client.26152 fetch_fsmap learned FSMap version 192 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=192,monmap=4+}) -- 0x556aa9f7d3d0 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe057e00640 1 -- 172.21.15.43:0/642829327 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe064009e10 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.947+0000 7fe057e00640 1 -- 172.21.15.43:0/642829327 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 192) ==== 6543+0+0 (secure 0 0 0) 0x7fe0680abaf0 con 0x556aa9b951b0 2024-07-26T08:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe083a3d740 10 client.26152 fetch_fsmap finished waiting for FSMap version 192 2024-07-26T08:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe083a3d740 10 client.26152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe083a3d740 20 client.26152 populate_metadata read hostname 'smithi043' 2024-07-26T08:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe083a3d740 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b7c9f0 0x556aa9f809a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe083a3d740 4 client.26152 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aa9edbb10 con 0x556aa9b7c9f0 2024-07-26T08:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.948+0000 7fe075400640 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b7c9f0 0x556aa9f809a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.949+0000 7fe075400640 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b7c9f0 0x556aa9f809a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3657c52c1f453dc2 server_cookie=51bbec47ca3c7f40 in_seq=0 out_seq=0 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.949+0000 7fe057e00640 10 client.26152 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe057e00640 1 -- 172.21.15.43:0/642829327 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556aa9edbb10 con 0x556aa9b7c9f0 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe057e00640 10 client.26152 handle_command_reply: tid=0 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 client.26152 shutdown 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 msgr2=0x556aa9f6e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f6e5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe068000c00 tx=0x7fe0680aa770 comp rx=0 tx=0).stop 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 shutdown_connections 2024-07-26T08:42:17.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b7c9f0 0x556aa9f809a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f6f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f6eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 --2- 172.21.15.43:0/642829327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f6e5d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe057e00640 0 client.26152 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 >> 172.21.15.43:0/642829327 conn(0x556aa9bb2460 msgr2=0x556aa9f66190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 shutdown_connections 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 1 -- 172.21.15.43:0/642829327 wait complete. 2024-07-26T08:42:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.950+0000 7fe083a3d740 20 client.26152 trim_cache size 0 max 16384 2024-07-26T08:42:17.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.969+0000 7fe083a3d740 1 Processor -- start 2024-07-26T08:42:17.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 -- start start 2024-07-26T08:42:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f5f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f64740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0781b9d60 con 0x556aa9b951b0 2024-07-26T08:42:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0781b8fc0 con 0x556aa9b9d390 2024-07-26T08:42:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.970+0000 7fe083a3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0781b9690 con 0x556aa9bbe070 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f5f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f5f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:48670/0 (socket says 172.21.15.43:48670) 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 -- 172.21.15.43:0/2599785460 learned_addr learned my addr 172.21.15.43:0/2599785460 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe076800640 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f64740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 -- 172.21.15.43:0/2599785460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 msgr2=0x556aa9f64740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f64740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 -- 172.21.15.43:0/2599785460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 msgr2=0x556aa9f704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075400640 1 -- 172.21.15.43:0/2599785460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa9f6f890 con 0x556aa9b9d390 2024-07-26T08:42:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.971+0000 7fe075e00640 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:42:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.972+0000 7fe075400640 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f5f530 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe064005890 tx=0x7fe064009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261a3e1ff160ffa2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.972+0000 7fe062a00640 1 -- 172.21.15.43:0/2599785460 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064033070 con 0x556aa9b9d390 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.972+0000 7fe062a00640 1 -- 172.21.15.43:0/2599785460 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe06401f040 con 0x556aa9b9d390 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.972+0000 7fe062a00640 1 -- 172.21.15.43:0/2599785460 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064003950 con 0x556aa9b9d390 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 -- 172.21.15.43:0/2599785460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 msgr2=0x556aa9f5f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f5f530 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe064005890 tx=0x7fe064009b00 comp rx=0 tx=0).stop 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 -- 172.21.15.43:0/2599785460 shutdown_connections 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9bbe070 0x556aa9f64740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9b9d390 0x556aa9f5f530 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2599785460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b951b0 0x556aa9f704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.973+0000 7fe083a3d740 1 -- 172.21.15.43:0/2599785460 >> 172.21.15.43:0/2599785460 conn(0x556aa9bb2460 msgr2=0x556aa9f64030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.974+0000 7fe083a3d740 1 -- 172.21.15.43:0/2599785460 shutdown_connections 2024-07-26T08:42:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.974+0000 7fe083a3d740 1 -- 172.21.15.43:0/2599785460 wait complete. 2024-07-26T08:42:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.974+0000 7fe083a3d740 1 -- start start 2024-07-26T08:42:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.974+0000 7fe083a3d740 1 Processor -- start 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f76e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f74350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f74890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0781b62c0 con 0x556aa9b9d390 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0781b76d0 con 0x556aa9bbe070 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0781b6930 con 0x556aa9b951b0 2024-07-26T08:42:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe083a3d740 10 client.0 _ll_register_callbacks cb 0x7fe0680a6d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe075400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f74350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe075400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f74350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43444/0 (socket says 172.21.15.43:43444) 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe075400640 1 -- 172.21.15.43:0/2306394867 learned_addr learned my addr 172.21.15.43:0/2306394867 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.975+0000 7fe076800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f74890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075e00640 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f76e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075400640 1 -- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 msgr2=0x556aa9f76e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075400640 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f76e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075400640 1 -- 172.21.15.43:0/2306394867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 msgr2=0x556aa9f74890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075400640 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f74890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075400640 1 -- 172.21.15.43:0/2306394867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aa9f74dd0 con 0x556aa9b9d390 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe075400640 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f74350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe064011850 tx=0x7fe064009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76866bb70bfb89b8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.976+0000 7fe057e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.977+0000 7fe057e00640 1 -- 172.21.15.43:0/2306394867 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064033070 con 0x556aa9b9d390 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.977+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe06401f040 con 0x556aa9b9d390 2024-07-26T08:42:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.977+0000 7fe057e00640 1 -- 172.21.15.43:0/2306394867 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 11602+0+0 (secure 0 0 0) 0x7fe064025640 con 0x556aa9b9d390 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.977+0000 7fe057e00640 1 -- 172.21.15.43:0/2306394867 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=192) ==== 24+0+0 (secure 0 0 0) 0x7fe064025840 con 0x556aa9b9d390 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.977+0000 7fe083a3d740 10 client.15918 fetch_fsmap learned FSMap version 192 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.977+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=192,monmap=4+}) -- 0x556aa9fe8d50 con 0x556aa9b9d390 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe057e00640 1 -- 172.21.15.43:0/2306394867 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe06401f040 con 0x556aa9b9d390 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe057e00640 1 -- 172.21.15.43:0/2306394867 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 192) ==== 6543+0+0 (secure 0 0 0) 0x7fe064018070 con 0x556aa9b9d390 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe083a3d740 10 client.15918 fetch_fsmap finished waiting for FSMap version 192 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe083a3d740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe083a3d740 20 client.15918 populate_metadata read hostname 'smithi043' 2024-07-26T08:42:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b51da0 0x556aa9feb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:17.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe083a3d740 4 client.15918 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:42:17.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556aa9ed75b0 con 0x556aa9b51da0 2024-07-26T08:42:17.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.978+0000 7fe075e00640 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b51da0 0x556aa9feb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe075e00640 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b51da0 0x556aa9feb3d0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb72b5848229941 server_cookie=e50c78329720532e in_seq=0 out_seq=0 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe057e00640 10 client.15918 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe057e00640 1 -- 172.21.15.43:0/2306394867 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x556aa9ed75b0 con 0x556aa9b51da0 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe057e00640 10 client.15918 handle_command_reply: tid=0 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe083a3d740 1 client.15918 shutdown 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 msgr2=0x556aa9f74350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.979+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f74350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe064011850 tx=0x7fe064009800 comp rx=0 tx=0).stop 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 shutdown_connections 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556aa9b51da0 0x556aa9feb3d0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556aa9bbe070 0x556aa9f74890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aa9b9d390 0x556aa9f74350 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 --2- 172.21.15.43:0/2306394867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556aa9b951b0 0x556aa9f76e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 >> 172.21.15.43:0/2306394867 conn(0x556aa9bb2460 msgr2=0x556aa9f648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe057e00640 0 client.15918 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 shutdown_connections 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 1 -- 172.21.15.43:0/2306394867 wait complete. 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.980+0000 7fe083a3d740 20 client.15918 trim_cache size 0 max 16384 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:42:17.983 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:42:17.984 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe05c0b3d40 msgr2=0x7fe05c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe05c0b3d40 0x7fe05c0b6250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe070009a60 tx=0x7fe070005d80 comp rx=0 tx=0).stop 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 msgr2=0x7fe0781a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 0x7fe0781a03c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d950 tx=0x7fe06800de10 comp rx=0 tx=0).stop 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 shutdown_connections 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe05c0b3d40 0x7fe05c0b6250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe07810fc80 0x7fe0781a5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07810f330 0x7fe0781a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 --2- 172.21.15.43:0/3382607068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0781099f0 0x7fe0781a03c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 >> 172.21.15.43:0/3382607068 conn(0x7fe078078ff0 msgr2=0x7fe0780795d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 shutdown_connections 2024-07-26T08:42:17.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:17.981+0000 7fe077200640 1 -- 172.21.15.43:0/3382607068 wait complete. 2024-07-26T08:42:18.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:rejoin 2024-07-26T08:42:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-mon[32384]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:42:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-mon[32384]: pgmap v787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: *** Caught signal (Aborted) ** 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: in thread 7fe1ebe00640 thread_name:ms_dispatch 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1f203e6f0] 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1f208b94c] 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 3: raise() 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 4: abort() 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1f202871b] 2024-07-26T08:42:18.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1f2037386] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e476ec66b9] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e47708480c] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e476fc42ca] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e476f94753] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e476f95a1b] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e476f79752] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e476ec7a56] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e476ecb637] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e476ecbf5e] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e476eaf03a] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1f2b9b407] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1f2b9bcf9] 2024-07-26T08:42:18.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1f2c785a1] 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1f2a25cdd] 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1f2a25cf9] 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1f2089c02] 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1f210ec40] 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.164+0000 7fe1ebe00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: in thread 7fe1ebe00640 thread_name:ms_dispatch 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:18.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1f203e6f0] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1f208b94c] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 3: raise() 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 4: abort() 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1f202871b] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1f2037386] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e476ec66b9] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e47708480c] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e476fc42ca] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e476f94753] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e476f95a1b] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e476f79752] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e476ec7a56] 2024-07-26T08:42:18.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e476ecb637] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e476ecbf5e] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e476eaf03a] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1f2b9b407] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1f2b9bcf9] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1f2c785a1] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1f2a25cdd] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1f2a25cf9] 2024-07-26T08:42:18.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1f2089c02] 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1f210ec40] 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 0> 2024-07-26T08:42:18.164+0000 7fe1ebe00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: in thread 7fe1ebe00640 thread_name:ms_dispatch 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1f203e6f0] 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1f208b94c] 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 3: raise() 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 4: abort() 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1f202871b] 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1f2037386] 2024-07-26T08:42:18.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e476ec66b9] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e47708480c] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e476fc42ca] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e476f94753] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e476f95a1b] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e476f79752] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e476ec7a56] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e476ecb637] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e476ecbf5e] 2024-07-26T08:42:18.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e476eaf03a] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1f2b9b407] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1f2b9bcf9] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1f2c785a1] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1f2a25cdd] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1f2a25cf9] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1f2089c02] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1f210ec40] 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 0> 2024-07-26T08:42:18.164+0000 7fe1ebe00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: in thread 7fe1ebe00640 thread_name:ms_dispatch 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1f203e6f0] 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1f208b94c] 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 3: raise() 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 4: abort() 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1f202871b] 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1f2037386] 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e476ec66b9] 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e47708480c] 2024-07-26T08:42:18.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e476fc42ca] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e476f94753] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e476f95a1b] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e476f79752] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e476ec7a56] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e476ecb637] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e476ecbf5e] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e476eaf03a] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1f2b9b407] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1f2b9bcf9] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1f2c785a1] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1f2a25cdd] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1f2a25cf9] 2024-07-26T08:42:18.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1f2089c02] 2024-07-26T08:42:18.245 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1f210ec40] 2024-07-26T08:42:18.245 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:18.245 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[105810]: 2024-07-26T08:42:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:18 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:rejoin 2024-07-26T08:42:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:18 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:18 smithi133 ceph-mon[37053]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:42:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:18 smithi133 ceph-mon[37053]: pgmap v787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:18 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:rejoin 2024-07-26T08:42:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:18 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:18 smithi063 ceph-mon[36747]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:42:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:18 smithi063 ceph-mon[36747]: pgmap v787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:19.017 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:42:19.135 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:19 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:19.136 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:19 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:active 2024-07-26T08:42:19.232 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:18 smithi043 podman[106029]: 2024-07-26 08:42:18.97684804 +0000 UTC m=+0.711257526 container died d9459020c75cf0467863eb8fd354e59b3363ac343a10d3816842ca51fa12a6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-07-26T08:42:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:19 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:19 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:active 2024-07-26T08:42:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:19 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:19 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:19.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:19 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:19 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:19.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:19 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:19 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/888824582,v1:172.21.15.43:6837/888824582] up:active 2024-07-26T08:42:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:19 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:19 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:20.147 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:19 smithi043 podman[106029]: 2024-07-26 08:42:19.751509188 +0000 UTC m=+1.485918673 container remove d9459020c75cf0467863eb8fd354e59b3363ac343a10d3816842ca51fa12a6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724) 2024-07-26T08:42:20.147 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:19 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:42:20.482 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:20 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:42:20.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:20 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.400s CPU time. 2024-07-26T08:42:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:20 smithi043 ceph-mon[32384]: pgmap v788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:20 smithi133 ceph-mon[37053]: pgmap v788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:20 smithi063 ceph-mon[36747]: pgmap v788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 386.712533 secs 2024-07-26T08:42:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 402.199855 secs 2024-07-26T08:42:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 386.712533 secs 2024-07-26T08:42:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 402.199855 secs 2024-07-26T08:42:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 386.712533 secs 2024-07-26T08:42:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 402.199855 secs 2024-07-26T08:42:22.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:22 smithi043 ceph-mon[32384]: pgmap v789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:22 smithi133 ceph-mon[37053]: pgmap v789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:22.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:22 smithi063 ceph-mon[36747]: pgmap v789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:24 smithi133 ceph-mon[37053]: pgmap v790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:42:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:24 smithi063 ceph-mon[36747]: pgmap v790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:42:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:24 smithi043 ceph-mon[32384]: pgmap v790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:42:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 391.712649 secs 2024-07-26T08:42:25.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 391.712649 secs 2024-07-26T08:42:25.916 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 391.712649 secs 2024-07-26T08:42:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 407.199878 secs 2024-07-26T08:42:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:26 smithi063 ceph-mon[36747]: pgmap v791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 10 op/s 2024-07-26T08:42:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 407.199878 secs 2024-07-26T08:42:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:26 smithi043 ceph-mon[32384]: pgmap v791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 10 op/s 2024-07-26T08:42:27.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 407.199878 secs 2024-07-26T08:42:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:26 smithi133 ceph-mon[37053]: pgmap v791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 180 B/s wr, 10 op/s 2024-07-26T08:42:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:28 smithi063 ceph-mon[36747]: pgmap v792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:42:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:28 smithi043 ceph-mon[32384]: pgmap v792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:42:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:28 smithi133 ceph-mon[37053]: pgmap v792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:42:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:30 smithi063 ceph-mon[36747]: pgmap v793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:42:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 396.712784 secs 2024-07-26T08:42:30.818 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:30 smithi133 ceph-mon[37053]: pgmap v793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:42:30.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 396.712784 secs 2024-07-26T08:42:30.906 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:30 smithi043 ceph-mon[32384]: pgmap v793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:42:30.907 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 396.712784 secs 2024-07-26T08:42:30.907 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:30 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:42:30.907 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:30 smithi043 systemd[1]: Stopped Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:42:30.907 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:30 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.400s CPU time. 2024-07-26T08:42:30.907 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:30 smithi043 systemd[1]: Starting Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:42:31.189 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:30 smithi043 podman[106131]: 2024-07-26 08:42:30.812500069 +0000 UTC m=+0.040181211 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:42:31.189 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:30 smithi043 podman[106131]: 2024-07-26 08:42:30.995267767 +0000 UTC m=+0.222948929 container create 00b788dd3f83caff551f8af11ad32c3059f17f9f07421c41f9cc23a831bc1399 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-07-26T08:42:31.544 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 podman[106131]: 2024-07-26 08:42:31.283328708 +0000 UTC m=+0.511009877 container init 00b788dd3f83caff551f8af11ad32c3059f17f9f07421c41f9cc23a831bc1399 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:42:31.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 podman[106131]: 2024-07-26 08:42:31.295153295 +0000 UTC m=+0.522834461 container start 00b788dd3f83caff551f8af11ad32c3059f17f9f07421c41f9cc23a831bc1399 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2) 2024-07-26T08:42:31.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mds[106150]: -- 172.21.15.43:0/97311176 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bca367b520 con 0x55bca7813a80 2024-07-26T08:42:31.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mds[106150]: -- 172.21.15.43:0/97311176 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bca3671c20 con 0x55bca7813a80 2024-07-26T08:42:31.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: starting mds.d at 2024-07-26T08:42:31.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 bash[106131]: 00b788dd3f83caff551f8af11ad32c3059f17f9f07421c41f9cc23a831bc1399 2024-07-26T08:42:31.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:31 smithi043 systemd[1]: Started Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 412.200005 secs 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: daemon mds.d restarted 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: osdmap e116: 12 total, 12 up, 12 in 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:boot 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:31 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 412.200005 secs 2024-07-26T08:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: daemon mds.d restarted 2024-07-26T08:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: osdmap e116: 12 total, 12 up, 12 in 2024-07-26T08:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:boot 2024-07-26T08:42:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:42:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:42:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:42:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:31 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 412.200005 secs 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: daemon mds.d restarted 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: osdmap e116: 12 total, 12 up, 12 in 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:boot 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-07-26T08:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:31 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:replay,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:32 smithi043 ceph-mon[32384]: pgmap v795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:42:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:32 smithi063 ceph-mon[36747]: pgmap v795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:42:33.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:32 smithi133 ceph-mon[37053]: pgmap v795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:42:33.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:33 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:resolve 2024-07-26T08:42:33.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:33 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:33.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:33 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:resolve 2024-07-26T08:42:33.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:33 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:34.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:33 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:resolve 2024-07-26T08:42:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:33 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:resolve,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:34 smithi043 ceph-mon[32384]: pgmap v796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:42:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:34 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:42:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:34 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:reconnect 2024-07-26T08:42:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:34 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:34 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899983 2024-07-26T08:42:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:34 smithi133 ceph-mon[37053]: pgmap v796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:42:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:34 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:42:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:34 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:reconnect 2024-07-26T08:42:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:34 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:34 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899983 2024-07-26T08:42:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:34 smithi063 ceph-mon[36747]: pgmap v796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:42:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:34 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299994 2024-07-26T08:42:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:34 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:reconnect 2024-07-26T08:42:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:34 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:reconnect,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:34 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899983 2024-07-26T08:42:35.408 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:42:35.408 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: *** Caught signal (Aborted) ** 2024-07-26T08:42:35.408 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: in thread 7f29bd9ca640 thread_name:ms_dispatch 2024-07-26T08:42:35.408 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29c2da16f0] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29c2dee94c] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 3: raise() 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 4: abort() 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29c2d8b71b] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 6: /lib64/libc.so.6(+0x37386) [0x7f29c2d9a386] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c9cf85c6b9] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c9cfa1a80c] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c9cf95a2ca] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c9cf92a753] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c9cf92ba1b] 2024-07-26T08:42:35.409 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c9cf90f752] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c9cf85da56] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c9cf861637] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c9cf861f5e] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c9cf84503a] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f29c366e407] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 18: (DispatchQueue::entry()+0x60f) [0x7f29c366ecf9] 2024-07-26T08:42:35.410 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f29c374b5a1] 2024-07-26T08:42:35.411 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 20: (Thread::entry_wrapper()+0x43) [0x7f29c34f8cdd] 2024-07-26T08:42:35.411 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 21: (Thread::_entry_func(void*)+0xd) [0x7f29c34f8cf9] 2024-07-26T08:42:35.411 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29c2decc02] 2024-07-26T08:42:35.411 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29c2e71c40] 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.019+0000 7f29bd9ca640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: in thread 7f29bd9ca640 thread_name:ms_dispatch 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29c2da16f0] 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29c2dee94c] 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 3: raise() 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 4: abort() 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29c2d8b71b] 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 6: /lib64/libc.so.6(+0x37386) [0x7f29c2d9a386] 2024-07-26T08:42:35.412 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c9cf85c6b9] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c9cfa1a80c] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c9cf95a2ca] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c9cf92a753] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c9cf92ba1b] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c9cf90f752] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c9cf85da56] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c9cf861637] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c9cf861f5e] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c9cf84503a] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f29c366e407] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 18: (DispatchQueue::entry()+0x60f) [0x7f29c366ecf9] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f29c374b5a1] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 20: (Thread::entry_wrapper()+0x43) [0x7f29c34f8cdd] 2024-07-26T08:42:35.413 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 21: (Thread::_entry_func(void*)+0xd) [0x7f29c34f8cf9] 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29c2decc02] 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29c2e71c40] 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 0> 2024-07-26T08:42:35.019+0000 7f29bd9ca640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: in thread 7f29bd9ca640 thread_name:ms_dispatch 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29c2da16f0] 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29c2dee94c] 2024-07-26T08:42:35.414 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 3: raise() 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 4: abort() 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29c2d8b71b] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 6: /lib64/libc.so.6(+0x37386) [0x7f29c2d9a386] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c9cf85c6b9] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c9cfa1a80c] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c9cf95a2ca] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c9cf92a753] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c9cf92ba1b] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c9cf90f752] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c9cf85da56] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c9cf861637] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c9cf861f5e] 2024-07-26T08:42:35.415 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c9cf84503a] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f29c366e407] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 18: (DispatchQueue::entry()+0x60f) [0x7f29c366ecf9] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f29c374b5a1] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 20: (Thread::entry_wrapper()+0x43) [0x7f29c34f8cdd] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 21: (Thread::_entry_func(void*)+0xd) [0x7f29c34f8cf9] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29c2decc02] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29c2e71c40] 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 0> 2024-07-26T08:42:35.019+0000 7f29bd9ca640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: in thread 7f29bd9ca640 thread_name:ms_dispatch 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.416 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f29c2da16f0] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f29c2dee94c] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 3: raise() 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 4: abort() 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 5: /lib64/libc.so.6(+0x2871b) [0x7f29c2d8b71b] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 6: /lib64/libc.so.6(+0x37386) [0x7f29c2d9a386] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c9cf85c6b9] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c9cfa1a80c] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c9cf95a2ca] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c9cf92a753] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c9cf92ba1b] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c9cf90f752] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c9cf85da56] 2024-07-26T08:42:35.417 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c9cf861637] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c9cf861f5e] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c9cf84503a] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f29c366e407] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 18: (DispatchQueue::entry()+0x60f) [0x7f29c366ecf9] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f29c374b5a1] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 20: (Thread::entry_wrapper()+0x43) [0x7f29c34f8cdd] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 21: (Thread::_entry_func(void*)+0xd) [0x7f29c34f8cf9] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 22: /lib64/libc.so.6(+0x89c02) [0x7f29c2decc02] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f29c2e71c40] 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:35.418 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l[73765]: 2024-07-26T08:42:35.419 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 podman[73815]: 2024-07-26 08:42:35.07808092 +0000 UTC m=+0.018772072 container died 1981fdefbf599af6fae00ad91c0eef555e283cb4b3de67cc44f2c65ae8e15251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T08:42:35.725 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:rejoin 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:active 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 401.712856 secs 2024-07-26T08:42:35.726 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 417.200069 secs 2024-07-26T08:42:35.977 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 podman[73815]: 2024-07-26 08:42:35.724866708 +0000 UTC m=+0.665557899 container remove 1981fdefbf599af6fae00ad91c0eef555e283cb4b3de67cc44f2c65ae8e15251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-l, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, ceph=True) 2024-07-26T08:42:35.977 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:42:35.977 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:42:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:42:35.777+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:42:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:rejoin 2024-07-26T08:42:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:42:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:active 2024-07-26T08:42:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 401.712856 secs 2024-07-26T08:42:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 417.200069 secs 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:rejoin 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=l=up:rejoin,2=i=up:active} 2 up:standby-replay 4 up:standby 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/4140446689,v1:172.21.15.133:6833/4140446689] up:active 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=l=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby 2024-07-26T08:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 401.712856 secs 2024-07-26T08:42:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 417.200069 secs 2024-07-26T08:42:36.265 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:42:36.265 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:35 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.862s CPU time. 2024-07-26T08:42:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:36 smithi043 ceph-mon[32384]: pgmap v797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:36 smithi133 ceph-mon[37053]: pgmap v797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:36 smithi063 ceph-mon[36747]: pgmap v797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:38 smithi043 ceph-mon[32384]: pgmap v798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:39.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:38 smithi133 ceph-mon[37053]: pgmap v798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:38 smithi063 ceph-mon[36747]: pgmap v798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:42:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:40 smithi043 ceph-mon[32384]: pgmap v799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:42:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 406.712998 secs 2024-07-26T08:42:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 422.200188 secs 2024-07-26T08:42:41.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:40 smithi133 ceph-mon[37053]: pgmap v799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:42:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 406.712998 secs 2024-07-26T08:42:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 422.200188 secs 2024-07-26T08:42:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:40 smithi063 ceph-mon[36747]: pgmap v799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:42:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 406.712998 secs 2024-07-26T08:42:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 422.200188 secs 2024-07-26T08:42:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:42 smithi043 ceph-mon[32384]: pgmap v800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 203 B/s wr, 10 op/s 2024-07-26T08:42:43.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:42 smithi133 ceph-mon[37053]: pgmap v800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 203 B/s wr, 10 op/s 2024-07-26T08:42:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:42 smithi063 ceph-mon[36747]: pgmap v800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 203 B/s wr, 10 op/s 2024-07-26T08:42:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:43 smithi043 ceph-mon[32384]: pgmap v801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:44.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:43 smithi133 ceph-mon[37053]: pgmap v801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:44.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:43 smithi063 ceph-mon[36747]: pgmap v801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:42:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:45 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 411.713135 secs 2024-07-26T08:42:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:45 smithi043 ceph-mon[32384]: slow request 360.222832 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:42:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:45 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 411.713135 secs 2024-07-26T08:42:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:45 smithi133 ceph-mon[37053]: slow request 360.222832 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:42:45.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:45 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 411.713135 secs 2024-07-26T08:42:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:45 smithi063 ceph-mon[36747]: slow request 360.222832 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 427.200332 secs 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:46 smithi133 ceph-mon[37053]: pgmap v802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:46 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:46 smithi133 systemd[1]: Stopped Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:46 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Consumed 1.862s CPU time. 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:46 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Start request repeated too quickly. 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:46 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-07-26T08:42:46.516 INFO:journalctl@ceph.mds.l.smithi133.stdout:Jul 26 08:42:46 smithi133 systemd[1]: Failed to start Ceph mds.l for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:42:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 427.200332 secs 2024-07-26T08:42:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:46 smithi063 ceph-mon[36747]: pgmap v802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:42:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 427.200332 secs 2024-07-26T08:42:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:46 smithi043 ceph-mon[32384]: pgmap v802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:42:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:48 smithi063 ceph-mon[36747]: pgmap v803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:42:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:48 smithi043 ceph-mon[32384]: pgmap v803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:42:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:48 smithi133 ceph-mon[37053]: pgmap v803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:42:49.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:42:49.542 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:42:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: pgmap v804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 7 op/s 2024-07-26T08:42:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: Replacing daemon mds.l as rank 1 with standby daemon mds.d 2024-07-26T08:42:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-07-26T08:42:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: osdmap e117: 12 total, 12 up, 12 in 2024-07-26T08:42:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 416.713253 secs 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: pgmap v804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 7 op/s 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: Replacing daemon mds.l as rank 1 with standby daemon mds.d 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: osdmap e117: 12 total, 12 up, 12 in 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 416.713253 secs 2024-07-26T08:42:51.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: pgmap v804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 7 op/s 2024-07-26T08:42:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: Replacing daemon mds.l as rank 1 with standby daemon mds.d 2024-07-26T08:42:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-07-26T08:42:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:42:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: osdmap e117: 12 total, 12 up, 12 in 2024-07-26T08:42:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 416.713253 secs 2024-07-26T08:42:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 432.200447 secs 2024-07-26T08:42:51.903 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 432.200447 secs 2024-07-26T08:42:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 432.200447 secs 2024-07-26T08:42:52.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 -- 172.21.15.43:0/2212841724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc1055d0 msgr2=0x7fb9bc1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 --2- 172.21.15.43:0/2212841724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc1059e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009900 tx=0x7fb9b002a410 comp rx=0 tx=0).stop 2024-07-26T08:42:52.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 -- 172.21.15.43:0/2212841724 shutdown_connections 2024-07-26T08:42:52.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 --2- 172.21.15.43:0/2212841724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 0x7fb9bc10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 --2- 172.21.15.43:0/2212841724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc10b860 0x7fb9bc112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 --2- 172.21.15.43:0/2212841724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc1059e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 -- 172.21.15.43:0/2212841724 >> 172.21.15.43:0/2212841724 conn(0x7fb9bc101040 msgr2=0x7fb9bc103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:52.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 -- 172.21.15.43:0/2212841724 shutdown_connections 2024-07-26T08:42:52.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.269+0000 7fb9c2800640 1 -- 172.21.15.43:0/2212841724 wait complete. 2024-07-26T08:42:52.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.272+0000 7fb9c2800640 1 Processor -- start 2024-07-26T08:42:52.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.272+0000 7fb9c2800640 1 -- start start 2024-07-26T08:42:52.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.272+0000 7fb9c2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c2800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 0x7fb9bc19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc10b860 0x7fb9bc1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc115690 con 0x7fb9bc1055d0 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c2800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc115510 con 0x7fb9bc10b860 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c2800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc115810 con 0x7fb9bc10af10 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc19bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51154/0 (socket says 172.21.15.43:51154) 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c1400640 1 -- 172.21.15.43:0/288521475 learned_addr learned my addr 172.21.15.43:0/288521475 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 0x7fb9bc19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc10b860 0x7fb9bc1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c0a00640 1 -- 172.21.15.43:0/288521475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc10b860 msgr2=0x7fb9bc1a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc10b860 0x7fb9bc1a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c0a00640 1 -- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc1055d0 msgr2=0x7fb9bc19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.273+0000 7fb9c0a00640 1 -- 172.21.15.43:0/288521475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc1a1f30 con 0x7fb9bc10af10 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.274+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 0x7fb9bc19c560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc06c270 tx=0x7fb9a800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.274+0000 7fb9ba000640 1 -- 172.21.15.43:0/288521475 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800cd00 con 0x7fb9bc10af10 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.274+0000 7fb9ba000640 1 -- 172.21.15.43:0/288521475 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9a80035f0 con 0x7fb9bc10af10 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.274+0000 7fb9ba000640 1 -- 172.21.15.43:0/288521475 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8010690 con 0x7fb9bc10af10 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.274+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc1a2220 con 0x7fb9bc10af10 2024-07-26T08:42:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.274+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc1a8980 con 0x7fb9bc10af10 2024-07-26T08:42:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 Processor -- start 2024-07-26T08:42:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 -- start start 2024-07-26T08:42:52.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 0x562db0dca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db09fc1b0 0x562db0dca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dcac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562db0d40b90 con 0x562db0a04390 2024-07-26T08:42:52.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562db0d30090 con 0x562db09fc1b0 2024-07-26T08:42:52.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.278+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562db0d340d0 con 0x562db0a25070 2024-07-26T08:42:52.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9ba000640 1 -- 172.21.15.43:0/288521475 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb9a80037a0 con 0x7fb9bc10af10 2024-07-26T08:42:52.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 0x562db0dca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 0x562db0dca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:55004/0 (socket says 172.21.15.43:55004) 2024-07-26T08:42:52.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 -- 172.21.15.43:0/1630703186 learned_addr learned my addr 172.21.15.43:0/1630703186 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:52.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1400640 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db09fc1b0 0x562db0dca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dcac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 -- 172.21.15.43:0/1630703186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db09fc1b0 msgr2=0x562db0dca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db09fc1b0 0x562db0dca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 -- 172.21.15.43:0/1630703186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 msgr2=0x562db0dcac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dcac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1e00640 1 -- 172.21.15.43:0/1630703186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db0a90650 con 0x562db0a25070 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.279+0000 7fb9c1400640 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db09fc1b0 0x562db0dca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:42:52.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.280+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 0x562db0dca1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fd0 tx=0x7fb9b40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d42e28bcf43d232 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:52.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.280+0000 7fb9ae600640 1 -- 172.21.15.43:0/1630703186 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4004d20 con 0x562db0a25070 2024-07-26T08:42:52.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.280+0000 7fb9ae600640 1 -- 172.21.15.43:0/1630703186 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9b4004050 con 0x562db0a25070 2024-07-26T08:42:52.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.280+0000 7fb9ae600640 1 -- 172.21.15.43:0/1630703186 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4005220 con 0x562db0a25070 2024-07-26T08:42:52.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/1630703186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 msgr2=0x562db0dca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 0x562db0dca1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fd0 tx=0x7fb9b40118d0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ba000640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9a40b3d40 0x7fb9a40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/1630703186 shutdown_connections 2024-07-26T08:42:52.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dcac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db09fc1b0 0x562db0dca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/1630703186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a25070 0x562db0dca1c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/1630703186 >> 172.21.15.43:0/1630703186 conn(0x562db0a19460 msgr2=0x562db0dc80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ba000640 1 -- 172.21.15.43:0/288521475 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 11774+0+0 (secure 0 0 0) 0x7fb9a80e4fe0 con 0x7fb9bc10af10 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/1630703186 shutdown_connections 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.281+0000 7fb9c1400640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9a40b3d40 0x7fb9a40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.282+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/1630703186 wait complete. 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.282+0000 7fb9ca9e3740 1 -- start start 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.282+0000 7fb9c1400640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9a40b3d40 0x7fb9a40b6250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00096c0 tx=0x7fb9b0031400 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:52.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 Processor -- start 2024-07-26T08:42:52.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dd5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a04390 0x562db0dd5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a25070 0x562db0dd6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562db0b93700 con 0x562db0a25070 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562db0ccc660 con 0x562db0a04390 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562db0dd89a0 con 0x562db09fc1b0 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.283+0000 7fb9ca9e3740 10 client.0 _ll_register_callbacks cb 0x562db0cdc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dd5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a25070 0x562db0dd6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dd5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:55012/0 (socket says 172.21.15.43:55012) 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 -- 172.21.15.43:0/4188320378 learned_addr learned my addr 172.21.15.43:0/4188320378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:52.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a04390 0x562db0dd5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 -- 172.21.15.43:0/4188320378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a04390 msgr2=0x562db0dd5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a04390 0x562db0dd5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 -- 172.21.15.43:0/4188320378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a25070 msgr2=0x562db0dd6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a25070 0x562db0dd6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.284+0000 7fb9c1400640 1 -- 172.21.15.43:0/4188320378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db0ce3800 con 0x562db09fc1b0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9c1400640 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dd5690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006010 tx=0x7fb9b0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f9d5d162a1fce16 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9a2a00640 1 -- 172.21.15.43:0/4188320378 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b004d070 con 0x562db09fc1b0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b4004050 con 0x562db09fc1b0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9a2a00640 1 -- 172.21.15.43:0/4188320378 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 11774+0+0 (secure 0 0 0) 0x7fb9b0003c40 con 0x562db09fc1b0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9a2a00640 1 -- 172.21.15.43:0/4188320378 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=202) ==== 24+0+0 (secure 0 0 0) 0x7fb9b0035040 con 0x562db09fc1b0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9ca9e3740 10 client.26176 fetch_fsmap learned FSMap version 202 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.285+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=202,monmap=4+}) -- 0x562db0de44c0 con 0x562db09fc1b0 2024-07-26T08:42:52.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9a2a00640 1 -- 172.21.15.43:0/4188320378 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9b4004050 con 0x562db09fc1b0 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9a2a00640 1 -- 172.21.15.43:0/4188320378 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 202) ==== 5938+0+0 (secure 0 0 0) 0x7fb9b0053c00 con 0x562db09fc1b0 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9ca9e3740 10 client.26176 fetch_fsmap finished waiting for FSMap version 202 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9ca9e3740 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9ca9e3740 20 client.26176 populate_metadata read hostname 'smithi043' 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09e39f0 0x562db0de7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9ca9e3740 4 client.26176 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562db0d42ae0 con 0x562db09e39f0 2024-07-26T08:42:52.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.286+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09e39f0 0x562db0de7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.287+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09e39f0 0x562db0de7c60 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f80a9f6322c0fc9 server_cookie=c0468d2e2ea6af03 in_seq=0 out_seq=0 2024-07-26T08:42:52.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.287+0000 7fb9a2a00640 10 client.26176 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:52.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9a2a00640 1 -- 172.21.15.43:0/4188320378 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb9a808be80 con 0x562db09e39f0 2024-07-26T08:42:52.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9a2a00640 10 client.26176 handle_command_reply: tid=0 2024-07-26T08:42:52.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 client.26176 shutdown 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 msgr2=0x562db0dd5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dd5690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006010 tx=0x7fb9b0009260 comp rx=0 tx=0).stop 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 shutdown_connections 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09e39f0 0x562db0de7c60 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a25070 0x562db0dd6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a04390 0x562db0dd5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/4188320378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dd5690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9a2a00640 0 client.26176 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 >> 172.21.15.43:0/4188320378 conn(0x562db0a19460 msgr2=0x562db0dcd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 shutdown_connections 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.288+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/4188320378 wait complete. 2024-07-26T08:42:52.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.289+0000 7fb9ca9e3740 20 client.26176 trim_cache size 0 max 16384 2024-07-26T08:42:52.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 Processor -- start 2024-07-26T08:42:52.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 -- start start 2024-07-26T08:42:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 0x562db0dc71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a04390 0x562db0dd7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0de1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1b3f80 con 0x562db09fc1b0 2024-07-26T08:42:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1b53f0 con 0x562db0a25070 2024-07-26T08:42:52.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1b4650 con 0x562db0a04390 2024-07-26T08:42:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 0x562db0dc71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 0x562db0dc71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51168/0 (socket says 172.21.15.43:51168) 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.308+0000 7fb9c1400640 1 -- 172.21.15.43:0/731504933 learned_addr learned my addr 172.21.15.43:0/731504933 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0de1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a04390 0x562db0dd7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1400640 1 -- 172.21.15.43:0/731504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a04390 msgr2=0x562db0dd7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1400640 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a04390 0x562db0dd7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1400640 1 -- 172.21.15.43:0/731504933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 msgr2=0x562db0de1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1400640 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0de1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1400640 1 -- 172.21.15.43:0/731504933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db0dce2d0 con 0x562db09fc1b0 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a04390 0x562db0dd7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.309+0000 7fb9c1400640 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 0x562db0dc71c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00495c0 tx=0x7fb9b0049940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dac6dbd7000636d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.310+0000 7fb9adc00640 1 -- 172.21.15.43:0/731504933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b004d040 con 0x562db09fc1b0 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.310+0000 7fb9adc00640 1 -- 172.21.15.43:0/731504933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9b0003f10 con 0x562db09fc1b0 2024-07-26T08:42:52.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.310+0000 7fb9adc00640 1 -- 172.21.15.43:0/731504933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0031a50 con 0x562db09fc1b0 2024-07-26T08:42:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/731504933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 msgr2=0x562db0dc71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 0x562db0dc71c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00495c0 tx=0x7fb9b0049940 comp rx=0 tx=0).stop 2024-07-26T08:42:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/731504933 shutdown_connections 2024-07-26T08:42:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db0a04390 0x562db0dd7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0de1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/731504933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db09fc1b0 0x562db0dc71c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/731504933 >> 172.21.15.43:0/731504933 conn(0x562db0a19460 msgr2=0x562db0dd5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/731504933 shutdown_connections 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/731504933 wait complete. 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.311+0000 7fb9ca9e3740 1 -- start start 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 Processor -- start 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dde140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dd95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0dd9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1b2da0 con 0x562db0a04390 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1b4d20 con 0x562db0a25070 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1b2060 con 0x562db09fc1b0 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.312+0000 7fb9ca9e3740 10 client.0 _ll_register_callbacks cb 0x7fb9b00041f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dd95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dd95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51184/0 (socket says 172.21.15.43:51184) 2024-07-26T08:42:52.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 -- 172.21.15.43:0/819930417 learned_addr learned my addr 172.21.15.43:0/819930417 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:42:52.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c1400640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dde140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0dd9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 -- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 msgr2=0x562db0dde140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dde140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 -- 172.21.15.43:0/819930417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 msgr2=0x562db0dd9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:42:52.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0dd9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c0a00640 1 -- 172.21.15.43:0/819930417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db0dda170 con 0x562db0a04390 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c1400640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dde140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.313+0000 7fb9c1e00640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0dd9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9c0a00640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dd95f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80e1ae0 tx=0x7fb9a8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d8e2b324b47b4b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9a2a00640 1 -- 172.21.15.43:0/819930417 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80af300 con 0x562db0a04390 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9a2a00640 1 -- 172.21.15.43:0/819930417 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 11774+0+0 (secure 0 0 0) 0x7fb9a80a7530 con 0x562db0a04390 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b0003f10 con 0x562db0a04390 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9a2a00640 1 -- 172.21.15.43:0/819930417 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=202) ==== 24+0+0 (secure 0 0 0) 0x7fb9a80af540 con 0x562db0a04390 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9ca9e3740 10 client.15939 fetch_fsmap learned FSMap version 202 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.314+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=202,monmap=4+}) -- 0x562db0e50250 con 0x562db0a04390 2024-07-26T08:42:52.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9a2a00640 1 -- 172.21.15.43:0/819930417 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9b0003f10 con 0x562db0a04390 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9a2a00640 1 -- 172.21.15.43:0/819930417 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 202) ==== 5938+0+0 (secure 0 0 0) 0x7fb9a80e6c30 con 0x562db0a04390 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9ca9e3740 10 client.15939 fetch_fsmap finished waiting for FSMap version 202 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9ca9e3740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9ca9e3740 20 client.15939 populate_metadata read hostname 'smithi043' 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09b8da0 0x562db0e52990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9ca9e3740 4 client.15939 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562db0dd1240 con 0x562db09b8da0 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.315+0000 7fb9c1400640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09b8da0 0x562db0e52990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9c1400640 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09b8da0 0x562db0e52990 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a5aa94b22d6ff6c server_cookie=4369c6a29d39de38 in_seq=0 out_seq=0 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9a2a00640 10 client.15939 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9a2a00640 1 -- 172.21.15.43:0/819930417 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x562db0dd1240 con 0x562db09b8da0 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9a2a00640 10 client.15939 handle_command_reply: tid=0 2024-07-26T08:42:52.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 client.15939 shutdown 2024-07-26T08:42:52.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 msgr2=0x562db0dd95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dd95f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80e1ae0 tx=0x7fb9a8003d80 comp rx=0 tx=0).stop 2024-07-26T08:42:52.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 shutdown_connections 2024-07-26T08:42:52.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562db09b8da0 0x562db0e52990 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562db0a25070 0x562db0dd9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562db0a04390 0x562db0dd95f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 --2- 172.21.15.43:0/819930417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562db09fc1b0 0x562db0dde140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9a2a00640 0 client.15939 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.316+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 >> 172.21.15.43:0/819930417 conn(0x562db0a19460 msgr2=0x562db0dd72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.317+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 shutdown_connections 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.317+0000 7fb9ca9e3740 1 -- 172.21.15.43:0/819930417 wait complete. 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.317+0000 7fb9ca9e3740 20 client.15939 trim_cache size 0 max 16384 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:42:52.321 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:42:52.322 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9a40b3d40 msgr2=0x7fb9a40b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9a40b3d40 0x7fb9a40b6250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00096c0 tx=0x7fb9b0031400 comp rx=0 tx=0).stop 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 msgr2=0x7fb9bc19c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 0x7fb9bc19c560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc06c270 tx=0x7fb9a800ee50 comp rx=0 tx=0).stop 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 shutdown_connections 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb9a40b3d40 0x7fb9a40b6250 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9bc10af10 0x7fb9bc19c560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9bc10b860 0x7fb9bc1a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 --2- 172.21.15.43:0/288521475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9bc1055d0 0x7fb9bc19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 >> 172.21.15.43:0/288521475 conn(0x7fb9bc101040 msgr2=0x7fb9bc10a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 shutdown_connections 2024-07-26T08:42:52.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:42:52.318+0000 7fb9c2800640 1 -- 172.21.15.43:0/288521475 wait complete. 2024-07-26T08:42:52.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:52 smithi043 ceph-mon[32384]: pgmap v806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:42:52.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:52 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:resolve 2024-07-26T08:42:52.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:52 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:52.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:52 smithi063 ceph-mon[36747]: pgmap v806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:42:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:52 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:resolve 2024-07-26T08:42:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:52 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:52 smithi133 ceph-mon[37053]: pgmap v806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:42:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:52 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:resolve 2024-07-26T08:42:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:52 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:53.552 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:42:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:53 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:42:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:reconnect 2024-07-26T08:42:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:53 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:53 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:42:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:53 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:42:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:reconnect 2024-07-26T08:42:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:53 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:53 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:42:54.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:53 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:42:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:reconnect 2024-07-26T08:42:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:53 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:53 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:42:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-mon[32384]: pgmap v807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:42:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:rejoin 2024-07-26T08:42:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-mon[32384]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:42:54.984 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:42:54.984 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: *** Caught signal (Aborted) ** 2024-07-26T08:42:54.984 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: in thread 7f6661800640 thread_name:ms_dispatch 2024-07-26T08:42:54.984 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6667a3e6f0] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6667a8b94c] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 3: raise() 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 4: abort() 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6667a2871b] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 6: /lib64/libc.so.6(+0x37386) [0x7f6667a37386] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55bc7278e6b9] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55bc7294c80c] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55bc7288c2ca] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55bc7285c753] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55bc7285da1b] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55bc72841752] 2024-07-26T08:42:54.985 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55bc7278fa56] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55bc72793637] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55bc72793f5e] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55bc7277703a] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f666859b407] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 18: (DispatchQueue::entry()+0x60f) [0x7f666859bcf9] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f66686785a1] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 20: (Thread::entry_wrapper()+0x43) [0x7f6668425cdd] 2024-07-26T08:42:54.986 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6668425cf9] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6667a89c02] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6667b0ec40] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.594+0000 7f6661800640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: in thread 7f6661800640 thread_name:ms_dispatch 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6667a3e6f0] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6667a8b94c] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 3: raise() 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 4: abort() 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6667a2871b] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 6: /lib64/libc.so.6(+0x37386) [0x7f6667a37386] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55bc7278e6b9] 2024-07-26T08:42:54.987 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55bc7294c80c] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55bc7288c2ca] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55bc7285c753] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55bc7285da1b] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55bc72841752] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55bc7278fa56] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55bc72793637] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55bc72793f5e] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55bc7277703a] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f666859b407] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 18: (DispatchQueue::entry()+0x60f) [0x7f666859bcf9] 2024-07-26T08:42:54.988 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f66686785a1] 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 20: (Thread::entry_wrapper()+0x43) [0x7f6668425cdd] 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6668425cf9] 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6667a89c02] 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6667b0ec40] 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 0> 2024-07-26T08:42:54.594+0000 7f6661800640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: in thread 7f6661800640 thread_name:ms_dispatch 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:54.989 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6667a3e6f0] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6667a8b94c] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 3: raise() 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 4: abort() 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6667a2871b] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 6: /lib64/libc.so.6(+0x37386) [0x7f6667a37386] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55bc7278e6b9] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55bc7294c80c] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55bc7288c2ca] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55bc7285c753] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55bc7285da1b] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55bc72841752] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55bc7278fa56] 2024-07-26T08:42:54.990 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55bc72793637] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55bc72793f5e] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55bc7277703a] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f666859b407] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 18: (DispatchQueue::entry()+0x60f) [0x7f666859bcf9] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f66686785a1] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 20: (Thread::entry_wrapper()+0x43) [0x7f6668425cdd] 2024-07-26T08:42:54.991 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6668425cf9] 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6667a89c02] 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6667b0ec40] 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 0> 2024-07-26T08:42:54.594+0000 7f6661800640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: in thread 7f6661800640 thread_name:ms_dispatch 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6667a3e6f0] 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6667a8b94c] 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 3: raise() 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 4: abort() 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6667a2871b] 2024-07-26T08:42:54.992 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 6: /lib64/libc.so.6(+0x37386) [0x7f6667a37386] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55bc7278e6b9] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55bc7294c80c] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55bc7288c2ca] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55bc7285c753] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55bc7285da1b] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55bc72841752] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55bc7278fa56] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55bc72793637] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55bc72793f5e] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55bc7277703a] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f666859b407] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 18: (DispatchQueue::entry()+0x60f) [0x7f666859bcf9] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f66686785a1] 2024-07-26T08:42:54.993 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 20: (Thread::entry_wrapper()+0x43) [0x7f6668425cdd] 2024-07-26T08:42:54.994 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6668425cf9] 2024-07-26T08:42:54.994 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6667a89c02] 2024-07-26T08:42:54.994 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6667b0ec40] 2024-07-26T08:42:54.994 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:42:54.994 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106146]: 2024-07-26T08:42:54.994 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:54 smithi043 podman[106377]: 2024-07-26 08:42:54.781510378 +0000 UTC m=+0.040025634 container died 00b788dd3f83caff551f8af11ad32c3059f17f9f07421c41f9cc23a831bc1399 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-07-26T08:42:55.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:54 smithi133 ceph-mon[37053]: pgmap v807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:54 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:rejoin 2024-07-26T08:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:54 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:54 smithi133 ceph-mon[37053]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:54 smithi063 ceph-mon[36747]: pgmap v807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:54 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:rejoin 2024-07-26T08:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:54 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:54 smithi063 ceph-mon[36747]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:42:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:55 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:active 2024-07-26T08:42:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:42:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 421.713389 secs 2024-07-26T08:42:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 437.200557 secs 2024-07-26T08:42:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:55 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:active 2024-07-26T08:42:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:42:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 421.713389 secs 2024-07-26T08:42:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 437.200557 secs 2024-07-26T08:42:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:55 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:42:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/170031347,v1:172.21.15.43:6837/170031347] up:active 2024-07-26T08:42:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:42:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:42:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 421.713389 secs 2024-07-26T08:42:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 437.200557 secs 2024-07-26T08:42:56.232 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:55 smithi043 podman[106377]: 2024-07-26 08:42:55.944635843 +0000 UTC m=+1.203151080 container remove 00b788dd3f83caff551f8af11ad32c3059f17f9f07421c41f9cc23a831bc1399 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T08:42:56.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:55 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:42:56.732 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:42:56.732 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:42:56 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.199s CPU time. 2024-07-26T08:42:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:56 smithi043 ceph-mon[32384]: pgmap v808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:42:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:56 smithi133 ceph-mon[37053]: pgmap v808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:42:57.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:56 smithi063 ceph-mon[36747]: pgmap v808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:42:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:42:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:42:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:42:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:42:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:42:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:42:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:42:58.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:42:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:42:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:42:58.875 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:58 smithi043 ceph-mon[32384]: pgmap v809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 111 B/s wr, 6 op/s 2024-07-26T08:42:58.875 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:58 smithi043 ceph-mon[32384]: pgmap v810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 143 B/s wr, 6 op/s 2024-07-26T08:42:59.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:58 smithi133 ceph-mon[37053]: pgmap v809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 111 B/s wr, 6 op/s 2024-07-26T08:42:59.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:58 smithi133 ceph-mon[37053]: pgmap v810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 143 B/s wr, 6 op/s 2024-07-26T08:42:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:58 smithi063 ceph-mon[36747]: pgmap v809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 111 B/s wr, 6 op/s 2024-07-26T08:42:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:58 smithi063 ceph-mon[36747]: pgmap v810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 143 B/s wr, 6 op/s 2024-07-26T08:42:59.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:42:59 smithi043 ceph-mon[32384]: pgmap v811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 238 B/s wr, 10 op/s 2024-07-26T08:43:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:42:59 smithi133 ceph-mon[37053]: pgmap v811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 238 B/s wr, 10 op/s 2024-07-26T08:43:00.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:42:59 smithi063 ceph-mon[36747]: pgmap v811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 238 B/s wr, 10 op/s 2024-07-26T08:43:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 426.713531 secs 2024-07-26T08:43:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 442.200693 secs 2024-07-26T08:43:00.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 426.713531 secs 2024-07-26T08:43:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 442.200693 secs 2024-07-26T08:43:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 426.713531 secs 2024-07-26T08:43:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 442.200693 secs 2024-07-26T08:43:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:01 smithi043 ceph-mon[32384]: pgmap v812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 223 B/s wr, 12 op/s 2024-07-26T08:43:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:01 smithi133 ceph-mon[37053]: pgmap v812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 223 B/s wr, 12 op/s 2024-07-26T08:43:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:01 smithi063 ceph-mon[36747]: pgmap v812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 223 B/s wr, 12 op/s 2024-07-26T08:43:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:03 smithi043 ceph-mon[32384]: pgmap v813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 223 B/s wr, 11 op/s 2024-07-26T08:43:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:03 smithi133 ceph-mon[37053]: pgmap v813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 223 B/s wr, 11 op/s 2024-07-26T08:43:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:03 smithi063 ceph-mon[36747]: pgmap v813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 223 B/s wr, 11 op/s 2024-07-26T08:43:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:05 smithi043 ceph-mon[32384]: pgmap v814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 111 B/s wr, 10 op/s 2024-07-26T08:43:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 431.713673 secs 2024-07-26T08:43:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 447.200810 secs 2024-07-26T08:43:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:05 smithi133 ceph-mon[37053]: pgmap v814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 111 B/s wr, 10 op/s 2024-07-26T08:43:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 431.713673 secs 2024-07-26T08:43:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 447.200810 secs 2024-07-26T08:43:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:05 smithi063 ceph-mon[36747]: pgmap v814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 111 B/s wr, 10 op/s 2024-07-26T08:43:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 431.713673 secs 2024-07-26T08:43:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 447.200810 secs 2024-07-26T08:43:06.894 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:06 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:43:06.894 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:06 smithi043 systemd[1]: Stopped Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:06.895 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:06 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.199s CPU time. 2024-07-26T08:43:06.895 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:06 smithi043 systemd[1]: Starting Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:43:07.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:06 smithi043 podman[106600]: 2024-07-26 08:43:06.79850085 +0000 UTC m=+0.037014992 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:43:07.233 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:06 smithi043 podman[106600]: 2024-07-26 08:43:06.954715371 +0000 UTC m=+0.193229519 container create ee06a4bb4b9ddd2d9753a3dfd158ed480adbf44521bfcdfea81a3cc5b19d3f67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724) 2024-07-26T08:43:07.656 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:07 smithi043 podman[106600]: 2024-07-26 08:43:07.267791306 +0000 UTC m=+0.506305487 container init ee06a4bb4b9ddd2d9753a3dfd158ed480adbf44521bfcdfea81a3cc5b19d3f67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-07-26T08:43:07.656 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:07 smithi043 podman[106600]: 2024-07-26 08:43:07.278358011 +0000 UTC m=+0.516872189 container start ee06a4bb4b9ddd2d9753a3dfd158ed480adbf44521bfcdfea81a3cc5b19d3f67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:43:07.657 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:07 smithi043 bash[106600]: ee06a4bb4b9ddd2d9753a3dfd158ed480adbf44521bfcdfea81a3cc5b19d3f67 2024-07-26T08:43:07.657 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:07 smithi043 systemd[1]: Started Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:07.657 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mds[106619]: -- 172.21.15.43:0/1239239746 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e882479860 con 0x55e88661b180 2024-07-26T08:43:07.657 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: starting mds.d at 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: pgmap v815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: daemon mds.d restarted 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: osdmap e118: 12 total, 12 up, 12 in 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:boot 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:07.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:07 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: pgmap v815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: daemon mds.d restarted 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: osdmap e118: 12 total, 12 up, 12 in 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:boot 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:43:08.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:08.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:07 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: pgmap v815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: daemon mds.d restarted 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: osdmap e118: 12 total, 12 up, 12 in 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:boot 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:07 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:09.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:09 smithi043 ceph-mon[32384]: pgmap v817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-07-26T08:43:09.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:09 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:resolve 2024-07-26T08:43:09.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:09 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:09 smithi133 ceph-mon[37053]: pgmap v817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-07-26T08:43:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:09 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:resolve 2024-07-26T08:43:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:09 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:09 smithi063 ceph-mon[36747]: pgmap v817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-07-26T08:43:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:09 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:resolve 2024-07-26T08:43:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:09 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:reconnect 2024-07-26T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:10 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:10 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00899991 2024-07-26T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:10 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 436.713817 secs 2024-07-26T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 452.200943 secs 2024-07-26T08:43:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:reconnect 2024-07-26T08:43:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:10 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:10 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00899991 2024-07-26T08:43:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:10 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:43:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 436.713817 secs 2024-07-26T08:43:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 452.200943 secs 2024-07-26T08:43:11.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:reconnect 2024-07-26T08:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:10 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:10 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00899991 2024-07-26T08:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:10 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 436.713817 secs 2024-07-26T08:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 452.200943 secs 2024-07-26T08:43:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:11 smithi043 ceph-mon[32384]: pgmap v818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:43:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:11 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:rejoin 2024-07-26T08:43:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:11 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:11 smithi043 ceph-mon[32384]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:43:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:11 smithi133 ceph-mon[37053]: pgmap v818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:43:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:11 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:rejoin 2024-07-26T08:43:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:11 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:11 smithi133 ceph-mon[37053]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:43:12.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-mon[36747]: pgmap v818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:43:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:rejoin 2024-07-26T08:43:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-mon[36747]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:43:12.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:43:12.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: *** Caught signal (Aborted) ** 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: in thread 7fda6a0c3640 thread_name:ms_dispatch 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fda6f49a6f0] 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fda6f4e794c] 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 3: raise() 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 4: abort() 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 5: /lib64/libc.so.6(+0x2871b) [0x7fda6f48471b] 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 6: /lib64/libc.so.6(+0x37386) [0x7fda6f493386] 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d4a7d546b9] 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d4a7f1280c] 2024-07-26T08:43:12.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d4a7e522ca] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d4a7e22753] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d4a7e23a1b] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d4a7e07752] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d4a7d55a56] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d4a7d59637] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d4a7d59f5e] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d4a7d3d03a] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fda6fd67407] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 18: (DispatchQueue::entry()+0x60f) [0x7fda6fd67cf9] 2024-07-26T08:43:12.070 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fda6fe445a1] 2024-07-26T08:43:12.071 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 20: (Thread::entry_wrapper()+0x43) [0x7fda6fbf1cdd] 2024-07-26T08:43:12.071 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 21: (Thread::_entry_func(void*)+0xd) [0x7fda6fbf1cf9] 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 22: /lib64/libc.so.6(+0x89c02) [0x7fda6f4e5c02] 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fda6f56ac40] 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:11.700+0000 7fda6a0c3640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: in thread 7fda6a0c3640 thread_name:ms_dispatch 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fda6f49a6f0] 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fda6f4e794c] 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 3: raise() 2024-07-26T08:43:12.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 4: abort() 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 5: /lib64/libc.so.6(+0x2871b) [0x7fda6f48471b] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 6: /lib64/libc.so.6(+0x37386) [0x7fda6f493386] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d4a7d546b9] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d4a7f1280c] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d4a7e522ca] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d4a7e22753] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d4a7e23a1b] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d4a7e07752] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d4a7d55a56] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d4a7d59637] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d4a7d59f5e] 2024-07-26T08:43:12.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d4a7d3d03a] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fda6fd67407] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 18: (DispatchQueue::entry()+0x60f) [0x7fda6fd67cf9] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fda6fe445a1] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 20: (Thread::entry_wrapper()+0x43) [0x7fda6fbf1cdd] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 21: (Thread::_entry_func(void*)+0xd) [0x7fda6fbf1cf9] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 22: /lib64/libc.so.6(+0x89c02) [0x7fda6f4e5c02] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fda6f56ac40] 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 0> 2024-07-26T08:43:11.700+0000 7fda6a0c3640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: in thread 7fda6a0c3640 thread_name:ms_dispatch 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:12.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fda6f49a6f0] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fda6f4e794c] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 3: raise() 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 4: abort() 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 5: /lib64/libc.so.6(+0x2871b) [0x7fda6f48471b] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 6: /lib64/libc.so.6(+0x37386) [0x7fda6f493386] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d4a7d546b9] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d4a7f1280c] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d4a7e522ca] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d4a7e22753] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d4a7e23a1b] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d4a7e07752] 2024-07-26T08:43:12.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d4a7d55a56] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d4a7d59637] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d4a7d59f5e] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d4a7d3d03a] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fda6fd67407] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 18: (DispatchQueue::entry()+0x60f) [0x7fda6fd67cf9] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fda6fe445a1] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 20: (Thread::entry_wrapper()+0x43) [0x7fda6fbf1cdd] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 21: (Thread::_entry_func(void*)+0xd) [0x7fda6fbf1cf9] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 22: /lib64/libc.so.6(+0x89c02) [0x7fda6f4e5c02] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fda6f56ac40] 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:12.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 0> 2024-07-26T08:43:11.700+0000 7fda6a0c3640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: in thread 7fda6a0c3640 thread_name:ms_dispatch 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fda6f49a6f0] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fda6f4e794c] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 3: raise() 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 4: abort() 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 5: /lib64/libc.so.6(+0x2871b) [0x7fda6f48471b] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 6: /lib64/libc.so.6(+0x37386) [0x7fda6f493386] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d4a7d546b9] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d4a7f1280c] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d4a7e522ca] 2024-07-26T08:43:12.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d4a7e22753] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d4a7e23a1b] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d4a7e07752] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d4a7d55a56] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d4a7d59637] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d4a7d59f5e] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d4a7d3d03a] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fda6fd67407] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 18: (DispatchQueue::entry()+0x60f) [0x7fda6fd67cf9] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fda6fe445a1] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 20: (Thread::entry_wrapper()+0x43) [0x7fda6fbf1cdd] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 21: (Thread::_entry_func(void*)+0xd) [0x7fda6fbf1cf9] 2024-07-26T08:43:12.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 22: /lib64/libc.so.6(+0x89c02) [0x7fda6f4e5c02] 2024-07-26T08:43:12.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fda6f56ac40] 2024-07-26T08:43:12.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:12.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[67430]: 2024-07-26T08:43:12.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:11 smithi063 podman[74625]: 2024-07-26 08:43:11.7603609 +0000 UTC m=+0.019644943 container died d1cc1bf1388183741ea920ab920ff5dd3870228b35095ace2c4ceb98f78bf0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-07-26T08:43:12.869 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:12 smithi063 podman[74625]: 2024-07-26 08:43:12.606205741 +0000 UTC m=+0.865489818 container remove d1cc1bf1388183741ea920ab920ff5dd3870228b35095ace2c4ceb98f78bf0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T08:43:12.869 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:12 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:43:12.869 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:12 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:12.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:active 2024-07-26T08:43:12.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:12 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:12.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:12 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:12.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:12 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:active 2024-07-26T08:43:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:12 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:12 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:12 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/10975952,v1:172.21.15.63:6833/10975952] up:active 2024-07-26T08:43:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:12 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:12 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:13.318 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:12 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:43:13.318 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:12 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 2.311s CPU time. 2024-07-26T08:43:13.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:13 smithi043 ceph-mon[32384]: pgmap v819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:14.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:13 smithi133 ceph-mon[37053]: pgmap v819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:13 smithi063 ceph-mon[36747]: pgmap v819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:15 smithi043 ceph-mon[32384]: pgmap v820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:43:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 441.713971 secs 2024-07-26T08:43:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 457.201061 secs 2024-07-26T08:43:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:15 smithi133 ceph-mon[37053]: pgmap v820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:43:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 441.713971 secs 2024-07-26T08:43:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 457.201061 secs 2024-07-26T08:43:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:15 smithi063 ceph-mon[36747]: pgmap v820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 10 op/s 2024-07-26T08:43:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 441.713971 secs 2024-07-26T08:43:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 457.201061 secs 2024-07-26T08:43:17.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:17 smithi043 ceph-mon[32384]: pgmap v821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:17 smithi133 ceph-mon[37053]: pgmap v821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:17 smithi063 ceph-mon[36747]: pgmap v821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:19 smithi133 ceph-mon[37053]: pgmap v822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:43:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:19 smithi063 ceph-mon[36747]: pgmap v822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:43:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:19 smithi043 ceph-mon[32384]: pgmap v822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 182 B/s wr, 10 op/s 2024-07-26T08:43:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 446.714133 secs 2024-07-26T08:43:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 462.201177 secs 2024-07-26T08:43:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 446.714133 secs 2024-07-26T08:43:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 462.201177 secs 2024-07-26T08:43:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 446.714133 secs 2024-07-26T08:43:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 462.201177 secs 2024-07-26T08:43:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:21 smithi133 ceph-mon[37053]: pgmap v823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:21 smithi063 ceph-mon[36747]: pgmap v823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:21 smithi043 ceph-mon[32384]: pgmap v823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:23.333 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:43:23.333 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 systemd[1]: Stopped Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:23.333 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 2.311s CPU time. 2024-07-26T08:43:23.333 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 systemd[1]: Starting Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:43:23.333 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 podman[74731]: 2024-07-26 08:43:23.215406757 +0000 UTC m=+0.018497433 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:43:23.333 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 podman[74731]: 2024-07-26 08:43:23.331873083 +0000 UTC m=+0.134963751 container create 46f24ce431f14c2fc4ca25274460e4c364721f9291cd511163492204ae499e38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-07-26T08:43:23.554 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: pgmap v824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: daemon mds.k restarted 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: osdmap e119: 12 total, 12 up, 12 in 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:boot 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:23 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: pgmap v824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: daemon mds.k restarted 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: osdmap e119: 12 total, 12 up, 12 in 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:boot 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:23 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:24.061 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:43:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: pgmap v824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: daemon mds.k restarted 2024-07-26T08:43:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:43:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: osdmap e119: 12 total, 12 up, 12 in 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:boot 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 podman[74731]: 2024-07-26 08:43:23.618320205 +0000 UTC m=+0.421410876 container init 46f24ce431f14c2fc4ca25274460e4c364721f9291cd511163492204ae499e38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 podman[74731]: 2024-07-26 08:43:23.621190647 +0000 UTC m=+0.424281321 container start 46f24ce431f14c2fc4ca25274460e4c364721f9291cd511163492204ae499e38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-mds[74750]: -- 172.21.15.63:0/3797244746 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555982571860 con 0x555986713180 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: starting mds.k at 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 bash[74731]: 46f24ce431f14c2fc4ca25274460e4c364721f9291cd511163492204ae499e38 2024-07-26T08:43:24.069 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:23 smithi063 systemd[1]: Started Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:25.970 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:25 smithi043 ceph-mon[32384]: pgmap v826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:43:25.971 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:25 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:resolve 2024-07-26T08:43:25.971 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:25 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:25.971 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 451.714164 secs 2024-07-26T08:43:25.971 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 467.201292 secs 2024-07-26T08:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:25 smithi063 ceph-mon[36747]: pgmap v826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:25 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:resolve 2024-07-26T08:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:25 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 451.714164 secs 2024-07-26T08:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 467.201292 secs 2024-07-26T08:43:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:25 smithi133 ceph-mon[37053]: pgmap v826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:43:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:25 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:resolve 2024-07-26T08:43:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:25 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 451.714164 secs 2024-07-26T08:43:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 467.201292 secs 2024-07-26T08:43:26.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.888+0000 7f487b200640 1 -- 172.21.15.43:0/230976744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487410b860 msgr2=0x7f4874112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.888+0000 7f487b200640 1 --2- 172.21.15.43:0/230976744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487410b860 0x7f4874112090 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4870009ca0 tx=0x7f487002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 -- 172.21.15.43:0/230976744 shutdown_connections 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 --2- 172.21.15.43:0/230976744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487410b860 0x7f4874112090 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 --2- 172.21.15.43:0/230976744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f487410af10 0x7f487410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 --2- 172.21.15.43:0/230976744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48741055d0 0x7f48741059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 -- 172.21.15.43:0/230976744 >> 172.21.15.43:0/230976744 conn(0x7f4874101040 msgr2=0x7f4874103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 -- 172.21.15.43:0/230976744 shutdown_connections 2024-07-26T08:43:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.889+0000 7f487b200640 1 -- 172.21.15.43:0/230976744 wait complete. 2024-07-26T08:43:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 Processor -- start 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 -- start start 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 0x7f487419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f487410af10 0x7f487419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f487410b860 0x7f48741a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48741156b0 con 0x7f48741055d0 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4874115530 con 0x7f487410b860 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.890+0000 7f487b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4874115830 con 0x7f487410af10 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 0x7f487419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 0x7f487419bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48360/0 (socket says 172.21.15.43:48360) 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 -- 172.21.15.43:0/626320265 learned_addr learned my addr 172.21.15.43:0/626320265 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f487a800640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f487410b860 0x7f48741a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879400640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f487410af10 0x7f487419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 -- 172.21.15.43:0/626320265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f487410af10 msgr2=0x7f487419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f487410af10 0x7f487419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 -- 172.21.15.43:0/626320265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f487410b860 msgr2=0x7f48741a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f487410b860 0x7f48741a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.891+0000 7f4879e00640 1 -- 172.21.15.43:0/626320265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48741a1ef0 con 0x7f48741055d0 2024-07-26T08:43:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.892+0000 7f4879e00640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 0x7f487419bf80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f486800e9f0 tx=0x7f486800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:43:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.892+0000 7f486ea00640 1 -- 172.21.15.43:0/626320265 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486800cd80 con 0x7f48741055d0 2024-07-26T08:43:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.892+0000 7f486ea00640 1 -- 172.21.15.43:0/626320265 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f48680054f0 con 0x7f48741055d0 2024-07-26T08:43:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.892+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48741a21e0 con 0x7f48741055d0 2024-07-26T08:43:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.892+0000 7f486ea00640 1 -- 172.21.15.43:0/626320265 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868010690 con 0x7f48741055d0 2024-07-26T08:43:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.892+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48741a8940 con 0x7f48741055d0 2024-07-26T08:43:26.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.895+0000 7f48833f6740 1 Processor -- start 2024-07-26T08:43:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.895+0000 7f48833f6740 1 -- start start 2024-07-26T08:43:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f48833f6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb98031c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f48833f6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9803700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f48833f6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb9803c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f48833f6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555cb9779b90 con 0x555cb94351b0 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f48833f6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555cb9769090 con 0x555cb945e070 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f48833f6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x555cb976d0d0 con 0x555cb943d390 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f486ea00640 1 -- 172.21.15.43:0/626320265 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f48680046c0 con 0x7f48741055d0 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f487a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb98031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f4879400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb9803c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f487a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb98031c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55100/0 (socket says 172.21.15.43:55100) 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f4879400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb9803c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:37072/0 (socket says 172.21.15.43:37072) 2024-07-26T08:43:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.896+0000 7f487a800640 1 -- 172.21.15.43:0/1849665697 learned_addr learned my addr 172.21.15.43:0/1849665697 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:43:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f4879e00640 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9803700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f487a800640 1 -- 172.21.15.43:0/1849665697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 msgr2=0x555cb9803c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f487a800640 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb9803c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f487a800640 1 -- 172.21.15.43:0/1849665697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 msgr2=0x555cb9803700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f487a800640 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9803700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f487a800640 1 -- 172.21.15.43:0/1849665697 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb94c9650 con 0x555cb945e070 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f4879e00640 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9803700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f487a800640 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb98031c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4870009ca0 tx=0x7f4870009430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555cb5a51dc14eda server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.897+0000 7f4867000640 1 -- 172.21.15.43:0/1849665697 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870031d40 con 0x555cb945e070 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.898+0000 7f4867000640 1 -- 172.21.15.43:0/1849665697 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4870036030 con 0x555cb945e070 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.898+0000 7f4867000640 1 -- 172.21.15.43:0/1849665697 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700042a0 con 0x555cb945e070 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.898+0000 7f486ea00640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f485c0b3d40 0x7f485c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.898+0000 7f486ea00640 1 -- 172.21.15.43:0/626320265 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 11946+0+0 (secure 0 0 0) 0x7f48680e5190 con 0x7f48741055d0 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.898+0000 7f4879e00640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f485c0b3d40 0x7f485c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 -- 172.21.15.43:0/1849665697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 msgr2=0x555cb98031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb98031c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4870009ca0 tx=0x7f4870009430 comp rx=0 tx=0).stop 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f4879e00640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f485c0b3d40 0x7f485c0b6250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x555cb9801e40 tx=0x7f4868004b70 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 -- 172.21.15.43:0/1849665697 shutdown_connections 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb9803c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9803700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 --2- 172.21.15.43:0/1849665697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb98031c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 -- 172.21.15.43:0/1849665697 >> 172.21.15.43:0/1849665697 conn(0x555cb9452460 msgr2=0x555cb98010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 -- 172.21.15.43:0/1849665697 shutdown_connections 2024-07-26T08:43:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.899+0000 7f48833f6740 1 -- 172.21.15.43:0/1849665697 wait complete. 2024-07-26T08:43:26.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 -- start start 2024-07-26T08:43:26.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 Processor -- start 2024-07-26T08:43:26.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb980e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb980ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb980f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555cb95cc700 con 0x555cb94351b0 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555cb9705660 con 0x555cb945e070 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.900+0000 7f48833f6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x555cb98117c0 con 0x555cb943d390 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f48833f6740 10 client.0 _ll_register_callbacks cb 0x555cb9715110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f487a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb980e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb980ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb980ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:37088/0 (socket says 172.21.15.43:37088) 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 -- 172.21.15.43:0/1338155400 learned_addr learned my addr 172.21.15.43:0/1338155400 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f487a800640 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb980f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 -- 172.21.15.43:0/1338155400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 msgr2=0x555cb980f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb980f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 -- 172.21.15.43:0/1338155400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 msgr2=0x555cb980e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb980e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.901+0000 7f4879400640 1 -- 172.21.15.43:0/1338155400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb971c800 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f4879400640 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb980ed50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f48600126e0 tx=0x7f4860012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0033265c3dd8ce server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f485b400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f485b400640 1 -- 172.21.15.43:0/1338155400 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860012190 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4870036030 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f485b400640 1 -- 172.21.15.43:0/1338155400 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 11946+0+0 (secure 0 0 0) 0x7f486000f920 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f485b400640 1 -- 172.21.15.43:0/1338155400 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=218) ==== 24+0+0 (secure 0 0 0) 0x7f486000fb20 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f48833f6740 10 client.26203 fetch_fsmap learned FSMap version 218 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.902+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=218,monmap=4+}) -- 0x555cb981d460 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f485b400640 1 -- 172.21.15.43:0/1338155400 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4870036030 con 0x555cb943d390 2024-07-26T08:43:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f485b400640 1 -- 172.21.15.43:0/1338155400 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 218) ==== 5938+0+0 (secure 0 0 0) 0x7f486001c420 con 0x555cb943d390 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f48833f6740 10 client.26203 fetch_fsmap finished waiting for FSMap version 218 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f48833f6740 10 client.26203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f48833f6740 20 client.26203 populate_metadata read hostname 'smithi043' 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f48833f6740 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb941c9f0 0x555cb9820d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f48833f6740 4 client.26203 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cb977bae0 con 0x555cb941c9f0 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.903+0000 7f487a800640 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb941c9f0 0x555cb9820d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.904+0000 7f487a800640 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb941c9f0 0x555cb9820d40 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1eab466682f66d server_cookie=18a778add32a473d in_seq=0 out_seq=0 2024-07-26T08:43:26.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.904+0000 7f485b400640 10 client.26203 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:43:26.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f485b400640 1 -- 172.21.15.43:0/1338155400 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cb977bae0 con 0x555cb941c9f0 2024-07-26T08:43:26.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f485b400640 10 client.26203 handle_command_reply: tid=0 2024-07-26T08:43:26.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 client.26203 shutdown 2024-07-26T08:43:26.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 msgr2=0x555cb980ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb980ed50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f48600126e0 tx=0x7f4860012ba0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 shutdown_connections 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb941c9f0 0x555cb9820d40 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb943d390 0x555cb980ed50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb945e070 0x555cb980f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f485b400640 0 client.26203 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 --2- 172.21.15.43:0/1338155400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb980e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.905+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 >> 172.21.15.43:0/1338155400 conn(0x555cb9452460 msgr2=0x555cb9806350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.906+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 shutdown_connections 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.906+0000 7f48833f6740 1 -- 172.21.15.43:0/1338155400 wait complete. 2024-07-26T08:43:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.906+0000 7f48833f6740 20 client.26203 trim_cache size 0 max 16384 2024-07-26T08:43:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 Processor -- start 2024-07-26T08:43:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 -- start start 2024-07-26T08:43:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb94351b0 0x555cb9804bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 0x555cb97ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9810440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48741b3fb0 con 0x555cb943d390 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f48741b5420 con 0x555cb94351b0 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f48833f6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f48741b4680 con 0x555cb945e070 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f4879400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 0x555cb97ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.925+0000 7f4879400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 0x555cb97ff6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48396/0 (socket says 172.21.15.43:48396) 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 -- 172.21.15.43:0/3404940680 learned_addr learned my addr 172.21.15.43:0/3404940680 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f487a800640 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb94351b0 0x555cb9804bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f487a800640 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9810440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 -- 172.21.15.43:0/3404940680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 msgr2=0x555cb9810440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9810440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 -- 172.21.15.43:0/3404940680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb94351b0 msgr2=0x555cb9804bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb94351b0 0x555cb9804bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 -- 172.21.15.43:0/3404940680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb9811340 con 0x555cb943d390 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f487a800640 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9810440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4879400640 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 0x555cb97ff6f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f486000f810 tx=0x7f486000f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6849ad67590987fd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.926+0000 7f4866600640 1 -- 172.21.15.43:0/3404940680 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860012190 con 0x555cb943d390 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f4866600640 1 -- 172.21.15.43:0/3404940680 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f48600055b0 con 0x555cb943d390 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f4866600640 1 -- 172.21.15.43:0/3404940680 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486001c680 con 0x555cb943d390 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 -- 172.21.15.43:0/3404940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 msgr2=0x555cb97ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 0x555cb97ff6f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f486000f810 tx=0x7f486000f840 comp rx=0 tx=0).stop 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 -- 172.21.15.43:0/3404940680 shutdown_connections 2024-07-26T08:43:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9810440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb943d390 0x555cb97ff6f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 --2- 172.21.15.43:0/3404940680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb94351b0 0x555cb9804bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.927+0000 7f48833f6740 1 -- 172.21.15.43:0/3404940680 >> 172.21.15.43:0/3404940680 conn(0x555cb9452460 msgr2=0x555cb980fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.928+0000 7f48833f6740 1 -- 172.21.15.43:0/3404940680 shutdown_connections 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.928+0000 7f48833f6740 1 -- 172.21.15.43:0/3404940680 wait complete. 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.928+0000 7f48833f6740 1 -- start start 2024-07-26T08:43:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.928+0000 7f48833f6740 1 Processor -- start 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9814450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb943d390 0x555cb98149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9880540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48741b2dd0 con 0x555cb94351b0 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f48741b4d50 con 0x555cb943d390 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f48741b2090 con 0x555cb945e070 2024-07-26T08:43:26.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f48833f6740 10 client.0 _ll_register_callbacks cb 0x7f4860009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f487a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9814450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f4879400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb943d390 0x555cb98149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f487a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9814450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48398/0 (socket says 172.21.15.43:48398) 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f487a800640 1 -- 172.21.15.43:0/521207294 learned_addr learned my addr 172.21.15.43:0/521207294 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.929+0000 7f487a800640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9880540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f4879400640 1 -- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 msgr2=0x555cb9880540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f4879400640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9880540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f4879400640 1 -- 172.21.15.43:0/521207294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 msgr2=0x555cb9814450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:43:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f4879400640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9814450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f4879400640 1 -- 172.21.15.43:0/521207294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb9880bb0 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f487a800640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9880540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f4879400640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb943d390 0x555cb98149f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f486001ca80 tx=0x7f486001cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886eefd734ceb0a3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f485b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f485b400640 1 -- 172.21.15.43:0/521207294 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486000fcc0 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f485b400640 1 -- 172.21.15.43:0/521207294 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 11946+0+0 (secure 0 0 0) 0x7f486001c420 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.930+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48600055b0 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f485b400640 1 -- 172.21.15.43:0/521207294 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=218) ==== 24+0+0 (secure 0 0 0) 0x7f486003c050 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 10 client.26207 fetch_fsmap learned FSMap version 218 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=218,monmap=4+}) -- 0x555cb98890c0 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f485b400640 1 -- 172.21.15.43:0/521207294 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f48600055b0 con 0x555cb943d390 2024-07-26T08:43:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f485b400640 1 -- 172.21.15.43:0/521207294 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 218) ==== 5938+0+0 (secure 0 0 0) 0x7f4860003bc0 con 0x555cb943d390 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 10 client.26207 fetch_fsmap finished waiting for FSMap version 218 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 10 client.26207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 20 client.26207 populate_metadata read hostname 'smithi043' 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb93f1da0 0x555cb988b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 4 client.26207 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.931+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555cb9777580 con 0x555cb93f1da0 2024-07-26T08:43:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.932+0000 7f487a800640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb93f1da0 0x555cb988b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:43:26.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.932+0000 7f487a800640 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb93f1da0 0x555cb988b760 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8653b0fca7c4b3d1 server_cookie=7cd911aaaacb64bd in_seq=0 out_seq=0 2024-07-26T08:43:26.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.932+0000 7f485b400640 10 client.26207 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:43:26.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f485b400640 1 -- 172.21.15.43:0/521207294 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x555cb9777580 con 0x555cb93f1da0 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f485b400640 10 client.26207 handle_command_reply: tid=0 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 client.26207 shutdown 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb943d390 msgr2=0x555cb98149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb943d390 0x555cb98149f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f486001ca80 tx=0x7f486001cb00 comp rx=0 tx=0).stop 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 shutdown_connections 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x555cb93f1da0 0x555cb988b760 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555cb945e070 0x555cb9880540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cb943d390 0x555cb98149f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 --2- 172.21.15.43:0/521207294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb94351b0 0x555cb9814450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f485b400640 0 client.26207 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 >> 172.21.15.43:0/521207294 conn(0x555cb9452460 msgr2=0x555cb9804980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:43:26.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 shutdown_connections 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 1 -- 172.21.15.43:0/521207294 wait complete. 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.933+0000 7f48833f6740 20 client.26207 trim_cache size 0 max 16384 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:43:26.939 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f485c0b3d40 msgr2=0x7f485c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f485c0b3d40 0x7f485c0b6250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x555cb9801e40 tx=0x7f4868004b70 comp rx=0 tx=0).stop 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 msgr2=0x7f487419bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:43:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 0x7f487419bf80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f486800e9f0 tx=0x7f486800edf0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 shutdown_connections 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f485c0b3d40 0x7f485c0b6250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f487410af10 0x7f487419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f487410b860 0x7f48741a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 --2- 172.21.15.43:0/626320265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48741055d0 0x7f487419bf80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 >> 172.21.15.43:0/626320265 conn(0x7f4874101040 msgr2=0x7f4874108440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 shutdown_connections 2024-07-26T08:43:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:43:26.934+0000 7f487b200640 1 -- 172.21.15.43:0/626320265 wait complete. 2024-07-26T08:43:27.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:26 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:43:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:26 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:reconnect 2024-07-26T08:43:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:26 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:26 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:43:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:26 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:43:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:26 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:reconnect 2024-07-26T08:43:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:26 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:26 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:43:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:26 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:43:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:26 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:reconnect 2024-07-26T08:43:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:26 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:26 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:43:27.818 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:43:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:27 smithi063 ceph-mon[36747]: pgmap v827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:43:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:27 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:rejoin 2024-07-26T08:43:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:27 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:27 smithi063 ceph-mon[36747]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:43:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-mon[32384]: pgmap v827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:43:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:rejoin 2024-07-26T08:43:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-mon[32384]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:43:28.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:43:28.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: *** Caught signal (Aborted) ** 2024-07-26T08:43:28.234 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: in thread 7f3b49c00640 thread_name:ms_dispatch 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3b4fe3e6f0] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f3b4fe8b94c] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 3: raise() 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 4: abort() 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 5: /lib64/libc.so.6(+0x2871b) [0x7f3b4fe2871b] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 6: /lib64/libc.so.6(+0x37386) [0x7f3b4fe37386] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e85a3f66b9] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e85a5b480c] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e85a4f42ca] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e85a4c4753] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e85a4c5a1b] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e85a4a9752] 2024-07-26T08:43:28.235 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e85a3f7a56] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e85a3fb637] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e85a3fbf5e] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e85a3df03a] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f3b5099b407] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 18: (DispatchQueue::entry()+0x60f) [0x7f3b5099bcf9] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f3b50a785a1] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 20: (Thread::entry_wrapper()+0x43) [0x7f3b50825cdd] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 21: (Thread::_entry_func(void*)+0xd) [0x7f3b50825cf9] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 22: /lib64/libc.so.6(+0x89c02) [0x7f3b4fe89c02] 2024-07-26T08:43:28.236 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f3b4ff0ec40] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:27.823+0000 7f3b49c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: in thread 7f3b49c00640 thread_name:ms_dispatch 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3b4fe3e6f0] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f3b4fe8b94c] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 3: raise() 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 4: abort() 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 5: /lib64/libc.so.6(+0x2871b) [0x7f3b4fe2871b] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 6: /lib64/libc.so.6(+0x37386) [0x7f3b4fe37386] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e85a3f66b9] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e85a5b480c] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e85a4f42ca] 2024-07-26T08:43:28.237 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e85a4c4753] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e85a4c5a1b] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e85a4a9752] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e85a3f7a56] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e85a3fb637] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e85a3fbf5e] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e85a3df03a] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f3b5099b407] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 18: (DispatchQueue::entry()+0x60f) [0x7f3b5099bcf9] 2024-07-26T08:43:28.238 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f3b50a785a1] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 20: (Thread::entry_wrapper()+0x43) [0x7f3b50825cdd] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 21: (Thread::_entry_func(void*)+0xd) [0x7f3b50825cf9] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 22: /lib64/libc.so.6(+0x89c02) [0x7f3b4fe89c02] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f3b4ff0ec40] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 0> 2024-07-26T08:43:27.823+0000 7f3b49c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: in thread 7f3b49c00640 thread_name:ms_dispatch 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3b4fe3e6f0] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f3b4fe8b94c] 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 3: raise() 2024-07-26T08:43:28.239 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 4: abort() 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 5: /lib64/libc.so.6(+0x2871b) [0x7f3b4fe2871b] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 6: /lib64/libc.so.6(+0x37386) [0x7f3b4fe37386] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e85a3f66b9] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e85a5b480c] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e85a4f42ca] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e85a4c4753] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e85a4c5a1b] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e85a4a9752] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e85a3f7a56] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e85a3fb637] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e85a3fbf5e] 2024-07-26T08:43:28.240 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e85a3df03a] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f3b5099b407] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 18: (DispatchQueue::entry()+0x60f) [0x7f3b5099bcf9] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f3b50a785a1] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 20: (Thread::entry_wrapper()+0x43) [0x7f3b50825cdd] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 21: (Thread::_entry_func(void*)+0xd) [0x7f3b50825cf9] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 22: /lib64/libc.so.6(+0x89c02) [0x7f3b4fe89c02] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f3b4ff0ec40] 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:28.241 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 0> 2024-07-26T08:43:27.823+0000 7f3b49c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: in thread 7f3b49c00640 thread_name:ms_dispatch 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3b4fe3e6f0] 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f3b4fe8b94c] 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 3: raise() 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 4: abort() 2024-07-26T08:43:28.242 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 5: /lib64/libc.so.6(+0x2871b) [0x7f3b4fe2871b] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 6: /lib64/libc.so.6(+0x37386) [0x7f3b4fe37386] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e85a3f66b9] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e85a5b480c] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e85a4f42ca] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e85a4c4753] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e85a4c5a1b] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e85a4a9752] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e85a3f7a56] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e85a3fb637] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e85a3fbf5e] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e85a3df03a] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f3b5099b407] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 18: (DispatchQueue::entry()+0x60f) [0x7f3b5099bcf9] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f3b50a785a1] 2024-07-26T08:43:28.243 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 20: (Thread::entry_wrapper()+0x43) [0x7f3b50825cdd] 2024-07-26T08:43:28.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 21: (Thread::_entry_func(void*)+0xd) [0x7f3b50825cf9] 2024-07-26T08:43:28.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 22: /lib64/libc.so.6(+0x89c02) [0x7f3b4fe89c02] 2024-07-26T08:43:28.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f3b4ff0ec40] 2024-07-26T08:43:28.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:28.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106615]: 2024-07-26T08:43:28.244 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:27 smithi043 podman[106840]: 2024-07-26 08:43:27.964778204 +0000 UTC m=+0.038531255 container died ee06a4bb4b9ddd2d9753a3dfd158ed480adbf44521bfcdfea81a3cc5b19d3f67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:43:28.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:27 smithi133 ceph-mon[37053]: pgmap v827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:43:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:27 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:rejoin 2024-07-26T08:43:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:27 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:27 smithi133 ceph-mon[37053]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:43:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:28 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:28 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:active 2024-07-26T08:43:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:28 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:28 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:29.155 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:28 smithi043 podman[106840]: 2024-07-26 08:43:28.785455726 +0000 UTC m=+0.859208783 container remove ee06a4bb4b9ddd2d9753a3dfd158ed480adbf44521bfcdfea81a3cc5b19d3f67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS) 2024-07-26T08:43:29.156 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:28 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:43:29.156 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:28 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:29.156 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:28 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:active 2024-07-26T08:43:29.156 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:28 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:29.156 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:28 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:28 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:28 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/90216852,v1:172.21.15.43:6837/90216852] up:active 2024-07-26T08:43:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:28 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:28 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:29.482 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:29 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:43:29.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:29 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.185s CPU time. 2024-07-26T08:43:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:29 smithi043 ceph-mon[32384]: pgmap v828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:43:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:29 smithi063 ceph-mon[36747]: pgmap v828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:43:30.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:29 smithi133 ceph-mon[37053]: pgmap v828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:43:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 456.714278 secs 2024-07-26T08:43:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 472.201363 secs 2024-07-26T08:43:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 456.714278 secs 2024-07-26T08:43:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 472.201363 secs 2024-07-26T08:43:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 456.714278 secs 2024-07-26T08:43:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 472.201363 secs 2024-07-26T08:43:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:31 smithi043 ceph-mon[32384]: pgmap v829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:43:32.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:31 smithi133 ceph-mon[37053]: pgmap v829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:43:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:31 smithi063 ceph-mon[36747]: pgmap v829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:43:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:33 smithi043 ceph-mon[32384]: pgmap v830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:34.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:33 smithi133 ceph-mon[37053]: pgmap v830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:33 smithi063 ceph-mon[36747]: pgmap v830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:35 smithi043 ceph-mon[32384]: pgmap v831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 186 B/s wr, 10 op/s 2024-07-26T08:43:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 461.714409 secs 2024-07-26T08:43:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 477.201475 secs 2024-07-26T08:43:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:35 smithi133 ceph-mon[37053]: pgmap v831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 186 B/s wr, 10 op/s 2024-07-26T08:43:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 461.714409 secs 2024-07-26T08:43:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 477.201475 secs 2024-07-26T08:43:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:35 smithi063 ceph-mon[36747]: pgmap v831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 186 B/s wr, 10 op/s 2024-07-26T08:43:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 461.714409 secs 2024-07-26T08:43:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 477.201475 secs 2024-07-26T08:43:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:37 smithi043 ceph-mon[32384]: pgmap v832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:38.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:37 smithi133 ceph-mon[37053]: pgmap v832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:37 smithi063 ceph-mon[36747]: pgmap v832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:39.852 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:39 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:43:39.852 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:39 smithi043 systemd[1]: Stopped Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:39.852 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:39 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.185s CPU time. 2024-07-26T08:43:39.852 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:39 smithi043 systemd[1]: Starting Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:43:40.164 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:39 smithi043 podman[106930]: 2024-07-26 08:43:39.804737657 +0000 UTC m=+0.041750166 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:43:40.164 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:39 smithi043 podman[106930]: 2024-07-26 08:43:39.978691979 +0000 UTC m=+0.215704490 container create 7ed72e11985e899d262bf4ceb218e4dec4a7ca605e5339a25fb8e5d60ca5c326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-07-26T08:43:40.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:39 smithi043 ceph-mon[32384]: pgmap v833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:40.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:39 smithi133 ceph-mon[37053]: pgmap v833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:39 smithi063 ceph-mon[36747]: pgmap v833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:40.733 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:40 smithi043 podman[106930]: 2024-07-26 08:43:40.300154303 +0000 UTC m=+0.537166821 container init 7ed72e11985e899d262bf4ceb218e4dec4a7ca605e5339a25fb8e5d60ca5c326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:43:40.733 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:40 smithi043 podman[106930]: 2024-07-26 08:43:40.311016397 +0000 UTC m=+0.548028934 container start 7ed72e11985e899d262bf4ceb218e4dec4a7ca605e5339a25fb8e5d60ca5c326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-07-26T08:43:40.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:40 smithi043 bash[106930]: 7ed72e11985e899d262bf4ceb218e4dec4a7ca605e5339a25fb8e5d60ca5c326 2024-07-26T08:43:40.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:40 smithi043 systemd[1]: Started Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:40.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mds[106949]: -- 172.21.15.43:0/2999182410 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e76d9e9c20 con 0x55e771b8ba80 2024-07-26T08:43:40.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: starting mds.d at 2024-07-26T08:43:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 466.714518 secs 2024-07-26T08:43:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: daemon mds.d restarted 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: osdmap e120: 12 total, 12 up, 12 in 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:boot 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 482.201545 secs 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 466.714518 secs 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: daemon mds.d restarted 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: osdmap e120: 12 total, 12 up, 12 in 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:boot 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 482.201545 secs 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 466.714518 secs 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: daemon mds.d restarted 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: osdmap e120: 12 total, 12 up, 12 in 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:boot 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 482.201545 secs 2024-07-26T08:43:42.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:42 smithi043 ceph-mon[32384]: pgmap v835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:43:42.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:42 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:resolve 2024-07-26T08:43:42.720 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:42 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:42 smithi133 ceph-mon[37053]: pgmap v835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:43:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:42 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:resolve 2024-07-26T08:43:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:42 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:42 smithi063 ceph-mon[36747]: pgmap v835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:43:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:42 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:resolve 2024-07-26T08:43:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:42 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:43 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:43:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:43 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:reconnect 2024-07-26T08:43:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:43 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:43 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:43:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:43 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:43:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:43 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:reconnect 2024-07-26T08:43:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:43 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:43 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:43:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:43 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:43:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:43 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:reconnect 2024-07-26T08:43:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:43 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:43 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:43:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:44 smithi133 ceph-mon[37053]: pgmap v836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:43:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:44 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:rejoin 2024-07-26T08:43:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:44 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:44 smithi133 ceph-mon[37053]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:43:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-mon[36747]: pgmap v836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:43:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:rejoin 2024-07-26T08:43:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-mon[36747]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: *** Caught signal (Aborted) ** 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: in thread 7faf077ec640 thread_name:ms_dispatch 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf0cbc36f0] 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7faf0cc1094c] 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 3: raise() 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 4: abort() 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 5: /lib64/libc.so.6(+0x2871b) [0x7faf0cbad71b] 2024-07-26T08:43:44.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 6: /lib64/libc.so.6(+0x37386) [0x7faf0cbbc386] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55597fb466b9] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55597fd0480c] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55597fc442ca] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55597fc14753] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55597fc15a1b] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55597fbf9752] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55597fb47a56] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55597fb4b637] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55597fb4bf5e] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55597fb2f03a] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7faf0d490407] 2024-07-26T08:43:44.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 18: (DispatchQueue::entry()+0x60f) [0x7faf0d490cf9] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7faf0d56d5a1] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 20: (Thread::entry_wrapper()+0x43) [0x7faf0d31acdd] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 21: (Thread::_entry_func(void*)+0xd) [0x7faf0d31acf9] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 22: /lib64/libc.so.6(+0x89c02) [0x7faf0cc0ec02] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7faf0cc93c40] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.524+0000 7faf077ec640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: in thread 7faf077ec640 thread_name:ms_dispatch 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf0cbc36f0] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7faf0cc1094c] 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 3: raise() 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 4: abort() 2024-07-26T08:43:44.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 5: /lib64/libc.so.6(+0x2871b) [0x7faf0cbad71b] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 6: /lib64/libc.so.6(+0x37386) [0x7faf0cbbc386] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55597fb466b9] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55597fd0480c] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55597fc442ca] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55597fc14753] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55597fc15a1b] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55597fbf9752] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55597fb47a56] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55597fb4b637] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55597fb4bf5e] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55597fb2f03a] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7faf0d490407] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 18: (DispatchQueue::entry()+0x60f) [0x7faf0d490cf9] 2024-07-26T08:43:44.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7faf0d56d5a1] 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 20: (Thread::entry_wrapper()+0x43) [0x7faf0d31acdd] 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 21: (Thread::_entry_func(void*)+0xd) [0x7faf0d31acf9] 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 22: /lib64/libc.so.6(+0x89c02) [0x7faf0cc0ec02] 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7faf0cc93c40] 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 0> 2024-07-26T08:43:44.524+0000 7faf077ec640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: in thread 7faf077ec640 thread_name:ms_dispatch 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf0cbc36f0] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7faf0cc1094c] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 3: raise() 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 4: abort() 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 5: /lib64/libc.so.6(+0x2871b) [0x7faf0cbad71b] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 6: /lib64/libc.so.6(+0x37386) [0x7faf0cbbc386] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55597fb466b9] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55597fd0480c] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55597fc442ca] 2024-07-26T08:43:44.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55597fc14753] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55597fc15a1b] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55597fbf9752] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55597fb47a56] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55597fb4b637] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55597fb4bf5e] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55597fb2f03a] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7faf0d490407] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 18: (DispatchQueue::entry()+0x60f) [0x7faf0d490cf9] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7faf0d56d5a1] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 20: (Thread::entry_wrapper()+0x43) [0x7faf0d31acdd] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 21: (Thread::_entry_func(void*)+0xd) [0x7faf0d31acf9] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 22: /lib64/libc.so.6(+0x89c02) [0x7faf0cc0ec02] 2024-07-26T08:43:44.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7faf0cc93c40] 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 0> 2024-07-26T08:43:44.524+0000 7faf077ec640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: in thread 7faf077ec640 thread_name:ms_dispatch 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf0cbc36f0] 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2: /lib64/libc.so.6(+0x8b94c) [0x7faf0cc1094c] 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 3: raise() 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 4: abort() 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 5: /lib64/libc.so.6(+0x2871b) [0x7faf0cbad71b] 2024-07-26T08:43:44.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 6: /lib64/libc.so.6(+0x37386) [0x7faf0cbbc386] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55597fb466b9] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55597fd0480c] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55597fc442ca] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55597fc14753] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55597fc15a1b] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55597fbf9752] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55597fb47a56] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55597fb4b637] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55597fb4bf5e] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55597fb2f03a] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7faf0d490407] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 18: (DispatchQueue::entry()+0x60f) [0x7faf0d490cf9] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7faf0d56d5a1] 2024-07-26T08:43:44.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 20: (Thread::entry_wrapper()+0x43) [0x7faf0d31acdd] 2024-07-26T08:43:44.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 21: (Thread::_entry_func(void*)+0xd) [0x7faf0d31acf9] 2024-07-26T08:43:44.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 22: /lib64/libc.so.6(+0x89c02) [0x7faf0cc0ec02] 2024-07-26T08:43:44.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 23: /lib64/libc.so.6(+0x10ec40) [0x7faf0cc93c40] 2024-07-26T08:43:44.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:43:44.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74746]: 2024-07-26T08:43:44.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:44 smithi063 podman[74785]: 2024-07-26 08:43:44.583413708 +0000 UTC m=+0.019738402 container died 46f24ce431f14c2fc4ca25274460e4c364721f9291cd511163492204ae499e38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True) 2024-07-26T08:43:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:44 smithi043 ceph-mon[32384]: pgmap v836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:43:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:44 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:rejoin 2024-07-26T08:43:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:44 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:44 smithi043 ceph-mon[32384]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:43:45.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:45 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:45.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:45 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:active 2024-07-26T08:43:45.541 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:45 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:45.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:45 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:45.542 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 471.714585 secs 2024-07-26T08:43:45.678 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:45 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:45.678 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:45 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:active 2024-07-26T08:43:45.678 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:45 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:45.678 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:45 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:45.679 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 471.714585 secs 2024-07-26T08:43:45.679 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:45 smithi063 podman[74785]: 2024-07-26 08:43:45.423067096 +0000 UTC m=+0.859391778 container remove 46f24ce431f14c2fc4ca25274460e4c364721f9291cd511163492204ae499e38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T08:43:45.679 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:43:45.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:45 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:43:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:45 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/1808516906,v1:172.21.15.63:6833/1808516906] up:active 2024-07-26T08:43:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:45 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:45 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:43:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 471.714585 secs 2024-07-26T08:43:46.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:43:46.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:45 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 1.959s CPU time. 2024-07-26T08:43:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:46 smithi063 ceph-mon[36747]: pgmap v837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:43:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 487.201670 secs 2024-07-26T08:43:46.879 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:46 smithi043 ceph-mon[32384]: pgmap v837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:43:46.879 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 487.201670 secs 2024-07-26T08:43:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:46 smithi133 ceph-mon[37053]: pgmap v837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-07-26T08:43:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 487.201670 secs 2024-07-26T08:43:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:48 smithi063 ceph-mon[36747]: pgmap v838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:48.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:48 smithi043 ceph-mon[32384]: pgmap v838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:48 smithi133 ceph-mon[37053]: pgmap v838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:50 smithi063 ceph-mon[36747]: pgmap v839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 476.714728 secs 2024-07-26T08:43:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:50 smithi043 ceph-mon[32384]: pgmap v839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 476.714728 secs 2024-07-26T08:43:51.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:50 smithi133 ceph-mon[37053]: pgmap v839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:43:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 476.714728 secs 2024-07-26T08:43:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 492.201796 secs 2024-07-26T08:43:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 492.201796 secs 2024-07-26T08:43:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 492.201796 secs 2024-07-26T08:43:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:52 smithi063 ceph-mon[36747]: pgmap v840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 200 B/s wr, 10 op/s 2024-07-26T08:43:52.893 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:52 smithi043 ceph-mon[32384]: pgmap v840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 200 B/s wr, 10 op/s 2024-07-26T08:43:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:52 smithi133 ceph-mon[37053]: pgmap v840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 200 B/s wr, 10 op/s 2024-07-26T08:43:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:54 smithi063 ceph-mon[36747]: pgmap v841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:54 smithi043 ceph-mon[32384]: pgmap v841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:55.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:54 smithi133 ceph-mon[37053]: pgmap v841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:43:55.718 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 481.714871 secs 2024-07-26T08:43:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 481.714871 secs 2024-07-26T08:43:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 481.714871 secs 2024-07-26T08:43:56.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:43:56.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:55 smithi063 systemd[1]: Stopped Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:56.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 1.959s CPU time. 2024-07-26T08:43:56.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:55 smithi063 systemd[1]: Starting Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:43:56.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 podman[74877]: 2024-07-26 08:43:55.960029798 +0000 UTC m=+0.018015028 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:43:56.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 podman[74877]: 2024-07-26 08:43:56.074450881 +0000 UTC m=+0.132436144 container create 4ef6a859a5889b571df3d7dca26e673edd63487f83ea1d05ab06b72f298c9a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 podman[74877]: 2024-07-26 08:43:56.335405182 +0000 UTC m=+0.393390404 container init 4ef6a859a5889b571df3d7dca26e673edd63487f83ea1d05ab06b72f298c9a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 podman[74877]: 2024-07-26 08:43:56.338593097 +0000 UTC m=+0.396578323 container start 4ef6a859a5889b571df3d7dca26e673edd63487f83ea1d05ab06b72f298c9a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240724) 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mds[74895]: -- 172.21.15.63:0/1259768262 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563142fc5860 con 0x563147167600 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: starting mds.k at 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 bash[74877]: 4ef6a859a5889b571df3d7dca26e673edd63487f83ea1d05ab06b72f298c9a10 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:43:56 smithi063 systemd[1]: Started Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:43:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: pgmap v842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 497.201922 secs 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: daemon mds.k restarted 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: osdmap e121: 12 total, 12 up, 12 in 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:boot 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:56 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:56.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: pgmap v842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 497.201922 secs 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: daemon mds.k restarted 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: osdmap e121: 12 total, 12 up, 12 in 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:boot 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:56 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: pgmap v842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 497.201922 secs 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: daemon mds.k restarted 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: osdmap e121: 12 total, 12 up, 12 in 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:boot 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:43:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:56 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:57.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:43:57.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:43:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:43:58.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:43:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:43:58.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:58 smithi043 ceph-mon[32384]: pgmap v844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:58.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:58 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:resolve 2024-07-26T08:43:58.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:58 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:58.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:43:58.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:43:58.725 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:43:59.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:58 smithi133 ceph-mon[37053]: pgmap v844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:58 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:resolve 2024-07-26T08:43:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:58 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:43:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:43:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:43:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:58 smithi063 ceph-mon[36747]: pgmap v844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:43:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:58 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:resolve 2024-07-26T08:43:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:58 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:43:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:43:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:43:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:59 smithi043 ceph-mon[32384]: pgmap v845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6 op/s 2024-07-26T08:43:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:59 smithi043 ceph-mon[32384]: pgmap v846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6 op/s 2024-07-26T08:43:59.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:59 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:43:59.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:59 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:reconnect 2024-07-26T08:43:59.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:59 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:43:59.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:43:59 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:44:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:59 smithi133 ceph-mon[37053]: pgmap v845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6 op/s 2024-07-26T08:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:59 smithi133 ceph-mon[37053]: pgmap v846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6 op/s 2024-07-26T08:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:59 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:59 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:reconnect 2024-07-26T08:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:59 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:43:59 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:44:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:59 smithi063 ceph-mon[36747]: pgmap v845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6 op/s 2024-07-26T08:44:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:59 smithi063 ceph-mon[36747]: pgmap v846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6 op/s 2024-07-26T08:44:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:59 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:44:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:59 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:reconnect 2024-07-26T08:44:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:59 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:43:59 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:44:00.361 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:44:00.361 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: *** Caught signal (Aborted) ** 2024-07-26T08:44:00.361 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: in thread 7f34f1200640 thread_name:ms_dispatch 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f34f743e6f0] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f34f748b94c] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 3: raise() 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 4: abort() 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 5: /lib64/libc.so.6(+0x2871b) [0x7f34f742871b] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 6: /lib64/libc.so.6(+0x37386) [0x7f34f7437386] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e7663556b9] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e76651380c] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e7664532ca] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e766423753] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e766424a1b] 2024-07-26T08:44:00.362 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e766408752] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e766356a56] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e76635a637] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e76635af5e] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e76633e03a] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f34f7f9b407] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 18: (DispatchQueue::entry()+0x60f) [0x7f34f7f9bcf9] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f34f80785a1] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 20: (Thread::entry_wrapper()+0x43) [0x7f34f7e25cdd] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 21: (Thread::_entry_func(void*)+0xd) [0x7f34f7e25cf9] 2024-07-26T08:44:00.363 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 22: /lib64/libc.so.6(+0x89c02) [0x7f34f7489c02] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f34f750ec40] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.086+0000 7f34f1200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: in thread 7f34f1200640 thread_name:ms_dispatch 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f34f743e6f0] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f34f748b94c] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 3: raise() 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 4: abort() 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 5: /lib64/libc.so.6(+0x2871b) [0x7f34f742871b] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 6: /lib64/libc.so.6(+0x37386) [0x7f34f7437386] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e7663556b9] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e76651380c] 2024-07-26T08:44:00.364 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e7664532ca] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e766423753] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e766424a1b] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e766408752] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e766356a56] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e76635a637] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e76635af5e] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e76633e03a] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f34f7f9b407] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 18: (DispatchQueue::entry()+0x60f) [0x7f34f7f9bcf9] 2024-07-26T08:44:00.365 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f34f80785a1] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 20: (Thread::entry_wrapper()+0x43) [0x7f34f7e25cdd] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 21: (Thread::_entry_func(void*)+0xd) [0x7f34f7e25cf9] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 22: /lib64/libc.so.6(+0x89c02) [0x7f34f7489c02] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f34f750ec40] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 0> 2024-07-26T08:44:00.086+0000 7f34f1200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: in thread 7f34f1200640 thread_name:ms_dispatch 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f34f743e6f0] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f34f748b94c] 2024-07-26T08:44:00.366 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 3: raise() 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 4: abort() 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 5: /lib64/libc.so.6(+0x2871b) [0x7f34f742871b] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 6: /lib64/libc.so.6(+0x37386) [0x7f34f7437386] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e7663556b9] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e76651380c] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e7664532ca] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e766423753] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e766424a1b] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e766408752] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e766356a56] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e76635a637] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e76635af5e] 2024-07-26T08:44:00.367 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e76633e03a] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f34f7f9b407] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 18: (DispatchQueue::entry()+0x60f) [0x7f34f7f9bcf9] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f34f80785a1] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 20: (Thread::entry_wrapper()+0x43) [0x7f34f7e25cdd] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 21: (Thread::_entry_func(void*)+0xd) [0x7f34f7e25cf9] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 22: /lib64/libc.so.6(+0x89c02) [0x7f34f7489c02] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f34f750ec40] 2024-07-26T08:44:00.368 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: -2> 2024-07-26T08:44:00.086+0000 7f34f1200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: in thread 7f34f1200640 thread_name:ms_dispatch 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f34f743e6f0] 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f34f748b94c] 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 3: raise() 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 4: abort() 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 5: /lib64/libc.so.6(+0x2871b) [0x7f34f742871b] 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 6: /lib64/libc.so.6(+0x37386) [0x7f34f7437386] 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e7663556b9] 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e76651380c] 2024-07-26T08:44:00.369 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e7664532ca] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e766423753] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e766424a1b] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e766408752] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e766356a56] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e76635a637] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e76635af5e] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e76633e03a] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f34f7f9b407] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 18: (DispatchQueue::entry()+0x60f) [0x7f34f7f9bcf9] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f34f80785a1] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 20: (Thread::entry_wrapper()+0x43) [0x7f34f7e25cdd] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 21: (Thread::_entry_func(void*)+0xd) [0x7f34f7e25cf9] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 22: /lib64/libc.so.6(+0x89c02) [0x7f34f7489c02] 2024-07-26T08:44:00.370 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f34f750ec40] 2024-07-26T08:44:00.371 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:00.371 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[106945]: 2024-07-26T08:44:00.613 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:00 smithi043 podman[107217]: 2024-07-26 08:44:00.368545038 +0000 UTC m=+0.152332846 container died 7ed72e11985e899d262bf4ceb218e4dec4a7ca605e5339a25fb8e5d60ca5c326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-07-26T08:44:00.917 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:44:00.783+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:44:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:rejoin 2024-07-26T08:44:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:44:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:active 2024-07-26T08:44:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 486.714952 secs 2024-07-26T08:44:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 502.202018 secs 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:rejoin 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:active 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 486.714952 secs 2024-07-26T08:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 502.202018 secs 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:rejoin 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/300735951,v1:172.21.15.43:6837/300735951] up:active 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 486.714952 secs 2024-07-26T08:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 502.202018 secs 2024-07-26T08:44:01.411 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:01 smithi043 podman[107217]: 2024-07-26 08:44:01.349378553 +0000 UTC m=+1.133166318 container remove 7ed72e11985e899d262bf4ceb218e4dec4a7ca605e5339a25fb8e5d60ca5c326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-07-26T08:44:01.412 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:01 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:44:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:01 smithi043 ceph-mon[32384]: pgmap v847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5 op/s 2024-07-26T08:44:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:01 smithi133 ceph-mon[37053]: pgmap v847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5 op/s 2024-07-26T08:44:02.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 -- 172.21.15.43:0/2466718428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 msgr2=0x7f36f81166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 --2- 172.21.15.43:0/2466718428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 0x7f36f81166a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009900 tx=0x7f36f002a3f0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 -- 172.21.15.43:0/2466718428 shutdown_connections 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 --2- 172.21.15.43:0/2466718428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36f810f520 0x7f36f810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 --2- 172.21.15.43:0/2466718428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 0x7f36f81166a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 --2- 172.21.15.43:0/2466718428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f8109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 -- 172.21.15.43:0/2466718428 >> 172.21.15.43:0/2466718428 conn(0x7f36f8077b10 msgr2=0x7f36f8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 -- 172.21.15.43:0/2466718428 shutdown_connections 2024-07-26T08:44:02.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.037+0000 7f36fd200640 1 -- 172.21.15.43:0/2466718428 wait complete. 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 Processor -- start 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 -- start start 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f81a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36f810f520 0x7f36f81a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 0x7f36f81a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8119c70 con 0x7f36f810fe70 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8119af0 con 0x7f36f8109be0 2024-07-26T08:44:02.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.039+0000 7f36fd200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8119df0 con 0x7f36f810f520 2024-07-26T08:44:02.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.040+0000 7f36f5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36f810f520 0x7f36f81a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.040+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f81a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f81a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56042/0 (socket says 172.21.15.43:56042) 2024-07-26T08:44:02.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 -- 172.21.15.43:0/90527671 learned_addr learned my addr 172.21.15.43:0/90527671 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:02.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f6800640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 0x7f36f81a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 -- 172.21.15.43:0/90527671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36f810f520 msgr2=0x7f36f81a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36f810f520 0x7f36f81a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 -- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 msgr2=0x7f36f81a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 0x7f36f81a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.041+0000 7f36f5e00640 1 -- 172.21.15.43:0/90527671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f81a64d0 con 0x7f36f8109be0 2024-07-26T08:44:02.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.042+0000 7f36f5e00640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f81a0560 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009d50 tx=0x7f36e800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:02.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.042+0000 7f36eea00640 1 -- 172.21.15.43:0/90527671 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8003b70 con 0x7f36f8109be0 2024-07-26T08:44:02.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.042+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f81a67c0 con 0x7f36f8109be0 2024-07-26T08:44:02.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.042+0000 7f36eea00640 1 -- 172.21.15.43:0/90527671 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e8003d10 con 0x7f36f8109be0 2024-07-26T08:44:02.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.042+0000 7f36eea00640 1 -- 172.21.15.43:0/90527671 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8010990 con 0x7f36f8109be0 2024-07-26T08:44:02.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.042+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81acf20 con 0x7f36f8109be0 2024-07-26T08:44:02.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.046+0000 7f36eea00640 1 -- 172.21.15.43:0/90527671 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f36e8004610 con 0x7f36f8109be0 2024-07-26T08:44:02.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.047+0000 7f3703e3d740 1 Processor -- start 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 -- start start 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f36eea00640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f36dc0b3d40 0x7f36dc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f36eea00640 1 -- 172.21.15.43:0/90527671 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 12118+0+0 (secure 0 0 0) 0x7f36e80e5560 con 0x7f36f8109be0 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f36f6800640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f36dc0b3d40 0x7f36dc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499ba1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997d41b0 0x559499ba2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559499b18b90 con 0x5594997d41b0 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559499b08090 con 0x5594997fd070 2024-07-26T08:44:02.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.048+0000 7f3703e3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559499b0c0d0 con 0x5594997dc390 2024-07-26T08:44:02.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997d41b0 0x559499ba2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499ba1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41938/0 (socket says 172.21.15.43:41938) 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f6800640 1 -- 172.21.15.43:0/580300798 learned_addr learned my addr 172.21.15.43:0/580300798 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5e00640 1 -- 172.21.15.43:0/580300798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 msgr2=0x559499ba2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5e00640 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5e00640 1 -- 172.21.15.43:0/580300798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997d41b0 msgr2=0x559499ba2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5e00640 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997d41b0 0x559499ba2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f5e00640 1 -- 172.21.15.43:0/580300798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559499868650 con 0x5594997fd070 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.049+0000 7f36f6800640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f36dc0b3d40 0x7f36dc0b6250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009900 tx=0x7f36f0032e80 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.050+0000 7f36f5e00640 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499ba1df0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36e80e1e40 tx=0x7f36e80aaa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd12293fb25f1fc1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.050+0000 7f36e7400640 1 -- 172.21.15.43:0/580300798 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80c5070 con 0x5594997fd070 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.050+0000 7f36e7400640 1 -- 172.21.15.43:0/580300798 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e80aba00 con 0x5594997fd070 2024-07-26T08:44:02.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.050+0000 7f36e7400640 1 -- 172.21.15.43:0/580300798 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b3f20 con 0x5594997fd070 2024-07-26T08:44:02.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 -- 172.21.15.43:0/580300798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 msgr2=0x559499ba1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499ba1df0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36e80e1e40 tx=0x7f36e80aaa70 comp rx=0 tx=0).stop 2024-07-26T08:44:02.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 -- 172.21.15.43:0/580300798 shutdown_connections 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997d41b0 0x559499ba2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 --2- 172.21.15.43:0/580300798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499ba1df0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 -- 172.21.15.43:0/580300798 >> 172.21.15.43:0/580300798 conn(0x5594997f1460 msgr2=0x559499b9fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 -- 172.21.15.43:0/580300798 shutdown_connections 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.051+0000 7f3703e3d740 1 -- 172.21.15.43:0/580300798 wait complete. 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.052+0000 7f3703e3d740 1 -- start start 2024-07-26T08:44:02.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.052+0000 7f3703e3d740 1 Processor -- start 2024-07-26T08:44:02.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 0x559499bad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499badf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55949996b700 con 0x5594997dc390 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559499aa4660 con 0x5594997fd070 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559499bb05d0 con 0x5594997d41b0 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f3703e3d740 10 client.0 _ll_register_callbacks cb 0x559499ab4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 0x559499bad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 0x559499bad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41948/0 (socket says 172.21.15.43:41948) 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f36f5e00640 1 -- 172.21.15.43:0/4099960668 learned_addr learned my addr 172.21.15.43:0/4099960668 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f36f5400640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f36f6800640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499badf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.053+0000 7f36f5e00640 1 -- 172.21.15.43:0/4099960668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 msgr2=0x559499badf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f5e00640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499badf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f5e00640 1 -- 172.21.15.43:0/4099960668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 msgr2=0x559499bad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f5e00640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f5e00640 1 -- 172.21.15.43:0/4099960668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559499abb800 con 0x5594997d41b0 2024-07-26T08:44:02.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f5400640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:44:02.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f6800640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499badf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:44:02.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36f5e00640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 0x559499bad460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36e8003f90 tx=0x7f36e80e5420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15acf9e9c81d89c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:02.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:44:02.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36dbe00640 1 -- 172.21.15.43:0/4099960668 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80c5070 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36e80aba00 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.054+0000 7f36dbe00640 1 -- 172.21.15.43:0/4099960668 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 12118+0+0 (secure 0 0 0) 0x7f36e80b4130 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f36dbe00640 1 -- 172.21.15.43:0/4099960668 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=233) ==== 24+0+0 (secure 0 0 0) 0x7f36e808d050 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 10 client.26224 fetch_fsmap learned FSMap version 233 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=233,monmap=4+}) -- 0x559499bbc250 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f36dbe00640 1 -- 172.21.15.43:0/4099960668 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e80ca070 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f36dbe00640 1 -- 172.21.15.43:0/4099960668 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 233) ==== 5934+0+0 (secure 0 0 0) 0x7f36e8086cd0 con 0x5594997d41b0 2024-07-26T08:44:02.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 10 client.26224 fetch_fsmap finished waiting for FSMap version 233 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 10 client.26224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 20 client.26224 populate_metadata read hostname 'smithi043' 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5594997bb9f0 0x559499bbf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 4 client.26224 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.055+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f36e80aba00 con 0x5594997bb9f0 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.056+0000 7f36f5400640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5594997bb9f0 0x559499bbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.056+0000 7f36f5400640 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5594997bb9f0 0x559499bbf600 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c23c704716d424 server_cookie=bd3d023d6bcaed94 in_seq=0 out_seq=0 2024-07-26T08:44:02.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.056+0000 7f36dbe00640 10 client.26224 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f36dbe00640 1 -- 172.21.15.43:0/4099960668 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f36e80aba00 con 0x5594997bb9f0 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f36dbe00640 10 client.26224 handle_command_reply: tid=0 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 client.26224 shutdown 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 msgr2=0x559499bad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 0x559499bad460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36e8003f90 tx=0x7f36e80e5420 comp rx=0 tx=0).stop 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 shutdown_connections 2024-07-26T08:44:02.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5594997bb9f0 0x559499bbf600 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997fd070 0x559499badf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f3703e3d740 1 --2- 172.21.15.43:0/4099960668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997d41b0 0x559499bad460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.058+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 >> 172.21.15.43:0/4099960668 conn(0x5594997f1460 msgr2=0x559499ba4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.057+0000 7f36dbe00640 0 client.26224 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.058+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 shutdown_connections 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.058+0000 7f3703e3d740 1 -- 172.21.15.43:0/4099960668 wait complete. 2024-07-26T08:44:02.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.058+0000 7f3703e3d740 20 client.26224 trim_cache size 0 max 16384 2024-07-26T08:44:02.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:01 smithi063 ceph-mon[36747]: pgmap v847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5 op/s 2024-07-26T08:44:02.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.077+0000 7f3703e3d740 1 Processor -- start 2024-07-26T08:44:02.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.077+0000 7f3703e3d740 1 -- start start 2024-07-26T08:44:02.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499ba8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997fd070 0x559499ba7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f3703e3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81b8090 con 0x5594997fd070 2024-07-26T08:44:02.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f3703e3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81b9bd0 con 0x5594997d41b0 2024-07-26T08:44:02.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f3703e3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81b8760 con 0x5594997dc390 2024-07-26T08:44:02.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499ba8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f36f6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997fd070 0x559499ba7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499ba8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56074/0 (socket says 172.21.15.43:56074) 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 -- 172.21.15.43:0/519404144 learned_addr learned my addr 172.21.15.43:0/519404144 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.078+0000 7f36f5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 -- 172.21.15.43:0/519404144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 msgr2=0x559499ba37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 -- 172.21.15.43:0/519404144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997fd070 msgr2=0x559499ba7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997fd070 0x559499ba7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 -- 172.21.15.43:0/519404144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559499baf830 con 0x5594997d41b0 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5400640 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:44:02.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.079+0000 7f36f5e00640 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499ba8c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36e80aafb0 tx=0x7f36e80e5490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2f3cef7dd652e61 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.080+0000 7f36e6a00640 1 -- 172.21.15.43:0/519404144 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80c5070 con 0x5594997d41b0 2024-07-26T08:44:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.080+0000 7f36e6a00640 1 -- 172.21.15.43:0/519404144 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e80ca070 con 0x5594997d41b0 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.080+0000 7f36e6a00640 1 -- 172.21.15.43:0/519404144 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80cc300 con 0x5594997d41b0 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 -- 172.21.15.43:0/519404144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 msgr2=0x559499ba8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499ba8c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36e80aafb0 tx=0x7f36e80e5490 comp rx=0 tx=0).stop 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 -- 172.21.15.43:0/519404144 shutdown_connections 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997dc390 0x559499ba37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997fd070 0x559499ba7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 --2- 172.21.15.43:0/519404144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499ba8c30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 -- 172.21.15.43:0/519404144 >> 172.21.15.43:0/519404144 conn(0x5594997f1460 msgr2=0x559499bae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 -- 172.21.15.43:0/519404144 shutdown_connections 2024-07-26T08:44:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.081+0000 7f3703e3d740 1 -- 172.21.15.43:0/519404144 wait complete. 2024-07-26T08:44:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 -- start start 2024-07-26T08:44:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 Processor -- start 2024-07-26T08:44:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499bb0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bb1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997fd070 0x559499c25d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81b9500 con 0x5594997dc390 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81b8e30 con 0x5594997d41b0 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81b6860 con 0x5594997fd070 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.082+0000 7f3703e3d740 10 client.0 _ll_register_callbacks cb 0x7f36e0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499bb0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bb1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499bb0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:56082/0 (socket says 172.21.15.43:56082) 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 -- 172.21.15.43:0/2812644096 learned_addr learned my addr 172.21.15.43:0/2812644096 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:02.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f6800640 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997fd070 0x559499c25d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 -- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997fd070 msgr2=0x559499c25d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997fd070 0x559499c25d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 -- 172.21.15.43:0/2812644096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 msgr2=0x559499bb1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bb1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.083+0000 7f36f5e00640 1 -- 172.21.15.43:0/2812644096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559499c26350 con 0x5594997d41b0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f36f5e00640 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499bb0ff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36e80aaa00 tx=0x7f36e80e5400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c718fccf5a18d4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f36dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f36dbe00640 1 -- 172.21.15.43:0/2812644096 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80c5070 con 0x5594997d41b0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f36dbe00640 1 -- 172.21.15.43:0/2812644096 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 12118+0+0 (secure 0 0 0) 0x7f36e80aa5b0 con 0x5594997d41b0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36e80ca070 con 0x5594997d41b0 2024-07-26T08:44:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f36dbe00640 1 -- 172.21.15.43:0/2812644096 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=233) ==== 24+0+0 (secure 0 0 0) 0x7f36e80b43b0 con 0x5594997d41b0 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f3703e3d740 10 client.26237 fetch_fsmap learned FSMap version 233 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.084+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=233,monmap=4+}) -- 0x559499c26350 con 0x5594997d41b0 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f36dbe00640 1 -- 172.21.15.43:0/2812644096 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e80ca070 con 0x5594997d41b0 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f36dbe00640 1 -- 172.21.15.43:0/2812644096 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 233) ==== 5934+0+0 (secure 0 0 0) 0x7f36e8090030 con 0x5594997d41b0 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f3703e3d740 10 client.26237 fetch_fsmap finished waiting for FSMap version 233 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f3703e3d740 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f3703e3d740 20 client.26237 populate_metadata read hostname 'smithi043' 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f3703e3d740 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559499790da0 0x559499c298e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f3703e3d740 4 client.26237 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559499b1aae0 con 0x559499790da0 2024-07-26T08:44:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.085+0000 7f36f5400640 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559499790da0 0x559499c298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.086+0000 7f36f5400640 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559499790da0 0x559499c298e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b2b4d82832f9356 server_cookie=220ab9fad4459820 in_seq=0 out_seq=0 2024-07-26T08:44:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.086+0000 7f36dbe00640 10 client.26237 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.086+0000 7f36dbe00640 1 -- 172.21.15.43:0/2812644096 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x559499b1aae0 con 0x559499790da0 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.086+0000 7f36dbe00640 10 client.26237 handle_command_reply: tid=0 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.086+0000 7f3703e3d740 1 client.26237 shutdown 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 msgr2=0x559499bb0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499bb0ff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36e80aaa00 tx=0x7f36e80e5400 comp rx=0 tx=0).stop 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 shutdown_connections 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559499790da0 0x559499c298e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5594997fd070 0x559499c25d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594997dc390 0x559499bb1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 --2- 172.21.15.43:0/2812644096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5594997d41b0 0x559499bb0ff0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 >> 172.21.15.43:0/2812644096 conn(0x5594997f1460 msgr2=0x559499bb86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f36dbe00640 0 client.26237 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 shutdown_connections 2024-07-26T08:44:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 1 -- 172.21.15.43:0/2812644096 wait complete. 2024-07-26T08:44:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.087+0000 7f3703e3d740 20 client.26237 trim_cache size 0 max 16384 2024-07-26T08:44:02.093 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:44:02.093 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:44:02.094 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f36dc0b3d40 msgr2=0x7f36dc0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f36dc0b3d40 0x7f36dc0b6250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009900 tx=0x7f36f0032e80 comp rx=0 tx=0).stop 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 msgr2=0x7f36f81a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f81a0560 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009d50 tx=0x7f36e800c6a0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 shutdown_connections 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f36dc0b3d40 0x7f36dc0b6250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36f810f520 0x7f36f81a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36f810fe70 0x7f36f81a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 --2- 172.21.15.43:0/90527671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36f8109be0 0x7f36f81a0560 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.088+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 >> 172.21.15.43:0/90527671 conn(0x7f36f8077b10 msgr2=0x7f36f8078170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.089+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 shutdown_connections 2024-07-26T08:44:02.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:02.089+0000 7f36fd200640 1 -- 172.21.15.43:0/90527671 wait complete. 2024-07-26T08:44:02.386 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:02 smithi043 podman[107271]: 2024-07-26 08:44:02.156524441 +0000 UTC m=+0.176496129 container died 467cca53b693d5d767888a3853dbb4fc31de1d8e54e663e712eb5c48564012de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=eloquent_shamir, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-26T08:44:02.732 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:02 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:44:02.733 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:02 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.445s CPU time. 2024-07-26T08:44:03.010 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:44:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:03 smithi043 ceph-mon[32384]: pgmap v848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 142 B/s wr, 6 op/s 2024-07-26T08:44:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:03 smithi133 ceph-mon[37053]: pgmap v848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 142 B/s wr, 6 op/s 2024-07-26T08:44:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:03 smithi063 ceph-mon[36747]: pgmap v848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 142 B/s wr, 6 op/s 2024-07-26T08:44:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:05 smithi043 ceph-mon[32384]: pgmap v849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 273 B/s wr, 10 op/s 2024-07-26T08:44:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 491.715114 secs 2024-07-26T08:44:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 507.202135 secs 2024-07-26T08:44:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:05 smithi133 ceph-mon[37053]: pgmap v849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 273 B/s wr, 10 op/s 2024-07-26T08:44:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 491.715114 secs 2024-07-26T08:44:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 507.202135 secs 2024-07-26T08:44:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:05 smithi063 ceph-mon[36747]: pgmap v849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 273 B/s wr, 10 op/s 2024-07-26T08:44:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 491.715114 secs 2024-07-26T08:44:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 507.202135 secs 2024-07-26T08:44:06.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:06 smithi043 ceph-mon[32384]: pgmap v850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 222 B/s wr, 12 op/s 2024-07-26T08:44:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:06 smithi133 ceph-mon[37053]: pgmap v850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 222 B/s wr, 12 op/s 2024-07-26T08:44:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:06 smithi063 ceph-mon[36747]: pgmap v850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 222 B/s wr, 12 op/s 2024-07-26T08:44:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:08 smithi043 ceph-mon[32384]: pgmap v851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:08 smithi133 ceph-mon[37053]: pgmap v851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:08 smithi063 ceph-mon[36747]: pgmap v851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:11 smithi063 ceph-mon[36747]: pgmap v852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 496.715194 secs 2024-07-26T08:44:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 512.202252 secs 2024-07-26T08:44:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:11 smithi043 ceph-mon[32384]: pgmap v852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 496.715194 secs 2024-07-26T08:44:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 512.202252 secs 2024-07-26T08:44:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:11 smithi133 ceph-mon[37053]: pgmap v852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 496.715194 secs 2024-07-26T08:44:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 512.202252 secs 2024-07-26T08:44:12.904 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:12 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:44:12.904 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:12 smithi043 systemd[1]: Stopped Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:44:12.904 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:12 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.445s CPU time. 2024-07-26T08:44:12.904 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:12 smithi043 systemd[1]: Starting Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:44:13.174 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:12 smithi043 podman[107395]: 2024-07-26 08:44:12.80699285 +0000 UTC m=+0.036994504 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:44:13.203 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:12 smithi043 podman[107395]: 2024-07-26 08:44:12.99753148 +0000 UTC m=+0.227533173 container create 452c296f8152664f1537052529d3e26e728dacb6c11d4518a64fe1fdfee43708 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:44:13.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:13 smithi043 ceph-mon[32384]: pgmap v853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:13 smithi063 ceph-mon[36747]: pgmap v853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:13 smithi133 ceph-mon[37053]: pgmap v853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:13.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:13 smithi043 podman[107395]: 2024-07-26 08:44:13.272244097 +0000 UTC m=+0.502245810 container init 452c296f8152664f1537052529d3e26e728dacb6c11d4518a64fe1fdfee43708 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2) 2024-07-26T08:44:13.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:13 smithi043 podman[107395]: 2024-07-26 08:44:13.2824732 +0000 UTC m=+0.512474867 container start 452c296f8152664f1537052529d3e26e728dacb6c11d4518a64fe1fdfee43708 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T08:44:13.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:13 smithi043 ceph-mds[107414]: -- 172.21.15.43:0/25475317 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d85cd4f860 con 0x55d860ef1a80 2024-07-26T08:44:13.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:13 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: starting mds.d at 2024-07-26T08:44:13.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:13 smithi043 bash[107395]: 452c296f8152664f1537052529d3e26e728dacb6c11d4518a64fe1fdfee43708 2024-07-26T08:44:13.734 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:13 smithi043 systemd[1]: Started Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: daemon mds.d restarted 2024-07-26T08:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: osdmap e122: 12 total, 12 up, 12 in 2024-07-26T08:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:boot 2024-07-26T08:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:44:14.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:44:14.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:14 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: daemon mds.d restarted 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: osdmap e122: 12 total, 12 up, 12 in 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:boot 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:44:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:14 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: daemon mds.d restarted 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: osdmap e122: 12 total, 12 up, 12 in 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:boot 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T08:44:14.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:14 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:15.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:15 smithi043 ceph-mon[32384]: pgmap v855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:44:15.690 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:15 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:resolve 2024-07-26T08:44:15.690 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:15 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:15.690 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 501.715326 secs 2024-07-26T08:44:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:15 smithi133 ceph-mon[37053]: pgmap v855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:44:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:15 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:resolve 2024-07-26T08:44:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:15 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 501.715326 secs 2024-07-26T08:44:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:15 smithi063 ceph-mon[36747]: pgmap v855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:44:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:15 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:resolve 2024-07-26T08:44:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:15 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 501.715326 secs 2024-07-26T08:44:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:16 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:44:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:16 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:reconnect 2024-07-26T08:44:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:16 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 517.202319 secs 2024-07-26T08:44:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:16 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:44:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:16 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:44:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:16 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:reconnect 2024-07-26T08:44:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:16 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 517.202319 secs 2024-07-26T08:44:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:16 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:44:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:16 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:44:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:16 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:reconnect 2024-07-26T08:44:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:16 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 517.202319 secs 2024-07-26T08:44:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:16 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:44:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:17 smithi043 ceph-mon[32384]: pgmap v856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:44:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:17 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:rejoin 2024-07-26T08:44:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:17 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:17 smithi043 ceph-mon[32384]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:44:17.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:17 smithi133 ceph-mon[37053]: pgmap v856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:44:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:17 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:rejoin 2024-07-26T08:44:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:17 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:17 smithi133 ceph-mon[37053]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:44:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-mon[36747]: pgmap v856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:44:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:rejoin 2024-07-26T08:44:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-mon[36747]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: *** Caught signal (Aborted) ** 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: in thread 7f5153bc7640 thread_name:ms_dispatch 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5158f9e6f0] 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5158feb94c] 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 3: raise() 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 4: abort() 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5158f8871b] 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 6: /lib64/libc.so.6(+0x37386) [0x7f5158f97386] 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5631413896b9] 2024-07-26T08:44:17.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56314154780c] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5631414872ca] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563141457753] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563141458a1b] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56314143c752] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56314138aa56] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56314138e637] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56314138ef5e] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56314137203a] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f515986b407] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 18: (DispatchQueue::entry()+0x60f) [0x7f515986bcf9] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51599485a1] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 20: (Thread::entry_wrapper()+0x43) [0x7f51596f5cdd] 2024-07-26T08:44:17.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51596f5cf9] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5158fe9c02] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f515906ec40] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.489+0000 7f5153bc7640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: in thread 7f5153bc7640 thread_name:ms_dispatch 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5158f9e6f0] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5158feb94c] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 3: raise() 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 4: abort() 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5158f8871b] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 6: /lib64/libc.so.6(+0x37386) [0x7f5158f97386] 2024-07-26T08:44:17.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5631413896b9] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56314154780c] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5631414872ca] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563141457753] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563141458a1b] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56314143c752] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56314138aa56] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56314138e637] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56314138ef5e] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56314137203a] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f515986b407] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 18: (DispatchQueue::entry()+0x60f) [0x7f515986bcf9] 2024-07-26T08:44:17.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51599485a1] 2024-07-26T08:44:17.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 20: (Thread::entry_wrapper()+0x43) [0x7f51596f5cdd] 2024-07-26T08:44:17.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51596f5cf9] 2024-07-26T08:44:17.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5158fe9c02] 2024-07-26T08:44:17.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f515906ec40] 2024-07-26T08:44:17.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 0> 2024-07-26T08:44:17.489+0000 7f5153bc7640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: in thread 7f5153bc7640 thread_name:ms_dispatch 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5158f9e6f0] 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5158feb94c] 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 3: raise() 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 4: abort() 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5158f8871b] 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 6: /lib64/libc.so.6(+0x37386) [0x7f5158f97386] 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5631413896b9] 2024-07-26T08:44:17.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56314154780c] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5631414872ca] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563141457753] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563141458a1b] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56314143c752] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56314138aa56] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56314138e637] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56314138ef5e] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56314137203a] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f515986b407] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 18: (DispatchQueue::entry()+0x60f) [0x7f515986bcf9] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51599485a1] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 20: (Thread::entry_wrapper()+0x43) [0x7f51596f5cdd] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51596f5cf9] 2024-07-26T08:44:17.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5158fe9c02] 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f515906ec40] 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 0> 2024-07-26T08:44:17.489+0000 7f5153bc7640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: in thread 7f5153bc7640 thread_name:ms_dispatch 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5158f9e6f0] 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5158feb94c] 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 3: raise() 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 4: abort() 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5158f8871b] 2024-07-26T08:44:17.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 6: /lib64/libc.so.6(+0x37386) [0x7f5158f97386] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5631413896b9] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56314154780c] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5631414872ca] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563141457753] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563141458a1b] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56314143c752] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56314138aa56] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56314138e637] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56314138ef5e] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56314137203a] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f515986b407] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 18: (DispatchQueue::entry()+0x60f) [0x7f515986bcf9] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51599485a1] 2024-07-26T08:44:17.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 20: (Thread::entry_wrapper()+0x43) [0x7f51596f5cdd] 2024-07-26T08:44:17.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51596f5cf9] 2024-07-26T08:44:17.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5158fe9c02] 2024-07-26T08:44:17.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f515906ec40] 2024-07-26T08:44:17.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:17.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[74891]: 2024-07-26T08:44:17.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:17 smithi063 podman[75059]: 2024-07-26 08:44:17.551481897 +0000 UTC m=+0.020604685 container died 4ef6a859a5889b571df3d7dca26e673edd63487f83ea1d05ab06b72f298c9a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-07-26T08:44:18.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:18 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:18.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:18 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:active 2024-07-26T08:44:18.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:18 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:18.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:18 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:18.621 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:18 smithi063 podman[75059]: 2024-07-26 08:44:18.37406235 +0000 UTC m=+0.843185137 container remove 4ef6a859a5889b571df3d7dca26e673edd63487f83ea1d05ab06b72f298c9a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-07-26T08:44:18.621 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:18 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:44:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:18 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:18 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:active 2024-07-26T08:44:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:18 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:18 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:18.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:18 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:18.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:18 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2026223441,v1:172.21.15.63:6833/2026223441] up:active 2024-07-26T08:44:18.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:18 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:18 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:19.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:18 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:44:19.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:18 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 1.955s CPU time. 2024-07-26T08:44:19.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:19 smithi133 ceph-mon[37053]: pgmap v857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:44:19.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:19 smithi063 ceph-mon[36747]: pgmap v857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:44:19.901 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:19 smithi043 ceph-mon[32384]: pgmap v857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:44:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 506.715470 secs 2024-07-26T08:44:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 506.715470 secs 2024-07-26T08:44:20.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 506.715470 secs 2024-07-26T08:44:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:21 smithi133 ceph-mon[37053]: pgmap v858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 522.202456 secs 2024-07-26T08:44:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:21 smithi063 ceph-mon[36747]: pgmap v858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 522.202456 secs 2024-07-26T08:44:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:21 smithi043 ceph-mon[32384]: pgmap v858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 522.202456 secs 2024-07-26T08:44:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:23 smithi063 ceph-mon[36747]: pgmap v859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:44:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:23 smithi043 ceph-mon[32384]: pgmap v859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:44:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:23 smithi133 ceph-mon[37053]: pgmap v859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:44:25.785 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:25 smithi043 ceph-mon[32384]: pgmap v860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 195 B/s wr, 10 op/s 2024-07-26T08:44:25.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 511.715606 secs 2024-07-26T08:44:25.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:25 smithi063 ceph-mon[36747]: pgmap v860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 195 B/s wr, 10 op/s 2024-07-26T08:44:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 511.715606 secs 2024-07-26T08:44:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:25 smithi133 ceph-mon[37053]: pgmap v860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 195 B/s wr, 10 op/s 2024-07-26T08:44:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 511.715606 secs 2024-07-26T08:44:26.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 527.202598 secs 2024-07-26T08:44:26.820 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 527.202598 secs 2024-07-26T08:44:27.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 527.202598 secs 2024-07-26T08:44:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:27 smithi063 ceph-mon[36747]: pgmap v861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:27 smithi043 ceph-mon[32384]: pgmap v861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:28.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:27 smithi133 ceph-mon[37053]: pgmap v861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:29.109 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:28 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:44:29.109 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:28 smithi063 systemd[1]: Stopped Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:44:29.109 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:28 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 1.955s CPU time. 2024-07-26T08:44:29.109 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:28 smithi063 systemd[1]: Starting Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:44:29.109 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 podman[75165]: 2024-07-26 08:44:28.959844294 +0000 UTC m=+0.017960955 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:44:29.109 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 podman[75165]: 2024-07-26 08:44:29.108454985 +0000 UTC m=+0.166571636 container create 61263644a326ca8ddfa568fdecd4dfcd970d46ff4db2397f9e063480ebb7ffdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0) 2024-07-26T08:44:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: pgmap v862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: daemon mds.k restarted 2024-07-26T08:44:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:44:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: osdmap e123: 12 total, 12 up, 12 in 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:boot 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 podman[75165]: 2024-07-26 08:44:29.43592483 +0000 UTC m=+0.494041478 container init 61263644a326ca8ddfa568fdecd4dfcd970d46ff4db2397f9e063480ebb7ffdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 podman[75165]: 2024-07-26 08:44:29.439253882 +0000 UTC m=+0.497370531 container start 61263644a326ca8ddfa568fdecd4dfcd970d46ff4db2397f9e063480ebb7ffdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-mds[75184]: -- 172.21.15.63:0/3253169504 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635a4e53860 con 0x5635a8ff5180 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: starting mds.k at 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 bash[75165]: 61263644a326ca8ddfa568fdecd4dfcd970d46ff4db2397f9e063480ebb7ffdc 2024-07-26T08:44:29.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:29 smithi063 systemd[1]: Started Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:44:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: pgmap v862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: daemon mds.k restarted 2024-07-26T08:44:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:44:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: osdmap e123: 12 total, 12 up, 12 in 2024-07-26T08:44:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:boot 2024-07-26T08:44:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:44:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:44:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:29 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: pgmap v862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: daemon mds.k restarted 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: osdmap e123: 12 total, 12 up, 12 in 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:boot 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T08:44:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:29 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:replay,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 516.715767 secs 2024-07-26T08:44:30.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 516.715767 secs 2024-07-26T08:44:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 516.715767 secs 2024-07-26T08:44:31.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:31 smithi043 ceph-mon[32384]: pgmap v864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 102 B/s wr, 7 op/s 2024-07-26T08:44:31.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 532.202721 secs 2024-07-26T08:44:31.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:31 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:resolve 2024-07-26T08:44:31.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:31 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:31.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:31 smithi063 ceph-mon[36747]: pgmap v864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 102 B/s wr, 7 op/s 2024-07-26T08:44:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 532.202721 secs 2024-07-26T08:44:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:31 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:resolve 2024-07-26T08:44:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:31 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:32.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:31 smithi133 ceph-mon[37053]: pgmap v864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 102 B/s wr, 7 op/s 2024-07-26T08:44:32.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 532.202721 secs 2024-07-26T08:44:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:31 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:resolve 2024-07-26T08:44:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:31 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:resolve,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:32 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.000999989 2024-07-26T08:44:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:32 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:reconnect 2024-07-26T08:44:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:32 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:32 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0079999 2024-07-26T08:44:33.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:44:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:32 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.000999989 2024-07-26T08:44:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:32 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:reconnect 2024-07-26T08:44:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:32 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:32 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0079999 2024-07-26T08:44:33.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:32 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.000999989 2024-07-26T08:44:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:32 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:reconnect 2024-07-26T08:44:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:32 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:reconnect,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:32 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0079999 2024-07-26T08:44:33.523 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:44:33.875 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-mon[32384]: pgmap v865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7 op/s 2024-07-26T08:44:33.876 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:rejoin 2024-07-26T08:44:33.876 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:33.876 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-mon[32384]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: *** Caught signal (Aborted) ** 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: in thread 7fa336c00640 thread_name:ms_dispatch 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33ce3e6f0] 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa33ce8b94c] 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 3: raise() 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 4: abort() 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa33ce2871b] 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 6: /lib64/libc.so.6(+0x37386) [0x7fa33ce37386] 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d82f87f6b9] 2024-07-26T08:44:33.878 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d82fa3d80c] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d82f97d2ca] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d82f94d753] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d82f94ea1b] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d82f932752] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d82f880a56] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d82f884637] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d82f884f5e] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d82f86803a] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa33d99b407] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 18: (DispatchQueue::entry()+0x60f) [0x7fa33d99bcf9] 2024-07-26T08:44:33.879 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa33da785a1] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 20: (Thread::entry_wrapper()+0x43) [0x7fa33d825cdd] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa33d825cf9] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa33ce89c02] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa33cf0ec40] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.600+0000 7fa336c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: in thread 7fa336c00640 thread_name:ms_dispatch 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33ce3e6f0] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa33ce8b94c] 2024-07-26T08:44:33.880 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 3: raise() 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 4: abort() 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa33ce2871b] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 6: /lib64/libc.so.6(+0x37386) [0x7fa33ce37386] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d82f87f6b9] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d82fa3d80c] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d82f97d2ca] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d82f94d753] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d82f94ea1b] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d82f932752] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d82f880a56] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d82f884637] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d82f884f5e] 2024-07-26T08:44:33.881 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d82f86803a] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa33d99b407] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 18: (DispatchQueue::entry()+0x60f) [0x7fa33d99bcf9] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa33da785a1] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 20: (Thread::entry_wrapper()+0x43) [0x7fa33d825cdd] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa33d825cf9] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa33ce89c02] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa33cf0ec40] 2024-07-26T08:44:33.882 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 0> 2024-07-26T08:44:33.600+0000 7fa336c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: in thread 7fa336c00640 thread_name:ms_dispatch 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33ce3e6f0] 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa33ce8b94c] 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 3: raise() 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 4: abort() 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa33ce2871b] 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 6: /lib64/libc.so.6(+0x37386) [0x7fa33ce37386] 2024-07-26T08:44:33.883 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d82f87f6b9] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d82fa3d80c] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d82f97d2ca] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d82f94d753] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d82f94ea1b] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d82f932752] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d82f880a56] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d82f884637] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d82f884f5e] 2024-07-26T08:44:33.884 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d82f86803a] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa33d99b407] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 18: (DispatchQueue::entry()+0x60f) [0x7fa33d99bcf9] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa33da785a1] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 20: (Thread::entry_wrapper()+0x43) [0x7fa33d825cdd] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa33d825cf9] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa33ce89c02] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa33cf0ec40] 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 0> 2024-07-26T08:44:33.600+0000 7fa336c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: in thread 7fa336c00640 thread_name:ms_dispatch 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.885 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa33ce3e6f0] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa33ce8b94c] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 3: raise() 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 4: abort() 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa33ce2871b] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 6: /lib64/libc.so.6(+0x37386) [0x7fa33ce37386] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d82f87f6b9] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d82fa3d80c] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d82f97d2ca] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d82f94d753] 2024-07-26T08:44:33.886 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d82f94ea1b] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d82f932752] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d82f880a56] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d82f884637] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d82f884f5e] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d82f86803a] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa33d99b407] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 18: (DispatchQueue::entry()+0x60f) [0x7fa33d99bcf9] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa33da785a1] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 20: (Thread::entry_wrapper()+0x43) [0x7fa33d825cdd] 2024-07-26T08:44:33.887 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa33d825cf9] 2024-07-26T08:44:33.888 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa33ce89c02] 2024-07-26T08:44:33.888 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa33cf0ec40] 2024-07-26T08:44:33.888 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:33.888 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d[107410]: 2024-07-26T08:44:33.888 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:33 smithi043 podman[107532]: 2024-07-26 08:44:33.813820729 +0000 UTC m=+0.105849006 container died 452c296f8152664f1537052529d3e26e728dacb6c11d4518a64fe1fdfee43708 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:44:34.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:33 smithi133 ceph-mon[37053]: pgmap v865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7 op/s 2024-07-26T08:44:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:33 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:rejoin 2024-07-26T08:44:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:33 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:33 smithi133 ceph-mon[37053]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:44:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:33 smithi063 ceph-mon[36747]: pgmap v865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7 op/s 2024-07-26T08:44:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:33 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:rejoin 2024-07-26T08:44:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:33 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=d=up:rejoin,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:33 smithi063 ceph-mon[36747]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-07-26T08:44:34.918 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:34 smithi043 podman[107532]: 2024-07-26 08:44:34.738623706 +0000 UTC m=+1.030651996 container remove 452c296f8152664f1537052529d3e26e728dacb6c11d4518a64fe1fdfee43708 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-d, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:44:34.918 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:34 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:44:34.918 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:34 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:34.919 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:34 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:active 2024-07-26T08:44:34.919 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:34 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:34.919 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:34 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:35.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:34 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:34 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:active 2024-07-26T08:44:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:34 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:34 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:34 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:34 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1562341679,v1:172.21.15.43:6837/1562341679] up:active 2024-07-26T08:44:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:34 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 2 up:standby-replay 3 up:standby 2024-07-26T08:44:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:34 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=d=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby 2024-07-26T08:44:35.866 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:35 smithi043 ceph-mon[32384]: pgmap v866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:44:35.866 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 521.715909 secs 2024-07-26T08:44:35.866 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 537.202843 secs 2024-07-26T08:44:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:35 smithi133 ceph-mon[37053]: pgmap v866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:44:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 521.715909 secs 2024-07-26T08:44:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 537.202843 secs 2024-07-26T08:44:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:35 smithi063 ceph-mon[36747]: pgmap v866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:44:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 521.715909 secs 2024-07-26T08:44:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 537.202843 secs 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.786+0000 7f3072a00640 1 -- 172.21.15.43:0/3929273658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c103590 msgr2=0x7f306c1039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.786+0000 7f3072a00640 1 --2- 172.21.15.43:0/3929273658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c103590 0x7f306c1039a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f305c009860 tx=0x7f305c02a340 comp rx=0 tx=0).stop 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.786+0000 7f3072a00640 1 -- 172.21.15.43:0/3929273658 shutdown_connections 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.786+0000 7f3072a00640 1 --2- 172.21.15.43:0/3929273658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.786+0000 7f3072a00640 1 --2- 172.21.15.43:0/3929273658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c109820 0x7f306c110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.786+0000 7f3072a00640 1 --2- 172.21.15.43:0/3929273658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c103590 0x7f306c1039a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.787+0000 7f3072a00640 1 -- 172.21.15.43:0/3929273658 >> 172.21.15.43:0/3929273658 conn(0x7f306c07b280 msgr2=0x7f306c07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:36.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.788+0000 7f3072a00640 1 -- 172.21.15.43:0/3929273658 shutdown_connections 2024-07-26T08:44:36.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.788+0000 7f3072a00640 1 -- 172.21.15.43:0/3929273658 wait complete. 2024-07-26T08:44:36.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.789+0000 7f3072a00640 1 Processor -- start 2024-07-26T08:44:36.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 -- start start 2024-07-26T08:44:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 0x7f306c19c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c19c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c109820 0x7f306c1a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f306c113600 con 0x7f306c103590 2024-07-26T08:44:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f306c113480 con 0x7f306c109820 2024-07-26T08:44:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.790+0000 7f3072a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f306c113780 con 0x7f306c108ed0 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 0x7f306c19c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f3063e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c19c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 0x7f306c19c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60974/0 (socket says 172.21.15.43:60974) 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 -- 172.21.15.43:0/1695424559 learned_addr learned my addr 172.21.15.43:0/1695424559 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f3063e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c19c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:34430/0 (socket says 172.21.15.43:34430) 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f3070a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c109820 0x7f306c1a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 -- 172.21.15.43:0/1695424559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 msgr2=0x7f306c19c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c19c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 -- 172.21.15.43:0/1695424559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c109820 msgr2=0x7f306c1a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c109820 0x7f306c1a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f306be00640 1 -- 172.21.15.43:0/1695424559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c1a2140 con 0x7f306c103590 2024-07-26T08:44:36.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.791+0000 7f3063e00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c19c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:44:36.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.792+0000 7f306be00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 0x7f306c19c1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f305c035040 tx=0x7f305c02af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:36.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.792+0000 7f3069600640 1 -- 172.21.15.43:0/1695424559 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c03f020 con 0x7f306c103590 2024-07-26T08:44:36.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.792+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c1a23d0 con 0x7f306c103590 2024-07-26T08:44:36.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.792+0000 7f3069600640 1 -- 172.21.15.43:0/1695424559 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f305c033e50 con 0x7f306c103590 2024-07-26T08:44:36.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.792+0000 7f3069600640 1 -- 172.21.15.43:0/1695424559 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c037040 con 0x7f306c103590 2024-07-26T08:44:36.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.793+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c1a8b90 con 0x7f306c103590 2024-07-26T08:44:36.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.796+0000 7f30796ba740 1 Processor -- start 2024-07-26T08:44:36.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 -- start start 2024-07-26T08:44:36.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbb8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbb9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbb9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c1fb2fb90 con 0x558c1f7f3390 2024-07-26T08:44:36.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558c1fb1f090 con 0x558c1f814070 2024-07-26T08:44:36.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f30796ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558c1fb230d0 con 0x558c1f7eb1b0 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f3070a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbb8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.797+0000 7f3070a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbb8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36878/0 (socket says 172.21.15.43:36878) 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 -- 172.21.15.43:0/3758357218 learned_addr learned my addr 172.21.15.43:0/3758357218 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3063e00640 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbb9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 -- 172.21.15.43:0/3758357218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 msgr2=0x558c1fbb9520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbb9520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 -- 172.21.15.43:0/3758357218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 msgr2=0x558c1fbb9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbb9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 -- 172.21.15.43:0/3758357218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c1f87f650 con 0x558c1f814070 2024-07-26T08:44:36.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3063e00640 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbb9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:44:36.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3069600640 1 -- 172.21.15.43:0/1695424559 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f305c042020 con 0x7f306c103590 2024-07-26T08:44:36.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.798+0000 7f3070a00640 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbb8fe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f306400e580 tx=0x7f30640095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb4918f10afeac0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:36.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.799+0000 7f3061200640 1 -- 172.21.15.43:0/3758357218 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064003970 con 0x558c1f814070 2024-07-26T08:44:36.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.799+0000 7f3061200640 1 -- 172.21.15.43:0/3758357218 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306400d830 con 0x558c1f814070 2024-07-26T08:44:36.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.799+0000 7f3061200640 1 -- 172.21.15.43:0/3758357218 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064004530 con 0x558c1f814070 2024-07-26T08:44:36.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 -- 172.21.15.43:0/3758357218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 msgr2=0x558c1fbb8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbb8fe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f306400e580 tx=0x7f30640095c0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 -- 172.21.15.43:0/3758357218 shutdown_connections 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbb9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbb9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 --2- 172.21.15.43:0/3758357218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbb8fe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 -- 172.21.15.43:0/3758357218 >> 172.21.15.43:0/3758357218 conn(0x558c1f808460 msgr2=0x558c1fbb6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f3069600640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30500b3d40 0x7f30500b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 -- 172.21.15.43:0/3758357218 shutdown_connections 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f3069600640 1 -- 172.21.15.43:0/1695424559 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12290+0+0 (secure 0 0 0) 0x7f305c104830 con 0x7f306c103590 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.800+0000 7f30796ba740 1 -- 172.21.15.43:0/3758357218 wait complete. 2024-07-26T08:44:36.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.801+0000 7f3063e00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30500b3d40 0x7f30500b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.801+0000 7f30796ba740 1 -- start start 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.801+0000 7f30796ba740 1 Processor -- start 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f3063e00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30500b3d40 0x7f30500b6250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f306c108920 tx=0x7f3054005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7f3390 0x558c1fbc4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbc4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c1f982700 con 0x558c1f814070 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558c1fabb660 con 0x558c1f7f3390 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558c1fbc77c0 con 0x558c1f7eb1b0 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.802+0000 7f30796ba740 10 client.0 _ll_register_callbacks cb 0x558c1facb110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f3070a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbc4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f3063e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7f3390 0x558c1fbc4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:34442/0 (socket says 172.21.15.43:34442) 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f3063e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7f3390 0x558c1fbc4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36890/0 (socket says 172.21.15.43:36890) 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 -- 172.21.15.43:0/3309773921 learned_addr learned my addr 172.21.15.43:0/3309773921 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 -- 172.21.15.43:0/3309773921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7f3390 msgr2=0x558c1fbc4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7f3390 0x558c1fbc4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 -- 172.21.15.43:0/3309773921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 msgr2=0x558c1fbc4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbc4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.803+0000 7f306be00640 1 -- 172.21.15.43:0/3309773921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1fad2800 con 0x558c1f7eb1b0 2024-07-26T08:44:36.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f306be00640 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc4570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f305c101230 tx=0x7f305c0ca590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70b229bdbf1422a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f3059600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f3059600640 1 -- 172.21.15.43:0/3309773921 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ca1a0 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f3059600640 1 -- 172.21.15.43:0/3309773921 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 12290+0+0 (secure 0 0 0) 0x7f305c0d32b0 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f306400d830 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f3059600640 1 -- 172.21.15.43:0/3309773921 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=247) ==== 24+0+0 (secure 0 0 0) 0x7f305c0cad90 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f30796ba740 10 client.26251 fetch_fsmap learned FSMap version 247 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.804+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=247,monmap=4+}) -- 0x558c1fbd3400 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f3059600640 1 -- 172.21.15.43:0/3309773921 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306400d830 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f3059600640 1 -- 172.21.15.43:0/3309773921 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 247) ==== 5934+0+0 (secure 0 0 0) 0x7f305c03a030 con 0x558c1f7eb1b0 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f30796ba740 10 client.26251 fetch_fsmap finished waiting for FSMap version 247 2024-07-26T08:44:36.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f30796ba740 10 client.26251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f30796ba740 20 client.26251 populate_metadata read hostname 'smithi043' 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f30796ba740 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1f7d29f0 0x558c1fbd6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f30796ba740 4 client.26251 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.805+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c1fb31ae0 con 0x558c1f7d29f0 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.806+0000 7f3063e00640 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1f7d29f0 0x558c1fbd6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.806+0000 7f3063e00640 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1f7d29f0 0x558c1fbd6800 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8ed055a1e7597a server_cookie=ec8e04f30d998c06 in_seq=0 out_seq=0 2024-07-26T08:44:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.806+0000 7f3059600640 10 client.26251 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:36.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.807+0000 7f3059600640 1 -- 172.21.15.43:0/3309773921 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c1fb31ae0 con 0x558c1f7d29f0 2024-07-26T08:44:36.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.807+0000 7f3059600640 10 client.26251 handle_command_reply: tid=0 2024-07-26T08:44:36.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.807+0000 7f30796ba740 1 client.26251 shutdown 2024-07-26T08:44:36.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.807+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 msgr2=0x558c1fbc4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.807+0000 7f30796ba740 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc4570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f305c101230 tx=0x7f305c0ca590 comp rx=0 tx=0).stop 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 shutdown_connections 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1f7d29f0 0x558c1fbd6800 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbc4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7f3390 0x558c1fbc4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 --2- 172.21.15.43:0/3309773921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc4570 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f3059600640 0 client.26251 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 >> 172.21.15.43:0/3309773921 conn(0x558c1f808460 msgr2=0x558c1fbbc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 shutdown_connections 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 1 -- 172.21.15.43:0/3309773921 wait complete. 2024-07-26T08:44:36.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.808+0000 7f30796ba740 20 client.26251 trim_cache size 0 max 16384 2024-07-26T08:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 Processor -- start 2024-07-26T08:44:36.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 -- start start 2024-07-26T08:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7f3390 0x558c1fbc4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbdbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1b3df0 con 0x558c1f814070 2024-07-26T08:44:36.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1b5930 con 0x558c1f7eb1b0 2024-07-26T08:44:36.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.846+0000 7f30796ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1b44c0 con 0x558c1f7f3390 2024-07-26T08:44:36.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36902/0 (socket says 172.21.15.43:36902) 2024-07-26T08:44:36.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 -- 172.21.15.43:0/1890297352 learned_addr learned my addr 172.21.15.43:0/1890297352 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:36.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f3063e00640 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7f3390 0x558c1fbc4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f3070a00640 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbdbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 -- 172.21.15.43:0/1890297352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7f3390 msgr2=0x558c1fbc4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7f3390 0x558c1fbc4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 -- 172.21.15.43:0/1890297352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 msgr2=0x558c1fbdbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbdbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.847+0000 7f306be00640 1 -- 172.21.15.43:0/1890297352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c1fbbbe40 con 0x558c1f7eb1b0 2024-07-26T08:44:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.848+0000 7f3070a00640 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbdbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:44:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.848+0000 7f306be00640 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc6450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f305c0ca620 tx=0x7f305c0ca460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170c1b6f5b8a5606 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:36.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.848+0000 7f305be00640 1 -- 172.21.15.43:0/1890297352 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ca1a0 con 0x558c1f7eb1b0 2024-07-26T08:44:36.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.848+0000 7f305be00640 1 -- 172.21.15.43:0/1890297352 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f305c0ca690 con 0x558c1f7eb1b0 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.848+0000 7f305be00640 1 -- 172.21.15.43:0/1890297352 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0d3740 con 0x558c1f7eb1b0 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 -- 172.21.15.43:0/1890297352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 msgr2=0x558c1fbc6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc6450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f305c0ca620 tx=0x7f305c0ca460 comp rx=0 tx=0).stop 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 -- 172.21.15.43:0/1890297352 shutdown_connections 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7f3390 0x558c1fbc4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f814070 0x558c1fbdbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 --2- 172.21.15.43:0/1890297352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f7eb1b0 0x558c1fbc6450 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f305c0ca620 tx=0x7f305c0ca460 comp rx=0 tx=0).stop 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 -- 172.21.15.43:0/1890297352 >> 172.21.15.43:0/1890297352 conn(0x558c1f808460 msgr2=0x558c1fbc44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 -- 172.21.15.43:0/1890297352 shutdown_connections 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.850+0000 7f30796ba740 1 -- 172.21.15.43:0/1890297352 wait complete. 2024-07-26T08:44:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 -- start start 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 Processor -- start 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbcd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbc8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7a7da0 0x558c1fbc8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1b5260 con 0x558c1f7f3390 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1b4b90 con 0x558c1f814070 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.851+0000 7f30796ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1b25c0 con 0x558c1f7a7da0 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f30796ba740 10 client.0 _ll_register_callbacks cb 0x7f305c0c6b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f306be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbcd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f306be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbcd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60996/0 (socket says 172.21.15.43:60996) 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f306be00640 1 -- 172.21.15.43:0/362379723 learned_addr learned my addr 172.21.15.43:0/362379723 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3063e00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbc8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3070a00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7a7da0 0x558c1fbc8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3063e00640 1 -- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7a7da0 msgr2=0x558c1fbc8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3063e00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7a7da0 0x558c1fbc8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3063e00640 1 -- 172.21.15.43:0/362379723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 msgr2=0x558c1fbcd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3063e00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbcd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.852+0000 7f3063e00640 1 -- 172.21.15.43:0/362379723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1fc3df90 con 0x558c1f814070 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.853+0000 7f3063e00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbc8830 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x558c1fbd6d60 tx=0x7f30540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d876df7e66bdc498 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:44:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.853+0000 7f3059600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.853+0000 7f3059600640 1 -- 172.21.15.43:0/362379723 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305400f5c0 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.853+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f305c0ca690 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.853+0000 7f3059600640 1 -- 172.21.15.43:0/362379723 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 12290+0+0 (secure 0 0 0) 0x7f305400f760 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.853+0000 7f3059600640 1 -- 172.21.15.43:0/362379723 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=247) ==== 24+0+0 (secure 0 0 0) 0x7f305403a030 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 10 client.26267 fetch_fsmap learned FSMap version 247 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=247,monmap=4+}) -- 0x558c1fc3f150 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f3059600640 1 -- 172.21.15.43:0/362379723 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f305c0ca690 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f3059600640 1 -- 172.21.15.43:0/362379723 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 247) ==== 5934+0+0 (secure 0 0 0) 0x7f3054033b60 con 0x558c1f814070 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 10 client.26267 fetch_fsmap finished waiting for FSMap version 247 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 10 client.26267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 20 client.26267 populate_metadata read hostname 'smithi043' 2024-07-26T08:44:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1fc3f8a0 0x558c1fc41cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 4 client.26267 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.854+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c1fb2d580 con 0x558c1fc3f8a0 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.855+0000 7f306be00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1fc3f8a0 0x558c1fc41cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.855+0000 7f306be00640 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1fc3f8a0 0x558c1fc41cc0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa7eb16ebd6eea2b server_cookie=e01aa2d46909454a in_seq=0 out_seq=0 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.855+0000 7f3059600640 10 client.26267 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.855+0000 7f3059600640 1 -- 172.21.15.43:0/362379723 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x558c1fb2d580 con 0x558c1fc3f8a0 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.855+0000 7f3059600640 10 client.26267 handle_command_reply: tid=0 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.855+0000 7f30796ba740 1 client.26267 shutdown 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 msgr2=0x558c1fbc8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbc8830 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x558c1fbd6d60 tx=0x7f30540046c0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 shutdown_connections 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c1fc3f8a0 0x558c1fc41cc0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c1f7a7da0 0x558c1fbc8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c1f814070 0x558c1fbc8830 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 --2- 172.21.15.43:0/362379723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c1f7f3390 0x558c1fbcd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f3059600640 0 client.26267 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 >> 172.21.15.43:0/362379723 conn(0x558c1f808460 msgr2=0x558c1fbc4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 shutdown_connections 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 1 -- 172.21.15.43:0/362379723 wait complete. 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.856+0000 7f30796ba740 20 client.26267 trim_cache size 0 max 16384 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:44:36.861 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:44:36.862 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30500b3d40 msgr2=0x7f30500b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30500b3d40 0x7f30500b6250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f306c108920 tx=0x7f3054005f90 comp rx=0 tx=0).stop 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 msgr2=0x7f306c19c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 0x7f306c19c1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f305c035040 tx=0x7f305c02af30 comp rx=0 tx=0).stop 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 shutdown_connections 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30500b3d40 0x7f30500b6250 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f306c108ed0 0x7f306c19c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c109820 0x7f306c1a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 --2- 172.21.15.43:0/1695424559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f306c103590 0x7f306c19c1d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:44:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.857+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 >> 172.21.15.43:0/1695424559 conn(0x7f306c07b280 msgr2=0x7f306c106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:44:36.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.858+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 shutdown_connections 2024-07-26T08:44:36.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:44:36.858+0000 7f3072a00640 1 -- 172.21.15.43:0/1695424559 wait complete. 2024-07-26T08:44:37.769 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:44:37.897 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:37 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:44:37.897 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:37 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.258s CPU time. 2024-07-26T08:44:37.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:37 smithi043 ceph-mon[32384]: pgmap v867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:38.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:37 smithi133 ceph-mon[37053]: pgmap v867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:38.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:37 smithi063 ceph-mon[36747]: pgmap v867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:39.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:39 smithi043 ceph-mon[32384]: pgmap v868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:40.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:39 smithi133 ceph-mon[37053]: pgmap v868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:39 smithi063 ceph-mon[36747]: pgmap v868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 526.716047 secs 2024-07-26T08:44:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 542.202962 secs 2024-07-26T08:44:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 526.716047 secs 2024-07-26T08:44:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 542.202962 secs 2024-07-26T08:44:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 526.716047 secs 2024-07-26T08:44:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 542.202962 secs 2024-07-26T08:44:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:41 smithi043 ceph-mon[32384]: pgmap v869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 197 B/s wr, 10 op/s 2024-07-26T08:44:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:41 smithi133 ceph-mon[37053]: pgmap v869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 197 B/s wr, 10 op/s 2024-07-26T08:44:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:41 smithi063 ceph-mon[36747]: pgmap v869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 197 B/s wr, 10 op/s 2024-07-26T08:44:42.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:42 smithi043 ceph-mon[32384]: pgmap v870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:43.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:42 smithi133 ceph-mon[37053]: pgmap v870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:43.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:42 smithi063 ceph-mon[36747]: pgmap v870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:44 smithi043 ceph-mon[32384]: pgmap v871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:45.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:44 smithi133 ceph-mon[37053]: pgmap v871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:44 smithi063 ceph-mon[36747]: pgmap v871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:44:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 531.716185 secs 2024-07-26T08:44:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 547.203079 secs 2024-07-26T08:44:46.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 531.716185 secs 2024-07-26T08:44:46.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 547.203079 secs 2024-07-26T08:44:46.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 531.716185 secs 2024-07-26T08:44:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 547.203079 secs 2024-07-26T08:44:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:46 smithi043 ceph-mon[32384]: pgmap v872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:47.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:46 smithi133 ceph-mon[37053]: pgmap v872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:47.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:46 smithi063 ceph-mon[36747]: pgmap v872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:44:48.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:47 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:44:48.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:47 smithi043 systemd[1]: Stopped Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:44:48.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:47 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Consumed 3.258s CPU time. 2024-07-26T08:44:48.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:47 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Start request repeated too quickly. 2024-07-26T08:44:48.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:47 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-07-26T08:44:48.483 INFO:journalctl@ceph.mds.d.smithi043.stdout:Jul 26 08:44:47 smithi043 systemd[1]: Failed to start Ceph mds.d for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:44:49.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:48 smithi043 ceph-mon[32384]: pgmap v873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:44:49.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:48 smithi133 ceph-mon[37053]: pgmap v873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:44:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:48 smithi063 ceph-mon[36747]: pgmap v873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T08:44:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: pgmap v874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-07-26T08:44:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 536.716261 secs 2024-07-26T08:44:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: Replacing daemon mds.d as rank 1 with standby daemon mds.k 2024-07-26T08:44:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-07-26T08:44:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: osdmap e124: 12 total, 12 up, 12 in 2024-07-26T08:44:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 552.203202 secs 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: pgmap v874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 536.716261 secs 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: Replacing daemon mds.d as rank 1 with standby daemon mds.k 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: osdmap e124: 12 total, 12 up, 12 in 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 552.203202 secs 2024-07-26T08:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: pgmap v874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-07-26T08:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 536.716261 secs 2024-07-26T08:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: Replacing daemon mds.d as rank 1 with standby daemon mds.k 2024-07-26T08:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-07-26T08:44:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:44:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: osdmap e124: 12 total, 12 up, 12 in 2024-07-26T08:44:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 552.203202 secs 2024-07-26T08:44:52.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:52 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:resolve 2024-07-26T08:44:52.348 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:52 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:52 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:resolve 2024-07-26T08:44:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:52 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:52 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:resolve 2024-07-26T08:44:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:52 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:53 smithi043 ceph-mon[32384]: pgmap v876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:44:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:reconnect 2024-07-26T08:44:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:53 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:53 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:44:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:53 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:44:53.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:53 smithi133 ceph-mon[37053]: pgmap v876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:44:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:reconnect 2024-07-26T08:44:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:53 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:53 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:44:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:53 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:44:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:53 smithi063 ceph-mon[36747]: pgmap v876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:44:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:reconnect 2024-07-26T08:44:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:53 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:53 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:44:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:53 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0099999 2024-07-26T08:44:54.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:54 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:rejoin 2024-07-26T08:44:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:54 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:54 smithi043 ceph-mon[32384]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:44:54.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:54 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:rejoin 2024-07-26T08:44:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:54 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:54 smithi133 ceph-mon[37053]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:44:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:rejoin 2024-07-26T08:44:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-mon[36747]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: *** Caught signal (Aborted) ** 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: in thread 7fcddc15c640 thread_name:ms_dispatch 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcde15336f0] 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fcde158094c] 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 3: raise() 2024-07-26T08:44:54.569 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 4: abort() 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 5: /lib64/libc.so.6(+0x2871b) [0x7fcde151d71b] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 6: /lib64/libc.so.6(+0x37386) [0x7fcde152c386] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5635a25446b9] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5635a270280c] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5635a26422ca] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5635a2612753] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5635a2613a1b] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5635a25f7752] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5635a2545a56] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5635a2549637] 2024-07-26T08:44:54.570 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5635a2549f5e] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5635a252d03a] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fcde1e00407] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 18: (DispatchQueue::entry()+0x60f) [0x7fcde1e00cf9] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fcde1edd5a1] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 20: (Thread::entry_wrapper()+0x43) [0x7fcde1c8acdd] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 21: (Thread::_entry_func(void*)+0xd) [0x7fcde1c8acf9] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 22: /lib64/libc.so.6(+0x89c02) [0x7fcde157ec02] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fcde1603c40] 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.133+0000 7fcddc15c640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: in thread 7fcddc15c640 thread_name:ms_dispatch 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:54.571 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcde15336f0] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fcde158094c] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 3: raise() 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 4: abort() 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 5: /lib64/libc.so.6(+0x2871b) [0x7fcde151d71b] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 6: /lib64/libc.so.6(+0x37386) [0x7fcde152c386] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5635a25446b9] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5635a270280c] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5635a26422ca] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5635a2612753] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5635a2613a1b] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5635a25f7752] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5635a2545a56] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5635a2549637] 2024-07-26T08:44:54.572 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5635a2549f5e] 2024-07-26T08:44:54.573 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5635a252d03a] 2024-07-26T08:44:54.573 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fcde1e00407] 2024-07-26T08:44:54.573 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 18: (DispatchQueue::entry()+0x60f) [0x7fcde1e00cf9] 2024-07-26T08:44:54.573 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fcde1edd5a1] 2024-07-26T08:44:54.573 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 20: (Thread::entry_wrapper()+0x43) [0x7fcde1c8acdd] 2024-07-26T08:44:54.573 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 21: (Thread::_entry_func(void*)+0xd) [0x7fcde1c8acf9] 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 22: /lib64/libc.so.6(+0x89c02) [0x7fcde157ec02] 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fcde1603c40] 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 0> 2024-07-26T08:44:54.133+0000 7fcddc15c640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: in thread 7fcddc15c640 thread_name:ms_dispatch 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcde15336f0] 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fcde158094c] 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 3: raise() 2024-07-26T08:44:54.574 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 4: abort() 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 5: /lib64/libc.so.6(+0x2871b) [0x7fcde151d71b] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 6: /lib64/libc.so.6(+0x37386) [0x7fcde152c386] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5635a25446b9] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5635a270280c] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5635a26422ca] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5635a2612753] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5635a2613a1b] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5635a25f7752] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5635a2545a56] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5635a2549637] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5635a2549f5e] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5635a252d03a] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fcde1e00407] 2024-07-26T08:44:54.575 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 18: (DispatchQueue::entry()+0x60f) [0x7fcde1e00cf9] 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fcde1edd5a1] 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 20: (Thread::entry_wrapper()+0x43) [0x7fcde1c8acdd] 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 21: (Thread::_entry_func(void*)+0xd) [0x7fcde1c8acf9] 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 22: /lib64/libc.so.6(+0x89c02) [0x7fcde157ec02] 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fcde1603c40] 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 0> 2024-07-26T08:44:54.133+0000 7fcddc15c640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: in thread 7fcddc15c640 thread_name:ms_dispatch 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:44:54.576 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcde15336f0] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fcde158094c] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 3: raise() 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 4: abort() 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 5: /lib64/libc.so.6(+0x2871b) [0x7fcde151d71b] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 6: /lib64/libc.so.6(+0x37386) [0x7fcde152c386] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5635a25446b9] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5635a270280c] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5635a26422ca] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5635a2612753] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5635a2613a1b] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5635a25f7752] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5635a2545a56] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5635a2549637] 2024-07-26T08:44:54.577 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5635a2549f5e] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5635a252d03a] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fcde1e00407] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 18: (DispatchQueue::entry()+0x60f) [0x7fcde1e00cf9] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fcde1edd5a1] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 20: (Thread::entry_wrapper()+0x43) [0x7fcde1c8acdd] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 21: (Thread::_entry_func(void*)+0xd) [0x7fcde1c8acf9] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 22: /lib64/libc.so.6(+0x89c02) [0x7fcde157ec02] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fcde1603c40] 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75180]: 2024-07-26T08:44:54.578 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:54 smithi063 podman[75218]: 2024-07-26 08:44:54.19466688 +0000 UTC m=+0.019990704 container died 61263644a326ca8ddfa568fdecd4dfcd970d46ff4db2397f9e063480ebb7ffdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:44:55.293 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:55 smithi063 podman[75218]: 2024-07-26 08:44:55.033284742 +0000 UTC m=+0.858608610 container remove 61263644a326ca8ddfa568fdecd4dfcd970d46ff4db2397f9e063480ebb7ffdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-07-26T08:44:55.293 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:44:55.294 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:55 smithi063 ceph-mon[36747]: pgmap v877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:44:55.294 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:55 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:55.294 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:active 2024-07-26T08:44:55.294 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:55.294 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:55 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:44:55.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:55 smithi043 ceph-mon[32384]: pgmap v877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:44:55.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:55 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:55.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:active 2024-07-26T08:44:55.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:55.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:55 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:44:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:55 smithi133 ceph-mon[37053]: pgmap v877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:44:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:55 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:44:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/194735852,v1:172.21.15.63:6833/194735852] up:active 2024-07-26T08:44:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:44:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:55 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:44:55.568 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:44:55.568 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:44:55 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 1.946s CPU time. 2024-07-26T08:44:56.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 541.716379 secs 2024-07-26T08:44:56.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 557.203318 secs 2024-07-26T08:44:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 541.716379 secs 2024-07-26T08:44:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 557.203318 secs 2024-07-26T08:44:56.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 541.716379 secs 2024-07-26T08:44:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 557.203318 secs 2024-07-26T08:44:57.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:57 smithi043 ceph-mon[32384]: pgmap v878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:57.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:57 smithi133 ceph-mon[37053]: pgmap v878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:57 smithi063 ceph-mon[36747]: pgmap v878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:44:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:44:58.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:44:58.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:44:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:59 smithi043 ceph-mon[32384]: pgmap v879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:44:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:44:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:44:59.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:59 smithi133 ceph-mon[37053]: pgmap v879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:59.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:44:59.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:44:59.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:44:59.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:59 smithi063 ceph-mon[36747]: pgmap v879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:44:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:44:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:44:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:45:00.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:00 smithi133 ceph-mon[37053]: pgmap v880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 222 B/s wr, 11 op/s 2024-07-26T08:45:00.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:00 smithi133 ceph-mon[37053]: pgmap v881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 227 B/s wr, 12 op/s 2024-07-26T08:45:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:00 smithi043 ceph-mon[32384]: pgmap v880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 222 B/s wr, 11 op/s 2024-07-26T08:45:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:00 smithi043 ceph-mon[32384]: pgmap v881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 227 B/s wr, 12 op/s 2024-07-26T08:45:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:00 smithi063 ceph-mon[36747]: pgmap v880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 222 B/s wr, 11 op/s 2024-07-26T08:45:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:00 smithi063 ceph-mon[36747]: pgmap v881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 227 B/s wr, 12 op/s 2024-07-26T08:45:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 546.716499 secs 2024-07-26T08:45:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 562.203476 secs 2024-07-26T08:45:01.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 546.716499 secs 2024-07-26T08:45:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 562.203476 secs 2024-07-26T08:45:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 546.716499 secs 2024-07-26T08:45:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 562.203476 secs 2024-07-26T08:45:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:02 smithi043 ceph-mon[32384]: pgmap v882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 222 B/s wr, 11 op/s 2024-07-26T08:45:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:02 smithi133 ceph-mon[37053]: pgmap v882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 222 B/s wr, 11 op/s 2024-07-26T08:45:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:02 smithi063 ceph-mon[36747]: pgmap v882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 222 B/s wr, 11 op/s 2024-07-26T08:45:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:04 smithi043 ceph-mon[32384]: pgmap v883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 222 B/s wr, 10 op/s 2024-07-26T08:45:04.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:04 smithi133 ceph-mon[37053]: pgmap v883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 222 B/s wr, 10 op/s 2024-07-26T08:45:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:04 smithi063 ceph-mon[36747]: pgmap v883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 222 B/s wr, 10 op/s 2024-07-26T08:45:05.585 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:45:05.585 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 systemd[1]: Stopped Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:05.585 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 1.946s CPU time. 2024-07-26T08:45:05.585 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 systemd[1]: Starting Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:45:05.585 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 podman[75440]: 2024-07-26 08:45:05.459972362 +0000 UTC m=+0.018326609 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:45:05.946 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 podman[75440]: 2024-07-26 08:45:05.584455656 +0000 UTC m=+0.142809891 container create 3a329f99d4d96812533ba7042bfcacd9c023566f7e0646b1106ab11b81ada62c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240724, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:45:05.946 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 podman[75440]: 2024-07-26 08:45:05.945498156 +0000 UTC m=+0.503852391 container init 3a329f99d4d96812533ba7042bfcacd9c023566f7e0646b1106ab11b81ada62c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 551.716631 secs 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: pgmap v884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 111 B/s wr, 8 op/s 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 567.203594 secs 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: daemon mds.k restarted 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:45:06.230 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: osdmap e125: 12 total, 12 up, 12 in 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:boot 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:06 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 podman[75440]: 2024-07-26 08:45:05.948925814 +0000 UTC m=+0.507280062 container start 3a329f99d4d96812533ba7042bfcacd9c023566f7e0646b1106ab11b81ada62c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 ceph-mds[75460]: -- 172.21.15.63:0/3920501490 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0d93c9860 con 0x55a0dd56b180 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: starting mds.k at 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:06 smithi063 bash[75440]: 3a329f99d4d96812533ba7042bfcacd9c023566f7e0646b1106ab11b81ada62c 2024-07-26T08:45:06.231 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:06 smithi063 systemd[1]: Started Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 551.716631 secs 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: pgmap v884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 111 B/s wr, 8 op/s 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 567.203594 secs 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: daemon mds.k restarted 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: osdmap e125: 12 total, 12 up, 12 in 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:boot 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:06 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 551.716631 secs 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: pgmap v884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 111 B/s wr, 8 op/s 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 567.203594 secs 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: daemon mds.k restarted 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: osdmap e125: 12 total, 12 up, 12 in 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:boot 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:06 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:07.770 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:45:08.266 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:45:08.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:08 smithi043 ceph-mon[32384]: pgmap v886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4 op/s 2024-07-26T08:45:08.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:08 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:resolve 2024-07-26T08:45:08.417 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:08 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:08 smithi133 ceph-mon[37053]: pgmap v886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4 op/s 2024-07-26T08:45:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:08 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:resolve 2024-07-26T08:45:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:08 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:08 smithi063 ceph-mon[36747]: pgmap v886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4 op/s 2024-07-26T08:45:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:08 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:resolve 2024-07-26T08:45:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:08 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:09 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:45:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:09 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:reconnect 2024-07-26T08:45:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:09 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:09.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:09 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:45:09.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:09 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:45:09.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:09 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:reconnect 2024-07-26T08:45:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:09 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:09 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:45:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:09 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:45:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:09 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:reconnect 2024-07-26T08:45:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:09 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:09 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:45:10.138 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:45:10.138 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: *** Caught signal (Aborted) ** 2024-07-26T08:45:10.138 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: in thread 7f5517600640 thread_name:ms_dispatch 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f551d83e6f0] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f551d88b94c] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 3: raise() 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 4: abort() 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 5: /lib64/libc.so.6(+0x2871b) [0x7f551d82871b] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 6: /lib64/libc.so.6(+0x37386) [0x7f551d837386] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5645bfe1e6b9] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5645bffdc80c] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5645bff1c2ca] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5645bfeec753] 2024-07-26T08:45:10.139 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5645bfeeda1b] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5645bfed1752] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5645bfe1fa56] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5645bfe23637] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5645bfe23f5e] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5645bfe0703a] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f551e39b407] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 18: (DispatchQueue::entry()+0x60f) [0x7f551e39bcf9] 2024-07-26T08:45:10.140 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f551e4785a1] 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 20: (Thread::entry_wrapper()+0x43) [0x7f551e225cdd] 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 21: (Thread::_entry_func(void*)+0xd) [0x7f551e225cf9] 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 22: /lib64/libc.so.6(+0x89c02) [0x7f551d889c02] 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f551d90ec40] 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.107+0000 7f5517600640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: in thread 7f5517600640 thread_name:ms_dispatch 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:10.141 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f551d83e6f0] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f551d88b94c] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 3: raise() 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 4: abort() 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 5: /lib64/libc.so.6(+0x2871b) [0x7f551d82871b] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 6: /lib64/libc.so.6(+0x37386) [0x7f551d837386] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5645bfe1e6b9] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5645bffdc80c] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5645bff1c2ca] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5645bfeec753] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5645bfeeda1b] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5645bfed1752] 2024-07-26T08:45:10.142 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5645bfe1fa56] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5645bfe23637] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5645bfe23f5e] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5645bfe0703a] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f551e39b407] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 18: (DispatchQueue::entry()+0x60f) [0x7f551e39bcf9] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f551e4785a1] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 20: (Thread::entry_wrapper()+0x43) [0x7f551e225cdd] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 21: (Thread::_entry_func(void*)+0xd) [0x7f551e225cf9] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 22: /lib64/libc.so.6(+0x89c02) [0x7f551d889c02] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f551d90ec40] 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 0> 2024-07-26T08:45:10.107+0000 7f5517600640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:10.143 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: in thread 7f5517600640 thread_name:ms_dispatch 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f551d83e6f0] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f551d88b94c] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 3: raise() 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 4: abort() 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 5: /lib64/libc.so.6(+0x2871b) [0x7f551d82871b] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 6: /lib64/libc.so.6(+0x37386) [0x7f551d837386] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5645bfe1e6b9] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5645bffdc80c] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5645bff1c2ca] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5645bfeec753] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5645bfeeda1b] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5645bfed1752] 2024-07-26T08:45:10.144 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5645bfe1fa56] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5645bfe23637] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5645bfe23f5e] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5645bfe0703a] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f551e39b407] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 18: (DispatchQueue::entry()+0x60f) [0x7f551e39bcf9] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f551e4785a1] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 20: (Thread::entry_wrapper()+0x43) [0x7f551e225cdd] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 21: (Thread::_entry_func(void*)+0xd) [0x7f551e225cf9] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 22: /lib64/libc.so.6(+0x89c02) [0x7f551d889c02] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f551d90ec40] 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:10.145 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: pgmap v887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:rejoin 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 556.716778 secs 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:active 2024-07-26T08:45:10.478 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 0> 2024-07-26T08:45:10.107+0000 7f5517600640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: in thread 7f5517600640 thread_name:ms_dispatch 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f551d83e6f0] 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f551d88b94c] 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 3: raise() 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 4: abort() 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 5: /lib64/libc.so.6(+0x2871b) [0x7f551d82871b] 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 6: /lib64/libc.so.6(+0x37386) [0x7f551d837386] 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5645bfe1e6b9] 2024-07-26T08:45:10.479 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5645bffdc80c] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5645bff1c2ca] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5645bfeec753] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5645bfeeda1b] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5645bfed1752] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5645bfe1fa56] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5645bfe23637] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5645bfe23f5e] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5645bfe0703a] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f551e39b407] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 18: (DispatchQueue::entry()+0x60f) [0x7f551e39bcf9] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f551e4785a1] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 20: (Thread::entry_wrapper()+0x43) [0x7f551e225cdd] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 21: (Thread::_entry_func(void*)+0xd) [0x7f551e225cf9] 2024-07-26T08:45:10.480 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 22: /lib64/libc.so.6(+0x89c02) [0x7f551d889c02] 2024-07-26T08:45:10.481 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f551d90ec40] 2024-07-26T08:45:10.481 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:10.481 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[101605]: 2024-07-26T08:45:10.481 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:10 smithi043 podman[107948]: 2024-07-26 08:45:10.474862243 +0000 UTC m=+0.275449414 container died eda477700ae123b6a32afa758498b8e12d2c19ab85d6082d92fd96cf4299c730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, ceph=True) 2024-07-26T08:45:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: pgmap v887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:rejoin 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 556.716778 secs 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:active 2024-07-26T08:45:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: pgmap v887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:rejoin 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 556.716778 secs 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6838/1379895152,v1:172.21.15.43:6839/1379895152] up:active 2024-07-26T08:45:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:10 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:11.212 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:45:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:45:10.789+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:45:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 572.203740 secs 2024-07-26T08:45:11.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:11 smithi043 podman[107948]: 2024-07-26 08:45:11.39617479 +0000 UTC m=+1.196761931 container remove eda477700ae123b6a32afa758498b8e12d2c19ab85d6082d92fd96cf4299c730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:45:11.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:11 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:45:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 572.203740 secs 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.203+0000 7f30cd600640 1 -- 172.21.15.43:0/557937480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8075b30 msgr2=0x7f30c810f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 --2- 172.21.15.43:0/557937480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8075b30 0x7f30c810f400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009900 tx=0x7f30b402a410 comp rx=0 tx=0).stop 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 -- 172.21.15.43:0/557937480 shutdown_connections 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 --2- 172.21.15.43:0/557937480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c810f940 0x7f30c8111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 --2- 172.21.15.43:0/557937480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8075b30 0x7f30c810f400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 --2- 172.21.15.43:0/557937480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c80751e0 0x7f30c80755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 -- 172.21.15.43:0/557937480 >> 172.21.15.43:0/557937480 conn(0x7f30c80fee70 msgr2=0x7f30c81012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 -- 172.21.15.43:0/557937480 shutdown_connections 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.204+0000 7f30cd600640 1 -- 172.21.15.43:0/557937480 wait complete. 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.205+0000 7f30cd600640 1 Processor -- start 2024-07-26T08:45:11.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.205+0000 7f30cd600640 1 -- start start 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30cd600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 0x7f30c8106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30cd600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c8075b30 0x7f30c81030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30cd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c810f940 0x7f30c81037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30cd600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8115610 con 0x7f30c810f940 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30cd600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8115490 con 0x7f30c8075b30 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30cd600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8115790 con 0x7f30c80751e0 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 0x7f30c8106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 0x7f30c8106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:32910/0 (socket says 172.21.15.43:32910) 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 -- 172.21.15.43:0/3927477574 learned_addr learned my addr 172.21.15.43:0/3927477574 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c8075b30 0x7f30c81030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c810f940 0x7f30c81037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 -- 172.21.15.43:0/3927477574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c8075b30 msgr2=0x7f30c81030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c8075b30 0x7f30c81030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 -- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c810f940 msgr2=0x7f30c81037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c810f940 0x7f30c81037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7e00640 1 -- 172.21.15.43:0/3927477574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c81ac550 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.206+0000 7f30c7400640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c8075b30 0x7f30c81030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.207+0000 7f30c7e00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 0x7f30c8106dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f30b800ea60 tx=0x7f30b800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.207+0000 7f30c4c00640 1 -- 172.21.15.43:0/3927477574 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b800cde0 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.207+0000 7f30c4c00640 1 -- 172.21.15.43:0/3927477574 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30b80035f0 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.207+0000 7f30c4c00640 1 -- 172.21.15.43:0/3927477574 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8010690 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.207+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c81ac780 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.207+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c81acce0 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.212+0000 7f30d584f740 1 Processor -- start 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.212+0000 7f30c4c00640 1 -- 172.21.15.43:0/3927477574 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f30b80037a0 con 0x7f30c80751e0 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.212+0000 7f30d584f740 1 -- start start 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30d584f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeebf3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30d584f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebf4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30d584f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebf4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30d584f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556eeeb6ab90 con 0x556eee8261b0 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30d584f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556eeeb5a090 con 0x556eee82e390 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30d584f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556eeeb5e0d0 con 0x556eee84f070 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeebf3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeebf3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:32924/0 (socket says 172.21.15.43:32924) 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30ccc00640 1 -- 172.21.15.43:0/2101426100 learned_addr learned my addr 172.21.15.43:0/2101426100 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30c7e00640 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebf4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.213+0000 7f30c7400640 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebf4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30ccc00640 1 -- 172.21.15.43:0/2101426100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 msgr2=0x556eeebf4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebf4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30ccc00640 1 -- 172.21.15.43:0/2101426100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 msgr2=0x556eeebf4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebf4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30ccc00640 1 -- 172.21.15.43:0/2101426100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eee8ba650 con 0x556eee84f070 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeebf3fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009fd0 tx=0x7f30c00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3dd9eaf664672eb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.214+0000 7f30c4c00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30ac0b3dc0 0x7f30ac0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.215+0000 7f30c4c00640 1 -- 172.21.15.43:0/3927477574 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 12462+0+0 (secure 0 0 0) 0x7f30b80e5310 con 0x7f30c80751e0 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.215+0000 7f30c7e00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30ac0b3dc0 0x7f30ac0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.215+0000 7f30bd200640 1 -- 172.21.15.43:0/2101426100 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0004d20 con 0x556eee84f070 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.215+0000 7f30bd200640 1 -- 172.21.15.43:0/2101426100 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30c0004050 con 0x556eee84f070 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.215+0000 7f30bd200640 1 -- 172.21.15.43:0/2101426100 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0005260 con 0x556eee84f070 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 -- 172.21.15.43:0/2101426100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 msgr2=0x556eeebf3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeebf3fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009fd0 tx=0x7f30c00118d0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30c7e00640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30ac0b3dc0 0x7f30ac0b62d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f30b80e8fd0 tx=0x7f30b80e8dc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 -- 172.21.15.43:0/2101426100 shutdown_connections 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebf4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebf4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 --2- 172.21.15.43:0/2101426100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeebf3fd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 -- 172.21.15.43:0/2101426100 >> 172.21.15.43:0/2101426100 conn(0x556eee843460 msgr2=0x556eeebf1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 -- 172.21.15.43:0/2101426100 shutdown_connections 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.216+0000 7f30d584f740 1 -- 172.21.15.43:0/2101426100 wait complete. 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.217+0000 7f30d584f740 1 -- start start 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.217+0000 7f30d584f740 1 Processor -- start 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebff580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebffac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec00000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556eee9bd700 con 0x556eee8261b0 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556eeeaf6660 con 0x556eee82e390 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556eeec027b0 con 0x556eee84f070 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30d584f740 10 client.0 _ll_register_callbacks cb 0x556eeeb06110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:45:11.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebff580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30c7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30c7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebffac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37222/0 (socket says 172.21.15.43:37222) 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.218+0000 7f30c7400640 1 -- 172.21.15.43:0/3590453298 learned_addr learned my addr 172.21.15.43:0/3590453298 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec00000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30c7400640 1 -- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 msgr2=0x556eeec00000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30c7400640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec00000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30c7400640 1 -- 172.21.15.43:0/3590453298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 msgr2=0x556eeebff580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30c7400640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebff580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30c7400640 1 -- 172.21.15.43:0/3590453298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eeeb0d800 con 0x556eee82e390 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30c7400640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebffac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009230 tx=0x7f30b4031740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfb31503ad88430c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.219+0000 7f30b1600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.220+0000 7f30b1600640 1 -- 172.21.15.43:0/3590453298 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4035040 con 0x556eee82e390 2024-07-26T08:45:11.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.220+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c0004050 con 0x556eee82e390 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.220+0000 7f30b1600640 1 -- 172.21.15.43:0/3590453298 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 12462+0+0 (secure 0 0 0) 0x7f30b4004450 con 0x556eee82e390 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30b1600640 1 -- 172.21.15.43:0/3590453298 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=259) ==== 24+0+0 (secure 0 0 0) 0x7f30b404d030 con 0x556eee82e390 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 10 client.26285 fetch_fsmap learned FSMap version 259 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=259,monmap=4+}) -- 0x556eeec0e3b0 con 0x556eee82e390 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30b1600640 1 -- 172.21.15.43:0/3590453298 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30c0004050 con 0x556eee82e390 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30b1600640 1 -- 172.21.15.43:0/3590453298 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 259) ==== 5329+0+0 (secure 0 0 0) 0x7f30b4004c90 con 0x556eee82e390 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 10 client.26285 fetch_fsmap finished waiting for FSMap version 259 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 10 client.26285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 20 client.26285 populate_metadata read hostname 'smithi043' 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee80d9f0 0x556eeec11d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 4 client.26285 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.223+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556eeeb6cae0 con 0x556eee80d9f0 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.224+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee80d9f0 0x556eeec11d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.224+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee80d9f0 0x556eeec11d00 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27b4f0e99195cc06 server_cookie=7ece3b32afea000f in_seq=0 out_seq=0 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.224+0000 7f30b1600640 10 client.26285 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.225+0000 7f30b1600640 1 -- 172.21.15.43:0/3590453298 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556eeeb6cae0 con 0x556eee80d9f0 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.225+0000 7f30b1600640 10 client.26285 handle_command_reply: tid=0 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.225+0000 7f30d584f740 1 client.26285 shutdown 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 msgr2=0x556eeebffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebffac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009230 tx=0x7f30b4031740 comp rx=0 tx=0).stop 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 shutdown_connections 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee80d9f0 0x556eeec11d00 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec00000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee82e390 0x556eeebffac0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 --2- 172.21.15.43:0/3590453298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee8261b0 0x556eeebff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30b1600640 0 client.26285 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 >> 172.21.15.43:0/3590453298 conn(0x556eee843460 msgr2=0x556eeebf7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:11.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 shutdown_connections 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 1 -- 172.21.15.43:0/3590453298 wait complete. 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.226+0000 7f30d584f740 20 client.26285 trim_cache size 0 max 16384 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 Processor -- start 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 -- start start 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeebf0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec17500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b9c30 con 0x556eee82e390 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b7a20 con 0x556eee8261b0 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.246+0000 7f30d584f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b9560 con 0x556eee84f070 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeebf0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeebf0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37224/0 (socket says 172.21.15.43:37224) 2024-07-26T08:45:11.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30c7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 -- 172.21.15.43:0/2662160568 learned_addr learned my addr 172.21.15.43:0/2662160568 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec17500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 -- 172.21.15.43:0/2662160568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 msgr2=0x556eeec17500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec17500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 -- 172.21.15.43:0/2662160568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 msgr2=0x556eeec011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 -- 172.21.15.43:0/2662160568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eeebf65b0 con 0x556eee8261b0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30ccc00640 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeebf0ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f30c0014040 tx=0x7f30c0009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=285b8de404135c9a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.247+0000 7f30b3e00640 1 -- 172.21.15.43:0/2662160568 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0004c90 con 0x556eee8261b0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.248+0000 7f30b3e00640 1 -- 172.21.15.43:0/2662160568 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30c0004e30 con 0x556eee8261b0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.248+0000 7f30b3e00640 1 -- 172.21.15.43:0/2662160568 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0005690 con 0x556eee8261b0 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.248+0000 7f30d584f740 1 -- 172.21.15.43:0/2662160568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 msgr2=0x556eeebf0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.248+0000 7f30d584f740 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeebf0ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f30c0014040 tx=0x7f30c0009500 comp rx=0 tx=0).stop 2024-07-26T08:45:11.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.248+0000 7f30d584f740 1 -- 172.21.15.43:0/2662160568 shutdown_connections 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec17500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 --2- 172.21.15.43:0/2662160568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeebf0ec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 -- 172.21.15.43:0/2662160568 >> 172.21.15.43:0/2662160568 conn(0x556eee843460 msgr2=0x556eeec00aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 -- 172.21.15.43:0/2662160568 shutdown_connections 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 -- 172.21.15.43:0/2662160568 wait complete. 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 -- start start 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.249+0000 7f30d584f740 1 Processor -- start 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeec05040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec05580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b87c0 con 0x556eee82e390 2024-07-26T08:45:11.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b80f0 con 0x556eee8261b0 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b8e90 con 0x556eee84f070 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30d584f740 10 client.0 _ll_register_callbacks cb 0x7f30b4005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeec05040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30c7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec05580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30ccc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeec05040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:37226/0 (socket says 172.21.15.43:37226) 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30ccc00640 1 -- 172.21.15.43:0/3069431478 learned_addr learned my addr 172.21.15.43:0/3069431478 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.250+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30c7400640 1 -- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 msgr2=0x556eeec784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30c7400640 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30c7400640 1 -- 172.21.15.43:0/3069431478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 msgr2=0x556eeec05040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30c7400640 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeec05040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30c7400640 1 -- 172.21.15.43:0/3069431478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eeec78a40 con 0x556eee82e390 2024-07-26T08:45:11.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30c7400640 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec05580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009900 tx=0x7f30b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe0dbdae782594f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30b1600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30b1600640 1 -- 172.21.15.43:0/3069431478 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4035040 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c0004e30 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.251+0000 7f30b1600640 1 -- 172.21.15.43:0/3069431478 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 12462+0+0 (secure 0 0 0) 0x7f30b4003df0 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30b1600640 1 -- 172.21.15.43:0/3069431478 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=259) ==== 24+0+0 (secure 0 0 0) 0x7f30b4062050 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30d584f740 10 client.16026 fetch_fsmap learned FSMap version 259 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=259,monmap=4+}) -- 0x556eeec79cd0 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30b1600640 1 -- 172.21.15.43:0/3069431478 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f30c0004e30 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30b1600640 1 -- 172.21.15.43:0/3069431478 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 259) ==== 5329+0+0 (secure 0 0 0) 0x7f30b405a060 con 0x556eee82e390 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30d584f740 10 client.16026 fetch_fsmap finished waiting for FSMap version 259 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30d584f740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30d584f740 20 client.16026 populate_metadata read hostname 'smithi043' 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.252+0000 7f30d584f740 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee7e2da0 0x556eeec7c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.253+0000 7f30d584f740 4 client.16026 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:45:11.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.253+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556eeeb68580 con 0x556eee7e2da0 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.253+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee7e2da0 0x556eeec7c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.253+0000 7f30ccc00640 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee7e2da0 0x556eeec7c420 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26900d36dc67601b server_cookie=fa744d69e93fb36 in_seq=0 out_seq=0 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.253+0000 7f30b1600640 10 client.16026 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30b1600640 1 -- 172.21.15.43:0/3069431478 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x556eeeb68580 con 0x556eee7e2da0 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30b1600640 10 client.16026 handle_command_reply: tid=0 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 client.16026 shutdown 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 msgr2=0x556eeec05580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec05580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009900 tx=0x7f30b4009260 comp rx=0 tx=0).stop 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 shutdown_connections 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x556eee7e2da0 0x556eeec7c420 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556eee84f070 0x556eeec784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556eee82e390 0x556eeec05580 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 --2- 172.21.15.43:0/3069431478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556eee8261b0 0x556eeec05040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 >> 172.21.15.43:0/3069431478 conn(0x556eee843460 msgr2=0x556eeebf0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30b1600640 0 client.16026 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 shutdown_connections 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 1 -- 172.21.15.43:0/3069431478 wait complete. 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.254+0000 7f30d584f740 20 client.16026 trim_cache size 0 max 16384 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30ac0b3dc0 msgr2=0x7f30ac0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30ac0b3dc0 0x7f30ac0b62d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f30b80e8fd0 tx=0x7f30b80e8dc0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 msgr2=0x7f30c8106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 0x7f30c8106dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f30b800ea60 tx=0x7f30b800ef20 comp rx=0 tx=0).stop 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 shutdown_connections 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f30ac0b3dc0 0x7f30ac0b62d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c810f940 0x7f30c81037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c8075b30 0x7f30c81030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 --2- 172.21.15.43:0/3927477574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c80751e0 0x7f30c8106dd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 >> 172.21.15.43:0/3927477574 conn(0x7f30c80fee70 msgr2=0x7f30c8100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 shutdown_connections 2024-07-26T08:45:11.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:11.255+0000 7f30cd600640 1 -- 172.21.15.43:0/3927477574 wait complete. 2024-07-26T08:45:11.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 572.203740 secs 2024-07-26T08:45:12.313 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:45:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:12 smithi043 ceph-mon[32384]: pgmap v888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:45:12.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:12 smithi133 ceph-mon[37053]: pgmap v888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:45:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:12 smithi063 ceph-mon[36747]: pgmap v888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:45:12.982 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:12 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:45:12.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:12 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.866s CPU time. 2024-07-26T08:45:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:14 smithi043 ceph-mon[32384]: pgmap v889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:45:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:14 smithi133 ceph-mon[37053]: pgmap v889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:45:14.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:14 smithi063 ceph-mon[36747]: pgmap v889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:45:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 561.716907 secs 2024-07-26T08:45:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 561.716907 secs 2024-07-26T08:45:15.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 561.716907 secs 2024-07-26T08:45:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:16 smithi133 ceph-mon[37053]: pgmap v890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:45:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 577.203881 secs 2024-07-26T08:45:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:16 smithi063 ceph-mon[36747]: pgmap v890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:45:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 577.203881 secs 2024-07-26T08:45:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:16 smithi043 ceph-mon[32384]: pgmap v890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:45:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 577.203881 secs 2024-07-26T08:45:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:18 smithi133 ceph-mon[37053]: pgmap v891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:45:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:18 smithi063 ceph-mon[36747]: pgmap v891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:45:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:18 smithi043 ceph-mon[32384]: pgmap v891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:45:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:20 smithi133 ceph-mon[37053]: pgmap v892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 566.717031 secs 2024-07-26T08:45:20.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:20 smithi063 ceph-mon[36747]: pgmap v892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 566.717031 secs 2024-07-26T08:45:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:20 smithi043 ceph-mon[32384]: pgmap v892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 566.717031 secs 2024-07-26T08:45:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 582.203986 secs 2024-07-26T08:45:21.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 582.203986 secs 2024-07-26T08:45:21.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 582.203986 secs 2024-07-26T08:45:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:22 smithi063 ceph-mon[36747]: pgmap v893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:22.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:22 smithi043 ceph-mon[32384]: pgmap v893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:22.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:22 smithi133 ceph-mon[37053]: pgmap v893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:23.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:22 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:45:23.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:22 smithi043 systemd[1]: Stopped Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:23.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:22 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.866s CPU time. 2024-07-26T08:45:23.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:22 smithi043 systemd[1]: Starting Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:45:23.428 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:23 smithi043 podman[108107]: 2024-07-26 08:45:23.052422258 +0000 UTC m=+0.033179043 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:45:23.428 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:23 smithi043 podman[108107]: 2024-07-26 08:45:23.261786465 +0000 UTC m=+0.242543289 container create 8e23e3c1470dc5fe74a72f9388b574929297197b4bf4fe3a1223773255dd27db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:45:23.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:23 smithi043 podman[108107]: 2024-07-26 08:45:23.532578801 +0000 UTC m=+0.513335625 container init 8e23e3c1470dc5fe74a72f9388b574929297197b4bf4fe3a1223773255dd27db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-26T08:45:23.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:23 smithi043 podman[108107]: 2024-07-26 08:45:23.543056484 +0000 UTC m=+0.523813308 container start 8e23e3c1470dc5fe74a72f9388b574929297197b4bf4fe3a1223773255dd27db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True) 2024-07-26T08:45:23.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:23 smithi043 ceph-mds[108126]: -- 172.21.15.43:0/1406798739 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55caddb39860 con 0x55cae1cdba80 2024-07-26T08:45:23.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: starting mds.g at 2024-07-26T08:45:24.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:24 smithi043 bash[108107]: 8e23e3c1470dc5fe74a72f9388b574929297197b4bf4fe3a1223773255dd27db 2024-07-26T08:45:24.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:24 smithi043 systemd[1]: Started Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: pgmap v894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:45:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: daemon mds.g restarted 2024-07-26T08:45:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: osdmap e126: 12 total, 12 up, 12 in 2024-07-26T08:45:24.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:boot 2024-07-26T08:45:24.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:45:24.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:24.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:45:24.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:24 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: pgmap v894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: daemon mds.g restarted 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: osdmap e126: 12 total, 12 up, 12 in 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:boot 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:45:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:24.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:45:24.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:24 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: pgmap v894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: daemon mds.g restarted 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: osdmap e126: 12 total, 12 up, 12 in 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:boot 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:45:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:24 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:25.961 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:25 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:resolve 2024-07-26T08:45:25.961 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:25 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:25.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 571.717135 secs 2024-07-26T08:45:25.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:25 smithi043 ceph-mon[32384]: pgmap v896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:45:25.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 587.204106 secs 2024-07-26T08:45:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:25 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:resolve 2024-07-26T08:45:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:25 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 571.717135 secs 2024-07-26T08:45:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:25 smithi133 ceph-mon[37053]: pgmap v896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:45:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 587.204106 secs 2024-07-26T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:25 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:resolve 2024-07-26T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:25 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 571.717135 secs 2024-07-26T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:25 smithi063 ceph-mon[36747]: pgmap v896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-07-26T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 587.204106 secs 2024-07-26T08:45:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:26 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:45:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:26 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:reconnect 2024-07-26T08:45:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:26 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:26 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:45:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:26 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:45:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:26 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:reconnect 2024-07-26T08:45:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:26 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:26 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:45:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:26 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:45:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:26 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:reconnect 2024-07-26T08:45:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:26 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:26 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0099999 2024-07-26T08:45:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:27 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:rejoin 2024-07-26T08:45:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:27 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:27.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:27 smithi043 ceph-mon[32384]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:45:27.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:27 smithi043 ceph-mon[32384]: pgmap v897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:45:28.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:27 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:rejoin 2024-07-26T08:45:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:27 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:27 smithi133 ceph-mon[37053]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:45:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:27 smithi133 ceph-mon[37053]: pgmap v897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:45:28.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:rejoin 2024-07-26T08:45:28.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:28.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-mon[36747]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:45:28.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-mon[36747]: pgmap v897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: *** Caught signal (Aborted) ** 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: in thread 7fe268135640 thread_name:ms_dispatch 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe26d50c6f0] 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe26d55994c] 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 3: raise() 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 4: abort() 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe26d4f671b] 2024-07-26T08:45:28.072 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 6: /lib64/libc.so.6(+0x37386) [0x7fe26d505386] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a0d77dc6b9] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a0d799a80c] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a0d78da2ca] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a0d78aa753] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a0d78aba1b] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a0d788f752] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a0d77dda56] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a0d77e1637] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a0d77e1f5e] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a0d77c503a] 2024-07-26T08:45:28.073 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe26ddd9407] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 18: (DispatchQueue::entry()+0x60f) [0x7fe26ddd9cf9] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe26deb65a1] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 20: (Thread::entry_wrapper()+0x43) [0x7fe26dc63cdd] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe26dc63cf9] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe26d557c02] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe26d5dcc40] 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:27.747+0000 7fe268135640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: in thread 7fe268135640 thread_name:ms_dispatch 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:28.074 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe26d50c6f0] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe26d55994c] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 3: raise() 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 4: abort() 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe26d4f671b] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 6: /lib64/libc.so.6(+0x37386) [0x7fe26d505386] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a0d77dc6b9] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a0d799a80c] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a0d78da2ca] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a0d78aa753] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a0d78aba1b] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a0d788f752] 2024-07-26T08:45:28.075 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a0d77dda56] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a0d77e1637] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a0d77e1f5e] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a0d77c503a] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe26ddd9407] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 18: (DispatchQueue::entry()+0x60f) [0x7fe26ddd9cf9] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe26deb65a1] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 20: (Thread::entry_wrapper()+0x43) [0x7fe26dc63cdd] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe26dc63cf9] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe26d557c02] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe26d5dcc40] 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 0> 2024-07-26T08:45:27.747+0000 7fe268135640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:28.076 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: in thread 7fe268135640 thread_name:ms_dispatch 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe26d50c6f0] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe26d55994c] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 3: raise() 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 4: abort() 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe26d4f671b] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 6: /lib64/libc.so.6(+0x37386) [0x7fe26d505386] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a0d77dc6b9] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a0d799a80c] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a0d78da2ca] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a0d78aa753] 2024-07-26T08:45:28.077 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a0d78aba1b] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a0d788f752] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a0d77dda56] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a0d77e1637] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a0d77e1f5e] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a0d77c503a] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe26ddd9407] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 18: (DispatchQueue::entry()+0x60f) [0x7fe26ddd9cf9] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe26deb65a1] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 20: (Thread::entry_wrapper()+0x43) [0x7fe26dc63cdd] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe26dc63cf9] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe26d557c02] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe26d5dcc40] 2024-07-26T08:45:28.078 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 0> 2024-07-26T08:45:27.747+0000 7fe268135640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: in thread 7fe268135640 thread_name:ms_dispatch 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe26d50c6f0] 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe26d55994c] 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 3: raise() 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 4: abort() 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe26d4f671b] 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 6: /lib64/libc.so.6(+0x37386) [0x7fe26d505386] 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a0d77dc6b9] 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a0d799a80c] 2024-07-26T08:45:28.079 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a0d78da2ca] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a0d78aa753] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a0d78aba1b] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a0d788f752] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a0d77dda56] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a0d77e1637] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a0d77e1f5e] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a0d77c503a] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe26ddd9407] 2024-07-26T08:45:28.080 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 18: (DispatchQueue::entry()+0x60f) [0x7fe26ddd9cf9] 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe26deb65a1] 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 20: (Thread::entry_wrapper()+0x43) [0x7fe26dc63cdd] 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe26dc63cf9] 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe26d557c02] 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe26d5dcc40] 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75455]: 2024-07-26T08:45:28.081 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:27 smithi063 podman[75506]: 2024-07-26 08:45:27.807846904 +0000 UTC m=+0.019706709 container died 3a329f99d4d96812533ba7042bfcacd9c023566f7e0646b1106ab11b81ada62c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:45:28.752 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:28 smithi063 podman[75506]: 2024-07-26 08:45:28.500522981 +0000 UTC m=+0.712382774 container remove 3a329f99d4d96812533ba7042bfcacd9c023566f7e0646b1106ab11b81ada62c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:45:28.752 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:28 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:45:28.752 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:28 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:28.752 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:28 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:active 2024-07-26T08:45:28.752 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:28 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:28.753 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:28 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:28 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:28 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:active 2024-07-26T08:45:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:28 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:28 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:28 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:28 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2161114143,v1:172.21.15.63:6833/2161114143] up:active 2024-07-26T08:45:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:28 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:28 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:29.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:28 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:45:29.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:28 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 2.020s CPU time. 2024-07-26T08:45:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:29 smithi133 ceph-mon[37053]: pgmap v898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:45:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:29 smithi063 ceph-mon[36747]: pgmap v898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:45:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:29 smithi043 ceph-mon[32384]: pgmap v898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:45:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 576.717276 secs 2024-07-26T08:45:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 592.204175 secs 2024-07-26T08:45:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 576.717276 secs 2024-07-26T08:45:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 592.204175 secs 2024-07-26T08:45:31.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 576.717276 secs 2024-07-26T08:45:31.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 592.204175 secs 2024-07-26T08:45:32.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:31 smithi133 ceph-mon[37053]: pgmap v899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:45:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:31 smithi063 ceph-mon[36747]: pgmap v899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:45:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:31 smithi043 ceph-mon[32384]: pgmap v899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 8 op/s 2024-07-26T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:34 smithi043 ceph-mon[32384]: pgmap v900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:45:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:34 smithi133 ceph-mon[37053]: pgmap v900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:45:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:34 smithi063 ceph-mon[36747]: pgmap v900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 581.717414 secs 2024-07-26T08:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:36 smithi043 ceph-mon[32384]: pgmap v901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 179 B/s wr, 9 op/s 2024-07-26T08:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 597.204271 secs 2024-07-26T08:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 581.717414 secs 2024-07-26T08:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:36 smithi133 ceph-mon[37053]: pgmap v901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 179 B/s wr, 9 op/s 2024-07-26T08:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 597.204271 secs 2024-07-26T08:45:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 581.717414 secs 2024-07-26T08:45:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:36 smithi063 ceph-mon[36747]: pgmap v901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 179 B/s wr, 9 op/s 2024-07-26T08:45:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 597.204271 secs 2024-07-26T08:45:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:38 smithi043 ceph-mon[32384]: pgmap v902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:38.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:38 smithi133 ceph-mon[37053]: pgmap v902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:38 smithi063 ceph-mon[36747]: pgmap v902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:39.110 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:38 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:45:39.111 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:38 smithi063 systemd[1]: Stopped Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:39.111 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:38 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 2.020s CPU time. 2024-07-26T08:45:39.111 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:38 smithi063 systemd[1]: Starting Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:45:39.111 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 podman[75599]: 2024-07-26 08:45:38.964893562 +0000 UTC m=+0.018518439 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:45:39.363 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 podman[75599]: 2024-07-26 08:45:39.109762304 +0000 UTC m=+0.163387223 container create e8e210da17743e223ef2be2b296cf251b9149c2371b6871a0e3ba38d454cd13a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-07-26T08:45:39.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 podman[75599]: 2024-07-26 08:45:39.362721846 +0000 UTC m=+0.416346737 container init e8e210da17743e223ef2be2b296cf251b9149c2371b6871a0e3ba38d454cd13a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:45:39.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 podman[75599]: 2024-07-26 08:45:39.365349562 +0000 UTC m=+0.418974449 container start e8e210da17743e223ef2be2b296cf251b9149c2371b6871a0e3ba38d454cd13a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-07-26T08:45:39.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 ceph-mds[75618]: -- 172.21.15.63:0/3504161699 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c00fa2f860 con 0x55c013bd1180 2024-07-26T08:45:39.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: starting mds.k at 2024-07-26T08:45:39.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 bash[75599]: e8e210da17743e223ef2be2b296cf251b9149c2371b6871a0e3ba38d454cd13a 2024-07-26T08:45:39.818 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:45:39 smithi063 systemd[1]: Started Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: pgmap v903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: daemon mds.k restarted 2024-07-26T08:45:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:45:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: osdmap e127: 12 total, 12 up, 12 in 2024-07-26T08:45:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:boot 2024-07-26T08:45:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:45:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:40 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: pgmap v903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: daemon mds.k restarted 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: osdmap e127: 12 total, 12 up, 12 in 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:boot 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:40 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: pgmap v903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: daemon mds.k restarted 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: osdmap e127: 12 total, 12 up, 12 in 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:boot 2024-07-26T08:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:45:40.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:40.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:40 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:41.452 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 586.717557 secs 2024-07-26T08:45:41.452 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:41 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:resolve 2024-07-26T08:45:41.452 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:41 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:41.452 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 602.204324 secs 2024-07-26T08:45:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 586.717557 secs 2024-07-26T08:45:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:41 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:resolve 2024-07-26T08:45:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:41 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 602.204324 secs 2024-07-26T08:45:41.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 586.717557 secs 2024-07-26T08:45:41.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:41 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:resolve 2024-07-26T08:45:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:41 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 602.204324 secs 2024-07-26T08:45:42.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:45:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:42 smithi043 ceph-mon[32384]: pgmap v905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:45:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:42 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:45:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:42 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:reconnect 2024-07-26T08:45:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:42 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:42 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:45:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:42 smithi133 ceph-mon[37053]: pgmap v905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:45:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:42 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:45:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:42 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:reconnect 2024-07-26T08:45:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:42 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:42 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:45:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:42 smithi063 ceph-mon[36747]: pgmap v905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8 op/s 2024-07-26T08:45:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:42 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:45:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:42 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:reconnect 2024-07-26T08:45:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:42 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:42 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:45:42.837 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:45:43.548 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:rejoin 2024-07-26T08:45:43.548 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:43.548 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-mon[32384]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:45:43.548 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:45:43.548 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: *** Caught signal (Aborted) ** 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: in thread 7f52a0400640 thread_name:ms_dispatch 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52a663e6f0] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f52a668b94c] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 3: raise() 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 4: abort() 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 5: /lib64/libc.so.6(+0x2871b) [0x7f52a662871b] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 6: /lib64/libc.so.6(+0x37386) [0x7f52a6637386] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cad23b86b9] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cad257680c] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cad24b62ca] 2024-07-26T08:45:43.549 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cad2486753] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cad2487a1b] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cad246b752] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cad23b9a56] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cad23bd637] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cad23bdf5e] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cad23a103a] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f52a719b407] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 18: (DispatchQueue::entry()+0x60f) [0x7f52a719bcf9] 2024-07-26T08:45:43.550 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52a72785a1] 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 20: (Thread::entry_wrapper()+0x43) [0x7f52a7025cdd] 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 21: (Thread::_entry_func(void*)+0xd) [0x7f52a7025cf9] 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 22: /lib64/libc.so.6(+0x89c02) [0x7f52a6689c02] 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f52a670ec40] 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:43.503+0000 7f52a0400640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: in thread 7f52a0400640 thread_name:ms_dispatch 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:43.551 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52a663e6f0] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f52a668b94c] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 3: raise() 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 4: abort() 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 5: /lib64/libc.so.6(+0x2871b) [0x7f52a662871b] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 6: /lib64/libc.so.6(+0x37386) [0x7f52a6637386] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cad23b86b9] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cad257680c] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cad24b62ca] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cad2486753] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cad2487a1b] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cad246b752] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cad23b9a56] 2024-07-26T08:45:43.552 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cad23bd637] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cad23bdf5e] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cad23a103a] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f52a719b407] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 18: (DispatchQueue::entry()+0x60f) [0x7f52a719bcf9] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52a72785a1] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 20: (Thread::entry_wrapper()+0x43) [0x7f52a7025cdd] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 21: (Thread::_entry_func(void*)+0xd) [0x7f52a7025cf9] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 22: /lib64/libc.so.6(+0x89c02) [0x7f52a6689c02] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f52a670ec40] 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 0> 2024-07-26T08:45:43.503+0000 7f52a0400640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: in thread 7f52a0400640 thread_name:ms_dispatch 2024-07-26T08:45:43.553 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52a663e6f0] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f52a668b94c] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 3: raise() 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 4: abort() 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 5: /lib64/libc.so.6(+0x2871b) [0x7f52a662871b] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 6: /lib64/libc.so.6(+0x37386) [0x7f52a6637386] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cad23b86b9] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cad257680c] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cad24b62ca] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cad2486753] 2024-07-26T08:45:43.554 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cad2487a1b] 2024-07-26T08:45:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:43 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:rejoin 2024-07-26T08:45:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:43 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:43 smithi133 ceph-mon[37053]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:45:43.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:43 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:rejoin 2024-07-26T08:45:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:43 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:43 smithi063 ceph-mon[36747]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cad246b752] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cad23b9a56] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cad23bd637] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cad23bdf5e] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cad23a103a] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f52a719b407] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 18: (DispatchQueue::entry()+0x60f) [0x7f52a719bcf9] 2024-07-26T08:45:43.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52a72785a1] 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 20: (Thread::entry_wrapper()+0x43) [0x7f52a7025cdd] 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 21: (Thread::_entry_func(void*)+0xd) [0x7f52a7025cf9] 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 22: /lib64/libc.so.6(+0x89c02) [0x7f52a6689c02] 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f52a670ec40] 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 0> 2024-07-26T08:45:43.503+0000 7f52a0400640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: in thread 7f52a0400640 thread_name:ms_dispatch 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52a663e6f0] 2024-07-26T08:45:43.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f52a668b94c] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 3: raise() 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 4: abort() 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 5: /lib64/libc.so.6(+0x2871b) [0x7f52a662871b] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 6: /lib64/libc.so.6(+0x37386) [0x7f52a6637386] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cad23b86b9] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cad257680c] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cad24b62ca] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cad2486753] 2024-07-26T08:45:43.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cad2487a1b] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cad246b752] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cad23b9a56] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cad23bd637] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cad23bdf5e] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cad23a103a] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f52a719b407] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 18: (DispatchQueue::entry()+0x60f) [0x7f52a719bcf9] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52a72785a1] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 20: (Thread::entry_wrapper()+0x43) [0x7f52a7025cdd] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 21: (Thread::_entry_func(void*)+0xd) [0x7f52a7025cf9] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 22: /lib64/libc.so.6(+0x89c02) [0x7f52a6689c02] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f52a670ec40] 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:45:43.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108122]: 2024-07-26T08:45:44.389 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:43 smithi043 podman[108259]: 2024-07-26 08:45:43.996372478 +0000 UTC m=+0.372692291 container died 8e23e3c1470dc5fe74a72f9388b574929297197b4bf4fe3a1223773255dd27db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-07-26T08:45:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:44 smithi043 ceph-mon[32384]: pgmap v906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:45:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:44 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:44 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:active 2024-07-26T08:45:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:44 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:44 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:44 smithi133 ceph-mon[37053]: pgmap v906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:45:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:44 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:44 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:active 2024-07-26T08:45:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:44 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:44 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:44 smithi063 ceph-mon[36747]: pgmap v906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:45:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:44 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:45:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:44 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/2435252716,v1:172.21.15.43:6837/2435252716] up:active 2024-07-26T08:45:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:44 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:44 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:45:45.387 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:45 smithi043 podman[108259]: 2024-07-26 08:45:45.069026459 +0000 UTC m=+1.445346286 container remove 8e23e3c1470dc5fe74a72f9388b574929297197b4bf4fe3a1223773255dd27db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-07-26T08:45:45.387 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:45 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:45:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 591.717692 secs 2024-07-26T08:45:45.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 591.717692 secs 2024-07-26T08:45:45.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 591.717692 secs 2024-07-26T08:45:46.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.707+0000 7f870f000640 1 -- 172.21.15.43:0/61638608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 msgr2=0x7f87081092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.707+0000 7f870f000640 1 --2- 172.21.15.43:0/61638608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f87081092e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009900 tx=0x7f86f402a410 comp rx=0 tx=0).stop 2024-07-26T08:45:46.710 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:46 smithi043 ceph-mon[32384]: pgmap v907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8 op/s 2024-07-26T08:45:46.710 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 607.204402 secs 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 -- 172.21.15.43:0/61638608 shutdown_connections 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 --2- 172.21.15.43:0/61638608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708109820 0x7f8708110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 --2- 172.21.15.43:0/61638608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f87081092e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 --2- 172.21.15.43:0/61638608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f87081039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 -- 172.21.15.43:0/61638608 >> 172.21.15.43:0/61638608 conn(0x7f870807b280 msgr2=0x7f870807b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 -- 172.21.15.43:0/61638608 shutdown_connections 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.708+0000 7f870f000640 1 -- 172.21.15.43:0/61638608 wait complete. 2024-07-26T08:45:46.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.709+0000 7f870f000640 1 Processor -- start 2024-07-26T08:45:46.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.709+0000 7f870f000640 1 -- start start 2024-07-26T08:45:46.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f8708075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f8708075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708109820 0x7f8708075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8708113650 con 0x7f8708108ed0 2024-07-26T08:45:46.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87081134d0 con 0x7f8708103590 2024-07-26T08:45:46.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f87081137d0 con 0x7f8708109820 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f8707e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f8708075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f8707e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f8708075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55826/0 (socket says 172.21.15.43:55826) 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f8707e00640 1 -- 172.21.15.43:0/3225279992 learned_addr learned my addr 172.21.15.43:0/3225279992 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f8707400640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f8708075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.710+0000 7f870d000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708109820 0x7f8708075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707e00640 1 -- 172.21.15.43:0/3225279992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708109820 msgr2=0x7f8708075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707e00640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708109820 0x7f8708075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707e00640 1 -- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 msgr2=0x7f8708075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707e00640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f8708075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707e00640 1 -- 172.21.15.43:0/3225279992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87081a8240 con 0x7f8708103590 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707400640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f8708075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:45:46.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8707e00640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f8708075140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f86f800e9f0 tx=0x7f86f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:46.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.711+0000 7f8704c00640 1 -- 172.21.15.43:0/3225279992 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f800cd80 con 0x7f8708103590 2024-07-26T08:45:46.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.712+0000 7f8704c00640 1 -- 172.21.15.43:0/3225279992 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86f8010900 con 0x7f8708103590 2024-07-26T08:45:46.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.712+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87081a8530 con 0x7f8708103590 2024-07-26T08:45:46.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.712+0000 7f8704c00640 1 -- 172.21.15.43:0/3225279992 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8018920 con 0x7f8708103590 2024-07-26T08:45:46.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.712+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87081a8a40 con 0x7f8708103590 2024-07-26T08:45:46.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8704c00640 1 -- 172.21.15.43:0/3225279992 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f86f8010ab0 con 0x7f8708103590 2024-07-26T08:45:46.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 Processor -- start 2024-07-26T08:45:46.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 -- start start 2024-07-26T08:45:46.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d210e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d211360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d2118a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b2d187bc0 con 0x559b2ce4b390 2024-07-26T08:45:46.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559b2d1770c0 con 0x559b2ce431b0 2024-07-26T08:45:46.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.716+0000 7f8715c8c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559b2d17b100 con 0x559b2ce6c070 2024-07-26T08:45:46.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.717+0000 7f8707e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d211360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.717+0000 7f8707400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d2118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.717+0000 7f8707e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d211360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55842/0 (socket says 172.21.15.43:55842) 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.717+0000 7f8707e00640 1 -- 172.21.15.43:0/1586261682 learned_addr learned my addr 172.21.15.43:0/1586261682 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f870d000640 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d210e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f8707400640 1 -- 172.21.15.43:0/1586261682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 msgr2=0x559b2d210e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f8707400640 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d210e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f8707400640 1 -- 172.21.15.43:0/1586261682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 msgr2=0x559b2d211360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f8707400640 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d211360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f8707400640 1 -- 172.21.15.43:0/1586261682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ced7650 con 0x559b2ce4b390 2024-07-26T08:45:46.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.718+0000 7f8707e00640 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d211360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.719+0000 7f8704c00640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f86ec0b3d40 0x7f86ec0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.719+0000 7f8707400640 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d2118a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009230 tx=0x7f86f40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253675529fc7cad1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.719+0000 7f870d000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f86ec0b3d40 0x7f86ec0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.719+0000 7f86fd600640 1 -- 172.21.15.43:0/1586261682 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4035030 con 0x559b2ce4b390 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.719+0000 7f86fd600640 1 -- 172.21.15.43:0/1586261682 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86f40044d0 con 0x559b2ce4b390 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.719+0000 7f86fd600640 1 -- 172.21.15.43:0/1586261682 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40035f0 con 0x559b2ce4b390 2024-07-26T08:45:46.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.720+0000 7f8704c00640 1 -- 172.21.15.43:0/3225279992 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 12634+0+0 (secure 0 0 0) 0x7f86f80e54e0 con 0x7f8708103590 2024-07-26T08:45:46.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.720+0000 7f8715c8c740 1 -- 172.21.15.43:0/1586261682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 msgr2=0x559b2d2118a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.720+0000 7f870d000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f86ec0b3d40 0x7f86ec0b6250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8700005fd0 tx=0x7f8700009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:46.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.720+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d2118a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009230 tx=0x7f86f40040e0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 -- 172.21.15.43:0/1586261682 shutdown_connections 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d2118a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d211360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1586261682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d210e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 -- 172.21.15.43:0/1586261682 >> 172.21.15.43:0/1586261682 conn(0x559b2ce60460 msgr2=0x559b2d20ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 -- 172.21.15.43:0/1586261682 shutdown_connections 2024-07-26T08:45:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 -- 172.21.15.43:0/1586261682 wait complete. 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.721+0000 7f8715c8c740 1 -- start start 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 Processor -- start 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce431b0 0x559b2d21c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce4b390 0x559b2d21c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d21cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b2cfda700 con 0x559b2ce431b0 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559b2d113690 con 0x559b2ce4b390 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559b2d2305b0 con 0x559b2ce6c070 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.722+0000 7f8715c8c740 10 client.0 _ll_register_callbacks cb 0x559b2d123140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:45:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce431b0 0x559b2d21c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce431b0 0x559b2d21c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54084/0 (socket says 172.21.15.43:54084) 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707e00640 1 -- 172.21.15.43:0/1053074766 learned_addr learned my addr 172.21.15.43:0/1053074766 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707400640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce4b390 0x559b2d21c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f870d000640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d21cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707400640 1 -- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 msgr2=0x559b2d21cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707400640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d21cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.723+0000 7f8707400640 1 -- 172.21.15.43:0/1053074766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce431b0 msgr2=0x559b2d21c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.724+0000 7f8707400640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce431b0 0x559b2d21c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.724+0000 7f8707400640 1 -- 172.21.15.43:0/1053074766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2d12a830 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.724+0000 7f8707400640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce4b390 0x559b2d21c8b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f86f402a930 tx=0x7f86f4003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8fac0dc69344ff server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.724+0000 7f86f2000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.724+0000 7f86f2000640 1 -- 172.21.15.43:0/1053074766 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4035070 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.724+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f40044d0 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.725+0000 7f86f2000640 1 -- 172.21.15.43:0/1053074766 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 12634+0+0 (secure 0 0 0) 0x7f86f40042d0 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.725+0000 7f86f2000640 1 -- 172.21.15.43:0/1053074766 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=273) ==== 24+0+0 (secure 0 0 0) 0x7f86f4005d50 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.725+0000 7f8715c8c740 10 client.26315 fetch_fsmap learned FSMap version 273 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.725+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=273,monmap=4+}) -- 0x559b2d23c160 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.725+0000 7f86f2000640 1 -- 172.21.15.43:0/1053074766 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86f40044d0 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f86f2000640 1 -- 172.21.15.43:0/1053074766 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 273) ==== 5329+0+0 (secure 0 0 0) 0x7f86f404e960 con 0x559b2ce4b390 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8715c8c740 10 client.26315 fetch_fsmap finished waiting for FSMap version 273 2024-07-26T08:45:46.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8715c8c740 10 client.26315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:45:46.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8715c8c740 20 client.26315 populate_metadata read hostname 'smithi043' 2024-07-26T08:45:46.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2ce2a9f0 0x559b2d23f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8715c8c740 4 client.26315 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:45:46.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2d189b10 con 0x559b2ce2a9f0 2024-07-26T08:45:46.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.726+0000 7f8707e00640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2ce2a9f0 0x559b2d23f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.727+0000 7f8707e00640 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2ce2a9f0 0x559b2d23f720 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ee7ade55d22699 server_cookie=888eb823817dbc61 in_seq=0 out_seq=0 2024-07-26T08:45:46.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.727+0000 7f86f2000640 10 client.26315 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:46.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f86f2000640 1 -- 172.21.15.43:0/1053074766 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b2d189b10 con 0x559b2ce2a9f0 2024-07-26T08:45:46.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f86f2000640 10 client.26315 handle_command_reply: tid=0 2024-07-26T08:45:46.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 client.26315 shutdown 2024-07-26T08:45:46.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce4b390 msgr2=0x559b2d21c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce4b390 0x559b2d21c8b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f86f402a930 tx=0x7f86f4003820 comp rx=0 tx=0).stop 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 shutdown_connections 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2ce2a9f0 0x559b2d23f720 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d21cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce4b390 0x559b2d21c8b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 --2- 172.21.15.43:0/1053074766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce431b0 0x559b2d21c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 >> 172.21.15.43:0/1053074766 conn(0x559b2ce60460 msgr2=0x559b2d214000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f86f2000640 0 client.26315 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 shutdown_connections 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.728+0000 7f8715c8c740 1 -- 172.21.15.43:0/1053074766 wait complete. 2024-07-26T08:45:46.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.729+0000 7f8715c8c740 20 client.26315 trim_cache size 0 max 16384 2024-07-26T08:45:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:46 smithi133 ceph-mon[37053]: pgmap v907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8 op/s 2024-07-26T08:45:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 607.204402 secs 2024-07-26T08:45:46.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.766+0000 7f8715c8c740 1 Processor -- start 2024-07-26T08:45:46.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.766+0000 7f8715c8c740 1 -- start start 2024-07-26T08:45:46.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d212810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d244f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d245460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8715c8c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f87081ad2f0 con 0x559b2ce4b390 2024-07-26T08:45:46.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8715c8c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87081ab0e0 con 0x559b2ce431b0 2024-07-26T08:45:46.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8715c8c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f87081acc20 con 0x559b2ce6c070 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8707e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d212810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8707400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d244f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8707e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d212810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:55874/0 (socket says 172.21.15.43:55874) 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f8707e00640 1 -- 172.21.15.43:0/746634067 learned_addr learned my addr 172.21.15.43:0/746634067 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.767+0000 7f870d000640 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d245460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707e00640 1 -- 172.21.15.43:0/746634067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 msgr2=0x559b2d245460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707e00640 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d245460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707e00640 1 -- 172.21.15.43:0/746634067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 msgr2=0x559b2d244f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707e00640 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d244f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707e00640 1 -- 172.21.15.43:0/746634067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2d213110 con 0x559b2ce431b0 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f870d000640 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d245460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707400640 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d244f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f8707e00640 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d212810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f80ea040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde1bd3ce71ac130 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.768+0000 7f86fcc00640 1 -- 172.21.15.43:0/746634067 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80aa7f0 con 0x559b2ce431b0 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.769+0000 7f86fcc00640 1 -- 172.21.15.43:0/746634067 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86f8010e20 con 0x559b2ce431b0 2024-07-26T08:45:46.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.769+0000 7f86fcc00640 1 -- 172.21.15.43:0/746634067 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80e1e40 con 0x559b2ce431b0 2024-07-26T08:45:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 -- 172.21.15.43:0/746634067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 msgr2=0x559b2d212810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d212810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f80ea040 comp rx=0 tx=0).stop 2024-07-26T08:45:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 -- 172.21.15.43:0/746634067 shutdown_connections 2024-07-26T08:45:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce6c070 0x559b2d245460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d244f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 --2- 172.21.15.43:0/746634067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce431b0 0x559b2d212810 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 -- 172.21.15.43:0/746634067 >> 172.21.15.43:0/746634067 conn(0x559b2ce60460 msgr2=0x559b2d214450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 -- 172.21.15.43:0/746634067 shutdown_connections 2024-07-26T08:45:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.770+0000 7f8715c8c740 1 -- 172.21.15.43:0/746634067 wait complete. 2024-07-26T08:45:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.771+0000 7f8715c8c740 1 -- start start 2024-07-26T08:45:46.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.771+0000 7f8715c8c740 1 Processor -- start 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 0x559b2d235f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d231990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce6c070 0x559b2d231f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f87081abe80 con 0x559b2ce4b390 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87081ab7b0 con 0x559b2ce6c070 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f87081ac550 con 0x559b2ce431b0 2024-07-26T08:45:46.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8715c8c740 10 client.0 _ll_register_callbacks cb 0x7f87000093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 0x559b2d235f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 0x559b2d235f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:52318/0 (socket says 172.21.15.43:52318) 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 -- 172.21.15.43:0/3229883707 learned_addr learned my addr 172.21.15.43:0/3229883707 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707400640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d231990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f870d000640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce6c070 0x559b2d231f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 -- 172.21.15.43:0/3229883707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce6c070 msgr2=0x559b2d231f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce6c070 0x559b2d231f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 -- 172.21.15.43:0/3229883707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 msgr2=0x559b2d231990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.772+0000 7f8707e00640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d231990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f8707e00640 1 -- 172.21.15.43:0/3229883707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2d2326e0 con 0x559b2ce431b0 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f8707e00640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 0x559b2d235f60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86f80e5850 tx=0x7f86f80aac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794226b4e6ef93f2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:45:46.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f86f2000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:45:46.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f86f2000640 1 -- 172.21.15.43:0/3229883707 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80aa7f0 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f86f2000640 1 -- 172.21.15.43:0/3229883707 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 12634+0+0 (secure 0 0 0) 0x7f86f80e1e40 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b2d1855b0 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.773+0000 7f86f2000640 1 -- 172.21.15.43:0/3229883707 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=273) ==== 24+0+0 (secure 0 0 0) 0x7f86f80e2040 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 10 client.26305 fetch_fsmap learned FSMap version 273 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=273,monmap=4+}) -- 0x559b2d2a6eb0 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f86f2000640 1 -- 172.21.15.43:0/3229883707 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x559b2d1855b0 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f86f2000640 1 -- 172.21.15.43:0/3229883707 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 273) ==== 5329+0+0 (secure 0 0 0) 0x7f86f80af110 con 0x559b2ce431b0 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 10 client.26305 fetch_fsmap finished waiting for FSMap version 273 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 10 client.26305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 20 client.26305 populate_metadata read hostname 'smithi043' 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2cdffda0 0x559b2d2a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:45:46.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 4 client.26305 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.774+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559b2d182cf0 con 0x559b2cdffda0 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.775+0000 7f8707400640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2cdffda0 0x559b2d2a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.775+0000 7f8707400640 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2cdffda0 0x559b2d2a9640 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de29cf309d1f6b8a server_cookie=4fc44b9d01708acd in_seq=0 out_seq=0 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.775+0000 7f86f2000640 10 client.26305 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f86f2000640 1 -- 172.21.15.43:0/3229883707 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x559b2d182cf0 con 0x559b2cdffda0 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f86f2000640 10 client.26305 handle_command_reply: tid=0 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 client.26305 shutdown 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 msgr2=0x559b2d235f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 0x559b2d235f60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86f80e5850 tx=0x7f86f80aac10 comp rx=0 tx=0).stop 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 shutdown_connections 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x559b2cdffda0 0x559b2d2a9640 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559b2ce6c070 0x559b2d231f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b2ce4b390 0x559b2d231990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 --2- 172.21.15.43:0/3229883707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559b2ce431b0 0x559b2d235f60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f86f2000640 0 client.26305 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 >> 172.21.15.43:0/3229883707 conn(0x559b2ce60460 msgr2=0x559b2d214450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 shutdown_connections 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.776+0000 7f8715c8c740 1 -- 172.21.15.43:0/3229883707 wait complete. 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.777+0000 7f8715c8c740 20 client.26305 trim_cache size 0 max 16384 2024-07-26T08:45:46.780 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:45:46.781 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.777+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f86ec0b3d40 msgr2=0x7f86ec0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.777+0000 7f870f000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f86ec0b3d40 0x7f86ec0b6250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8700005fd0 tx=0x7f8700009500 comp rx=0 tx=0).stop 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.777+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 msgr2=0x7f8708075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.777+0000 7f870f000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f8708075140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f86f800e9f0 tx=0x7f86f800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 shutdown_connections 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f86ec0b3d40 0x7f86ec0b6250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708109820 0x7f8708075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8708108ed0 0x7f8708075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 --2- 172.21.15.43:0/3225279992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8708103590 0x7f8708075140 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:45:46.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 >> 172.21.15.43:0/3225279992 conn(0x7f870807b280 msgr2=0x7f8708106ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:45:46.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 shutdown_connections 2024-07-26T08:45:46.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:45:46.778+0000 7f870f000640 1 -- 172.21.15.43:0/3225279992 wait complete. 2024-07-26T08:45:46.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:46 smithi063 ceph-mon[36747]: pgmap v907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8 op/s 2024-07-26T08:45:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 607.204402 secs 2024-07-26T08:45:47.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:47 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:45:47.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:47 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.291s CPU time. 2024-07-26T08:45:47.686 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:45:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:48 smithi133 ceph-mon[37053]: pgmap v908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:45:48.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:48 smithi063 ceph-mon[36747]: pgmap v908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:45:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:48 smithi043 ceph-mon[32384]: pgmap v908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:45:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:50 smithi133 ceph-mon[37053]: pgmap v909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T08:45:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 596.717829 secs 2024-07-26T08:45:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:50 smithi063 ceph-mon[36747]: pgmap v909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T08:45:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 596.717829 secs 2024-07-26T08:45:50.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:50 smithi043 ceph-mon[32384]: pgmap v909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T08:45:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 596.717829 secs 2024-07-26T08:45:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 612.204497 secs 2024-07-26T08:45:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 612.204497 secs 2024-07-26T08:45:51.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 612.204497 secs 2024-07-26T08:45:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:52 smithi133 ceph-mon[37053]: pgmap v910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 175 B/s wr, 10 op/s 2024-07-26T08:45:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:52 smithi063 ceph-mon[36747]: pgmap v910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 175 B/s wr, 10 op/s 2024-07-26T08:45:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:52 smithi043 ceph-mon[32384]: pgmap v910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 175 B/s wr, 10 op/s 2024-07-26T08:45:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:54 smithi133 ceph-mon[37053]: pgmap v911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:54 smithi063 ceph-mon[36747]: pgmap v911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:54 smithi043 ceph-mon[32384]: pgmap v911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:45:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 601.717967 secs 2024-07-26T08:45:55.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 601.717967 secs 2024-07-26T08:45:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 601.717967 secs 2024-07-26T08:45:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:56 smithi063 ceph-mon[36747]: pgmap v912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 617.204633 secs 2024-07-26T08:45:56.923 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:56 smithi043 ceph-mon[32384]: pgmap v912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:56.923 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 617.204633 secs 2024-07-26T08:45:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:56 smithi133 ceph-mon[37053]: pgmap v912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:45:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 617.204633 secs 2024-07-26T08:45:57.605 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:57 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:45:57.605 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:57 smithi043 systemd[1]: Stopped Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:57.605 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:57 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.291s CPU time. 2024-07-26T08:45:57.605 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:57 smithi043 systemd[1]: Starting Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:45:57.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:57 smithi043 podman[108443]: 2024-07-26 08:45:57.545055297 +0000 UTC m=+0.037425114 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:45:57.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:57 smithi043 podman[108443]: 2024-07-26 08:45:57.675219495 +0000 UTC m=+0.167589322 container create d82e4daa11145ba581c3eb54ba9c9637f445cdd7008030996d4627596962765f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-07-26T08:45:58.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:58 smithi043 podman[108443]: 2024-07-26 08:45:58.129738847 +0000 UTC m=+0.622108726 container init d82e4daa11145ba581c3eb54ba9c9637f445cdd7008030996d4627596962765f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True) 2024-07-26T08:45:58.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:58 smithi043 podman[108443]: 2024-07-26 08:45:58.139661977 +0000 UTC m=+0.632031787 container start d82e4daa11145ba581c3eb54ba9c9637f445cdd7008030996d4627596962765f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True) 2024-07-26T08:45:58.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:58 smithi043 bash[108443]: d82e4daa11145ba581c3eb54ba9c9637f445cdd7008030996d4627596962765f 2024-07-26T08:45:58.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:58 smithi043 systemd[1]: Started Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:45:58.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mds[108469]: -- 172.21.15.43:0/2973445079 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556cbdc3d860 con 0x556cc1ddf180 2024-07-26T08:45:58.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: starting mds.g at 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: pgmap v913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: daemon mds.g restarted 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: osdmap e128: 12 total, 12 up, 12 in 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:boot 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:45:58.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:58 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: pgmap v913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:45:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: daemon mds.g restarted 2024-07-26T08:45:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: osdmap e128: 12 total, 12 up, 12 in 2024-07-26T08:45:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:boot 2024-07-26T08:45:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:45:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:45:58.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:58 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: pgmap v913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: daemon mds.g restarted 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: osdmap e128: 12 total, 12 up, 12 in 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:boot 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:45:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:58 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:replay,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:45:59.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:45:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:45:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:45:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:46:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:45:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: pgmap v915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:resolve 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 606.718090 secs 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:46:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: pgmap v915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:resolve 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 606.718090 secs 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:46:00.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:46:00.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:46:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: pgmap v915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:resolve 2024-07-26T08:46:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:resolve,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 606.718090 secs 2024-07-26T08:46:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:46:00.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: pgmap v916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: pgmap v917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 622.204776 secs 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00099999 2024-07-26T08:46:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:reconnect 2024-07-26T08:46:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:01 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:46:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: pgmap v916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: pgmap v917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 622.204776 secs 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00099999 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:reconnect 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:01 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:46:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:46:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: pgmap v916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: pgmap v917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 622.204776 secs 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00099999 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:reconnect 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:reconnect,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:01 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899991 2024-07-26T08:46:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:rejoin 2024-07-26T08:46:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-mon[36747]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: *** Caught signal (Aborted) ** 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: in thread 7fa7b7a05640 thread_name:ms_dispatch 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bcddc6f0] 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa7bce2994c] 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 3: raise() 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 4: abort() 2024-07-26T08:46:02.819 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa7bcdc671b] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 6: /lib64/libc.so.6(+0x37386) [0x7fa7bcdd5386] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c00cdad6b9] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c00cf6b80c] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c00ceab2ca] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c00ce7b753] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c00ce7ca1b] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c00ce60752] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c00cdaea56] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c00cdb2637] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c00cdb2f5e] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c00cd9603a] 2024-07-26T08:46:02.820 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa7bd6a9407] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 18: (DispatchQueue::entry()+0x60f) [0x7fa7bd6a9cf9] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa7bd7865a1] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 20: (Thread::entry_wrapper()+0x43) [0x7fa7bd533cdd] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa7bd533cf9] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa7bce27c02] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa7bceacc40] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.592+0000 7fa7b7a05640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: in thread 7fa7b7a05640 thread_name:ms_dispatch 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bcddc6f0] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa7bce2994c] 2024-07-26T08:46:02.821 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 3: raise() 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 4: abort() 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa7bcdc671b] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 6: /lib64/libc.so.6(+0x37386) [0x7fa7bcdd5386] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c00cdad6b9] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c00cf6b80c] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c00ceab2ca] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c00ce7b753] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c00ce7ca1b] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c00ce60752] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c00cdaea56] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c00cdb2637] 2024-07-26T08:46:02.822 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c00cdb2f5e] 2024-07-26T08:46:02.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c00cd9603a] 2024-07-26T08:46:02.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa7bd6a9407] 2024-07-26T08:46:02.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 18: (DispatchQueue::entry()+0x60f) [0x7fa7bd6a9cf9] 2024-07-26T08:46:02.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa7bd7865a1] 2024-07-26T08:46:02.823 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 20: (Thread::entry_wrapper()+0x43) [0x7fa7bd533cdd] 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa7bd533cf9] 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa7bce27c02] 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa7bceacc40] 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 0> 2024-07-26T08:46:02.592+0000 7fa7b7a05640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: in thread 7fa7b7a05640 thread_name:ms_dispatch 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bcddc6f0] 2024-07-26T08:46:02.824 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa7bce2994c] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 3: raise() 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 4: abort() 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa7bcdc671b] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 6: /lib64/libc.so.6(+0x37386) [0x7fa7bcdd5386] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c00cdad6b9] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c00cf6b80c] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c00ceab2ca] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c00ce7b753] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c00ce7ca1b] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c00ce60752] 2024-07-26T08:46:02.825 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c00cdaea56] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c00cdb2637] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c00cdb2f5e] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c00cd9603a] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa7bd6a9407] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 18: (DispatchQueue::entry()+0x60f) [0x7fa7bd6a9cf9] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa7bd7865a1] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 20: (Thread::entry_wrapper()+0x43) [0x7fa7bd533cdd] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa7bd533cf9] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa7bce27c02] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa7bceacc40] 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.826 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 0> 2024-07-26T08:46:02.592+0000 7fa7b7a05640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: in thread 7fa7b7a05640 thread_name:ms_dispatch 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bcddc6f0] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa7bce2994c] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 3: raise() 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 4: abort() 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa7bcdc671b] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 6: /lib64/libc.so.6(+0x37386) [0x7fa7bcdd5386] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c00cdad6b9] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c00cf6b80c] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c00ceab2ca] 2024-07-26T08:46:02.827 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c00ce7b753] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c00ce7ca1b] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c00ce60752] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c00cdaea56] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c00cdb2637] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c00cdb2f5e] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c00cd9603a] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa7bd6a9407] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 18: (DispatchQueue::entry()+0x60f) [0x7fa7bd6a9cf9] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa7bd7865a1] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 20: (Thread::entry_wrapper()+0x43) [0x7fa7bd533cdd] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa7bd533cf9] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa7bce27c02] 2024-07-26T08:46:02.828 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa7bceacc40] 2024-07-26T08:46:02.829 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:02.829 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k[75614]: 2024-07-26T08:46:02.829 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:02 smithi063 podman[75781]: 2024-07-26 08:46:02.652691027 +0000 UTC m=+0.020259627 container died e8e210da17743e223ef2be2b296cf251b9149c2371b6871a0e3ba38d454cd13a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240724, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-07-26T08:46:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:02 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:rejoin 2024-07-26T08:46:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:02 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:02 smithi043 ceph-mon[32384]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:46:03.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:02 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:rejoin 2024-07-26T08:46:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:02 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=k=up:rejoin,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:02 smithi133 ceph-mon[37053]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-07-26T08:46:03.631 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:03 smithi063 podman[75781]: 2024-07-26 08:46:03.376568704 +0000 UTC m=+0.744137328 container remove e8e210da17743e223ef2be2b296cf251b9149c2371b6871a0e3ba38d454cd13a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_BRANCH=HEAD) 2024-07-26T08:46:03.632 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:03 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:46:03.632 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:03 smithi063 ceph-mon[36747]: pgmap v918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-07-26T08:46:03.632 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:03 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:03.632 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:03 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:active 2024-07-26T08:46:03.632 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:03 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:03.632 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:03 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:46:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:03 smithi043 ceph-mon[32384]: pgmap v918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-07-26T08:46:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:03 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:03 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:active 2024-07-26T08:46:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:03 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:03 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:46:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:03 smithi133 ceph-mon[37053]: pgmap v918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-07-26T08:46:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:03 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:03 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.63:6832/2807089237,v1:172.21.15.63:6833/2807089237] up:active 2024-07-26T08:46:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:03 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 2 up:standby-replay 2 up:standby 2024-07-26T08:46:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:03 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=k=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby 2024-07-26T08:46:04.067 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:03 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:46:04.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:03 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 2.051s CPU time. 2024-07-26T08:46:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:05 smithi043 ceph-mon[32384]: pgmap v919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 140 B/s wr, 8 op/s 2024-07-26T08:46:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 611.718239 secs 2024-07-26T08:46:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:05 smithi133 ceph-mon[37053]: pgmap v919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 140 B/s wr, 8 op/s 2024-07-26T08:46:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 611.718239 secs 2024-07-26T08:46:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:05 smithi063 ceph-mon[36747]: pgmap v919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 140 B/s wr, 8 op/s 2024-07-26T08:46:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 611.718239 secs 2024-07-26T08:46:06.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 627.204938 secs 2024-07-26T08:46:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 627.204938 secs 2024-07-26T08:46:07.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 627.204938 secs 2024-07-26T08:46:07.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:07 smithi043 ceph-mon[32384]: pgmap v920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 252 B/s wr, 9 op/s 2024-07-26T08:46:08.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:07 smithi133 ceph-mon[37053]: pgmap v920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 252 B/s wr, 9 op/s 2024-07-26T08:46:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:07 smithi063 ceph-mon[36747]: pgmap v920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 252 B/s wr, 9 op/s 2024-07-26T08:46:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:09 smithi043 ceph-mon[32384]: pgmap v921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:46:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:09 smithi133 ceph-mon[37053]: pgmap v921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:46:10.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:09 smithi063 ceph-mon[36747]: pgmap v921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:46:10.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 616.718305 secs 2024-07-26T08:46:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 616.718305 secs 2024-07-26T08:46:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 616.718305 secs 2024-07-26T08:46:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:11 smithi043 ceph-mon[32384]: pgmap v922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T08:46:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 632.205003 secs 2024-07-26T08:46:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:11 smithi133 ceph-mon[37053]: pgmap v922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T08:46:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 632.205003 secs 2024-07-26T08:46:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:11 smithi063 ceph-mon[36747]: pgmap v922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T08:46:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 632.205003 secs 2024-07-26T08:46:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:13 smithi043 ceph-mon[32384]: pgmap v923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:14.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:13 smithi133 ceph-mon[37053]: pgmap v923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:13 smithi063 ceph-mon[36747]: pgmap v923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:13 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:13 smithi063 systemd[1]: Stopped Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:13 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Consumed 2.051s CPU time. 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:13 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Start request repeated too quickly. 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:13 smithi063 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T08:46:14.068 INFO:journalctl@ceph.mds.k.smithi063.stdout:Jul 26 08:46:13 smithi063 systemd[1]: Failed to start Ceph mds.k for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:46:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:15 smithi043 ceph-mon[32384]: pgmap v924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 621.718442 secs 2024-07-26T08:46:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 637.205116 secs 2024-07-26T08:46:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:15 smithi133 ceph-mon[37053]: pgmap v924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 621.718442 secs 2024-07-26T08:46:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 637.205116 secs 2024-07-26T08:46:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:15 smithi063 ceph-mon[36747]: pgmap v924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 621.718442 secs 2024-07-26T08:46:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 637.205116 secs 2024-07-26T08:46:17.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:46:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:17 smithi043 ceph-mon[32384]: pgmap v925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:46:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:17 smithi133 ceph-mon[37053]: pgmap v925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:46:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:17 smithi063 ceph-mon[36747]: pgmap v925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T08:46:18.185 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:46:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:19 smithi043 ceph-mon[32384]: pgmap v926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7 op/s 2024-07-26T08:46:20.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:19 smithi133 ceph-mon[37053]: pgmap v926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7 op/s 2024-07-26T08:46:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:19 smithi063 ceph-mon[36747]: pgmap v926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7 op/s 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 626.718581 secs 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: Replacing daemon mds.k as rank 1 with standby daemon mds.g 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: osdmap e129: 12 total, 12 up, 12 in 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:20.689 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 642.205201 secs 2024-07-26T08:46:20.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 -- 172.21.15.43:0/3720015381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001074e0 msgr2=0x7f3d001079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 --2- 172.21.15.43:0/3720015381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001074e0 0x7f3d001079c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009ca0 tx=0x7f3cf802a8c0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 -- 172.21.15.43:0/3720015381 shutdown_connections 2024-07-26T08:46:20.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 --2- 172.21.15.43:0/3720015381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001074e0 0x7f3d001079c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 --2- 172.21.15.43:0/3720015381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d00106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 --2- 172.21.15.43:0/3720015381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001020a0 0x7f3d001024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 -- 172.21.15.43:0/3720015381 >> 172.21.15.43:0/3720015381 conn(0x7f3d000fdd90 msgr2=0x7f3d001001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:20.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 -- 172.21.15.43:0/3720015381 shutdown_connections 2024-07-26T08:46:20.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.801+0000 7f3d05800640 1 -- 172.21.15.43:0/3720015381 wait complete. 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.802+0000 7f3d05800640 1 Processor -- start 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.802+0000 7f3d05800640 1 -- start start 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d05800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001020a0 0x7f3d001a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d05800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d001a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d05800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001074e0 0x7f3d001a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d05800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00119ac0 con 0x7f3d001029f0 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d05800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00119940 con 0x7f3d001074e0 2024-07-26T08:46:20.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d05800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00119c40 con 0x7f3d001020a0 2024-07-26T08:46:20.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3cff400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d001a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3cff400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d001a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57090/0 (socket says 172.21.15.43:57090) 2024-07-26T08:46:20.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3cff400640 1 -- 172.21.15.43:0/2618482096 learned_addr learned my addr 172.21.15.43:0/2618482096 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:20.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3d04e00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001074e0 0x7f3d001a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.803+0000 7f3cffe00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001020a0 0x7f3d001a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3d04e00640 1 -- 172.21.15.43:0/2618482096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001020a0 msgr2=0x7f3d001a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3d04e00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001020a0 0x7f3d001a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3d04e00640 1 -- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 msgr2=0x7f3d001a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3d04e00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d001a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3d04e00640 1 -- 172.21.15.43:0/2618482096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d001a63a0 con 0x7f3d001074e0 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3cff400640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d001a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.804+0000 7f3cffe00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001020a0 0x7f3d001a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.805+0000 7f3d04e00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001074e0 0x7f3d001a5c70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802ade0 tx=0x7f3cf8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:20.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.805+0000 7f3cfcc00640 1 -- 172.21.15.43:0/2618482096 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8031650 con 0x7f3d001074e0 2024-07-26T08:46:20.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.805+0000 7f3cfcc00640 1 -- 172.21.15.43:0/2618482096 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cf80317f0 con 0x7f3d001074e0 2024-07-26T08:46:20.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.805+0000 7f3cfcc00640 1 -- 172.21.15.43:0/2618482096 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf802fa80 con 0x7f3d001074e0 2024-07-26T08:46:20.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.805+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d001a6630 con 0x7f3d001074e0 2024-07-26T08:46:20.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.805+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d001acdf0 con 0x7f3d001074e0 2024-07-26T08:46:20.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.809+0000 7f3d0da45740 1 Processor -- start 2024-07-26T08:46:20.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.809+0000 7f3cfcc00640 1 -- 172.21.15.43:0/2618482096 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3cf802fc20 con 0x7f3d001074e0 2024-07-26T08:46:20.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.809+0000 7f3d0da45740 1 -- start start 2024-07-26T08:46:20.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba27f9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba27fa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2434390 0x563ba27faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3d0da45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563ba2770b90 con 0x563ba2434390 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3d0da45740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563ba2760090 con 0x563ba242c1b0 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3d0da45740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563ba27640d0 con 0x563ba2455070 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3cff400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba27f9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3cff400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba27f9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:44408/0 (socket says 172.21.15.43:44408) 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3cff400640 1 -- 172.21.15.43:0/946677553 learned_addr learned my addr 172.21.15.43:0/946677553 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3cff400640 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2434390 0x563ba27faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.810+0000 7f3cffe00640 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba27fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cff400640 1 -- 172.21.15.43:0/946677553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 msgr2=0x563ba27fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cff400640 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba27fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cff400640 1 -- 172.21.15.43:0/946677553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2434390 msgr2=0x563ba27faa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cff400640 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2434390 0x563ba27faa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cff400640 1 -- 172.21.15.43:0/946677553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ba24c0650 con 0x563ba2455070 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cff400640 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba27f9fd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3cec005d00 tx=0x7f3cec005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=393586b56d688ef2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cf5600640 1 -- 172.21.15.43:0/946677553 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec012cf0 con 0x563ba2455070 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cfcc00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3ce40b3dc0 0x7f3ce40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cf5600640 1 -- 172.21.15.43:0/946677553 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cec010bd0 con 0x563ba2455070 2024-07-26T08:46:20.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.811+0000 7f3cf5600640 1 -- 172.21.15.43:0/946677553 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec003b20 con 0x563ba2455070 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3cfcc00640 1 -- 172.21.15.43:0/2618482096 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 12806+0+0 (secure 0 0 0) 0x7f3cf8106300 con 0x7f3d001074e0 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3cffe00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3ce40b3dc0 0x7f3ce40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 -- 172.21.15.43:0/946677553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 msgr2=0x563ba27f9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba27f9fd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3cec005d00 tx=0x7f3cec005c90 comp rx=0 tx=0).stop 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 -- 172.21.15.43:0/946677553 shutdown_connections 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2434390 0x563ba27faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba27fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 --2- 172.21.15.43:0/946677553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba27f9fd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.812+0000 7f3d0da45740 1 -- 172.21.15.43:0/946677553 >> 172.21.15.43:0/946677553 conn(0x563ba2449460 msgr2=0x563ba27f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.813+0000 7f3d0da45740 1 -- 172.21.15.43:0/946677553 shutdown_connections 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.813+0000 7f3cffe00640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3ce40b3dc0 0x7f3ce40b62d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x563ba27f8c50 tx=0x7f3cf0005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:20.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.813+0000 7f3d0da45740 1 -- 172.21.15.43:0/946677553 wait complete. 2024-07-26T08:46:20.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.813+0000 7f3d0da45740 1 -- start start 2024-07-26T08:46:20.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.813+0000 7f3d0da45740 1 Processor -- start 2024-07-26T08:46:20.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba2805610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2434390 0x563ba2805b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba28060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563ba25c3700 con 0x563ba242c1b0 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563ba26fc660 con 0x563ba2434390 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563ba28087b0 con 0x563ba2455070 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3d0da45740 10 client.0 _ll_register_callbacks cb 0x563ba270c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3cffe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba2805610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3cffe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba2805610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57104/0 (socket says 172.21.15.43:57104) 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.814+0000 7f3cffe00640 1 -- 172.21.15.43:0/1966533913 learned_addr learned my addr 172.21.15.43:0/1966533913 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cff400640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2434390 0x563ba2805b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3d04e00640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba28060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cffe00640 1 -- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 msgr2=0x563ba28060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cffe00640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba28060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cffe00640 1 -- 172.21.15.43:0/1966533913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2434390 msgr2=0x563ba2805b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cffe00640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2434390 0x563ba2805b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cffe00640 1 -- 172.21.15.43:0/1966533913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ba2713800 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cffe00640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba2805610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009f70 tx=0x7f3cf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7f9aa5e7081522 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.815+0000 7f3cea000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3cea000640 1 -- 172.21.15.43:0/1966533913 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000f8b0 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3cea000640 1 -- 172.21.15.43:0/1966533913 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 12806+0+0 (secure 0 0 0) 0x7f3cf000fa50 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cec010bd0 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3cea000640 1 -- 172.21.15.43:0/1966533913 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=281) ==== 24+0+0 (secure 0 0 0) 0x7f3cf000fc50 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3d0da45740 10 client.16068 fetch_fsmap learned FSMap version 281 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=281,monmap=4+}) -- 0x563ba28144e0 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.816+0000 7f3cea000640 1 -- 172.21.15.43:0/1966533913 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cec010bd0 con 0x563ba242c1b0 2024-07-26T08:46:20.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3cea000640 1 -- 172.21.15.43:0/1966533913 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 281) ==== 4728+0+0 (secure 0 0 0) 0x7f3cf0027070 con 0x563ba242c1b0 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3d0da45740 10 client.16068 fetch_fsmap finished waiting for FSMap version 281 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3d0da45740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3d0da45740 20 client.16068 populate_metadata read hostname 'smithi043' 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3d0da45740 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba24139f0 0x563ba2817ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3d0da45740 4 client.16068 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ba2772ae0 con 0x563ba24139f0 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.817+0000 7f3cff400640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba24139f0 0x563ba2817ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.818+0000 7f3cff400640 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba24139f0 0x563ba2817ef0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1566d4f7cef112b server_cookie=b7eaaf5241a5f9 in_seq=0 out_seq=0 2024-07-26T08:46:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.818+0000 7f3cea000640 10 client.16068 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:20.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3cea000640 1 -- 172.21.15.43:0/1966533913 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ba2772ae0 con 0x563ba24139f0 2024-07-26T08:46:20.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3cea000640 10 client.16068 handle_command_reply: tid=0 2024-07-26T08:46:20.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 client.16068 shutdown 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 msgr2=0x563ba2805610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba2805610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009f70 tx=0x7f3cf0004730 comp rx=0 tx=0).stop 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 shutdown_connections 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba24139f0 0x563ba2817ef0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2455070 0x563ba28060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2434390 0x563ba2805b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 --2- 172.21.15.43:0/1966533913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba2805610 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 >> 172.21.15.43:0/1966533913 conn(0x563ba2449460 msgr2=0x563ba27fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3cea000640 0 client.16068 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 shutdown_connections 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.819+0000 7f3d0da45740 1 -- 172.21.15.43:0/1966533913 wait complete. 2024-07-26T08:46:20.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.820+0000 7f3d0da45740 20 client.16068 trim_cache size 0 max 16384 2024-07-26T08:46:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 Processor -- start 2024-07-26T08:46:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 -- start start 2024-07-26T08:46:20.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba28074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba27f6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2455070 0x563ba27fb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001b9710 con 0x563ba242c1b0 2024-07-26T08:46:20.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001b7bd0 con 0x563ba2455070 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3d0da45740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001b9040 con 0x563ba2434390 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.839+0000 7f3cffe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba28074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba28074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57106/0 (socket says 172.21.15.43:57106) 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 -- 172.21.15.43:0/3019775432 learned_addr learned my addr 172.21.15.43:0/3019775432 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cff400640 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba27f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3d04e00640 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2455070 0x563ba27fb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 -- 172.21.15.43:0/3019775432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 msgr2=0x563ba27f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba27f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 -- 172.21.15.43:0/3019775432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2455070 msgr2=0x563ba27fb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2455070 0x563ba27fb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 -- 172.21.15.43:0/3019775432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ba27fc590 con 0x563ba242c1b0 2024-07-26T08:46:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3d04e00640 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2455070 0x563ba27fb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.840+0000 7f3cffe00640 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba28074f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00092e0 tx=0x7f3cf0004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24a9fd4795f591f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.841+0000 7f3cf4c00640 1 -- 172.21.15.43:0/3019775432 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000fab0 con 0x563ba242c1b0 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.841+0000 7f3cf4c00640 1 -- 172.21.15.43:0/3019775432 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cf0032030 con 0x563ba242c1b0 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.841+0000 7f3cf4c00640 1 -- 172.21.15.43:0/3019775432 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00316d0 con 0x563ba242c1b0 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.841+0000 7f3d0da45740 1 -- 172.21.15.43:0/3019775432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 msgr2=0x563ba28074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.841+0000 7f3d0da45740 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba28074f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00092e0 tx=0x7f3cf0004650 comp rx=0 tx=0).stop 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 -- 172.21.15.43:0/3019775432 shutdown_connections 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba27f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba2455070 0x563ba27fb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 --2- 172.21.15.43:0/3019775432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba242c1b0 0x563ba28074f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 -- 172.21.15.43:0/3019775432 >> 172.21.15.43:0/3019775432 conn(0x563ba2449460 msgr2=0x563ba27fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 -- 172.21.15.43:0/3019775432 shutdown_connections 2024-07-26T08:46:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 -- 172.21.15.43:0/3019775432 wait complete. 2024-07-26T08:46:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 -- start start 2024-07-26T08:46:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.842+0000 7f3d0da45740 1 Processor -- start 2024-07-26T08:46:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba280b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba280b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 0x563ba2877640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001b8970 con 0x563ba2455070 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001b82a0 con 0x563ba242c1b0 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001b6b10 con 0x563ba2434390 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d0da45740 10 client.0 _ll_register_callbacks cb 0x7f3cf00045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.843+0000 7f3d04e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 0x563ba2877640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 0x563ba2877640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57110/0 (socket says 172.21.15.43:57110) 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 -- 172.21.15.43:0/350728097 learned_addr learned my addr 172.21.15.43:0/350728097 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3cff400640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba280b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3cffe00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba280b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 -- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 msgr2=0x563ba280b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba280b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 -- 172.21.15.43:0/350728097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 msgr2=0x563ba280b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba280b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 -- 172.21.15.43:0/350728097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ba27fce30 con 0x563ba2455070 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3cffe00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba280b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3d04e00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 0x563ba2877640 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80cbe90 tx=0x7f3cf80c7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54aab19152362601 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.844+0000 7f3cea000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3cea000640 1 -- 172.21.15.43:0/350728097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80cb670 con 0x563ba2455070 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3cea000640 1 -- 172.21.15.43:0/350728097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 12806+0+0 (secure 0 0 0) 0x7f3cf80cc370 con 0x563ba2455070 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf0032030 con 0x563ba2455070 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3cea000640 1 -- 172.21.15.43:0/350728097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=281) ==== 24+0+0 (secure 0 0 0) 0x7f3cf80cba10 con 0x563ba2455070 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3d0da45740 10 client.16074 fetch_fsmap learned FSMap version 281 2024-07-26T08:46:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=281,monmap=4+}) -- 0x563ba287ff90 con 0x563ba2455070 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3cea000640 1 -- 172.21.15.43:0/350728097 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cf0032030 con 0x563ba2455070 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.845+0000 7f3cea000640 1 -- 172.21.15.43:0/350728097 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 281) ==== 4728+0+0 (secure 0 0 0) 0x7f3cf8004b40 con 0x563ba2455070 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3d0da45740 10 client.16074 fetch_fsmap finished waiting for FSMap version 281 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3d0da45740 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3d0da45740 20 client.16074 populate_metadata read hostname 'smithi043' 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3d0da45740 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba23e8da0 0x563ba2882780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3d0da45740 4 client.16074 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ba276e580 con 0x563ba23e8da0 2024-07-26T08:46:20.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.846+0000 7f3cffe00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba23e8da0 0x563ba2882780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:20.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3cffe00640 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba23e8da0 0x563ba2882780 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62fb2c9da4712bcd server_cookie=e0221db4bf13abb7 in_seq=0 out_seq=0 2024-07-26T08:46:20.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3cea000640 10 client.16074 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3cea000640 1 -- 172.21.15.43:0/350728097 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x563ba276e580 con 0x563ba23e8da0 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3cea000640 10 client.16074 handle_command_reply: tid=0 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 client.16074 shutdown 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 msgr2=0x563ba2877640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 0x563ba2877640 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80cbe90 tx=0x7f3cf80c7e30 comp rx=0 tx=0).stop 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 shutdown_connections 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x563ba23e8da0 0x563ba2882780 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ba2434390 0x563ba280b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ba2455070 0x563ba2877640 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 --2- 172.21.15.43:0/350728097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ba242c1b0 0x563ba280b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3cea000640 0 client.16074 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.847+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 >> 172.21.15.43:0/350728097 conn(0x563ba2449460 msgr2=0x563ba2807250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 shutdown_connections 2024-07-26T08:46:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d0da45740 1 -- 172.21.15.43:0/350728097 wait complete. 2024-07-26T08:46:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d0da45740 20 client.16074 trim_cache size 0 max 16384 2024-07-26T08:46:20.853 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:46:20.853 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:46:20.853 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:46:20.854 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3ce40b3dc0 msgr2=0x7f3ce40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d05800640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3ce40b3dc0 0x7f3ce40b62d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x563ba27f8c50 tx=0x7f3cf0005f90 comp rx=0 tx=0).stop 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001074e0 msgr2=0x7f3d001a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.848+0000 7f3d05800640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001074e0 0x7f3d001a5c70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802ade0 tx=0x7f3cf8003ce0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 shutdown_connections 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f3ce40b3dc0 0x7f3ce40b62d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d001074e0 0x7f3d001a5c70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d001029f0 0x7f3d001a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 --2- 172.21.15.43:0/2618482096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d001020a0 0x7f3d001a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 >> 172.21.15.43:0/2618482096 conn(0x7f3d000fdd90 msgr2=0x7f3d00104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 shutdown_connections 2024-07-26T08:46:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:20.849+0000 7f3d05800640 1 -- 172.21.15.43:0/2618482096 wait complete. 2024-07-26T08:46:20.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 626.718581 secs 2024-07-26T08:46:20.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: Replacing daemon mds.k as rank 1 with standby daemon mds.g 2024-07-26T08:46:20.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T08:46:20.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:20.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: osdmap e129: 12 total, 12 up, 12 in 2024-07-26T08:46:20.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:20.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 642.205201 secs 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 626.718581 secs 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: Replacing daemon mds.k as rank 1 with standby daemon mds.g 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: osdmap e129: 12 total, 12 up, 12 in 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 642.205201 secs 2024-07-26T08:46:21.737 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:46:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:21 smithi043 ceph-mon[32384]: pgmap v928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:21 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:resolve 2024-07-26T08:46:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:21 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:21.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:21 smithi063 ceph-mon[36747]: pgmap v928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:21.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:21 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:resolve 2024-07-26T08:46:21.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:21 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:21 smithi133 ceph-mon[37053]: pgmap v928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:21 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:resolve 2024-07-26T08:46:22.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:21 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:23 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:reconnect 2024-07-26T08:46:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:23 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:23 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:46:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:23 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0109999 2024-07-26T08:46:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:23 smithi043 ceph-mon[32384]: pgmap v929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:46:23.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:23 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:reconnect 2024-07-26T08:46:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:23 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:23 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:46:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:23 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0109999 2024-07-26T08:46:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:23 smithi133 ceph-mon[37053]: pgmap v929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:46:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:23 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:reconnect 2024-07-26T08:46:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:23 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:23 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:46:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:23 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0109999 2024-07-26T08:46:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:23 smithi063 ceph-mon[36747]: pgmap v929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-07-26T08:46:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:rejoin 2024-07-26T08:46:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-mon[32384]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:46:24.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:46:24.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: *** Caught signal (Aborted) ** 2024-07-26T08:46:24.484 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: in thread 7f6a84c00640 thread_name:ms_dispatch 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6a8ae3e6f0] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6a8ae8b94c] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 3: raise() 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 4: abort() 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6a8ae2871b] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 6: /lib64/libc.so.6(+0x37386) [0x7f6a8ae37386] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556ca058b6b9] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556ca074980c] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556ca06892ca] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556ca0659753] 2024-07-26T08:46:24.485 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556ca065aa1b] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556ca063e752] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556ca058ca56] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556ca0590637] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556ca0590f5e] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556ca057403a] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6a8b99b407] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 18: (DispatchQueue::entry()+0x60f) [0x7f6a8b99bcf9] 2024-07-26T08:46:24.486 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6a8ba785a1] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 20: (Thread::entry_wrapper()+0x43) [0x7f6a8b825cdd] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6a8b825cf9] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6a8ae89c02] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6a8af0ec40] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.208+0000 7f6a84c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: in thread 7f6a84c00640 thread_name:ms_dispatch 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6a8ae3e6f0] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6a8ae8b94c] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 3: raise() 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 4: abort() 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6a8ae2871b] 2024-07-26T08:46:24.487 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 6: /lib64/libc.so.6(+0x37386) [0x7f6a8ae37386] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556ca058b6b9] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556ca074980c] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556ca06892ca] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556ca0659753] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556ca065aa1b] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556ca063e752] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556ca058ca56] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556ca0590637] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556ca0590f5e] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556ca057403a] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6a8b99b407] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 18: (DispatchQueue::entry()+0x60f) [0x7f6a8b99bcf9] 2024-07-26T08:46:24.488 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6a8ba785a1] 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 20: (Thread::entry_wrapper()+0x43) [0x7f6a8b825cdd] 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6a8b825cf9] 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6a8ae89c02] 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6a8af0ec40] 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 0> 2024-07-26T08:46:24.208+0000 7f6a84c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: in thread 7f6a84c00640 thread_name:ms_dispatch 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:24.489 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6a8ae3e6f0] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6a8ae8b94c] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 3: raise() 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 4: abort() 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6a8ae2871b] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 6: /lib64/libc.so.6(+0x37386) [0x7f6a8ae37386] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556ca058b6b9] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556ca074980c] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556ca06892ca] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556ca0659753] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556ca065aa1b] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556ca063e752] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556ca058ca56] 2024-07-26T08:46:24.490 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556ca0590637] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556ca0590f5e] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556ca057403a] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6a8b99b407] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 18: (DispatchQueue::entry()+0x60f) [0x7f6a8b99bcf9] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6a8ba785a1] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 20: (Thread::entry_wrapper()+0x43) [0x7f6a8b825cdd] 2024-07-26T08:46:24.491 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6a8b825cf9] 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6a8ae89c02] 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6a8af0ec40] 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: -3> 2024-07-26T08:46:24.208+0000 7f6a84c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: in thread 7f6a84c00640 thread_name:ms_dispatch 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6a8ae3e6f0] 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6a8ae8b94c] 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 3: raise() 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 4: abort() 2024-07-26T08:46:24.492 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6a8ae2871b] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 6: /lib64/libc.so.6(+0x37386) [0x7f6a8ae37386] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556ca058b6b9] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556ca074980c] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556ca06892ca] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556ca0659753] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556ca065aa1b] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556ca063e752] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556ca058ca56] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556ca0590637] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556ca0590f5e] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556ca057403a] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6a8b99b407] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 18: (DispatchQueue::entry()+0x60f) [0x7f6a8b99bcf9] 2024-07-26T08:46:24.493 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6a8ba785a1] 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 20: (Thread::entry_wrapper()+0x43) [0x7f6a8b825cdd] 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6a8b825cf9] 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6a8ae89c02] 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6a8af0ec40] 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108463]: 2024-07-26T08:46:24.494 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:24 smithi043 podman[108825]: 2024-07-26 08:46:24.401402841 +0000 UTC m=+0.039348568 container died d82e4daa11145ba581c3eb54ba9c9637f445cdd7008030996d4627596962765f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:46:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:24 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:rejoin 2024-07-26T08:46:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:24 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:24.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:24 smithi133 ceph-mon[37053]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:46:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:24 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:rejoin 2024-07-26T08:46:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:24 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:24 smithi063 ceph-mon[36747]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:46:25.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:25 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:25 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:active 2024-07-26T08:46:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:25 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:25 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:25 smithi043 ceph-mon[32384]: pgmap v930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:46:25.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:25 smithi043 podman[108825]: 2024-07-26 08:46:25.173294087 +0000 UTC m=+0.811239852 container remove d82e4daa11145ba581c3eb54ba9c9637f445cdd7008030996d4627596962765f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:46:25.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:46:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:25 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:25 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:active 2024-07-26T08:46:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:25 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:25 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:25 smithi133 ceph-mon[37053]: pgmap v930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:46:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:25 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:25 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/1364452024,v1:172.21.15.43:6837/1364452024] up:active 2024-07-26T08:46:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:25 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:25 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:25 smithi063 ceph-mon[36747]: pgmap v930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:46:25.982 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:46:25.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.218s CPU time. 2024-07-26T08:46:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 631.718720 secs 2024-07-26T08:46:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 647.205328 secs 2024-07-26T08:46:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 631.718720 secs 2024-07-26T08:46:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 647.205328 secs 2024-07-26T08:46:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 631.718720 secs 2024-07-26T08:46:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 647.205328 secs 2024-07-26T08:46:27.407 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:27 smithi043 ceph-mon[32384]: pgmap v931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:46:27.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:27 smithi133 ceph-mon[37053]: pgmap v931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:46:27.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:27 smithi063 ceph-mon[36747]: pgmap v931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:46:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:29 smithi043 ceph-mon[32384]: pgmap v932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:46:29.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:29 smithi133 ceph-mon[37053]: pgmap v932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:46:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:29 smithi063 ceph-mon[36747]: pgmap v932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:46:30.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 636.718835 secs 2024-07-26T08:46:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 636.718835 secs 2024-07-26T08:46:30.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 636.718835 secs 2024-07-26T08:46:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:31 smithi043 ceph-mon[32384]: pgmap v933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 199 B/s wr, 10 op/s 2024-07-26T08:46:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 652.205424 secs 2024-07-26T08:46:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:31 smithi133 ceph-mon[37053]: pgmap v933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 199 B/s wr, 10 op/s 2024-07-26T08:46:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 652.205424 secs 2024-07-26T08:46:31.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:31 smithi063 ceph-mon[36747]: pgmap v933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 199 B/s wr, 10 op/s 2024-07-26T08:46:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 652.205424 secs 2024-07-26T08:46:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:33 smithi063 ceph-mon[36747]: pgmap v934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:33 smithi043 ceph-mon[32384]: pgmap v934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:33.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:33 smithi133 ceph-mon[37053]: pgmap v934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:35.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:35 smithi043 ceph-mon[32384]: pgmap v935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:35.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 641.718970 secs 2024-07-26T08:46:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:35 smithi133 ceph-mon[37053]: pgmap v935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 641.718970 secs 2024-07-26T08:46:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:35 smithi063 ceph-mon[36747]: pgmap v935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:46:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 641.718970 secs 2024-07-26T08:46:36.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:35 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:46:36.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:35 smithi043 systemd[1]: Stopped Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:46:36.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:35 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.218s CPU time. 2024-07-26T08:46:36.149 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:35 smithi043 systemd[1]: Starting Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:46:36.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 podman[108928]: 2024-07-26 08:46:36.052154466 +0000 UTC m=+0.034311033 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:46:36.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 podman[108928]: 2024-07-26 08:46:36.178982414 +0000 UTC m=+0.161139016 container create d223b302bde444bcceb5d7b9b1ab7fcfe4ef64d5789912f9580dd3ea52fdc73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-07-26T08:46:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 657.205567 secs 2024-07-26T08:46:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 657.205567 secs 2024-07-26T08:46:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 657.205567 secs 2024-07-26T08:46:36.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 podman[108928]: 2024-07-26 08:46:36.546463118 +0000 UTC m=+0.528619757 container init d223b302bde444bcceb5d7b9b1ab7fcfe4ef64d5789912f9580dd3ea52fdc73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS) 2024-07-26T08:46:36.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 podman[108928]: 2024-07-26 08:46:36.556583732 +0000 UTC m=+0.538740307 container start d223b302bde444bcceb5d7b9b1ab7fcfe4ef64d5789912f9580dd3ea52fdc73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux ) 2024-07-26T08:46:36.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 bash[108928]: d223b302bde444bcceb5d7b9b1ab7fcfe4ef64d5789912f9580dd3ea52fdc73e 2024-07-26T08:46:36.983 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 systemd[1]: Started Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:46:36.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 ceph-mds[108947]: -- 172.21.15.43:0/951785389 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561671f07860 con 0x5616760a9600 2024-07-26T08:46:36.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:36 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: starting mds.g at 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: pgmap v936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: daemon mds.g restarted 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: osdmap e130: 12 total, 12 up, 12 in 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:boot 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:37 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: pgmap v936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: daemon mds.g restarted 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: osdmap e130: 12 total, 12 up, 12 in 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:boot 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:37 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: pgmap v936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: daemon mds.g restarted 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: osdmap e130: 12 total, 12 up, 12 in 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:boot 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:46:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:46:37.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:46:37.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:37 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:38 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:resolve 2024-07-26T08:46:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:38 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:38 smithi043 ceph-mon[32384]: pgmap v938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:46:39.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:38 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:resolve 2024-07-26T08:46:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:38 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:38 smithi133 ceph-mon[37053]: pgmap v938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:46:39.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:38 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:resolve 2024-07-26T08:46:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:38 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:38 smithi063 ceph-mon[36747]: pgmap v938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:46:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:39 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00499994 2024-07-26T08:46:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:39 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:reconnect 2024-07-26T08:46:39.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:39 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:39.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:39 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:46:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:39 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00499994 2024-07-26T08:46:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:39 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:reconnect 2024-07-26T08:46:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:39 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:39 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:46:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:39 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00499994 2024-07-26T08:46:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:39 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:reconnect 2024-07-26T08:46:40.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:39 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:40.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:39 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: *** Caught signal (Aborted) ** 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: in thread 7fd291c00640 thread_name:ms_dispatch 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd297e3e6f0] 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd297e8b94c] 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 3: raise() 2024-07-26T08:46:40.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 4: abort() 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd297e2871b] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 6: /lib64/libc.so.6(+0x37386) [0x7fd297e37386] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558dcaf6e6b9] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558dcb12c80c] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558dcb06c2ca] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558dcb03c753] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558dcb03da1b] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558dcb021752] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558dcaf6fa56] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558dcaf73637] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558dcaf73f5e] 2024-07-26T08:46:40.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558dcaf5703a] 2024-07-26T08:46:40.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd29899b407] 2024-07-26T08:46:40.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 18: (DispatchQueue::entry()+0x60f) [0x7fd29899bcf9] 2024-07-26T08:46:40.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd298a785a1] 2024-07-26T08:46:40.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 20: (Thread::entry_wrapper()+0x43) [0x7fd298825cdd] 2024-07-26T08:46:40.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd298825cf9] 2024-07-26T08:46:40.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd297e89c02] 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd297f0ec40] 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.173+0000 7fd291c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: in thread 7fd291c00640 thread_name:ms_dispatch 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd297e3e6f0] 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd297e8b94c] 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 3: raise() 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 4: abort() 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd297e2871b] 2024-07-26T08:46:40.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 6: /lib64/libc.so.6(+0x37386) [0x7fd297e37386] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558dcaf6e6b9] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558dcb12c80c] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558dcb06c2ca] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558dcb03c753] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558dcb03da1b] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558dcb021752] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558dcaf6fa56] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558dcaf73637] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558dcaf73f5e] 2024-07-26T08:46:40.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558dcaf5703a] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd29899b407] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 18: (DispatchQueue::entry()+0x60f) [0x7fd29899bcf9] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd298a785a1] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 20: (Thread::entry_wrapper()+0x43) [0x7fd298825cdd] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd298825cf9] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd297e89c02] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd297f0ec40] 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 0> 2024-07-26T08:46:40.173+0000 7fd291c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: in thread 7fd291c00640 thread_name:ms_dispatch 2024-07-26T08:46:40.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd297e3e6f0] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd297e8b94c] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 3: raise() 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 4: abort() 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd297e2871b] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 6: /lib64/libc.so.6(+0x37386) [0x7fd297e37386] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558dcaf6e6b9] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558dcb12c80c] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558dcb06c2ca] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558dcb03c753] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558dcb03da1b] 2024-07-26T08:46:40.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558dcb021752] 2024-07-26T08:46:40.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558dcaf6fa56] 2024-07-26T08:46:40.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558dcaf73637] 2024-07-26T08:46:40.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558dcaf73f5e] 2024-07-26T08:46:40.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558dcaf5703a] 2024-07-26T08:46:40.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd29899b407] 2024-07-26T08:46:40.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 18: (DispatchQueue::entry()+0x60f) [0x7fd29899bcf9] 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd298a785a1] 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 20: (Thread::entry_wrapper()+0x43) [0x7fd298825cdd] 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd298825cf9] 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd297e89c02] 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd297f0ec40] 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 0> 2024-07-26T08:46:40.173+0000 7fd291c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: in thread 7fd291c00640 thread_name:ms_dispatch 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:40.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd297e3e6f0] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd297e8b94c] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 3: raise() 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 4: abort() 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd297e2871b] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 6: /lib64/libc.so.6(+0x37386) [0x7fd297e37386] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558dcaf6e6b9] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558dcb12c80c] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558dcb06c2ca] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558dcb03c753] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558dcb03da1b] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558dcb021752] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558dcaf6fa56] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558dcaf73637] 2024-07-26T08:46:40.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558dcaf73f5e] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558dcaf5703a] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd29899b407] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 18: (DispatchQueue::entry()+0x60f) [0x7fd29899bcf9] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd298a785a1] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 20: (Thread::entry_wrapper()+0x43) [0x7fd298825cdd] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd298825cf9] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd297e89c02] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd297f0ec40] 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[77251]: 2024-07-26T08:46:40.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:40 smithi043 podman[108981]: 2024-07-26 08:46:40.326819828 +0000 UTC m=+0.045291515 container died 5e3c181654526cee0fe6e2749c1e259a682d8c0a6bfd74917b4c41b2cefeb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:rejoin 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 646.719129 secs 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:active 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: pgmap v939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:46:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 662.205707 secs 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:46:40.796+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:rejoin 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 646.719129 secs 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:active 2024-07-26T08:46:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:41.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: pgmap v939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:46:41.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 662.205707 secs 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:rejoin 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 646.719129 secs 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3989413214,v1:172.21.15.43:6835/3989413214] up:active 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: pgmap v939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:46:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 662.205707 secs 2024-07-26T08:46:41.483 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:41 smithi043 podman[108981]: 2024-07-26 08:46:41.193086359 +0000 UTC m=+0.911558067 container remove 5e3c181654526cee0fe6e2749c1e259a682d8c0a6bfd74917b4c41b2cefeb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-07-26T08:46:41.483 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:41 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:46:42.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:41 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:46:42.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:41 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 4.048s CPU time. 2024-07-26T08:46:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:43 smithi043 ceph-mon[32384]: pgmap v940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:46:43.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:43 smithi133 ceph-mon[37053]: pgmap v940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:46:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:43 smithi063 ceph-mon[36747]: pgmap v940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:46:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:45 smithi043 ceph-mon[32384]: pgmap v941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:46:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 651.719242 secs 2024-07-26T08:46:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:45 smithi133 ceph-mon[37053]: pgmap v941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:46:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 651.719242 secs 2024-07-26T08:46:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:45 smithi063 ceph-mon[36747]: pgmap v941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:46:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 651.719242 secs 2024-07-26T08:46:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 667.205824 secs 2024-07-26T08:46:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 667.205824 secs 2024-07-26T08:46:46.907 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 667.205824 secs 2024-07-26T08:46:47.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:47 smithi133 ceph-mon[37053]: pgmap v942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:46:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:47 smithi063 ceph-mon[36747]: pgmap v942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:46:47.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:47 smithi043 ceph-mon[32384]: pgmap v942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:46:49.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:49 smithi133 ceph-mon[37053]: pgmap v943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 174 B/s wr, 10 op/s 2024-07-26T08:46:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:49 smithi063 ceph-mon[36747]: pgmap v943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 174 B/s wr, 10 op/s 2024-07-26T08:46:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:49 smithi043 ceph-mon[32384]: pgmap v943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 174 B/s wr, 10 op/s 2024-07-26T08:46:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 656.719355 secs 2024-07-26T08:46:50.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 656.719355 secs 2024-07-26T08:46:50.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 656.719355 secs 2024-07-26T08:46:51.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:46:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:51 smithi133 ceph-mon[37053]: pgmap v944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 672.205939 secs 2024-07-26T08:46:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:51 smithi063 ceph-mon[36747]: pgmap v944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 672.205939 secs 2024-07-26T08:46:51.826 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:51 smithi043 ceph-mon[32384]: pgmap v944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:51.826 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 672.205939 secs 2024-07-26T08:46:52.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:51 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 1. 2024-07-26T08:46:52.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:51 smithi043 systemd[1]: Stopped Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:46:52.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:51 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 4.048s CPU time. 2024-07-26T08:46:52.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:51 smithi043 systemd[1]: Starting Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:46:52.634 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 podman[109103]: 2024-07-26 08:46:52.158800535 +0000 UTC m=+0.042138447 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:46:52.634 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 podman[109103]: 2024-07-26 08:46:52.336189075 +0000 UTC m=+0.219527023 container create d524a264b82a4513d6dafd7219f1b63fafe202fe70882a857ba296a4d5fa74cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:46:52.879 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:46:53.031 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 podman[109103]: 2024-07-26 08:46:52.740715675 +0000 UTC m=+0.624053625 container init d524a264b82a4513d6dafd7219f1b63fafe202fe70882a857ba296a4d5fa74cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-07-26T08:46:53.031 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 podman[109103]: 2024-07-26 08:46:52.751727425 +0000 UTC m=+0.635065332 container start d524a264b82a4513d6dafd7219f1b63fafe202fe70882a857ba296a4d5fa74cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T08:46:53.031 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 bash[109103]: d524a264b82a4513d6dafd7219f1b63fafe202fe70882a857ba296a4d5fa74cf 2024-07-26T08:46:53.031 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 systemd[1]: Started Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:46:53.032 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 ceph-mds[109147]: -- 172.21.15.43:0/2665229556 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f8bb8b860 con 0x563f8fd2da80 2024-07-26T08:46:53.032 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:46:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: starting mds.j at 2024-07-26T08:46:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: pgmap v945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: daemon mds.j restarted 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: osdmap e131: 12 total, 12 up, 12 in 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:boot 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:46:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:53 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: pgmap v945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: daemon mds.j restarted 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: osdmap e131: 12 total, 12 up, 12 in 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:boot 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:53 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: pgmap v945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: daemon mds.j restarted 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: osdmap e131: 12 total, 12 up, 12 in 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:boot 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:46:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:53 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:55.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.595+0000 7f4469a00640 1 -- 172.21.15.43:0/3945257785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4464108d00 msgr2=0x7f4464109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.595+0000 7f4469a00640 1 --2- 172.21.15.43:0/3945257785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4464108d00 0x7f4464109110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f444c009900 tx=0x7f444c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 -- 172.21.15.43:0/3945257785 shutdown_connections 2024-07-26T08:46:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 --2- 172.21.15.43:0/3945257785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 0x7f446410fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 --2- 172.21.15.43:0/3945257785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4464108d00 0x7f4464109110 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 --2- 172.21.15.43:0/3945257785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44641033c0 0x7f44641037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 -- 172.21.15.43:0/3945257785 >> 172.21.15.43:0/3945257785 conn(0x7f44640fee10 msgr2=0x7f4464101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 -- 172.21.15.43:0/3945257785 shutdown_connections 2024-07-26T08:46:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.596+0000 7f4469a00640 1 -- 172.21.15.43:0/3945257785 wait complete. 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.597+0000 7f4469a00640 1 Processor -- start 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 -- start start 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 0x7f446419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464108d00 0x7f446419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 0x7f44641a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4464113480 con 0x7f44641033c0 2024-07-26T08:46:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4464113300 con 0x7f4464109650 2024-07-26T08:46:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4469a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4464113600 con 0x7f4464108d00 2024-07-26T08:46:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4463e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 0x7f446419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4463e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 0x7f446419c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59636/0 (socket says 172.21.15.43:59636) 2024-07-26T08:46:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.598+0000 7f4463e00640 1 -- 172.21.15.43:0/3858384842 learned_addr learned my addr 172.21.15.43:0/3858384842 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4469000640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 0x7f44641a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4463e00640 1 -- 172.21.15.43:0/3858384842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464108d00 msgr2=0x7f446419c5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4463e00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464108d00 0x7f446419c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4463e00640 1 -- 172.21.15.43:0/3858384842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 msgr2=0x7f44641a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4463e00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 0x7f44641a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4463e00640 1 -- 172.21.15.43:0/3858384842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44641a1f80 con 0x7f44641033c0 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4469000640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 0x7f44641a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.599+0000 7f4463e00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 0x7f446419c010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f445c00ebc0 tx=0x7f445c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.600+0000 7f4460c00640 1 -- 172.21.15.43:0/3858384842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c010630 con 0x7f44641033c0 2024-07-26T08:46:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.600+0000 7f4460c00640 1 -- 172.21.15.43:0/3858384842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f445c010ca0 con 0x7f44641033c0 2024-07-26T08:46:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.600+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44641a2270 con 0x7f44641033c0 2024-07-26T08:46:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.600+0000 7f4460c00640 1 -- 172.21.15.43:0/3858384842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c018ba0 con 0x7f44641033c0 2024-07-26T08:46:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.600+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44641a89d0 con 0x7f44641033c0 2024-07-26T08:46:55.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.604+0000 7f4471c4b740 1 Processor -- start 2024-07-26T08:46:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.604+0000 7f4471c4b740 1 -- start start 2024-07-26T08:46:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df58000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df58540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db92390 0x55957df58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4471c4b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55957decebc0 con 0x55957dbb3070 2024-07-26T08:46:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4471c4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55957debe0c0 con 0x55957db92390 2024-07-26T08:46:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4471c4b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55957dec2100 con 0x55957db8a1b0 2024-07-26T08:46:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4469000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df58000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4469000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df58000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59642/0 (socket says 172.21.15.43:59642) 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4469000640 1 -- 172.21.15.43:0/2276734782 learned_addr learned my addr 172.21.15.43:0/2276734782 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.605+0000 7f4463400640 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db92390 0x55957df58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4469000640 1 -- 172.21.15.43:0/2276734782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 msgr2=0x55957df58540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4469000640 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df58540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4469000640 1 -- 172.21.15.43:0/2276734782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db92390 msgr2=0x55957df58a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4469000640 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db92390 0x55957df58a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4469000640 1 -- 172.21.15.43:0/2276734782 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957dc1e650 con 0x55957dbb3070 2024-07-26T08:46:55.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4460c00640 1 -- 172.21.15.43:0/3858384842 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f445c018420 con 0x7f44641033c0 2024-07-26T08:46:55.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.606+0000 7f4469000640 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df58000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4454009cc0 tx=0x7f44540117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94f09f182f23f94 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:55.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.607+0000 7f4459600640 1 -- 172.21.15.43:0/2276734782 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454012450 con 0x55957dbb3070 2024-07-26T08:46:55.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.607+0000 7f4459600640 1 -- 172.21.15.43:0/2276734782 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4454012ac0 con 0x55957dbb3070 2024-07-26T08:46:55.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.607+0000 7f4459600640 1 -- 172.21.15.43:0/2276734782 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445400fc60 con 0x55957dbb3070 2024-07-26T08:46:55.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4460c00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44480b3d40 0x7f44480b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 -- 172.21.15.43:0/2276734782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 msgr2=0x55957df58000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df58000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4454009cc0 tx=0x7f44540117b0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4460c00640 1 -- 172.21.15.43:0/3858384842 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 12978+0+0 (secure 0 0 0) 0x7f445c0e5710 con 0x7f44641033c0 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 -- 172.21.15.43:0/2276734782 shutdown_connections 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df58540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db92390 0x55957df58a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 --2- 172.21.15.43:0/2276734782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df58000 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4471c4b740 1 -- 172.21.15.43:0/2276734782 >> 172.21.15.43:0/2276734782 conn(0x55957dba7460 msgr2=0x55957df55ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.608+0000 7f4463e00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44480b3d40 0x7f44480b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.609+0000 7f4471c4b740 1 -- 172.21.15.43:0/2276734782 shutdown_connections 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.609+0000 7f4471c4b740 1 -- 172.21.15.43:0/2276734782 wait complete. 2024-07-26T08:46:55.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.609+0000 7f4463e00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44480b3d40 0x7f44480b6250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55957df56c80 tx=0x7f445c018820 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.609+0000 7f4471c4b740 1 -- start start 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 Processor -- start 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df63580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df63ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957dbb3070 0x55957df64000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55957dd21700 con 0x55957db92390 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55957de5a690 con 0x55957db8a1b0 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55957df667e0 con 0x55957dbb3070 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.610+0000 7f4471c4b740 10 client.0 _ll_register_callbacks cb 0x55957de6a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df63ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4469000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df63580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df63ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59648/0 (socket says 172.21.15.43:59648) 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 -- 172.21.15.43:0/4235088591 learned_addr learned my addr 172.21.15.43:0/4235088591 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4469000640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957dbb3070 0x55957df64000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 -- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957dbb3070 msgr2=0x55957df64000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957dbb3070 0x55957df64000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 -- 172.21.15.43:0/4235088591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 msgr2=0x55957df63580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df63580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4463400640 1 -- 172.21.15.43:0/4235088591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957de71830 con 0x55957db92390 2024-07-26T08:46:55.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.611+0000 7f4469000640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df63580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:46:55.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.612+0000 7f4463400640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df63ac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f444c005ab0 tx=0x7f444c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a42bca79dd9edc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:55.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.612+0000 7f4452000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.612+0000 7f4452000640 1 -- 172.21.15.43:0/4235088591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c040070 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.612+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4454012ac0 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.612+0000 7f4452000640 1 -- 172.21.15.43:0/4235088591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 12978+0+0 (secure 0 0 0) 0x7f444c0037f0 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4452000640 1 -- 172.21.15.43:0/4235088591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=296) ==== 24+0+0 (secure 0 0 0) 0x7f444c035040 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 10 client.16098 fetch_fsmap learned FSMap version 296 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=296,monmap=4+}) -- 0x55957df72440 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4452000640 1 -- 172.21.15.43:0/4235088591 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4454012ac0 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4452000640 1 -- 172.21.15.43:0/4235088591 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 296) ==== 4728+0+0 (secure 0 0 0) 0x7f444c031be0 con 0x55957db92390 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 10 client.16098 fetch_fsmap finished waiting for FSMap version 296 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 20 client.16098 populate_metadata read hostname 'smithi043' 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db719f0 0x55957df75ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 4 client.16098 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:46:55.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.613+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55957ded0b10 con 0x55957db719f0 2024-07-26T08:46:55.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.625+0000 7f4469000640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db719f0 0x55957df75ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.668+0000 7f4469000640 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db719f0 0x55957df75ce0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d6d58ea161c2389 server_cookie=d0cd3cf3e187e133 in_seq=0 out_seq=0 2024-07-26T08:46:55.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.668+0000 7f4452000640 10 client.16098 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:55.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4452000640 1 -- 172.21.15.43:0/4235088591 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55957ded0b10 con 0x55957db719f0 2024-07-26T08:46:55.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4452000640 10 client.16098 handle_command_reply: tid=0 2024-07-26T08:46:55.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 client.16098 shutdown 2024-07-26T08:46:55.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 msgr2=0x55957df63ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df63ac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f444c005ab0 tx=0x7f444c004270 comp rx=0 tx=0).stop 2024-07-26T08:46:55.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 shutdown_connections 2024-07-26T08:46:55.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db719f0 0x55957df75ce0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957dbb3070 0x55957df64000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df63ac0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 --2- 172.21.15.43:0/4235088591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df63580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 >> 172.21.15.43:0/4235088591 conn(0x55957dba7460 msgr2=0x55957df5b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:55.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.669+0000 7f4452000640 0 client.16098 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:55.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.670+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 shutdown_connections 2024-07-26T08:46:55.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.670+0000 7f4471c4b740 1 -- 172.21.15.43:0/4235088591 wait complete. 2024-07-26T08:46:55.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.670+0000 7f4471c4b740 20 client.16098 trim_cache size 0 max 16384 2024-07-26T08:46:55.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 Processor -- start 2024-07-26T08:46:55.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 -- start start 2024-07-26T08:46:55.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df54ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db92390 0x55957df59740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df7b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4440012a10 con 0x55957dbb3070 2024-07-26T08:46:55.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4440010ed0 con 0x55957db8a1b0 2024-07-26T08:46:55.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.689+0000 7f4471c4b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4440012340 con 0x55957db92390 2024-07-26T08:46:55.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df54ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df54ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:43926/0 (socket says 172.21.15.43:43926) 2024-07-26T08:46:55.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 -- 172.21.15.43:0/200780215 learned_addr learned my addr 172.21.15.43:0/200780215 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:55.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df7b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 -- 172.21.15.43:0/200780215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db92390 msgr2=0x55957df59740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db92390 0x55957df59740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 -- 172.21.15.43:0/200780215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 msgr2=0x55957df7b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df7b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.690+0000 7f4469000640 1 -- 172.21.15.43:0/200780215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957df5a5e0 con 0x55957db8a1b0 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.691+0000 7f4469000640 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df54ef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f445400f730 tx=0x7f4454005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ede309abf19cf88 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.691+0000 7f4458c00640 1 -- 172.21.15.43:0/200780215 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445400fd20 con 0x55957db8a1b0 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.691+0000 7f4458c00640 1 -- 172.21.15.43:0/200780215 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4454009e30 con 0x55957db8a1b0 2024-07-26T08:46:55.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.691+0000 7f4458c00640 1 -- 172.21.15.43:0/200780215 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454012a20 con 0x55957db8a1b0 2024-07-26T08:46:55.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 -- 172.21.15.43:0/200780215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 msgr2=0x55957df54ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df54ef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f445400f730 tx=0x7f4454005f90 comp rx=0 tx=0).stop 2024-07-26T08:46:55.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 -- 172.21.15.43:0/200780215 shutdown_connections 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db92390 0x55957df59740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957dbb3070 0x55957df7b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 --2- 172.21.15.43:0/200780215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957db8a1b0 0x55957df54ef0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 -- 172.21.15.43:0/200780215 >> 172.21.15.43:0/200780215 conn(0x55957dba7460 msgr2=0x55957df59030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 -- 172.21.15.43:0/200780215 shutdown_connections 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.692+0000 7f4471c4b740 1 -- 172.21.15.43:0/200780215 wait complete. 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.693+0000 7f4471c4b740 1 -- start start 2024-07-26T08:46:55.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.693+0000 7f4471c4b740 1 Processor -- start 2024-07-26T08:46:55.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.693+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df6c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.693+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df688e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4471c4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957dbb3070 0x55957df68ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4471c4b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4440011c70 con 0x55957db92390 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4471c4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44400115a0 con 0x55957dbb3070 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4471c4b740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f444000fe10 con 0x55957db8a1b0 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4471c4b740 10 client.0 _ll_register_callbacks cb 0x7f444c005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df6c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4463400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df6c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35232/0 (socket says 172.21.15.43:35232) 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 -- 172.21.15.43:0/3198483242 learned_addr learned my addr 172.21.15.43:0/3198483242 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957dbb3070 0x55957df68ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 -- 172.21.15.43:0/3198483242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957dbb3070 msgr2=0x55957df68ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957dbb3070 0x55957df68ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 -- 172.21.15.43:0/3198483242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 msgr2=0x55957df688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:46:55.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4469000640 1 -- 172.21.15.43:0/3198483242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957dfdc4b0 con 0x55957db8a1b0 2024-07-26T08:46:55.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.694+0000 7f4463400640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:46:55.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.695+0000 7f4469000640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df6c3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4454009be0 tx=0x7f445400f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf8418f314f6f497 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.695+0000 7f4452000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.695+0000 7f4452000640 1 -- 172.21.15.43:0/3198483242 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44540129a0 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.695+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4454009e30 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.695+0000 7f4452000640 1 -- 172.21.15.43:0/3198483242 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 12978+0+0 (secure 0 0 0) 0x7f445400fb20 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4452000640 1 -- 172.21.15.43:0/3198483242 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=296) ==== 24+0+0 (secure 0 0 0) 0x7f445400fd20 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 10 client.26350 fetch_fsmap learned FSMap version 296 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=296,monmap=4+}) -- 0x55957dfdd640 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4452000640 1 -- 172.21.15.43:0/3198483242 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4454009e30 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4452000640 1 -- 172.21.15.43:0/3198483242 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 296) ==== 4728+0+0 (secure 0 0 0) 0x7f4454026040 con 0x55957db8a1b0 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 10 client.26350 fetch_fsmap finished waiting for FSMap version 296 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 10 client.26350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 20 client.26350 populate_metadata read hostname 'smithi043' 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db46da0 0x55957dfdfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:46:55.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 4 client.26350 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.696+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55957decc5b0 con 0x55957db46da0 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.697+0000 7f4463400640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db46da0 0x55957dfdfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.697+0000 7f4463400640 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db46da0 0x55957dfdfcc0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecd4191efe2de506 server_cookie=3db617c084cb21be in_seq=0 out_seq=0 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.697+0000 7f4452000640 10 client.26350 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4452000640 1 -- 172.21.15.43:0/3198483242 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55957decc5b0 con 0x55957db46da0 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4452000640 10 client.26350 handle_command_reply: tid=0 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 client.26350 shutdown 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 msgr2=0x55957df6c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df6c3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4454009be0 tx=0x7f445400f460 comp rx=0 tx=0).stop 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 shutdown_connections 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55957db46da0 0x55957dfdfcc0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55957dbb3070 0x55957df68ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55957db92390 0x55957df688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 --2- 172.21.15.43:0/3198483242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55957db8a1b0 0x55957df6c3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4452000640 0 client.26350 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:46:55.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 >> 172.21.15.43:0/3198483242 conn(0x55957dba7460 msgr2=0x55957df599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:55.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 shutdown_connections 2024-07-26T08:46:55.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 1 -- 172.21.15.43:0/3198483242 wait complete. 2024-07-26T08:46:55.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.698+0000 7f4471c4b740 20 client.26350 trim_cache size 0 max 16384 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:46:55.703 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44480b3d40 msgr2=0x7f44480b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44480b3d40 0x7f44480b6250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55957df56c80 tx=0x7f445c018820 comp rx=0 tx=0).stop 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 msgr2=0x7f446419c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 0x7f446419c010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f445c00ebc0 tx=0x7f445c00c6a0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 shutdown_connections 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f44480b3d40 0x7f44480b6250 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464108d00 0x7f446419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4464109650 0x7f44641a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 --2- 172.21.15.43:0/3858384842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44641033c0 0x7f446419c010 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:46:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.699+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 >> 172.21.15.43:0/3858384842 conn(0x7f44640fee10 msgr2=0x7f446410e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:46:55.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.700+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 shutdown_connections 2024-07-26T08:46:55.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:46:55.700+0000 7f4469a00640 1 -- 172.21.15.43:0/3858384842 wait complete. 2024-07-26T08:46:55.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:55 smithi043 ceph-mon[32384]: pgmap v947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:46:55.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:55 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:resolve 2024-07-26T08:46:55.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:55 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:55.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 661.719429 secs 2024-07-26T08:46:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:55 smithi063 ceph-mon[36747]: pgmap v947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:46:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:55 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:resolve 2024-07-26T08:46:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:55 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 661.719429 secs 2024-07-26T08:46:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:55 smithi133 ceph-mon[37053]: pgmap v947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-07-26T08:46:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:55 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:resolve 2024-07-26T08:46:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:55 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 661.719429 secs 2024-07-26T08:46:56.669 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:46:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 677.206012 secs 2024-07-26T08:46:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:56 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399995 2024-07-26T08:46:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:56 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:reconnect 2024-07-26T08:46:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:56 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:56 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 677.206012 secs 2024-07-26T08:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:56 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399995 2024-07-26T08:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:56 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:reconnect 2024-07-26T08:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:56 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:56 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:46:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 677.206012 secs 2024-07-26T08:46:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:56 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00399995 2024-07-26T08:46:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:56 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:reconnect 2024-07-26T08:46:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:56 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:56 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:46:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:57 smithi063 ceph-mon[36747]: pgmap v948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:57 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:rejoin 2024-07-26T08:46:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:57 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:57 smithi063 ceph-mon[36747]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:46:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-mon[32384]: pgmap v948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:rejoin 2024-07-26T08:46:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-mon[32384]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: *** Caught signal (Aborted) ** 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: in thread 7fc9ac200640 thread_name:ms_dispatch 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc9b243e6f0] 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc9b248b94c] 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 3: raise() 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 4: abort() 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc9b242871b] 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 6: /lib64/libc.so.6(+0x37386) [0x7fc9b2437386] 2024-07-26T08:46:57.984 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56165d3896b9] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56165d54780c] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56165d4872ca] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56165d457753] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56165d458a1b] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56165d43c752] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56165d38aa56] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56165d38e637] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56165d38ef5e] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56165d37203a] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc9b2f9b407] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 18: (DispatchQueue::entry()+0x60f) [0x7fc9b2f9bcf9] 2024-07-26T08:46:57.985 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc9b30785a1] 2024-07-26T08:46:57.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 20: (Thread::entry_wrapper()+0x43) [0x7fc9b2e25cdd] 2024-07-26T08:46:57.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc9b2e25cf9] 2024-07-26T08:46:57.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc9b2489c02] 2024-07-26T08:46:57.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc9b250ec40] 2024-07-26T08:46:57.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.583+0000 7fc9ac200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:57.986 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: in thread 7fc9ac200640 thread_name:ms_dispatch 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc9b243e6f0] 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc9b248b94c] 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 3: raise() 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 4: abort() 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc9b242871b] 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 6: /lib64/libc.so.6(+0x37386) [0x7fc9b2437386] 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56165d3896b9] 2024-07-26T08:46:57.987 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56165d54780c] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56165d4872ca] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56165d457753] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56165d458a1b] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56165d43c752] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56165d38aa56] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56165d38e637] 2024-07-26T08:46:57.988 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56165d38ef5e] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56165d37203a] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc9b2f9b407] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 18: (DispatchQueue::entry()+0x60f) [0x7fc9b2f9bcf9] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc9b30785a1] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 20: (Thread::entry_wrapper()+0x43) [0x7fc9b2e25cdd] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc9b2e25cf9] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc9b2489c02] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc9b250ec40] 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 0> 2024-07-26T08:46:57.583+0000 7fc9ac200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: in thread 7fc9ac200640 thread_name:ms_dispatch 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:57.989 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc9b243e6f0] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc9b248b94c] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 3: raise() 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 4: abort() 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc9b242871b] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 6: /lib64/libc.so.6(+0x37386) [0x7fc9b2437386] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56165d3896b9] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56165d54780c] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56165d4872ca] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56165d457753] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56165d458a1b] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56165d43c752] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56165d38aa56] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56165d38e637] 2024-07-26T08:46:57.990 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56165d38ef5e] 2024-07-26T08:46:57.991 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56165d37203a] 2024-07-26T08:46:57.991 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc9b2f9b407] 2024-07-26T08:46:57.991 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 18: (DispatchQueue::entry()+0x60f) [0x7fc9b2f9bcf9] 2024-07-26T08:46:57.991 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc9b30785a1] 2024-07-26T08:46:57.991 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 20: (Thread::entry_wrapper()+0x43) [0x7fc9b2e25cdd] 2024-07-26T08:46:57.991 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc9b2e25cf9] 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc9b2489c02] 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc9b250ec40] 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 0> 2024-07-26T08:46:57.583+0000 7fc9ac200640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: in thread 7fc9ac200640 thread_name:ms_dispatch 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc9b243e6f0] 2024-07-26T08:46:57.992 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc9b248b94c] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 3: raise() 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 4: abort() 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc9b242871b] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 6: /lib64/libc.so.6(+0x37386) [0x7fc9b2437386] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56165d3896b9] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56165d54780c] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56165d4872ca] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56165d457753] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56165d458a1b] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56165d43c752] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56165d38aa56] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56165d38e637] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56165d38ef5e] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56165d37203a] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc9b2f9b407] 2024-07-26T08:46:57.993 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 18: (DispatchQueue::entry()+0x60f) [0x7fc9b2f9bcf9] 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc9b30785a1] 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 20: (Thread::entry_wrapper()+0x43) [0x7fc9b2e25cdd] 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc9b2e25cf9] 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc9b2489c02] 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc9b250ec40] 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[108943]: 2024-07-26T08:46:57.994 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:57 smithi043 podman[109317]: 2024-07-26 08:46:57.714346226 +0000 UTC m=+0.031561743 container died d223b302bde444bcceb5d7b9b1ab7fcfe4ef64d5789912f9580dd3ea52fdc73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-07-26T08:46:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:57 smithi133 ceph-mon[37053]: pgmap v948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:46:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:57 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:rejoin 2024-07-26T08:46:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:57 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:57 smithi133 ceph-mon[37053]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:46:58.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:58 smithi043 podman[109317]: 2024-07-26 08:46:58.458158542 +0000 UTC m=+0.775374119 container remove d223b302bde444bcceb5d7b9b1ab7fcfe4ef64d5789912f9580dd3ea52fdc73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:46:58.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:58 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:46:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:58 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:58 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:active 2024-07-26T08:46:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:58 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:58 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:58 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:58 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:active 2024-07-26T08:46:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:58 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:58 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:58 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:46:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:58 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/10005976,v1:172.21.15.43:6837/10005976] up:active 2024-07-26T08:46:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:58 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:46:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:58 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:46:59.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:59 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:46:59.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:46:59 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.281s CPU time. 2024-07-26T08:46:59.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:46:59 smithi063 ceph-mon[36747]: pgmap v949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:46:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:46:59 smithi043 ceph-mon[32384]: pgmap v949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:47:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:46:59 smithi133 ceph-mon[37053]: pgmap v949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:47:00.916 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 666.719547 secs 2024-07-26T08:47:00.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 666.719547 secs 2024-07-26T08:47:01.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 666.719547 secs 2024-07-26T08:47:01.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: pgmap v950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 102 B/s wr, 9 op/s 2024-07-26T08:47:01.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 682.206092 secs 2024-07-26T08:47:01.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:47:01.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.638 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:01.638 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: pgmap v950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 102 B/s wr, 9 op/s 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 682.206092 secs 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: pgmap v950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 102 B/s wr, 9 op/s 2024-07-26T08:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 682.206092 secs 2024-07-26T08:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:47:03.931 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:03 smithi043 ceph-mon[32384]: pgmap v951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 220 B/s wr, 10 op/s 2024-07-26T08:47:03.931 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:03 smithi043 ceph-mon[32384]: pgmap v952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 232 B/s wr, 9 op/s 2024-07-26T08:47:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:03 smithi133 ceph-mon[37053]: pgmap v951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 220 B/s wr, 10 op/s 2024-07-26T08:47:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:03 smithi133 ceph-mon[37053]: pgmap v952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 232 B/s wr, 9 op/s 2024-07-26T08:47:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:03 smithi063 ceph-mon[36747]: pgmap v951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 220 B/s wr, 10 op/s 2024-07-26T08:47:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:03 smithi063 ceph-mon[36747]: pgmap v952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 232 B/s wr, 9 op/s 2024-07-26T08:47:05.915 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:05 smithi043 ceph-mon[32384]: pgmap v953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:47:05.915 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 671.719651 secs 2024-07-26T08:47:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:05 smithi133 ceph-mon[37053]: pgmap v953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:47:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 671.719651 secs 2024-07-26T08:47:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:05 smithi063 ceph-mon[36747]: pgmap v953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:47:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 671.719651 secs 2024-07-26T08:47:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 687.206158 secs 2024-07-26T08:47:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 687.206158 secs 2024-07-26T08:47:07.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 687.206158 secs 2024-07-26T08:47:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:07 smithi043 ceph-mon[32384]: pgmap v954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:47:08.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:07 smithi133 ceph-mon[37053]: pgmap v954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:47:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:07 smithi063 ceph-mon[36747]: pgmap v954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 220 B/s wr, 11 op/s 2024-07-26T08:47:09.618 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:47:09.618 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 systemd[1]: Stopped Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:47:09.618 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.281s CPU time. 2024-07-26T08:47:09.618 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 systemd[1]: Starting Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:47:09.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:09 smithi043 ceph-mon[32384]: pgmap v955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 110 B/s wr, 10 op/s 2024-07-26T08:47:09.884 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 podman[109537]: 2024-07-26 08:47:09.558995077 +0000 UTC m=+0.033008382 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:47:09.884 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 podman[109537]: 2024-07-26 08:47:09.706800682 +0000 UTC m=+0.180814010 container create 3e9cd34a974721b135c1678d864f099f8e8bf28cb8427787150eb21a760fe92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T08:47:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:09 smithi133 ceph-mon[37053]: pgmap v955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 110 B/s wr, 10 op/s 2024-07-26T08:47:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:09 smithi063 ceph-mon[36747]: pgmap v955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 110 B/s wr, 10 op/s 2024-07-26T08:47:10.155 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:09 smithi043 podman[109537]: 2024-07-26 08:47:09.997611899 +0000 UTC m=+0.471625277 container init 3e9cd34a974721b135c1678d864f099f8e8bf28cb8427787150eb21a760fe92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD) 2024-07-26T08:47:10.155 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:10 smithi043 podman[109537]: 2024-07-26 08:47:10.008643086 +0000 UTC m=+0.482656414 container start 3e9cd34a974721b135c1678d864f099f8e8bf28cb8427787150eb21a760fe92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T08:47:10.155 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mds[109556]: -- 172.21.15.43:0/3173839029 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55670e6bb860 con 0x55671285d600 2024-07-26T08:47:10.155 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: starting mds.g at 2024-07-26T08:47:10.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:10 smithi043 bash[109537]: 3e9cd34a974721b135c1678d864f099f8e8bf28cb8427787150eb21a760fe92a 2024-07-26T08:47:10.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:10 smithi043 systemd[1]: Started Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:47:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 676.719801 secs 2024-07-26T08:47:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: daemon mds.g restarted 2024-07-26T08:47:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:47:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: osdmap e132: 12 total, 12 up, 12 in 2024-07-26T08:47:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:boot 2024-07-26T08:47:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:47:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:47:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 692.206278 secs 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 676.719801 secs 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: daemon mds.g restarted 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: osdmap e132: 12 total, 12 up, 12 in 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:boot 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 692.206278 secs 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 676.719801 secs 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: daemon mds.g restarted 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: osdmap e132: 12 total, 12 up, 12 in 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:boot 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 692.206278 secs 2024-07-26T08:47:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:11 smithi043 ceph-mon[32384]: pgmap v956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 110 B/s wr, 8 op/s 2024-07-26T08:47:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:11 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:resolve 2024-07-26T08:47:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:11 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:11 smithi133 ceph-mon[37053]: pgmap v956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 110 B/s wr, 8 op/s 2024-07-26T08:47:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:11 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:resolve 2024-07-26T08:47:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:11 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:11 smithi063 ceph-mon[36747]: pgmap v956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 110 B/s wr, 8 op/s 2024-07-26T08:47:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:11 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:resolve 2024-07-26T08:47:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:11 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:13 smithi043 ceph-mon[32384]: pgmap v958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7 op/s 2024-07-26T08:47:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:13 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:reconnect 2024-07-26T08:47:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:13 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0 2024-07-26T08:47:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:13 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:13 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00299996 2024-07-26T08:47:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:13 smithi133 ceph-mon[37053]: pgmap v958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7 op/s 2024-07-26T08:47:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:13 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:reconnect 2024-07-26T08:47:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:13 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0 2024-07-26T08:47:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:13 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:13 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00299996 2024-07-26T08:47:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:13 smithi063 ceph-mon[36747]: pgmap v958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7 op/s 2024-07-26T08:47:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:13 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:reconnect 2024-07-26T08:47:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:13 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0 2024-07-26T08:47:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:13 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:13 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00299996 2024-07-26T08:47:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:rejoin 2024-07-26T08:47:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-mon[32384]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:47:14.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:47:14.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: *** Caught signal (Aborted) ** 2024-07-26T08:47:14.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: in thread 7fc68b800640 thread_name:ms_dispatch 2024-07-26T08:47:14.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:14.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc691a3e6f0] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc691a8b94c] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 3: raise() 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 4: abort() 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc691a2871b] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 6: /lib64/libc.so.6(+0x37386) [0x7fc691a37386] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563f5b26b6b9] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563f5b42980c] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563f5b3692ca] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563f5b339753] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563f5b33aa1b] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563f5b31e752] 2024-07-26T08:47:14.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563f5b26ca56] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563f5b270637] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563f5b270f5e] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563f5b25403a] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc69259b407] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 18: (DispatchQueue::entry()+0x60f) [0x7fc69259bcf9] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6926785a1] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 20: (Thread::entry_wrapper()+0x43) [0x7fc692425cdd] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc692425cf9] 2024-07-26T08:47:14.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc691a89c02] 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc691b0ec40] 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.220+0000 7fc68b800640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: in thread 7fc68b800640 thread_name:ms_dispatch 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc691a3e6f0] 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc691a8b94c] 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 3: raise() 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 4: abort() 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc691a2871b] 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 6: /lib64/libc.so.6(+0x37386) [0x7fc691a37386] 2024-07-26T08:47:14.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563f5b26b6b9] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563f5b42980c] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563f5b3692ca] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563f5b339753] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563f5b33aa1b] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563f5b31e752] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563f5b26ca56] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563f5b270637] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563f5b270f5e] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563f5b25403a] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc69259b407] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 18: (DispatchQueue::entry()+0x60f) [0x7fc69259bcf9] 2024-07-26T08:47:14.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6926785a1] 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 20: (Thread::entry_wrapper()+0x43) [0x7fc692425cdd] 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc692425cf9] 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc691a89c02] 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc691b0ec40] 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 0> 2024-07-26T08:47:14.220+0000 7fc68b800640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: in thread 7fc68b800640 thread_name:ms_dispatch 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:14.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc691a3e6f0] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc691a8b94c] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 3: raise() 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 4: abort() 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc691a2871b] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 6: /lib64/libc.so.6(+0x37386) [0x7fc691a37386] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563f5b26b6b9] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563f5b42980c] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563f5b3692ca] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563f5b339753] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563f5b33aa1b] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563f5b31e752] 2024-07-26T08:47:14.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563f5b26ca56] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563f5b270637] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563f5b270f5e] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563f5b25403a] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc69259b407] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 18: (DispatchQueue::entry()+0x60f) [0x7fc69259bcf9] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6926785a1] 2024-07-26T08:47:14.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 20: (Thread::entry_wrapper()+0x43) [0x7fc692425cdd] 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc692425cf9] 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc691a89c02] 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc691b0ec40] 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 0> 2024-07-26T08:47:14.220+0000 7fc68b800640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: in thread 7fc68b800640 thread_name:ms_dispatch 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc691a3e6f0] 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc691a8b94c] 2024-07-26T08:47:14.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 3: raise() 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 4: abort() 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc691a2871b] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 6: /lib64/libc.so.6(+0x37386) [0x7fc691a37386] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x563f5b26b6b9] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563f5b42980c] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563f5b3692ca] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563f5b339753] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563f5b33aa1b] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563f5b31e752] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x563f5b26ca56] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x563f5b270637] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563f5b270f5e] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563f5b25403a] 2024-07-26T08:47:14.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc69259b407] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 18: (DispatchQueue::entry()+0x60f) [0x7fc69259bcf9] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc6926785a1] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 20: (Thread::entry_wrapper()+0x43) [0x7fc692425cdd] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc692425cf9] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc691a89c02] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc691b0ec40] 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109143]: 2024-07-26T08:47:14.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:14 smithi043 podman[109590]: 2024-07-26 08:47:14.359070455 +0000 UTC m=+0.033210654 container died d524a264b82a4513d6dafd7219f1b63fafe202fe70882a857ba296a4d5fa74cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-07-26T08:47:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:14 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:rejoin 2024-07-26T08:47:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:14 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:14 smithi133 ceph-mon[37053]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:47:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:14 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:rejoin 2024-07-26T08:47:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:14 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:14 smithi063 ceph-mon[36747]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:15 smithi043 podman[109590]: 2024-07-26 08:47:15.328131383 +0000 UTC m=+1.002271624 container remove d524a264b82a4513d6dafd7219f1b63fafe202fe70882a857ba296a4d5fa74cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:15 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:15 smithi043 ceph-mon[32384]: pgmap v959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:15 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:15 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:active 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:15 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:15 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:47:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:15 smithi133 ceph-mon[37053]: pgmap v959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:47:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:15 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:15 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:active 2024-07-26T08:47:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:15 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:15 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:47:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:15 smithi063 ceph-mon[36747]: pgmap v959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:47:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:15 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:15 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/254024538,v1:172.21.15.43:6835/254024538] up:active 2024-07-26T08:47:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:15 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:15 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:47:16.196 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:15 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:47:16.196 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:15 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.313s CPU time. 2024-07-26T08:47:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 681.719941 secs 2024-07-26T08:47:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 697.206424 secs 2024-07-26T08:47:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 681.719941 secs 2024-07-26T08:47:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 697.206424 secs 2024-07-26T08:47:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 681.719941 secs 2024-07-26T08:47:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 697.206424 secs 2024-07-26T08:47:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:17 smithi043 ceph-mon[32384]: pgmap v960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:47:17.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:17 smithi133 ceph-mon[37053]: pgmap v960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:47:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:17 smithi063 ceph-mon[36747]: pgmap v960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:47:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:19 smithi043 ceph-mon[32384]: pgmap v961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:19.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:19 smithi133 ceph-mon[37053]: pgmap v961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:19.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:19 smithi063 ceph-mon[36747]: pgmap v961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:21 smithi043 ceph-mon[32384]: pgmap v962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 686.720077 secs 2024-07-26T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 702.206574 secs 2024-07-26T08:47:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:21 smithi133 ceph-mon[37053]: pgmap v962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 686.720077 secs 2024-07-26T08:47:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 702.206574 secs 2024-07-26T08:47:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:21 smithi063 ceph-mon[36747]: pgmap v962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 686.720077 secs 2024-07-26T08:47:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 702.206574 secs 2024-07-26T08:47:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:23 smithi043 ceph-mon[32384]: pgmap v963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 176 B/s wr, 10 op/s 2024-07-26T08:47:23.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:23 smithi133 ceph-mon[37053]: pgmap v963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 176 B/s wr, 10 op/s 2024-07-26T08:47:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:23 smithi063 ceph-mon[36747]: pgmap v963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 176 B/s wr, 10 op/s 2024-07-26T08:47:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:25 smithi043 ceph-mon[32384]: pgmap v964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:47:25.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:25 smithi133 ceph-mon[37053]: pgmap v964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:47:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:25 smithi063 ceph-mon[36747]: pgmap v964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T08:47:26.231 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 2. 2024-07-26T08:47:26.231 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:25 smithi043 systemd[1]: Stopped Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:47:26.232 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.313s CPU time. 2024-07-26T08:47:26.232 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 systemd[1]: Starting Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:47:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 691.720215 secs 2024-07-26T08:47:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 707.206714 secs 2024-07-26T08:47:26.483 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 podman[109679]: 2024-07-26 08:47:26.313420489 +0000 UTC m=+0.035758496 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:47:26.483 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 podman[109679]: 2024-07-26 08:47:26.43135293 +0000 UTC m=+0.153690975 container create 7bed5715d7b45e8f1e32ed6915d6b96b0cf784a99830b4dd674c36844b5ba761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T08:47:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 691.720215 secs 2024-07-26T08:47:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 707.206714 secs 2024-07-26T08:47:26.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 691.720215 secs 2024-07-26T08:47:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 707.206714 secs 2024-07-26T08:47:26.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:47:27.141 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:47:27.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 podman[109679]: 2024-07-26 08:47:26.766326174 +0000 UTC m=+0.488664219 container init 7bed5715d7b45e8f1e32ed6915d6b96b0cf784a99830b4dd674c36844b5ba761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:47:27.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 podman[109679]: 2024-07-26 08:47:26.778194514 +0000 UTC m=+0.500532582 container start 7bed5715d7b45e8f1e32ed6915d6b96b0cf784a99830b4dd674c36844b5ba761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-07-26T08:47:27.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 ceph-mds[109716]: -- 172.21.15.43:0/3575195983 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b137bb860 con 0x559b1795d600 2024-07-26T08:47:27.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: starting mds.j at 2024-07-26T08:47:27.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 bash[109679]: 7bed5715d7b45e8f1e32ed6915d6b96b0cf784a99830b4dd674c36844b5ba761 2024-07-26T08:47:27.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:26 smithi043 systemd[1]: Started Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: pgmap v965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: daemon mds.j restarted 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: osdmap e133: 12 total, 12 up, 12 in 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:boot 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:47:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:27 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:27.529 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: pgmap v965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:27.529 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: daemon mds.j restarted 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: osdmap e133: 12 total, 12 up, 12 in 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:boot 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:47:27.530 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:27 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: pgmap v965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: daemon mds.j restarted 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: osdmap e133: 12 total, 12 up, 12 in 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:boot 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-07-26T08:47:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:47:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:47:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:27 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:replay,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:29.016 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:28 smithi043 ceph-mon[32384]: pgmap v967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:47:29.016 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:28 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:resolve 2024-07-26T08:47:29.016 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:28 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:28 smithi133 ceph-mon[37053]: pgmap v967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:47:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:28 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:resolve 2024-07-26T08:47:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:28 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:28 smithi063 ceph-mon[36747]: pgmap v967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6 op/s 2024-07-26T08:47:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:28 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:resolve 2024-07-26T08:47:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:28 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:resolve,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 -- 172.21.15.43:0/3191947575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 msgr2=0x7f44381059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 --2- 172.21.15.43:0/3191947575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f44381059e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4428009900 tx=0x7f442802a410 comp rx=0 tx=0).stop 2024-07-26T08:47:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 -- 172.21.15.43:0/3191947575 shutdown_connections 2024-07-26T08:47:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 --2- 172.21.15.43:0/3191947575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810b860 0x7f4438112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 --2- 172.21.15.43:0/3191947575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810af10 0x7f443810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 --2- 172.21.15.43:0/3191947575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f44381059e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 -- 172.21.15.43:0/3191947575 >> 172.21.15.43:0/3191947575 conn(0x7f4438101040 msgr2=0x7f4438103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:47:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 -- 172.21.15.43:0/3191947575 shutdown_connections 2024-07-26T08:47:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.682+0000 7f443d000640 1 -- 172.21.15.43:0/3191947575 wait complete. 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.683+0000 7f443d000640 1 Processor -- start 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.683+0000 7f443d000640 1 -- start start 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f443d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f443819c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f443d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 0x7f443819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f443d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810b860 0x7f44381a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f443d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4438115640 con 0x7f443810b860 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f443d000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44381154c0 con 0x7f443810af10 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f443d000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f44381157c0 con 0x7f44381055d0 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f442ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 0x7f443819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f442ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 0x7f443819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38322/0 (socket says 172.21.15.43:38322) 2024-07-26T08:47:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f4437e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810b860 0x7f44381a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f442ea00640 1 -- 172.21.15.43:0/604466759 learned_addr learned my addr 172.21.15.43:0/604466759 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:47:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.684+0000 7f4437400640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f443819c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f442ea00640 1 -- 172.21.15.43:0/604466759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 msgr2=0x7f443819c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f442ea00640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f443819c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f442ea00640 1 -- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810b860 msgr2=0x7f44381a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f442ea00640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810b860 0x7f44381a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f442ea00640 1 -- 172.21.15.43:0/604466759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44381a1f80 con 0x7f443810af10 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f4437400640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f443819c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f4437e00640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810b860 0x7f44381a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.685+0000 7f442ea00640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 0x7f443819c5b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f442000e9f0 tx=0x7f442000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.686+0000 7f4434c00640 1 -- 172.21.15.43:0/604466759 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442000ccc0 con 0x7f443810af10 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.686+0000 7f4434c00640 1 -- 172.21.15.43:0/604466759 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4420010900 con 0x7f443810af10 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.686+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44381a2270 con 0x7f443810af10 2024-07-26T08:47:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.686+0000 7f4434c00640 1 -- 172.21.15.43:0/604466759 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420018860 con 0x7f443810af10 2024-07-26T08:47:29.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.686+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44381a89d0 con 0x7f443810af10 2024-07-26T08:47:29.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.689+0000 7f4445254740 1 Processor -- start 2024-07-26T08:47:29.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 -- start start 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd79fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4434c00640 1 -- 172.21.15.43:0/604466759 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4420010ab0 con 0x7f443810af10 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd7aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c6dcf0b90 con 0x558c6d9d5070 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558c6dce0090 con 0x558c6d9ac1b0 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4445254740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558c6dce40d0 con 0x558c6d9b4390 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4437e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd79fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4437e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd79fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49110/0 (socket says 172.21.15.43:49110) 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4437e00640 1 -- 172.21.15.43:0/802591818 learned_addr learned my addr 172.21.15.43:0/802591818 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:47:29.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f4437400640 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.690+0000 7f442ea00640 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd7aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437e00640 1 -- 172.21.15.43:0/802591818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 msgr2=0x558c6dd7aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437e00640 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd7aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437e00640 1 -- 172.21.15.43:0/802591818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9ac1b0 msgr2=0x558c6dd7a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437e00640 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437e00640 1 -- 172.21.15.43:0/802591818 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6da40650 con 0x558c6d9d5070 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437400640 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.691+0000 7f4437e00640 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd79fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4430011810 tx=0x7f4430011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8bd1864aa31873 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.692+0000 7f442cc00640 1 -- 172.21.15.43:0/802591818 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430011310 con 0x558c6d9d5070 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.692+0000 7f442cc00640 1 -- 172.21.15.43:0/802591818 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f443000f9a0 con 0x558c6d9d5070 2024-07-26T08:47:29.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.692+0000 7f442cc00640 1 -- 172.21.15.43:0/802591818 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44300056c0 con 0x558c6d9d5070 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.692+0000 7f4434c00640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f441c0b3d40 0x7f441c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.692+0000 7f4434c00640 1 -- 172.21.15.43:0/604466759 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 13150+0+0 (secure 0 0 0) 0x7f44200e5570 con 0x7f443810af10 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4437400640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f441c0b3d40 0x7f441c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 -- 172.21.15.43:0/802591818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 msgr2=0x558c6dd79fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd79fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4430011810 tx=0x7f4430011cd0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 -- 172.21.15.43:0/802591818 shutdown_connections 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd7aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 --2- 172.21.15.43:0/802591818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd79fd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 -- 172.21.15.43:0/802591818 >> 172.21.15.43:0/802591818 conn(0x558c6d9c9460 msgr2=0x558c6dd77ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 -- 172.21.15.43:0/802591818 shutdown_connections 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.693+0000 7f4445254740 1 -- 172.21.15.43:0/802591818 wait complete. 2024-07-26T08:47:29.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.694+0000 7f4437400640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f441c0b3d40 0x7f441c0b6250 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4428009230 tx=0x7f44280058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.694+0000 7f4445254740 1 -- start start 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.694+0000 7f4445254740 1 Processor -- start 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 0x558c6dd855d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd85b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd86050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c6db43700 con 0x558c6d9d5070 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558c6dc7c660 con 0x558c6d9b4390 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558c6dd887b0 con 0x558c6d9ac1b0 2024-07-26T08:47:29.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4445254740 10 client.0 _ll_register_callbacks cb 0x558c6dc8c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4437400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 0x558c6dd855d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4437400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 0x558c6dd855d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:36536/0 (socket says 172.21.15.43:36536) 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4437e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd86050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f4437400640 1 -- 172.21.15.43:0/1961861293 learned_addr learned my addr 172.21.15.43:0/1961861293 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.695+0000 7f442ea00640 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd85b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4437400640 1 -- 172.21.15.43:0/1961861293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 msgr2=0x558c6dd85b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4437400640 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd85b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4437400640 1 -- 172.21.15.43:0/1961861293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 msgr2=0x558c6dd86050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4437400640 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd86050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4437400640 1 -- 172.21.15.43:0/1961861293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6dc93800 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4437400640 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 0x558c6dd855d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4428033000 tx=0x7f4428009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=608bf93989002266 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4425600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.696+0000 7f4425600640 1 -- 172.21.15.43:0/1961861293 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442804d070 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.697+0000 7f4425600640 1 -- 172.21.15.43:0/1961861293 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 13150+0+0 (secure 0 0 0) 0x7f4428003800 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.697+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443000f9a0 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.697+0000 7f4425600640 1 -- 172.21.15.43:0/1961861293 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=310) ==== 24+0+0 (secure 0 0 0) 0x7f4428043070 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.697+0000 7f4445254740 10 client.26374 fetch_fsmap learned FSMap version 310 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.697+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=310,monmap=4+}) -- 0x558c6dd943e0 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.697+0000 7f4425600640 1 -- 172.21.15.43:0/1961861293 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f443000f9a0 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4425600640 1 -- 172.21.15.43:0/1961861293 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 310) ==== 4728+0+0 (secure 0 0 0) 0x7f4428052b60 con 0x558c6d9ac1b0 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4445254740 10 client.26374 fetch_fsmap finished waiting for FSMap version 310 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4445254740 10 client.26374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:47:29.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4445254740 20 client.26374 populate_metadata read hostname 'smithi043' 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4445254740 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d9939f0 0x558c6dd97da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4445254740 4 client.26374 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c6dcf2ae0 con 0x558c6d9939f0 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.698+0000 7f442ea00640 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d9939f0 0x558c6dd97da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.699+0000 7f442ea00640 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d9939f0 0x558c6dd97da0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b5cdb1a8cf694f0 server_cookie=6143c47f4b2575b9 in_seq=0 out_seq=0 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.699+0000 7f4425600640 10 client.26374 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4425600640 1 -- 172.21.15.43:0/1961861293 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c6dcf2ae0 con 0x558c6d9939f0 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4425600640 10 client.26374 handle_command_reply: tid=0 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 client.26374 shutdown 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 msgr2=0x558c6dd855d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 0x558c6dd855d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4428033000 tx=0x7f4428009260 comp rx=0 tx=0).stop 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 shutdown_connections 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d9939f0 0x558c6dd97da0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9d5070 0x558c6dd86050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd85b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 --2- 172.21.15.43:0/1961861293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9ac1b0 0x558c6dd855d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4425600640 0 client.26374 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:47:29.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 >> 172.21.15.43:0/1961861293 conn(0x558c6d9c9460 msgr2=0x558c6dd7d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:47:29.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.700+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 shutdown_connections 2024-07-26T08:47:29.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.701+0000 7f4445254740 1 -- 172.21.15.43:0/1961861293 wait complete. 2024-07-26T08:47:29.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.701+0000 7f4445254740 20 client.26374 trim_cache size 0 max 16384 2024-07-26T08:47:29.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 Processor -- start 2024-07-26T08:47:29.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 -- start start 2024-07-26T08:47:29.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd76500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 0x558c6dd87200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44381b55c0 con 0x558c6d9ac1b0 2024-07-26T08:47:29.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44381b3a80 con 0x558c6d9d5070 2024-07-26T08:47:29.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4445254740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f44381b4ef0 con 0x558c6d9b4390 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4437400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.720+0000 7f4437e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 0x558c6dd87200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f442ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd76500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49128/0 (socket says 172.21.15.43:49128) 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 0x558c6dd87200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38342/0 (socket says 172.21.15.43:38342) 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437400640 1 -- 172.21.15.43:0/1762557901 learned_addr learned my addr 172.21.15.43:0/1762557901 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:47:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 -- 172.21.15.43:0/1762557901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 msgr2=0x558c6dd76500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd76500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 -- 172.21.15.43:0/1762557901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 msgr2=0x558c6dd7b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 -- 172.21.15.43:0/1762557901 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6dd7c590 con 0x558c6d9d5070 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f442ea00640 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd76500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.721+0000 7f4437e00640 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 0x558c6dd87200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4430000f80 tx=0x7f4430005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fa7cb4a83c27b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.722+0000 7f4427e00640 1 -- 172.21.15.43:0/1762557901 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443002a070 con 0x558c6d9d5070 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.722+0000 7f4427e00640 1 -- 172.21.15.43:0/1762557901 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f443001f040 con 0x558c6d9d5070 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.722+0000 7f4427e00640 1 -- 172.21.15.43:0/1762557901 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430004a00 con 0x558c6d9d5070 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 -- 172.21.15.43:0/1762557901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 msgr2=0x558c6dd87200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 0x558c6dd87200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4430000f80 tx=0x7f4430005280 comp rx=0 tx=0).stop 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 -- 172.21.15.43:0/1762557901 shutdown_connections 2024-07-26T08:47:29.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9b4390 0x558c6dd76500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9d5070 0x558c6dd87200 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 --2- 172.21.15.43:0/1762557901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd7b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 -- 172.21.15.43:0/1762557901 >> 172.21.15.43:0/1762557901 conn(0x558c6d9c9460 msgr2=0x558c6dd86af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 -- 172.21.15.43:0/1762557901 shutdown_connections 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.723+0000 7f4445254740 1 -- 172.21.15.43:0/1762557901 wait complete. 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.724+0000 7f4445254740 1 -- start start 2024-07-26T08:47:29.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.724+0000 7f4445254740 1 Processor -- start 2024-07-26T08:47:29.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.724+0000 7f4445254740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd8e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.724+0000 7f4445254740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd8b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4445254740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9d5070 0x558c6dd8bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4445254740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44381b4820 con 0x558c6d9ac1b0 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4445254740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44381b4150 con 0x558c6d9b4390 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4445254740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f44381b29c0 con 0x558c6d9d5070 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4445254740 10 client.0 _ll_register_callbacks cb 0x7f4428031820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4437400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd8e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd8b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd8b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38346/0 (socket says 172.21.15.43:38346) 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 -- 172.21.15.43:0/2874249344 learned_addr learned my addr 172.21.15.43:0/2874249344 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4437400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd8e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49140/0 (socket says 172.21.15.43:49140) 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f4437e00640 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9d5070 0x558c6dd8bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 -- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9d5070 msgr2=0x558c6dd8bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9d5070 0x558c6dd8bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 -- 172.21.15.43:0/2874249344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 msgr2=0x558c6dd8e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd8e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.725+0000 7f442ea00640 1 -- 172.21.15.43:0/2874249344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6dd8c550 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f442ea00640 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd8b740 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f44200e1ab0 tx=0x7f442000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b89fd9c92bd396 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4425600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4425600640 1 -- 172.21.15.43:0/2874249344 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44200e1ee0 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443001f040 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4425600640 1 -- 172.21.15.43:0/2874249344 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 13150+0+0 (secure 0 0 0) 0x7f44200aa170 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4425600640 1 -- 172.21.15.43:0/2874249344 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=310) ==== 24+0+0 (secure 0 0 0) 0x7f44200ab610 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4445254740 10 client.26405 fetch_fsmap learned FSMap version 310 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.726+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=310,monmap=4+}) -- 0x558c6de00670 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4425600640 1 -- 172.21.15.43:0/2874249344 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f443001f040 con 0x558c6d9b4390 2024-07-26T08:47:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4425600640 1 -- 172.21.15.43:0/2874249344 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 310) ==== 4728+0+0 (secure 0 0 0) 0x7f44200a6880 con 0x558c6d9b4390 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4445254740 10 client.26405 fetch_fsmap finished waiting for FSMap version 310 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4445254740 10 client.26405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4445254740 20 client.26405 populate_metadata read hostname 'smithi043' 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4445254740 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d968da0 0x558c6de02de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4445254740 4 client.26405 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c6dcee580 con 0x558c6d968da0 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.727+0000 7f4437400640 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d968da0 0x558c6de02de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4437400640 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d968da0 0x558c6de02de0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb463c2b131a745d server_cookie=4c89795f78da4936 in_seq=0 out_seq=0 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4425600640 10 client.26405 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4425600640 1 -- 172.21.15.43:0/2874249344 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x558c6dcee580 con 0x558c6d968da0 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4425600640 10 client.26405 handle_command_reply: tid=0 2024-07-26T08:47:29.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4445254740 1 client.26405 shutdown 2024-07-26T08:47:29.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 msgr2=0x558c6dd8b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.728+0000 7f4445254740 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd8b740 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f44200e1ab0 tx=0x7f442000cef0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 shutdown_connections 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x558c6d968da0 0x558c6de02de0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558c6d9d5070 0x558c6dd8bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558c6d9b4390 0x558c6dd8b740 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 --2- 172.21.15.43:0/2874249344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c6d9ac1b0 0x558c6dd8e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4425600640 0 client.26405 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 >> 172.21.15.43:0/2874249344 conn(0x558c6d9c9460 msgr2=0x558c6dd7b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 shutdown_connections 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 1 -- 172.21.15.43:0/2874249344 wait complete. 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.729+0000 7f4445254740 20 client.26405 trim_cache size 0 max 16384 2024-07-26T08:47:29.734 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:47:29.735 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f441c0b3d40 msgr2=0x7f441c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f441c0b3d40 0x7f441c0b6250 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4428009230 tx=0x7f44280058d0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 msgr2=0x7f443819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 0x7f443819c5b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f442000e9f0 tx=0x7f442000edf0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 shutdown_connections 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f441c0b3d40 0x7f441c0b6250 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f443810b860 0x7f44381a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f443810af10 0x7f443819c5b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 --2- 172.21.15.43:0/604466759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44381055d0 0x7f443819c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:47:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 >> 172.21.15.43:0/604466759 conn(0x7f4438101040 msgr2=0x7f4438103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:47:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 shutdown_connections 2024-07-26T08:47:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:47:29.730+0000 7f443d000640 1 -- 172.21.15.43:0/604466759 wait complete. 2024-07-26T08:47:30.237 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:47:30.237 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: *** Caught signal (Aborted) ** 2024-07-26T08:47:30.237 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: in thread 7f6e08a00640 thread_name:ms_dispatch 2024-07-26T08:47:30.237 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6e0ec3e6f0] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6e0ec8b94c] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 3: raise() 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 4: abort() 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6e0ec2871b] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 6: /lib64/libc.so.6(+0x37386) [0x7f6e0ec37386] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566fa0676b9] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566fa22580c] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566fa1652ca] 2024-07-26T08:47:30.238 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566fa135753] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566fa136a1b] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566fa11a752] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566fa068a56] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566fa06c637] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566fa06cf5e] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566fa05003a] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6e0f79b407] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 18: (DispatchQueue::entry()+0x60f) [0x7f6e0f79bcf9] 2024-07-26T08:47:30.239 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6e0f8785a1] 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:29 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:29 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:reconnect 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:29 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:29 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 20: (Thread::entry_wrapper()+0x43) [0x7f6e0f625cdd] 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6e0f625cf9] 2024-07-26T08:47:30.242 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6e0ec89c02] 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6e0ed0ec40] 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.187+0000 7f6e08a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: in thread 7f6e08a00640 thread_name:ms_dispatch 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6e0ec3e6f0] 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6e0ec8b94c] 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 3: raise() 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 4: abort() 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6e0ec2871b] 2024-07-26T08:47:30.243 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 6: /lib64/libc.so.6(+0x37386) [0x7f6e0ec37386] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566fa0676b9] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566fa22580c] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566fa1652ca] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566fa135753] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566fa136a1b] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566fa11a752] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566fa068a56] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566fa06c637] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566fa06cf5e] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566fa05003a] 2024-07-26T08:47:30.244 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6e0f79b407] 2024-07-26T08:47:30.245 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 18: (DispatchQueue::entry()+0x60f) [0x7f6e0f79bcf9] 2024-07-26T08:47:30.245 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6e0f8785a1] 2024-07-26T08:47:30.245 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 20: (Thread::entry_wrapper()+0x43) [0x7f6e0f625cdd] 2024-07-26T08:47:30.245 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6e0f625cf9] 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6e0ec89c02] 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6e0ed0ec40] 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 0> 2024-07-26T08:47:30.187+0000 7f6e08a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: in thread 7f6e08a00640 thread_name:ms_dispatch 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6e0ec3e6f0] 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6e0ec8b94c] 2024-07-26T08:47:30.246 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 3: raise() 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 4: abort() 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6e0ec2871b] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 6: /lib64/libc.so.6(+0x37386) [0x7f6e0ec37386] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566fa0676b9] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566fa22580c] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566fa1652ca] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566fa135753] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566fa136a1b] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566fa11a752] 2024-07-26T08:47:30.247 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566fa068a56] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566fa06c637] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566fa06cf5e] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566fa05003a] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6e0f79b407] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 18: (DispatchQueue::entry()+0x60f) [0x7f6e0f79bcf9] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6e0f8785a1] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 20: (Thread::entry_wrapper()+0x43) [0x7f6e0f625cdd] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6e0f625cf9] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6e0ec89c02] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6e0ed0ec40] 2024-07-26T08:47:30.248 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:30.249 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:29 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:47:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:29 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:reconnect 2024-07-26T08:47:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:29 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:29 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:47:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:29 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:47:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:29 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:reconnect 2024-07-26T08:47:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:29 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:reconnect,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:29 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 0> 2024-07-26T08:47:30.187+0000 7f6e08a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: in thread 7f6e08a00640 thread_name:ms_dispatch 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6e0ec3e6f0] 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6e0ec8b94c] 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 3: raise() 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 4: abort() 2024-07-26T08:47:30.619 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6e0ec2871b] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 6: /lib64/libc.so.6(+0x37386) [0x7f6e0ec37386] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566fa0676b9] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566fa22580c] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566fa1652ca] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566fa135753] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566fa136a1b] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566fa11a752] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566fa068a56] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566fa06c637] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566fa06cf5e] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566fa05003a] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6e0f79b407] 2024-07-26T08:47:30.620 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 18: (DispatchQueue::entry()+0x60f) [0x7f6e0f79bcf9] 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6e0f8785a1] 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 20: (Thread::entry_wrapper()+0x43) [0x7f6e0f625cdd] 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6e0f625cf9] 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6e0ec89c02] 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6e0ed0ec40] 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:30.621 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g[109552]: 2024-07-26T08:47:30.682 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:47:30.947 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:30 smithi043 podman[109909]: 2024-07-26 08:47:30.655492141 +0000 UTC m=+0.352425587 container died 3e9cd34a974721b135c1678d864f099f8e8bf28cb8427787150eb21a760fe92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: pgmap v968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:rejoin 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 696.720358 secs 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:active 2024-07-26T08:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:47:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 712.206834 secs 2024-07-26T08:47:31.265 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T08:47:30.800+0000 7f79f1f3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: pgmap v968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:rejoin 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 696.720358 secs 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:active 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 712.206834 secs 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: pgmap v968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:rejoin 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=g=up:rejoin,2=i=up:active} 2 up:standby-replay 1 up:standby 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 696.720358 secs 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6836/3942566175,v1:172.21.15.43:6837/3942566175] up:active 2024-07-26T08:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 2024-07-26T08:47:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 712.206834 secs 2024-07-26T08:47:31.732 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:31 smithi043 podman[109909]: 2024-07-26 08:47:31.394399252 +0000 UTC m=+1.091332704 container remove 3e9cd34a974721b135c1678d864f099f8e8bf28cb8427787150eb21a760fe92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-g, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-07-26T08:47:31.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:31 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:47:32.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:31 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:47:32.483 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:31 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.423s CPU time. 2024-07-26T08:47:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:32 smithi043 ceph-mon[32384]: pgmap v969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:47:33.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:32 smithi133 ceph-mon[37053]: pgmap v969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:47:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:32 smithi063 ceph-mon[36747]: pgmap v969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-07-26T08:47:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:34 smithi043 ceph-mon[32384]: pgmap v970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:47:35.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:34 smithi133 ceph-mon[37053]: pgmap v970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:47:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:34 smithi063 ceph-mon[36747]: pgmap v970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:47:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 701.720508 secs 2024-07-26T08:47:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 717.206955 secs 2024-07-26T08:47:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 701.720508 secs 2024-07-26T08:47:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 717.206955 secs 2024-07-26T08:47:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 701.720508 secs 2024-07-26T08:47:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 717.206955 secs 2024-07-26T08:47:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:36 smithi043 ceph-mon[32384]: pgmap v971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:37.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:36 smithi133 ceph-mon[37053]: pgmap v971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:37.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:36 smithi063 ceph-mon[36747]: pgmap v971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 10 op/s 2024-07-26T08:47:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:38 smithi043 ceph-mon[32384]: pgmap v972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 189 B/s wr, 11 op/s 2024-07-26T08:47:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:38 smithi133 ceph-mon[37053]: pgmap v972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 189 B/s wr, 11 op/s 2024-07-26T08:47:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:38 smithi063 ceph-mon[36747]: pgmap v972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 189 B/s wr, 11 op/s 2024-07-26T08:47:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:40 smithi133 ceph-mon[37053]: pgmap v973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 706.720649 secs 2024-07-26T08:47:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:40 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 722.207037 secs 2024-07-26T08:47:41.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:40 smithi133 ceph-mon[37053]: slow request 722.207036 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:47:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:40 smithi063 ceph-mon[36747]: pgmap v973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 706.720649 secs 2024-07-26T08:47:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:40 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 722.207037 secs 2024-07-26T08:47:41.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:40 smithi063 ceph-mon[36747]: slow request 722.207036 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:47:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:40 smithi043 ceph-mon[32384]: pgmap v973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 706.720649 secs 2024-07-26T08:47:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:40 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 722.207037 secs 2024-07-26T08:47:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:40 smithi043 ceph-mon[32384]: slow request 722.207036 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:47:42.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:42 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:47:42.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:42 smithi043 systemd[1]: Stopped Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:47:42.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:42 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Consumed 3.423s CPU time. 2024-07-26T08:47:42.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:42 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Start request repeated too quickly. 2024-07-26T08:47:42.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:42 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T08:47:42.733 INFO:journalctl@ceph.mds.g.smithi043.stdout:Jul 26 08:47:42 smithi043 systemd[1]: Failed to start Ceph mds.g for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:47:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:42 smithi043 ceph-mon[32384]: pgmap v974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:42 smithi133 ceph-mon[37053]: pgmap v974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:42 smithi063 ceph-mon[36747]: pgmap v974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:47:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:44 smithi043 ceph-mon[32384]: pgmap v975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:47:45.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:44 smithi133 ceph-mon[37053]: pgmap v975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:47:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:44 smithi063 ceph-mon[36747]: pgmap v975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 711.720771 secs 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: Replacing daemon mds.g as rank 1 with standby daemon mds.j 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: osdmap e134: 12 total, 12 up, 12 in 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 727.207158 secs 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 711.720771 secs 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: Replacing daemon mds.g as rank 1 with standby daemon mds.j 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: osdmap e134: 12 total, 12 up, 12 in 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 727.207158 secs 2024-07-26T08:47:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 711.720771 secs 2024-07-26T08:47:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: Replacing daemon mds.g as rank 1 with standby daemon mds.j 2024-07-26T08:47:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2024-07-26T08:47:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:47:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: osdmap e134: 12 total, 12 up, 12 in 2024-07-26T08:47:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 727.207158 secs 2024-07-26T08:47:47.449 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:47 smithi043 ceph-mon[32384]: pgmap v977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:47:47.449 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:47 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:resolve 2024-07-26T08:47:47.449 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:47 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:47.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:47 smithi133 ceph-mon[37053]: pgmap v977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:47:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:47 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:resolve 2024-07-26T08:47:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:47 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:47 smithi063 ceph-mon[36747]: pgmap v977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T08:47:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:47 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:resolve 2024-07-26T08:47:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:47 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:48 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:reconnect 2024-07-26T08:47:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:48 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:48 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0109999 2024-07-26T08:47:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:48 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:47:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:48 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:reconnect 2024-07-26T08:47:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:48 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:48 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0109999 2024-07-26T08:47:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:48 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:47:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:48 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:reconnect 2024-07-26T08:47:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:48 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:48 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0109999 2024-07-26T08:47:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:48 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0109999 2024-07-26T08:47:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-mon[32384]: pgmap v978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:47:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:rejoin 2024-07-26T08:47:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-mon[32384]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: *** Caught signal (Aborted) ** 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: in thread 7f2a29600640 thread_name:ms_dispatch 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2a2f83e6f0] 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2a2f88b94c] 2024-07-26T08:47:49.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 3: raise() 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 4: abort() 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2a2f82871b] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 6: /lib64/libc.so.6(+0x37386) [0x7f2a2f837386] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559b111a86b9] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559b1136680c] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559b112a62ca] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559b11276753] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559b11277a1b] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559b1125b752] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559b111a9a56] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559b111ad637] 2024-07-26T08:47:49.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559b111adf5e] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559b1119103a] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a3039b407] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a3039bcf9] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a304785a1] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a30225cdd] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a30225cf9] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2a2f889c02] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2a2f90ec40] 2024-07-26T08:47:49.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.245+0000 7f2a29600640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: in thread 7f2a29600640 thread_name:ms_dispatch 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2a2f83e6f0] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2a2f88b94c] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 3: raise() 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 4: abort() 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2a2f82871b] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 6: /lib64/libc.so.6(+0x37386) [0x7f2a2f837386] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559b111a86b9] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559b1136680c] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559b112a62ca] 2024-07-26T08:47:49.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559b11276753] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559b11277a1b] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559b1125b752] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559b111a9a56] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559b111ad637] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559b111adf5e] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559b1119103a] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a3039b407] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a3039bcf9] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a304785a1] 2024-07-26T08:47:49.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a30225cdd] 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a30225cf9] 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2a2f889c02] 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2a2f90ec40] 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 0> 2024-07-26T08:47:49.245+0000 7f2a29600640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: in thread 7f2a29600640 thread_name:ms_dispatch 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2a2f83e6f0] 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2a2f88b94c] 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 3: raise() 2024-07-26T08:47:49.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 4: abort() 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2a2f82871b] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 6: /lib64/libc.so.6(+0x37386) [0x7f2a2f837386] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559b111a86b9] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559b1136680c] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559b112a62ca] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559b11276753] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559b11277a1b] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559b1125b752] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559b111a9a56] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559b111ad637] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559b111adf5e] 2024-07-26T08:47:49.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559b1119103a] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a3039b407] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a3039bcf9] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a304785a1] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a30225cdd] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a30225cf9] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2a2f889c02] 2024-07-26T08:47:49.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2a2f90ec40] 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 0> 2024-07-26T08:47:49.245+0000 7f2a29600640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: in thread 7f2a29600640 thread_name:ms_dispatch 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2a2f83e6f0] 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2a2f88b94c] 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 3: raise() 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 4: abort() 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2a2f82871b] 2024-07-26T08:47:49.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 6: /lib64/libc.so.6(+0x37386) [0x7f2a2f837386] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559b111a86b9] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559b1136680c] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559b112a62ca] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559b11276753] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559b11277a1b] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559b1125b752] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559b111a9a56] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559b111ad637] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559b111adf5e] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559b1119103a] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2a3039b407] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 18: (DispatchQueue::entry()+0x60f) [0x7f2a3039bcf9] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2a304785a1] 2024-07-26T08:47:49.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 20: (Thread::entry_wrapper()+0x43) [0x7f2a30225cdd] 2024-07-26T08:47:49.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2a30225cf9] 2024-07-26T08:47:49.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2a2f889c02] 2024-07-26T08:47:49.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2a2f90ec40] 2024-07-26T08:47:49.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:47:49.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[109694]: 2024-07-26T08:47:49.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:49 smithi043 podman[109968]: 2024-07-26 08:47:49.432857725 +0000 UTC m=+0.039666347 container died 7bed5715d7b45e8f1e32ed6915d6b96b0cf784a99830b4dd674c36844b5ba761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T08:47:49.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:49 smithi133 ceph-mon[37053]: pgmap v978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:47:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:49 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:rejoin 2024-07-26T08:47:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:49 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:49 smithi133 ceph-mon[37053]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:47:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:49 smithi063 ceph-mon[36747]: pgmap v978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6 op/s 2024-07-26T08:47:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:49 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:rejoin 2024-07-26T08:47:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:49 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:49 smithi063 ceph-mon[36747]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:47:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:50 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:50 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:active 2024-07-26T08:47:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:50 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 716.720910 secs 2024-07-26T08:47:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:50 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:50 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:active 2024-07-26T08:47:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:50 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 716.720910 secs 2024-07-26T08:47:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:50 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:47:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:50 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1337199959,v1:172.21.15.43:6835/1337199959] up:active 2024-07-26T08:47:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:50 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:47:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 716.720910 secs 2024-07-26T08:47:50.733 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:50 smithi043 podman[109968]: 2024-07-26 08:47:50.392210546 +0000 UTC m=+0.999019195 container remove 7bed5715d7b45e8f1e32ed6915d6b96b0cf784a99830b4dd674c36844b5ba761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-07-26T08:47:50.734 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:50 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:47:51.232 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:50 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:47:51.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:47:50 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.390s CPU time. 2024-07-26T08:47:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:51 smithi133 ceph-mon[37053]: pgmap v979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 7 op/s 2024-07-26T08:47:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 732.207280 secs 2024-07-26T08:47:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:51 smithi063 ceph-mon[36747]: pgmap v979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 7 op/s 2024-07-26T08:47:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 732.207280 secs 2024-07-26T08:47:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:51 smithi043 ceph-mon[32384]: pgmap v979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 7 op/s 2024-07-26T08:47:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 732.207280 secs 2024-07-26T08:47:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:53 smithi133 ceph-mon[37053]: pgmap v980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:47:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:53 smithi063 ceph-mon[36747]: pgmap v980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:47:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:53 smithi043 ceph-mon[32384]: pgmap v980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 102 B/s wr, 8 op/s 2024-07-26T08:47:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:55 smithi133 ceph-mon[37053]: pgmap v981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:47:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:55 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 721.721027 secs 2024-07-26T08:47:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:55 smithi133 ceph-mon[37053]: slow request 721.721026 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:47:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:55 smithi063 ceph-mon[36747]: pgmap v981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:47:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:55 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 721.721027 secs 2024-07-26T08:47:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:55 smithi063 ceph-mon[36747]: slow request 721.721026 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:47:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:55 smithi043 ceph-mon[32384]: pgmap v981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:47:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:55 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 721.721027 secs 2024-07-26T08:47:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:55 smithi043 ceph-mon[32384]: slow request 721.721026 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:47:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 737.207401 secs 2024-07-26T08:47:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 737.207401 secs 2024-07-26T08:47:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 737.207401 secs 2024-07-26T08:47:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:57 smithi063 ceph-mon[36747]: pgmap v982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 193 B/s wr, 9 op/s 2024-07-26T08:47:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:57 smithi043 ceph-mon[32384]: pgmap v982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 193 B/s wr, 9 op/s 2024-07-26T08:47:57.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:57 smithi133 ceph-mon[37053]: pgmap v982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 193 B/s wr, 9 op/s 2024-07-26T08:47:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:47:59 smithi063 ceph-mon[36747]: pgmap v983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:47:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:47:59 smithi043 ceph-mon[32384]: pgmap v983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:47:59.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:47:59 smithi133 ceph-mon[37053]: pgmap v983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 726.721147 secs 2024-07-26T08:48:00.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 726.721147 secs 2024-07-26T08:48:00.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:48:00.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 726.721147 secs 2024-07-26T08:48:01.015 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:00 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 3. 2024-07-26T08:48:01.015 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:00 smithi043 systemd[1]: Stopped Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:01.015 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:00 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.390s CPU time. 2024-07-26T08:48:01.015 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:01 smithi043 systemd[1]: Starting Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:48:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:48:01.550 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:01 smithi043 ceph-mon[32384]: pgmap v984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:01.550 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 742.207524 secs 2024-07-26T08:48:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:01 smithi063 ceph-mon[36747]: pgmap v984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 742.207524 secs 2024-07-26T08:48:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:01 smithi133 ceph-mon[37053]: pgmap v984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 742.207524 secs 2024-07-26T08:48:01.982 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:01 smithi043 podman[110128]: 2024-07-26 08:48:01.509639412 +0000 UTC m=+0.271900948 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:48:01.982 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:01 smithi043 podman[110128]: 2024-07-26 08:48:01.646087465 +0000 UTC m=+0.408348958 container create a564b48ba7e92edbcb051fc5ed4b1eca521e721695527053725e2e0fdbf720ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-07-26T08:48:02.446 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:48:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:48:02.733 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:02 smithi043 podman[110128]: 2024-07-26 08:48:02.444391295 +0000 UTC m=+1.206652823 container init a564b48ba7e92edbcb051fc5ed4b1eca521e721695527053725e2e0fdbf720ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-26T08:48:02.734 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:02 smithi043 podman[110128]: 2024-07-26 08:48:02.453325257 +0000 UTC m=+1.215586722 container start a564b48ba7e92edbcb051fc5ed4b1eca521e721695527053725e2e0fdbf720ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-07-26T08:48:02.734 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:02 smithi043 bash[110128]: a564b48ba7e92edbcb051fc5ed4b1eca521e721695527053725e2e0fdbf720ba 2024-07-26T08:48:02.734 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:02 smithi043 systemd[1]: Started Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:02.734 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:02 smithi043 ceph-mds[110243]: -- 172.21.15.43:0/3763918319 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8ba867860 con 0x55a8bea09a80 2024-07-26T08:48:02.734 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:02 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: starting mds.j at 2024-07-26T08:48:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:48:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: pgmap v985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-07-26T08:48:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: daemon mds.j restarted 2024-07-26T08:48:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: osdmap e135: 12 total, 12 up, 12 in 2024-07-26T08:48:03.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:boot 2024-07-26T08:48:03.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:03.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:03.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:03.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:48:03.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:48:03.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:48:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: pgmap v985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-07-26T08:48:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: daemon mds.j restarted 2024-07-26T08:48:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: osdmap e135: 12 total, 12 up, 12 in 2024-07-26T08:48:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:boot 2024-07-26T08:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: pgmap v985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: daemon mds.j restarted 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: osdmap e135: 12 total, 12 up, 12 in 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:boot 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:48:03.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 -- 172.21.15.43:0/260949153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 msgr2=0x7f6730109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 --2- 172.21.15.43:0/260949153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 0x7f6730109130 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f671c009900 tx=0x7f671c02a3f0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 -- 172.21.15.43:0/260949153 shutdown_connections 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 --2- 172.21.15.43:0/260949153 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6730109670 0x7f673010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 --2- 172.21.15.43:0/260949153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 0x7f6730109130 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 --2- 172.21.15.43:0/260949153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67301033e0 0x7f67301037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 -- 172.21.15.43:0/260949153 >> 172.21.15.43:0/260949153 conn(0x7f67300fee30 msgr2=0x7f6730101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 -- 172.21.15.43:0/260949153 shutdown_connections 2024-07-26T08:48:04.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.487+0000 7f6736200640 1 -- 172.21.15.43:0/260949153 wait complete. 2024-07-26T08:48:04.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.488+0000 7f6736200640 1 Processor -- start 2024-07-26T08:48:04.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.488+0000 7f6736200640 1 -- start start 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6736200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 0x7f673019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6736200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 0x7f673019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6736200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6730109670 0x7f67301a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6736200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67301134a0 con 0x7f6730108d20 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6736200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6730113320 con 0x7f67301033e0 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6736200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6730113620 con 0x7f6730109670 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6734e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 0x7f673019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f672fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 0x7f673019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6734e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 0x7f673019c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47016/0 (socket says 172.21.15.43:47016) 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.489+0000 7f6734e00640 1 -- 172.21.15.43:0/2160834208 learned_addr learned my addr 172.21.15.43:0/2160834208 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6735800640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6730109670 0x7f67301a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6734e00640 1 -- 172.21.15.43:0/2160834208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6730109670 msgr2=0x7f67301a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6734e00640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6730109670 0x7f67301a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6734e00640 1 -- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 msgr2=0x7f673019c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6734e00640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 0x7f673019c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6734e00640 1 -- 172.21.15.43:0/2160834208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67301a1fc0 con 0x7f67301033e0 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6735800640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6730109670 0x7f67301a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.490+0000 7f6734e00640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 0x7f673019c050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f672400e9f0 tx=0x7f672400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.491+0000 7f672d600640 1 -- 172.21.15.43:0/2160834208 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672400cd80 con 0x7f67301033e0 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.491+0000 7f672d600640 1 -- 172.21.15.43:0/2160834208 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f67240054f0 con 0x7f67301033e0 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.491+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67301a22b0 con 0x7f67301033e0 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.491+0000 7f672d600640 1 -- 172.21.15.43:0/2160834208 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724010690 con 0x7f67301033e0 2024-07-26T08:48:04.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.491+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67301a8a10 con 0x7f67301033e0 2024-07-26T08:48:04.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.495+0000 7f672d600640 1 -- 172.21.15.43:0/2160834208 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f67240046c0 con 0x7f67301033e0 2024-07-26T08:48:04.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.495+0000 7f673e5e0740 1 Processor -- start 2024-07-26T08:48:04.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 -- start start 2024-07-26T08:48:04.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d3b070 0x55eba60e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f672d600640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f67180b3d40 0x7f67180b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eba6056bc0 con 0x55eba5d1a390 2024-07-26T08:48:04.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55eba60460c0 con 0x55eba5d3b070 2024-07-26T08:48:04.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.496+0000 7f673e5e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eba604a100 con 0x55eba5d121b0 2024-07-26T08:48:04.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.497+0000 7f6735800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d3b070 0x55eba60e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.497+0000 7f6735800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d3b070 0x55eba60e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47020/0 (socket says 172.21.15.43:47020) 2024-07-26T08:48:04.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.497+0000 7f6735800640 1 -- 172.21.15.43:0/3392891157 learned_addr learned my addr 172.21.15.43:0/3392891157 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:04.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.497+0000 7f6735800640 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.497+0000 7f672fe00640 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6735800640 1 -- 172.21.15.43:0/3392891157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 msgr2=0x55eba60e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6735800640 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6735800640 1 -- 172.21.15.43:0/3392891157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d3b070 msgr2=0x55eba60e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6735800640 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d3b070 0x55eba60e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6735800640 1 -- 172.21.15.43:0/3392891157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eba5da6650 con 0x55eba5d1a390 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f672d600640 1 -- 172.21.15.43:0/2160834208 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 13322+0+0 (secure 0 0 0) 0x7f67240e57a0 con 0x7f67301033e0 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6734e00640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f67180b3d40 0x7f67180b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.498+0000 7f6735800640 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e0a80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6728012960 tx=0x7f6728009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617e996df71d0e66 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:04.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.499+0000 7f6722000640 1 -- 172.21.15.43:0/3392891157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728003b70 con 0x55eba5d1a390 2024-07-26T08:48:04.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.499+0000 7f6722000640 1 -- 172.21.15.43:0/3392891157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6728003d10 con 0x55eba5d1a390 2024-07-26T08:48:04.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.499+0000 7f6722000640 1 -- 172.21.15.43:0/3392891157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672800f450 con 0x55eba5d1a390 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 -- 172.21.15.43:0/3392891157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 msgr2=0x55eba60e0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f6734e00640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f67180b3d40 0x7f67180b6250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f67240ab020 tx=0x7f6724009310 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e0a80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6728012960 tx=0x7f6728009500 comp rx=0 tx=0).stop 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 -- 172.21.15.43:0/3392891157 shutdown_connections 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e0a80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3392891157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d3b070 0x55eba60e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 -- 172.21.15.43:0/3392891157 >> 172.21.15.43:0/3392891157 conn(0x55eba5d2f460 msgr2=0x55eba60ddef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 -- 172.21.15.43:0/3392891157 shutdown_connections 2024-07-26T08:48:04.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.500+0000 7f673e5e0740 1 -- 172.21.15.43:0/3392891157 wait complete. 2024-07-26T08:48:04.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.501+0000 7f673e5e0740 1 -- start start 2024-07-26T08:48:04.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.501+0000 7f673e5e0740 1 Processor -- start 2024-07-26T08:48:04.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60eb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60eba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba60ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eba5ea9700 con 0x55eba5d1a390 2024-07-26T08:48:04.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55eba5fe2690 con 0x55eba5d121b0 2024-07-26T08:48:04.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eba60ee7e0 con 0x55eba5d3b070 2024-07-26T08:48:04.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f673e5e0740 10 client.0 _ll_register_callbacks cb 0x55eba5ff2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f6735800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f6735800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60eb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47024/0 (socket says 172.21.15.43:47024) 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.502+0000 7f6735800640 1 -- 172.21.15.43:0/3941153856 learned_addr learned my addr 172.21.15.43:0/3941153856 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba60ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f672fe00640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 -- 172.21.15.43:0/3941153856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 msgr2=0x55eba60eb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60eb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 -- 172.21.15.43:0/3941153856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 msgr2=0x55eba60eba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60eba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 -- 172.21.15.43:0/3941153856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eba5ff9830 con 0x55eba5d3b070 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.503+0000 7f6735800640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba60ebf90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6728004350 tx=0x7f6728000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49d801bbe15506b0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f6716a00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:48:04.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f6716a00640 1 -- 172.21.15.43:0/3941153856 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728009c60 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6728003d10 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f6716a00640 1 -- 172.21.15.43:0/3941153856 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 13322+0+0 (secure 0 0 0) 0x7f672800da50 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f6716a00640 1 -- 172.21.15.43:0/3941153856 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=320) ==== 24+0+0 (secure 0 0 0) 0x7f6728004820 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f673e5e0740 10 client.26398 fetch_fsmap learned FSMap version 320 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.504+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=320,monmap=4+}) -- 0x55eba60fa340 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f6716a00640 1 -- 172.21.15.43:0/3941153856 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6728003d10 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f6716a00640 1 -- 172.21.15.43:0/3941153856 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 320) ==== 4123+0+0 (secure 0 0 0) 0x7f672801c030 con 0x55eba5d3b070 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f673e5e0740 10 client.26398 fetch_fsmap finished waiting for FSMap version 320 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f673e5e0740 10 client.26398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f673e5e0740 20 client.26398 populate_metadata read hostname 'smithi043' 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cf99f0 0x55eba60fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f673e5e0740 4 client.26398 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eba6058b10 con 0x55eba5cf99f0 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.505+0000 7f672fe00640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cf99f0 0x55eba60fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.506+0000 7f672fe00640 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cf99f0 0x55eba60fda30 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a4e8649096bf1cd server_cookie=c9cd494661dbf04 in_seq=0 out_seq=0 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.506+0000 7f6716a00640 10 client.26398 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f6716a00640 1 -- 172.21.15.43:0/3941153856 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eba6058b10 con 0x55eba5cf99f0 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f6716a00640 10 client.26398 handle_command_reply: tid=0 2024-07-26T08:48:04.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f673e5e0740 1 client.26398 shutdown 2024-07-26T08:48:04.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 msgr2=0x55eba60ebf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba60ebf90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6728004350 tx=0x7f6728000f40 comp rx=0 tx=0).stop 2024-07-26T08:48:04.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 shutdown_connections 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.507+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cf99f0 0x55eba60fda30 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba60ebf90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60eba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3941153856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60eb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 >> 172.21.15.43:0/3941153856 conn(0x55eba5d2f460 msgr2=0x55eba60e31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f6716a00640 0 client.26398 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 shutdown_connections 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 1 -- 172.21.15.43:0/3941153856 wait complete. 2024-07-26T08:48:04.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.508+0000 7f673e5e0740 20 client.26398 trim_cache size 0 max 16384 2024-07-26T08:48:04.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.527+0000 7f673e5e0740 1 Processor -- start 2024-07-26T08:48:04.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 -- start start 2024-07-26T08:48:04.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba61031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67301b5080 con 0x55eba5d1a390 2024-07-26T08:48:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f67301b3540 con 0x55eba5d121b0 2024-07-26T08:48:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f673e5e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f67301b49b0 con 0x55eba5d3b070 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f6735800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f6735800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60dcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47028/0 (socket says 172.21.15.43:47028) 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.528+0000 7f672fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 -- 172.21.15.43:0/2492490432 learned_addr learned my addr 172.21.15.43:0/2492490432 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba61031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 -- 172.21.15.43:0/2492490432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 msgr2=0x55eba61031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba61031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 -- 172.21.15.43:0/2492490432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 msgr2=0x55eba60e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 -- 172.21.15.43:0/2492490432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eba60ee360 con 0x55eba5d121b0 2024-07-26T08:48:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.529+0000 7f6735800640 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60dcef0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6728005b40 tx=0x7f6728014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95dc335f002d11f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:04.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.530+0000 7f6721600640 1 -- 172.21.15.43:0/2492490432 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67280040d0 con 0x55eba5d121b0 2024-07-26T08:48:04.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.530+0000 7f6721600640 1 -- 172.21.15.43:0/2492490432 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6728004420 con 0x55eba5d121b0 2024-07-26T08:48:04.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.530+0000 7f6721600640 1 -- 172.21.15.43:0/2492490432 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728009c60 con 0x55eba5d121b0 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 -- 172.21.15.43:0/2492490432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 msgr2=0x55eba60dcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60dcef0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6728005b40 tx=0x7f6728014040 comp rx=0 tx=0).stop 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 -- 172.21.15.43:0/2492490432 shutdown_connections 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d3b070 0x55eba61031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d1a390 0x55eba60e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 --2- 172.21.15.43:0/2492490432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d121b0 0x55eba60dcef0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.531+0000 7f673e5e0740 1 -- 172.21.15.43:0/2492490432 >> 172.21.15.43:0/2492490432 conn(0x55eba5d2f460 msgr2=0x55eba60e1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.532+0000 7f673e5e0740 1 -- 172.21.15.43:0/2492490432 shutdown_connections 2024-07-26T08:48:04.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.532+0000 7f673e5e0740 1 -- 172.21.15.43:0/2492490432 wait complete. 2024-07-26T08:48:04.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.532+0000 7f673e5e0740 1 -- start start 2024-07-26T08:48:04.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 Processor -- start 2024-07-26T08:48:04.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 0x55eba60f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d3b070 0x55eba60f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67301b42e0 con 0x55eba5d3b070 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f67301b3c10 con 0x55eba5d1a390 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eba6056bc0 con 0x55eba5d121b0 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.533+0000 7f673e5e0740 10 client.0 _ll_register_callbacks cb 0x7f6728004020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f6735800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f6735800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d3b070 0x55eba60f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 0x55eba60f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 0x55eba60f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47042/0 (socket says 172.21.15.43:47042) 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 -- 172.21.15.43:0/3495542926 learned_addr learned my addr 172.21.15.43:0/3495542926 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 -- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 msgr2=0x55eba60f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 -- 172.21.15.43:0/3495542926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d3b070 msgr2=0x55eba60f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d3b070 0x55eba60f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.534+0000 7f672fe00640 1 -- 172.21.15.43:0/3495542926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eba61641a0 con 0x55eba5d1a390 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f672fe00640 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 0x55eba60f0770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f671c000c00 tx=0x7f671c004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b413787604619ee server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f6716a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f6716a00640 1 -- 172.21.15.43:0/3495542926 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c035040 con 0x55eba5d1a390 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6728004420 con 0x55eba5d1a390 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f6716a00640 1 -- 172.21.15.43:0/3495542926 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 13322+0+0 (secure 0 0 0) 0x7f671c005590 con 0x55eba5d1a390 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f6716a00640 1 -- 172.21.15.43:0/3495542926 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=320) ==== 24+0+0 (secure 0 0 0) 0x7f671c057050 con 0x55eba5d1a390 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f673e5e0740 10 client.26429 fetch_fsmap learned FSMap version 320 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.535+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=320,monmap=4+}) -- 0x55eba6165300 con 0x55eba5d1a390 2024-07-26T08:48:04.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f6716a00640 1 -- 172.21.15.43:0/3495542926 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6728004420 con 0x55eba5d1a390 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f6716a00640 1 -- 172.21.15.43:0/3495542926 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 320) ==== 4123+0+0 (secure 0 0 0) 0x7f671c031a70 con 0x55eba5d1a390 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f673e5e0740 10 client.26429 fetch_fsmap finished waiting for FSMap version 320 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f673e5e0740 10 client.26429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f673e5e0740 20 client.26429 populate_metadata read hostname 'smithi043' 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cceda0 0x55eba6167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f673e5e0740 4 client.26429 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.536+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eba60545b0 con 0x55eba5cceda0 2024-07-26T08:48:04.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.537+0000 7f6735800640 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cceda0 0x55eba6167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:04.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.537+0000 7f6716a00640 10 client.26429 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:04.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.537+0000 7f6735800640 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cceda0 0x55eba6167ad0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d68adfa6949a462f server_cookie=efcf06f5426b6b96 in_seq=0 out_seq=0 2024-07-26T08:48:04.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.537+0000 7f6716a00640 1 -- 172.21.15.43:0/3495542926 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55eba60545b0 con 0x55eba5cceda0 2024-07-26T08:48:04.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.537+0000 7f6716a00640 10 client.26429 handle_command_reply: tid=0 2024-07-26T08:48:04.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 client.26429 shutdown 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 msgr2=0x55eba60f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 0x55eba60f0770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f671c000c00 tx=0x7f671c004580 comp rx=0 tx=0).stop 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 shutdown_connections 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55eba5cceda0 0x55eba6167ad0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eba5d3b070 0x55eba60f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55eba5d1a390 0x55eba60f0770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 --2- 172.21.15.43:0/3495542926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eba5d121b0 0x55eba60f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 >> 172.21.15.43:0/3495542926 conn(0x55eba5d2f460 msgr2=0x55eba60dccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f6716a00640 0 client.26429 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 shutdown_connections 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 1 -- 172.21.15.43:0/3495542926 wait complete. 2024-07-26T08:48:04.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.538+0000 7f673e5e0740 20 client.26429 trim_cache size 0 max 16384 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:48:04.542 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:48:04.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f67180b3d40 msgr2=0x7f67180b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f67180b3d40 0x7f67180b6250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f67240ab020 tx=0x7f6724009310 comp rx=0 tx=0).stop 2024-07-26T08:48:04.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 msgr2=0x7f673019c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:04.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 0x7f673019c050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f672400e9f0 tx=0x7f672400edf0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 shutdown_connections 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f67180b3d40 0x7f67180b6250 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6730109670 0x7f67301a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6730108d20 0x7f673019c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 --2- 172.21.15.43:0/2160834208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67301033e0 0x7f673019c050 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.539+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 >> 172.21.15.43:0/2160834208 conn(0x7f67300fee30 msgr2=0x7f67301083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.540+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 shutdown_connections 2024-07-26T08:48:04.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:04.540+0000 7f6736200640 1 -- 172.21.15.43:0/2160834208 wait complete. 2024-07-26T08:48:04.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:04 smithi043 ceph-mon[32384]: pgmap v987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 4 op/s 2024-07-26T08:48:04.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:04 smithi043 ceph-mon[32384]: pgmap v988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 4 op/s 2024-07-26T08:48:04.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:04 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:resolve 2024-07-26T08:48:04.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:04 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:04 smithi133 ceph-mon[37053]: pgmap v987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 4 op/s 2024-07-26T08:48:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:04 smithi133 ceph-mon[37053]: pgmap v988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 4 op/s 2024-07-26T08:48:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:04 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:resolve 2024-07-26T08:48:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:04 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:04 smithi063 ceph-mon[36747]: pgmap v987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 4 op/s 2024-07-26T08:48:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:04 smithi063 ceph-mon[36747]: pgmap v988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 4 op/s 2024-07-26T08:48:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:04 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:resolve 2024-07-26T08:48:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:04 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:05.519 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:48:05.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:05 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 731.721259 secs 2024-07-26T08:48:05.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:05 smithi043 ceph-mon[32384]: slow request 724.414272 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:48:05.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:05 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:48:05.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:05 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:reconnect 2024-07-26T08:48:05.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:05 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:05.839 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:05 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:48:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:05 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 731.721259 secs 2024-07-26T08:48:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:05 smithi133 ceph-mon[37053]: slow request 724.414272 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:48:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:05 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:48:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:05 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:reconnect 2024-07-26T08:48:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:05 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:05 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:05 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 731.721259 secs 2024-07-26T08:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:05 smithi063 ceph-mon[36747]: slow request 724.414272 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T08:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:05 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00299996 2024-07-26T08:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:05 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:reconnect 2024-07-26T08:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:05 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:05 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00999988 2024-07-26T08:48:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:06 smithi043 ceph-mon[32384]: pgmap v989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 4 op/s 2024-07-26T08:48:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 747.207627 secs 2024-07-26T08:48:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:06 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:rejoin 2024-07-26T08:48:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:06 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:06 smithi043 ceph-mon[32384]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:06 smithi133 ceph-mon[37053]: pgmap v989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 4 op/s 2024-07-26T08:48:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 747.207627 secs 2024-07-26T08:48:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:06 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:rejoin 2024-07-26T08:48:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:06 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:06 smithi133 ceph-mon[37053]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:06 smithi063 ceph-mon[36747]: pgmap v989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 4 op/s 2024-07-26T08:48:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 747.207627 secs 2024-07-26T08:48:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:06 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:rejoin 2024-07-26T08:48:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:06 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:06 smithi063 ceph-mon[36747]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:07.618 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:48:07.618 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: *** Caught signal (Aborted) ** 2024-07-26T08:48:07.618 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: in thread 7fdce9e00640 thread_name:ms_dispatch 2024-07-26T08:48:07.618 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:07.618 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdcf003e6f0] 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fdcf008b94c] 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 3: raise() 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 4: abort() 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 5: /lib64/libc.so.6(+0x2871b) [0x7fdcf002871b] 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 6: /lib64/libc.so.6(+0x37386) [0x7fdcf0037386] 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a8b2c6c6b9] 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a8b2e2a80c] 2024-07-26T08:48:07.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a8b2d6a2ca] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a8b2d3a753] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a8b2d3ba1b] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a8b2d1f752] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a8b2c6da56] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a8b2c71637] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a8b2c71f5e] 2024-07-26T08:48:07.620 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a8b2c5503a] 2024-07-26T08:48:07.621 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fdcf0b9b407] 2024-07-26T08:48:07.621 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 18: (DispatchQueue::entry()+0x60f) [0x7fdcf0b9bcf9] 2024-07-26T08:48:07.621 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fdcf0c785a1] 2024-07-26T08:48:07.621 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 20: (Thread::entry_wrapper()+0x43) [0x7fdcf0a25cdd] 2024-07-26T08:48:07.621 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 21: (Thread::_entry_func(void*)+0xd) [0x7fdcf0a25cf9] 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 22: /lib64/libc.so.6(+0x89c02) [0x7fdcf0089c02] 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fdcf010ec40] 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.344+0000 7fdce9e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: in thread 7fdce9e00640 thread_name:ms_dispatch 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdcf003e6f0] 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fdcf008b94c] 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 3: raise() 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 4: abort() 2024-07-26T08:48:07.622 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 5: /lib64/libc.so.6(+0x2871b) [0x7fdcf002871b] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 6: /lib64/libc.so.6(+0x37386) [0x7fdcf0037386] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a8b2c6c6b9] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a8b2e2a80c] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a8b2d6a2ca] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a8b2d3a753] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a8b2d3ba1b] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a8b2d1f752] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a8b2c6da56] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a8b2c71637] 2024-07-26T08:48:07.623 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a8b2c71f5e] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a8b2c5503a] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fdcf0b9b407] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 18: (DispatchQueue::entry()+0x60f) [0x7fdcf0b9bcf9] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fdcf0c785a1] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 20: (Thread::entry_wrapper()+0x43) [0x7fdcf0a25cdd] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 21: (Thread::_entry_func(void*)+0xd) [0x7fdcf0a25cf9] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 22: /lib64/libc.so.6(+0x89c02) [0x7fdcf0089c02] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fdcf010ec40] 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 0> 2024-07-26T08:48:07.344+0000 7fdce9e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: in thread 7fdce9e00640 thread_name:ms_dispatch 2024-07-26T08:48:07.624 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdcf003e6f0] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fdcf008b94c] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 3: raise() 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 4: abort() 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 5: /lib64/libc.so.6(+0x2871b) [0x7fdcf002871b] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 6: /lib64/libc.so.6(+0x37386) [0x7fdcf0037386] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a8b2c6c6b9] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a8b2e2a80c] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a8b2d6a2ca] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a8b2d3a753] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a8b2d3ba1b] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a8b2d1f752] 2024-07-26T08:48:07.625 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a8b2c6da56] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a8b2c71637] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a8b2c71f5e] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a8b2c5503a] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fdcf0b9b407] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 18: (DispatchQueue::entry()+0x60f) [0x7fdcf0b9bcf9] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fdcf0c785a1] 2024-07-26T08:48:07.626 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 20: (Thread::entry_wrapper()+0x43) [0x7fdcf0a25cdd] 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 21: (Thread::_entry_func(void*)+0xd) [0x7fdcf0a25cf9] 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 22: /lib64/libc.so.6(+0x89c02) [0x7fdcf0089c02] 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fdcf010ec40] 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 0> 2024-07-26T08:48:07.344+0000 7fdce9e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: in thread 7fdce9e00640 thread_name:ms_dispatch 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdcf003e6f0] 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fdcf008b94c] 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 3: raise() 2024-07-26T08:48:07.627 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 4: abort() 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 5: /lib64/libc.so.6(+0x2871b) [0x7fdcf002871b] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 6: /lib64/libc.so.6(+0x37386) [0x7fdcf0037386] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a8b2c6c6b9] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a8b2e2a80c] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a8b2d6a2ca] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a8b2d3a753] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a8b2d3ba1b] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a8b2d1f752] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a8b2c6da56] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a8b2c71637] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a8b2c71f5e] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a8b2c5503a] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fdcf0b9b407] 2024-07-26T08:48:07.628 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 18: (DispatchQueue::entry()+0x60f) [0x7fdcf0b9bcf9] 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fdcf0c785a1] 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 20: (Thread::entry_wrapper()+0x43) [0x7fdcf0a25cdd] 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 21: (Thread::_entry_func(void*)+0xd) [0x7fdcf0a25cf9] 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 22: /lib64/libc.so.6(+0x89c02) [0x7fdcf0089c02] 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fdcf010ec40] 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110148]: 2024-07-26T08:48:07.629 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:07 smithi043 podman[110426]: 2024-07-26 08:48:07.518163286 +0000 UTC m=+0.040541784 container died a564b48ba7e92edbcb051fc5ed4b1eca521e721695527053725e2e0fdbf720ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T08:48:07.943 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:07.943 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:active 2024-07-26T08:48:07.943 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:07 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:07 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:07 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:active 2024-07-26T08:48:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:07 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:08.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:07 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:07 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1786973356,v1:172.21.15.43:6835/1786973356] up:active 2024-07-26T08:48:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:07 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:08.618 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:08 smithi043 podman[110426]: 2024-07-26 08:48:08.324731775 +0000 UTC m=+0.847110314 container remove a564b48ba7e92edbcb051fc5ed4b1eca521e721695527053725e2e0fdbf720ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-07-26T08:48:08.619 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:08 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:48:08.906 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:08 smithi043 ceph-mon[32384]: pgmap v990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 4 op/s 2024-07-26T08:48:09.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:08 smithi133 ceph-mon[37053]: pgmap v990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 4 op/s 2024-07-26T08:48:09.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:08 smithi063 ceph-mon[36747]: pgmap v990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 4 op/s 2024-07-26T08:48:09.218 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:08 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:48:09.219 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:08 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.336s CPU time. 2024-07-26T08:48:10.882 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:10 smithi043 ceph-mon[32384]: pgmap v991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 141 B/s wr, 9 op/s 2024-07-26T08:48:10.882 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 736.721376 secs 2024-07-26T08:48:10.882 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 752.207748 secs 2024-07-26T08:48:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:10 smithi133 ceph-mon[37053]: pgmap v991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 141 B/s wr, 9 op/s 2024-07-26T08:48:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 736.721376 secs 2024-07-26T08:48:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 752.207748 secs 2024-07-26T08:48:11.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:10 smithi063 ceph-mon[36747]: pgmap v991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 141 B/s wr, 9 op/s 2024-07-26T08:48:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 736.721376 secs 2024-07-26T08:48:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 752.207748 secs 2024-07-26T08:48:12.923 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:12 smithi043 ceph-mon[32384]: pgmap v992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 243 B/s wr, 10 op/s 2024-07-26T08:48:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:12 smithi133 ceph-mon[37053]: pgmap v992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 243 B/s wr, 10 op/s 2024-07-26T08:48:13.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:12 smithi063 ceph-mon[36747]: pgmap v992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 243 B/s wr, 10 op/s 2024-07-26T08:48:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:14 smithi043 ceph-mon[32384]: pgmap v993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:15.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:14 smithi133 ceph-mon[37053]: pgmap v993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:15.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:14 smithi063 ceph-mon[36747]: pgmap v993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:15.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 741.721492 secs 2024-07-26T08:48:15.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 757.207888 secs 2024-07-26T08:48:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 741.721492 secs 2024-07-26T08:48:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 757.207888 secs 2024-07-26T08:48:16.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 741.721492 secs 2024-07-26T08:48:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 757.207888 secs 2024-07-26T08:48:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:16 smithi043 ceph-mon[32384]: pgmap v994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:16 smithi133 ceph-mon[37053]: pgmap v994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:16 smithi063 ceph-mon[36747]: pgmap v994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:18 smithi043 ceph-mon[32384]: pgmap v995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:19.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:18 smithi133 ceph-mon[37053]: pgmap v995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:18 smithi063 ceph-mon[36747]: pgmap v995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:19.384 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:18 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 4. 2024-07-26T08:48:19.384 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:18 smithi043 systemd[1]: Stopped Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:19.384 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:18 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.336s CPU time. 2024-07-26T08:48:19.384 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 systemd[1]: Starting Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:48:19.667 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 podman[110520]: 2024-07-26 08:48:19.287612605 +0000 UTC m=+0.034578198 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:48:19.668 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 podman[110520]: 2024-07-26 08:48:19.434675469 +0000 UTC m=+0.181641085 container create 649cf1f46a75aec9f7ee65fc9250a7790200e8515adcb4bb3bd1771feae5046b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-07-26T08:48:20.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 podman[110520]: 2024-07-26 08:48:19.77228423 +0000 UTC m=+0.519249883 container init 649cf1f46a75aec9f7ee65fc9250a7790200e8515adcb4bb3bd1771feae5046b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724) 2024-07-26T08:48:20.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 podman[110520]: 2024-07-26 08:48:19.78292822 +0000 UTC m=+0.529893843 container start 649cf1f46a75aec9f7ee65fc9250a7790200e8515adcb4bb3bd1771feae5046b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-07-26T08:48:20.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 ceph-mds[110538]: -- 172.21.15.43:0/697948501 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e951e67860 con 0x55e956009180 2024-07-26T08:48:20.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: starting mds.j at 2024-07-26T08:48:20.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 bash[110520]: 649cf1f46a75aec9f7ee65fc9250a7790200e8515adcb4bb3bd1771feae5046b 2024-07-26T08:48:20.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:19 smithi043 systemd[1]: Started Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: pgmap v996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: daemon mds.j restarted 2024-07-26T08:48:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: osdmap e136: 12 total, 12 up, 12 in 2024-07-26T08:48:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:boot 2024-07-26T08:48:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 746.721634 secs 2024-07-26T08:48:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 762.207966 secs 2024-07-26T08:48:21.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: pgmap v996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: daemon mds.j restarted 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: osdmap e136: 12 total, 12 up, 12 in 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:boot 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 746.721634 secs 2024-07-26T08:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 762.207966 secs 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: pgmap v996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: daemon mds.j restarted 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: osdmap e136: 12 total, 12 up, 12 in 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:boot 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:21.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:21.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:21.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 746.721634 secs 2024-07-26T08:48:21.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 762.207966 secs 2024-07-26T08:48:22.191 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:21 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:resolve 2024-07-26T08:48:22.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:21 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:22.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:21 smithi043 ceph-mon[32384]: pgmap v998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:48:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:21 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:resolve 2024-07-26T08:48:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:21 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:21 smithi133 ceph-mon[37053]: pgmap v998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:48:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:21 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:resolve 2024-07-26T08:48:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:21 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:21 smithi063 ceph-mon[36747]: pgmap v998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:48:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:22 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:reconnect 2024-07-26T08:48:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:22 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:22 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0129998 2024-07-26T08:48:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:22 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0129998 2024-07-26T08:48:23.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:22 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:reconnect 2024-07-26T08:48:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:22 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:22 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0129998 2024-07-26T08:48:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:22 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0129998 2024-07-26T08:48:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:22 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:reconnect 2024-07-26T08:48:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:22 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:22 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.0129998 2024-07-26T08:48:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:22 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.0129998 2024-07-26T08:48:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:rejoin 2024-07-26T08:48:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-mon[32384]: pgmap v999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5 op/s 2024-07-26T08:48:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-mon[32384]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: *** Caught signal (Aborted) ** 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: in thread 7f87a7c00640 thread_name:ms_dispatch 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f87ade3e6f0] 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f87ade8b94c] 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 3: raise() 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 4: abort() 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 5: /lib64/libc.so.6(+0x2871b) [0x7f87ade2871b] 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 6: /lib64/libc.so.6(+0x37386) [0x7f87ade37386] 2024-07-26T08:48:24.235 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e945b3f6b9] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e945cfd80c] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e945c3d2ca] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e945c0d753] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e945c0ea1b] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e945bf2752] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e945b40a56] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e945b44637] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e945b44f5e] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e945b2803a] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f87ae99b407] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 18: (DispatchQueue::entry()+0x60f) [0x7f87ae99bcf9] 2024-07-26T08:48:24.236 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f87aea785a1] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 20: (Thread::entry_wrapper()+0x43) [0x7f87ae825cdd] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 21: (Thread::_entry_func(void*)+0xd) [0x7f87ae825cf9] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 22: /lib64/libc.so.6(+0x89c02) [0x7f87ade89c02] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f87adf0ec40] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:23.997+0000 7f87a7c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: in thread 7f87a7c00640 thread_name:ms_dispatch 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f87ade3e6f0] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f87ade8b94c] 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 3: raise() 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 4: abort() 2024-07-26T08:48:24.237 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 5: /lib64/libc.so.6(+0x2871b) [0x7f87ade2871b] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 6: /lib64/libc.so.6(+0x37386) [0x7f87ade37386] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e945b3f6b9] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e945cfd80c] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e945c3d2ca] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e945c0d753] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e945c0ea1b] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e945bf2752] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e945b40a56] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e945b44637] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e945b44f5e] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e945b2803a] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f87ae99b407] 2024-07-26T08:48:24.238 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 18: (DispatchQueue::entry()+0x60f) [0x7f87ae99bcf9] 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f87aea785a1] 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 20: (Thread::entry_wrapper()+0x43) [0x7f87ae825cdd] 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 21: (Thread::_entry_func(void*)+0xd) [0x7f87ae825cf9] 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 22: /lib64/libc.so.6(+0x89c02) [0x7f87ade89c02] 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f87adf0ec40] 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 0> 2024-07-26T08:48:23.997+0000 7f87a7c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: in thread 7f87a7c00640 thread_name:ms_dispatch 2024-07-26T08:48:24.239 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f87ade3e6f0] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f87ade8b94c] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 3: raise() 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 4: abort() 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 5: /lib64/libc.so.6(+0x2871b) [0x7f87ade2871b] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 6: /lib64/libc.so.6(+0x37386) [0x7f87ade37386] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e945b3f6b9] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e945cfd80c] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e945c3d2ca] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e945c0d753] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e945c0ea1b] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e945bf2752] 2024-07-26T08:48:24.240 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e945b40a56] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e945b44637] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e945b44f5e] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e945b2803a] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f87ae99b407] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 18: (DispatchQueue::entry()+0x60f) [0x7f87ae99bcf9] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f87aea785a1] 2024-07-26T08:48:24.241 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 20: (Thread::entry_wrapper()+0x43) [0x7f87ae825cdd] 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 21: (Thread::_entry_func(void*)+0xd) [0x7f87ae825cf9] 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 22: /lib64/libc.so.6(+0x89c02) [0x7f87ade89c02] 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f87adf0ec40] 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 0> 2024-07-26T08:48:23.997+0000 7f87a7c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: in thread 7f87a7c00640 thread_name:ms_dispatch 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f87ade3e6f0] 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f87ade8b94c] 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 3: raise() 2024-07-26T08:48:24.242 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 4: abort() 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 5: /lib64/libc.so.6(+0x2871b) [0x7f87ade2871b] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 6: /lib64/libc.so.6(+0x37386) [0x7f87ade37386] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e945b3f6b9] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e945cfd80c] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e945c3d2ca] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e945c0d753] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e945c0ea1b] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e945bf2752] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e945b40a56] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e945b44637] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e945b44f5e] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e945b2803a] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f87ae99b407] 2024-07-26T08:48:24.243 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 18: (DispatchQueue::entry()+0x60f) [0x7f87ae99bcf9] 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f87aea785a1] 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 20: (Thread::entry_wrapper()+0x43) [0x7f87ae825cdd] 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 21: (Thread::_entry_func(void*)+0xd) [0x7f87ae825cf9] 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 22: /lib64/libc.so.6(+0x89c02) [0x7f87ade89c02] 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f87adf0ec40] 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110534]: 2024-07-26T08:48:24.244 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:24 smithi043 podman[110572]: 2024-07-26 08:48:24.175619994 +0000 UTC m=+0.039516673 container died 649cf1f46a75aec9f7ee65fc9250a7790200e8515adcb4bb3bd1771feae5046b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-07-26T08:48:24.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:23 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:rejoin 2024-07-26T08:48:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:23 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:23 smithi133 ceph-mon[37053]: pgmap v999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5 op/s 2024-07-26T08:48:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:23 smithi133 ceph-mon[37053]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:23 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:rejoin 2024-07-26T08:48:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:23 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:23 smithi063 ceph-mon[36747]: pgmap v999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5 op/s 2024-07-26T08:48:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:23 smithi063 ceph-mon[36747]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:active 2024-07-26T08:48:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:24 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:25.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:25 smithi043 podman[110572]: 2024-07-26 08:48:25.077105908 +0000 UTC m=+0.941002583 container remove 649cf1f46a75aec9f7ee65fc9250a7790200e8515adcb4bb3bd1771feae5046b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-07-26T08:48:25.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:48:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:24 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:24 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:active 2024-07-26T08:48:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:24 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:24 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:24 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/1153480487,v1:172.21.15.43:6835/1153480487] up:active 2024-07-26T08:48:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:24 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:25.983 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:48:25.983 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:25 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.232s CPU time. 2024-07-26T08:48:26.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:25 smithi133 ceph-mon[37053]: pgmap v1000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7 op/s 2024-07-26T08:48:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 751.721706 secs 2024-07-26T08:48:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 767.208046 secs 2024-07-26T08:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:25 smithi063 ceph-mon[36747]: pgmap v1000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7 op/s 2024-07-26T08:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 751.721706 secs 2024-07-26T08:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 767.208046 secs 2024-07-26T08:48:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:25 smithi043 ceph-mon[32384]: pgmap v1000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7 op/s 2024-07-26T08:48:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 751.721706 secs 2024-07-26T08:48:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 767.208046 secs 2024-07-26T08:48:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:28 smithi043 ceph-mon[32384]: pgmap v1001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 7 op/s 2024-07-26T08:48:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:28 smithi063 ceph-mon[36747]: pgmap v1001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 7 op/s 2024-07-26T08:48:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:28 smithi133 ceph-mon[37053]: pgmap v1001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 7 op/s 2024-07-26T08:48:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:30 smithi043 ceph-mon[32384]: pgmap v1002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:30.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:30 smithi133 ceph-mon[37053]: pgmap v1002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:30 smithi063 ceph-mon[36747]: pgmap v1002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 756.721820 secs 2024-07-26T08:48:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 772.208153 secs 2024-07-26T08:48:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 756.721820 secs 2024-07-26T08:48:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 772.208153 secs 2024-07-26T08:48:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 756.721820 secs 2024-07-26T08:48:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 772.208153 secs 2024-07-26T08:48:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:32 smithi043 ceph-mon[32384]: pgmap v1003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:48:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:32 smithi133 ceph-mon[37053]: pgmap v1003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:48:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:32 smithi063 ceph-mon[36747]: pgmap v1003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 184 B/s wr, 9 op/s 2024-07-26T08:48:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:34 smithi043 ceph-mon[32384]: pgmap v1004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:34 smithi133 ceph-mon[37053]: pgmap v1004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:34 smithi063 ceph-mon[36747]: pgmap v1004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T08:48:35.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:48:35.982 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:35 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 5. 2024-07-26T08:48:35.982 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:35 smithi043 systemd[1]: Stopped Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:35.983 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:35 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.232s CPU time. 2024-07-26T08:48:35.983 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:35 smithi043 systemd[1]: Starting Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T08:48:36.014 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:48:36.386 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 podman[110732]: 2024-07-26 08:48:36.042696729 +0000 UTC m=+0.038048918 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T08:48:36.386 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 podman[110732]: 2024-07-26 08:48:36.169726671 +0000 UTC m=+0.165078853 container create ce8f7d40898751bbb0a7b0484a03b4fe42977ab02d71c271461e872eedbe1052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-07-26T08:48:36.387 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:36 smithi043 ceph-mon[32384]: pgmap v1005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:36.387 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 761.721958 secs 2024-07-26T08:48:36.387 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 777.208216 secs 2024-07-26T08:48:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:36 smithi133 ceph-mon[37053]: pgmap v1005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 761.721958 secs 2024-07-26T08:48:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 777.208216 secs 2024-07-26T08:48:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:36 smithi063 ceph-mon[36747]: pgmap v1005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 761.721958 secs 2024-07-26T08:48:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 777.208216 secs 2024-07-26T08:48:36.760 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 podman[110732]: 2024-07-26 08:48:36.49114468 +0000 UTC m=+0.486496883 container init ce8f7d40898751bbb0a7b0484a03b4fe42977ab02d71c271461e872eedbe1052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-07-26T08:48:36.760 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 podman[110732]: 2024-07-26 08:48:36.503204277 +0000 UTC m=+0.498556444 container start ce8f7d40898751bbb0a7b0484a03b4fe42977ab02d71c271461e872eedbe1052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-26T08:48:36.761 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 ceph-mds[110765]: -- 172.21.15.43:0/887205912 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b34207860 con 0x557b383a9180 2024-07-26T08:48:36.761 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: starting mds.j at 2024-07-26T08:48:36.761 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 bash[110732]: ce8f7d40898751bbb0a7b0484a03b4fe42977ab02d71c271461e872eedbe1052 2024-07-26T08:48:36.761 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:36 smithi043 systemd[1]: Started Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: daemon mds.j restarted 2024-07-26T08:48:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: osdmap e137: 12 total, 12 up, 12 in 2024-07-26T08:48:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:boot 2024-07-26T08:48:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:37 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: daemon mds.j restarted 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: osdmap e137: 12 total, 12 up, 12 in 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:boot 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:37 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: daemon mds.j restarted 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: osdmap e137: 12 total, 12 up, 12 in 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:boot 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: fsmap cephfs:2/3 {0=c=up:active,2=i=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-07-26T08:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:37 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:replay,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:38.699 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:38 smithi043 ceph-mon[32384]: pgmap v1007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:48:38.699 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:38 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:resolve 2024-07-26T08:48:38.700 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:38 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:39.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:38 smithi133 ceph-mon[37053]: pgmap v1007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:48:39.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:38 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:resolve 2024-07-26T08:48:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:38 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:39.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:38 smithi063 ceph-mon[36747]: pgmap v1007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:48:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:38 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:resolve 2024-07-26T08:48:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:38 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:resolve,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 -- 172.21.15.43:0/937906649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 msgr2=0x7f7340106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 --2- 172.21.15.43:0/937906649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f7340106e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7328009900 tx=0x7f732802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 -- 172.21.15.43:0/937906649 shutdown_connections 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 --2- 172.21.15.43:0/937906649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f7340106e70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 --2- 172.21.15.43:0/937906649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7340107430 0x7f7340107910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 --2- 172.21.15.43:0/937906649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f7340102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 -- 172.21.15.43:0/937906649 >> 172.21.15.43:0/937906649 conn(0x7f73400fdd00 msgr2=0x7f7340100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 -- 172.21.15.43:0/937906649 shutdown_connections 2024-07-26T08:48:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.074+0000 7f733fe00640 1 -- 172.21.15.43:0/937906649 wait complete. 2024-07-26T08:48:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.076+0000 7f733fe00640 1 Processor -- start 2024-07-26T08:48:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.076+0000 7f733fe00640 1 -- start start 2024-07-26T08:48:39.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f73401a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f73401a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7340107430 0x7f73401a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73401199f0 con 0x7f7340107430 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7340119870 con 0x7f7340101ff0 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7340119b70 con 0x7f7340102940 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f73401a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f73401a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52362/0 (socket says 172.21.15.43:52362) 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733ea00640 1 -- 172.21.15.43:0/2422435490 learned_addr learned my addr 172.21.15.43:0/2422435490 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f7337e00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f73401a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.077+0000 7f733f400640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7340107430 0x7f73401a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f7337e00640 1 -- 172.21.15.43:0/2422435490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 msgr2=0x7f73401a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f7337e00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f73401a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f7337e00640 1 -- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7340107430 msgr2=0x7f73401a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f7337e00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7340107430 0x7f73401a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f7337e00640 1 -- 172.21.15.43:0/2422435490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73401a6390 con 0x7f7340102940 2024-07-26T08:48:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f733ea00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f73401a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:48:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.078+0000 7f7337e00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f73401a09c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f732802a910 tx=0x7f73280049d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.079+0000 7f7337400640 1 -- 172.21.15.43:0/2422435490 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732803f030 con 0x7f7340102940 2024-07-26T08:48:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.079+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73401a6620 con 0x7f7340102940 2024-07-26T08:48:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.079+0000 7f7337400640 1 -- 172.21.15.43:0/2422435490 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7328004dd0 con 0x7f7340102940 2024-07-26T08:48:39.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.079+0000 7f7337400640 1 -- 172.21.15.43:0/2422435490 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328035070 con 0x7f7340102940 2024-07-26T08:48:39.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.079+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73401acde0 con 0x7f7340102940 2024-07-26T08:48:39.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.083+0000 7f734c22e740 1 Processor -- start 2024-07-26T08:48:39.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.083+0000 7f734c22e740 1 -- start start 2024-07-26T08:48:39.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f734c22e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f734c22e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f734c22e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a432da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f734c22e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0a42a3bc0 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f734c22e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a0a42930c0 con 0x55a0a3f88070 2024-07-26T08:48:39.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f734c22e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a0a4297100 con 0x55a0a3f67390 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f733ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f733f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f733ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36710/0 (socket says 172.21.15.43:36710) 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f733f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52376/0 (socket says 172.21.15.43:52376) 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.084+0000 7f733ea00640 1 -- 172.21.15.43:0/684505488 learned_addr learned my addr 172.21.15.43:0/684505488 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f7337400640 1 -- 172.21.15.43:0/2422435490 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7328042030 con 0x7f7340102940 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733f400640 1 -- 172.21.15.43:0/684505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 msgr2=0x55a0a432da80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733f400640 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a432da80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733f400640 1 -- 172.21.15.43:0/684505488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 msgr2=0x55a0a432d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733f400640 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733f400640 1 -- 172.21.15.43:0/684505488 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0a3ff3650 con 0x55a0a3f88070 2024-07-26T08:48:39.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733ea00640 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:48:39.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.085+0000 7f733f400640 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432d000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7338009f30 tx=0x7f7338010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=844255cd2d170777 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.086+0000 7f732f400640 1 -- 172.21.15.43:0/684505488 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338016070 con 0x55a0a3f88070 2024-07-26T08:48:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.086+0000 7f732f400640 1 -- 172.21.15.43:0/684505488 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7338004d20 con 0x55a0a3f88070 2024-07-26T08:48:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.086+0000 7f732f400640 1 -- 172.21.15.43:0/684505488 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338012770 con 0x55a0a3f88070 2024-07-26T08:48:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.087+0000 7f7337400640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73240b3d40 0x7f73240b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.087+0000 7f734c22e740 1 -- 172.21.15.43:0/684505488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 msgr2=0x55a0a432d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.087+0000 7f734c22e740 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432d000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7338009f30 tx=0x7f7338010800 comp rx=0 tx=0).stop 2024-07-26T08:48:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.087+0000 7f7337400640 1 -- 172.21.15.43:0/2422435490 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f7328105710 con 0x7f7340102940 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f734c22e740 1 -- 172.21.15.43:0/684505488 shutdown_connections 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f734c22e740 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a432da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f734c22e740 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f734c22e740 1 --2- 172.21.15.43:0/684505488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432d000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f734c22e740 1 -- 172.21.15.43:0/684505488 >> 172.21.15.43:0/684505488 conn(0x55a0a3f7c460 msgr2=0x55a0a432aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f733ea00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73240b3d40 0x7f73240b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.088+0000 7f734c22e740 1 -- 172.21.15.43:0/684505488 shutdown_connections 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.089+0000 7f734c22e740 1 -- 172.21.15.43:0/684505488 wait complete. 2024-07-26T08:48:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.089+0000 7f733ea00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73240b3d40 0x7f73240b6250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55a0a432bc80 tx=0x7f7330005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.089+0000 7f734c22e740 1 -- start start 2024-07-26T08:48:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 Processor -- start 2024-07-26T08:48:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4338620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4338b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f88070 0x55a0a43390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0a40f6700 con 0x55a0a3f67390 2024-07-26T08:48:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a0a422f690 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.090+0000 7f734c22e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a0a433b7e0 con 0x55a0a3f88070 2024-07-26T08:48:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f734c22e740 10 client.0 _ll_register_callbacks cb 0x55a0a423f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:48:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4338620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4338620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52382/0 (socket says 172.21.15.43:52382) 2024-07-26T08:48:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 -- 172.21.15.43:0/2777335895 learned_addr learned my addr 172.21.15.43:0/2777335895 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733f400640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f88070 0x55a0a43390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f7337e00640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4338b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 -- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f88070 msgr2=0x55a0a43390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f88070 0x55a0a43390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 -- 172.21.15.43:0/2777335895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 msgr2=0x55a0a4338b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4338b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.091+0000 7f733ea00640 1 -- 172.21.15.43:0/2777335895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0a4246830 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.092+0000 7f733ea00640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4338620 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f733000f800 tx=0x7f7330004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb55547550e65e68 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.092+0000 7f7323e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.092+0000 7f7323e00640 1 -- 172.21.15.43:0/2777335895 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73300119c0 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.092+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7338004d20 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.092+0000 7f7323e00640 1 -- 172.21.15.43:0/2777335895 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f7330011b60 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f7323e00640 1 -- 172.21.15.43:0/2777335895 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=333) ==== 24+0+0 (secure 0 0 0) 0x7f7330011d60 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f734c22e740 10 client.26453 fetch_fsmap learned FSMap version 333 2024-07-26T08:48:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=333,monmap=4+}) -- 0x55a0a43474a0 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f7323e00640 1 -- 172.21.15.43:0/2777335895 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7338004d20 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f7323e00640 1 -- 172.21.15.43:0/2777335895 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 333) ==== 4123+0+0 (secure 0 0 0) 0x7f7330027070 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f734c22e740 10 client.26453 fetch_fsmap finished waiting for FSMap version 333 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f734c22e740 10 client.26453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.093+0000 7f734c22e740 20 client.26453 populate_metadata read hostname 'smithi043' 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.094+0000 7f734c22e740 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f469f0 0x55a0a434ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.094+0000 7f734c22e740 4 client.26453 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.094+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0a42a5b10 con 0x55a0a3f469f0 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.094+0000 7f7337e00640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f469f0 0x55a0a434ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.095+0000 7f7337e00640 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f469f0 0x55a0a434ad90 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86785550f27371e4 server_cookie=71cdf1cdc8460c87 in_seq=0 out_seq=0 2024-07-26T08:48:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.095+0000 7f7323e00640 10 client.26453 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.095+0000 7f7323e00640 1 -- 172.21.15.43:0/2777335895 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0a42a5b10 con 0x55a0a3f469f0 2024-07-26T08:48:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.095+0000 7f7323e00640 10 client.26453 handle_command_reply: tid=0 2024-07-26T08:48:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 client.26453 shutdown 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 msgr2=0x55a0a4338620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4338620 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f733000f800 tx=0x7f7330004730 comp rx=0 tx=0).stop 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 shutdown_connections 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f469f0 0x55a0a434ad90 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f88070 0x55a0a43390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4338b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 --2- 172.21.15.43:0/2777335895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4338620 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f7323e00640 0 client.26453 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 >> 172.21.15.43:0/2777335895 conn(0x55a0a3f7c460 msgr2=0x55a0a432dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 shutdown_connections 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.096+0000 7f734c22e740 1 -- 172.21.15.43:0/2777335895 wait complete. 2024-07-26T08:48:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.097+0000 7f734c22e740 20 client.26453 trim_cache size 0 max 16384 2024-07-26T08:48:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.121+0000 7f734c22e740 1 Processor -- start 2024-07-26T08:48:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 -- start start 2024-07-26T08:48:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4333cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73401b94a0 con 0x55a0a3f67390 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73401b7960 con 0x55a0a3f88070 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f734c22e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f73401b8dd0 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.122+0000 7f7337e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4333cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f7337e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4333cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36724/0 (socket says 172.21.15.43:36724) 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f7337e00640 1 -- 172.21.15.43:0/2687949538 learned_addr learned my addr 172.21.15.43:0/2687949538 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733f400640 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733ea00640 1 -- 172.21.15.43:0/2687949538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 msgr2=0x55a0a432e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733ea00640 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733ea00640 1 -- 172.21.15.43:0/2687949538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 msgr2=0x55a0a4333cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733ea00640 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4333cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.123+0000 7f733ea00640 1 -- 172.21.15.43:0/2687949538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0a4331110 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.164+0000 7f733ea00640 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432a000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f733000f800 tx=0x7f7330011f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b3b74c12c1961a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:39.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.164+0000 7f732ea00640 1 -- 172.21.15.43:0/2687949538 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330027360 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.164+0000 7f732ea00640 1 -- 172.21.15.43:0/2687949538 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7330027500 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.164+0000 7f732ea00640 1 -- 172.21.15.43:0/2687949538 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330021330 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 -- 172.21.15.43:0/2687949538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f5f1b0 msgr2=0x55a0a432a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432a000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f733000f800 tx=0x7f7330011f00 comp rx=0 tx=0).stop 2024-07-26T08:48:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 -- 172.21.15.43:0/2687949538 shutdown_connections 2024-07-26T08:48:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a432e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f67390 0x55a0a4333cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 --2- 172.21.15.43:0/2687949538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f5f1b0 0x55a0a432a000 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.165+0000 7f734c22e740 1 -- 172.21.15.43:0/2687949538 >> 172.21.15.43:0/2687949538 conn(0x55a0a3f7c460 msgr2=0x55a0a432dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.166+0000 7f734c22e740 1 -- 172.21.15.43:0/2687949538 shutdown_connections 2024-07-26T08:48:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.166+0000 7f734c22e740 1 -- 172.21.15.43:0/2687949538 wait complete. 2024-07-26T08:48:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.166+0000 7f734c22e740 1 -- start start 2024-07-26T08:48:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.166+0000 7f734c22e740 1 Processor -- start 2024-07-26T08:48:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4340f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a433c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a433c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73401b8700 con 0x55a0a3f5f1b0 2024-07-26T08:48:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73401b8030 con 0x55a0a3f88070 2024-07-26T08:48:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a0a43383d0 con 0x55a0a3f67390 2024-07-26T08:48:39.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.167+0000 7f734c22e740 10 client.0 _ll_register_callbacks cb 0x7f733000f5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:48:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f733f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a433c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f733ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4340f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a433c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f733f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a433c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:52388/0 (socket says 172.21.15.43:52388) 2024-07-26T08:48:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f733f400640 1 -- 172.21.15.43:0/891728537 learned_addr learned my addr 172.21.15.43:0/891728537 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:48:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 -- 172.21.15.43:0/891728537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 msgr2=0x55a0a433c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a433c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 -- 172.21.15.43:0/891728537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 msgr2=0x55a0a4340f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4340f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 -- 172.21.15.43:0/891728537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0a433ced0 con 0x55a0a3f67390 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7337e00640 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a433c3d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f73280314e0 tx=0x7f73280cabd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f71a3d27daed6b9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.168+0000 7f7323e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f7323e00640 1 -- 172.21.15.43:0/891728537 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328049040 con 0x55a0a3f67390 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7330027500 con 0x55a0a3f67390 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f7323e00640 1 -- 172.21.15.43:0/891728537 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f73280c75f0 con 0x55a0a3f67390 2024-07-26T08:48:39.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f7323e00640 1 -- 172.21.15.43:0/891728537 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=333) ==== 24+0+0 (secure 0 0 0) 0x7f73280d4000 con 0x55a0a3f67390 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f734c22e740 10 client.26431 fetch_fsmap learned FSMap version 333 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=333,monmap=4+}) -- 0x55a0a43b32c0 con 0x55a0a3f67390 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.169+0000 7f7323e00640 1 -- 172.21.15.43:0/891728537 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7330027500 con 0x55a0a3f67390 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f7323e00640 1 -- 172.21.15.43:0/891728537 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 333) ==== 4123+0+0 (secure 0 0 0) 0x7f7328101d10 con 0x55a0a3f67390 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f734c22e740 10 client.26431 fetch_fsmap finished waiting for FSMap version 333 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f734c22e740 10 client.26431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f734c22e740 20 client.26431 populate_metadata read hostname 'smithi043' 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f734c22e740 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f1bda0 0x55a0a43b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f734c22e740 4 client.26431 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0a42a15b0 con 0x55a0a3f1bda0 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.170+0000 7f733ea00640 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f1bda0 0x55a0a43b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f733ea00640 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f1bda0 0x55a0a43b5910 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26717888ad7b5bb0 server_cookie=38135335992b2ac8 in_seq=0 out_seq=0 2024-07-26T08:48:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f7323e00640 10 client.26431 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f7323e00640 1 -- 172.21.15.43:0/891728537 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55a0a42a15b0 con 0x55a0a3f1bda0 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f7323e00640 10 client.26431 handle_command_reply: tid=0 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 client.26431 shutdown 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 msgr2=0x55a0a433c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a433c3d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f73280314e0 tx=0x7f73280cabd0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 shutdown_connections 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55a0a3f1bda0 0x55a0a43b5910 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0a3f67390 0x55a0a433c3d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0a3f88070 0x55a0a433c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 --2- 172.21.15.43:0/891728537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0a3f5f1b0 0x55a0a4340f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 >> 172.21.15.43:0/891728537 conn(0x55a0a3f7c460 msgr2=0x55a0a4330890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f7323e00640 0 client.26431 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 shutdown_connections 2024-07-26T08:48:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.171+0000 7f734c22e740 1 -- 172.21.15.43:0/891728537 wait complete. 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.172+0000 7f734c22e740 20 client.26431 trim_cache size 0 max 16384 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:48:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:48:39.182 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:48:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.172+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73240b3d40 msgr2=0x7f73240b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.172+0000 7f733fe00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73240b3d40 0x7f73240b6250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55a0a432bc80 tx=0x7f7330005f90 comp rx=0 tx=0).stop 2024-07-26T08:48:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.172+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 msgr2=0x7f73401a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:48:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.172+0000 7f733fe00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f73401a09c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f732802a910 tx=0x7f73280049d0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 shutdown_connections 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f73240b3d40 0x7f73240b6250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7340102940 0x7f73401a09c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7340107430 0x7f73401a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 --2- 172.21.15.43:0/2422435490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7340101ff0 0x7f73401a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 >> 172.21.15.43:0/2422435490 conn(0x7f73400fdd00 msgr2=0x7f7340104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 shutdown_connections 2024-07-26T08:48:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:48:39.173+0000 7f733fe00640 1 -- 172.21.15.43:0/2422435490 wait complete. 2024-07-26T08:48:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:40 smithi043 ceph-mon[32384]: pgmap v1008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5 op/s 2024-07-26T08:48:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:40 smithi043 ceph-mon[32384]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:48:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:40 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:reconnect 2024-07-26T08:48:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:40 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:40 smithi043 ceph-mon[32384]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:48:40.447 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:48:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:40 smithi133 ceph-mon[37053]: pgmap v1008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5 op/s 2024-07-26T08:48:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:40 smithi133 ceph-mon[37053]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:48:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:40 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:reconnect 2024-07-26T08:48:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:40 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:40 smithi133 ceph-mon[37053]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:48:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:40 smithi063 ceph-mon[36747]: pgmap v1008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5 op/s 2024-07-26T08:48:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:40 smithi063 ceph-mon[36747]: reconnect by client.25498 172.21.15.43:0/3037420582 after 0.00199998 2024-07-26T08:48:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:40 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:reconnect 2024-07-26T08:48:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:40 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:reconnect,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:40 smithi063 ceph-mon[36747]: reconnect by client.15216 192.168.0.1:0/1938065427 after 0.00899989 2024-07-26T08:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 766.722034 secs 2024-07-26T08:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:rejoin 2024-07-26T08:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-mon[32384]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-mon[32384]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 782.208285 secs 2024-07-26T08:48:41.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T08:48:41.484 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: *** Caught signal (Aborted) ** 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: in thread 7fb465000640 thread_name:ms_dispatch 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb46b23e6f0] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb46b28b94c] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 3: raise() 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 4: abort() 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb46b22871b] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 6: /lib64/libc.so.6(+0x37386) [0x7fb46b237386] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557b2f3c56b9] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557b2f58380c] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557b2f4c32ca] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557b2f493753] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557b2f494a1b] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557b2f478752] 2024-07-26T08:48:41.485 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557b2f3c6a56] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557b2f3ca637] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557b2f3caf5e] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557b2f3ae03a] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb46bd9b407] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 18: (DispatchQueue::entry()+0x60f) [0x7fb46bd9bcf9] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb46be785a1] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 20: (Thread::entry_wrapper()+0x43) [0x7fb46bc25cdd] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb46bc25cf9] 2024-07-26T08:48:41.486 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb46b289c02] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb46b30ec40] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.151+0000 7fb465000640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: in thread 7fb465000640 thread_name:ms_dispatch 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb46b23e6f0] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb46b28b94c] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 3: raise() 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 4: abort() 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb46b22871b] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 6: /lib64/libc.so.6(+0x37386) [0x7fb46b237386] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557b2f3c56b9] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557b2f58380c] 2024-07-26T08:48:41.487 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557b2f4c32ca] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557b2f493753] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557b2f494a1b] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557b2f478752] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557b2f3c6a56] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557b2f3ca637] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557b2f3caf5e] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557b2f3ae03a] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb46bd9b407] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 18: (DispatchQueue::entry()+0x60f) [0x7fb46bd9bcf9] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb46be785a1] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 20: (Thread::entry_wrapper()+0x43) [0x7fb46bc25cdd] 2024-07-26T08:48:41.488 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb46bc25cf9] 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb46b289c02] 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb46b30ec40] 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 0> 2024-07-26T08:48:41.151+0000 7fb465000640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: in thread 7fb465000640 thread_name:ms_dispatch 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb46b23e6f0] 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb46b28b94c] 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 3: raise() 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 4: abort() 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb46b22871b] 2024-07-26T08:48:41.489 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 6: /lib64/libc.so.6(+0x37386) [0x7fb46b237386] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557b2f3c56b9] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557b2f58380c] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557b2f4c32ca] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557b2f493753] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557b2f494a1b] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557b2f478752] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557b2f3c6a56] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557b2f3ca637] 2024-07-26T08:48:41.490 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557b2f3caf5e] 2024-07-26T08:48:41.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557b2f3ae03a] 2024-07-26T08:48:41.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb46bd9b407] 2024-07-26T08:48:41.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 18: (DispatchQueue::entry()+0x60f) [0x7fb46bd9bcf9] 2024-07-26T08:48:41.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb46be785a1] 2024-07-26T08:48:41.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 20: (Thread::entry_wrapper()+0x43) [0x7fb46bc25cdd] 2024-07-26T08:48:41.491 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb46bc25cf9] 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb46b289c02] 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb46b30ec40] 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 0> 2024-07-26T08:48:41.151+0000 7fb465000640 -1 *** Caught signal (Aborted) ** 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: in thread 7fb465000640 thread_name:ms_dispatch 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb46b23e6f0] 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb46b28b94c] 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 3: raise() 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 4: abort() 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb46b22871b] 2024-07-26T08:48:41.492 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 6: /lib64/libc.so.6(+0x37386) [0x7fb46b237386] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557b2f3c56b9] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557b2f58380c] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557b2f4c32ca] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557b2f493753] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557b2f494a1b] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557b2f478752] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557b2f3c6a56] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557b2f3ca637] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557b2f3caf5e] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557b2f3ae03a] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb46bd9b407] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 18: (DispatchQueue::entry()+0x60f) [0x7fb46bd9bcf9] 2024-07-26T08:48:41.493 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb46be785a1] 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 20: (Thread::entry_wrapper()+0x43) [0x7fb46bc25cdd] 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb46bc25cf9] 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb46b289c02] 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb46b30ec40] 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j[110761]: 2024-07-26T08:48:41.494 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 podman[110909]: 2024-07-26 08:48:41.303711377 +0000 UTC m=+0.041154115 container died ce8f7d40898751bbb0a7b0484a03b4fe42977ab02d71c271461e872eedbe1052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-07-26T08:48:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 766.722034 secs 2024-07-26T08:48:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:41 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:rejoin 2024-07-26T08:48:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:41 smithi133 ceph-mon[37053]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:41 smithi133 ceph-mon[37053]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 782.208285 secs 2024-07-26T08:48:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 766.722034 secs 2024-07-26T08:48:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:41 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:rejoin 2024-07-26T08:48:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:41 smithi063 ceph-mon[36747]: fsmap cephfs:3/3 {0=c=up:active,1=j=up:rejoin,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:41 smithi063 ceph-mon[36747]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-07-26T08:48:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 782.208285 secs 2024-07-26T08:48:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:42 smithi043 ceph-mon[32384]: pgmap v1009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:48:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:42 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:42 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:active 2024-07-26T08:48:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:42 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:42.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 podman[110909]: 2024-07-26 08:48:41.974223605 +0000 UTC m=+0.711666323 container remove ce8f7d40898751bbb0a7b0484a03b4fe42977ab02d71c271461e872eedbe1052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-07-26T08:48:42.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:41 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-07-26T08:48:42.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:42 smithi133 ceph-mon[37053]: pgmap v1009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:48:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:42 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:42 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:active 2024-07-26T08:48:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:42 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:42 smithi063 ceph-mon[36747]: pgmap v1009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 102 B/s wr, 5 op/s 2024-07-26T08:48:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:42 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T08:48:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:42 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/3604421927,v1:172.21.15.43:6835/3604421927] up:active 2024-07-26T08:48:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:42 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active,2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:42.986 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:42 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:48:42.986 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:42 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.211s CPU time. 2024-07-26T08:48:44.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:44 smithi043 ceph-mon[32384]: pgmap v1010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:48:44.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:44 smithi133 ceph-mon[37053]: pgmap v1010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:48:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:44 smithi063 ceph-mon[36747]: pgmap v1010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 7 op/s 2024-07-26T08:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:46 smithi043 ceph-mon[32384]: pgmap v1011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:46 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 771.722147 secs 2024-07-26T08:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:46 smithi043 ceph-mon[32384]: slow request 720.231844 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 787.208404 secs 2024-07-26T08:48:46.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:46 smithi133 ceph-mon[37053]: pgmap v1011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:46 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 771.722147 secs 2024-07-26T08:48:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:46 smithi133 ceph-mon[37053]: slow request 720.231844 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:48:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 787.208404 secs 2024-07-26T08:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:46 smithi063 ceph-mon[36747]: pgmap v1011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 204 B/s wr, 9 op/s 2024-07-26T08:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:46 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 771.722147 secs 2024-07-26T08:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:46 smithi063 ceph-mon[36747]: slow request 720.231844 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T08:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 787.208404 secs 2024-07-26T08:48:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:48 smithi043 ceph-mon[32384]: pgmap v1012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 197 B/s wr, 9 op/s 2024-07-26T08:48:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:48 smithi133 ceph-mon[37053]: pgmap v1012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 197 B/s wr, 9 op/s 2024-07-26T08:48:48.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:48 smithi063 ceph-mon[36747]: pgmap v1012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 197 B/s wr, 9 op/s 2024-07-26T08:48:50.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:50 smithi043 ceph-mon[32384]: pgmap v1013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:48:50.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:50 smithi133 ceph-mon[37053]: pgmap v1013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:48:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:50 smithi063 ceph-mon[36747]: pgmap v1013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T08:48:51.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 776.722265 secs 2024-07-26T08:48:51.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 792.208552 secs 2024-07-26T08:48:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 776.722265 secs 2024-07-26T08:48:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 792.208552 secs 2024-07-26T08:48:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 776.722265 secs 2024-07-26T08:48:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 792.208552 secs 2024-07-26T08:48:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:52 smithi043 ceph-mon[32384]: pgmap v1014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:52 smithi133 ceph-mon[37053]: pgmap v1014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:52 smithi063 ceph-mon[36747]: pgmap v1014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-07-26T08:48:53.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:52 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 6. 2024-07-26T08:48:53.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:52 smithi043 systemd[1]: Stopped Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:53.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:52 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Consumed 3.211s CPU time. 2024-07-26T08:48:53.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:52 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Start request repeated too quickly. 2024-07-26T08:48:53.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:52 smithi043 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-07-26T08:48:53.233 INFO:journalctl@ceph.mds.j.smithi043.stdout:Jul 26 08:48:52 smithi043 systemd[1]: Failed to start Ceph mds.j for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T08:48:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:54 smithi043 ceph-mon[32384]: pgmap v1015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-07-26T08:48:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:54 smithi133 ceph-mon[37053]: pgmap v1015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-07-26T08:48:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:54 smithi063 ceph-mon[36747]: pgmap v1015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-07-26T08:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:56 smithi043 ceph-mon[32384]: pgmap v1016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-07-26T08:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 781.722379 secs 2024-07-26T08:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:56 smithi043 ceph-mon[32384]: fsmap cephfs:3 {0=c=up:active,1=j=up:active(laggy or crashed),2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 797.208671 secs 2024-07-26T08:48:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:56 smithi133 ceph-mon[37053]: pgmap v1016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-07-26T08:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 781.722379 secs 2024-07-26T08:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:56 smithi133 ceph-mon[37053]: fsmap cephfs:3 {0=c=up:active,1=j=up:active(laggy or crashed),2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 797.208671 secs 2024-07-26T08:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:56 smithi063 ceph-mon[36747]: pgmap v1016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-07-26T08:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 781.722379 secs 2024-07-26T08:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:56 smithi063 ceph-mon[36747]: fsmap cephfs:3 {0=c=up:active,1=j=up:active(laggy or crashed),2=i=up:active} 2 up:standby-replay 2024-07-26T08:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 797.208671 secs 2024-07-26T08:48:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:48:58 smithi043 ceph-mon[32384]: pgmap v1017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:48:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:48:58 smithi133 ceph-mon[37053]: pgmap v1017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:48:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:48:58 smithi063 ceph-mon[36747]: pgmap v1017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:00 smithi043 ceph-mon[32384]: pgmap v1018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:00 smithi133 ceph-mon[37053]: pgmap v1018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:00 smithi063 ceph-mon[36747]: pgmap v1018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 786.722475 secs 2024-07-26T08:49:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 802.208819 secs 2024-07-26T08:49:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 786.722475 secs 2024-07-26T08:49:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 802.208819 secs 2024-07-26T08:49:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 786.722475 secs 2024-07-26T08:49:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 802.208819 secs 2024-07-26T08:49:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:02 smithi133 ceph-mon[37053]: pgmap v1019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:02 smithi063 ceph-mon[36747]: pgmap v1019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:02 smithi043 ceph-mon[32384]: pgmap v1019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:03.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:49:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:49:03.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:49:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:04 smithi133 ceph-mon[37053]: pgmap v1020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:49:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:04 smithi063 ceph-mon[36747]: pgmap v1020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:49:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:04.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:04 smithi043 ceph-mon[32384]: pgmap v1020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:49:04.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:04.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:05.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:49:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:49:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 791.722597 secs 2024-07-26T08:49:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:49:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:49:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 791.722597 secs 2024-07-26T08:49:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:49:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:49:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:49:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 791.722597 secs 2024-07-26T08:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:06 smithi063 ceph-mon[36747]: pgmap v1021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:06 smithi063 ceph-mon[36747]: pgmap v1022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 807.208947 secs 2024-07-26T08:49:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:06 smithi043 ceph-mon[32384]: pgmap v1021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:49:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:06 smithi043 ceph-mon[32384]: pgmap v1022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 807.208947 secs 2024-07-26T08:49:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:06 smithi133 ceph-mon[37053]: pgmap v1021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:49:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:06 smithi133 ceph-mon[37053]: pgmap v1022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 807.208947 secs 2024-07-26T08:49:08.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:08 smithi063 ceph-mon[36747]: pgmap v1023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:08 smithi043 ceph-mon[32384]: pgmap v1023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:08 smithi133 ceph-mon[37053]: pgmap v1023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:10.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:49:10.534 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:10 smithi043 ceph-mon[32384]: pgmap v1024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:10.534 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 796.722723 secs 2024-07-26T08:49:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:10 smithi063 ceph-mon[36747]: pgmap v1024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 796.722723 secs 2024-07-26T08:49:10.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:10 smithi133 ceph-mon[37053]: pgmap v1024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 796.722723 secs 2024-07-26T08:49:10.932 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:49:11.343 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 812.209088 secs 2024-07-26T08:49:11.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 812.209088 secs 2024-07-26T08:49:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 812.209088 secs 2024-07-26T08:49:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:12 smithi043 ceph-mon[32384]: pgmap v1025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:12.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:12 smithi063 ceph-mon[36747]: pgmap v1025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:12 smithi133 ceph-mon[37053]: pgmap v1025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:49:13.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 -- 172.21.15.43:0/4261211298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0301055d0 msgr2=0x7ff0301059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 --2- 172.21.15.43:0/4261211298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0301055d0 0x7ff0301059e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff020009900 tx=0x7ff02002a410 comp rx=0 tx=0).stop 2024-07-26T08:49:13.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 -- 172.21.15.43:0/4261211298 shutdown_connections 2024-07-26T08:49:13.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 --2- 172.21.15.43:0/4261211298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff03010af10 0x7ff03010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 --2- 172.21.15.43:0/4261211298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 0x7ff030112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 --2- 172.21.15.43:0/4261211298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0301055d0 0x7ff0301059e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 -- 172.21.15.43:0/4261211298 >> 172.21.15.43:0/4261211298 conn(0x7ff030101040 msgr2=0x7ff030103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:13.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 -- 172.21.15.43:0/4261211298 shutdown_connections 2024-07-26T08:49:13.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.520+0000 7ff035c00640 1 -- 172.21.15.43:0/4261211298 wait complete. 2024-07-26T08:49:13.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.521+0000 7ff035c00640 1 Processor -- start 2024-07-26T08:49:13.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.521+0000 7ff035c00640 1 -- start start 2024-07-26T08:49:13.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0301055d0 0x7ff03019bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 0x7ff03019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 0x7ff0301a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff030115690 con 0x7ff03010b860 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff030115510 con 0x7ff03010af10 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff030115810 con 0x7ff0301055d0 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff02f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 0x7ff03019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff035200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 0x7ff0301a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff02f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 0x7ff03019c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47770/0 (socket says 172.21.15.43:47770) 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff02f400640 1 -- 172.21.15.43:0/2943187362 learned_addr learned my addr 172.21.15.43:0/2943187362 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.522+0000 7ff02fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0301055d0 0x7ff03019bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff02f400640 1 -- 172.21.15.43:0/2943187362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0301055d0 msgr2=0x7ff03019bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff02f400640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0301055d0 0x7ff03019bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff02f400640 1 -- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 msgr2=0x7ff0301a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff02f400640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 0x7ff0301a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff02f400640 1 -- 172.21.15.43:0/2943187362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0301a1f30 con 0x7ff03010af10 2024-07-26T08:49:13.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff035200640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 0x7ff0301a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:49:13.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.523+0000 7ff02f400640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 0x7ff03019c560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00e9f0 tx=0x7ff01c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:13.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.524+0000 7ff02cc00640 1 -- 172.21.15.43:0/2943187362 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00ccc0 con 0x7ff03010af10 2024-07-26T08:49:13.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.524+0000 7ff02cc00640 1 -- 172.21.15.43:0/2943187362 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff01c010900 con 0x7ff03010af10 2024-07-26T08:49:13.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.524+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0301a2220 con 0x7ff03010af10 2024-07-26T08:49:13.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.524+0000 7ff02cc00640 1 -- 172.21.15.43:0/2943187362 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c018900 con 0x7ff03010af10 2024-07-26T08:49:13.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.524+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0301a8980 con 0x7ff03010af10 2024-07-26T08:49:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.527+0000 7ff03e016740 1 Processor -- start 2024-07-26T08:49:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.527+0000 7ff03e016740 1 -- start start 2024-07-26T08:49:13.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff03e016740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5591070 0x55e7d5935fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff03e016740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 0x55e7d5936510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff02cc00640 1 -- 172.21.15.43:0/2943187362 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff01c010ab0 con 0x7ff03010af10 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff03e016740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d5936a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff03e016740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e7d58acb90 con 0x55e7d5591070 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff03e016740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e7d589c090 con 0x55e7d55681b0 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff03e016740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e7d58a00d0 con 0x55e7d5570390 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff035200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5591070 0x55e7d5935fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff02f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d5936a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff02fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 0x55e7d5936510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff035200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5591070 0x55e7d5935fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58120/0 (socket says 172.21.15.43:58120) 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff02fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 0x55e7d5936510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47774/0 (socket says 172.21.15.43:47774) 2024-07-26T08:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.528+0000 7ff035200640 1 -- 172.21.15.43:0/2832466706 learned_addr learned my addr 172.21.15.43:0/2832466706 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff02fe00640 1 -- 172.21.15.43:0/2832466706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 msgr2=0x55e7d5936a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff02fe00640 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d5936a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff02fe00640 1 -- 172.21.15.43:0/2832466706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5591070 msgr2=0x55e7d5935fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff02fe00640 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5591070 0x55e7d5935fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff02fe00640 1 -- 172.21.15.43:0/2832466706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d55fc650 con 0x55e7d55681b0 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff02fe00640 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 0x55e7d5936510 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff02002aa00 tx=0x7ff020009630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ed63493e6e574c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.529+0000 7ff025600640 1 -- 172.21.15.43:0/2832466706 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020040070 con 0x55e7d55681b0 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.530+0000 7ff025600640 1 -- 172.21.15.43:0/2832466706 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff020004480 con 0x55e7d55681b0 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.530+0000 7ff025600640 1 -- 172.21.15.43:0/2832466706 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035040 con 0x55e7d55681b0 2024-07-26T08:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.530+0000 7ff02cc00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0140b3dc0 0x7ff0140b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.530+0000 7ff02cc00640 1 -- 172.21.15.43:0/2943187362 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7ff01c0e5630 con 0x7ff03010af10 2024-07-26T08:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.530+0000 7ff035200640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0140b3dc0 0x7ff0140b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 -- 172.21.15.43:0/2832466706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 msgr2=0x55e7d5936510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 0x55e7d5936510 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff02002aa00 tx=0x7ff020009630 comp rx=0 tx=0).stop 2024-07-26T08:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 -- 172.21.15.43:0/2832466706 shutdown_connections 2024-07-26T08:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d5936a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d55681b0 0x55e7d5936510 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 --2- 172.21.15.43:0/2832466706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5591070 0x55e7d5935fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 -- 172.21.15.43:0/2832466706 >> 172.21.15.43:0/2832466706 conn(0x55e7d5585460 msgr2=0x55e7d5933ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 -- 172.21.15.43:0/2832466706 shutdown_connections 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff035200640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0140b3dc0 0x7ff0140b62d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff028009fd0 tx=0x7ff028009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.531+0000 7ff03e016740 1 -- 172.21.15.43:0/2832466706 wait complete. 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 -- start start 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 Processor -- start 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5941640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5570390 0x55e7d5941b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5591070 0x55e7d59420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e7d56ff700 con 0x55e7d55681b0 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e7d5838660 con 0x55e7d5570390 2024-07-26T08:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.532+0000 7ff03e016740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e7d5944750 con 0x55e7d5591070 2024-07-26T08:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff03e016740 10 client.0 _ll_register_callbacks cb 0x55e7d5848110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5941640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5570390 0x55e7d5941b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5941640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58126/0 (socket says 172.21.15.43:58126) 2024-07-26T08:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 -- 172.21.15.43:0/1941645842 learned_addr learned my addr 172.21.15.43:0/1941645842 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff035200640 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5591070 0x55e7d59420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 -- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5591070 msgr2=0x55e7d59420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5591070 0x55e7d59420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 -- 172.21.15.43:0/1941645842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5570390 msgr2=0x55e7d5941b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5570390 0x55e7d5941b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.533+0000 7ff02fe00640 1 -- 172.21.15.43:0/1941645842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d584f800 con 0x55e7d55681b0 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.534+0000 7ff02fe00640 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5941640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff020006010 tx=0x7ff0200058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f430d3de928be66e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.534+0000 7ff01a000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.534+0000 7ff01a000640 1 -- 172.21.15.43:0/1941645842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035070 con 0x55e7d55681b0 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.534+0000 7ff01a000640 1 -- 172.21.15.43:0/1941645842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7ff020004e80 con 0x55e7d55681b0 2024-07-26T08:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.534+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff020004480 con 0x55e7d55681b0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff01a000640 1 -- 172.21.15.43:0/1941645842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7ff020059050 con 0x55e7d55681b0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 10 client.16194 fetch_fsmap learned FSMap version 336 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55e7d59503d0 con 0x55e7d55681b0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff01a000640 1 -- 172.21.15.43:0/1941645842 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff020004480 con 0x55e7d55681b0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff01a000640 1 -- 172.21.15.43:0/1941645842 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7ff020003bc0 con 0x55e7d55681b0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 10 client.16194 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 20 client.16194 populate_metadata read hostname 'smithi043' 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d554f9f0 0x55e7d59539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 4 client.16194 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.535+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7d58aeae0 con 0x55e7d554f9f0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.536+0000 7ff02f400640 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d554f9f0 0x55e7d59539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.536+0000 7ff02f400640 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d554f9f0 0x55e7d59539e0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d7f13882dbaef47 server_cookie=da9e9ceedc2b1ad3 in_seq=0 out_seq=0 2024-07-26T08:49:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.536+0000 7ff01a000640 10 client.16194 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff01a000640 1 -- 172.21.15.43:0/1941645842 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7d58aeae0 con 0x55e7d554f9f0 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff01a000640 10 client.16194 handle_command_reply: tid=0 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff03e016740 1 client.16194 shutdown 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 msgr2=0x55e7d5941640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff03e016740 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5941640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff020006010 tx=0x7ff0200058e0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 shutdown_connections 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.537+0000 7ff03e016740 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d554f9f0 0x55e7d59539e0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5591070 0x55e7d59420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5570390 0x55e7d5941b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 1 --2- 172.21.15.43:0/1941645842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5941640 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 >> 172.21.15.43:0/1941645842 conn(0x55e7d5585460 msgr2=0x55e7d59391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff01a000640 0 client.16194 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 shutdown_connections 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 1 -- 172.21.15.43:0/1941645842 wait complete. 2024-07-26T08:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.538+0000 7ff03e016740 20 client.16194 trim_cache size 0 max 16384 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 Processor -- start 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 -- start start 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5937710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d59591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d59596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b50e0 con 0x55e7d55681b0 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b35a0 con 0x55e7d5591070 2024-07-26T08:49:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.557+0000 7ff03e016740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b4a10 con 0x55e7d5570390 2024-07-26T08:49:13.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d59596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff02f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d59591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff02fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5937710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d59596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:47790/0 (socket says 172.21.15.43:47790) 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 -- 172.21.15.43:0/1597339839 learned_addr learned my addr 172.21.15.43:0/1597339839 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff02f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d59591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:54096/0 (socket says 172.21.15.43:54096) 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 -- 172.21.15.43:0/1597339839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 msgr2=0x55e7d59591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d59591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 -- 172.21.15.43:0/1597339839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 msgr2=0x55e7d5937710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5937710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.558+0000 7ff035200640 1 -- 172.21.15.43:0/1597339839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d5942450 con 0x55e7d5591070 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.559+0000 7ff035200640 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d59596e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff028011ab0 tx=0x7ff028016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf20d19e8ac3c634 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.559+0000 7ff024c00640 1 -- 172.21.15.43:0/1597339839 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02801c590 con 0x55e7d5591070 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.559+0000 7ff024c00640 1 -- 172.21.15.43:0/1597339839 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff02802d070 con 0x55e7d5591070 2024-07-26T08:49:13.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.559+0000 7ff024c00640 1 -- 172.21.15.43:0/1597339839 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028028c80 con 0x55e7d5591070 2024-07-26T08:49:13.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 -- 172.21.15.43:0/1597339839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 msgr2=0x55e7d59596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d59596e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff028011ab0 tx=0x7ff028016000 comp rx=0 tx=0).stop 2024-07-26T08:49:13.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 -- 172.21.15.43:0/1597339839 shutdown_connections 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d5570390 0x55e7d59591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d59596e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 --2- 172.21.15.43:0/1597339839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d55681b0 0x55e7d5937710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 -- 172.21.15.43:0/1597339839 >> 172.21.15.43:0/1597339839 conn(0x55e7d5585460 msgr2=0x55e7d5937000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 -- 172.21.15.43:0/1597339839 shutdown_connections 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.560+0000 7ff03e016740 1 -- 172.21.15.43:0/1597339839 wait complete. 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 -- start start 2024-07-26T08:49:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 Processor -- start 2024-07-26T08:49:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d55681b0 0x55e7d5949f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 0x55e7d5947440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d5947980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b4340 con 0x55e7d5570390 2024-07-26T08:49:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b3c70 con 0x55e7d5591070 2024-07-26T08:49:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.561+0000 7ff03e016740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e7d5947f40 con 0x55e7d55681b0 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff03e016740 10 client.0 _ll_register_callbacks cb 0x7ff020009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 0x55e7d5947440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 0x55e7d5947440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58158/0 (socket says 172.21.15.43:58158) 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02f400640 1 -- 172.21.15.43:0/362764906 learned_addr learned my addr 172.21.15.43:0/362764906 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02fe00640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d55681b0 0x55e7d5949f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff035200640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d5947980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02fe00640 1 -- 172.21.15.43:0/362764906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 msgr2=0x55e7d5947980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02fe00640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d5947980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02fe00640 1 -- 172.21.15.43:0/362764906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 msgr2=0x55e7d5947440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02fe00640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 0x55e7d5947440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02fe00640 1 -- 172.21.15.43:0/362764906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d5948140 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.562+0000 7ff02f400640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 0x55e7d5947440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff02fe00640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d55681b0 0x55e7d5949f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55e7d5943e90 tx=0x7ff020004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3efb0de4acaef719 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff01a000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff01a000640 1 -- 172.21.15.43:0/362764906 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035040 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff02802d070 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff01a000640 1 -- 172.21.15.43:0/362764906 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7ff020004bb0 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff01a000640 1 -- 172.21.15.43:0/362764906 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7ff02006c050 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff03e016740 10 client.26449 fetch_fsmap learned FSMap version 336 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.563+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55e7d59bc100 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff01a000640 1 -- 172.21.15.43:0/362764906 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff02802d070 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff01a000640 1 -- 172.21.15.43:0/362764906 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7ff020066030 con 0x55e7d55681b0 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff03e016740 10 client.26449 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff03e016740 10 client.26449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:49:13.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff03e016740 20 client.26449 populate_metadata read hostname 'smithi043' 2024-07-26T08:49:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff03e016740 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d5524da0 0x55e7d59be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff03e016740 4 client.26449 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:49:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e7d58aa580 con 0x55e7d5524da0 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.564+0000 7ff02f400640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d5524da0 0x55e7d59be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff02f400640 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d5524da0 0x55e7d59be850 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f459ee54a7012a1 server_cookie=7983a684fe45f655 in_seq=0 out_seq=0 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff01a000640 10 client.26449 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff01a000640 1 -- 172.21.15.43:0/362764906 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55e7d58aa580 con 0x55e7d5524da0 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff01a000640 10 client.26449 handle_command_reply: tid=0 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 client.26449 shutdown 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d55681b0 msgr2=0x55e7d5949f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d55681b0 0x55e7d5949f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55e7d5943e90 tx=0x7ff020004730 comp rx=0 tx=0).stop 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 shutdown_connections 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e7d5524da0 0x55e7d59be850 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e7d5591070 0x55e7d5947980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d5570390 0x55e7d5947440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 --2- 172.21.15.43:0/362764906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7d55681b0 0x55e7d5949f20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff01a000640 0 client.26449 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 >> 172.21.15.43:0/362764906 conn(0x55e7d5585460 msgr2=0x55e7d594c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 shutdown_connections 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.565+0000 7ff03e016740 1 -- 172.21.15.43:0/362764906 wait complete. 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff03e016740 20 client.26449 trim_cache size 0 max 16384 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:49:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:49:13.571 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:49:13.571 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:49:13.571 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:49:13.571 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:49:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0140b3dc0 msgr2=0x7ff0140b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0140b3dc0 0x7ff0140b62d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff028009fd0 tx=0x7ff028009500 comp rx=0 tx=0).stop 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 msgr2=0x7ff03019c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 0x7ff03019c560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00e9f0 tx=0x7ff01c00eeb0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 shutdown_connections 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7ff0140b3dc0 0x7ff0140b62d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03010b860 0x7ff0301a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff03010af10 0x7ff03019c560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 --2- 172.21.15.43:0/2943187362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0301055d0 0x7ff03019bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.566+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 >> 172.21.15.43:0/2943187362 conn(0x7ff030101040 msgr2=0x7ff03010a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.567+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 shutdown_connections 2024-07-26T08:49:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:13.567+0000 7ff035c00640 1 -- 172.21.15.43:0/2943187362 wait complete. 2024-07-26T08:49:14.475 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:49:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:14 smithi063 ceph-mon[36747]: pgmap v1026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:49:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:14 smithi043 ceph-mon[32384]: pgmap v1026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:49:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:14 smithi133 ceph-mon[37053]: pgmap v1026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:49:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 801.722857 secs 2024-07-26T08:49:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 801.722857 secs 2024-07-26T08:49:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 801.722857 secs 2024-07-26T08:49:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:16 smithi063 ceph-mon[36747]: pgmap v1027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:49:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 817.209206 secs 2024-07-26T08:49:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:16 smithi043 ceph-mon[32384]: pgmap v1027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:49:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 817.209206 secs 2024-07-26T08:49:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:16 smithi133 ceph-mon[37053]: pgmap v1027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:49:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 817.209206 secs 2024-07-26T08:49:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:18 smithi043 ceph-mon[32384]: pgmap v1028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:18 smithi133 ceph-mon[37053]: pgmap v1028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:18.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:18 smithi063 ceph-mon[36747]: pgmap v1028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:20 smithi043 ceph-mon[32384]: pgmap v1029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 806.722956 secs 2024-07-26T08:49:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:20 smithi133 ceph-mon[37053]: pgmap v1029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 806.722956 secs 2024-07-26T08:49:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:20 smithi063 ceph-mon[36747]: pgmap v1029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 806.722956 secs 2024-07-26T08:49:21.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 822.209289 secs 2024-07-26T08:49:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 822.209289 secs 2024-07-26T08:49:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 822.209289 secs 2024-07-26T08:49:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:22 smithi043 ceph-mon[32384]: pgmap v1030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:22 smithi133 ceph-mon[37053]: pgmap v1030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:22.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:22 smithi063 ceph-mon[36747]: pgmap v1030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:24 smithi043 ceph-mon[32384]: pgmap v1031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:24.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:24 smithi133 ceph-mon[37053]: pgmap v1031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:24 smithi063 ceph-mon[36747]: pgmap v1031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 811.723028 secs 2024-07-26T08:49:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 811.723028 secs 2024-07-26T08:49:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 811.723028 secs 2024-07-26T08:49:26.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:26 smithi043 ceph-mon[32384]: pgmap v1032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:26.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 827.209412 secs 2024-07-26T08:49:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:26 smithi133 ceph-mon[37053]: pgmap v1032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 827.209412 secs 2024-07-26T08:49:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:26 smithi063 ceph-mon[36747]: pgmap v1032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 827.209412 secs 2024-07-26T08:49:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:28 smithi043 ceph-mon[32384]: pgmap v1033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:28.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:28 smithi133 ceph-mon[37053]: pgmap v1033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:28 smithi063 ceph-mon[36747]: pgmap v1033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:30 smithi043 ceph-mon[32384]: pgmap v1034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 816.723135 secs 2024-07-26T08:49:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:30 smithi133 ceph-mon[37053]: pgmap v1034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 816.723135 secs 2024-07-26T08:49:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:30 smithi063 ceph-mon[36747]: pgmap v1034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 816.723135 secs 2024-07-26T08:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 832.209529 secs 2024-07-26T08:49:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 832.209529 secs 2024-07-26T08:49:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 832.209529 secs 2024-07-26T08:49:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:32 smithi043 ceph-mon[32384]: pgmap v1035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:32.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:32 smithi133 ceph-mon[37053]: pgmap v1035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:32 smithi063 ceph-mon[36747]: pgmap v1035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:34 smithi043 ceph-mon[32384]: pgmap v1036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:34 smithi133 ceph-mon[37053]: pgmap v1036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:34.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:34 smithi063 ceph-mon[36747]: pgmap v1036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 821.723264 secs 2024-07-26T08:49:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 821.723264 secs 2024-07-26T08:49:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 821.723264 secs 2024-07-26T08:49:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:36 smithi043 ceph-mon[32384]: pgmap v1037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 837.209670 secs 2024-07-26T08:49:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:36 smithi133 ceph-mon[37053]: pgmap v1037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 837.209670 secs 2024-07-26T08:49:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:36 smithi063 ceph-mon[36747]: pgmap v1037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 837.209670 secs 2024-07-26T08:49:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:38 smithi043 ceph-mon[32384]: pgmap v1038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:38.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:38 smithi133 ceph-mon[37053]: pgmap v1038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:38 smithi063 ceph-mon[36747]: pgmap v1038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:40 smithi043 ceph-mon[32384]: pgmap v1039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 826.723397 secs 2024-07-26T08:49:40.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:40 smithi133 ceph-mon[37053]: pgmap v1039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 826.723397 secs 2024-07-26T08:49:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:40 smithi063 ceph-mon[36747]: pgmap v1039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 826.723397 secs 2024-07-26T08:49:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 842.209795 secs 2024-07-26T08:49:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 842.209795 secs 2024-07-26T08:49:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 842.209795 secs 2024-07-26T08:49:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:42 smithi043 ceph-mon[32384]: pgmap v1040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:42 smithi133 ceph-mon[37053]: pgmap v1040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:42 smithi063 ceph-mon[36747]: pgmap v1040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:44.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:49:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:44 smithi043 ceph-mon[32384]: pgmap v1041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:44 smithi133 ceph-mon[37053]: pgmap v1041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:44 smithi063 ceph-mon[36747]: pgmap v1041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:49:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 831.723464 secs 2024-07-26T08:49:45.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 831.723464 secs 2024-07-26T08:49:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 831.723464 secs 2024-07-26T08:49:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:46 smithi043 ceph-mon[32384]: pgmap v1042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 847.209917 secs 2024-07-26T08:49:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:46 smithi133 ceph-mon[37053]: pgmap v1042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:46.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 847.209917 secs 2024-07-26T08:49:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:46 smithi063 ceph-mon[36747]: pgmap v1042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 847.209917 secs 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 -- 172.21.15.43:0/1919099355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c10f330 msgr2=0x7f817c10f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 --2- 172.21.15.43:0/1919099355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c10f330 0x7f817c10f740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8168009900 tx=0x7f816802a3f0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 -- 172.21.15.43:0/1919099355 shutdown_connections 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 --2- 172.21.15.43:0/1919099355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10fc80 0x7f817c1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 --2- 172.21.15.43:0/1919099355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c10f330 0x7f817c10f740 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 --2- 172.21.15.43:0/1919099355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f817c1099f0 0x7f817c109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.728+0000 7f8180a00640 1 -- 172.21.15.43:0/1919099355 >> 172.21.15.43:0/1919099355 conn(0x7f817c078ff0 msgr2=0x7f817c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.729+0000 7f8180a00640 1 -- 172.21.15.43:0/1919099355 shutdown_connections 2024-07-26T08:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.729+0000 7f8180a00640 1 -- 172.21.15.43:0/1919099355 wait complete. 2024-07-26T08:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.731+0000 7f8180a00640 1 Processor -- start 2024-07-26T08:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.731+0000 7f8180a00640 1 -- start start 2024-07-26T08:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8180a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 0x7f817c1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8180a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10f330 0x7f817c1a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8180a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f817c10fc80 0x7f817c1a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8180a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f817c119a60 con 0x7f817c1099f0 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8180a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1198e0 con 0x7f817c10f330 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8180a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f817c119be0 con 0x7f817c10fc80 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f817a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 0x7f817c1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f817a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 0x7f817c1a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34516/0 (socket says 172.21.15.43:34516) 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f8179e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10f330 0x7f817c1a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f817a800640 1 -- 172.21.15.43:0/1484592519 learned_addr learned my addr 172.21.15.43:0/1484592519 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.732+0000 7f817b200640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f817c10fc80 0x7f817c1a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f817a800640 1 -- 172.21.15.43:0/1484592519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f817c10fc80 msgr2=0x7f817c1a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f817a800640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f817c10fc80 0x7f817c1a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f817a800640 1 -- 172.21.15.43:0/1484592519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10f330 msgr2=0x7f817c1a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f817a800640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10f330 0x7f817c1a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f817a800640 1 -- 172.21.15.43:0/1484592519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c1a63c0 con 0x7f817c1099f0 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f8179e00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10f330 0x7f817c1a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f817a800640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 0x7f817c1a0450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e9f0 tx=0x7f816c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f8173400640 1 -- 172.21.15.43:0/1484592519 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c00ccc0 con 0x7f817c1099f0 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f8173400640 1 -- 172.21.15.43:0/1484592519 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f816c00ce60 con 0x7f817c1099f0 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.733+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c1a66b0 con 0x7f817c1099f0 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.734+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c1ace10 con 0x7f817c1099f0 2024-07-26T08:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.734+0000 7f8173400640 1 -- 172.21.15.43:0/1484592519 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c010690 con 0x7f817c1099f0 2024-07-26T08:49:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.737+0000 7f8187fd2740 1 Processor -- start 2024-07-26T08:49:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.737+0000 7f8187fd2740 1 -- start start 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8173400640 1 -- 172.21.15.43:0/1484592519 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f816c0046c0 con 0x7f817c1099f0 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cad1b0 0x56296a07b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 0x56296a07bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8187fd2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562969ff1bc0 con 0x562969cb5390 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8187fd2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562969fe10c0 con 0x562969cad1b0 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8187fd2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562969fe5100 con 0x562969cd6070 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8179e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 0x56296a07bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f817b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f817a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cad1b0 0x56296a07b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8179e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 0x56296a07bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34532/0 (socket says 172.21.15.43:34532) 2024-07-26T08:49:47.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.738+0000 7f8179e00640 1 -- 172.21.15.43:0/775996529 learned_addr learned my addr 172.21.15.43:0/775996529 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:47.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f817b200640 1 -- 172.21.15.43:0/775996529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cad1b0 msgr2=0x56296a07b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f817b200640 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cad1b0 0x56296a07b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f817b200640 1 -- 172.21.15.43:0/775996529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 msgr2=0x56296a07bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f817b200640 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 0x56296a07bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f817b200640 1 -- 172.21.15.43:0/775996529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562969d41650 con 0x562969cd6070 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f8179e00640 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 0x56296a07bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.739+0000 7f817b200640 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07b1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8174009f10 tx=0x7f8174011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4c99cccadb1b36 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.740+0000 7f8167400640 1 -- 172.21.15.43:0/775996529 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174004d20 con 0x562969cd6070 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.740+0000 7f8167400640 1 -- 172.21.15.43:0/775996529 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8174004030 con 0x562969cd6070 2024-07-26T08:49:47.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.740+0000 7f8167400640 1 -- 172.21.15.43:0/775996529 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174005260 con 0x562969cd6070 2024-07-26T08:49:47.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.740+0000 7f8173400640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81600b3d40 0x7f81600b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 -- 172.21.15.43:0/775996529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 msgr2=0x56296a07b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07b1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8174009f10 tx=0x7f8174011810 comp rx=0 tx=0).stop 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8173400640 1 -- 172.21.15.43:0/1484592519 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f816c0e57d0 con 0x7f817c1099f0 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f817a800640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81600b3d40 0x7f81600b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 -- 172.21.15.43:0/775996529 shutdown_connections 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cb5390 0x56296a07bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cad1b0 0x56296a07b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 --2- 172.21.15.43:0/775996529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07b1f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 -- 172.21.15.43:0/775996529 >> 172.21.15.43:0/775996529 conn(0x562969cca460 msgr2=0x56296a0790e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 -- 172.21.15.43:0/775996529 shutdown_connections 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.741+0000 7f8187fd2740 1 -- 172.21.15.43:0/775996529 wait complete. 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.742+0000 7f817a800640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81600b3d40 0x7f81600b6250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56296a079e70 tx=0x7f816c0eb530 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:47.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.742+0000 7f8187fd2740 1 -- start start 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.742+0000 7f8187fd2740 1 Processor -- start 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cad1b0 0x56296a086760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a086ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cd6070 0x56296a0871e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562969e44700 con 0x562969cd6070 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562969f7d690 con 0x562969cb5390 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56296a0899d0 con 0x562969cad1b0 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8187fd2740 10 client.0 _ll_register_callbacks cb 0x562969f8d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:49:47.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8179e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a086ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f817b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cad1b0 0x56296a086760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8179e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a086ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:49376/0 (socket says 172.21.15.43:49376) 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.743+0000 7f8179e00640 1 -- 172.21.15.43:0/3782189492 learned_addr learned my addr 172.21.15.43:0/3782189492 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f817b200640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cd6070 0x56296a0871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f8179e00640 1 -- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cad1b0 msgr2=0x56296a086760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f8179e00640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cad1b0 0x56296a086760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f8179e00640 1 -- 172.21.15.43:0/3782189492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cd6070 msgr2=0x56296a0871e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f8179e00640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cd6070 0x56296a0871e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f8179e00640 1 -- 172.21.15.43:0/3782189492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562969f94830 con 0x562969cb5390 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.744+0000 7f817b200640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cad1b0 0x56296a086760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.745+0000 7f8179e00640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a086ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8168005940 tx=0x7f8168031740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2080553690b429e4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:47.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.745+0000 7f815be00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:49:47.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.745+0000 7f815be00640 1 -- 172.21.15.43:0/3782189492 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168035040 con 0x562969cb5390 2024-07-26T08:49:47.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.745+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8174004030 con 0x562969cb5390 2024-07-26T08:49:47.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.745+0000 7f815be00640 1 -- 172.21.15.43:0/3782189492 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f8168004450 con 0x562969cb5390 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.745+0000 7f815be00640 1 -- 172.21.15.43:0/3782189492 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f8168031930 con 0x562969cb5390 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 10 client.26489 fetch_fsmap learned FSMap version 336 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x56296a0955d0 con 0x562969cb5390 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f815be00640 1 -- 172.21.15.43:0/3782189492 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8174004030 con 0x562969cb5390 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f815be00640 1 -- 172.21.15.43:0/3782189492 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f816803d830 con 0x562969cb5390 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 10 client.26489 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 10 client.26489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 20 client.26489 populate_metadata read hostname 'smithi043' 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c949f0 0x56296a098f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 4 client.26489 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.746+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562969ff3b10 con 0x562969c949f0 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.747+0000 7f817b200640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c949f0 0x56296a098f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.747+0000 7f817b200640 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c949f0 0x56296a098f40 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c3b56b9068a2846 server_cookie=2f9210617e9b54c7 in_seq=0 out_seq=0 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.747+0000 7f815be00640 10 client.26489 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f815be00640 1 -- 172.21.15.43:0/3782189492 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562969ff3b10 con 0x562969c949f0 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f815be00640 10 client.26489 handle_command_reply: tid=0 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 client.26489 shutdown 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 msgr2=0x56296a086ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a086ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8168005940 tx=0x7f8168031740 comp rx=0 tx=0).stop 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 shutdown_connections 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c949f0 0x56296a098f40 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cd6070 0x56296a0871e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a086ca0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 --2- 172.21.15.43:0/3782189492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cad1b0 0x56296a086760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f815be00640 0 client.26489 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:47.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.748+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 >> 172.21.15.43:0/3782189492 conn(0x562969cca460 msgr2=0x56296a07e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:47.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.749+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 shutdown_connections 2024-07-26T08:49:47.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.749+0000 7f8187fd2740 1 -- 172.21.15.43:0/3782189492 wait complete. 2024-07-26T08:49:47.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.749+0000 7f8187fd2740 20 client.26489 trim_cache size 0 max 16384 2024-07-26T08:49:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.768+0000 7f8187fd2740 1 Processor -- start 2024-07-26T08:49:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.768+0000 7f8187fd2740 1 -- start start 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a088640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a077720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8187fd2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1b94b0 con 0x562969cad1b0 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8187fd2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1b7970 con 0x562969cb5390 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8187fd2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1b8de0 con 0x562969cd6070 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f817b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a088640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f817b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a088640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34542/0 (socket says 172.21.15.43:34542) 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f817b200640 1 -- 172.21.15.43:0/845400976 learned_addr learned my addr 172.21.15.43:0/845400976 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f8179e00640 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a077720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.769+0000 7f817b200640 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f817b200640 1 -- 172.21.15.43:0/845400976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 msgr2=0x56296a07c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f817b200640 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f817b200640 1 -- 172.21.15.43:0/845400976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 msgr2=0x56296a077720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f817b200640 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a077720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f817b200640 1 -- 172.21.15.43:0/845400976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296a088ea0 con 0x562969cad1b0 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f817b200640 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a088640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8174000f80 tx=0x7f8174009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed8a10dc5091957 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.770+0000 7f8166a00640 1 -- 172.21.15.43:0/845400976 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817401e040 con 0x562969cad1b0 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.771+0000 7f8166a00640 1 -- 172.21.15.43:0/845400976 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8174032040 con 0x562969cad1b0 2024-07-26T08:49:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.771+0000 7f8166a00640 1 -- 172.21.15.43:0/845400976 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817400fc40 con 0x562969cad1b0 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.771+0000 7f8187fd2740 1 -- 172.21.15.43:0/845400976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 msgr2=0x56296a088640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.771+0000 7f8187fd2740 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a088640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8174000f80 tx=0x7f8174009cd0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 -- 172.21.15.43:0/845400976 shutdown_connections 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a07c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a077720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 --2- 172.21.15.43:0/845400976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a088640 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 -- 172.21.15.43:0/845400976 >> 172.21.15.43:0/845400976 conn(0x562969cca460 msgr2=0x56296a07c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:47.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 -- 172.21.15.43:0/845400976 shutdown_connections 2024-07-26T08:49:47.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 -- 172.21.15.43:0/845400976 wait complete. 2024-07-26T08:49:47.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 -- start start 2024-07-26T08:49:47.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.772+0000 7f8187fd2740 1 Processor -- start 2024-07-26T08:49:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a08c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a08ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a0f9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1b8710 con 0x562969cad1b0 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1b8040 con 0x562969cb5390 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562969ff3b10 con 0x562969cd6070 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8187fd2740 10 client.0 _ll_register_callbacks cb 0x7f8168005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f817b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a08c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f817b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a08c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34554/0 (socket says 172.21.15.43:34554) 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f817b200640 1 -- 172.21.15.43:0/2788340725 learned_addr learned my addr 172.21.15.43:0/2788340725 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.773+0000 7f8179e00640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a08ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f817b200640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a0f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f8179e00640 1 -- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 msgr2=0x56296a0f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f8179e00640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a0f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f8179e00640 1 -- 172.21.15.43:0/2788340725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 msgr2=0x56296a08c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f8179e00640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a08c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f8179e00640 1 -- 172.21.15.43:0/2788340725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296a0f9d80 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f817b200640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a08c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f8179e00640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a08ca50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f816802a910 tx=0x7f8168009830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d876a5f14946085 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.774+0000 7f815be00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f815be00640 1 -- 172.21.15.43:0/2788340725 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168059020 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8174032040 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f815be00640 1 -- 172.21.15.43:0/2788340725 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f816803d650 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f815be00640 1 -- 172.21.15.43:0/2788340725 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f8168062050 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f8187fd2740 10 client.26495 fetch_fsmap learned FSMap version 336 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x56296a1010d0 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f815be00640 1 -- 172.21.15.43:0/2788340725 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8174032040 con 0x562969cb5390 2024-07-26T08:49:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f815be00640 1 -- 172.21.15.43:0/2788340725 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f81680047a0 con 0x562969cb5390 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f8187fd2740 10 client.26495 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.775+0000 7f8187fd2740 10 client.26495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f8187fd2740 20 client.26495 populate_metadata read hostname 'smithi043' 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f8187fd2740 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c69da0 0x56296a103820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f8187fd2740 4 client.26495 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562969fef5b0 con 0x562969c69da0 2024-07-26T08:49:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f817b200640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c69da0 0x56296a103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:49:47.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f817b200640 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c69da0 0x56296a103820 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=357c366e85c3019a server_cookie=2d60d8c5ad09ea in_seq=0 out_seq=0 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.776+0000 7f815be00640 10 client.26495 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f815be00640 1 -- 172.21.15.43:0/2788340725 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x562969fef5b0 con 0x562969c69da0 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f815be00640 10 client.26495 handle_command_reply: tid=0 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 client.26495 shutdown 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 msgr2=0x56296a08ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a08ca50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f816802a910 tx=0x7f8168009830 comp rx=0 tx=0).stop 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 shutdown_connections 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x562969c69da0 0x56296a103820 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562969cd6070 0x56296a0f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562969cb5390 0x56296a08ca50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 --2- 172.21.15.43:0/2788340725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562969cad1b0 0x56296a08c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 >> 172.21.15.43:0/2788340725 conn(0x562969cca460 msgr2=0x56296a0883e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f815be00640 0 client.26495 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 shutdown_connections 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 1 -- 172.21.15.43:0/2788340725 wait complete. 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.777+0000 7f8187fd2740 20 client.26495 trim_cache size 0 max 16384 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:49:47.783 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81600b3d40 msgr2=0x7f81600b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81600b3d40 0x7f81600b6250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56296a079e70 tx=0x7f816c0eb530 comp rx=0 tx=0).stop 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 msgr2=0x7f817c1a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:49:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 0x7f817c1a0450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e9f0 tx=0x7f816c00edf0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 shutdown_connections 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f81600b3d40 0x7f81600b6250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f817c10fc80 0x7f817c1a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f817c10f330 0x7f817c1a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 --2- 172.21.15.43:0/1484592519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f817c1099f0 0x7f817c1a0450 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 >> 172.21.15.43:0/1484592519 conn(0x7f817c078ff0 msgr2=0x7f817c079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 shutdown_connections 2024-07-26T08:49:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:49:47.778+0000 7f8180a00640 1 -- 172.21.15.43:0/1484592519 wait complete. 2024-07-26T08:49:48.657 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:48 smithi043 ceph-mon[32384]: pgmap v1043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:48.732 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:49:48.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:48 smithi133 ceph-mon[37053]: pgmap v1043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:48 smithi063 ceph-mon[36747]: pgmap v1043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:50 smithi043 ceph-mon[32384]: pgmap v1044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 836.723591 secs 2024-07-26T08:49:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:50 smithi133 ceph-mon[37053]: pgmap v1044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 836.723591 secs 2024-07-26T08:49:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:50 smithi063 ceph-mon[36747]: pgmap v1044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 836.723591 secs 2024-07-26T08:49:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 852.209982 secs 2024-07-26T08:49:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 852.209982 secs 2024-07-26T08:49:51.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 852.209982 secs 2024-07-26T08:49:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:52 smithi043 ceph-mon[32384]: pgmap v1045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:52 smithi133 ceph-mon[37053]: pgmap v1045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:52 smithi063 ceph-mon[36747]: pgmap v1045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:54 smithi133 ceph-mon[37053]: pgmap v1046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:54 smithi063 ceph-mon[36747]: pgmap v1046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:54 smithi043 ceph-mon[32384]: pgmap v1046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:49:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 841.723722 secs 2024-07-26T08:49:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 841.723722 secs 2024-07-26T08:49:55.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 841.723722 secs 2024-07-26T08:49:56.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:56 smithi133 ceph-mon[37053]: pgmap v1047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 857.210102 secs 2024-07-26T08:49:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:56 smithi063 ceph-mon[36747]: pgmap v1047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 857.210102 secs 2024-07-26T08:49:56.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:56 smithi043 ceph-mon[32384]: pgmap v1047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:49:56.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 857.210102 secs 2024-07-26T08:49:58.605 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:49:58 smithi043 ceph-mon[32384]: pgmap v1048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:49:58 smithi133 ceph-mon[37053]: pgmap v1048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:49:58.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:49:58 smithi063 ceph-mon[36747]: pgmap v1048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:00 smithi133 ceph-mon[37053]: pgmap v1049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 3 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T08:50:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 846.723840 secs 2024-07-26T08:50:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:00 smithi063 ceph-mon[36747]: pgmap v1049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 3 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T08:50:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 846.723840 secs 2024-07-26T08:50:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:00 smithi043 ceph-mon[32384]: pgmap v1049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 3 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T08:50:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 846.723840 secs 2024-07-26T08:50:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 862.210226 secs 2024-07-26T08:50:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 862.210226 secs 2024-07-26T08:50:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 862.210226 secs 2024-07-26T08:50:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:02 smithi063 ceph-mon[36747]: pgmap v1050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:02 smithi043 ceph-mon[32384]: pgmap v1050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:03.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:02 smithi133 ceph-mon[37053]: pgmap v1050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:04 smithi063 ceph-mon[36747]: pgmap v1051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:04 smithi043 ceph-mon[32384]: pgmap v1051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:04 smithi133 ceph-mon[37053]: pgmap v1051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 851.723960 secs 2024-07-26T08:50:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:50:05.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 851.723960 secs 2024-07-26T08:50:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:50:05.871 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 851.723960 secs 2024-07-26T08:50:05.871 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:50:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:06 smithi043 ceph-mon[32384]: pgmap v1052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 867.210295 secs 2024-07-26T08:50:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:06 smithi063 ceph-mon[36747]: pgmap v1052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 867.210295 secs 2024-07-26T08:50:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:06 smithi133 ceph-mon[37053]: pgmap v1052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 867.210295 secs 2024-07-26T08:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: pgmap v1053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: pgmap v1053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: pgmap v1053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:10.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:10 smithi043 ceph-mon[32384]: pgmap v1054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 856.724078 secs 2024-07-26T08:50:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 872.210418 secs 2024-07-26T08:50:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:10 smithi133 ceph-mon[37053]: pgmap v1054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 856.724078 secs 2024-07-26T08:50:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 872.210418 secs 2024-07-26T08:50:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:10 smithi063 ceph-mon[36747]: pgmap v1054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 856.724078 secs 2024-07-26T08:50:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 872.210418 secs 2024-07-26T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: pgmap v1055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: pgmap v1056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:50:12.322 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: pgmap v1057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:50:12.322 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.322 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:12 smithi063 ceph-mon[36747]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T08:50:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: pgmap v1055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:50:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:50:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: pgmap v1056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:50:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: pgmap v1057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:50:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:12 smithi043 ceph-mon[32384]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: pgmap v1055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: pgmap v1056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: pgmap v1057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:50:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:50:12.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:12 smithi133 ceph-mon[37053]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T08:50:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:14 smithi043 ceph-mon[32384]: pgmap v1058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:50:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:14 smithi133 ceph-mon[37053]: pgmap v1058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:50:14.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:14 smithi063 ceph-mon[36747]: pgmap v1058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:50:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 861.724197 secs 2024-07-26T08:50:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:16 smithi043 ceph-mon[32384]: pgmap v1059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:50:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 877.210561 secs 2024-07-26T08:50:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 861.724197 secs 2024-07-26T08:50:16.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:16 smithi133 ceph-mon[37053]: pgmap v1059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:50:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 877.210561 secs 2024-07-26T08:50:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 861.724197 secs 2024-07-26T08:50:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:16 smithi063 ceph-mon[36747]: pgmap v1059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:50:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 877.210561 secs 2024-07-26T08:50:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:18 smithi043 ceph-mon[32384]: pgmap v1060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:50:18.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:18 smithi133 ceph-mon[37053]: pgmap v1060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:50:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:18 smithi063 ceph-mon[36747]: pgmap v1060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:50:18.734 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:50:19.225 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:50:20.424 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:20 smithi043 ceph-mon[32384]: pgmap v1061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:50:20.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:20 smithi133 ceph-mon[37053]: pgmap v1061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:50:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:20 smithi063 ceph-mon[36747]: pgmap v1061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:50:21.408 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 866.724311 secs 2024-07-26T08:50:21.408 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 882.210691 secs 2024-07-26T08:50:21.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 866.724311 secs 2024-07-26T08:50:21.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 882.210691 secs 2024-07-26T08:50:21.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 866.724311 secs 2024-07-26T08:50:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 882.210691 secs 2024-07-26T08:50:21.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.765+0000 7faffe000640 1 -- 172.21.15.43:0/990672388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8077370 msgr2=0x7faff8077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.765+0000 7faffe000640 1 --2- 172.21.15.43:0/990672388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8077370 0x7faff8077780 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009be0 tx=0x7fafe802a6c0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 -- 172.21.15.43:0/990672388 shutdown_connections 2024-07-26T08:50:21.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 --2- 172.21.15.43:0/990672388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faff8113fb0 0x7faff81163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 --2- 172.21.15.43:0/990672388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077cc0 0x7faff8113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 --2- 172.21.15.43:0/990672388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8077370 0x7faff8077780 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 -- 172.21.15.43:0/990672388 >> 172.21.15.43:0/990672388 conn(0x7faff81010a0 msgr2=0x7faff81034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:21.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 -- 172.21.15.43:0/990672388 shutdown_connections 2024-07-26T08:50:21.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.766+0000 7faffe000640 1 -- 172.21.15.43:0/990672388 wait complete. 2024-07-26T08:50:21.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.767+0000 7faffe000640 1 Processor -- start 2024-07-26T08:50:21.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.767+0000 7faffe000640 1 -- start start 2024-07-26T08:50:21.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.767+0000 7faffe000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 0x7faff81a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffe000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faff8077cc0 0x7faff81a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffe000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8113fb0 0x7faff81a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffe000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faff8119a50 con 0x7faff8077370 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffe000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faff81198d0 con 0x7faff8077cc0 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffe000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faff8119bd0 con 0x7faff8113fb0 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 0x7faff81a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 0x7faff81a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38256/0 (socket says 172.21.15.43:38256) 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 -- 172.21.15.43:0/3415321792 learned_addr learned my addr 172.21.15.43:0/3415321792 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faff7e00640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faff8077cc0 0x7faff81a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffd600640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8113fb0 0x7faff81a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 -- 172.21.15.43:0/3415321792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8113fb0 msgr2=0x7faff81a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8113fb0 0x7faff81a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 -- 172.21.15.43:0/3415321792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faff8077cc0 msgr2=0x7faff81a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faff8077cc0 0x7faff81a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.768+0000 7faffcc00640 1 -- 172.21.15.43:0/3415321792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff81a6350 con 0x7faff8077370 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.769+0000 7faffcc00640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 0x7faff81a03e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fafe802acb0 tx=0x7fafe8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.769+0000 7faff5600640 1 -- 172.21.15.43:0/3415321792 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8041020 con 0x7faff8077370 2024-07-26T08:50:21.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.769+0000 7faff5600640 1 -- 172.21.15.43:0/3415321792 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafe8030e90 con 0x7faff8077370 2024-07-26T08:50:21.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.769+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff81a65e0 con 0x7faff8077370 2024-07-26T08:50:21.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.769+0000 7faff5600640 1 -- 172.21.15.43:0/3415321792 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8036040 con 0x7faff8077370 2024-07-26T08:50:21.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.769+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff81acda0 con 0x7faff8077370 2024-07-26T08:50:21.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.774+0000 7fb006401740 1 Processor -- start 2024-07-26T08:50:21.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.774+0000 7fb006401740 1 -- start start 2024-07-26T08:50:21.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7fb006401740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d2a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7fb006401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2a4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7fb006401740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7fb006401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55610d21abc0 con 0x55610ced61b0 2024-07-26T08:50:21.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7fb006401740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55610d20a0c0 con 0x55610ceff070 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7fb006401740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55610d20e100 con 0x55610cede390 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7faff5600640 1 -- 172.21.15.43:0/3415321792 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fafe8044020 con 0x7faff8077370 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7faffd600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d2a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7faffd600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d2a41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38778/0 (socket says 172.21.15.43:38778) 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7faffd600640 1 -- 172.21.15.43:0/1832926690 learned_addr learned my addr 172.21.15.43:0/1832926690 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7faff7e00640 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.775+0000 7faffcc00640 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.776+0000 7faffd600640 1 -- 172.21.15.43:0/1832926690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 msgr2=0x55610d2a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.776+0000 7faffd600640 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.776+0000 7faffd600640 1 -- 172.21.15.43:0/1832926690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 msgr2=0x55610d2a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.776+0000 7faffd600640 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.776+0000 7faffd600640 1 -- 172.21.15.43:0/1832926690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610cf6a650 con 0x55610ceff070 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.776+0000 7faffd600640 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d2a41f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faff000b700 tx=0x7faff000bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419aba2423fb844c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.777+0000 7fafedc00640 1 -- 172.21.15.43:0/1832926690 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0003dd0 con 0x55610ceff070 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.777+0000 7fafedc00640 1 -- 172.21.15.43:0/1832926690 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faff0015070 con 0x55610ceff070 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.777+0000 7fafedc00640 1 -- 172.21.15.43:0/1832926690 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0010680 con 0x55610ceff070 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.777+0000 7faff5600640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fafdc0b3d40 0x7fafdc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7faff5600640 1 -- 172.21.15.43:0/3415321792 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fafe8105fb0 con 0x7faff8077370 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7faffcc00640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fafdc0b3d40 0x7fafdc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 -- 172.21.15.43:0/1832926690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 msgr2=0x55610d2a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d2a41f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faff000b700 tx=0x7faff000bbc0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 -- 172.21.15.43:0/1832926690 shutdown_connections 2024-07-26T08:50:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 --2- 172.21.15.43:0/1832926690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d2a41f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 -- 172.21.15.43:0/1832926690 >> 172.21.15.43:0/1832926690 conn(0x55610cef3460 msgr2=0x55610d2a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 -- 172.21.15.43:0/1832926690 shutdown_connections 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.778+0000 7fb006401740 1 -- 172.21.15.43:0/1832926690 wait complete. 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.779+0000 7faffcc00640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fafdc0b3d40 0x7fafdc0b6250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55610d2a2e70 tx=0x7fafe802a6c0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.779+0000 7fb006401740 1 -- start start 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.779+0000 7fb006401740 1 Processor -- start 2024-07-26T08:50:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55610d06d700 con 0x55610ceff070 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55610d1a6690 con 0x55610cede390 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55610d2b29d0 con 0x55610ced61b0 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7fb006401740 10 client.0 _ll_register_callbacks cb 0x55610d1b6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7faff7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7faffd600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7faff7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:38780/0 (socket says 172.21.15.43:38780) 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7faff7e00640 1 -- 172.21.15.43:0/4011689581 learned_addr learned my addr 172.21.15.43:0/4011689581 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:21.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.780+0000 7faffd600640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faff7e00640 1 -- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 msgr2=0x55610d2af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faff7e00640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faff7e00640 1 -- 172.21.15.43:0/4011689581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 msgr2=0x55610d2b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faff7e00640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faff7e00640 1 -- 172.21.15.43:0/4011689581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610d1bd830 con 0x55610cede390 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faffd600640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7faff7e00640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2afd80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fafe40116a0 tx=0x7fafe4011b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9227d4fca1b4648 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7fafe2000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7fafe2000640 1 -- 172.21.15.43:0/4011689581 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe401e060 con 0x55610cede390 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff0015070 con 0x55610cede390 2024-07-26T08:50:21.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.781+0000 7fafe2000640 1 -- 172.21.15.43:0/4011689581 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fafe400fbf0 con 0x55610cede390 2024-07-26T08:50:21.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fafe2000640 1 -- 172.21.15.43:0/4011689581 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7fafe4026050 con 0x55610cede390 2024-07-26T08:50:21.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 10 client.26507 fetch_fsmap learned FSMap version 336 2024-07-26T08:50:21.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55610d2be700 con 0x55610cede390 2024-07-26T08:50:21.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fafe2000640 1 -- 172.21.15.43:0/4011689581 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faff0015070 con 0x55610cede390 2024-07-26T08:50:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fafe2000640 1 -- 172.21.15.43:0/4011689581 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7fafe4019070 con 0x55610cede390 2024-07-26T08:50:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 10 client.26507 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:50:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 10 client.26507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:50:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 20 client.26507 populate_metadata read hostname 'smithi043' 2024-07-26T08:50:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610cebd9f0 0x55610d2c2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 4 client.26507 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.782+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55610d21cb10 con 0x55610cebd9f0 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.783+0000 7faffd600640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610cebd9f0 0x55610d2c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.783+0000 7faffd600640 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610cebd9f0 0x55610d2c2040 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a725ca94a7e4ec server_cookie=34e77a43be7add39 in_seq=0 out_seq=0 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.783+0000 7fafe2000640 10 client.26507 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.784+0000 7fafe2000640 1 -- 172.21.15.43:0/4011689581 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55610d21cb10 con 0x55610cebd9f0 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.784+0000 7fafe2000640 10 client.26507 handle_command_reply: tid=0 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.784+0000 7fb006401740 1 client.26507 shutdown 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 msgr2=0x55610d2afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2afd80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fafe40116a0 tx=0x7fafe4011b60 comp rx=0 tx=0).stop 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 shutdown_connections 2024-07-26T08:50:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610cebd9f0 0x55610d2c2040 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2afd80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 --2- 172.21.15.43:0/4011689581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fafe2000640 0 client.26507 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 >> 172.21.15.43:0/4011689581 conn(0x55610cef3460 msgr2=0x55610d2a7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 shutdown_connections 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 1 -- 172.21.15.43:0/4011689581 wait complete. 2024-07-26T08:50:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.785+0000 7fb006401740 20 client.26507 trim_cache size 0 max 16384 2024-07-26T08:50:21.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.804+0000 7fb006401740 1 Processor -- start 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.804+0000 7fb006401740 1 -- start start 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7fb006401740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7fb006401740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2a0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7fb006401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7fb006401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faff81b9490 con 0x55610ceff070 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7fb006401740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faff81b7950 con 0x55610cede390 2024-07-26T08:50:21.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7fb006401740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faff81b8dc0 con 0x55610ced61b0 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7faffd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7faffd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38284/0 (socket says 172.21.15.43:38284) 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.805+0000 7faffd600640 1 -- 172.21.15.43:0/2380970084 learned_addr learned my addr 172.21.15.43:0/2380970084 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faff7e00640 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 -- 172.21.15.43:0/2380970084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 msgr2=0x55610d2a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 -- 172.21.15.43:0/2380970084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 msgr2=0x55610d2a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 -- 172.21.15.43:0/2380970084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610d2a29d0 con 0x55610ceff070 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.806+0000 7faffd600640 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b1470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faff0011f20 tx=0x7faff000b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d0f4b8f1a2c613 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.807+0000 7fafed200640 1 -- 172.21.15.43:0/2380970084 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0023040 con 0x55610ceff070 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.807+0000 7fafed200640 1 -- 172.21.15.43:0/2380970084 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faff0015070 con 0x55610ceff070 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.807+0000 7fafed200640 1 -- 172.21.15.43:0/2380970084 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00048a0 con 0x55610ceff070 2024-07-26T08:50:21.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 -- 172.21.15.43:0/2380970084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 msgr2=0x55610d2b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b1470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faff0011f20 tx=0x7faff000b2e0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 -- 172.21.15.43:0/2380970084 shutdown_connections 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ceff070 0x55610d2b1470 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610cede390 0x55610d2a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 --2- 172.21.15.43:0/2380970084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610ced61b0 0x55610d2a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 -- 172.21.15.43:0/2380970084 >> 172.21.15.43:0/2380970084 conn(0x55610cef3460 msgr2=0x55610d2b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 -- 172.21.15.43:0/2380970084 shutdown_connections 2024-07-26T08:50:21.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.808+0000 7fb006401740 1 -- 172.21.15.43:0/2380970084 wait complete. 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.809+0000 7fb006401740 1 -- start start 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.809+0000 7fb006401740 1 Processor -- start 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d3227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faff81b86f0 con 0x55610ced61b0 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faff81b8020 con 0x55610ceff070 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55610d2a0c60 con 0x55610cede390 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7fb006401740 10 client.0 _ll_register_callbacks cb 0x7fafe4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45208/0 (socket says 172.21.15.43:45208) 2024-07-26T08:50:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 -- 172.21.15.43:0/4131594039 learned_addr learned my addr 172.21.15.43:0/4131594039 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faffd600640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faffd600640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d3227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 -- 172.21.15.43:0/4131594039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 msgr2=0x55610d3227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d3227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 -- 172.21.15.43:0/4131594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 msgr2=0x55610d2b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faff7e00640 1 -- 172.21.15.43:0/4131594039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610d322e50 con 0x55610cede390 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.810+0000 7faffd600640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7faff7e00640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2b59c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafe40213e0 tx=0x7fafe4004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5be01e8e3e6d2588 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fafe2000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fafe2000640 1 -- 172.21.15.43:0/4131594039 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe402f020 con 0x55610cede390 2024-07-26T08:50:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff0015070 con 0x55610cede390 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fafe2000640 1 -- 172.21.15.43:0/4131594039 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fafe4004440 con 0x55610cede390 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fafe2000640 1 -- 172.21.15.43:0/4131594039 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7fafe403b050 con 0x55610cede390 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fb006401740 10 client.26485 fetch_fsmap learned FSMap version 336 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.811+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55610d32a1b0 con 0x55610cede390 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fafe2000640 1 -- 172.21.15.43:0/4131594039 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faff0015070 con 0x55610cede390 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fafe2000640 1 -- 172.21.15.43:0/4131594039 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7fafe4029040 con 0x55610cede390 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fb006401740 10 client.26485 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fb006401740 10 client.26485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fb006401740 20 client.26485 populate_metadata read hostname 'smithi043' 2024-07-26T08:50:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fb006401740 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610ce92da0 0x55610d32c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fb006401740 4 client.26485 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55610d2185b0 con 0x55610ce92da0 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.812+0000 7faffd600640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610ce92da0 0x55610d32c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7faffd600640 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610ce92da0 0x55610d32c990 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2208e78f6511c28b server_cookie=da9869232ddebde in_seq=0 out_seq=0 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7fafe2000640 10 client.26485 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7fafe2000640 1 -- 172.21.15.43:0/4131594039 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55610d2185b0 con 0x55610ce92da0 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7fafe2000640 10 client.26485 handle_command_reply: tid=0 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7fb006401740 1 client.26485 shutdown 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 msgr2=0x55610d2b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.813+0000 7fb006401740 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2b59c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafe40213e0 tx=0x7fafe4004250 comp rx=0 tx=0).stop 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 shutdown_connections 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55610ce92da0 0x55610d32c990 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55610cede390 0x55610d2b59c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55610ceff070 0x55610d3227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 --2- 172.21.15.43:0/4131594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55610ced61b0 0x55610d2b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fafe2000640 0 client.26485 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 >> 172.21.15.43:0/4131594039 conn(0x55610cef3460 msgr2=0x55610d2a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 shutdown_connections 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 1 -- 172.21.15.43:0/4131594039 wait complete. 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.814+0000 7fb006401740 20 client.26485 trim_cache size 0 max 16384 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:50:21.821 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:50:21.822 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fafdc0b3d40 msgr2=0x7fafdc0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fafdc0b3d40 0x7fafdc0b6250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55610d2a2e70 tx=0x7fafe802a6c0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 msgr2=0x7faff81a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 0x7faff81a03e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fafe802acb0 tx=0x7fafe8003c10 comp rx=0 tx=0).stop 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 shutdown_connections 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fafdc0b3d40 0x7fafdc0b6250 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff8113fb0 0x7faff81a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faff8077cc0 0x7faff81a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 --2- 172.21.15.43:0/3415321792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faff8077370 0x7faff81a03e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:21.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 >> 172.21.15.43:0/3415321792 conn(0x7faff81010a0 msgr2=0x7faff8115fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:21.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 shutdown_connections 2024-07-26T08:50:21.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:21.815+0000 7faffe000640 1 -- 172.21.15.43:0/3415321792 wait complete. 2024-07-26T08:50:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:22 smithi043 ceph-mon[32384]: pgmap v1062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:50:22.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:22 smithi133 ceph-mon[37053]: pgmap v1062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:50:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:22 smithi063 ceph-mon[36747]: pgmap v1062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:50:22.807 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:50:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:24 smithi043 ceph-mon[32384]: pgmap v1063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:24 smithi133 ceph-mon[37053]: pgmap v1063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:24 smithi063 ceph-mon[36747]: pgmap v1063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 871.724426 secs 2024-07-26T08:50:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:26 smithi043 ceph-mon[32384]: pgmap v1064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 887.210847 secs 2024-07-26T08:50:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 871.724426 secs 2024-07-26T08:50:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:26 smithi133 ceph-mon[37053]: pgmap v1064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 887.210847 secs 2024-07-26T08:50:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 871.724426 secs 2024-07-26T08:50:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:26 smithi063 ceph-mon[36747]: pgmap v1064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 887.210847 secs 2024-07-26T08:50:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:28 smithi043 ceph-mon[32384]: pgmap v1065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:28 smithi133 ceph-mon[37053]: pgmap v1065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:28 smithi063 ceph-mon[36747]: pgmap v1065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:30 smithi043 ceph-mon[32384]: pgmap v1066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:30.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:30 smithi133 ceph-mon[37053]: pgmap v1066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:30 smithi063 ceph-mon[36747]: pgmap v1066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 876.724541 secs 2024-07-26T08:50:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 892.210907 secs 2024-07-26T08:50:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 876.724541 secs 2024-07-26T08:50:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 892.210907 secs 2024-07-26T08:50:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 876.724541 secs 2024-07-26T08:50:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 892.210907 secs 2024-07-26T08:50:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:32 smithi043 ceph-mon[32384]: pgmap v1067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:32.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:32 smithi133 ceph-mon[37053]: pgmap v1067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:32.572 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:32 smithi063 ceph-mon[36747]: pgmap v1067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:34 smithi043 ceph-mon[32384]: pgmap v1068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:34 smithi133 ceph-mon[37053]: pgmap v1068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:34 smithi063 ceph-mon[36747]: pgmap v1068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 881.724642 secs 2024-07-26T08:50:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:36 smithi043 ceph-mon[32384]: pgmap v1069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 897.210982 secs 2024-07-26T08:50:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 881.724642 secs 2024-07-26T08:50:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:36 smithi133 ceph-mon[37053]: pgmap v1069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 897.210982 secs 2024-07-26T08:50:36.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 881.724642 secs 2024-07-26T08:50:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:36 smithi063 ceph-mon[36747]: pgmap v1069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 897.210982 secs 2024-07-26T08:50:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:38 smithi043 ceph-mon[32384]: pgmap v1070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:38 smithi133 ceph-mon[37053]: pgmap v1070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:38 smithi063 ceph-mon[36747]: pgmap v1070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:40 smithi043 ceph-mon[32384]: pgmap v1071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:40.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:40 smithi133 ceph-mon[37053]: pgmap v1071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:40 smithi063 ceph-mon[36747]: pgmap v1071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 886.724783 secs 2024-07-26T08:50:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 902.211106 secs 2024-07-26T08:50:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 886.724783 secs 2024-07-26T08:50:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 902.211106 secs 2024-07-26T08:50:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 886.724783 secs 2024-07-26T08:50:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 902.211106 secs 2024-07-26T08:50:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:42 smithi133 ceph-mon[37053]: pgmap v1072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:42 smithi063 ceph-mon[36747]: pgmap v1072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:42 smithi043 ceph-mon[32384]: pgmap v1072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:44 smithi133 ceph-mon[37053]: pgmap v1073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:44 smithi063 ceph-mon[36747]: pgmap v1073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:44 smithi043 ceph-mon[32384]: pgmap v1073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 891.724921 secs 2024-07-26T08:50:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:46 smithi133 ceph-mon[37053]: pgmap v1074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 907.211189 secs 2024-07-26T08:50:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 891.724921 secs 2024-07-26T08:50:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:46 smithi063 ceph-mon[36747]: pgmap v1074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 907.211189 secs 2024-07-26T08:50:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 891.724921 secs 2024-07-26T08:50:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:46 smithi043 ceph-mon[32384]: pgmap v1074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 907.211189 secs 2024-07-26T08:50:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:48 smithi133 ceph-mon[37053]: pgmap v1075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:48 smithi063 ceph-mon[36747]: pgmap v1075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:48 smithi043 ceph-mon[32384]: pgmap v1075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:50 smithi133 ceph-mon[37053]: pgmap v1076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 896.725067 secs 2024-07-26T08:50:50.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:50 smithi063 ceph-mon[36747]: pgmap v1076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 896.725067 secs 2024-07-26T08:50:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:50 smithi043 ceph-mon[32384]: pgmap v1076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 896.725067 secs 2024-07-26T08:50:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 912.211274 secs 2024-07-26T08:50:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 912.211274 secs 2024-07-26T08:50:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 912.211274 secs 2024-07-26T08:50:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:52 smithi063 ceph-mon[36747]: pgmap v1077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:52 smithi043 ceph-mon[32384]: pgmap v1077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:52.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:52 smithi133 ceph-mon[37053]: pgmap v1077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:52.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:50:53.302 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:50:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:54 smithi063 ceph-mon[36747]: pgmap v1078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:54 smithi043 ceph-mon[32384]: pgmap v1078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:54.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:54 smithi133 ceph-mon[37053]: pgmap v1078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:50:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 901.725217 secs 2024-07-26T08:50:55.601 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 901.725217 secs 2024-07-26T08:50:55.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 901.725217 secs 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.112+0000 7fdc05800640 1 -- 172.21.15.43:0/1841375475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0010fc80 msgr2=0x7fdc001164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.112+0000 7fdc05800640 1 --2- 172.21.15.43:0/1841375475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0010fc80 0x7fdc001164b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8009be0 tx=0x7fdbf802a6c0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 -- 172.21.15.43:0/1841375475 shutdown_connections 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 --2- 172.21.15.43:0/1841375475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0010fc80 0x7fdc001164b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 --2- 172.21.15.43:0/1841375475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010f330 0x7fdc0010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 --2- 172.21.15.43:0/1841375475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc001099f0 0x7fdc00109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 -- 172.21.15.43:0/1841375475 >> 172.21.15.43:0/1841375475 conn(0x7fdc00078ff0 msgr2=0x7fdc00107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 -- 172.21.15.43:0/1841375475 shutdown_connections 2024-07-26T08:50:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.113+0000 7fdc05800640 1 -- 172.21.15.43:0/1841375475 wait complete. 2024-07-26T08:50:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.114+0000 7fdc05800640 1 Processor -- start 2024-07-26T08:50:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 -- start start 2024-07-26T08:50:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc001099f0 0x7fdc001a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc0010f330 0x7fdc001a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 0x7fdc001a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdc00119a60 con 0x7fdc0010fc80 2024-07-26T08:50:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001198e0 con 0x7fdc0010f330 2024-07-26T08:50:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.115+0000 7fdc05800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdc00119be0 con 0x7fdc001099f0 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 0x7fdc001a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdbf7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc0010f330 0x7fdc001a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc001099f0 0x7fdc001a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 0x7fdc001a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42026/0 (socket says 172.21.15.43:42026) 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 -- 172.21.15.43:0/1627253178 learned_addr learned my addr 172.21.15.43:0/1627253178 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 -- 172.21.15.43:0/1627253178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc001099f0 msgr2=0x7fdc001a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc001099f0 0x7fdc001a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 -- 172.21.15.43:0/1627253178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc0010f330 msgr2=0x7fdc001a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc0010f330 0x7fdc001a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdc04e00640 1 -- 172.21.15.43:0/1627253178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc001a6300 con 0x7fdc0010fc80 2024-07-26T08:50:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdbffe00640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc001099f0 0x7fdc001a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:50:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.116+0000 7fdbf7400640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc0010f330 0x7fdc001a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:50:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.117+0000 7fdc04e00640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 0x7fdc001a5bd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8004af0 tx=0x7fdbf8032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.117+0000 7fdbfd600640 1 -- 172.21.15.43:0/1627253178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8041020 con 0x7fdc0010fc80 2024-07-26T08:50:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.117+0000 7fdbfd600640 1 -- 172.21.15.43:0/1627253178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbf8030e90 con 0x7fdc0010fc80 2024-07-26T08:50:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.117+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc001a6590 con 0x7fdc0010fc80 2024-07-26T08:50:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.117+0000 7fdbfd600640 1 -- 172.21.15.43:0/1627253178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8036040 con 0x7fdc0010fc80 2024-07-26T08:50:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.118+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc001acd50 con 0x7fdc0010fc80 2024-07-26T08:50:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.121+0000 7fdc0da07740 1 Processor -- start 2024-07-26T08:50:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.122+0000 7fdbfd600640 1 -- 172.21.15.43:0/1627253178 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fdbf8044020 con 0x7fdc0010fc80 2024-07-26T08:50:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 -- start start 2024-07-26T08:50:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33937070 0x55cd33cdbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33cdc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33cdca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cd33c52b90 con 0x55cd33916390 2024-07-26T08:50:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cd33c42090 con 0x55cd3390e1b0 2024-07-26T08:50:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdc0da07740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cd33c460d0 con 0x55cd33937070 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33cdc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.123+0000 7fdbf7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33cdca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33cdc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:48112/0 (socket says 172.21.15.43:48112) 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbf7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33cdca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42028/0 (socket says 172.21.15.43:42028) 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 -- 172.21.15.43:0/3789767522 learned_addr learned my addr 172.21.15.43:0/3789767522 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbf7400640 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33937070 0x55cd33cdbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 -- 172.21.15.43:0/3789767522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33937070 msgr2=0x55cd33cdbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33937070 0x55cd33cdbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 -- 172.21.15.43:0/3789767522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 msgr2=0x55cd33cdca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33cdca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 -- 172.21.15.43:0/3789767522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd339a2650 con 0x55cd3390e1b0 2024-07-26T08:50:56.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.124+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33cdc510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0011510 tx=0x7fdbf00119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f50568ac983df9b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.125+0000 7fdbf5600640 1 -- 172.21.15.43:0/3789767522 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0004020 con 0x55cd3390e1b0 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.125+0000 7fdbf5600640 1 -- 172.21.15.43:0/3789767522 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbf00041c0 con 0x55cd3390e1b0 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.125+0000 7fdbf5600640 1 -- 172.21.15.43:0/3789767522 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000f930 con 0x55cd3390e1b0 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.125+0000 7fdbfd600640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdbe40b3dc0 0x7fdbe40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.125+0000 7fdbfd600640 1 -- 172.21.15.43:0/1627253178 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fdbf8105b50 con 0x7fdc0010fc80 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdbf7400640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdbe40b3dc0 0x7fdbe40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 -- 172.21.15.43:0/3789767522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 msgr2=0x55cd33cdc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33cdc510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0011510 tx=0x7fdbf00119d0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 -- 172.21.15.43:0/3789767522 shutdown_connections 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33cdca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33cdc510 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3789767522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33937070 0x55cd33cdbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 -- 172.21.15.43:0/3789767522 >> 172.21.15.43:0/3789767522 conn(0x55cd3392b460 msgr2=0x55cd33cd9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 -- 172.21.15.43:0/3789767522 shutdown_connections 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.126+0000 7fdc0da07740 1 -- 172.21.15.43:0/3789767522 wait complete. 2024-07-26T08:50:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.127+0000 7fdbf7400640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdbe40b3dc0 0x7fdbe40b62d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc0010fa30 tx=0x7fdbe8004730 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.127+0000 7fdc0da07740 1 -- start start 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.127+0000 7fdc0da07740 1 Processor -- start 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33ce7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33916390 0x55cd33ce7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33ce7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cd33aa5700 con 0x55cd33937070 2024-07-26T08:50:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cd33bde660 con 0x55cd3390e1b0 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cd33cea7b0 con 0x55cd33916390 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc0da07740 10 client.0 _ll_register_callbacks cb 0x55cd33bee110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33ce7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33ce7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:48122/0 (socket says 172.21.15.43:48122) 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdbffe00640 1 -- 172.21.15.43:0/2038025231 learned_addr learned my addr 172.21.15.43:0/2038025231 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdc04e00640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33ce7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.128+0000 7fdbf7400640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33916390 0x55cd33ce7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbffe00640 1 -- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33916390 msgr2=0x55cd33ce7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbffe00640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33916390 0x55cd33ce7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbffe00640 1 -- 172.21.15.43:0/2038025231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 msgr2=0x55cd33ce7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbffe00640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33ce7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbffe00640 1 -- 172.21.15.43:0/2038025231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd33bf5800 con 0x55cd3390e1b0 2024-07-26T08:50:56.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbf7400640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33916390 0x55cd33ce7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbffe00640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33ce7530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0006010 tx=0x7fdbf0005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc82a318d73cc560 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.129+0000 7fdbee000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.130+0000 7fdbee000640 1 -- 172.21.15.43:0/2038025231 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0027070 con 0x55cd3390e1b0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.130+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf00041c0 con 0x55cd3390e1b0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.130+0000 7fdbee000640 1 -- 172.21.15.43:0/2038025231 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fdbf0003f70 con 0x55cd3390e1b0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.130+0000 7fdbee000640 1 -- 172.21.15.43:0/2038025231 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7fdbf0034050 con 0x55cd3390e1b0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.130+0000 7fdc0da07740 10 client.26525 fetch_fsmap learned FSMap version 336 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.130+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55cd33cf6390 con 0x55cd3390e1b0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdbee000640 1 -- 172.21.15.43:0/2038025231 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbf00041c0 con 0x55cd3390e1b0 2024-07-26T08:50:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdbee000640 1 -- 172.21.15.43:0/2038025231 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7fdbf0004ab0 con 0x55cd3390e1b0 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdc0da07740 10 client.26525 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdc0da07740 10 client.26525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdc0da07740 20 client.26525 populate_metadata read hostname 'smithi043' 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdc0da07740 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338f59f0 0x55cd33cf9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdc0da07740 4 client.26525 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd33c54ae0 con 0x55cd338f59f0 2024-07-26T08:50:56.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.131+0000 7fdbf7400640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338f59f0 0x55cd33cf9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.132+0000 7fdbf7400640 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338f59f0 0x55cd33cf9ba0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97028ba7f4600d0 server_cookie=e829bfe679482c68 in_seq=0 out_seq=0 2024-07-26T08:50:56.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.132+0000 7fdbee000640 10 client.26525 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:56.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.133+0000 7fdbee000640 1 -- 172.21.15.43:0/2038025231 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd33c54ae0 con 0x55cd338f59f0 2024-07-26T08:50:56.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.133+0000 7fdbee000640 10 client.26525 handle_command_reply: tid=0 2024-07-26T08:50:56.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.133+0000 7fdc0da07740 1 client.26525 shutdown 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 msgr2=0x55cd33ce7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33ce7530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0006010 tx=0x7fdbf0005e10 comp rx=0 tx=0).stop 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 shutdown_connections 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338f59f0 0x55cd33cf9ba0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd33916390 0x55cd33ce7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33ce7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 --2- 172.21.15.43:0/2038025231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd3390e1b0 0x55cd33ce7530 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdbee000640 0 client.26525 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 >> 172.21.15.43:0/2038025231 conn(0x55cd3392b460 msgr2=0x55cd33cdf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 shutdown_connections 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 1 -- 172.21.15.43:0/2038025231 wait complete. 2024-07-26T08:50:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.134+0000 7fdc0da07740 20 client.26525 trim_cache size 0 max 16384 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.153+0000 7fdc0da07740 1 Processor -- start 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.153+0000 7fdc0da07740 1 -- start start 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.154+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cd8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.154+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33916390 0x55cd33ce7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.154+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33cff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.154+0000 7fdc0da07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001b9550 con 0x55cd33937070 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.154+0000 7fdc0da07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001b7a10 con 0x55cd33916390 2024-07-26T08:50:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.154+0000 7fdc0da07740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001b8e80 con 0x55cd3390e1b0 2024-07-26T08:50:56.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cd8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdc04e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33cff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cd8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57304/0 (socket says 172.21.15.43:57304) 2024-07-26T08:50:56.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdbffe00640 1 -- 172.21.15.43:0/3865795656 learned_addr learned my addr 172.21.15.43:0/3865795656 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdbf7400640 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33916390 0x55cd33ce7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdc04e00640 1 -- 172.21.15.43:0/3865795656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 msgr2=0x55cd33cd8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdc04e00640 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cd8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdc04e00640 1 -- 172.21.15.43:0/3865795656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33916390 msgr2=0x55cd33ce7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdc04e00640 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33916390 0x55cd33ce7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdc04e00640 1 -- 172.21.15.43:0/3865795656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd33cdee30 con 0x55cd33937070 2024-07-26T08:50:56.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.155+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cd8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:50:56.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.156+0000 7fdc04e00640 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33cff3a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8101ed0 tx=0x7fdbf80cabc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c84bd25eb2fc65 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:56.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.156+0000 7fdbf4c00640 1 -- 172.21.15.43:0/3865795656 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80cb390 con 0x55cd33937070 2024-07-26T08:50:56.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.156+0000 7fdbf4c00640 1 -- 172.21.15.43:0/3865795656 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbf80cf990 con 0x55cd33937070 2024-07-26T08:50:56.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.156+0000 7fdbf4c00640 1 -- 172.21.15.43:0/3865795656 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80d4210 con 0x55cd33937070 2024-07-26T08:50:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.157+0000 7fdc0da07740 1 -- 172.21.15.43:0/3865795656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 msgr2=0x55cd33cff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.157+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33cff3a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8101ed0 tx=0x7fdbf80cabc0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 -- 172.21.15.43:0/3865795656 shutdown_connections 2024-07-26T08:50:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33937070 0x55cd33cff3a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33916390 0x55cd33ce7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3865795656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cd8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 -- 172.21.15.43:0/3865795656 >> 172.21.15.43:0/3865795656 conn(0x55cd3392b460 msgr2=0x55cd33ce74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:56.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 -- 172.21.15.43:0/3865795656 shutdown_connections 2024-07-26T08:50:56.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.158+0000 7fdc0da07740 1 -- 172.21.15.43:0/3865795656 wait complete. 2024-07-26T08:50:56.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.159+0000 7fdc0da07740 1 -- start start 2024-07-26T08:50:56.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.159+0000 7fdc0da07740 1 Processor -- start 2024-07-26T08:50:56.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33ced350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33937070 0x55cd33d60370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001b87b0 con 0x55cd33916390 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001b80e0 con 0x55cd33937070 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cd33ce72e0 con 0x55cd3390e1b0 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdc0da07740 10 client.0 _ll_register_callbacks cb 0x7fdbf0009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdbffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cecd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:57306/0 (socket says 172.21.15.43:57306) 2024-07-26T08:50:56.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.160+0000 7fdbffe00640 1 -- 172.21.15.43:0/3989938723 learned_addr learned my addr 172.21.15.43:0/3989938723 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:50:56.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdbf7400640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33ced350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdc04e00640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33937070 0x55cd33d60370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdbffe00640 1 -- 172.21.15.43:0/3989938723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33937070 msgr2=0x55cd33d60370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33937070 0x55cd33d60370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdbffe00640 1 -- 172.21.15.43:0/3989938723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 msgr2=0x55cd33ced350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33ced350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.161+0000 7fdbffe00640 1 -- 172.21.15.43:0/3989938723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd33d608b0 con 0x55cd3390e1b0 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.162+0000 7fdbffe00640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cecd70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0000c00 tx=0x7fdbf00119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bd1a44211a949fa server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.162+0000 7fdbee000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.162+0000 7fdbee000640 1 -- 172.21.15.43:0/3989938723 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0027040 con 0x55cd3390e1b0 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.162+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf80cf990 con 0x55cd3390e1b0 2024-07-26T08:50:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.162+0000 7fdbee000640 1 -- 172.21.15.43:0/3989938723 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fdbf000fd70 con 0x55cd3390e1b0 2024-07-26T08:50:56.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.162+0000 7fdbee000640 1 -- 172.21.15.43:0/3989938723 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7fdbf0009260 con 0x55cd3390e1b0 2024-07-26T08:50:56.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdc0da07740 10 client.26503 fetch_fsmap learned FSMap version 336 2024-07-26T08:50:56.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55cd33d61a70 con 0x55cd3390e1b0 2024-07-26T08:50:56.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdbee000640 1 -- 172.21.15.43:0/3989938723 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbf80cf990 con 0x55cd3390e1b0 2024-07-26T08:50:56.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdbee000640 1 -- 172.21.15.43:0/3989938723 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7fdbf0037070 con 0x55cd3390e1b0 2024-07-26T08:50:56.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdc0da07740 10 client.26503 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:50:56.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdc0da07740 10 client.26503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:50:56.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdc0da07740 20 client.26503 populate_metadata read hostname 'smithi043' 2024-07-26T08:50:56.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.163+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338cada0 0x55cd33d64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:50:56.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.164+0000 7fdc0da07740 4 client.26503 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:50:56.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.164+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd33c50580 con 0x55cd338cada0 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.164+0000 7fdbf7400640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338cada0 0x55cd33d64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdbf7400640 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338cada0 0x55cd33d64250 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89a0ce1d91f705be server_cookie=7976b42cda84e0d8 in_seq=0 out_seq=0 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdbee000640 10 client.26503 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdbee000640 1 -- 172.21.15.43:0/3989938723 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55cd33c50580 con 0x55cd338cada0 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdbee000640 10 client.26503 handle_command_reply: tid=0 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdc0da07740 1 client.26503 shutdown 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 msgr2=0x55cd33cecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.165+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cecd70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0000c00 tx=0x7fdbf00119d0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 shutdown_connections 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55cd338cada0 0x55cd33d64250 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd33937070 0x55cd33d60370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd33916390 0x55cd33ced350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 --2- 172.21.15.43:0/3989938723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd3390e1b0 0x55cd33cecd70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdbee000640 0 client.26503 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 >> 172.21.15.43:0/3989938723 conn(0x55cd3392b460 msgr2=0x55cd33cd8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 shutdown_connections 2024-07-26T08:50:56.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 1 -- 172.21.15.43:0/3989938723 wait complete. 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.166+0000 7fdc0da07740 20 client.26503 trim_cache size 0 max 16384 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:50:56.169 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdbe40b3dc0 msgr2=0x7fdbe40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdbe40b3dc0 0x7fdbe40b62d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc0010fa30 tx=0x7fdbe8004730 comp rx=0 tx=0).stop 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 msgr2=0x7fdc001a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 0x7fdc001a5bd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8004af0 tx=0x7fdbf8032f90 comp rx=0 tx=0).stop 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 shutdown_connections 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fdbe40b3dc0 0x7fdbe40b62d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0010fc80 0x7fdc001a5bd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc0010f330 0x7fdc001a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 --2- 172.21.15.43:0/1627253178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc001099f0 0x7fdc001a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:50:56.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.167+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 >> 172.21.15.43:0/1627253178 conn(0x7fdc00078ff0 msgr2=0x7fdc00079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:50:56.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.168+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 shutdown_connections 2024-07-26T08:50:56.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:50:56.168+0000 7fdc05800640 1 -- 172.21.15.43:0/1627253178 wait complete. 2024-07-26T08:50:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:56 smithi043 ceph-mon[32384]: pgmap v1079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 917.211414 secs 2024-07-26T08:50:56.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:56 smithi063 ceph-mon[36747]: pgmap v1079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:56.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 917.211414 secs 2024-07-26T08:50:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:56 smithi133 ceph-mon[37053]: pgmap v1079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:50:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 917.211414 secs 2024-07-26T08:50:57.019 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:50:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:50:58 smithi063 ceph-mon[36747]: pgmap v1080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:50:58 smithi043 ceph-mon[32384]: pgmap v1080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:50:58.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:50:58 smithi133 ceph-mon[37053]: pgmap v1080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:00 smithi063 ceph-mon[36747]: pgmap v1081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 906.725333 secs 2024-07-26T08:51:00.568 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:00 smithi133 ceph-mon[37053]: pgmap v1081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:00.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 906.725333 secs 2024-07-26T08:51:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:00 smithi043 ceph-mon[32384]: pgmap v1081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 906.725333 secs 2024-07-26T08:51:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 922.211498 secs 2024-07-26T08:51:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 922.211498 secs 2024-07-26T08:51:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 922.211498 secs 2024-07-26T08:51:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:02 smithi043 ceph-mon[32384]: pgmap v1082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:02 smithi133 ceph-mon[37053]: pgmap v1082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:02 smithi063 ceph-mon[36747]: pgmap v1082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:04 smithi043 ceph-mon[32384]: pgmap v1083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:04 smithi133 ceph-mon[37053]: pgmap v1083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:04 smithi063 ceph-mon[36747]: pgmap v1083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:05.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 911.725418 secs 2024-07-26T08:51:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 911.725418 secs 2024-07-26T08:51:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 911.725418 secs 2024-07-26T08:51:06.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:06 smithi043 ceph-mon[32384]: pgmap v1084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 927.211578 secs 2024-07-26T08:51:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:06 smithi133 ceph-mon[37053]: pgmap v1084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 927.211578 secs 2024-07-26T08:51:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:06 smithi063 ceph-mon[36747]: pgmap v1084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 927.211578 secs 2024-07-26T08:51:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:08 smithi043 ceph-mon[32384]: pgmap v1085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:08.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:08 smithi133 ceph-mon[37053]: pgmap v1085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:08 smithi063 ceph-mon[36747]: pgmap v1085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:10 smithi043 ceph-mon[32384]: pgmap v1086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 916.725552 secs 2024-07-26T08:51:10.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:10 smithi133 ceph-mon[37053]: pgmap v1086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 916.725552 secs 2024-07-26T08:51:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:10 smithi063 ceph-mon[36747]: pgmap v1086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 916.725552 secs 2024-07-26T08:51:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 932.211715 secs 2024-07-26T08:51:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:11 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:51:11.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 932.211715 secs 2024-07-26T08:51:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:11 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:51:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 932.211715 secs 2024-07-26T08:51:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:11 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:51:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:12 smithi043 ceph-mon[32384]: pgmap v1087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:12.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:12 smithi133 ceph-mon[37053]: pgmap v1087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:12 smithi063 ceph-mon[36747]: pgmap v1087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:51:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:51:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:13 smithi043 ceph-mon[32384]: pgmap v1088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:51:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:13 smithi043 ceph-mon[32384]: pgmap v1089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:51:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:51:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:51:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:51:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:13 smithi133 ceph-mon[37053]: pgmap v1088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:51:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:13 smithi133 ceph-mon[37053]: pgmap v1089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:51:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:51:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:51:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:51:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:13 smithi063 ceph-mon[36747]: pgmap v1088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:51:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:13 smithi063 ceph-mon[36747]: pgmap v1089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:51:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:51:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:15 smithi043 ceph-mon[32384]: pgmap v1090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 921.725655 secs 2024-07-26T08:51:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:15 smithi133 ceph-mon[37053]: pgmap v1090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 921.725655 secs 2024-07-26T08:51:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:15 smithi063 ceph-mon[36747]: pgmap v1090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 921.725655 secs 2024-07-26T08:51:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 937.211841 secs 2024-07-26T08:51:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 937.211841 secs 2024-07-26T08:51:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 937.211841 secs 2024-07-26T08:51:17.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:17 smithi133 ceph-mon[37053]: pgmap v1091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:51:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:17 smithi063 ceph-mon[36747]: pgmap v1091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:51:17.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:17 smithi043 ceph-mon[32384]: pgmap v1091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:51:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:19 smithi133 ceph-mon[37053]: pgmap v1092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:51:19.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:19 smithi063 ceph-mon[36747]: pgmap v1092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:51:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:19 smithi043 ceph-mon[32384]: pgmap v1092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:51:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 926.725762 secs 2024-07-26T08:51:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 926.725762 secs 2024-07-26T08:51:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 926.725762 secs 2024-07-26T08:51:21.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:21 smithi133 ceph-mon[37053]: pgmap v1093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T08:51:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 942.211979 secs 2024-07-26T08:51:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:21 smithi063 ceph-mon[36747]: pgmap v1093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T08:51:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 942.211979 secs 2024-07-26T08:51:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:21 smithi043 ceph-mon[32384]: pgmap v1093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T08:51:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 942.211979 secs 2024-07-26T08:51:23.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:23 smithi133 ceph-mon[37053]: pgmap v1094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:51:23.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:23 smithi063 ceph-mon[36747]: pgmap v1094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:51:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:23 smithi043 ceph-mon[32384]: pgmap v1094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:51:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:25 smithi063 ceph-mon[36747]: pgmap v1095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:51:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 931.725898 secs 2024-07-26T08:51:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:25 smithi043 ceph-mon[32384]: pgmap v1095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:51:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 931.725898 secs 2024-07-26T08:51:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:25 smithi133 ceph-mon[37053]: pgmap v1095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:51:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 931.725898 secs 2024-07-26T08:51:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 947.212050 secs 2024-07-26T08:51:26.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 947.212050 secs 2024-07-26T08:51:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 947.212050 secs 2024-07-26T08:51:27.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:51:27.509 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:51:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:27 smithi063 ceph-mon[36747]: pgmap v1096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:51:27.918 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:27 smithi043 ceph-mon[32384]: pgmap v1096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:51:28.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:27 smithi133 ceph-mon[37053]: pgmap v1096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:51:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:29 smithi063 ceph-mon[36747]: pgmap v1097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:29.819 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:29 smithi043 ceph-mon[32384]: pgmap v1097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:29 smithi133 ceph-mon[37053]: pgmap v1097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:30.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.203+0000 7f5a95200640 1 -- 172.21.15.43:0/1648923011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a901057b0 msgr2=0x7f5a90105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.203+0000 7f5a95200640 1 --2- 172.21.15.43:0/1648923011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a901057b0 0x7f5a90105bc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009ca0 tx=0x7f5a8002a8c0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 -- 172.21.15.43:0/1648923011 shutdown_connections 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 --2- 172.21.15.43:0/1648923011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9010b0f0 0x7f5a9010b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 --2- 172.21.15.43:0/1648923011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a9010ba40 0x7f5a90112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 --2- 172.21.15.43:0/1648923011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a901057b0 0x7f5a90105bc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 -- 172.21.15.43:0/1648923011 >> 172.21.15.43:0/1648923011 conn(0x7f5a90101240 msgr2=0x7f5a90103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 -- 172.21.15.43:0/1648923011 shutdown_connections 2024-07-26T08:51:30.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.204+0000 7f5a95200640 1 -- 172.21.15.43:0/1648923011 wait complete. 2024-07-26T08:51:30.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.206+0000 7f5a95200640 1 Processor -- start 2024-07-26T08:51:30.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.206+0000 7f5a95200640 1 -- start start 2024-07-26T08:51:30.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a95200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a901057b0 0x7f5a9019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a95200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9010b0f0 0x7f5a9019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a95200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 0x7f5a901a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a95200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a90115870 con 0x7f5a901057b0 2024-07-26T08:51:30.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a95200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901156f0 con 0x7f5a9010ba40 2024-07-26T08:51:30.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a95200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901159f0 con 0x7f5a9010b0f0 2024-07-26T08:51:30.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a901057b0 0x7f5a9019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a8e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 0x7f5a901a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a8e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 0x7f5a901a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46020/0 (socket says 172.21.15.43:46020) 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a8e800640 1 -- 172.21.15.43:0/908352958 learned_addr learned my addr 172.21.15.43:0/908352958 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.207+0000 7f5a8d400640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9010b0f0 0x7f5a9019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a8e800640 1 -- 172.21.15.43:0/908352958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9010b0f0 msgr2=0x7f5a9019c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a8e800640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9010b0f0 0x7f5a9019c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a8e800640 1 -- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a901057b0 msgr2=0x7f5a9019c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a8e800640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a901057b0 0x7f5a9019c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a8e800640 1 -- 172.21.15.43:0/908352958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a901a2150 con 0x7f5a9010ba40 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a8e800640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 0x7f5a901a1a20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e970 tx=0x7f5a8800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a86a00640 1 -- 172.21.15.43:0/908352958 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800ccc0 con 0x7f5a9010ba40 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a86a00640 1 -- 172.21.15.43:0/908352958 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a8800ce60 con 0x7f5a9010ba40 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a901a2440 con 0x7f5a9010ba40 2024-07-26T08:51:30.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.208+0000 7f5a86a00640 1 -- 172.21.15.43:0/908352958 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88010430 con 0x7f5a9010ba40 2024-07-26T08:51:30.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.209+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a901a8ba0 con 0x7f5a9010ba40 2024-07-26T08:51:30.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.212+0000 7f5a9be11740 1 Processor -- start 2024-07-26T08:51:30.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.212+0000 7f5a86a00640 1 -- 172.21.15.43:0/908352958 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5a88005020 con 0x7f5a9010ba40 2024-07-26T08:51:30.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 -- start start 2024-07-26T08:51:30.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658a3ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a3d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a3d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5626589b3bc0 con 0x562658677390 2024-07-26T08:51:30.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5626589a30c0 con 0x56265866f1b0 2024-07-26T08:51:30.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.213+0000 7f5a9be11740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5626589a7100 con 0x562658698070 2024-07-26T08:51:30.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658a3ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658a3ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:50462/0 (socket says 172.21.15.43:50462) 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 -- 172.21.15.43:0/3912692522 learned_addr learned my addr 172.21.15.43:0/3912692522 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a3d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8de00640 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a3d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 -- 172.21.15.43:0/3912692522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 msgr2=0x562658a3d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a3d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 -- 172.21.15.43:0/3912692522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 msgr2=0x562658a3d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a3d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8d400640 1 -- 172.21.15.43:0/3912692522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562658703650 con 0x562658698070 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.214+0000 7f5a8de00640 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a3d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:51:30.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a86a00640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5a740b3d40 0x7f5a740b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a8d400640 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658a3ce20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5a780097e0 tx=0x7f5a78009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e97aab19434f95 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:51:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a86a00640 1 -- 172.21.15.43:0/908352958 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f5a880e57c0 con 0x7f5a9010ba40 2024-07-26T08:51:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a7f400640 1 -- 172.21.15.43:0/3912692522 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78004050 con 0x562658698070 2024-07-26T08:51:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a8de00640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5a740b3d40 0x7f5a740b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a7f400640 1 -- 172.21.15.43:0/3912692522 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a7800fc90 con 0x562658698070 2024-07-26T08:51:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.215+0000 7f5a7f400640 1 -- 172.21.15.43:0/3912692522 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a780038e0 con 0x562658698070 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 -- 172.21.15.43:0/3912692522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 msgr2=0x562658a3ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658a3ce20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5a780097e0 tx=0x7f5a78009770 comp rx=0 tx=0).stop 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a8de00640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5a740b3d40 0x7f5a740b6250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a80006010 tx=0x7f5a80009820 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 -- 172.21.15.43:0/3912692522 shutdown_connections 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a3d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a3d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 --2- 172.21.15.43:0/3912692522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658a3ce20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 -- 172.21.15.43:0/3912692522 >> 172.21.15.43:0/3912692522 conn(0x56265868c460 msgr2=0x562658a3ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 -- 172.21.15.43:0/3912692522 shutdown_connections 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.216+0000 7f5a9be11740 1 -- 172.21.15.43:0/3912692522 wait complete. 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.217+0000 7f5a9be11740 1 -- start start 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.217+0000 7f5a9be11740 1 Processor -- start 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56265866f1b0 0x562658a48440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a48980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a48ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562658806700 con 0x562658677390 2024-07-26T08:51:30.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56265893f690 con 0x562658698070 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562658a4b600 con 0x56265866f1b0 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a9be11740 10 client.0 _ll_register_callbacks cb 0x56265894f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56265866f1b0 0x562658a48440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a48980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a48980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47470/0 (socket says 172.21.15.43:47470) 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56265866f1b0 0x562658a48440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:50478/0 (socket says 172.21.15.43:50478) 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a8d400640 1 -- 172.21.15.43:0/959216261 learned_addr learned my addr 172.21.15.43:0/959216261 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:51:30.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.218+0000 7f5a8e800640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a48ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8d400640 1 -- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56265866f1b0 msgr2=0x562658a48440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8d400640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56265866f1b0 0x562658a48440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8d400640 1 -- 172.21.15.43:0/959216261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 msgr2=0x562658a48ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8d400640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a48ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8d400640 1 -- 172.21.15.43:0/959216261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562658956830 con 0x562658677390 2024-07-26T08:51:30.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8e800640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a48ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a8d400640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a48980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a78004650 tx=0x7f5a78009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ef1b93103a8cb8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.219+0000 7f5a73e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a73e00640 1 -- 172.21.15.43:0/959216261 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78005450 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a73e00640 1 -- 172.21.15.43:0/959216261 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f5a780055f0 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a7800fc90 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a73e00640 1 -- 172.21.15.43:0/959216261 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f5a780046c0 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a9be11740 10 client.16266 fetch_fsmap learned FSMap version 336 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x562658a57280 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.220+0000 7f5a73e00640 1 -- 172.21.15.43:0/959216261 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a7800fc90 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a73e00640 1 -- 172.21.15.43:0/959216261 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f5a78026070 con 0x562658677390 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a9be11740 10 client.16266 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a9be11740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:51:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a9be11740 20 client.16266 populate_metadata read hostname 'smithi043' 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a9be11740 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5626586569f0 0x562658a5a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a9be11740 4 client.16266 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626589b5b10 con 0x5626586569f0 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.221+0000 7f5a8de00640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5626586569f0 0x562658a5a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.222+0000 7f5a8de00640 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5626586569f0 0x562658a5a880 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63aa651a80ff77a3 server_cookie=b06a791d7ac3dd2d in_seq=0 out_seq=0 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.222+0000 7f5a73e00640 10 client.16266 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.222+0000 7f5a73e00640 1 -- 172.21.15.43:0/959216261 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626589b5b10 con 0x5626586569f0 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.222+0000 7f5a73e00640 10 client.16266 handle_command_reply: tid=0 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 client.16266 shutdown 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 msgr2=0x562658a48980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a48980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a78004650 tx=0x7f5a78009370 comp rx=0 tx=0).stop 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 shutdown_connections 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5626586569f0 0x562658a5a880 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a48ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a48980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 --2- 172.21.15.43:0/959216261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56265866f1b0 0x562658a48440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 >> 172.21.15.43:0/959216261 conn(0x56265868c460 msgr2=0x562658a3ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a73e00640 0 client.16266 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 shutdown_connections 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 1 -- 172.21.15.43:0/959216261 wait complete. 2024-07-26T08:51:30.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.223+0000 7f5a9be11740 20 client.16266 trim_cache size 0 max 16384 2024-07-26T08:51:30.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 Processor -- start 2024-07-26T08:51:30.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 -- start start 2024-07-26T08:51:30.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56265866f1b0 0x562658a4a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 0x562658a60030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a60570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901b5290 con 0x56265866f1b0 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901b3750 con 0x562658698070 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.243+0000 7f5a9be11740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901b4bc0 con 0x562658677390 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56265866f1b0 0x562658a4a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a60570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 0x562658a60030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56265866f1b0 0x562658a4a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47482/0 (socket says 172.21.15.43:47482) 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a60570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46038/0 (socket says 172.21.15.43:46038) 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 0x562658a60030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:50486/0 (socket says 172.21.15.43:50486) 2024-07-26T08:51:30.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8e800640 1 -- 172.21.15.43:0/937182146 learned_addr learned my addr 172.21.15.43:0/937182146 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 -- 172.21.15.43:0/937182146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 msgr2=0x562658a60570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a60570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 -- 172.21.15.43:0/937182146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56265866f1b0 msgr2=0x562658a4a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56265866f1b0 0x562658a4a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8d400640 1 -- 172.21.15.43:0/937182146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562658a36180 con 0x562658677390 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.244+0000 7f5a8e800640 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a60570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:51:30.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.245+0000 7f5a8d400640 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 0x562658a60030 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5a78028b40 tx=0x7f5a7800ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6533ca14c162977a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:51:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.245+0000 7f5a7ea00640 1 -- 172.21.15.43:0/937182146 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800fb60 con 0x562658677390 2024-07-26T08:51:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.245+0000 7f5a7ea00640 1 -- 172.21.15.43:0/937182146 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a7800fd00 con 0x562658677390 2024-07-26T08:51:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.245+0000 7f5a7ea00640 1 -- 172.21.15.43:0/937182146 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a780054b0 con 0x562658677390 2024-07-26T08:51:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 -- 172.21.15.43:0/937182146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 msgr2=0x562658a60030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 0x562658a60030 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5a78028b40 tx=0x7f5a7800ff80 comp rx=0 tx=0).stop 2024-07-26T08:51:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 -- 172.21.15.43:0/937182146 shutdown_connections 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658677390 0x562658a60030 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562658698070 0x562658a60570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 --2- 172.21.15.43:0/937182146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56265866f1b0 0x562658a4a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 -- 172.21.15.43:0/937182146 >> 172.21.15.43:0/937182146 conn(0x56265868c460 msgr2=0x562658a49960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 -- 172.21.15.43:0/937182146 shutdown_connections 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.246+0000 7f5a9be11740 1 -- 172.21.15.43:0/937182146 wait complete. 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.247+0000 7f5a9be11740 1 -- start start 2024-07-26T08:51:30.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.247+0000 7f5a9be11740 1 Processor -- start 2024-07-26T08:51:30.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.247+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a4d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.247+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a4d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.247+0000 7f5a9be11740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658ac0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.247+0000 7f5a9be11740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901b44f0 con 0x562658677390 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a9be11740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5a901b3e20 con 0x56265866f1b0 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a9be11740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562658a3f110 con 0x562658698070 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a9be11740 10 client.0 _ll_register_callbacks cb 0x7f5a780116a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a4d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a4d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a4d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46052/0 (socket says 172.21.15.43:46052) 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 -- 172.21.15.43:0/1252658936 learned_addr learned my addr 172.21.15.43:0/1252658936 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8e800640 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658ac0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 -- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 msgr2=0x562658ac0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658ac0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 -- 172.21.15.43:0/1252658936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 msgr2=0x562658a4d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a4d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.248+0000 7f5a8de00640 1 -- 172.21.15.43:0/1252658936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562658ac1530 con 0x56265866f1b0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a8de00640 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a4d3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a8002ade0 tx=0x7f5a800095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a639fcc9b937b93 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a73e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a73e00640 1 -- 172.21.15.43:0/1252658936 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80003b70 con 0x56265866f1b0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626589b15b0 con 0x56265866f1b0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a73e00640 1 -- 172.21.15.43:0/1252658936 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f5a80003d10 con 0x56265866f1b0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a73e00640 1 -- 172.21.15.43:0/1252658936 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f5a80065050 con 0x56265866f1b0 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a9be11740 10 client.26549 fetch_fsmap learned FSMap version 336 2024-07-26T08:51:30.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.249+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x562658ac27c0 con 0x56265866f1b0 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a73e00640 1 -- 172.21.15.43:0/1252658936 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5626589b15b0 con 0x56265866f1b0 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a73e00640 1 -- 172.21.15.43:0/1252658936 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f5a800046b0 con 0x56265866f1b0 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a9be11740 10 client.26549 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a9be11740 10 client.26549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a9be11740 20 client.26549 populate_metadata read hostname 'smithi043' 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a9be11740 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56265862bda0 0x562658ac4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a9be11740 4 client.26549 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626589aecf0 con 0x56265862bda0 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.250+0000 7f5a8d400640 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56265862bda0 0x562658ac4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a8d400640 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56265862bda0 0x562658ac4f60 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c140378eb9015168 server_cookie=bfe2b0ad77f2acab in_seq=0 out_seq=0 2024-07-26T08:51:30.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a73e00640 10 client.26549 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a73e00640 1 -- 172.21.15.43:0/1252658936 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x5626589aecf0 con 0x56265862bda0 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a73e00640 10 client.26549 handle_command_reply: tid=0 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 client.26549 shutdown 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 msgr2=0x562658a4d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a4d3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a8002ade0 tx=0x7f5a800095c0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 shutdown_connections 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x56265862bda0 0x562658ac4f60 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562658698070 0x562658ac0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562658677390 0x562658a4d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 --2- 172.21.15.43:0/1252658936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56265866f1b0 0x562658a4d3a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.251+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 >> 172.21.15.43:0/1252658936 conn(0x56265868c460 msgr2=0x562658a3e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.252+0000 7f5a73e00640 0 client.26549 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.252+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 shutdown_connections 2024-07-26T08:51:30.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.252+0000 7f5a9be11740 1 -- 172.21.15.43:0/1252658936 wait complete. 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.252+0000 7f5a9be11740 20 client.26549 trim_cache size 0 max 16384 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:51:30.256 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5a740b3d40 msgr2=0x7f5a740b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5a740b3d40 0x7f5a740b6250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a80006010 tx=0x7f5a80009820 comp rx=0 tx=0).stop 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 msgr2=0x7f5a901a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 0x7f5a901a1a20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e970 tx=0x7f5a8800ed70 comp rx=0 tx=0).stop 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 shutdown_connections 2024-07-26T08:51:30.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f5a740b3d40 0x7f5a740b6250 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9010b0f0 0x7f5a9019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a9010ba40 0x7f5a901a1a20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 --2- 172.21.15.43:0/908352958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a901057b0 0x7f5a9019c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:51:30.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 >> 172.21.15.43:0/908352958 conn(0x7f5a90101240 msgr2=0x7f5a9010a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:51:30.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 shutdown_connections 2024-07-26T08:51:30.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:51:30.253+0000 7f5a95200640 1 -- 172.21.15.43:0/908352958 wait complete. 2024-07-26T08:51:30.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 936.726032 secs 2024-07-26T08:51:30.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 936.726032 secs 2024-07-26T08:51:30.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 936.726032 secs 2024-07-26T08:51:31.239 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:51:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:31 smithi063 ceph-mon[36747]: pgmap v1098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 952.212167 secs 2024-07-26T08:51:31.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:31 smithi043 ceph-mon[32384]: pgmap v1098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:31.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 952.212167 secs 2024-07-26T08:51:32.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:31 smithi133 ceph-mon[37053]: pgmap v1098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 952.212167 secs 2024-07-26T08:51:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:33 smithi063 ceph-mon[36747]: pgmap v1099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:33.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:33 smithi043 ceph-mon[32384]: pgmap v1099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:34.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:33 smithi133 ceph-mon[37053]: pgmap v1099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:35 smithi043 ceph-mon[32384]: pgmap v1100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 941.726186 secs 2024-07-26T08:51:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:35 smithi133 ceph-mon[37053]: pgmap v1100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 941.726186 secs 2024-07-26T08:51:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:35 smithi063 ceph-mon[36747]: pgmap v1100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 941.726186 secs 2024-07-26T08:51:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 957.212294 secs 2024-07-26T08:51:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 957.212294 secs 2024-07-26T08:51:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 957.212294 secs 2024-07-26T08:51:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:37 smithi043 ceph-mon[32384]: pgmap v1101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:38.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:37 smithi133 ceph-mon[37053]: pgmap v1101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:37 smithi063 ceph-mon[36747]: pgmap v1101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:39.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:39 smithi043 ceph-mon[32384]: pgmap v1102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:39 smithi133 ceph-mon[37053]: pgmap v1102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:39 smithi063 ceph-mon[36747]: pgmap v1102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:40.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 946.726282 secs 2024-07-26T08:51:41.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 946.726282 secs 2024-07-26T08:51:41.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 946.726282 secs 2024-07-26T08:51:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:41 smithi043 ceph-mon[32384]: pgmap v1103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 962.212377 secs 2024-07-26T08:51:42.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:41 smithi133 ceph-mon[37053]: pgmap v1103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 962.212377 secs 2024-07-26T08:51:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:41 smithi063 ceph-mon[36747]: pgmap v1103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 962.212377 secs 2024-07-26T08:51:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:43 smithi043 ceph-mon[32384]: pgmap v1104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:44.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:43 smithi133 ceph-mon[37053]: pgmap v1104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:43 smithi063 ceph-mon[36747]: pgmap v1104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:45 smithi043 ceph-mon[32384]: pgmap v1105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 951.726374 secs 2024-07-26T08:51:46.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:45 smithi133 ceph-mon[37053]: pgmap v1105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 951.726374 secs 2024-07-26T08:51:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:45 smithi063 ceph-mon[36747]: pgmap v1105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 951.726374 secs 2024-07-26T08:51:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 967.212512 secs 2024-07-26T08:51:47.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 967.212512 secs 2024-07-26T08:51:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 967.212512 secs 2024-07-26T08:51:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:47 smithi043 ceph-mon[32384]: pgmap v1106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:48.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:47 smithi133 ceph-mon[37053]: pgmap v1106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:47 smithi063 ceph-mon[36747]: pgmap v1106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:49 smithi043 ceph-mon[32384]: pgmap v1107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:50.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:49 smithi133 ceph-mon[37053]: pgmap v1107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:49 smithi063 ceph-mon[36747]: pgmap v1107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 956.726470 secs 2024-07-26T08:51:51.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 956.726470 secs 2024-07-26T08:51:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 956.726470 secs 2024-07-26T08:51:51.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:51 smithi063 ceph-mon[36747]: pgmap v1108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:51.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 972.212597 secs 2024-07-26T08:51:51.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:51 smithi043 ceph-mon[32384]: pgmap v1108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:51.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 972.212597 secs 2024-07-26T08:51:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:51 smithi133 ceph-mon[37053]: pgmap v1108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:51:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 972.212597 secs 2024-07-26T08:51:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:53 smithi043 ceph-mon[32384]: pgmap v1109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:53 smithi133 ceph-mon[37053]: pgmap v1109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:54.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:53 smithi063 ceph-mon[36747]: pgmap v1109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:55 smithi043 ceph-mon[32384]: pgmap v1110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 961.726537 secs 2024-07-26T08:51:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 977.212714 secs 2024-07-26T08:51:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:55 smithi133 ceph-mon[37053]: pgmap v1110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 961.726537 secs 2024-07-26T08:51:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 977.212714 secs 2024-07-26T08:51:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:55 smithi063 ceph-mon[36747]: pgmap v1110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:51:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 961.726537 secs 2024-07-26T08:51:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 977.212714 secs 2024-07-26T08:51:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:57 smithi043 ceph-mon[32384]: pgmap v1111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:57 smithi133 ceph-mon[37053]: pgmap v1111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:57 smithi063 ceph-mon[36747]: pgmap v1111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:51:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:51:59 smithi043 ceph-mon[32384]: pgmap v1112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:51:59 smithi133 ceph-mon[37053]: pgmap v1112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:51:59 smithi063 ceph-mon[36747]: pgmap v1112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 966.726601 secs 2024-07-26T08:52:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 982.212850 secs 2024-07-26T08:52:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 966.726601 secs 2024-07-26T08:52:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 982.212850 secs 2024-07-26T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 966.726601 secs 2024-07-26T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 982.212850 secs 2024-07-26T08:52:01.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:52:01.745 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:52:01.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:01 smithi043 ceph-mon[32384]: pgmap v1113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:02.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:01 smithi133 ceph-mon[37053]: pgmap v1113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:01 smithi063 ceph-mon[36747]: pgmap v1113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:03.855 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:03 smithi043 ceph-mon[32384]: pgmap v1114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:03 smithi133 ceph-mon[37053]: pgmap v1114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:04.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:03 smithi063 ceph-mon[36747]: pgmap v1114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 -- 172.21.15.43:0/3954988633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077370 msgr2=0x7f2a98077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 --2- 172.21.15.43:0/3954988633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077370 0x7f2a98077780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009900 tx=0x7f2a8802a410 comp rx=0 tx=0).stop 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 -- 172.21.15.43:0/3954988633 shutdown_connections 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 --2- 172.21.15.43:0/3954988633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 0x7f2a981165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 --2- 172.21.15.43:0/3954988633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077cc0 0x7f2a98113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 --2- 172.21.15.43:0/3954988633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077370 0x7f2a98077780 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 -- 172.21.15.43:0/3954988633 >> 172.21.15.43:0/3954988633 conn(0x7f2a981011f0 msgr2=0x7f2a98103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 -- 172.21.15.43:0/3954988633 shutdown_connections 2024-07-26T08:52:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.566+0000 7f2a9d200640 1 -- 172.21.15.43:0/3954988633 wait complete. 2024-07-26T08:52:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 Processor -- start 2024-07-26T08:52:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 -- start start 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 0x7f2a981a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077cc0 0x7f2a981a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 0x7f2a981a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98119c60 con 0x7f2a98077cc0 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98119ae0 con 0x7f2a98077370 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.568+0000 7f2a9d200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98119de0 con 0x7f2a981141a0 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 0x7f2a981a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 0x7f2a981a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:40060/0 (socket says 172.21.15.43:40060) 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95e00640 1 -- 172.21.15.43:0/104889673 learned_addr learned my addr 172.21.15.43:0/104889673 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077cc0 0x7f2a981a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a96800640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 0x7f2a981a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95400640 1 -- 172.21.15.43:0/104889673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 msgr2=0x7f2a981a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95400640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 0x7f2a981a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95400640 1 -- 172.21.15.43:0/104889673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 msgr2=0x7f2a981a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95400640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 0x7f2a981a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95400640 1 -- 172.21.15.43:0/104889673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a981a65c0 con 0x7f2a98077cc0 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a95e00640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 0x7f2a981a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.569+0000 7f2a96800640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 0x7f2a981a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:04.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.570+0000 7f2a95400640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077cc0 0x7f2a981a0bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a9806c3a0 tx=0x7f2a8400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:04.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.570+0000 7f2a8ea00640 1 -- 172.21.15.43:0/104889673 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400cc40 con 0x7f2a98077cc0 2024-07-26T08:52:04.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.570+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a981a68b0 con 0x7f2a98077cc0 2024-07-26T08:52:04.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.570+0000 7f2a8ea00640 1 -- 172.21.15.43:0/104889673 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a8400cde0 con 0x7f2a98077cc0 2024-07-26T08:52:04.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.570+0000 7f2a8ea00640 1 -- 172.21.15.43:0/104889673 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84018820 con 0x7f2a98077cc0 2024-07-26T08:52:04.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.570+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981ad010 con 0x7f2a98077cc0 2024-07-26T08:52:04.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.574+0000 7f2aa401e740 1 Processor -- start 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.574+0000 7f2aa401e740 1 -- start start 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 0x55e5629a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625db390 0x55e5629a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2aa401e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e562917bc0 con 0x55e5625d31b0 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2aa401e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e5629070c0 con 0x55e5625db390 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2aa401e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e56290b100 con 0x55e5625fc070 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2a96800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 0x55e5629a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36190/0 (socket says 172.21.15.43:36190) 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2a96800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 0x55e5629a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45748/0 (socket says 172.21.15.43:45748) 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2a95e00640 1 -- 172.21.15.43:0/649135749 learned_addr learned my addr 172.21.15.43:0/649135749 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.575+0000 7f2a8ea00640 1 -- 172.21.15.43:0/104889673 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2a84010b40 con 0x7f2a98077cc0 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a95400640 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625db390 0x55e5629a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a96800640 1 -- 172.21.15.43:0/649135749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625db390 msgr2=0x55e5629a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a96800640 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625db390 0x55e5629a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a96800640 1 -- 172.21.15.43:0/649135749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 msgr2=0x55e5629a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a96800640 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a96800640 1 -- 172.21.15.43:0/649135749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e562667650 con 0x55e5625fc070 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a95400640 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625db390 0x55e5629a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a95e00640 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a96800640 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 0x55e5629a0e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2a90005fd0 tx=0x7f2a90011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72b73806ead91d8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a83400640 1 -- 172.21.15.43:0/649135749 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90004d20 con 0x55e5625fc070 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a83400640 1 -- 172.21.15.43:0/649135749 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a9000f9a0 con 0x55e5625fc070 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.576+0000 7f2a83400640 1 -- 172.21.15.43:0/649135749 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90004480 con 0x55e5625fc070 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.577+0000 7f2a8ea00640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2a7c0b3dc0 0x7f2a7c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.577+0000 7f2a8ea00640 1 -- 172.21.15.43:0/104889673 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f2a840e5670 con 0x7f2a98077cc0 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.577+0000 7f2a95e00640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2a7c0b3dc0 0x7f2a7c0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 -- 172.21.15.43:0/649135749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 msgr2=0x55e5629a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 0x55e5629a0e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2a90005fd0 tx=0x7f2a90011bf0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 -- 172.21.15.43:0/649135749 shutdown_connections 2024-07-26T08:52:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625db390 0x55e5629a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 --2- 172.21.15.43:0/649135749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625fc070 0x55e5629a0e20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 -- 172.21.15.43:0/649135749 >> 172.21.15.43:0/649135749 conn(0x55e5625f0460 msgr2=0x55e56299ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 -- 172.21.15.43:0/649135749 shutdown_connections 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.578+0000 7f2aa401e740 1 -- 172.21.15.43:0/649135749 wait complete. 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.579+0000 7f2a95e00640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2a7c0b3dc0 0x7f2a7c0b62d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2a88005f70 tx=0x7f2a88005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.579+0000 7f2aa401e740 1 -- start start 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.579+0000 7f2aa401e740 1 Processor -- start 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 0x55e5629ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625db390 0x55e5629ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e56276a700 con 0x55e5625db390 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e5628a3690 con 0x55e5625fc070 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e5629af600 con 0x55e5625d31b0 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2aa401e740 10 client.0 _ll_register_callbacks cb 0x55e5628b3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:52:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2a96800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 0x55e5629ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2a95400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625db390 0x55e5629ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 0x55e5629ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:45750/0 (socket says 172.21.15.43:45750) 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2a95e00640 1 -- 172.21.15.43:0/558879570 learned_addr learned my addr 172.21.15.43:0/558879570 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.580+0000 7f2a96800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:40070/0 (socket says 172.21.15.43:40070) 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a95e00640 1 -- 172.21.15.43:0/558879570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 msgr2=0x55e5629ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a95e00640 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a95e00640 1 -- 172.21.15.43:0/558879570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625db390 msgr2=0x55e5629ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a95e00640 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625db390 0x55e5629ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a95e00640 1 -- 172.21.15.43:0/558879570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5628ba830 con 0x55e5625d31b0 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a95e00640 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 0x55e5629ac3d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a880042c0 tx=0x7f2a88009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a0ed6361ff3743 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:04.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a77e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:52:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.581+0000 7f2a77e00640 1 -- 172.21.15.43:0/558879570 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8804e070 con 0x55e5625d31b0 2024-07-26T08:52:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a9000f9a0 con 0x55e5625d31b0 2024-07-26T08:52:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2a77e00640 1 -- 172.21.15.43:0/558879570 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f2a88005440 con 0x55e5625d31b0 2024-07-26T08:52:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2a77e00640 1 -- 172.21.15.43:0/558879570 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f2a8805b050 con 0x55e5625d31b0 2024-07-26T08:52:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 10 client.26533 fetch_fsmap learned FSMap version 336 2024-07-26T08:52:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55e5629bb1a0 con 0x55e5625d31b0 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2a77e00640 1 -- 172.21.15.43:0/558879570 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a9000f9a0 con 0x55e5625d31b0 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2a77e00640 1 -- 172.21.15.43:0/558879570 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f2a88003890 con 0x55e5625d31b0 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 10 client.26533 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 10 client.26533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 20 client.26533 populate_metadata read hostname 'smithi043' 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e5625ba9f0 0x55e5629bea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 4 client.26533 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.582+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e562919b10 con 0x55e5625ba9f0 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.583+0000 7f2a95400640 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e5625ba9f0 0x55e5629bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.583+0000 7f2a95400640 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e5625ba9f0 0x55e5629bea60 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=617ea1647b32c0cd server_cookie=a5bee62d18fa4736 in_seq=0 out_seq=0 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.583+0000 7f2a77e00640 10 client.26533 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.584+0000 7f2a77e00640 1 -- 172.21.15.43:0/558879570 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e562919b10 con 0x55e5625ba9f0 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.584+0000 7f2a77e00640 10 client.26533 handle_command_reply: tid=0 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.584+0000 7f2aa401e740 1 client.26533 shutdown 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 msgr2=0x55e5629ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 0x55e5629ac3d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a880042c0 tx=0x7f2a88009260 comp rx=0 tx=0).stop 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 shutdown_connections 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e5625ba9f0 0x55e5629bea60 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625db390 0x55e5629ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 --2- 172.21.15.43:0/558879570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625d31b0 0x55e5629ac3d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2a77e00640 0 client.26533 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 >> 172.21.15.43:0/558879570 conn(0x55e5625f0460 msgr2=0x55e5629a3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:04.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 shutdown_connections 2024-07-26T08:52:04.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 1 -- 172.21.15.43:0/558879570 wait complete. 2024-07-26T08:52:04.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.585+0000 7f2aa401e740 20 client.26533 trim_cache size 0 max 16384 2024-07-26T08:52:04.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.604+0000 7f2aa401e740 1 Processor -- start 2024-07-26T08:52:04.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.604+0000 7f2aa401e740 1 -- start start 2024-07-26T08:52:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e56299d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2aa401e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b96f0 con 0x55e5625d31b0 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2aa401e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b7bb0 con 0x55e5625fc070 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2aa401e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b9020 con 0x55e5625db390 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36202/0 (socket says 172.21.15.43:36202) 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2a95e00640 1 -- 172.21.15.43:0/2354199843 learned_addr learned my addr 172.21.15.43:0/2354199843 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2a96800640 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.605+0000 7f2a95400640 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e56299d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a95e00640 1 -- 172.21.15.43:0/2354199843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 msgr2=0x55e56299d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a95e00640 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e56299d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a95e00640 1 -- 172.21.15.43:0/2354199843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 msgr2=0x55e5629ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a95e00640 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a95e00640 1 -- 172.21.15.43:0/2354199843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5629a7f40 con 0x55e5625d31b0 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a95e00640 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a2810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009a20 tx=0x7f2a8802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7597a1f295de2cf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a82a00640 1 -- 172.21.15.43:0/2354199843 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8804e040 con 0x55e5625d31b0 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a82a00640 1 -- 172.21.15.43:0/2354199843 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a88041070 con 0x55e5625d31b0 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.606+0000 7f2a82a00640 1 -- 172.21.15.43:0/2354199843 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88043070 con 0x55e5625d31b0 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.607+0000 7f2aa401e740 1 -- 172.21.15.43:0/2354199843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 msgr2=0x55e5629a2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.607+0000 7f2aa401e740 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a2810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009a20 tx=0x7f2a8802a410 comp rx=0 tx=0).stop 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.607+0000 7f2aa401e740 1 -- 172.21.15.43:0/2354199843 shutdown_connections 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.607+0000 7f2aa401e740 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e56299d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.608+0000 7f2aa401e740 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.608+0000 7f2aa401e740 1 --2- 172.21.15.43:0/2354199843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629a2810 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.608+0000 7f2aa401e740 1 -- 172.21.15.43:0/2354199843 >> 172.21.15.43:0/2354199843 conn(0x55e5625f0460 msgr2=0x55e5629ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:04.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.608+0000 7f2aa401e740 1 -- 172.21.15.43:0/2354199843 shutdown_connections 2024-07-26T08:52:04.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.608+0000 7f2aa401e740 1 -- 172.21.15.43:0/2354199843 wait complete. 2024-07-26T08:52:04.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.608+0000 7f2aa401e740 1 -- start start 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 Processor -- start 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e5629b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b8950 con 0x55e5625d31b0 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b8280 con 0x55e5625fc070 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e56276a700 con 0x55e5625db390 2024-07-26T08:52:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.609+0000 7f2aa401e740 10 client.0 _ll_register_callbacks cb 0x7f2a880318a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e5629b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36204/0 (socket says 172.21.15.43:36204) 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 -- 172.21.15.43:0/1175600853 learned_addr learned my addr 172.21.15.43:0/1175600853 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a96800640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 -- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 msgr2=0x55e5629b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e5629b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 -- 172.21.15.43:0/1175600853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 msgr2=0x55e5629b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 -- 172.21.15.43:0/1175600853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5629b3240 con 0x55e5625d31b0 2024-07-26T08:52:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95400640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e5629b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a95e00640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629b5000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2a88003ce0 tx=0x7f2a88003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fcfaec2588fc0d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.610+0000 7f2a77e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.611+0000 7f2a77e00640 1 -- 172.21.15.43:0/1175600853 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8804e070 con 0x55e5625d31b0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.611+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a88041070 con 0x55e5625d31b0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.611+0000 7f2a77e00640 1 -- 172.21.15.43:0/1175600853 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f2a88004b00 con 0x55e5625d31b0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.611+0000 7f2a77e00640 1 -- 172.21.15.43:0/1175600853 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f2a88070050 con 0x55e5625d31b0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.611+0000 7f2aa401e740 10 client.16290 fetch_fsmap learned FSMap version 336 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.611+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55e562a27230 con 0x55e5625d31b0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2a77e00640 1 -- 172.21.15.43:0/1175600853 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a88041070 con 0x55e5625d31b0 2024-07-26T08:52:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2a77e00640 1 -- 172.21.15.43:0/1175600853 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f2a8805e070 con 0x55e5625d31b0 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2aa401e740 10 client.16290 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2aa401e740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2aa401e740 20 client.16290 populate_metadata read hostname 'smithi043' 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2aa401e740 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e56258fda0 0x55e562a29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2aa401e740 4 client.16290 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5629155b0 con 0x55e56258fda0 2024-07-26T08:52:04.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.612+0000 7f2a95400640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e56258fda0 0x55e562a29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:04.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2a95400640 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e56258fda0 0x55e562a29880 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce42ace93dc49a69 server_cookie=abbe0ee7e693c46b in_seq=0 out_seq=0 2024-07-26T08:52:04.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2a77e00640 10 client.16290 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:04.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2a77e00640 1 -- 172.21.15.43:0/1175600853 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55e5629155b0 con 0x55e56258fda0 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2a77e00640 10 client.16290 handle_command_reply: tid=0 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 client.16290 shutdown 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 msgr2=0x55e5629b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629b5000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2a88003ce0 tx=0x7f2a88003820 comp rx=0 tx=0).stop 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 shutdown_connections 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55e56258fda0 0x55e562a29880 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5625db390 0x55e5629b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e5625fc070 0x55e5629b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2a77e00640 0 client.16290 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.613+0000 7f2aa401e740 1 --2- 172.21.15.43:0/1175600853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5625d31b0 0x55e5629b5000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.614+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 >> 172.21.15.43:0/1175600853 conn(0x55e5625f0460 msgr2=0x55e5629a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.614+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 shutdown_connections 2024-07-26T08:52:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.614+0000 7f2aa401e740 1 -- 172.21.15.43:0/1175600853 wait complete. 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.614+0000 7f2aa401e740 20 client.16290 trim_cache size 0 max 16384 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:52:04.620 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2a7c0b3dc0 msgr2=0x7f2a7c0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2a7c0b3dc0 0x7f2a7c0b62d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2a88005f70 tx=0x7f2a88005a20 comp rx=0 tx=0).stop 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077cc0 msgr2=0x7f2a981a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077cc0 0x7f2a981a0bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a9806c3a0 tx=0x7f2a8400ee50 comp rx=0 tx=0).stop 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 shutdown_connections 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f2a7c0b3dc0 0x7f2a7c0b62d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a981141a0 0x7f2a981a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a98077cc0 0x7f2a981a0bf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 --2- 172.21.15.43:0/104889673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a98077370 0x7f2a981a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 >> 172.21.15.43:0/104889673 conn(0x7f2a981011f0 msgr2=0x7f2a98103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 shutdown_connections 2024-07-26T08:52:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:04.615+0000 7f2a9d200640 1 -- 172.21.15.43:0/104889673 wait complete. 2024-07-26T08:52:05.584 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:52:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:05 smithi043 ceph-mon[32384]: pgmap v1115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 971.726723 secs 2024-07-26T08:52:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 987.212951 secs 2024-07-26T08:52:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:05 smithi133 ceph-mon[37053]: pgmap v1115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 971.726723 secs 2024-07-26T08:52:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 987.212951 secs 2024-07-26T08:52:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:05 smithi063 ceph-mon[36747]: pgmap v1115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 971.726723 secs 2024-07-26T08:52:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 987.212951 secs 2024-07-26T08:52:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:07 smithi043 ceph-mon[32384]: pgmap v1116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:08.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:07 smithi133 ceph-mon[37053]: pgmap v1116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:07 smithi063 ceph-mon[36747]: pgmap v1116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:09 smithi043 ceph-mon[32384]: pgmap v1117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:09 smithi133 ceph-mon[37053]: pgmap v1117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:09 smithi063 ceph-mon[36747]: pgmap v1117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 976.726846 secs 2024-07-26T08:52:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 992.213075 secs 2024-07-26T08:52:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 976.726846 secs 2024-07-26T08:52:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 992.213075 secs 2024-07-26T08:52:11.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 976.726846 secs 2024-07-26T08:52:11.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 992.213075 secs 2024-07-26T08:52:11.880 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:11 smithi043 ceph-mon[32384]: pgmap v1118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:11 smithi133 ceph-mon[37053]: pgmap v1118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:11 smithi063 ceph-mon[36747]: pgmap v1118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:12.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:52:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:52:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:52:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:13 smithi133 ceph-mon[37053]: pgmap v1119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:52:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:52:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:52:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:13 smithi063 ceph-mon[36747]: pgmap v1119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:52:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:52:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:52:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:13 smithi043 ceph-mon[32384]: pgmap v1119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:52:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:52:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:52:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:14 smithi133 ceph-mon[37053]: pgmap v1120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:14 smithi133 ceph-mon[37053]: pgmap v1121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:15.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:14 smithi063 ceph-mon[36747]: pgmap v1120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:14 smithi063 ceph-mon[36747]: pgmap v1121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:14 smithi043 ceph-mon[32384]: pgmap v1120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:14 smithi043 ceph-mon[32384]: pgmap v1121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 981.726965 secs 2024-07-26T08:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 997.213157 secs 2024-07-26T08:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:15 smithi133 ceph-mon[37053]: pgmap v1122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 981.726965 secs 2024-07-26T08:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 997.213157 secs 2024-07-26T08:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:15 smithi063 ceph-mon[36747]: pgmap v1122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 981.726965 secs 2024-07-26T08:52:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 997.213157 secs 2024-07-26T08:52:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:15 smithi043 ceph-mon[32384]: pgmap v1122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:18 smithi043 ceph-mon[32384]: pgmap v1123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:52:19.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:18 smithi133 ceph-mon[37053]: pgmap v1123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:52:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:18 smithi063 ceph-mon[36747]: pgmap v1123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:52:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:20 smithi043 ceph-mon[32384]: pgmap v1124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 986.727129 secs 2024-07-26T08:52:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1002.213239 secs 2024-07-26T08:52:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:20 smithi133 ceph-mon[37053]: pgmap v1124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 986.727129 secs 2024-07-26T08:52:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1002.213239 secs 2024-07-26T08:52:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:20 smithi063 ceph-mon[36747]: pgmap v1124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 986.727129 secs 2024-07-26T08:52:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1002.213239 secs 2024-07-26T08:52:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:22 smithi043 ceph-mon[32384]: pgmap v1125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:22 smithi133 ceph-mon[37053]: pgmap v1125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:22 smithi063 ceph-mon[36747]: pgmap v1125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:52:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:24 smithi043 ceph-mon[32384]: pgmap v1126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:52:25.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:24 smithi133 ceph-mon[37053]: pgmap v1126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:52:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:24 smithi063 ceph-mon[36747]: pgmap v1126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:52:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 991.727242 secs 2024-07-26T08:52:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1007.213320 secs 2024-07-26T08:52:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 991.727242 secs 2024-07-26T08:52:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1007.213320 secs 2024-07-26T08:52:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 991.727242 secs 2024-07-26T08:52:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1007.213320 secs 2024-07-26T08:52:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:26 smithi043 ceph-mon[32384]: pgmap v1127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:26 smithi133 ceph-mon[37053]: pgmap v1127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:26 smithi063 ceph-mon[36747]: pgmap v1127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:28 smithi043 ceph-mon[32384]: pgmap v1128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:28 smithi133 ceph-mon[37053]: pgmap v1128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:28 smithi063 ceph-mon[36747]: pgmap v1128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:30 smithi043 ceph-mon[32384]: pgmap v1129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 996.727369 secs 2024-07-26T08:52:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1012.213417 secs 2024-07-26T08:52:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:30 smithi133 ceph-mon[37053]: pgmap v1129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 996.727369 secs 2024-07-26T08:52:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1012.213417 secs 2024-07-26T08:52:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:30 smithi063 ceph-mon[36747]: pgmap v1129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 996.727369 secs 2024-07-26T08:52:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1012.213417 secs 2024-07-26T08:52:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:32 smithi043 ceph-mon[32384]: pgmap v1130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:33.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:32 smithi133 ceph-mon[37053]: pgmap v1130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:32 smithi063 ceph-mon[36747]: pgmap v1130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:34 smithi043 ceph-mon[32384]: pgmap v1131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:35.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:34 smithi133 ceph-mon[37053]: pgmap v1131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:35.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:34 smithi063 ceph-mon[36747]: pgmap v1131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:35.585 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:52:35.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1001.727444 secs 2024-07-26T08:52:35.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1017.213499 secs 2024-07-26T08:52:36.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1001.727444 secs 2024-07-26T08:52:36.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1017.213499 secs 2024-07-26T08:52:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1001.727444 secs 2024-07-26T08:52:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1017.213499 secs 2024-07-26T08:52:36.079 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:52:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:36 smithi043 ceph-mon[32384]: pgmap v1132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:36 smithi133 ceph-mon[37053]: pgmap v1132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:36 smithi063 ceph-mon[36747]: pgmap v1132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.385+0000 7f0474000640 1 -- 172.21.15.43:0/4293368698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c10ba70 msgr2=0x7f046c1122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.385+0000 7f0474000640 1 --2- 172.21.15.43:0/4293368698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c10ba70 0x7f046c1122a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0464009ca0 tx=0x7f046402a8c0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 -- 172.21.15.43:0/4293368698 shutdown_connections 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 --2- 172.21.15.43:0/4293368698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c10ba70 0x7f046c1122a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 --2- 172.21.15.43:0/4293368698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 --2- 172.21.15.43:0/4293368698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046c1057e0 0x7f046c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 -- 172.21.15.43:0/4293368698 >> 172.21.15.43:0/4293368698 conn(0x7f046c1011f0 msgr2=0x7f046c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 -- 172.21.15.43:0/4293368698 shutdown_connections 2024-07-26T08:52:38.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.386+0000 7f0474000640 1 -- 172.21.15.43:0/4293368698 wait complete. 2024-07-26T08:52:38.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.387+0000 7f0474000640 1 Processor -- start 2024-07-26T08:52:38.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.387+0000 7f0474000640 1 -- start start 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0474000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c1057e0 0x7f046c19c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0474000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0474000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046c10ba70 0x7f046c1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0474000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f046c115850 con 0x7f046c1057e0 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0474000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1156d0 con 0x7f046c10b120 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0474000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1159d0 con 0x7f046c10ba70 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0470c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0471600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c1057e0 0x7f046c19c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0470c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c19c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:45432/0 (socket says 172.21.15.43:45432) 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0470c00640 1 -- 172.21.15.43:0/2812167920 learned_addr learned my addr 172.21.15.43:0/2812167920 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:38.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.388+0000 7f0472000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046c10ba70 0x7f046c1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0470c00640 1 -- 172.21.15.43:0/2812167920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046c10ba70 msgr2=0x7f046c1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0470c00640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046c10ba70 0x7f046c1a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0470c00640 1 -- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c1057e0 msgr2=0x7f046c19c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0470c00640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c1057e0 0x7f046c19c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0470c00640 1 -- 172.21.15.43:0/2812167920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c1a2110 con 0x7f046c10b120 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0471600640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c1057e0 0x7f046c19c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:38.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f0470c00640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c19c740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f045800e9f0 tx=0x7f045800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:38.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.389+0000 7f046a000640 1 -- 172.21.15.43:0/2812167920 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045800ccc0 con 0x7f046c10b120 2024-07-26T08:52:38.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.390+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c1a2400 con 0x7f046c10b120 2024-07-26T08:52:38.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.390+0000 7f046a000640 1 -- 172.21.15.43:0/2812167920 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0458010900 con 0x7f046c10b120 2024-07-26T08:52:38.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.390+0000 7f046a000640 1 -- 172.21.15.43:0/2812167920 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458018900 con 0x7f046c10b120 2024-07-26T08:52:38.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.390+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c1a8b60 con 0x7f046c10b120 2024-07-26T08:52:38.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.394+0000 7f047abe1740 1 Processor -- start 2024-07-26T08:52:38.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.394+0000 7f047abe1740 1 -- start start 2024-07-26T08:52:38.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f047abe1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27d7070 0x55bfe2b7bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f047abe1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b7c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f047abe1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27b6390 0x55bfe2b7c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f047abe1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2af2b90 con 0x55bfe27b6390 2024-07-26T08:52:38.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f047abe1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2ae2090 con 0x55bfe27d7070 2024-07-26T08:52:38.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f047abe1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2ae60d0 con 0x55bfe27ae1b0 2024-07-26T08:52:38.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f046a000640 1 -- 172.21.15.43:0/2812167920 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0458010ab0 con 0x7f046c10b120 2024-07-26T08:52:38.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f0471600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b7c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.395+0000 7f0471600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b7c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:48546/0 (socket says 172.21.15.43:48546) 2024-07-26T08:52:38.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0471600640 1 -- 172.21.15.43:0/347780649 learned_addr learned my addr 172.21.15.43:0/347780649 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0472000640 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27d7070 0x55bfe2b7bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0471600640 1 -- 172.21.15.43:0/347780649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27d7070 msgr2=0x55bfe2b7bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0471600640 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27d7070 0x55bfe2b7bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0471600640 1 -- 172.21.15.43:0/347780649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27b6390 msgr2=0x55bfe2b7c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0470c00640 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27b6390 0x55bfe2b7c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0471600640 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27b6390 0x55bfe2b7c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0471600640 1 -- 172.21.15.43:0/347780649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe2842650 con 0x55bfe27ae1b0 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.396+0000 7f0470c00640 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27b6390 0x55bfe2b7c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.397+0000 7f0471600640 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b7c330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04600115f0 tx=0x7f0460011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab048c64c32abf29 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.397+0000 7f045e600640 1 -- 172.21.15.43:0/347780649 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046001e070 con 0x55bfe27ae1b0 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.397+0000 7f045e600640 1 -- 172.21.15.43:0/347780649 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f046000fb10 con 0x55bfe27ae1b0 2024-07-26T08:52:38.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.397+0000 7f045e600640 1 -- 172.21.15.43:0/347780649 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460019bc0 con 0x55bfe27ae1b0 2024-07-26T08:52:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.398+0000 7f046a000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f04540b3dc0 0x7f04540b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.398+0000 7f046a000640 1 -- 172.21.15.43:0/2812167920 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f04580e5610 con 0x7f046c10b120 2024-07-26T08:52:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.398+0000 7f047abe1740 1 -- 172.21.15.43:0/347780649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 msgr2=0x55bfe2b7c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.398+0000 7f047abe1740 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b7c330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04600115f0 tx=0x7f0460011ab0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.398+0000 7f0472000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f04540b3dc0 0x7f04540b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 -- 172.21.15.43:0/347780649 shutdown_connections 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b7c330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27b6390 0x55bfe2b7c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 --2- 172.21.15.43:0/347780649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27d7070 0x55bfe2b7bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 -- 172.21.15.43:0/347780649 >> 172.21.15.43:0/347780649 conn(0x55bfe27cb460 msgr2=0x55bfe2b79ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 -- 172.21.15.43:0/347780649 shutdown_connections 2024-07-26T08:52:38.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.399+0000 7f047abe1740 1 -- 172.21.15.43:0/347780649 wait complete. 2024-07-26T08:52:38.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.400+0000 7f0472000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f04540b3dc0 0x7f04540b62d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f046402f500 tx=0x7f046402f310 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:38.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.400+0000 7f047abe1740 1 -- start start 2024-07-26T08:52:38.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 Processor -- start 2024-07-26T08:52:38.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b90470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b90a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27d7070 0x55bfe2b95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2945700 con 0x55bfe27d7070 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2a7e660 con 0x55bfe27b6390 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.401+0000 7f047abe1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2b8a5d0 con 0x55bfe27ae1b0 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f047abe1740 10 client.0 _ll_register_callbacks cb 0x55bfe2a8e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b90470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:48552/0 (socket says 172.21.15.43:48552) 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 -- 172.21.15.43:0/3404271482 learned_addr learned my addr 172.21.15.43:0/3404271482 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0470c00640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b90a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0472000640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27d7070 0x55bfe2b95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 -- 172.21.15.43:0/3404271482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 msgr2=0x55bfe2b90a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b90a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 -- 172.21.15.43:0/3404271482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27d7070 msgr2=0x55bfe2b95a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27d7070 0x55bfe2b95a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0471600640 1 -- 172.21.15.43:0/3404271482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe2a95800 con 0x55bfe27ae1b0 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0472000640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27d7070 0x55bfe2b95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.402+0000 7f0470c00640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b90a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f0471600640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b90470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f04600198a0 tx=0x7f0460005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5903d5ddb18dce14 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:38.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f0452a00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:52:38.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f0452a00640 1 -- 172.21.15.43:0/3404271482 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460027060 con 0x55bfe27ae1b0 2024-07-26T08:52:38.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f046000fb10 con 0x55bfe27ae1b0 2024-07-26T08:52:38.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f0452a00640 1 -- 172.21.15.43:0/3404271482 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f046000f700 con 0x55bfe27ae1b0 2024-07-26T08:52:38.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f0452a00640 1 -- 172.21.15.43:0/3404271482 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f046002f050 con 0x55bfe27ae1b0 2024-07-26T08:52:38.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f047abe1740 10 client.26551 fetch_fsmap learned FSMap version 336 2024-07-26T08:52:38.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.403+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55bfe2b9e930 con 0x55bfe27ae1b0 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f0452a00640 1 -- 172.21.15.43:0/3404271482 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f046000fb10 con 0x55bfe27ae1b0 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f0452a00640 1 -- 172.21.15.43:0/3404271482 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f0460021030 con 0x55bfe27ae1b0 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f047abe1740 10 client.26551 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f047abe1740 10 client.26551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f047abe1740 20 client.26551 populate_metadata read hostname 'smithi043' 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f047abe1740 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe27959f0 0x55bfe2ba2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f047abe1740 4 client.26551 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.404+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfe2af4ae0 con 0x55bfe27959f0 2024-07-26T08:52:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.405+0000 7f0470c00640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe27959f0 0x55bfe2ba2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.405+0000 7f0452a00640 10 client.26551 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:38.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.405+0000 7f0470c00640 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe27959f0 0x55bfe2ba2130 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87d5f0923df49714 server_cookie=729a32de889c4d9d in_seq=0 out_seq=0 2024-07-26T08:52:38.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.406+0000 7f0452a00640 1 -- 172.21.15.43:0/3404271482 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfe2af4ae0 con 0x55bfe27959f0 2024-07-26T08:52:38.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.406+0000 7f0452a00640 10 client.26551 handle_command_reply: tid=0 2024-07-26T08:52:38.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.406+0000 7f047abe1740 1 client.26551 shutdown 2024-07-26T08:52:38.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.406+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 msgr2=0x55bfe2b90470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b90470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f04600198a0 tx=0x7f0460005da0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 shutdown_connections 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe27959f0 0x55bfe2ba2130 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27d7070 0x55bfe2b95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b90a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 --2- 172.21.15.43:0/3404271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b90470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f0452a00640 0 client.26551 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 >> 172.21.15.43:0/3404271482 conn(0x55bfe27cb460 msgr2=0x55bfe2b7ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 shutdown_connections 2024-07-26T08:52:38.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 1 -- 172.21.15.43:0/3404271482 wait complete. 2024-07-26T08:52:38.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.407+0000 7f047abe1740 20 client.26551 trim_cache size 0 max 16384 2024-07-26T08:52:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.426+0000 7f047abe1740 1 Processor -- start 2024-07-26T08:52:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.426+0000 7f047abe1740 1 -- start start 2024-07-26T08:52:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f047abe1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b8b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f047abe1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f047abe1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2b798f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f047abe1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1b0f30 con 0x55bfe27ae1b0 2024-07-26T08:52:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f047abe1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1af3f0 con 0x55bfe27b6390 2024-07-26T08:52:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f047abe1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1b0860 con 0x55bfe27d7070 2024-07-26T08:52:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f0470c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f0472000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2b798f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f0470c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b793b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:45470/0 (socket says 172.21.15.43:45470) 2024-07-26T08:52:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f0470c00640 1 -- 172.21.15.43:0/2441260481 learned_addr learned my addr 172.21.15.43:0/2441260481 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.427+0000 7f0471600640 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b8b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0470c00640 1 -- 172.21.15.43:0/2441260481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 msgr2=0x55bfe2b798f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0470c00640 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2b798f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0470c00640 1 -- 172.21.15.43:0/2441260481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 msgr2=0x55bfe2b8b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0470c00640 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b8b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0470c00640 1 -- 172.21.15.43:0/2441260481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe2b7ff00 con 0x55bfe27b6390 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0472000640 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2b798f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0471600640 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b8b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.428+0000 7f0470c00640 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b793b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f04580aac00 tx=0x7f04580e7a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ac42d433fe67d6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.429+0000 7f045dc00640 1 -- 172.21.15.43:0/2441260481 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580b3f00 con 0x55bfe27b6390 2024-07-26T08:52:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.429+0000 7f045dc00640 1 -- 172.21.15.43:0/2441260481 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04580e4020 con 0x55bfe27b6390 2024-07-26T08:52:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.429+0000 7f045dc00640 1 -- 172.21.15.43:0/2441260481 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580aa160 con 0x55bfe27b6390 2024-07-26T08:52:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 -- 172.21.15.43:0/2441260481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 msgr2=0x55bfe2b793b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b793b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f04580aac00 tx=0x7f04580e7a60 comp rx=0 tx=0).stop 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 -- 172.21.15.43:0/2441260481 shutdown_connections 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2b798f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b793b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 --2- 172.21.15.43:0/2441260481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b8b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 -- 172.21.15.43:0/2441260481 >> 172.21.15.43:0/2441260481 conn(0x55bfe27cb460 msgr2=0x55bfe2b7d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 -- 172.21.15.43:0/2441260481 shutdown_connections 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.430+0000 7f047abe1740 1 -- 172.21.15.43:0/2441260481 wait complete. 2024-07-26T08:52:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 -- start start 2024-07-26T08:52:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 Processor -- start 2024-07-26T08:52:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b97420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b97960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2c088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1b0190 con 0x55bfe27ae1b0 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1afac0 con 0x55bfe27b6390 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.431+0000 7f047abe1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bfe2b7a1f0 con 0x55bfe27d7070 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f047abe1740 10 client.0 _ll_register_callbacks cb 0x7f0460011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0471600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b97420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0470c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b97960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0471600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b97420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60606/0 (socket says 172.21.15.43:60606) 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0472000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2c088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0471600640 1 -- 172.21.15.43:0/40307274 learned_addr learned my addr 172.21.15.43:0/40307274 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:52:38.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0470c00640 1 -- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 msgr2=0x55bfe2c088f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0470c00640 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2c088f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0470c00640 1 -- 172.21.15.43:0/40307274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 msgr2=0x55bfe2b97420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0470c00640 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b97420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0470c00640 1 -- 172.21.15.43:0/40307274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe2c08e30 con 0x55bfe27b6390 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.432+0000 7f0471600640 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b97420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f0470c00640 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b97960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55bfe2b7cdd0 tx=0x7f04580e1980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49727dd8517f3a5f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f0452a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f0452a00640 1 -- 172.21.15.43:0/40307274 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580b3f00 con 0x55bfe27b6390 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f0452a00640 1 -- 172.21.15.43:0/40307274 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f04580e5070 con 0x55bfe27b6390 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04580e4020 con 0x55bfe27b6390 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f0452a00640 1 -- 172.21.15.43:0/40307274 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7f04580c8e60 con 0x55bfe27b6390 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f047abe1740 10 client.26582 fetch_fsmap learned FSMap version 336 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.433+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x55bfe2c0a000 con 0x55bfe27b6390 2024-07-26T08:52:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f0452a00640 1 -- 172.21.15.43:0/40307274 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04580e4020 con 0x55bfe27b6390 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f0452a00640 1 -- 172.21.15.43:0/40307274 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7f04580a6a70 con 0x55bfe27b6390 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f047abe1740 10 client.26582 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f047abe1740 10 client.26582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f047abe1740 20 client.26582 populate_metadata read hostname 'smithi043' 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f047abe1740 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe276ada0 0x55bfe2c0c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f047abe1740 4 client.26582 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:52:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bfe2af0580 con 0x55bfe276ada0 2024-07-26T08:52:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.434+0000 7f0471600640 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe276ada0 0x55bfe2c0c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:52:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.435+0000 7f0471600640 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe276ada0 0x55bfe2c0c740 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ccb7896f1bc5b server_cookie=eacc1b97512201a0 in_seq=0 out_seq=0 2024-07-26T08:52:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.435+0000 7f0452a00640 10 client.26582 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.435+0000 7f0452a00640 1 -- 172.21.15.43:0/40307274 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55bfe2af0580 con 0x55bfe276ada0 2024-07-26T08:52:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.435+0000 7f0452a00640 10 client.26582 handle_command_reply: tid=0 2024-07-26T08:52:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.435+0000 7f047abe1740 1 client.26582 shutdown 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 msgr2=0x55bfe2b97960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b97960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55bfe2b7cdd0 tx=0x7f04580e1980 comp rx=0 tx=0).stop 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 shutdown_connections 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x55bfe276ada0 0x55bfe2c0c740 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bfe27d7070 0x55bfe2c088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfe27b6390 0x55bfe2b97960 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 --2- 172.21.15.43:0/40307274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bfe27ae1b0 0x55bfe2b97420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 >> 172.21.15.43:0/40307274 conn(0x55bfe27cb460 msgr2=0x55bfe2b7d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f0452a00640 0 client.26582 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 shutdown_connections 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 1 -- 172.21.15.43:0/40307274 wait complete. 2024-07-26T08:52:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.436+0000 7f047abe1740 20 client.26582 trim_cache size 0 max 16384 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:52:38.441 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f04540b3dc0 msgr2=0x7f04540b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f04540b3dc0 0x7f04540b62d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f046402f500 tx=0x7f046402f310 comp rx=0 tx=0).stop 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 msgr2=0x7f046c19c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c19c740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f045800e9f0 tx=0x7f045800eeb0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 shutdown_connections 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f04540b3dc0 0x7f04540b62d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046c10ba70 0x7f046c1a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f046c10b120 0x7f046c19c740 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 --2- 172.21.15.43:0/2812167920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046c1057e0 0x7f046c19c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:52:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.437+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 >> 172.21.15.43:0/2812167920 conn(0x7f046c1011f0 msgr2=0x7f046c108610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:52:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.438+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 shutdown_connections 2024-07-26T08:52:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:52:38.438+0000 7f0474000640 1 -- 172.21.15.43:0/2812167920 wait complete. 2024-07-26T08:52:39.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:38 smithi133 ceph-mon[37053]: pgmap v1133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:38 smithi063 ceph-mon[36747]: pgmap v1133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:39.153 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:38 smithi043 ceph-mon[32384]: pgmap v1133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:39.220 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:52:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:39 smithi133 ceph-mon[37053]: pgmap v1134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:39 smithi063 ceph-mon[36747]: pgmap v1134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:40.084 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:39 smithi043 ceph-mon[32384]: pgmap v1134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1006.727565 secs 2024-07-26T08:52:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1022.213616 secs 2024-07-26T08:52:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1006.727565 secs 2024-07-26T08:52:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1022.213616 secs 2024-07-26T08:52:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1006.727565 secs 2024-07-26T08:52:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1022.213616 secs 2024-07-26T08:52:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:41 smithi133 ceph-mon[37053]: pgmap v1135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:41 smithi063 ceph-mon[36747]: pgmap v1135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:41 smithi043 ceph-mon[32384]: pgmap v1135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:44 smithi043 ceph-mon[32384]: pgmap v1136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:44 smithi133 ceph-mon[37053]: pgmap v1136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:44 smithi063 ceph-mon[36747]: pgmap v1136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1011.727690 secs 2024-07-26T08:52:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1027.213740 secs 2024-07-26T08:52:46.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1011.727690 secs 2024-07-26T08:52:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1027.213740 secs 2024-07-26T08:52:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1011.727690 secs 2024-07-26T08:52:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1027.213740 secs 2024-07-26T08:52:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:46 smithi043 ceph-mon[32384]: pgmap v1137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:47.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:46 smithi133 ceph-mon[37053]: pgmap v1137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:46 smithi063 ceph-mon[36747]: pgmap v1137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:48 smithi043 ceph-mon[32384]: pgmap v1138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:48 smithi133 ceph-mon[37053]: pgmap v1138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:48 smithi063 ceph-mon[36747]: pgmap v1138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:50 smithi043 ceph-mon[32384]: pgmap v1139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1016.727812 secs 2024-07-26T08:52:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1032.213857 secs 2024-07-26T08:52:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:50 smithi133 ceph-mon[37053]: pgmap v1139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1016.727812 secs 2024-07-26T08:52:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1032.213857 secs 2024-07-26T08:52:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:50 smithi063 ceph-mon[36747]: pgmap v1139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1016.727812 secs 2024-07-26T08:52:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1032.213857 secs 2024-07-26T08:52:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:52 smithi043 ceph-mon[32384]: pgmap v1140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:52 smithi133 ceph-mon[37053]: pgmap v1140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:52 smithi063 ceph-mon[36747]: pgmap v1140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:54 smithi043 ceph-mon[32384]: pgmap v1141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:55.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:54 smithi133 ceph-mon[37053]: pgmap v1141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:54 smithi063 ceph-mon[36747]: pgmap v1141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:52:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1021.727969 secs 2024-07-26T08:52:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1037.213967 secs 2024-07-26T08:52:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1021.727969 secs 2024-07-26T08:52:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1037.213967 secs 2024-07-26T08:52:56.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1021.727969 secs 2024-07-26T08:52:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1037.213967 secs 2024-07-26T08:52:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:56 smithi043 ceph-mon[32384]: pgmap v1142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:56 smithi133 ceph-mon[37053]: pgmap v1142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:56 smithi063 ceph-mon[36747]: pgmap v1142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:52:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:52:58 smithi043 ceph-mon[32384]: pgmap v1143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:59.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:52:58 smithi133 ceph-mon[37053]: pgmap v1143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:52:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:52:58 smithi063 ceph-mon[36747]: pgmap v1143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:00 smithi043 ceph-mon[32384]: pgmap v1144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1026.728073 secs 2024-07-26T08:53:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1042.214089 secs 2024-07-26T08:53:01.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:00 smithi133 ceph-mon[37053]: pgmap v1144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1026.728073 secs 2024-07-26T08:53:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1042.214089 secs 2024-07-26T08:53:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:00 smithi063 ceph-mon[36747]: pgmap v1144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1026.728073 secs 2024-07-26T08:53:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1042.214089 secs 2024-07-26T08:53:03.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:02 smithi133 ceph-mon[37053]: pgmap v1145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:02 smithi063 ceph-mon[36747]: pgmap v1145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:02 smithi043 ceph-mon[32384]: pgmap v1145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:04 smithi133 ceph-mon[37053]: pgmap v1146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:04 smithi063 ceph-mon[36747]: pgmap v1146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:05.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:04 smithi043 ceph-mon[32384]: pgmap v1146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1031.728193 secs 2024-07-26T08:53:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1047.214176 secs 2024-07-26T08:53:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:05 smithi133 ceph-mon[37053]: pgmap v1147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1031.728193 secs 2024-07-26T08:53:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1047.214176 secs 2024-07-26T08:53:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:05 smithi063 ceph-mon[36747]: pgmap v1147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1031.728193 secs 2024-07-26T08:53:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1047.214176 secs 2024-07-26T08:53:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:05 smithi043 ceph-mon[32384]: pgmap v1147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:08 smithi043 ceph-mon[32384]: pgmap v1148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:09.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:08 smithi133 ceph-mon[37053]: pgmap v1148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:08 smithi063 ceph-mon[36747]: pgmap v1148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:09.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-26T08:53:09.737 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T08:53:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:10 smithi043 ceph-mon[32384]: pgmap v1149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1036.728330 secs 2024-07-26T08:53:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1052.214305 secs 2024-07-26T08:53:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:10 smithi133 ceph-mon[37053]: pgmap v1149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1036.728330 secs 2024-07-26T08:53:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1052.214305 secs 2024-07-26T08:53:11.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:10 smithi063 ceph-mon[36747]: pgmap v1149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:11.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1036.728330 secs 2024-07-26T08:53:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1052.214305 secs 2024-07-26T08:53:12.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.173+0000 7fe3cf200640 1 -- 172.21.15.43:0/971863227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d010f330 msgr2=0x7fe3d010f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.173+0000 7fe3cf200640 1 --2- 172.21.15.43:0/971863227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d010f330 0x7fe3d010f740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009860 tx=0x7fe3b802a340 comp rx=0 tx=0).stop 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 -- 172.21.15.43:0/971863227 shutdown_connections 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 --2- 172.21.15.43:0/971863227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010fc80 0x7fe3d01164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 --2- 172.21.15.43:0/971863227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d010f330 0x7fe3d010f740 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 --2- 172.21.15.43:0/971863227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d01099f0 0x7fe3d0109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 -- 172.21.15.43:0/971863227 >> 172.21.15.43:0/971863227 conn(0x7fe3d0078ff0 msgr2=0x7fe3d0107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 -- 172.21.15.43:0/971863227 shutdown_connections 2024-07-26T08:53:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.174+0000 7fe3cf200640 1 -- 172.21.15.43:0/971863227 wait complete. 2024-07-26T08:53:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.175+0000 7fe3cf200640 1 Processor -- start 2024-07-26T08:53:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.175+0000 7fe3cf200640 1 -- start start 2024-07-26T08:53:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010f330 0x7fe3d01a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cf200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0119a60 con 0x7fe3d010f330 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01198e0 con 0x7fe3d01099f0 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cf200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0119be0 con 0x7fe3d010fc80 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010f330 0x7fe3d01a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:60808/0 (socket says 172.21.15.43:60808) 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.176+0000 7fe3cde00640 1 -- 172.21.15.43:0/1569437529 learned_addr learned my addr 172.21.15.43:0/1569437529 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cde00640 1 -- 172.21.15.43:0/1569437529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d010fc80 msgr2=0x7fe3d01a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cde00640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cde00640 1 -- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010f330 msgr2=0x7fe3d01a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cde00640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010f330 0x7fe3d01a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cde00640 1 -- 172.21.15.43:0/1569437529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01a6380 con 0x7fe3d01099f0 2024-07-26T08:53:12.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cd400640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010f330 0x7fe3d01a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T08:53:12.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cde00640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0410 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000ebc0 tx=0x7fe3c000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:53:12.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3c6a00640 1 -- 172.21.15.43:0/1569437529 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0010430 con 0x7fe3d01099f0 2024-07-26T08:53:12.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d01a6670 con 0x7fe3d01099f0 2024-07-26T08:53:12.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3c6a00640 1 -- 172.21.15.43:0/1569437529 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3c0010aa0 con 0x7fe3d01099f0 2024-07-26T08:53:12.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.177+0000 7fe3c6a00640 1 -- 172.21.15.43:0/1569437529 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0018b00 con 0x7fe3d01099f0 2024-07-26T08:53:12.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.178+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01acdd0 con 0x7fe3d01099f0 2024-07-26T08:53:12.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.181+0000 7fe3dbbc2740 1 Processor -- start 2024-07-26T08:53:12.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.181+0000 7fe3dbbc2740 1 -- start start 2024-07-26T08:53:12.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.181+0000 7fe3c6a00640 1 -- 172.21.15.43:0/1569437529 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe3c0018ca0 con 0x7fe3d01099f0 2024-07-26T08:53:12.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e0dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5640b6d84b90 con 0x5640b6a401b0 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5640b6d74090 con 0x5640b6a48390 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5640b6d780d0 con 0x5640b6a69070 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3cde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e0dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e0dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:38860/0 (socket says 172.21.15.43:38860) 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3ce800640 1 -- 172.21.15.43:0/1663719382 learned_addr learned my addr 172.21.15.43:0/1663719382 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:53:12.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.182+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:60812/0 (socket says 172.21.15.43:60812) 2024-07-26T08:53:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3ce800640 1 -- 172.21.15.43:0/1663719382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 msgr2=0x5640b6e0ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3ce800640 1 -- 172.21.15.43:0/1663719382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 msgr2=0x5640b6e0e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3ce800640 1 -- 172.21.15.43:0/1663719382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b6ad4650 con 0x5640b6a69070 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e0dfd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009c60 tx=0x7fe3c8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260163beb271fad9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3bf400640 1 -- 172.21.15.43:0/1663719382 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c801e070 con 0x5640b6a69070 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3bf400640 1 -- 172.21.15.43:0/1663719382 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3c8019b00 con 0x5640b6a69070 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3c6a00640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3b40b3dc0 0x7fe3b40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.183+0000 7fe3bf400640 1 -- 172.21.15.43:0/1663719382 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800ea40 con 0x5640b6a69070 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.184+0000 7fe3c6a00640 1 -- 172.21.15.43:0/1569437529 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fe3c00e5a10 con 0x7fe3d01099f0 2024-07-26T08:53:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.184+0000 7fe3cde00640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3b40b3dc0 0x7fe3b40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1663719382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 msgr2=0x5640b6e0dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e0dfd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009c60 tx=0x7fe3c8011810 comp rx=0 tx=0).stop 2024-07-26T08:53:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3cde00640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3b40b3dc0 0x7fe3b40b62d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x5640b6e0cc50 tx=0x7fe3c00e9410 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:53:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1663719382 shutdown_connections 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1663719382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e0dfd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1663719382 >> 172.21.15.43:0/1663719382 conn(0x5640b6a5d460 msgr2=0x5640b6e0bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1663719382 shutdown_connections 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.185+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1663719382 wait complete. 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 -- start start 2024-07-26T08:53:12.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 Processor -- start 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 0x5640b6e19ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a69070 0x5640b6e19ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5640b6bd7700 con 0x5640b6a401b0 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5640b6d10660 con 0x5640b6a69070 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.186+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5640b6e1c7b0 con 0x5640b6a48390 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3dbbc2740 10 client.0 _ll_register_callbacks cb 0x5640b6d20110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 0x5640b6e19ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 0x5640b6e19ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:38862/0 (socket says 172.21.15.43:38862) 2024-07-26T08:53:12.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 -- 172.21.15.43:0/358674708 learned_addr learned my addr 172.21.15.43:0/358674708 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3ce800640 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a69070 0x5640b6e19ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 -- 172.21.15.43:0/358674708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a69070 msgr2=0x5640b6e19ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a69070 0x5640b6e19ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 -- 172.21.15.43:0/358674708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 msgr2=0x5640b6e19570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e19570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.187+0000 7fe3cd400640 1 -- 172.21.15.43:0/358674708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b6d27800 con 0x5640b6a48390 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3cd400640 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 0x5640b6e19ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe3b802a930 tx=0x7fe3b80040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3abb1bfbb968ca63 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3b3e00640 1 -- 172.21.15.43:0/358674708 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8037040 con 0x5640b6a48390 2024-07-26T08:53:12.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c8019b00 con 0x5640b6a48390 2024-07-26T08:53:12.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3b3e00640 1 -- 172.21.15.43:0/358674708 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fe3b8030540 con 0x5640b6a48390 2024-07-26T08:53:12.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3b3e00640 1 -- 172.21.15.43:0/358674708 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7fe3b804d050 con 0x5640b6a48390 2024-07-26T08:53:12.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3dbbc2740 10 client.26569 fetch_fsmap learned FSMap version 336 2024-07-26T08:53:12.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.188+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x5640b6e28400 con 0x5640b6a48390 2024-07-26T08:53:12.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3b3e00640 1 -- 172.21.15.43:0/358674708 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3c8019b00 con 0x5640b6a48390 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3b3e00640 1 -- 172.21.15.43:0/358674708 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7fe3b80474c0 con 0x5640b6a48390 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3dbbc2740 10 client.26569 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3dbbc2740 10 client.26569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3dbbc2740 20 client.26569 populate_metadata read hostname 'smithi043' 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b6a279f0 0x5640b6e2bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3dbbc2740 4 client.26569 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b6d86ae0 con 0x5640b6a279f0 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.189+0000 7fe3ce800640 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b6a279f0 0x5640b6e2bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.190+0000 7fe3ce800640 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b6a279f0 0x5640b6e2bd20 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2afd23f876953eba server_cookie=7da0f3edad5ad45 in_seq=0 out_seq=0 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.190+0000 7fe3b3e00640 10 client.26569 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.191+0000 7fe3b3e00640 1 -- 172.21.15.43:0/358674708 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640b6d86ae0 con 0x5640b6a279f0 2024-07-26T08:53:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.191+0000 7fe3b3e00640 10 client.26569 handle_command_reply: tid=0 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.191+0000 7fe3dbbc2740 1 client.26569 shutdown 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.191+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 msgr2=0x5640b6e19ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.191+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 0x5640b6e19ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe3b802a930 tx=0x7fe3b80040d0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 shutdown_connections 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b6a279f0 0x5640b6e2bd20 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a48390 0x5640b6e19ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a69070 0x5640b6e19ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/358674708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3b3e00640 0 client.26569 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 >> 172.21.15.43:0/358674708 conn(0x5640b6a5d460 msgr2=0x5640b6e11160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 shutdown_connections 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/358674708 wait complete. 2024-07-26T08:53:12.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.192+0000 7fe3dbbc2740 20 client.26569 trim_cache size 0 max 16384 2024-07-26T08:53:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.211+0000 7fe3dbbc2740 1 Processor -- start 2024-07-26T08:53:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.211+0000 7fe3dbbc2740 1 -- start start 2024-07-26T08:53:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e1b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b9530 con 0x5640b6a401b0 2024-07-26T08:53:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b79f0 con 0x5640b6a48390 2024-07-26T08:53:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b8e60 con 0x5640b6a69070 2024-07-26T08:53:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33416/0 (socket says 172.21.15.43:33416) 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.212+0000 7fe3ce800640 1 -- 172.21.15.43:0/1829731551 learned_addr learned my addr 172.21.15.43:0/1829731551 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3cd400640 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e1b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 -- 172.21.15.43:0/1829731551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 msgr2=0x5640b6e1b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e1b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 -- 172.21.15.43:0/1829731551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 msgr2=0x5640b6e0f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 -- 172.21.15.43:0/1829731551 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b6e17a70 con 0x5640b6a401b0 2024-07-26T08:53:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.213+0000 7fe3ce800640 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0afd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8000c00 tx=0x7fe3c8009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde379636ae264f1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:53:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.214+0000 7fe3bea00640 1 -- 172.21.15.43:0/1829731551 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c801e040 con 0x5640b6a401b0 2024-07-26T08:53:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.214+0000 7fe3bea00640 1 -- 172.21.15.43:0/1829731551 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3c80050c0 con 0x5640b6a401b0 2024-07-26T08:53:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.214+0000 7fe3bea00640 1 -- 172.21.15.43:0/1829731551 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800e950 con 0x5640b6a401b0 2024-07-26T08:53:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1829731551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 msgr2=0x5640b6e0afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0afd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8000c00 tx=0x7fe3c8009a10 comp rx=0 tx=0).stop 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1829731551 shutdown_connections 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a69070 0x5640b6e1b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e0f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/1829731551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a401b0 0x5640b6e0afd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1829731551 >> 172.21.15.43:0/1829731551 conn(0x5640b6a5d460 msgr2=0x5640b6e1aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1829731551 shutdown_connections 2024-07-26T08:53:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.215+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/1829731551 wait complete. 2024-07-26T08:53:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.216+0000 7fe3dbbc2740 1 -- start start 2024-07-26T08:53:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.216+0000 7fe3dbbc2740 1 Processor -- start 2024-07-26T08:53:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a401b0 0x5640b6e221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e1d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a69070 0x5640b6e1dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b8790 con 0x5640b6a69070 2024-07-26T08:53:12.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b80c0 con 0x5640b6a48390 2024-07-26T08:53:12.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5640b6d86ae0 con 0x5640b6a401b0 2024-07-26T08:53:12.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3dbbc2740 10 client.0 _ll_register_callbacks cb 0x7fe3b8009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e1d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a69070 0x5640b6e1dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3cd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e1d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:60846/0 (socket says 172.21.15.43:60846) 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3cd400640 1 -- 172.21.15.43:0/3414801677 learned_addr learned my addr 172.21.15.43:0/3414801677 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.217+0000 7fe3ce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a401b0 0x5640b6e221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3cd400640 1 -- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a401b0 msgr2=0x5640b6e221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3cd400640 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a401b0 0x5640b6e221c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3cd400640 1 -- 172.21.15.43:0/3414801677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a69070 msgr2=0x5640b6e1dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3cd400640 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a69070 0x5640b6e1dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3cd400640 1 -- 172.21.15.43:0/3414801677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b6e1e480 con 0x5640b6a48390 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3ce800640 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a69070 0x5640b6e1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3cd400640 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e1d6c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8047a70 tx=0x7fe3b8047d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302811ea6cc0e1fb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T08:53:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.218+0000 7fe3b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-07-26T08:53:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.219+0000 7fe3b3e00640 1 -- 172.21.15.43:0/3414801677 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8055060 con 0x5640b6a48390 2024-07-26T08:53:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.219+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c80050c0 con 0x5640b6a48390 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.219+0000 7fe3b3e00640 1 -- 172.21.15.43:0/3414801677 <== mon.2 v2:172.21.15.63:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fe3b8045c80 con 0x5640b6a48390 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.219+0000 7fe3b3e00640 1 -- 172.21.15.43:0/3414801677 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=336) ==== 24+0+0 (secure 0 0 0) 0x7fe3b805d050 con 0x5640b6a48390 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.219+0000 7fe3dbbc2740 10 client.26600 fetch_fsmap learned FSMap version 336 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.219+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=336,monmap=4+}) -- 0x5640b6e94540 con 0x5640b6a48390 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3b3e00640 1 -- 172.21.15.43:0/3414801677 <== mon.2 v2:172.21.15.63:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3c80050c0 con 0x5640b6a48390 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3b3e00640 1 -- 172.21.15.43:0/3414801677 <== mon.2 v2:172.21.15.63:3300/0 5 ==== fsmap(e 336) ==== 4131+0+0 (secure 0 0 0) 0x7fe3b8050070 con 0x5640b6a48390 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3dbbc2740 10 client.26600 fetch_fsmap finished waiting for FSMap version 336 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3dbbc2740 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.c 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3dbbc2740 20 client.26600 populate_metadata read hostname 'smithi043' 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b69fcda0 0x5640b6e96c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3dbbc2740 4 client.26600 mds_command: new command op to 24697 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-26T08:53:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 --> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640b6d82580 con 0x5640b69fcda0 2024-07-26T08:53:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.220+0000 7fe3ce800640 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b69fcda0 0x5640b6e96c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T08:53:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.221+0000 7fe3ce800640 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b69fcda0 0x5640b6e96c70 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=836e0cb74e56767 server_cookie=48dfabd08594ad1e in_seq=0 out_seq=0 2024-07-26T08:53:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.221+0000 7fe3b3e00640 10 client.26600 ms_handle_connect on v2:172.21.15.133:6836/2370435591 2024-07-26T08:53:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.221+0000 7fe3b3e00640 1 -- 172.21.15.43:0/3414801677 <== mds.0 v2:172.21.15.133:6836/2370435591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x5640b6d82580 con 0x5640b69fcda0 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.221+0000 7fe3b3e00640 10 client.26600 handle_command_reply: tid=0 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.221+0000 7fe3dbbc2740 1 client.26600 shutdown 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 msgr2=0x5640b6e1d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e1d6c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8047a70 tx=0x7fe3b8047d20 comp rx=0 tx=0).stop 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 shutdown_connections 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:6836/2370435591,v1:172.21.15.133:6837/2370435591] conn(0x5640b69fcda0 0x5640b6e96c70 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640b6a69070 0x5640b6e1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640b6a48390 0x5640b6e1d6c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 --2- 172.21.15.43:0/3414801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5640b6a401b0 0x5640b6e221c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 >> 172.21.15.43:0/3414801677 conn(0x5640b6a5d460 msgr2=0x5640b6e0f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:53:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3b3e00640 0 client.26600 ms_handle_reset on v2:172.21.15.133:6836/2370435591 2024-07-26T08:53:12.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 shutdown_connections 2024-07-26T08:53:12.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 1 -- 172.21.15.43:0/3414801677 wait complete. 2024-07-26T08:53:12.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.222+0000 7fe3dbbc2740 20 client.26600 trim_cache size 0 max 16384 2024-07-26T08:53:12.225 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: "status": "scrub active (0 inodes in the stack)", 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: "scrubs": { 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: "4127e342-81cf-463e-9563-5b02624d2063": { 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: "tag": "4127e342-81cf-463e-9563-5b02624d2063", 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: "options": "recursive,force" 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T08:53:12.226 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3b40b3dc0 msgr2=0x7fe3b40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3b40b3dc0 0x7fe3b40b62d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x5640b6e0cc50 tx=0x7fe3c00e9410 comp rx=0 tx=0).stop 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 msgr2=0x7fe3d01a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0410 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000ebc0 tx=0x7fe3c000c2d0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 shutdown_connections 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe3b40b3dc0 0x7fe3b40b62d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d010f330 0x7fe3d01a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 --2- 172.21.15.43:0/1569437529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0410 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T08:53:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 >> 172.21.15.43:0/1569437529 conn(0x7fe3d0078ff0 msgr2=0x7fe3d010b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T08:53:12.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.223+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 shutdown_connections 2024-07-26T08:53:12.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T08:53:12.224+0000 7fe3cf200640 1 -- 172.21.15.43:0/1569437529 wait complete. 2024-07-26T08:53:12.928 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:12 smithi043 ceph-mon[32384]: pgmap v1150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:13.009 INFO:tasks.cephfs.filesystem:scrub status for tag:4127e342-81cf-463e-9563-5b02624d2063 - {'path': '/', 'tag': '4127e342-81cf-463e-9563-5b02624d2063', 'options': 'recursive,force'} 2024-07-26T08:53:13.009 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/fwd_scrub.py", line 67, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/cephfs/filesystem.py", line 1825, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2024-07-26T08:53:13.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:12 smithi133 ceph-mon[37053]: pgmap v1150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:13.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:12 smithi063 ceph-mon[36747]: pgmap v1150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:14.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:14 smithi043 ceph-mon[32384]: pgmap v1151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:53:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:14 smithi133 ceph-mon[37053]: pgmap v1151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:53:15.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:14 smithi063 ceph-mon[36747]: pgmap v1151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:53:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:53:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:53:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:53:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1041.728421 secs 2024-07-26T08:53:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1057.214422 secs 2024-07-26T08:53:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:53:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:53:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:53:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1041.728421 secs 2024-07-26T08:53:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1057.214422 secs 2024-07-26T08:53:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:53:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:53:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:53:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1041.728421 secs 2024-07-26T08:53:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1057.214422 secs 2024-07-26T08:53:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:16 smithi043 ceph-mon[32384]: pgmap v1152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:53:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:16 smithi043 ceph-mon[32384]: pgmap v1153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:53:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:16 smithi133 ceph-mon[37053]: pgmap v1152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:53:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:16 smithi133 ceph-mon[37053]: pgmap v1153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:53:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:16 smithi063 ceph-mon[36747]: pgmap v1152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:53:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:16 smithi063 ceph-mon[36747]: pgmap v1153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:53:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:18 smithi043 ceph-mon[32384]: pgmap v1154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:53:19.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:18 smithi133 ceph-mon[37053]: pgmap v1154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:53:19.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:18 smithi063 ceph-mon[36747]: pgmap v1154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:53:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:20 smithi043 ceph-mon[32384]: pgmap v1155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:53:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1046.728545 secs 2024-07-26T08:53:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1062.214535 secs 2024-07-26T08:53:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:20 smithi133 ceph-mon[37053]: pgmap v1155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:53:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1046.728545 secs 2024-07-26T08:53:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1062.214535 secs 2024-07-26T08:53:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:20 smithi063 ceph-mon[36747]: pgmap v1155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:53:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1046.728545 secs 2024-07-26T08:53:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1062.214535 secs 2024-07-26T08:53:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:22 smithi043 ceph-mon[32384]: pgmap v1156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:53:23.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:22 smithi133 ceph-mon[37053]: pgmap v1156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:53:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:22 smithi063 ceph-mon[36747]: pgmap v1156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:53:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:24 smithi133 ceph-mon[37053]: pgmap v1157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:53:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:24 smithi063 ceph-mon[36747]: pgmap v1157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:53:25.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:24 smithi043 ceph-mon[32384]: pgmap v1157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:53:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1051.728664 secs 2024-07-26T08:53:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1067.214683 secs 2024-07-26T08:53:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1051.728664 secs 2024-07-26T08:53:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1067.214683 secs 2024-07-26T08:53:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1051.728664 secs 2024-07-26T08:53:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1067.214683 secs 2024-07-26T08:53:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:26 smithi133 ceph-mon[37053]: pgmap v1158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:53:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:26 smithi063 ceph-mon[36747]: pgmap v1158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:53:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:26 smithi043 ceph-mon[32384]: pgmap v1158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:53:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:27 smithi133 ceph-mon[37053]: pgmap v1159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:27 smithi063 ceph-mon[36747]: pgmap v1159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:28.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:27 smithi043 ceph-mon[32384]: pgmap v1159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:29 smithi043 ceph-mon[32384]: pgmap v1160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:29 smithi133 ceph-mon[37053]: pgmap v1160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:29 smithi063 ceph-mon[36747]: pgmap v1160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1056.728789 secs 2024-07-26T08:53:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1072.214801 secs 2024-07-26T08:53:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1056.728789 secs 2024-07-26T08:53:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1072.214801 secs 2024-07-26T08:53:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1056.728789 secs 2024-07-26T08:53:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1072.214801 secs 2024-07-26T08:53:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:31 smithi043 ceph-mon[32384]: pgmap v1161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:32.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:31 smithi133 ceph-mon[37053]: pgmap v1161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:31 smithi063 ceph-mon[36747]: pgmap v1161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:33 smithi043 ceph-mon[32384]: pgmap v1162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:33 smithi133 ceph-mon[37053]: pgmap v1162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:34.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:33 smithi063 ceph-mon[36747]: pgmap v1162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:35 smithi043 ceph-mon[32384]: pgmap v1163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1061.728919 secs 2024-07-26T08:53:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1077.214939 secs 2024-07-26T08:53:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:35 smithi133 ceph-mon[37053]: pgmap v1163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1061.728919 secs 2024-07-26T08:53:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1077.214939 secs 2024-07-26T08:53:36.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:35 smithi063 ceph-mon[36747]: pgmap v1163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1061.728919 secs 2024-07-26T08:53:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1077.214939 secs 2024-07-26T08:53:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:37 smithi043 ceph-mon[32384]: pgmap v1164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:37 smithi133 ceph-mon[37053]: pgmap v1164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:37 smithi063 ceph-mon[36747]: pgmap v1164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:39 smithi043 ceph-mon[32384]: pgmap v1165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:40.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:39 smithi133 ceph-mon[37053]: pgmap v1165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:40.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:39 smithi063 ceph-mon[36747]: pgmap v1165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1066.729044 secs 2024-07-26T08:53:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1082.215078 secs 2024-07-26T08:53:41.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1066.729044 secs 2024-07-26T08:53:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1082.215078 secs 2024-07-26T08:53:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1066.729044 secs 2024-07-26T08:53:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1082.215078 secs 2024-07-26T08:53:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:41 smithi133 ceph-mon[37053]: pgmap v1166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:41 smithi063 ceph-mon[36747]: pgmap v1166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:41 smithi043 ceph-mon[32384]: pgmap v1166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:43 smithi133 ceph-mon[37053]: pgmap v1167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:43 smithi063 ceph-mon[36747]: pgmap v1167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:43 smithi043 ceph-mon[32384]: pgmap v1167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:45 smithi133 ceph-mon[37053]: pgmap v1168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1071.729144 secs 2024-07-26T08:53:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1087.215217 secs 2024-07-26T08:53:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:45 smithi063 ceph-mon[36747]: pgmap v1168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1071.729144 secs 2024-07-26T08:53:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1087.215217 secs 2024-07-26T08:53:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:45 smithi043 ceph-mon[32384]: pgmap v1168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1071.729144 secs 2024-07-26T08:53:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1087.215217 secs 2024-07-26T08:53:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:47 smithi133 ceph-mon[37053]: pgmap v1169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:47 smithi063 ceph-mon[36747]: pgmap v1169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:47 smithi043 ceph-mon[32384]: pgmap v1169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:50.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:50 smithi133 ceph-mon[37053]: pgmap v1170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:50 smithi063 ceph-mon[36747]: pgmap v1170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:50.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:50 smithi043 ceph-mon[32384]: pgmap v1170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1076.729266 secs 2024-07-26T08:53:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1092.215358 secs 2024-07-26T08:53:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1076.729266 secs 2024-07-26T08:53:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1092.215358 secs 2024-07-26T08:53:51.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1076.729266 secs 2024-07-26T08:53:51.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1092.215358 secs 2024-07-26T08:53:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:52 smithi063 ceph-mon[36747]: pgmap v1171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:52 smithi043 ceph-mon[32384]: pgmap v1171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:52 smithi133 ceph-mon[37053]: pgmap v1171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:54 smithi063 ceph-mon[36747]: pgmap v1172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:54 smithi043 ceph-mon[32384]: pgmap v1172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:54 smithi133 ceph-mon[37053]: pgmap v1172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:53:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:56 smithi063 ceph-mon[36747]: pgmap v1173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1081.729401 secs 2024-07-26T08:53:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1097.215491 secs 2024-07-26T08:53:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:56 smithi043 ceph-mon[32384]: pgmap v1173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1081.729401 secs 2024-07-26T08:53:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1097.215491 secs 2024-07-26T08:53:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:56 smithi133 ceph-mon[37053]: pgmap v1173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:53:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1081.729401 secs 2024-07-26T08:53:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1097.215491 secs 2024-07-26T08:53:58.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:53:58 smithi043 ceph-mon[32384]: pgmap v1174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:53:58 smithi063 ceph-mon[36747]: pgmap v1174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:53:58.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:53:58 smithi133 ceph-mon[37053]: pgmap v1174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:00.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:00 smithi133 ceph-mon[37053]: pgmap v1175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:00 smithi063 ceph-mon[36747]: pgmap v1175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:00 smithi043 ceph-mon[32384]: pgmap v1175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1086.729532 secs 2024-07-26T08:54:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1102.215640 secs 2024-07-26T08:54:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1086.729532 secs 2024-07-26T08:54:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1102.215640 secs 2024-07-26T08:54:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1086.729532 secs 2024-07-26T08:54:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1102.215640 secs 2024-07-26T08:54:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:02 smithi063 ceph-mon[36747]: pgmap v1176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:02 smithi043 ceph-mon[32384]: pgmap v1176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:02 smithi133 ceph-mon[37053]: pgmap v1176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:04 smithi063 ceph-mon[36747]: pgmap v1177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:04 smithi043 ceph-mon[32384]: pgmap v1177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:04 smithi133 ceph-mon[37053]: pgmap v1177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:06 smithi063 ceph-mon[36747]: pgmap v1178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1091.729681 secs 2024-07-26T08:54:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1107.215780 secs 2024-07-26T08:54:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:06 smithi043 ceph-mon[32384]: pgmap v1178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1091.729681 secs 2024-07-26T08:54:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1107.215780 secs 2024-07-26T08:54:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:06 smithi133 ceph-mon[37053]: pgmap v1178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1091.729681 secs 2024-07-26T08:54:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1107.215780 secs 2024-07-26T08:54:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:08 smithi043 ceph-mon[32384]: pgmap v1179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:08.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:08 smithi133 ceph-mon[37053]: pgmap v1179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:08 smithi063 ceph-mon[36747]: pgmap v1179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:10 smithi043 ceph-mon[32384]: pgmap v1180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:10.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:10 smithi133 ceph-mon[37053]: pgmap v1180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:10 smithi063 ceph-mon[36747]: pgmap v1180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1096.729753 secs 2024-07-26T08:54:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1112.215928 secs 2024-07-26T08:54:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1096.729753 secs 2024-07-26T08:54:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1112.215928 secs 2024-07-26T08:54:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1096.729753 secs 2024-07-26T08:54:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1112.215928 secs 2024-07-26T08:54:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:12 smithi043 ceph-mon[32384]: pgmap v1181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:12 smithi133 ceph-mon[37053]: pgmap v1181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:12 smithi063 ceph-mon[36747]: pgmap v1181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:14.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:14 smithi043 ceph-mon[32384]: pgmap v1182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:54:14.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:14 smithi133 ceph-mon[37053]: pgmap v1182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:54:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:14 smithi063 ceph-mon[36747]: pgmap v1182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:54:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:54:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1101.729849 secs 2024-07-26T08:54:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:54:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1101.729849 secs 2024-07-26T08:54:15.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:54:15.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1101.729849 secs 2024-07-26T08:54:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:16 smithi043 ceph-mon[32384]: pgmap v1183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:54:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1117.216011 secs 2024-07-26T08:54:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:54:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:54:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:54:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:16 smithi133 ceph-mon[37053]: pgmap v1183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:54:16.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1117.216011 secs 2024-07-26T08:54:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:54:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:54:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:54:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:16 smithi063 ceph-mon[36747]: pgmap v1183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:54:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1117.216011 secs 2024-07-26T08:54:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:54:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:54:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:54:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:17 smithi043 ceph-mon[32384]: pgmap v1184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:17 smithi043 ceph-mon[32384]: pgmap v1185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:17.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:17 smithi133 ceph-mon[37053]: pgmap v1184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:17 smithi133 ceph-mon[37053]: pgmap v1185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:17 smithi063 ceph-mon[36747]: pgmap v1184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:17 smithi063 ceph-mon[36747]: pgmap v1185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:19 smithi043 ceph-mon[32384]: pgmap v1186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:19.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:19 smithi133 ceph-mon[37053]: pgmap v1186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:19 smithi063 ceph-mon[36747]: pgmap v1186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1106.729969 secs 2024-07-26T08:54:20.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1106.729969 secs 2024-07-26T08:54:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1106.729969 secs 2024-07-26T08:54:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:21 smithi043 ceph-mon[32384]: pgmap v1187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T08:54:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1122.216153 secs 2024-07-26T08:54:21.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:21 smithi133 ceph-mon[37053]: pgmap v1187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T08:54:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1122.216153 secs 2024-07-26T08:54:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:21 smithi063 ceph-mon[36747]: pgmap v1187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T08:54:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1122.216153 secs 2024-07-26T08:54:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:23 smithi043 ceph-mon[32384]: pgmap v1188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:54:23.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:23 smithi133 ceph-mon[37053]: pgmap v1188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:54:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:23 smithi063 ceph-mon[36747]: pgmap v1188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:54:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:25 smithi043 ceph-mon[32384]: pgmap v1189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:54:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1111.730126 secs 2024-07-26T08:54:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:25 smithi133 ceph-mon[37053]: pgmap v1189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:54:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1111.730126 secs 2024-07-26T08:54:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:25 smithi063 ceph-mon[36747]: pgmap v1189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:54:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1111.730126 secs 2024-07-26T08:54:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1127.216266 secs 2024-07-26T08:54:26.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1127.216266 secs 2024-07-26T08:54:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1127.216266 secs 2024-07-26T08:54:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:27 smithi043 ceph-mon[32384]: pgmap v1190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:54:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:27 smithi133 ceph-mon[37053]: pgmap v1190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:54:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:27 smithi063 ceph-mon[36747]: pgmap v1190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:54:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:29 smithi043 ceph-mon[32384]: pgmap v1191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:29.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:29 smithi133 ceph-mon[37053]: pgmap v1191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:29.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:29 smithi063 ceph-mon[36747]: pgmap v1191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1116.730228 secs 2024-07-26T08:54:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1116.730228 secs 2024-07-26T08:54:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1116.730228 secs 2024-07-26T08:54:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:31 smithi133 ceph-mon[37053]: pgmap v1192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1132.216399 secs 2024-07-26T08:54:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:31 smithi063 ceph-mon[36747]: pgmap v1192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1132.216399 secs 2024-07-26T08:54:31.931 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:31 smithi043 ceph-mon[32384]: pgmap v1192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:31.931 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1132.216399 secs 2024-07-26T08:54:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:33 smithi133 ceph-mon[37053]: pgmap v1193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:33 smithi063 ceph-mon[36747]: pgmap v1193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:33 smithi043 ceph-mon[32384]: pgmap v1193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:35.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:35 smithi133 ceph-mon[37053]: pgmap v1194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1121.730289 secs 2024-07-26T08:54:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:35 smithi063 ceph-mon[36747]: pgmap v1194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1121.730289 secs 2024-07-26T08:54:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:35 smithi043 ceph-mon[32384]: pgmap v1194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1121.730289 secs 2024-07-26T08:54:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1137.216536 secs 2024-07-26T08:54:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1137.216536 secs 2024-07-26T08:54:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1137.216536 secs 2024-07-26T08:54:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:37 smithi063 ceph-mon[36747]: pgmap v1195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:37 smithi043 ceph-mon[32384]: pgmap v1195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:37 smithi133 ceph-mon[37053]: pgmap v1195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:39 smithi063 ceph-mon[36747]: pgmap v1196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:39 smithi043 ceph-mon[32384]: pgmap v1196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:39 smithi133 ceph-mon[37053]: pgmap v1196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1126.730400 secs 2024-07-26T08:54:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1126.730400 secs 2024-07-26T08:54:41.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1126.730400 secs 2024-07-26T08:54:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:41 smithi063 ceph-mon[36747]: pgmap v1197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1142.216673 secs 2024-07-26T08:54:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:41 smithi043 ceph-mon[32384]: pgmap v1197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1142.216673 secs 2024-07-26T08:54:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:41 smithi133 ceph-mon[37053]: pgmap v1197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1142.216673 secs 2024-07-26T08:54:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:43 smithi063 ceph-mon[36747]: pgmap v1198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:43 smithi043 ceph-mon[32384]: pgmap v1198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:43 smithi133 ceph-mon[37053]: pgmap v1198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:45 smithi063 ceph-mon[36747]: pgmap v1199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1131.730537 secs 2024-07-26T08:54:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:45 smithi043 ceph-mon[32384]: pgmap v1199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1131.730537 secs 2024-07-26T08:54:46.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:45 smithi133 ceph-mon[37053]: pgmap v1199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1131.730537 secs 2024-07-26T08:54:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1147.216792 secs 2024-07-26T08:54:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1147.216792 secs 2024-07-26T08:54:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1147.216792 secs 2024-07-26T08:54:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:47 smithi063 ceph-mon[36747]: pgmap v1200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:47 smithi043 ceph-mon[32384]: pgmap v1200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:47 smithi133 ceph-mon[37053]: pgmap v1200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:49 smithi043 ceph-mon[32384]: pgmap v1201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:49 smithi133 ceph-mon[37053]: pgmap v1201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:49 smithi063 ceph-mon[36747]: pgmap v1201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1136.730654 secs 2024-07-26T08:54:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1136.730654 secs 2024-07-26T08:54:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1136.730654 secs 2024-07-26T08:54:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:51 smithi043 ceph-mon[32384]: pgmap v1202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1152.216918 secs 2024-07-26T08:54:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:51 smithi133 ceph-mon[37053]: pgmap v1202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1152.216918 secs 2024-07-26T08:54:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:51 smithi063 ceph-mon[36747]: pgmap v1202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:54:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1152.216918 secs 2024-07-26T08:54:53.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:53 smithi063 ceph-mon[36747]: pgmap v1203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:53.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:53 smithi043 ceph-mon[32384]: pgmap v1203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:54.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:53 smithi133 ceph-mon[37053]: pgmap v1203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:55 smithi043 ceph-mon[32384]: pgmap v1204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1141.730793 secs 2024-07-26T08:54:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:55 smithi133 ceph-mon[37053]: pgmap v1204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1141.730793 secs 2024-07-26T08:54:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:55 smithi063 ceph-mon[36747]: pgmap v1204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:54:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1141.730793 secs 2024-07-26T08:54:56.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1157.217052 secs 2024-07-26T08:54:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1157.217052 secs 2024-07-26T08:54:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1157.217052 secs 2024-07-26T08:54:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:57 smithi043 ceph-mon[32384]: pgmap v1205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:57 smithi133 ceph-mon[37053]: pgmap v1205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:57 smithi063 ceph-mon[36747]: pgmap v1205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:54:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:54:59 smithi043 ceph-mon[32384]: pgmap v1206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:00.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:54:59 smithi133 ceph-mon[37053]: pgmap v1206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:54:59 smithi063 ceph-mon[36747]: pgmap v1206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:00.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1146.730912 secs 2024-07-26T08:55:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1146.730912 secs 2024-07-26T08:55:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1146.730912 secs 2024-07-26T08:55:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:01 smithi043 ceph-mon[32384]: pgmap v1207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1162.217139 secs 2024-07-26T08:55:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:01 smithi133 ceph-mon[37053]: pgmap v1207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1162.217139 secs 2024-07-26T08:55:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:01 smithi063 ceph-mon[36747]: pgmap v1207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1162.217139 secs 2024-07-26T08:55:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:03 smithi043 ceph-mon[32384]: pgmap v1208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:03 smithi133 ceph-mon[37053]: pgmap v1208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:03 smithi063 ceph-mon[36747]: pgmap v1208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:05 smithi043 ceph-mon[32384]: pgmap v1209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1151.731030 secs 2024-07-26T08:55:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:05 smithi133 ceph-mon[37053]: pgmap v1209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1151.731030 secs 2024-07-26T08:55:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:05 smithi063 ceph-mon[36747]: pgmap v1209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1151.731030 secs 2024-07-26T08:55:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1167.217282 secs 2024-07-26T08:55:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1167.217282 secs 2024-07-26T08:55:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1167.217282 secs 2024-07-26T08:55:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:07 smithi043 ceph-mon[32384]: pgmap v1210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:07 smithi133 ceph-mon[37053]: pgmap v1210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:07 smithi063 ceph-mon[36747]: pgmap v1210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:09.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:09 smithi043 ceph-mon[32384]: pgmap v1211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:09 smithi133 ceph-mon[37053]: pgmap v1211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:09 smithi063 ceph-mon[36747]: pgmap v1211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1156.731133 secs 2024-07-26T08:55:11.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1156.731133 secs 2024-07-26T08:55:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1156.731133 secs 2024-07-26T08:55:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:11 smithi043 ceph-mon[32384]: pgmap v1212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1172.217401 secs 2024-07-26T08:55:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:11 smithi133 ceph-mon[37053]: pgmap v1212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1172.217401 secs 2024-07-26T08:55:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:11 smithi063 ceph-mon[36747]: pgmap v1212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1172.217401 secs 2024-07-26T08:55:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:13 smithi043 ceph-mon[32384]: pgmap v1213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:13 smithi133 ceph-mon[37053]: pgmap v1213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:13 smithi063 ceph-mon[36747]: pgmap v1213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:15 smithi043 ceph-mon[32384]: pgmap v1214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1161.731224 secs 2024-07-26T08:55:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1177.217464 secs 2024-07-26T08:55:16.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:15 smithi133 ceph-mon[37053]: pgmap v1214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1161.731224 secs 2024-07-26T08:55:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1177.217464 secs 2024-07-26T08:55:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:15 smithi063 ceph-mon[36747]: pgmap v1214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1161.731224 secs 2024-07-26T08:55:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1177.217464 secs 2024-07-26T08:55:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:55:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:55:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:55:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:17 smithi043 ceph-mon[32384]: pgmap v1215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:55:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:55:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:55:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:17 smithi133 ceph-mon[37053]: pgmap v1215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:55:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:55:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:55:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:17 smithi063 ceph-mon[36747]: pgmap v1215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:55:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:55:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:55:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:18 smithi043 ceph-mon[32384]: pgmap v1216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:18 smithi043 ceph-mon[32384]: pgmap v1217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:18 smithi133 ceph-mon[37053]: pgmap v1216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:18 smithi133 ceph-mon[37053]: pgmap v1217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:18 smithi063 ceph-mon[36747]: pgmap v1216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:18 smithi063 ceph-mon[36747]: pgmap v1217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:20 smithi043 ceph-mon[32384]: pgmap v1218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1166.731347 secs 2024-07-26T08:55:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1182.217602 secs 2024-07-26T08:55:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:20 smithi133 ceph-mon[37053]: pgmap v1218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1166.731347 secs 2024-07-26T08:55:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1182.217602 secs 2024-07-26T08:55:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:20 smithi063 ceph-mon[36747]: pgmap v1218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1166.731347 secs 2024-07-26T08:55:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1182.217602 secs 2024-07-26T08:55:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:22 smithi043 ceph-mon[32384]: pgmap v1219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:55:23.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:22 smithi133 ceph-mon[37053]: pgmap v1219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:55:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:22 smithi063 ceph-mon[36747]: pgmap v1219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:55:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:24 smithi043 ceph-mon[32384]: pgmap v1220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:25.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:24 smithi133 ceph-mon[37053]: pgmap v1220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:24 smithi063 ceph-mon[36747]: pgmap v1220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:55:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1171.731468 secs 2024-07-26T08:55:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1187.217739 secs 2024-07-26T08:55:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1171.731468 secs 2024-07-26T08:55:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1187.217739 secs 2024-07-26T08:55:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1171.731468 secs 2024-07-26T08:55:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1187.217739 secs 2024-07-26T08:55:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:26 smithi133 ceph-mon[37053]: pgmap v1221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:55:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:26 smithi063 ceph-mon[36747]: pgmap v1221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:55:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:26 smithi043 ceph-mon[32384]: pgmap v1221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:55:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:28 smithi133 ceph-mon[37053]: pgmap v1222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:55:29.038 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:28 smithi043 ceph-mon[32384]: pgmap v1222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:55:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:28 smithi063 ceph-mon[36747]: pgmap v1222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:55:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:30 smithi133 ceph-mon[37053]: pgmap v1223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1176.731610 secs 2024-07-26T08:55:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1192.217857 secs 2024-07-26T08:55:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:30 smithi063 ceph-mon[36747]: pgmap v1223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1176.731610 secs 2024-07-26T08:55:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1192.217857 secs 2024-07-26T08:55:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:30 smithi043 ceph-mon[32384]: pgmap v1223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1176.731610 secs 2024-07-26T08:55:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1192.217857 secs 2024-07-26T08:55:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:32 smithi133 ceph-mon[37053]: pgmap v1224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:32 smithi063 ceph-mon[36747]: pgmap v1224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:32 smithi043 ceph-mon[32384]: pgmap v1224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:34 smithi133 ceph-mon[37053]: pgmap v1225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:34 smithi063 ceph-mon[36747]: pgmap v1225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:34 smithi043 ceph-mon[32384]: pgmap v1225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1181.731691 secs 2024-07-26T08:55:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1197.217986 secs 2024-07-26T08:55:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1181.731691 secs 2024-07-26T08:55:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1197.217986 secs 2024-07-26T08:55:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1181.731691 secs 2024-07-26T08:55:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1197.217986 secs 2024-07-26T08:55:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:36 smithi063 ceph-mon[36747]: pgmap v1226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:37.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:36 smithi043 ceph-mon[32384]: pgmap v1226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:37.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:36 smithi133 ceph-mon[37053]: pgmap v1226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:37 smithi063 ceph-mon[36747]: pgmap v1227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:37 smithi043 ceph-mon[32384]: pgmap v1227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:37 smithi133 ceph-mon[37053]: pgmap v1227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:40 smithi133 ceph-mon[37053]: pgmap v1228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1186.731809 secs 2024-07-26T08:55:40.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:40 smithi063 ceph-mon[36747]: pgmap v1228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1186.731809 secs 2024-07-26T08:55:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:40 smithi043 ceph-mon[32384]: pgmap v1228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1186.731809 secs 2024-07-26T08:55:41.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1202.218081 secs 2024-07-26T08:55:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1202.218081 secs 2024-07-26T08:55:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1202.218081 secs 2024-07-26T08:55:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:42 smithi063 ceph-mon[36747]: pgmap v1229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:42 smithi043 ceph-mon[32384]: pgmap v1229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:42 smithi133 ceph-mon[37053]: pgmap v1229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:44 smithi063 ceph-mon[36747]: pgmap v1230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:44 smithi043 ceph-mon[32384]: pgmap v1230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:45.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:44 smithi133 ceph-mon[37053]: pgmap v1230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1191.731931 secs 2024-07-26T08:55:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1191.731931 secs 2024-07-26T08:55:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1191.731931 secs 2024-07-26T08:55:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:46 smithi063 ceph-mon[36747]: pgmap v1231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1207.218221 secs 2024-07-26T08:55:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:46 smithi043 ceph-mon[32384]: pgmap v1231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1207.218221 secs 2024-07-26T08:55:47.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:46 smithi133 ceph-mon[37053]: pgmap v1231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1207.218221 secs 2024-07-26T08:55:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:48 smithi063 ceph-mon[36747]: pgmap v1232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:48 smithi043 ceph-mon[32384]: pgmap v1232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:48 smithi133 ceph-mon[37053]: pgmap v1232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:50 smithi063 ceph-mon[36747]: pgmap v1233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1196.732052 secs 2024-07-26T08:55:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:50 smithi043 ceph-mon[32384]: pgmap v1233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1196.732052 secs 2024-07-26T08:55:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:50 smithi133 ceph-mon[37053]: pgmap v1233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1196.732052 secs 2024-07-26T08:55:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1212.218368 secs 2024-07-26T08:55:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1212.218368 secs 2024-07-26T08:55:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1212.218368 secs 2024-07-26T08:55:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:52 smithi063 ceph-mon[36747]: pgmap v1234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:52 smithi043 ceph-mon[32384]: pgmap v1234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:52 smithi133 ceph-mon[37053]: pgmap v1234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:55:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:54 smithi043 ceph-mon[32384]: pgmap v1235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:54 smithi133 ceph-mon[37053]: pgmap v1235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:54 smithi063 ceph-mon[36747]: pgmap v1235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:55:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1201.732163 secs 2024-07-26T08:55:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1201.732163 secs 2024-07-26T08:55:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1201.732163 secs 2024-07-26T08:55:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:56 smithi043 ceph-mon[32384]: pgmap v1236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1217.218505 secs 2024-07-26T08:55:57.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:56 smithi133 ceph-mon[37053]: pgmap v1236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1217.218505 secs 2024-07-26T08:55:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:56 smithi063 ceph-mon[36747]: pgmap v1236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:55:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1217.218505 secs 2024-07-26T08:55:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:55:58 smithi043 ceph-mon[32384]: pgmap v1237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:59.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:55:58 smithi133 ceph-mon[37053]: pgmap v1237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:55:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:55:58 smithi063 ceph-mon[36747]: pgmap v1237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:00 smithi043 ceph-mon[32384]: pgmap v1238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1206.732285 secs 2024-07-26T08:56:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:00 smithi133 ceph-mon[37053]: pgmap v1238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1206.732285 secs 2024-07-26T08:56:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:00 smithi063 ceph-mon[36747]: pgmap v1238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1206.732285 secs 2024-07-26T08:56:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1222.218627 secs 2024-07-26T08:56:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1222.218627 secs 2024-07-26T08:56:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1222.218627 secs 2024-07-26T08:56:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:02 smithi043 ceph-mon[32384]: pgmap v1239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:03.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:02 smithi133 ceph-mon[37053]: pgmap v1239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:02 smithi063 ceph-mon[36747]: pgmap v1239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:04 smithi043 ceph-mon[32384]: pgmap v1240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:04 smithi133 ceph-mon[37053]: pgmap v1240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:04 smithi063 ceph-mon[36747]: pgmap v1240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1211.732383 secs 2024-07-26T08:56:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1211.732383 secs 2024-07-26T08:56:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1211.732383 secs 2024-07-26T08:56:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:06 smithi043 ceph-mon[32384]: pgmap v1241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1227.218765 secs 2024-07-26T08:56:07.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:06 smithi133 ceph-mon[37053]: pgmap v1241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1227.218765 secs 2024-07-26T08:56:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:06 smithi063 ceph-mon[36747]: pgmap v1241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1227.218765 secs 2024-07-26T08:56:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:08 smithi043 ceph-mon[32384]: pgmap v1242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:09.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:08 smithi133 ceph-mon[37053]: pgmap v1242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:08 smithi063 ceph-mon[36747]: pgmap v1242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:10 smithi043 ceph-mon[32384]: pgmap v1243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1216.732526 secs 2024-07-26T08:56:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:10 smithi133 ceph-mon[37053]: pgmap v1243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1216.732526 secs 2024-07-26T08:56:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:10 smithi063 ceph-mon[36747]: pgmap v1243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1216.732526 secs 2024-07-26T08:56:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1232.218908 secs 2024-07-26T08:56:12.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1232.218908 secs 2024-07-26T08:56:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1232.218908 secs 2024-07-26T08:56:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:12 smithi043 ceph-mon[32384]: pgmap v1244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:12 smithi133 ceph-mon[37053]: pgmap v1244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:12 smithi063 ceph-mon[36747]: pgmap v1244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:14 smithi043 ceph-mon[32384]: pgmap v1245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:14 smithi133 ceph-mon[37053]: pgmap v1245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:15.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:14 smithi063 ceph-mon[36747]: pgmap v1245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1221.732662 secs 2024-07-26T08:56:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1221.732662 secs 2024-07-26T08:56:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1221.732662 secs 2024-07-26T08:56:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:16 smithi043 ceph-mon[32384]: pgmap v1246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1237.219048 secs 2024-07-26T08:56:17.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:16 smithi133 ceph-mon[37053]: pgmap v1246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1237.219048 secs 2024-07-26T08:56:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:16 smithi063 ceph-mon[36747]: pgmap v1246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1237.219048 secs 2024-07-26T08:56:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:56:18.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:56:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:56:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:18 smithi063 ceph-mon[36747]: pgmap v1247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:18.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:18 smithi043 ceph-mon[32384]: pgmap v1247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:18 smithi133 ceph-mon[37053]: pgmap v1247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:56:20.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:20 smithi043 ceph-mon[32384]: pgmap v1248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:20.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1226.732804 secs 2024-07-26T08:56:20.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1242.219119 secs 2024-07-26T08:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:20 smithi133 ceph-mon[37053]: pgmap v1248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1226.732804 secs 2024-07-26T08:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1242.219119 secs 2024-07-26T08:56:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:20 smithi063 ceph-mon[36747]: pgmap v1248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1226.732804 secs 2024-07-26T08:56:21.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1242.219119 secs 2024-07-26T08:56:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:22 smithi043 ceph-mon[32384]: pgmap v1249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:22 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:22 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:22 smithi133 ceph-mon[37053]: pgmap v1249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:22 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:22 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:22 smithi063 ceph-mon[36747]: pgmap v1249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:22 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:22 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:24.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: pgmap v1250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:24.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:24.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:24.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:56:24.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:24.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: pgmap v1250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:24.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:24.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:24.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:56:24.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: pgmap v1250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:56:25.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:56:25.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:56:25.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:56:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:25 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:56:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:25 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:56:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:25 smithi043 ceph-mon[32384]: pgmap v1251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:56:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:25 smithi043 ceph-mon[32384]: pgmap v1252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T08:56:25.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1231.732922 secs 2024-07-26T08:56:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:25 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:56:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:25 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:56:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:25 smithi133 ceph-mon[37053]: pgmap v1251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:56:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:25 smithi133 ceph-mon[37053]: pgmap v1252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T08:56:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1231.732922 secs 2024-07-26T08:56:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:25 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T08:56:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:25 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T08:56:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:25 smithi063 ceph-mon[36747]: pgmap v1251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:56:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:25 smithi063 ceph-mon[36747]: pgmap v1252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T08:56:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1231.732922 secs 2024-07-26T08:56:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1247.219189 secs 2024-07-26T08:56:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1247.219189 secs 2024-07-26T08:56:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1247.219189 secs 2024-07-26T08:56:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:27 smithi043 ceph-mon[32384]: pgmap v1253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:56:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:27 smithi133 ceph-mon[37053]: pgmap v1253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:56:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:27 smithi063 ceph-mon[36747]: pgmap v1253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:56:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:29 smithi043 ceph-mon[32384]: pgmap v1254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T08:56:30.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:29 smithi133 ceph-mon[37053]: pgmap v1254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T08:56:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:29 smithi063 ceph-mon[36747]: pgmap v1254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T08:56:30.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1236.733037 secs 2024-07-26T08:56:30.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1236.733037 secs 2024-07-26T08:56:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1236.733037 secs 2024-07-26T08:56:31.904 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:31 smithi043 ceph-mon[32384]: pgmap v1255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T08:56:31.904 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1252.219275 secs 2024-07-26T08:56:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:31 smithi133 ceph-mon[37053]: pgmap v1255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T08:56:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1252.219275 secs 2024-07-26T08:56:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:31 smithi063 ceph-mon[36747]: pgmap v1255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T08:56:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1252.219275 secs 2024-07-26T08:56:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:33 smithi043 ceph-mon[32384]: pgmap v1256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-07-26T08:56:34.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:33 smithi133 ceph-mon[37053]: pgmap v1256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-07-26T08:56:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:33 smithi063 ceph-mon[36747]: pgmap v1256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-07-26T08:56:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:35 smithi043 ceph-mon[32384]: pgmap v1257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:56:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1241.733145 secs 2024-07-26T08:56:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:35 smithi133 ceph-mon[37053]: pgmap v1257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:56:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1241.733145 secs 2024-07-26T08:56:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:35 smithi063 ceph-mon[36747]: pgmap v1257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:56:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1241.733145 secs 2024-07-26T08:56:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1257.219386 secs 2024-07-26T08:56:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1257.219386 secs 2024-07-26T08:56:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1257.219386 secs 2024-07-26T08:56:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:37 smithi043 ceph-mon[32384]: pgmap v1258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:37 smithi133 ceph-mon[37053]: pgmap v1258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:37 smithi063 ceph-mon[36747]: pgmap v1258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:39 smithi043 ceph-mon[32384]: pgmap v1259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:39 smithi133 ceph-mon[37053]: pgmap v1259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:39 smithi063 ceph-mon[36747]: pgmap v1259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1246.733260 secs 2024-07-26T08:56:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1246.733260 secs 2024-07-26T08:56:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1246.733260 secs 2024-07-26T08:56:41.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:41 smithi043 ceph-mon[32384]: pgmap v1260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:41.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1262.219527 secs 2024-07-26T08:56:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:41 smithi133 ceph-mon[37053]: pgmap v1260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1262.219527 secs 2024-07-26T08:56:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:41 smithi063 ceph-mon[36747]: pgmap v1260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1262.219527 secs 2024-07-26T08:56:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:43 smithi043 ceph-mon[32384]: pgmap v1261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:43 smithi133 ceph-mon[37053]: pgmap v1261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:44.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:43 smithi063 ceph-mon[36747]: pgmap v1261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:45 smithi043 ceph-mon[32384]: pgmap v1262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1251.733344 secs 2024-07-26T08:56:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:45 smithi133 ceph-mon[37053]: pgmap v1262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1251.733344 secs 2024-07-26T08:56:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:45 smithi063 ceph-mon[36747]: pgmap v1262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1251.733344 secs 2024-07-26T08:56:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1267.219662 secs 2024-07-26T08:56:47.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1267.219662 secs 2024-07-26T08:56:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1267.219662 secs 2024-07-26T08:56:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:47 smithi043 ceph-mon[32384]: pgmap v1263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:47 smithi133 ceph-mon[37053]: pgmap v1263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:47 smithi063 ceph-mon[36747]: pgmap v1263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:49 smithi043 ceph-mon[32384]: pgmap v1264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:49 smithi133 ceph-mon[37053]: pgmap v1264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:49 smithi063 ceph-mon[36747]: pgmap v1264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1256.733462 secs 2024-07-26T08:56:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1272.219777 secs 2024-07-26T08:56:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1256.733462 secs 2024-07-26T08:56:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1272.219777 secs 2024-07-26T08:56:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1256.733462 secs 2024-07-26T08:56:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1272.219777 secs 2024-07-26T08:56:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:51 smithi043 ceph-mon[32384]: pgmap v1265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:52.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:51 smithi133 ceph-mon[37053]: pgmap v1265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:51 smithi063 ceph-mon[36747]: pgmap v1265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:56:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:53 smithi043 ceph-mon[32384]: pgmap v1266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:53 smithi133 ceph-mon[37053]: pgmap v1266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:53 smithi063 ceph-mon[36747]: pgmap v1266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:55 smithi133 ceph-mon[37053]: pgmap v1267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1261.733584 secs 2024-07-26T08:56:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1277.219917 secs 2024-07-26T08:56:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:55 smithi063 ceph-mon[36747]: pgmap v1267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1261.733584 secs 2024-07-26T08:56:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1277.219917 secs 2024-07-26T08:56:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:55 smithi043 ceph-mon[32384]: pgmap v1267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:56:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1261.733584 secs 2024-07-26T08:56:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1277.219917 secs 2024-07-26T08:56:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:57 smithi133 ceph-mon[37053]: pgmap v1268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:57 smithi063 ceph-mon[36747]: pgmap v1268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:56:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:57 smithi043 ceph-mon[32384]: pgmap v1268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:56:59 smithi133 ceph-mon[37053]: pgmap v1269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:00.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:56:59 smithi043 ceph-mon[32384]: pgmap v1269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:56:59 smithi063 ceph-mon[36747]: pgmap v1269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1266.733703 secs 2024-07-26T08:57:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1282.219994 secs 2024-07-26T08:57:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1266.733703 secs 2024-07-26T08:57:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1282.219994 secs 2024-07-26T08:57:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1266.733703 secs 2024-07-26T08:57:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1282.219994 secs 2024-07-26T08:57:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:01 smithi133 ceph-mon[37053]: pgmap v1270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:01 smithi063 ceph-mon[36747]: pgmap v1270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:01 smithi043 ceph-mon[32384]: pgmap v1270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:03 smithi133 ceph-mon[37053]: pgmap v1271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:03 smithi063 ceph-mon[36747]: pgmap v1271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:03 smithi043 ceph-mon[32384]: pgmap v1271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:05 smithi063 ceph-mon[36747]: pgmap v1272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1271.733822 secs 2024-07-26T08:57:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1287.220060 secs 2024-07-26T08:57:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:05 smithi043 ceph-mon[32384]: pgmap v1272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1271.733822 secs 2024-07-26T08:57:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1287.220060 secs 2024-07-26T08:57:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:05 smithi133 ceph-mon[37053]: pgmap v1272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1271.733822 secs 2024-07-26T08:57:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1287.220060 secs 2024-07-26T08:57:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:07 smithi063 ceph-mon[36747]: pgmap v1273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:08.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:07 smithi043 ceph-mon[32384]: pgmap v1273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:08.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:07 smithi133 ceph-mon[37053]: pgmap v1273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:09 smithi063 ceph-mon[36747]: pgmap v1274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:09 smithi043 ceph-mon[32384]: pgmap v1274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:09 smithi133 ceph-mon[37053]: pgmap v1274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1276.733943 secs 2024-07-26T08:57:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1292.220217 secs 2024-07-26T08:57:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1276.733943 secs 2024-07-26T08:57:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1292.220217 secs 2024-07-26T08:57:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1276.733943 secs 2024-07-26T08:57:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1292.220217 secs 2024-07-26T08:57:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:11 smithi063 ceph-mon[36747]: pgmap v1275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:11 smithi043 ceph-mon[32384]: pgmap v1275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:11 smithi133 ceph-mon[37053]: pgmap v1275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:13 smithi063 ceph-mon[36747]: pgmap v1276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:13 smithi043 ceph-mon[32384]: pgmap v1276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:13 smithi133 ceph-mon[37053]: pgmap v1276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:14 smithi043 ceph-mon[32384]: pgmap v1277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:15.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:14 smithi133 ceph-mon[37053]: pgmap v1277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:14 smithi063 ceph-mon[36747]: pgmap v1277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1281.734061 secs 2024-07-26T08:57:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1297.220350 secs 2024-07-26T08:57:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1281.734061 secs 2024-07-26T08:57:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1297.220350 secs 2024-07-26T08:57:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1281.734061 secs 2024-07-26T08:57:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1297.220350 secs 2024-07-26T08:57:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:16 smithi043 ceph-mon[32384]: pgmap v1278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:16 smithi133 ceph-mon[37053]: pgmap v1278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:16 smithi063 ceph-mon[36747]: pgmap v1278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:18 smithi133 ceph-mon[37053]: pgmap v1279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:57:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:18 smithi063 ceph-mon[36747]: pgmap v1279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:57:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:18 smithi043 ceph-mon[32384]: pgmap v1279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:57:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:21 smithi133 ceph-mon[37053]: pgmap v1280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:57:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1286.734181 secs 2024-07-26T08:57:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1302.220491 secs 2024-07-26T08:57:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:21 smithi063 ceph-mon[36747]: pgmap v1280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:57:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1286.734181 secs 2024-07-26T08:57:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1302.220491 secs 2024-07-26T08:57:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:21 smithi043 ceph-mon[32384]: pgmap v1280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:57:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1286.734181 secs 2024-07-26T08:57:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1302.220491 secs 2024-07-26T08:57:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:23 smithi043 ceph-mon[32384]: pgmap v1281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:23 smithi133 ceph-mon[37053]: pgmap v1281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:23 smithi063 ceph-mon[36747]: pgmap v1281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: pgmap v1282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:57:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:57:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:57:25.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:25 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: pgmap v1282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:57:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:25 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:57:25.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: pgmap v1282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T08:57:25.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:25 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T08:57:26.279 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1291.734272 secs 2024-07-26T08:57:26.280 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1307.220599 secs 2024-07-26T08:57:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1291.734272 secs 2024-07-26T08:57:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1307.220599 secs 2024-07-26T08:57:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1291.734272 secs 2024-07-26T08:57:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1307.220599 secs 2024-07-26T08:57:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:27 smithi063 ceph-mon[36747]: pgmap v1283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:27.458 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:27 smithi133 ceph-mon[37053]: pgmap v1283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:27 smithi043 ceph-mon[32384]: pgmap v1283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: pgmap v1284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: pgmap v1285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: pgmap v1286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:57:29.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: pgmap v1284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: pgmap v1285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: pgmap v1286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:57:29.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: pgmap v1284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: pgmap v1285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: pgmap v1286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T08:57:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:57:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:31 smithi063 ceph-mon[36747]: pgmap v1287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:57:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1296.734354 secs 2024-07-26T08:57:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1312.220750 secs 2024-07-26T08:57:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:31 smithi043 ceph-mon[32384]: pgmap v1287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:57:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1296.734354 secs 2024-07-26T08:57:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1312.220750 secs 2024-07-26T08:57:31.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:31 smithi133 ceph-mon[37053]: pgmap v1287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:57:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1296.734354 secs 2024-07-26T08:57:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1312.220750 secs 2024-07-26T08:57:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:33 smithi063 ceph-mon[36747]: pgmap v1288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:57:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:33 smithi043 ceph-mon[32384]: pgmap v1288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:57:33.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:33 smithi133 ceph-mon[37053]: pgmap v1288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:57:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:35 smithi063 ceph-mon[36747]: pgmap v1289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:57:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:35 smithi043 ceph-mon[32384]: pgmap v1289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:57:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:35 smithi133 ceph-mon[37053]: pgmap v1289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T08:57:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1301.734484 secs 2024-07-26T08:57:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1317.220896 secs 2024-07-26T08:57:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1301.734484 secs 2024-07-26T08:57:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1317.220896 secs 2024-07-26T08:57:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1301.734484 secs 2024-07-26T08:57:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1317.220896 secs 2024-07-26T08:57:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:37 smithi063 ceph-mon[36747]: pgmap v1290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:57:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:37 smithi043 ceph-mon[32384]: pgmap v1290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:57:37.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:37 smithi133 ceph-mon[37053]: pgmap v1290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T08:57:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:39 smithi043 ceph-mon[32384]: pgmap v1291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:39 smithi133 ceph-mon[37053]: pgmap v1291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:39 smithi063 ceph-mon[36747]: pgmap v1291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:57:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:41 smithi043 ceph-mon[32384]: pgmap v1292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1306.734616 secs 2024-07-26T08:57:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1322.220972 secs 2024-07-26T08:57:41.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:41 smithi133 ceph-mon[37053]: pgmap v1292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1306.734616 secs 2024-07-26T08:57:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1322.220972 secs 2024-07-26T08:57:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:41 smithi063 ceph-mon[36747]: pgmap v1292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1306.734616 secs 2024-07-26T08:57:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1322.220972 secs 2024-07-26T08:57:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:43 smithi043 ceph-mon[32384]: pgmap v1293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:43.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:43 smithi133 ceph-mon[37053]: pgmap v1293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:43 smithi063 ceph-mon[36747]: pgmap v1293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:45 smithi043 ceph-mon[32384]: pgmap v1294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:45.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:45 smithi133 ceph-mon[37053]: pgmap v1294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:45 smithi063 ceph-mon[36747]: pgmap v1294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1311.734738 secs 2024-07-26T08:57:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1327.221117 secs 2024-07-26T08:57:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1311.734738 secs 2024-07-26T08:57:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1327.221117 secs 2024-07-26T08:57:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1311.734738 secs 2024-07-26T08:57:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1327.221117 secs 2024-07-26T08:57:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:47 smithi043 ceph-mon[32384]: pgmap v1295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:47 smithi133 ceph-mon[37053]: pgmap v1295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:47 smithi063 ceph-mon[36747]: pgmap v1295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:49 smithi043 ceph-mon[32384]: pgmap v1296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:49 smithi133 ceph-mon[37053]: pgmap v1296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:49 smithi063 ceph-mon[36747]: pgmap v1296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:51 smithi043 ceph-mon[32384]: pgmap v1297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1316.734845 secs 2024-07-26T08:57:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1332.221206 secs 2024-07-26T08:57:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:51 smithi133 ceph-mon[37053]: pgmap v1297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1316.734845 secs 2024-07-26T08:57:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1332.221206 secs 2024-07-26T08:57:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:51 smithi063 ceph-mon[36747]: pgmap v1297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:57:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1316.734845 secs 2024-07-26T08:57:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1332.221206 secs 2024-07-26T08:57:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:53 smithi043 ceph-mon[32384]: pgmap v1298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:53 smithi133 ceph-mon[37053]: pgmap v1298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:53 smithi063 ceph-mon[36747]: pgmap v1298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:55 smithi043 ceph-mon[32384]: pgmap v1299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:55 smithi133 ceph-mon[37053]: pgmap v1299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:55 smithi063 ceph-mon[36747]: pgmap v1299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1321.734983 secs 2024-07-26T08:57:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1337.221326 secs 2024-07-26T08:57:56.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1321.734983 secs 2024-07-26T08:57:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1337.221326 secs 2024-07-26T08:57:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1321.734983 secs 2024-07-26T08:57:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1337.221326 secs 2024-07-26T08:57:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:57 smithi043 ceph-mon[32384]: pgmap v1300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:57.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:57 smithi133 ceph-mon[37053]: pgmap v1300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:57 smithi063 ceph-mon[36747]: pgmap v1300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:57:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:57:59 smithi043 ceph-mon[32384]: pgmap v1301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:59.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:57:59 smithi133 ceph-mon[37053]: pgmap v1301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:57:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:57:59 smithi063 ceph-mon[36747]: pgmap v1301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:01 smithi043 ceph-mon[32384]: pgmap v1302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1326.735115 secs 2024-07-26T08:58:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1342.221400 secs 2024-07-26T08:58:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:01 smithi133 ceph-mon[37053]: pgmap v1302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1326.735115 secs 2024-07-26T08:58:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1342.221400 secs 2024-07-26T08:58:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:01 smithi063 ceph-mon[36747]: pgmap v1302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1326.735115 secs 2024-07-26T08:58:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1342.221400 secs 2024-07-26T08:58:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:03 smithi043 ceph-mon[32384]: pgmap v1303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:03 smithi133 ceph-mon[37053]: pgmap v1303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:03 smithi063 ceph-mon[36747]: pgmap v1303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:05 smithi043 ceph-mon[32384]: pgmap v1304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:05 smithi133 ceph-mon[37053]: pgmap v1304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:05 smithi063 ceph-mon[36747]: pgmap v1304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1331.735223 secs 2024-07-26T08:58:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1347.221516 secs 2024-07-26T08:58:06.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1331.735223 secs 2024-07-26T08:58:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1347.221516 secs 2024-07-26T08:58:06.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1331.735223 secs 2024-07-26T08:58:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1347.221516 secs 2024-07-26T08:58:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:07 smithi043 ceph-mon[32384]: pgmap v1305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:07 smithi133 ceph-mon[37053]: pgmap v1305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:07 smithi063 ceph-mon[36747]: pgmap v1305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:09 smithi043 ceph-mon[32384]: pgmap v1306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:09 smithi133 ceph-mon[37053]: pgmap v1306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:09 smithi063 ceph-mon[36747]: pgmap v1306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:11 smithi043 ceph-mon[32384]: pgmap v1307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1336.735290 secs 2024-07-26T08:58:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1352.221653 secs 2024-07-26T08:58:11.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:11 smithi133 ceph-mon[37053]: pgmap v1307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1336.735290 secs 2024-07-26T08:58:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1352.221653 secs 2024-07-26T08:58:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:11 smithi063 ceph-mon[36747]: pgmap v1307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1336.735290 secs 2024-07-26T08:58:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1352.221653 secs 2024-07-26T08:58:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:13 smithi043 ceph-mon[32384]: pgmap v1308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:13 smithi133 ceph-mon[37053]: pgmap v1308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:13 smithi063 ceph-mon[36747]: pgmap v1308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:15 smithi043 ceph-mon[32384]: pgmap v1309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:15 smithi133 ceph-mon[37053]: pgmap v1309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:15 smithi063 ceph-mon[36747]: pgmap v1309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1341.735410 secs 2024-07-26T08:58:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1357.221717 secs 2024-07-26T08:58:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1341.735410 secs 2024-07-26T08:58:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1357.221717 secs 2024-07-26T08:58:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1341.735410 secs 2024-07-26T08:58:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1357.221717 secs 2024-07-26T08:58:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:17 smithi043 ceph-mon[32384]: pgmap v1310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:17 smithi133 ceph-mon[37053]: pgmap v1310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:17 smithi063 ceph-mon[36747]: pgmap v1310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:19 smithi043 ceph-mon[32384]: pgmap v1311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:19.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:19 smithi133 ceph-mon[37053]: pgmap v1311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:19 smithi063 ceph-mon[36747]: pgmap v1311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:21 smithi043 ceph-mon[32384]: pgmap v1312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1346.735478 secs 2024-07-26T08:58:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1362.221781 secs 2024-07-26T08:58:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:21 smithi133 ceph-mon[37053]: pgmap v1312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1346.735478 secs 2024-07-26T08:58:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1362.221781 secs 2024-07-26T08:58:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:21 smithi063 ceph-mon[36747]: pgmap v1312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1346.735478 secs 2024-07-26T08:58:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1362.221781 secs 2024-07-26T08:58:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:23 smithi043 ceph-mon[32384]: pgmap v1313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:23 smithi133 ceph-mon[37053]: pgmap v1313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:23 smithi063 ceph-mon[36747]: pgmap v1313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:25 smithi133 ceph-mon[37053]: pgmap v1314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:25 smithi063 ceph-mon[36747]: pgmap v1314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:25 smithi043 ceph-mon[32384]: pgmap v1314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1351.735600 secs 2024-07-26T08:58:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1367.221846 secs 2024-07-26T08:58:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1351.735600 secs 2024-07-26T08:58:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1367.221846 secs 2024-07-26T08:58:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1351.735600 secs 2024-07-26T08:58:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1367.221846 secs 2024-07-26T08:58:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:27 smithi133 ceph-mon[37053]: pgmap v1315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:27 smithi063 ceph-mon[36747]: pgmap v1315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:27 smithi043 ceph-mon[32384]: pgmap v1315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:28.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:58:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:58:28.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:58:29.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:29 smithi133 ceph-mon[37053]: pgmap v1316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:29.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:29 smithi063 ceph-mon[36747]: pgmap v1316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:29 smithi043 ceph-mon[32384]: pgmap v1316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:58:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:58:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:30 smithi063 ceph-mon[36747]: pgmap v1317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:58:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:30 smithi063 ceph-mon[36747]: pgmap v1318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:58:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:58:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:58:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:58:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:30 smithi043 ceph-mon[32384]: pgmap v1317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:58:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:30 smithi043 ceph-mon[32384]: pgmap v1318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:58:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:58:30.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:58:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:58:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:30 smithi133 ceph-mon[37053]: pgmap v1317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T08:58:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:30 smithi133 ceph-mon[37053]: pgmap v1318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:58:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:58:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1356.735722 secs 2024-07-26T08:58:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1372.221919 secs 2024-07-26T08:58:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1356.735722 secs 2024-07-26T08:58:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1372.221919 secs 2024-07-26T08:58:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1356.735722 secs 2024-07-26T08:58:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1372.221919 secs 2024-07-26T08:58:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:32 smithi063 ceph-mon[36747]: pgmap v1319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:58:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:32 smithi043 ceph-mon[32384]: pgmap v1319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:58:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:32 smithi133 ceph-mon[37053]: pgmap v1319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T08:58:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:34 smithi063 ceph-mon[36747]: pgmap v1320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:58:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:34 smithi043 ceph-mon[32384]: pgmap v1320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:58:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:34 smithi133 ceph-mon[37053]: pgmap v1320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T08:58:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1361.735801 secs 2024-07-26T08:58:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:36 smithi063 ceph-mon[36747]: pgmap v1321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:58:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1377.221983 secs 2024-07-26T08:58:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1361.735801 secs 2024-07-26T08:58:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:36 smithi043 ceph-mon[32384]: pgmap v1321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:58:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1377.221983 secs 2024-07-26T08:58:36.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1361.735801 secs 2024-07-26T08:58:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:36 smithi133 ceph-mon[37053]: pgmap v1321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:58:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1377.221983 secs 2024-07-26T08:58:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:38 smithi063 ceph-mon[36747]: pgmap v1322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:58:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:38 smithi043 ceph-mon[32384]: pgmap v1322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:58:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:38 smithi133 ceph-mon[37053]: pgmap v1322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T08:58:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:40 smithi063 ceph-mon[36747]: pgmap v1323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:58:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:40 smithi043 ceph-mon[32384]: pgmap v1323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:58:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:40 smithi133 ceph-mon[37053]: pgmap v1323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:58:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1366.735959 secs 2024-07-26T08:58:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1382.222054 secs 2024-07-26T08:58:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1366.735959 secs 2024-07-26T08:58:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1382.222054 secs 2024-07-26T08:58:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1366.735959 secs 2024-07-26T08:58:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1382.222054 secs 2024-07-26T08:58:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:42 smithi043 ceph-mon[32384]: pgmap v1324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:42.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:42 smithi133 ceph-mon[37053]: pgmap v1324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:42 smithi063 ceph-mon[36747]: pgmap v1324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:44 smithi043 ceph-mon[32384]: pgmap v1325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:44.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:44 smithi133 ceph-mon[37053]: pgmap v1325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:44 smithi063 ceph-mon[36747]: pgmap v1325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1371.736044 secs 2024-07-26T08:58:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1371.736044 secs 2024-07-26T08:58:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1371.736044 secs 2024-07-26T08:58:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:46 smithi043 ceph-mon[32384]: pgmap v1326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1387.222118 secs 2024-07-26T08:58:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:46 smithi133 ceph-mon[37053]: pgmap v1326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1387.222118 secs 2024-07-26T08:58:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:46 smithi063 ceph-mon[36747]: pgmap v1326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1387.222118 secs 2024-07-26T08:58:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:48 smithi043 ceph-mon[32384]: pgmap v1327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:48 smithi133 ceph-mon[37053]: pgmap v1327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:48 smithi063 ceph-mon[36747]: pgmap v1327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:50 smithi043 ceph-mon[32384]: pgmap v1328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1376.736166 secs 2024-07-26T08:58:50.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:50 smithi133 ceph-mon[37053]: pgmap v1328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1376.736166 secs 2024-07-26T08:58:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:50 smithi063 ceph-mon[36747]: pgmap v1328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1376.736166 secs 2024-07-26T08:58:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1392.222181 secs 2024-07-26T08:58:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1392.222181 secs 2024-07-26T08:58:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1392.222181 secs 2024-07-26T08:58:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:52 smithi043 ceph-mon[32384]: pgmap v1329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:52 smithi133 ceph-mon[37053]: pgmap v1329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:52 smithi063 ceph-mon[36747]: pgmap v1329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:58:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:54 smithi043 ceph-mon[32384]: pgmap v1330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:54 smithi133 ceph-mon[37053]: pgmap v1330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:54 smithi063 ceph-mon[36747]: pgmap v1330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:55.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1381.736257 secs 2024-07-26T08:58:55.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1381.736257 secs 2024-07-26T08:58:55.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1381.736257 secs 2024-07-26T08:58:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:56 smithi043 ceph-mon[32384]: pgmap v1331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1397.222245 secs 2024-07-26T08:58:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:56 smithi133 ceph-mon[37053]: pgmap v1331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1397.222245 secs 2024-07-26T08:58:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:56 smithi063 ceph-mon[36747]: pgmap v1331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:58:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1397.222245 secs 2024-07-26T08:58:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:58:58 smithi043 ceph-mon[32384]: pgmap v1332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:58:58 smithi133 ceph-mon[37053]: pgmap v1332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:58:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:58:58 smithi063 ceph-mon[36747]: pgmap v1332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:00 smithi043 ceph-mon[32384]: pgmap v1333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1386.736377 secs 2024-07-26T08:59:00.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:00 smithi133 ceph-mon[37053]: pgmap v1333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1386.736377 secs 2024-07-26T08:59:00.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:00 smithi063 ceph-mon[36747]: pgmap v1333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1386.736377 secs 2024-07-26T08:59:01.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1402.222309 secs 2024-07-26T08:59:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1402.222309 secs 2024-07-26T08:59:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1402.222309 secs 2024-07-26T08:59:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:02 smithi043 ceph-mon[32384]: pgmap v1334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:02.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:02 smithi133 ceph-mon[37053]: pgmap v1334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:02.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:02 smithi063 ceph-mon[36747]: pgmap v1334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:04 smithi043 ceph-mon[32384]: pgmap v1335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:04 smithi133 ceph-mon[37053]: pgmap v1335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:04 smithi063 ceph-mon[36747]: pgmap v1335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1391.736501 secs 2024-07-26T08:59:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1391.736501 secs 2024-07-26T08:59:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1391.736501 secs 2024-07-26T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:06 smithi043 ceph-mon[32384]: pgmap v1336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1407.222381 secs 2024-07-26T08:59:06.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:06 smithi133 ceph-mon[37053]: pgmap v1336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1407.222381 secs 2024-07-26T08:59:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:06 smithi063 ceph-mon[36747]: pgmap v1336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1407.222381 secs 2024-07-26T08:59:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:08 smithi043 ceph-mon[32384]: pgmap v1337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:08 smithi133 ceph-mon[37053]: pgmap v1337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:08 smithi063 ceph-mon[36747]: pgmap v1337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:10 smithi043 ceph-mon[32384]: pgmap v1338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1396.736641 secs 2024-07-26T08:59:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:10 smithi133 ceph-mon[37053]: pgmap v1338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1396.736641 secs 2024-07-26T08:59:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:10 smithi063 ceph-mon[36747]: pgmap v1338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1396.736641 secs 2024-07-26T08:59:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1412.222505 secs 2024-07-26T08:59:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1412.222505 secs 2024-07-26T08:59:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1412.222505 secs 2024-07-26T08:59:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:12 smithi043 ceph-mon[32384]: pgmap v1339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:12.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:12 smithi133 ceph-mon[37053]: pgmap v1339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:12 smithi063 ceph-mon[36747]: pgmap v1339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:14 smithi043 ceph-mon[32384]: pgmap v1340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:14 smithi133 ceph-mon[37053]: pgmap v1340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:14 smithi063 ceph-mon[36747]: pgmap v1340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1401.736797 secs 2024-07-26T08:59:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1401.736797 secs 2024-07-26T08:59:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1401.736797 secs 2024-07-26T08:59:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:16 smithi133 ceph-mon[37053]: pgmap v1341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1417.222571 secs 2024-07-26T08:59:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:16 smithi063 ceph-mon[36747]: pgmap v1341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1417.222571 secs 2024-07-26T08:59:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:16 smithi043 ceph-mon[32384]: pgmap v1341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1417.222571 secs 2024-07-26T08:59:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:18 smithi133 ceph-mon[37053]: pgmap v1342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:18 smithi063 ceph-mon[36747]: pgmap v1342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:18 smithi043 ceph-mon[32384]: pgmap v1342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:20 smithi133 ceph-mon[37053]: pgmap v1343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1406.736925 secs 2024-07-26T08:59:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:20 smithi063 ceph-mon[36747]: pgmap v1343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1406.736925 secs 2024-07-26T08:59:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:20 smithi043 ceph-mon[32384]: pgmap v1343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1406.736925 secs 2024-07-26T08:59:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1422.222723 secs 2024-07-26T08:59:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1422.222723 secs 2024-07-26T08:59:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1422.222723 secs 2024-07-26T08:59:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:22 smithi063 ceph-mon[36747]: pgmap v1344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:22 smithi043 ceph-mon[32384]: pgmap v1344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:22 smithi133 ceph-mon[37053]: pgmap v1344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:24 smithi063 ceph-mon[36747]: pgmap v1345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:24 smithi043 ceph-mon[32384]: pgmap v1345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:24 smithi133 ceph-mon[37053]: pgmap v1345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1411.737053 secs 2024-07-26T08:59:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1411.737053 secs 2024-07-26T08:59:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1411.737053 secs 2024-07-26T08:59:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:26 smithi063 ceph-mon[36747]: pgmap v1346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1427.222875 secs 2024-07-26T08:59:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:26 smithi043 ceph-mon[32384]: pgmap v1346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1427.222875 secs 2024-07-26T08:59:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:26 smithi133 ceph-mon[37053]: pgmap v1346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1427.222875 secs 2024-07-26T08:59:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:28 smithi063 ceph-mon[36747]: pgmap v1347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:28 smithi043 ceph-mon[32384]: pgmap v1347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:28 smithi133 ceph-mon[37053]: pgmap v1347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:59:29.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:59:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T08:59:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:30 smithi063 ceph-mon[36747]: pgmap v1348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1416.737177 secs 2024-07-26T08:59:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:30 smithi043 ceph-mon[32384]: pgmap v1348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1416.737177 secs 2024-07-26T08:59:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:30 smithi133 ceph-mon[37053]: pgmap v1348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1416.737177 secs 2024-07-26T08:59:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1432.222990 secs 2024-07-26T08:59:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:59:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:59:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1432.222990 secs 2024-07-26T08:59:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:59:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:59:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1432.222990 secs 2024-07-26T08:59:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T08:59:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T08:59:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T08:59:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:32 smithi043 ceph-mon[32384]: pgmap v1349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:32 smithi043 ceph-mon[32384]: pgmap v1350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:32 smithi133 ceph-mon[37053]: pgmap v1349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:32 smithi133 ceph-mon[37053]: pgmap v1350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:32 smithi063 ceph-mon[36747]: pgmap v1349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:32 smithi063 ceph-mon[36747]: pgmap v1350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:34 smithi043 ceph-mon[32384]: pgmap v1351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:35.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:34 smithi133 ceph-mon[37053]: pgmap v1351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:34 smithi063 ceph-mon[36747]: pgmap v1351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1421.737305 secs 2024-07-26T08:59:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1421.737305 secs 2024-07-26T08:59:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1421.737305 secs 2024-07-26T08:59:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:36 smithi043 ceph-mon[32384]: pgmap v1352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1437.223111 secs 2024-07-26T08:59:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:36 smithi133 ceph-mon[37053]: pgmap v1352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1437.223111 secs 2024-07-26T08:59:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:36 smithi063 ceph-mon[36747]: pgmap v1352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1437.223111 secs 2024-07-26T08:59:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:38 smithi043 ceph-mon[32384]: pgmap v1353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:38 smithi133 ceph-mon[37053]: pgmap v1353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:38 smithi063 ceph-mon[36747]: pgmap v1353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:40 smithi043 ceph-mon[32384]: pgmap v1354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1426.737445 secs 2024-07-26T08:59:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:40 smithi133 ceph-mon[37053]: pgmap v1354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1426.737445 secs 2024-07-26T08:59:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:40 smithi063 ceph-mon[36747]: pgmap v1354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T08:59:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1426.737445 secs 2024-07-26T08:59:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:41 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 1442.223175 secs 2024-07-26T08:59:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:41 smithi043 ceph-mon[32384]: slow request 1442.223174 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:59:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:41 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 1442.223175 secs 2024-07-26T08:59:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:41 smithi133 ceph-mon[37053]: slow request 1442.223174 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:59:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:41 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 1442.223175 secs 2024-07-26T08:59:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:41 smithi063 ceph-mon[36747]: slow request 1442.223174 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T08:59:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:42 smithi043 ceph-mon[32384]: pgmap v1355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:59:43.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:42 smithi133 ceph-mon[37053]: pgmap v1355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:59:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:42 smithi063 ceph-mon[36747]: pgmap v1355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T08:59:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:44 smithi043 ceph-mon[32384]: pgmap v1356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:44 smithi133 ceph-mon[37053]: pgmap v1356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:44 smithi063 ceph-mon[36747]: pgmap v1356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1431.737575 secs 2024-07-26T08:59:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1431.737575 secs 2024-07-26T08:59:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1431.737575 secs 2024-07-26T08:59:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:46 smithi043 ceph-mon[32384]: pgmap v1357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1447.223278 secs 2024-07-26T08:59:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:46 smithi133 ceph-mon[37053]: pgmap v1357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1447.223278 secs 2024-07-26T08:59:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:46 smithi063 ceph-mon[36747]: pgmap v1357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1447.223278 secs 2024-07-26T08:59:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:48 smithi043 ceph-mon[32384]: pgmap v1358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:49.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:48 smithi133 ceph-mon[37053]: pgmap v1358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:48 smithi063 ceph-mon[36747]: pgmap v1358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:50 smithi043 ceph-mon[32384]: pgmap v1359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1436.737714 secs 2024-07-26T08:59:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:50 smithi133 ceph-mon[37053]: pgmap v1359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1436.737714 secs 2024-07-26T08:59:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:50 smithi063 ceph-mon[36747]: pgmap v1359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1436.737714 secs 2024-07-26T08:59:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1452.223357 secs 2024-07-26T08:59:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1452.223357 secs 2024-07-26T08:59:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1452.223357 secs 2024-07-26T08:59:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:52 smithi043 ceph-mon[32384]: pgmap v1360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:52 smithi133 ceph-mon[37053]: pgmap v1360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:52 smithi063 ceph-mon[36747]: pgmap v1360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T08:59:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:54 smithi043 ceph-mon[32384]: pgmap v1361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:54 smithi133 ceph-mon[37053]: pgmap v1361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:54 smithi063 ceph-mon[36747]: pgmap v1361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:55.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:55 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 1441.737816 secs 2024-07-26T08:59:55.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:55 smithi063 ceph-mon[36747]: slow request 1441.737815 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:59:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:55 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 1441.737816 secs 2024-07-26T08:59:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:55 smithi043 ceph-mon[32384]: slow request 1441.737815 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:59:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:55 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 1441.737816 secs 2024-07-26T08:59:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:55 smithi133 ceph-mon[37053]: slow request 1441.737815 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T08:59:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:56 smithi043 ceph-mon[32384]: pgmap v1362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1457.223469 secs 2024-07-26T08:59:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:56 smithi133 ceph-mon[37053]: pgmap v1362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1457.223469 secs 2024-07-26T08:59:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:56 smithi063 ceph-mon[36747]: pgmap v1362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T08:59:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1457.223469 secs 2024-07-26T08:59:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 08:59:58 smithi043 ceph-mon[32384]: pgmap v1363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 08:59:58 smithi133 ceph-mon[37053]: pgmap v1363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T08:59:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 08:59:58 smithi063 ceph-mon[36747]: pgmap v1363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: pgmap v1364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.j on smithi043 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.d on smithi043 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.g on smithi043 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.k on smithi063 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.e on smithi063 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.h on smithi063 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.b on smithi063 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: daemon mds.l on smithi133 is in error state 2024-07-26T09:00:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-07-26T09:00:00.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: mds.c(mds.0): 3 slow requests are blocked > 180 secs 2024-07-26T09:00:00.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: mds.i(mds.2): 1 slow requests are blocked > 180 secs 2024-07-26T09:00:00.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1446.737902 secs 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: pgmap v1364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.j on smithi043 is in error state 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.d on smithi043 is in error state 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.g on smithi043 is in error state 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.k on smithi063 is in error state 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.e on smithi063 is in error state 2024-07-26T09:00:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.h on smithi063 is in error state 2024-07-26T09:00:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.b on smithi063 is in error state 2024-07-26T09:00:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: daemon mds.l on smithi133 is in error state 2024-07-26T09:00:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-07-26T09:00:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: mds.c(mds.0): 3 slow requests are blocked > 180 secs 2024-07-26T09:00:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: mds.i(mds.2): 1 slow requests are blocked > 180 secs 2024-07-26T09:00:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1446.737902 secs 2024-07-26T09:00:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: pgmap v1364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:00:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T09:00:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.j on smithi043 is in error state 2024-07-26T09:00:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.d on smithi043 is in error state 2024-07-26T09:00:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.g on smithi043 is in error state 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.k on smithi063 is in error state 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.e on smithi063 is in error state 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.h on smithi063 is in error state 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.b on smithi063 is in error state 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: daemon mds.l on smithi133 is in error state 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: mds.c(mds.0): 3 slow requests are blocked > 180 secs 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: mds.i(mds.2): 1 slow requests are blocked > 180 secs 2024-07-26T09:00:01.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1446.737902 secs 2024-07-26T09:00:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1462.223622 secs 2024-07-26T09:00:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1462.223622 secs 2024-07-26T09:00:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1462.223622 secs 2024-07-26T09:00:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:02 smithi043 ceph-mon[32384]: pgmap v1365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:02 smithi133 ceph-mon[37053]: pgmap v1365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:02 smithi063 ceph-mon[36747]: pgmap v1365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:04 smithi043 ceph-mon[32384]: pgmap v1366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:04 smithi133 ceph-mon[37053]: pgmap v1366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:04 smithi063 ceph-mon[36747]: pgmap v1366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:05 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 1451.737980 secs 2024-07-26T09:00:06.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:05 smithi133 ceph-mon[37053]: slow request 1444.430993 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T09:00:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:05 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 1451.737980 secs 2024-07-26T09:00:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:05 smithi063 ceph-mon[36747]: slow request 1444.430993 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T09:00:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:05 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 1451.737980 secs 2024-07-26T09:00:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:05 smithi043 ceph-mon[32384]: slow request 1444.430993 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T09:00:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:06 smithi133 ceph-mon[37053]: pgmap v1367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1467.223737 secs 2024-07-26T09:00:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:06 smithi063 ceph-mon[36747]: pgmap v1367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1467.223737 secs 2024-07-26T09:00:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:06 smithi043 ceph-mon[32384]: pgmap v1367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1467.223737 secs 2024-07-26T09:00:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:08 smithi133 ceph-mon[37053]: pgmap v1368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:08 smithi063 ceph-mon[36747]: pgmap v1368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:09.092 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:08 smithi043 ceph-mon[32384]: pgmap v1368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:10 smithi133 ceph-mon[37053]: pgmap v1369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1456.738118 secs 2024-07-26T09:00:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1472.223881 secs 2024-07-26T09:00:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:10 smithi063 ceph-mon[36747]: pgmap v1369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1456.738118 secs 2024-07-26T09:00:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1472.223881 secs 2024-07-26T09:00:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:10 smithi043 ceph-mon[32384]: pgmap v1369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1456.738118 secs 2024-07-26T09:00:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1472.223881 secs 2024-07-26T09:00:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:12 smithi133 ceph-mon[37053]: pgmap v1370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:12 smithi063 ceph-mon[36747]: pgmap v1370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:12 smithi043 ceph-mon[32384]: pgmap v1370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:14 smithi133 ceph-mon[37053]: pgmap v1371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:14 smithi063 ceph-mon[36747]: pgmap v1371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:14 smithi043 ceph-mon[32384]: pgmap v1371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1461.738231 secs 2024-07-26T09:00:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1477.223957 secs 2024-07-26T09:00:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1461.738231 secs 2024-07-26T09:00:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1477.223957 secs 2024-07-26T09:00:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1461.738231 secs 2024-07-26T09:00:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1477.223957 secs 2024-07-26T09:00:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:16 smithi063 ceph-mon[36747]: pgmap v1372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:16 smithi043 ceph-mon[32384]: pgmap v1372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:16 smithi133 ceph-mon[37053]: pgmap v1372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:18 smithi063 ceph-mon[36747]: pgmap v1373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:18 smithi043 ceph-mon[32384]: pgmap v1373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:18 smithi133 ceph-mon[37053]: pgmap v1373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:20 smithi063 ceph-mon[36747]: pgmap v1374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1466.738352 secs 2024-07-26T09:00:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1482.224022 secs 2024-07-26T09:00:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:20 smithi043 ceph-mon[32384]: pgmap v1374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1466.738352 secs 2024-07-26T09:00:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1482.224022 secs 2024-07-26T09:00:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:20 smithi133 ceph-mon[37053]: pgmap v1374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1466.738352 secs 2024-07-26T09:00:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1482.224022 secs 2024-07-26T09:00:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:22 smithi063 ceph-mon[36747]: pgmap v1375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:22 smithi043 ceph-mon[32384]: pgmap v1375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:23.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:22 smithi133 ceph-mon[37053]: pgmap v1375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:24 smithi063 ceph-mon[36747]: pgmap v1376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:24 smithi043 ceph-mon[32384]: pgmap v1376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:25.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:24 smithi133 ceph-mon[37053]: pgmap v1376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1471.738475 secs 2024-07-26T09:00:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1487.224153 secs 2024-07-26T09:00:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1471.738475 secs 2024-07-26T09:00:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1487.224153 secs 2024-07-26T09:00:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1471.738475 secs 2024-07-26T09:00:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1487.224153 secs 2024-07-26T09:00:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:26 smithi063 ceph-mon[36747]: pgmap v1377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:26 smithi043 ceph-mon[32384]: pgmap v1377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:26 smithi133 ceph-mon[37053]: pgmap v1377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:28 smithi043 ceph-mon[32384]: pgmap v1378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:28 smithi133 ceph-mon[37053]: pgmap v1378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:28 smithi063 ceph-mon[36747]: pgmap v1378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:31.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:30 smithi043 ceph-mon[32384]: pgmap v1379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:31.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1476.738595 secs 2024-07-26T09:00:31.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1492.224254 secs 2024-07-26T09:00:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:30 smithi133 ceph-mon[37053]: pgmap v1379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1476.738595 secs 2024-07-26T09:00:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1492.224254 secs 2024-07-26T09:00:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:30 smithi063 ceph-mon[36747]: pgmap v1379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1476.738595 secs 2024-07-26T09:00:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1492.224254 secs 2024-07-26T09:00:32.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:00:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:00:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:00:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:32 smithi043 ceph-mon[32384]: pgmap v1380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:32 smithi133 ceph-mon[37053]: pgmap v1380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:32 smithi063 ceph-mon[36747]: pgmap v1380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:33.344 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.345 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.345 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:33.345 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:34 smithi043 ceph-mon[32384]: pgmap v1381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:34.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:34.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:34 smithi133 ceph-mon[37053]: pgmap v1381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:34 smithi063 ceph-mon[36747]: pgmap v1381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1481.738677 secs 2024-07-26T09:00:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:36.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1481.738677 secs 2024-07-26T09:00:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1481.738677 secs 2024-07-26T09:00:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:36 smithi043 ceph-mon[32384]: pgmap v1382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1497.224376 secs 2024-07-26T09:00:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:36 smithi133 ceph-mon[37053]: pgmap v1382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1497.224376 secs 2024-07-26T09:00:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:36 smithi063 ceph-mon[36747]: pgmap v1382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1497.224376 secs 2024-07-26T09:00:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:00:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:00:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:37 smithi043 ceph-mon[32384]: pgmap v1383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:00:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:37 smithi043 ceph-mon[32384]: pgmap v1384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:00:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:00:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:00:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:37 smithi133 ceph-mon[37053]: pgmap v1383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:00:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:37 smithi133 ceph-mon[37053]: pgmap v1384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:00:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:00:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:00:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:37 smithi063 ceph-mon[36747]: pgmap v1383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:00:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:37 smithi063 ceph-mon[36747]: pgmap v1384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:00:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:00:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:39 smithi043 ceph-mon[32384]: pgmap v1385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:39 smithi133 ceph-mon[37053]: pgmap v1385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:39 smithi063 ceph-mon[36747]: pgmap v1385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1486.738888 secs 2024-07-26T09:00:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1486.738888 secs 2024-07-26T09:00:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1486.738888 secs 2024-07-26T09:00:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1502.224477 secs 2024-07-26T09:00:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:41 smithi043 ceph-mon[32384]: pgmap v1386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:42.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1502.224477 secs 2024-07-26T09:00:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:41 smithi133 ceph-mon[37053]: pgmap v1386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1502.224477 secs 2024-07-26T09:00:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:41 smithi063 ceph-mon[36747]: pgmap v1386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:43 smithi043 ceph-mon[32384]: pgmap v1387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:43 smithi133 ceph-mon[37053]: pgmap v1387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:43 smithi063 ceph-mon[36747]: pgmap v1387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:45 smithi043 ceph-mon[32384]: pgmap v1388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:45 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 1491.739033 secs 2024-07-26T09:00:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:45 smithi043 ceph-mon[32384]: slow request 1440.248730 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T09:00:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:45 smithi133 ceph-mon[37053]: pgmap v1388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:45 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 1491.739033 secs 2024-07-26T09:00:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:45 smithi133 ceph-mon[37053]: slow request 1440.248730 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T09:00:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:45 smithi063 ceph-mon[36747]: pgmap v1388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:00:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:45 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 1491.739033 secs 2024-07-26T09:00:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:45 smithi063 ceph-mon[36747]: slow request 1440.248730 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T09:00:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1507.224594 secs 2024-07-26T09:00:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1507.224594 secs 2024-07-26T09:00:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1507.224594 secs 2024-07-26T09:00:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:47 smithi043 ceph-mon[32384]: pgmap v1389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:00:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:47 smithi133 ceph-mon[37053]: pgmap v1389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:00:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:47 smithi063 ceph-mon[36747]: pgmap v1389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:00:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:49 smithi043 ceph-mon[32384]: pgmap v1390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:49 smithi133 ceph-mon[37053]: pgmap v1390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:49 smithi063 ceph-mon[36747]: pgmap v1390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1496.739147 secs 2024-07-26T09:00:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1496.739147 secs 2024-07-26T09:00:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1496.739147 secs 2024-07-26T09:00:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1512.224752 secs 2024-07-26T09:00:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:51 smithi043 ceph-mon[32384]: pgmap v1391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1512.224752 secs 2024-07-26T09:00:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:51 smithi133 ceph-mon[37053]: pgmap v1391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1512.224752 secs 2024-07-26T09:00:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:51 smithi063 ceph-mon[36747]: pgmap v1391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:53 smithi043 ceph-mon[32384]: pgmap v1392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:54.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:53 smithi133 ceph-mon[37053]: pgmap v1392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:53 smithi063 ceph-mon[36747]: pgmap v1392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:00:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:55 smithi043 ceph-mon[32384]: pgmap v1393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1501.739208 secs 2024-07-26T09:00:56.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:55 smithi133 ceph-mon[37053]: pgmap v1393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1501.739208 secs 2024-07-26T09:00:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:55 smithi063 ceph-mon[36747]: pgmap v1393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:00:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1501.739208 secs 2024-07-26T09:00:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1517.224882 secs 2024-07-26T09:00:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1517.224882 secs 2024-07-26T09:00:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1517.224882 secs 2024-07-26T09:00:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:57 smithi133 ceph-mon[37053]: pgmap v1394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:57 smithi063 ceph-mon[36747]: pgmap v1394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:00:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:57 smithi043 ceph-mon[32384]: pgmap v1394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:00:59 smithi133 ceph-mon[37053]: pgmap v1395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:00:59 smithi063 ceph-mon[36747]: pgmap v1395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:00:59 smithi043 ceph-mon[32384]: pgmap v1395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1506.739325 secs 2024-07-26T09:01:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1522.224971 secs 2024-07-26T09:01:01.051 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1506.739325 secs 2024-07-26T09:01:01.051 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1522.224971 secs 2024-07-26T09:01:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1506.739325 secs 2024-07-26T09:01:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1522.224971 secs 2024-07-26T09:01:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:01 smithi043 ceph-mon[32384]: pgmap v1396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:01 smithi133 ceph-mon[37053]: pgmap v1396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:01 smithi063 ceph-mon[36747]: pgmap v1396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:03 smithi063 ceph-mon[36747]: pgmap v1397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:03 smithi043 ceph-mon[32384]: pgmap v1397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:03 smithi133 ceph-mon[37053]: pgmap v1397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:05 smithi063 ceph-mon[36747]: pgmap v1398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1511.739410 secs 2024-07-26T09:01:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1527.225088 secs 2024-07-26T09:01:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:05 smithi043 ceph-mon[32384]: pgmap v1398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1511.739410 secs 2024-07-26T09:01:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1527.225088 secs 2024-07-26T09:01:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:05 smithi133 ceph-mon[37053]: pgmap v1398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1511.739410 secs 2024-07-26T09:01:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1527.225088 secs 2024-07-26T09:01:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:07 smithi063 ceph-mon[36747]: pgmap v1399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:07 smithi043 ceph-mon[32384]: pgmap v1399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:07 smithi133 ceph-mon[37053]: pgmap v1399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:09 smithi063 ceph-mon[36747]: pgmap v1400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:09 smithi043 ceph-mon[32384]: pgmap v1400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:09 smithi133 ceph-mon[37053]: pgmap v1400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1516.739550 secs 2024-07-26T09:01:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1532.225224 secs 2024-07-26T09:01:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1516.739550 secs 2024-07-26T09:01:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1532.225224 secs 2024-07-26T09:01:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1516.739550 secs 2024-07-26T09:01:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1532.225224 secs 2024-07-26T09:01:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:11 smithi063 ceph-mon[36747]: pgmap v1401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:11 smithi043 ceph-mon[32384]: pgmap v1401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:11 smithi133 ceph-mon[37053]: pgmap v1401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:13 smithi063 ceph-mon[36747]: pgmap v1402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:13 smithi043 ceph-mon[32384]: pgmap v1402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:13 smithi133 ceph-mon[37053]: pgmap v1402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:15 smithi063 ceph-mon[36747]: pgmap v1403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1521.739691 secs 2024-07-26T09:01:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1537.225321 secs 2024-07-26T09:01:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:15 smithi043 ceph-mon[32384]: pgmap v1403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1521.739691 secs 2024-07-26T09:01:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1537.225321 secs 2024-07-26T09:01:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:15 smithi133 ceph-mon[37053]: pgmap v1403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1521.739691 secs 2024-07-26T09:01:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1537.225321 secs 2024-07-26T09:01:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:17 smithi063 ceph-mon[36747]: pgmap v1404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:17 smithi043 ceph-mon[32384]: pgmap v1404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:17 smithi133 ceph-mon[37053]: pgmap v1404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:19 smithi043 ceph-mon[32384]: pgmap v1405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:19 smithi133 ceph-mon[37053]: pgmap v1405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:19 smithi063 ceph-mon[36747]: pgmap v1405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1526.739846 secs 2024-07-26T09:01:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1542.225419 secs 2024-07-26T09:01:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1526.739846 secs 2024-07-26T09:01:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1542.225419 secs 2024-07-26T09:01:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1526.739846 secs 2024-07-26T09:01:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1542.225419 secs 2024-07-26T09:01:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:21 smithi043 ceph-mon[32384]: pgmap v1406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:21 smithi133 ceph-mon[37053]: pgmap v1406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:21 smithi063 ceph-mon[36747]: pgmap v1406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:23 smithi043 ceph-mon[32384]: pgmap v1407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:23 smithi133 ceph-mon[37053]: pgmap v1407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:23 smithi063 ceph-mon[36747]: pgmap v1407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:26.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:25 smithi063 ceph-mon[36747]: pgmap v1408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:26.169 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1531.739973 secs 2024-07-26T09:01:26.169 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1547.225540 secs 2024-07-26T09:01:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:25 smithi043 ceph-mon[32384]: pgmap v1408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1531.739973 secs 2024-07-26T09:01:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1547.225540 secs 2024-07-26T09:01:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:25 smithi133 ceph-mon[37053]: pgmap v1408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1531.739973 secs 2024-07-26T09:01:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1547.225540 secs 2024-07-26T09:01:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:27 smithi043 ceph-mon[32384]: pgmap v1409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:27 smithi133 ceph-mon[37053]: pgmap v1409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:27 smithi063 ceph-mon[36747]: pgmap v1409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:28 smithi043 ceph-mon[32384]: pgmap v1410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:29.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:28 smithi133 ceph-mon[37053]: pgmap v1410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:28 smithi063 ceph-mon[36747]: pgmap v1410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1536.740140 secs 2024-07-26T09:01:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1536.740140 secs 2024-07-26T09:01:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1536.740140 secs 2024-07-26T09:01:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1552.225642 secs 2024-07-26T09:01:31.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:31 smithi043 ceph-mon[32384]: pgmap v1411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1552.225642 secs 2024-07-26T09:01:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:31 smithi133 ceph-mon[37053]: pgmap v1411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1552.225642 secs 2024-07-26T09:01:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:31 smithi063 ceph-mon[36747]: pgmap v1411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:33 smithi043 ceph-mon[32384]: pgmap v1412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:33 smithi133 ceph-mon[37053]: pgmap v1412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:33 smithi063 ceph-mon[36747]: pgmap v1412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:35 smithi043 ceph-mon[32384]: pgmap v1413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1541.740262 secs 2024-07-26T09:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:35 smithi133 ceph-mon[37053]: pgmap v1413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1541.740262 secs 2024-07-26T09:01:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:35 smithi063 ceph-mon[36747]: pgmap v1413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1541.740262 secs 2024-07-26T09:01:36.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1557.225766 secs 2024-07-26T09:01:37.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1557.225766 secs 2024-07-26T09:01:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1557.225766 secs 2024-07-26T09:01:37.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:37 smithi043 ceph-mon[32384]: pgmap v1414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:01:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:37 smithi133 ceph-mon[37053]: pgmap v1414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:01:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:37 smithi063 ceph-mon[36747]: pgmap v1414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:01:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:01:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:01:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:01:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:01:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:01:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:01:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:01:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:01:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:01:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:39 smithi043 ceph-mon[32384]: pgmap v1415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:01:39.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:39 smithi043 ceph-mon[32384]: pgmap v1416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:39 smithi133 ceph-mon[37053]: pgmap v1415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:01:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:39 smithi133 ceph-mon[37053]: pgmap v1416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:39 smithi063 ceph-mon[36747]: pgmap v1415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:01:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:39 smithi063 ceph-mon[36747]: pgmap v1416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1546.740386 secs 2024-07-26T09:01:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1546.740386 secs 2024-07-26T09:01:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1546.740386 secs 2024-07-26T09:01:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:41 smithi133 ceph-mon[37053]: pgmap v1417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:01:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1562.225831 secs 2024-07-26T09:01:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:41 smithi063 ceph-mon[36747]: pgmap v1417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:01:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1562.225831 secs 2024-07-26T09:01:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:41 smithi043 ceph-mon[32384]: pgmap v1417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:01:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1562.225831 secs 2024-07-26T09:01:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:43 smithi133 ceph-mon[37053]: pgmap v1418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:01:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:43 smithi063 ceph-mon[36747]: pgmap v1418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:01:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:43 smithi043 ceph-mon[32384]: pgmap v1418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:01:46.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:45 smithi133 ceph-mon[37053]: pgmap v1419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1551.740484 secs 2024-07-26T09:01:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1567.225950 secs 2024-07-26T09:01:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:45 smithi063 ceph-mon[36747]: pgmap v1419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1551.740484 secs 2024-07-26T09:01:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1567.225950 secs 2024-07-26T09:01:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:45 smithi043 ceph-mon[32384]: pgmap v1419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1551.740484 secs 2024-07-26T09:01:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1567.225950 secs 2024-07-26T09:01:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:47 smithi133 ceph-mon[37053]: pgmap v1420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:47 smithi063 ceph-mon[36747]: pgmap v1420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:47 smithi043 ceph-mon[32384]: pgmap v1420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:49 smithi133 ceph-mon[37053]: pgmap v1421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:01:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:49 smithi063 ceph-mon[36747]: pgmap v1421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:01:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:49 smithi043 ceph-mon[32384]: pgmap v1421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:01:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1556.740604 secs 2024-07-26T09:01:51.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1572.226016 secs 2024-07-26T09:01:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1556.740604 secs 2024-07-26T09:01:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1572.226016 secs 2024-07-26T09:01:51.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1556.740604 secs 2024-07-26T09:01:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1572.226016 secs 2024-07-26T09:01:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:51 smithi063 ceph-mon[36747]: pgmap v1422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:51 smithi043 ceph-mon[32384]: pgmap v1422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:51 smithi133 ceph-mon[37053]: pgmap v1422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:01:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:53 smithi063 ceph-mon[36747]: pgmap v1423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:53 smithi043 ceph-mon[32384]: pgmap v1423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:53 smithi133 ceph-mon[37053]: pgmap v1423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:55 smithi063 ceph-mon[36747]: pgmap v1424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1561.740736 secs 2024-07-26T09:01:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1577.226140 secs 2024-07-26T09:01:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:55 smithi043 ceph-mon[32384]: pgmap v1424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1561.740736 secs 2024-07-26T09:01:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1577.226140 secs 2024-07-26T09:01:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:55 smithi133 ceph-mon[37053]: pgmap v1424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:01:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1561.740736 secs 2024-07-26T09:01:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1577.226140 secs 2024-07-26T09:01:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:57 smithi063 ceph-mon[36747]: pgmap v1425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:57 smithi043 ceph-mon[32384]: pgmap v1425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:01:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:57 smithi133 ceph-mon[37053]: pgmap v1425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:01:59 smithi063 ceph-mon[36747]: pgmap v1426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:01:59 smithi043 ceph-mon[32384]: pgmap v1426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:00.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:01:59 smithi133 ceph-mon[37053]: pgmap v1426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1566.740834 secs 2024-07-26T09:02:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1582.226223 secs 2024-07-26T09:02:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1566.740834 secs 2024-07-26T09:02:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1582.226223 secs 2024-07-26T09:02:01.171 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1566.740834 secs 2024-07-26T09:02:01.171 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1582.226223 secs 2024-07-26T09:02:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:01 smithi043 ceph-mon[32384]: pgmap v1427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:01 smithi133 ceph-mon[37053]: pgmap v1427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:01 smithi063 ceph-mon[36747]: pgmap v1427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:03 smithi043 ceph-mon[32384]: pgmap v1428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:03 smithi133 ceph-mon[37053]: pgmap v1428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:03 smithi063 ceph-mon[36747]: pgmap v1428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:05 smithi043 ceph-mon[32384]: pgmap v1429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1571.740933 secs 2024-07-26T09:02:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1587.226340 secs 2024-07-26T09:02:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:05 smithi133 ceph-mon[37053]: pgmap v1429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1571.740933 secs 2024-07-26T09:02:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1587.226340 secs 2024-07-26T09:02:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:05 smithi063 ceph-mon[36747]: pgmap v1429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1571.740933 secs 2024-07-26T09:02:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1587.226340 secs 2024-07-26T09:02:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:07 smithi043 ceph-mon[32384]: pgmap v1430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:07 smithi133 ceph-mon[37053]: pgmap v1430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:07 smithi063 ceph-mon[36747]: pgmap v1430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:09 smithi043 ceph-mon[32384]: pgmap v1431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:09 smithi133 ceph-mon[37053]: pgmap v1431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:09 smithi063 ceph-mon[36747]: pgmap v1431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1576.741073 secs 2024-07-26T09:02:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1592.226435 secs 2024-07-26T09:02:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1576.741073 secs 2024-07-26T09:02:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1592.226435 secs 2024-07-26T09:02:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1576.741073 secs 2024-07-26T09:02:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1592.226435 secs 2024-07-26T09:02:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:11 smithi043 ceph-mon[32384]: pgmap v1432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:11 smithi133 ceph-mon[37053]: pgmap v1432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:11 smithi063 ceph-mon[36747]: pgmap v1432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:13 smithi043 ceph-mon[32384]: pgmap v1433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:13 smithi133 ceph-mon[37053]: pgmap v1433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:13 smithi063 ceph-mon[36747]: pgmap v1433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:14 smithi043 ceph-mon[32384]: pgmap v1434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:14 smithi133 ceph-mon[37053]: pgmap v1434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:14 smithi063 ceph-mon[36747]: pgmap v1434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:02:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1581.741196 secs 2024-07-26T09:02:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1597.226558 secs 2024-07-26T09:02:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1581.741196 secs 2024-07-26T09:02:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1597.226558 secs 2024-07-26T09:02:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1581.741196 secs 2024-07-26T09:02:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1597.226558 secs 2024-07-26T09:02:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:16 smithi043 ceph-mon[32384]: pgmap v1435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:16 smithi133 ceph-mon[37053]: pgmap v1435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:16 smithi063 ceph-mon[36747]: pgmap v1435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:19 smithi063 ceph-mon[36747]: pgmap v1436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:19 smithi043 ceph-mon[32384]: pgmap v1436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:19 smithi133 ceph-mon[37053]: pgmap v1436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:21 smithi063 ceph-mon[36747]: pgmap v1437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1586.741318 secs 2024-07-26T09:02:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1602.226628 secs 2024-07-26T09:02:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:21 smithi043 ceph-mon[32384]: pgmap v1437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1586.741318 secs 2024-07-26T09:02:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1602.226628 secs 2024-07-26T09:02:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:21 smithi133 ceph-mon[37053]: pgmap v1437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1586.741318 secs 2024-07-26T09:02:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1602.226628 secs 2024-07-26T09:02:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:23 smithi063 ceph-mon[36747]: pgmap v1438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:23 smithi043 ceph-mon[32384]: pgmap v1438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:23 smithi133 ceph-mon[37053]: pgmap v1438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:25 smithi063 ceph-mon[36747]: pgmap v1439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:25 smithi043 ceph-mon[32384]: pgmap v1439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:25 smithi133 ceph-mon[37053]: pgmap v1439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1591.741432 secs 2024-07-26T09:02:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1607.226728 secs 2024-07-26T09:02:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1591.741432 secs 2024-07-26T09:02:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1607.226728 secs 2024-07-26T09:02:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1591.741432 secs 2024-07-26T09:02:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1607.226728 secs 2024-07-26T09:02:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:27 smithi063 ceph-mon[36747]: pgmap v1440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:27 smithi043 ceph-mon[32384]: pgmap v1440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:27 smithi133 ceph-mon[37053]: pgmap v1440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:29 smithi063 ceph-mon[36747]: pgmap v1441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:29 smithi043 ceph-mon[32384]: pgmap v1441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:29 smithi133 ceph-mon[37053]: pgmap v1441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:31 smithi043 ceph-mon[32384]: pgmap v1442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1596.741552 secs 2024-07-26T09:02:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1612.226885 secs 2024-07-26T09:02:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:31 smithi133 ceph-mon[37053]: pgmap v1442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1596.741552 secs 2024-07-26T09:02:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1612.226885 secs 2024-07-26T09:02:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:31 smithi063 ceph-mon[36747]: pgmap v1442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1596.741552 secs 2024-07-26T09:02:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1612.226885 secs 2024-07-26T09:02:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:33 smithi043 ceph-mon[32384]: pgmap v1443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:33 smithi133 ceph-mon[37053]: pgmap v1443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:33 smithi063 ceph-mon[36747]: pgmap v1443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:35 smithi043 ceph-mon[32384]: pgmap v1444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:35.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:35 smithi133 ceph-mon[37053]: pgmap v1444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:35 smithi063 ceph-mon[36747]: pgmap v1444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1601.741645 secs 2024-07-26T09:02:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1617.226983 secs 2024-07-26T09:02:36.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1601.741645 secs 2024-07-26T09:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1617.226983 secs 2024-07-26T09:02:36.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1601.741645 secs 2024-07-26T09:02:36.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1617.226983 secs 2024-07-26T09:02:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:37 smithi043 ceph-mon[32384]: pgmap v1445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:37 smithi133 ceph-mon[37053]: pgmap v1445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:37 smithi063 ceph-mon[36747]: pgmap v1445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:39 smithi043 ceph-mon[32384]: pgmap v1446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:02:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:39 smithi133 ceph-mon[37053]: pgmap v1446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:02:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:39 smithi063 ceph-mon[36747]: pgmap v1446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:02:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:02:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:02:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:40 smithi043 ceph-mon[32384]: pgmap v1447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:02:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:40 smithi043 ceph-mon[32384]: pgmap v1448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:02:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:02:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:02:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:02:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:40 smithi133 ceph-mon[37053]: pgmap v1447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:02:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:40 smithi133 ceph-mon[37053]: pgmap v1448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:02:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:02:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:02:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:02:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:40 smithi063 ceph-mon[36747]: pgmap v1447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:02:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:40 smithi063 ceph-mon[36747]: pgmap v1448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:02:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:02:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1606.741797 secs 2024-07-26T09:02:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1622.227102 secs 2024-07-26T09:02:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1606.741797 secs 2024-07-26T09:02:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1622.227102 secs 2024-07-26T09:02:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1606.741797 secs 2024-07-26T09:02:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1622.227102 secs 2024-07-26T09:02:42.482 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:42 smithi043 ceph-mon[32384]: pgmap v1449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:02:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:42 smithi133 ceph-mon[37053]: pgmap v1449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:02:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:42 smithi063 ceph-mon[36747]: pgmap v1449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:02:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:44 smithi063 ceph-mon[36747]: pgmap v1450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:02:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:44 smithi043 ceph-mon[32384]: pgmap v1450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:02:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:44 smithi133 ceph-mon[37053]: pgmap v1450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:02:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1611.741915 secs 2024-07-26T09:02:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:46 smithi063 ceph-mon[36747]: pgmap v1451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1627.227222 secs 2024-07-26T09:02:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1611.741915 secs 2024-07-26T09:02:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:46 smithi043 ceph-mon[32384]: pgmap v1451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1627.227222 secs 2024-07-26T09:02:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1611.741915 secs 2024-07-26T09:02:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:46 smithi133 ceph-mon[37053]: pgmap v1451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1627.227222 secs 2024-07-26T09:02:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:48 smithi063 ceph-mon[36747]: pgmap v1452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:48 smithi043 ceph-mon[32384]: pgmap v1452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:48 smithi133 ceph-mon[37053]: pgmap v1452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:02:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:50 smithi043 ceph-mon[32384]: pgmap v1453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:50 smithi063 ceph-mon[36747]: pgmap v1453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:50 smithi133 ceph-mon[37053]: pgmap v1453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:02:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1616.742068 secs 2024-07-26T09:02:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1632.227341 secs 2024-07-26T09:02:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1616.742068 secs 2024-07-26T09:02:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1632.227341 secs 2024-07-26T09:02:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1616.742068 secs 2024-07-26T09:02:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1632.227341 secs 2024-07-26T09:02:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:52 smithi043 ceph-mon[32384]: pgmap v1454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:52 smithi133 ceph-mon[37053]: pgmap v1454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:52 smithi063 ceph-mon[36747]: pgmap v1454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:02:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:54 smithi043 ceph-mon[32384]: pgmap v1455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:54 smithi133 ceph-mon[37053]: pgmap v1455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:54 smithi063 ceph-mon[36747]: pgmap v1455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1621.742180 secs 2024-07-26T09:02:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:56 smithi043 ceph-mon[32384]: pgmap v1456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1637.227460 secs 2024-07-26T09:02:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1621.742180 secs 2024-07-26T09:02:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:56 smithi133 ceph-mon[37053]: pgmap v1456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1637.227460 secs 2024-07-26T09:02:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1621.742180 secs 2024-07-26T09:02:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:56 smithi063 ceph-mon[36747]: pgmap v1456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:02:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1637.227460 secs 2024-07-26T09:02:58.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:02:58 smithi063 ceph-mon[36747]: pgmap v1457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:02:58 smithi043 ceph-mon[32384]: pgmap v1457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:02:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:02:58 smithi133 ceph-mon[37053]: pgmap v1457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:00 smithi043 ceph-mon[32384]: pgmap v1458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:00 smithi133 ceph-mon[37053]: pgmap v1458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:00 smithi063 ceph-mon[36747]: pgmap v1458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1626.742297 secs 2024-07-26T09:03:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1642.227529 secs 2024-07-26T09:03:01.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1626.742297 secs 2024-07-26T09:03:01.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1642.227529 secs 2024-07-26T09:03:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1626.742297 secs 2024-07-26T09:03:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1642.227529 secs 2024-07-26T09:03:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:02 smithi043 ceph-mon[32384]: pgmap v1459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:02 smithi133 ceph-mon[37053]: pgmap v1459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:02 smithi063 ceph-mon[36747]: pgmap v1459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:04 smithi043 ceph-mon[32384]: pgmap v1460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:04 smithi133 ceph-mon[37053]: pgmap v1460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:04 smithi063 ceph-mon[36747]: pgmap v1460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1631.742380 secs 2024-07-26T09:03:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1631.742380 secs 2024-07-26T09:03:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1631.742380 secs 2024-07-26T09:03:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:06 smithi043 ceph-mon[32384]: pgmap v1461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1647.227600 secs 2024-07-26T09:03:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:06 smithi133 ceph-mon[37053]: pgmap v1461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1647.227600 secs 2024-07-26T09:03:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:06 smithi063 ceph-mon[36747]: pgmap v1461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1647.227600 secs 2024-07-26T09:03:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:08 smithi043 ceph-mon[32384]: pgmap v1462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:08 smithi133 ceph-mon[37053]: pgmap v1462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:08 smithi063 ceph-mon[36747]: pgmap v1462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:10 smithi043 ceph-mon[32384]: pgmap v1463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:10.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1636.742509 secs 2024-07-26T09:03:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:10 smithi133 ceph-mon[37053]: pgmap v1463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1636.742509 secs 2024-07-26T09:03:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:10 smithi063 ceph-mon[36747]: pgmap v1463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1636.742509 secs 2024-07-26T09:03:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1652.227723 secs 2024-07-26T09:03:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1652.227723 secs 2024-07-26T09:03:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1652.227723 secs 2024-07-26T09:03:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:12 smithi043 ceph-mon[32384]: pgmap v1464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:12 smithi133 ceph-mon[37053]: pgmap v1464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:12 smithi063 ceph-mon[36747]: pgmap v1464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:14 smithi043 ceph-mon[32384]: pgmap v1465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:14 smithi133 ceph-mon[37053]: pgmap v1465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:14 smithi063 ceph-mon[36747]: pgmap v1465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1641.742642 secs 2024-07-26T09:03:15.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1641.742642 secs 2024-07-26T09:03:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1641.742642 secs 2024-07-26T09:03:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:16 smithi043 ceph-mon[32384]: pgmap v1466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:03:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1657.227821 secs 2024-07-26T09:03:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:16 smithi133 ceph-mon[37053]: pgmap v1466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:03:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1657.227821 secs 2024-07-26T09:03:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:16 smithi063 ceph-mon[36747]: pgmap v1466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:03:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1657.227821 secs 2024-07-26T09:03:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:18 smithi043 ceph-mon[32384]: pgmap v1467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:18 smithi133 ceph-mon[37053]: pgmap v1467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:18 smithi063 ceph-mon[36747]: pgmap v1467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:20 smithi043 ceph-mon[32384]: pgmap v1468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1646.742758 secs 2024-07-26T09:03:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:20 smithi133 ceph-mon[37053]: pgmap v1468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1646.742758 secs 2024-07-26T09:03:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:20 smithi063 ceph-mon[36747]: pgmap v1468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:03:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1646.742758 secs 2024-07-26T09:03:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1662.227950 secs 2024-07-26T09:03:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1662.227950 secs 2024-07-26T09:03:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1662.227950 secs 2024-07-26T09:03:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:22 smithi043 ceph-mon[32384]: pgmap v1469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:22 smithi133 ceph-mon[37053]: pgmap v1469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:22 smithi063 ceph-mon[36747]: pgmap v1469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:24 smithi043 ceph-mon[32384]: pgmap v1470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:24 smithi133 ceph-mon[37053]: pgmap v1470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:24 smithi063 ceph-mon[36747]: pgmap v1470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1651.742895 secs 2024-07-26T09:03:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1651.742895 secs 2024-07-26T09:03:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1651.742895 secs 2024-07-26T09:03:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:26 smithi043 ceph-mon[32384]: pgmap v1471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1667.228018 secs 2024-07-26T09:03:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:26 smithi133 ceph-mon[37053]: pgmap v1471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1667.228018 secs 2024-07-26T09:03:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:26 smithi063 ceph-mon[36747]: pgmap v1471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1667.228018 secs 2024-07-26T09:03:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:28 smithi133 ceph-mon[37053]: pgmap v1472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:28 smithi063 ceph-mon[36747]: pgmap v1472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:28 smithi043 ceph-mon[32384]: pgmap v1472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:30 smithi133 ceph-mon[37053]: pgmap v1473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1656.743027 secs 2024-07-26T09:03:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:30 smithi063 ceph-mon[36747]: pgmap v1473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1656.743027 secs 2024-07-26T09:03:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:30 smithi043 ceph-mon[32384]: pgmap v1473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1656.743027 secs 2024-07-26T09:03:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1672.228139 secs 2024-07-26T09:03:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1672.228139 secs 2024-07-26T09:03:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1672.228139 secs 2024-07-26T09:03:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:32 smithi133 ceph-mon[37053]: pgmap v1474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:32 smithi063 ceph-mon[36747]: pgmap v1474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:32 smithi043 ceph-mon[32384]: pgmap v1474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:34 smithi133 ceph-mon[37053]: pgmap v1475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:34 smithi063 ceph-mon[36747]: pgmap v1475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:34 smithi043 ceph-mon[32384]: pgmap v1475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1661.743144 secs 2024-07-26T09:03:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1661.743144 secs 2024-07-26T09:03:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1661.743144 secs 2024-07-26T09:03:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:36 smithi063 ceph-mon[36747]: pgmap v1476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1677.228204 secs 2024-07-26T09:03:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:36 smithi043 ceph-mon[32384]: pgmap v1476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1677.228204 secs 2024-07-26T09:03:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:36 smithi133 ceph-mon[37053]: pgmap v1476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1677.228204 secs 2024-07-26T09:03:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:38 smithi063 ceph-mon[36747]: pgmap v1477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:38 smithi043 ceph-mon[32384]: pgmap v1477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:38 smithi133 ceph-mon[37053]: pgmap v1477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:03:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:03:40.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:03:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:40 smithi063 ceph-mon[36747]: pgmap v1478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1666.743208 secs 2024-07-26T09:03:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:03:40.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:03:40.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:03:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:40 smithi043 ceph-mon[32384]: pgmap v1478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1666.743208 secs 2024-07-26T09:03:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:03:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:03:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:03:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:40 smithi133 ceph-mon[37053]: pgmap v1478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:03:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1666.743208 secs 2024-07-26T09:03:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:03:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:03:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:03:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1682.228272 secs 2024-07-26T09:03:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:41 smithi063 ceph-mon[36747]: pgmap v1479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:03:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:41 smithi063 ceph-mon[36747]: pgmap v1480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:03:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1682.228272 secs 2024-07-26T09:03:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:41 smithi043 ceph-mon[32384]: pgmap v1479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:03:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:41 smithi043 ceph-mon[32384]: pgmap v1480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1682.228272 secs 2024-07-26T09:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:41 smithi133 ceph-mon[37053]: pgmap v1479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:41 smithi133 ceph-mon[37053]: pgmap v1480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:03:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:43 smithi063 ceph-mon[36747]: pgmap v1481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:43 smithi043 ceph-mon[32384]: pgmap v1481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:43 smithi133 ceph-mon[37053]: pgmap v1481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:45 smithi063 ceph-mon[36747]: pgmap v1482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1671.743324 secs 2024-07-26T09:03:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:45 smithi043 ceph-mon[32384]: pgmap v1482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1671.743324 secs 2024-07-26T09:03:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:45 smithi133 ceph-mon[37053]: pgmap v1482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1671.743324 secs 2024-07-26T09:03:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1687.228391 secs 2024-07-26T09:03:47.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1687.228391 secs 2024-07-26T09:03:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1687.228391 secs 2024-07-26T09:03:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:47 smithi043 ceph-mon[32384]: pgmap v1483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:03:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:47 smithi133 ceph-mon[37053]: pgmap v1483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:03:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:47 smithi063 ceph-mon[36747]: pgmap v1483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:03:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:49 smithi043 ceph-mon[32384]: pgmap v1484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:49 smithi133 ceph-mon[37053]: pgmap v1484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:49 smithi063 ceph-mon[36747]: pgmap v1484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:03:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1676.743443 secs 2024-07-26T09:03:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1676.743443 secs 2024-07-26T09:03:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1676.743443 secs 2024-07-26T09:03:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1692.228513 secs 2024-07-26T09:03:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:51 smithi043 ceph-mon[32384]: pgmap v1485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1692.228513 secs 2024-07-26T09:03:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:51 smithi133 ceph-mon[37053]: pgmap v1485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1692.228513 secs 2024-07-26T09:03:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:51 smithi063 ceph-mon[36747]: pgmap v1485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:03:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:53 smithi043 ceph-mon[32384]: pgmap v1486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:03:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:53 smithi133 ceph-mon[37053]: pgmap v1486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:03:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:53 smithi063 ceph-mon[36747]: pgmap v1486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:03:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:55 smithi043 ceph-mon[32384]: pgmap v1487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1681.743562 secs 2024-07-26T09:03:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:55 smithi133 ceph-mon[37053]: pgmap v1487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1681.743562 secs 2024-07-26T09:03:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:55 smithi063 ceph-mon[36747]: pgmap v1487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:03:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1681.743562 secs 2024-07-26T09:03:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1697.228632 secs 2024-07-26T09:03:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1697.228632 secs 2024-07-26T09:03:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1697.228632 secs 2024-07-26T09:03:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:57 smithi043 ceph-mon[32384]: pgmap v1488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:57 smithi133 ceph-mon[37053]: pgmap v1488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:57 smithi063 ceph-mon[36747]: pgmap v1488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:03:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:03:59 smithi043 ceph-mon[32384]: pgmap v1489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:03:59 smithi133 ceph-mon[37053]: pgmap v1489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:03:59 smithi063 ceph-mon[36747]: pgmap v1489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1686.743681 secs 2024-07-26T09:04:01.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1686.743681 secs 2024-07-26T09:04:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1686.743681 secs 2024-07-26T09:04:01.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1702.228772 secs 2024-07-26T09:04:01.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:01 smithi043 ceph-mon[32384]: pgmap v1490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1702.228772 secs 2024-07-26T09:04:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:01 smithi133 ceph-mon[37053]: pgmap v1490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1702.228772 secs 2024-07-26T09:04:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:01 smithi063 ceph-mon[36747]: pgmap v1490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:03 smithi043 ceph-mon[32384]: pgmap v1491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:03 smithi133 ceph-mon[37053]: pgmap v1491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:03 smithi063 ceph-mon[36747]: pgmap v1491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:05 smithi043 ceph-mon[32384]: pgmap v1492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1691.743829 secs 2024-07-26T09:04:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:05 smithi133 ceph-mon[37053]: pgmap v1492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1691.743829 secs 2024-07-26T09:04:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:05 smithi063 ceph-mon[36747]: pgmap v1492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1691.743829 secs 2024-07-26T09:04:06.914 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1707.228893 secs 2024-07-26T09:04:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1707.228893 secs 2024-07-26T09:04:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1707.228893 secs 2024-07-26T09:04:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:07 smithi043 ceph-mon[32384]: pgmap v1493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:07 smithi133 ceph-mon[37053]: pgmap v1493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:07 smithi063 ceph-mon[36747]: pgmap v1493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:09 smithi043 ceph-mon[32384]: pgmap v1494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:09 smithi133 ceph-mon[37053]: pgmap v1494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:09 smithi063 ceph-mon[36747]: pgmap v1494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1696.743941 secs 2024-07-26T09:04:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1696.743941 secs 2024-07-26T09:04:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1696.743941 secs 2024-07-26T09:04:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1712.229023 secs 2024-07-26T09:04:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:11 smithi043 ceph-mon[32384]: pgmap v1495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1712.229023 secs 2024-07-26T09:04:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:11 smithi133 ceph-mon[37053]: pgmap v1495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1712.229023 secs 2024-07-26T09:04:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:11 smithi063 ceph-mon[36747]: pgmap v1495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:13 smithi043 ceph-mon[32384]: pgmap v1496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:13 smithi133 ceph-mon[37053]: pgmap v1496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:13 smithi063 ceph-mon[36747]: pgmap v1496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:15 smithi043 ceph-mon[32384]: pgmap v1497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1701.744038 secs 2024-07-26T09:04:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:15 smithi133 ceph-mon[37053]: pgmap v1497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1701.744038 secs 2024-07-26T09:04:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:15 smithi063 ceph-mon[36747]: pgmap v1497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1701.744038 secs 2024-07-26T09:04:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1717.229135 secs 2024-07-26T09:04:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1717.229135 secs 2024-07-26T09:04:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1717.229135 secs 2024-07-26T09:04:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:17 smithi043 ceph-mon[32384]: pgmap v1498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:17 smithi133 ceph-mon[37053]: pgmap v1498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:17 smithi063 ceph-mon[36747]: pgmap v1498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:19 smithi043 ceph-mon[32384]: pgmap v1499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:19 smithi133 ceph-mon[37053]: pgmap v1499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:19 smithi063 ceph-mon[36747]: pgmap v1499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1706.744173 secs 2024-07-26T09:04:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1706.744173 secs 2024-07-26T09:04:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1706.744173 secs 2024-07-26T09:04:21.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1722.229250 secs 2024-07-26T09:04:21.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:21 smithi043 ceph-mon[32384]: pgmap v1500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1722.229250 secs 2024-07-26T09:04:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:21 smithi133 ceph-mon[37053]: pgmap v1500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1722.229250 secs 2024-07-26T09:04:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:21 smithi063 ceph-mon[36747]: pgmap v1500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:23 smithi133 ceph-mon[37053]: pgmap v1501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:23 smithi063 ceph-mon[36747]: pgmap v1501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:24.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:23 smithi043 ceph-mon[32384]: pgmap v1501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:25 smithi133 ceph-mon[37053]: pgmap v1502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1711.744292 secs 2024-07-26T09:04:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:25 smithi063 ceph-mon[36747]: pgmap v1502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1711.744292 secs 2024-07-26T09:04:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:25 smithi043 ceph-mon[32384]: pgmap v1502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1711.744292 secs 2024-07-26T09:04:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1727.229331 secs 2024-07-26T09:04:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1727.229331 secs 2024-07-26T09:04:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1727.229331 secs 2024-07-26T09:04:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:27 smithi133 ceph-mon[37053]: pgmap v1503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:27 smithi063 ceph-mon[36747]: pgmap v1503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:27 smithi043 ceph-mon[32384]: pgmap v1503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:29 smithi133 ceph-mon[37053]: pgmap v1504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:29 smithi063 ceph-mon[36747]: pgmap v1504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:29 smithi043 ceph-mon[32384]: pgmap v1504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1716.744415 secs 2024-07-26T09:04:31.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1716.744415 secs 2024-07-26T09:04:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1716.744415 secs 2024-07-26T09:04:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1732.229399 secs 2024-07-26T09:04:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:31 smithi063 ceph-mon[36747]: pgmap v1505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:32.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1732.229399 secs 2024-07-26T09:04:32.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:31 smithi133 ceph-mon[37053]: pgmap v1505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1732.229399 secs 2024-07-26T09:04:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:31 smithi043 ceph-mon[32384]: pgmap v1505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:33 smithi063 ceph-mon[36747]: pgmap v1506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:33 smithi043 ceph-mon[32384]: pgmap v1506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:33 smithi133 ceph-mon[37053]: pgmap v1506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:04:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:35 smithi063 ceph-mon[36747]: pgmap v1507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1721.744568 secs 2024-07-26T09:04:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1737.229502 secs 2024-07-26T09:04:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:35 smithi043 ceph-mon[32384]: pgmap v1507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1721.744568 secs 2024-07-26T09:04:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1737.229502 secs 2024-07-26T09:04:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:35 smithi133 ceph-mon[37053]: pgmap v1507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1721.744568 secs 2024-07-26T09:04:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1737.229502 secs 2024-07-26T09:04:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:37 smithi063 ceph-mon[36747]: pgmap v1508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:38.143 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:37 smithi043 ceph-mon[32384]: pgmap v1508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:37 smithi133 ceph-mon[37053]: pgmap v1508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:39 smithi063 ceph-mon[36747]: pgmap v1509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:39 smithi043 ceph-mon[32384]: pgmap v1509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:39 smithi133 ceph-mon[37053]: pgmap v1509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1726.744691 secs 2024-07-26T09:04:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1742.229623 secs 2024-07-26T09:04:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:04:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1726.744691 secs 2024-07-26T09:04:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1742.229623 secs 2024-07-26T09:04:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:04:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1726.744691 secs 2024-07-26T09:04:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1742.229623 secs 2024-07-26T09:04:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:04:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:41 smithi063 ceph-mon[36747]: pgmap v1510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:41 smithi043 ceph-mon[32384]: pgmap v1510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:41 smithi133 ceph-mon[37053]: pgmap v1510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:04:43.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:04:43.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:04:43.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:42 smithi043 ceph-mon[32384]: pgmap v1511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:04:43.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:42 smithi043 ceph-mon[32384]: pgmap v1512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:04:43.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:04:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:04:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:04:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:42 smithi133 ceph-mon[37053]: pgmap v1511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:04:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:42 smithi133 ceph-mon[37053]: pgmap v1512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:04:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:04:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:04:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:04:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:42 smithi063 ceph-mon[36747]: pgmap v1511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:04:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:42 smithi063 ceph-mon[36747]: pgmap v1512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:04:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:04:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:44 smithi043 ceph-mon[32384]: pgmap v1513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:44 smithi133 ceph-mon[37053]: pgmap v1513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:44 smithi063 ceph-mon[36747]: pgmap v1513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1731.744808 secs 2024-07-26T09:04:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1747.229761 secs 2024-07-26T09:04:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1731.744808 secs 2024-07-26T09:04:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1747.229761 secs 2024-07-26T09:04:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1731.744808 secs 2024-07-26T09:04:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1747.229761 secs 2024-07-26T09:04:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:46 smithi043 ceph-mon[32384]: pgmap v1514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:46 smithi133 ceph-mon[37053]: pgmap v1514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:46 smithi063 ceph-mon[36747]: pgmap v1514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:47 smithi043 ceph-mon[32384]: pgmap v1515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:04:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:47 smithi133 ceph-mon[37053]: pgmap v1515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:04:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:47 smithi063 ceph-mon[36747]: pgmap v1515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:04:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:50 smithi043 ceph-mon[32384]: pgmap v1516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1736.744905 secs 2024-07-26T09:04:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1752.229914 secs 2024-07-26T09:04:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:50 smithi133 ceph-mon[37053]: pgmap v1516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1736.744905 secs 2024-07-26T09:04:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1752.229914 secs 2024-07-26T09:04:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:50 smithi063 ceph-mon[36747]: pgmap v1516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:04:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1736.744905 secs 2024-07-26T09:04:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1752.229914 secs 2024-07-26T09:04:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:52 smithi043 ceph-mon[32384]: pgmap v1517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:04:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:52 smithi133 ceph-mon[37053]: pgmap v1517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:04:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:52 smithi063 ceph-mon[36747]: pgmap v1517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:04:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:53 smithi043 ceph-mon[32384]: pgmap v1518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:53 smithi133 ceph-mon[37053]: pgmap v1518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:53 smithi063 ceph-mon[36747]: pgmap v1518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1741.745024 secs 2024-07-26T09:04:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1741.745024 secs 2024-07-26T09:04:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1741.745024 secs 2024-07-26T09:04:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1757.230000 secs 2024-07-26T09:04:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:56 smithi043 ceph-mon[32384]: pgmap v1519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1757.230000 secs 2024-07-26T09:04:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:56 smithi133 ceph-mon[37053]: pgmap v1519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1757.230000 secs 2024-07-26T09:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:56 smithi063 ceph-mon[36747]: pgmap v1519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:04:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:58 smithi043 ceph-mon[32384]: pgmap v1520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:58 smithi133 ceph-mon[37053]: pgmap v1520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:04:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:58 smithi063 ceph-mon[36747]: pgmap v1520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:04:59 smithi043 ceph-mon[32384]: pgmap v1521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:04:59 smithi133 ceph-mon[37053]: pgmap v1521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:04:59 smithi063 ceph-mon[36747]: pgmap v1521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1746.745147 secs 2024-07-26T09:05:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1762.230146 secs 2024-07-26T09:05:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1746.745147 secs 2024-07-26T09:05:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1762.230146 secs 2024-07-26T09:05:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1746.745147 secs 2024-07-26T09:05:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1762.230146 secs 2024-07-26T09:05:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:01 smithi043 ceph-mon[32384]: pgmap v1522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:01 smithi133 ceph-mon[37053]: pgmap v1522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:01 smithi063 ceph-mon[36747]: pgmap v1522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:04 smithi043 ceph-mon[32384]: pgmap v1523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:04 smithi133 ceph-mon[37053]: pgmap v1523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:04 smithi063 ceph-mon[36747]: pgmap v1523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1751.745269 secs 2024-07-26T09:05:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1767.230277 secs 2024-07-26T09:05:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:05 smithi043 ceph-mon[32384]: pgmap v1524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1751.745269 secs 2024-07-26T09:05:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1767.230277 secs 2024-07-26T09:05:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:05 smithi133 ceph-mon[37053]: pgmap v1524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1751.745269 secs 2024-07-26T09:05:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1767.230277 secs 2024-07-26T09:05:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:05 smithi063 ceph-mon[36747]: pgmap v1524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:07 smithi043 ceph-mon[32384]: pgmap v1525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:07 smithi133 ceph-mon[37053]: pgmap v1525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:07 smithi063 ceph-mon[36747]: pgmap v1525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:09 smithi043 ceph-mon[32384]: pgmap v1526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:09 smithi133 ceph-mon[37053]: pgmap v1526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:09 smithi063 ceph-mon[36747]: pgmap v1526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1756.745364 secs 2024-07-26T09:05:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1772.230426 secs 2024-07-26T09:05:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1756.745364 secs 2024-07-26T09:05:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1772.230426 secs 2024-07-26T09:05:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1756.745364 secs 2024-07-26T09:05:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1772.230426 secs 2024-07-26T09:05:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:11 smithi043 ceph-mon[32384]: pgmap v1527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:11 smithi133 ceph-mon[37053]: pgmap v1527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:11 smithi063 ceph-mon[36747]: pgmap v1527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:13 smithi043 ceph-mon[32384]: pgmap v1528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:13 smithi133 ceph-mon[37053]: pgmap v1528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:13 smithi063 ceph-mon[36747]: pgmap v1528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1761.745461 secs 2024-07-26T09:05:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1761.745461 secs 2024-07-26T09:05:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1761.745461 secs 2024-07-26T09:05:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1777.230569 secs 2024-07-26T09:05:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:16 smithi043 ceph-mon[32384]: pgmap v1529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1777.230569 secs 2024-07-26T09:05:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:16 smithi133 ceph-mon[37053]: pgmap v1529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1777.230569 secs 2024-07-26T09:05:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:16 smithi063 ceph-mon[36747]: pgmap v1529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:17 smithi043 ceph-mon[32384]: pgmap v1530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:17 smithi133 ceph-mon[37053]: pgmap v1530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:17 smithi063 ceph-mon[36747]: pgmap v1530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:19 smithi043 ceph-mon[32384]: pgmap v1531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:19 smithi133 ceph-mon[37053]: pgmap v1531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:19 smithi063 ceph-mon[36747]: pgmap v1531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1766.745610 secs 2024-07-26T09:05:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1782.230691 secs 2024-07-26T09:05:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1766.745610 secs 2024-07-26T09:05:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1782.230691 secs 2024-07-26T09:05:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1766.745610 secs 2024-07-26T09:05:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1782.230691 secs 2024-07-26T09:05:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:21 smithi043 ceph-mon[32384]: pgmap v1532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:21 smithi133 ceph-mon[37053]: pgmap v1532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:21 smithi063 ceph-mon[36747]: pgmap v1532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:23 smithi043 ceph-mon[32384]: pgmap v1533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:23 smithi133 ceph-mon[37053]: pgmap v1533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:23 smithi063 ceph-mon[36747]: pgmap v1533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1771.745723 secs 2024-07-26T09:05:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1771.745723 secs 2024-07-26T09:05:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1771.745723 secs 2024-07-26T09:05:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1787.230823 secs 2024-07-26T09:05:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:26 smithi043 ceph-mon[32384]: pgmap v1534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1787.230823 secs 2024-07-26T09:05:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:26 smithi133 ceph-mon[37053]: pgmap v1534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1787.230823 secs 2024-07-26T09:05:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:26 smithi063 ceph-mon[36747]: pgmap v1534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:27 smithi043 ceph-mon[32384]: pgmap v1535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:27 smithi133 ceph-mon[37053]: pgmap v1535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:27 smithi063 ceph-mon[36747]: pgmap v1535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:29 smithi043 ceph-mon[32384]: pgmap v1536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:29 smithi133 ceph-mon[37053]: pgmap v1536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:29 smithi063 ceph-mon[36747]: pgmap v1536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1776.745828 secs 2024-07-26T09:05:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1792.230941 secs 2024-07-26T09:05:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1776.745828 secs 2024-07-26T09:05:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1792.230941 secs 2024-07-26T09:05:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1776.745828 secs 2024-07-26T09:05:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1792.230941 secs 2024-07-26T09:05:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:31 smithi043 ceph-mon[32384]: pgmap v1537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:31 smithi133 ceph-mon[37053]: pgmap v1537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:31 smithi063 ceph-mon[36747]: pgmap v1537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:33 smithi043 ceph-mon[32384]: pgmap v1538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:33 smithi133 ceph-mon[37053]: pgmap v1538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:33 smithi063 ceph-mon[36747]: pgmap v1538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1781.745947 secs 2024-07-26T09:05:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1781.745947 secs 2024-07-26T09:05:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1781.745947 secs 2024-07-26T09:05:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1797.231072 secs 2024-07-26T09:05:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:36 smithi043 ceph-mon[32384]: pgmap v1539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1797.231072 secs 2024-07-26T09:05:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:36 smithi133 ceph-mon[37053]: pgmap v1539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1797.231072 secs 2024-07-26T09:05:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:36 smithi063 ceph-mon[36747]: pgmap v1539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:37 smithi043 ceph-mon[32384]: pgmap v1540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:37 smithi133 ceph-mon[37053]: pgmap v1540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:37 smithi063 ceph-mon[36747]: pgmap v1540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:05:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:39 smithi043 ceph-mon[32384]: pgmap v1541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:39 smithi133 ceph-mon[37053]: pgmap v1541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:39 smithi063 ceph-mon[36747]: pgmap v1541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1786.746084 secs 2024-07-26T09:05:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1802.231199 secs 2024-07-26T09:05:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1786.746084 secs 2024-07-26T09:05:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1802.231199 secs 2024-07-26T09:05:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1786.746084 secs 2024-07-26T09:05:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1802.231199 secs 2024-07-26T09:05:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:41 smithi043 ceph-mon[32384]: pgmap v1542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:41 smithi133 ceph-mon[37053]: pgmap v1542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:41 smithi063 ceph-mon[36747]: pgmap v1542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:05:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:05:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:05:44.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:05:44.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:05:44.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:43 smithi133 ceph-mon[37053]: pgmap v1543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:44.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:43 smithi133 ceph-mon[37053]: pgmap v1544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:05:44.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:05:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:05:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:05:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:43 smithi063 ceph-mon[36747]: pgmap v1543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:44.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:43 smithi063 ceph-mon[36747]: pgmap v1544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:05:44.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:43 smithi043 ceph-mon[32384]: pgmap v1543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:43 smithi043 ceph-mon[32384]: pgmap v1544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:05:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:46 smithi043 ceph-mon[32384]: pgmap v1545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:05:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1791.746175 secs 2024-07-26T09:05:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1807.231286 secs 2024-07-26T09:05:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:46 smithi133 ceph-mon[37053]: pgmap v1545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:05:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1791.746175 secs 2024-07-26T09:05:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1807.231286 secs 2024-07-26T09:05:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:46 smithi063 ceph-mon[36747]: pgmap v1545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:05:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1791.746175 secs 2024-07-26T09:05:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1807.231286 secs 2024-07-26T09:05:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:48 smithi043 ceph-mon[32384]: pgmap v1546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:05:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:48 smithi133 ceph-mon[37053]: pgmap v1546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:05:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:48 smithi063 ceph-mon[36747]: pgmap v1546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:05:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:50 smithi043 ceph-mon[32384]: pgmap v1547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:50 smithi133 ceph-mon[37053]: pgmap v1547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:50 smithi063 ceph-mon[36747]: pgmap v1547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1796.746272 secs 2024-07-26T09:05:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1812.231359 secs 2024-07-26T09:05:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1796.746272 secs 2024-07-26T09:05:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1812.231359 secs 2024-07-26T09:05:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1796.746272 secs 2024-07-26T09:05:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1812.231359 secs 2024-07-26T09:05:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:52 smithi043 ceph-mon[32384]: pgmap v1548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:52 smithi133 ceph-mon[37053]: pgmap v1548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:52 smithi063 ceph-mon[36747]: pgmap v1548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:05:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:54 smithi043 ceph-mon[32384]: pgmap v1549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:05:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:54 smithi133 ceph-mon[37053]: pgmap v1549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:05:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:54 smithi063 ceph-mon[36747]: pgmap v1549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:05:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:56 smithi043 ceph-mon[32384]: pgmap v1550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1801.746395 secs 2024-07-26T09:05:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1817.231508 secs 2024-07-26T09:05:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:56 smithi133 ceph-mon[37053]: pgmap v1550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1801.746395 secs 2024-07-26T09:05:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1817.231508 secs 2024-07-26T09:05:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:56 smithi063 ceph-mon[36747]: pgmap v1550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:05:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1801.746395 secs 2024-07-26T09:05:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1817.231508 secs 2024-07-26T09:05:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:05:58 smithi043 ceph-mon[32384]: pgmap v1551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:05:58 smithi133 ceph-mon[37053]: pgmap v1551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:05:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:05:58 smithi063 ceph-mon[36747]: pgmap v1551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:00 smithi043 ceph-mon[32384]: pgmap v1552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:00 smithi133 ceph-mon[37053]: pgmap v1552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:00 smithi063 ceph-mon[36747]: pgmap v1552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1806.746546 secs 2024-07-26T09:06:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1822.231636 secs 2024-07-26T09:06:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1806.746546 secs 2024-07-26T09:06:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1822.231636 secs 2024-07-26T09:06:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1806.746546 secs 2024-07-26T09:06:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1822.231636 secs 2024-07-26T09:06:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:02 smithi043 ceph-mon[32384]: pgmap v1553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:02 smithi133 ceph-mon[37053]: pgmap v1553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:02 smithi063 ceph-mon[36747]: pgmap v1553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:04 smithi043 ceph-mon[32384]: pgmap v1554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:04 smithi133 ceph-mon[37053]: pgmap v1554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:04 smithi063 ceph-mon[36747]: pgmap v1554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:06 smithi043 ceph-mon[32384]: pgmap v1555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1811.746680 secs 2024-07-26T09:06:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1827.231766 secs 2024-07-26T09:06:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:06 smithi133 ceph-mon[37053]: pgmap v1555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1811.746680 secs 2024-07-26T09:06:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1827.231766 secs 2024-07-26T09:06:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:06 smithi063 ceph-mon[36747]: pgmap v1555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1811.746680 secs 2024-07-26T09:06:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1827.231766 secs 2024-07-26T09:06:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:08 smithi043 ceph-mon[32384]: pgmap v1556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:08 smithi133 ceph-mon[37053]: pgmap v1556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:08 smithi063 ceph-mon[36747]: pgmap v1556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:10 smithi133 ceph-mon[37053]: pgmap v1557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:10 smithi063 ceph-mon[36747]: pgmap v1557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:10 smithi043 ceph-mon[32384]: pgmap v1557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1816.746801 secs 2024-07-26T09:06:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1832.231911 secs 2024-07-26T09:06:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1816.746801 secs 2024-07-26T09:06:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1832.231911 secs 2024-07-26T09:06:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1816.746801 secs 2024-07-26T09:06:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1832.231911 secs 2024-07-26T09:06:12.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:12 smithi133 ceph-mon[37053]: pgmap v1558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:12 smithi063 ceph-mon[36747]: pgmap v1558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:12.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:12 smithi043 ceph-mon[32384]: pgmap v1558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:14 smithi133 ceph-mon[37053]: pgmap v1559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:14 smithi063 ceph-mon[36747]: pgmap v1559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:14 smithi043 ceph-mon[32384]: pgmap v1559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:16 smithi133 ceph-mon[37053]: pgmap v1560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1821.746859 secs 2024-07-26T09:06:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1837.232061 secs 2024-07-26T09:06:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:16 smithi063 ceph-mon[36747]: pgmap v1560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1821.746859 secs 2024-07-26T09:06:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1837.232061 secs 2024-07-26T09:06:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:16 smithi043 ceph-mon[32384]: pgmap v1560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1821.746859 secs 2024-07-26T09:06:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1837.232061 secs 2024-07-26T09:06:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:18 smithi133 ceph-mon[37053]: pgmap v1561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:18 smithi063 ceph-mon[36747]: pgmap v1561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:18 smithi043 ceph-mon[32384]: pgmap v1561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:20 smithi063 ceph-mon[36747]: pgmap v1562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:20 smithi043 ceph-mon[32384]: pgmap v1562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:20 smithi133 ceph-mon[37053]: pgmap v1562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1826.747000 secs 2024-07-26T09:06:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1842.232196 secs 2024-07-26T09:06:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1826.747000 secs 2024-07-26T09:06:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1842.232196 secs 2024-07-26T09:06:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1826.747000 secs 2024-07-26T09:06:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1842.232196 secs 2024-07-26T09:06:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:22 smithi063 ceph-mon[36747]: pgmap v1563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:22 smithi043 ceph-mon[32384]: pgmap v1563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:22 smithi133 ceph-mon[37053]: pgmap v1563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:24 smithi063 ceph-mon[36747]: pgmap v1564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:24 smithi043 ceph-mon[32384]: pgmap v1564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:24 smithi133 ceph-mon[37053]: pgmap v1564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1831.747141 secs 2024-07-26T09:06:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:26 smithi063 ceph-mon[36747]: pgmap v1565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1847.232358 secs 2024-07-26T09:06:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1831.747141 secs 2024-07-26T09:06:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:26 smithi043 ceph-mon[32384]: pgmap v1565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1847.232358 secs 2024-07-26T09:06:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1831.747141 secs 2024-07-26T09:06:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:26 smithi133 ceph-mon[37053]: pgmap v1565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1847.232358 secs 2024-07-26T09:06:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:28 smithi043 ceph-mon[32384]: pgmap v1566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:28 smithi063 ceph-mon[36747]: pgmap v1566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:28 smithi133 ceph-mon[37053]: pgmap v1566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:30 smithi063 ceph-mon[36747]: pgmap v1567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:30 smithi043 ceph-mon[32384]: pgmap v1567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:30 smithi133 ceph-mon[37053]: pgmap v1567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1836.747231 secs 2024-07-26T09:06:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1852.232509 secs 2024-07-26T09:06:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1836.747231 secs 2024-07-26T09:06:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1852.232509 secs 2024-07-26T09:06:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1836.747231 secs 2024-07-26T09:06:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1852.232509 secs 2024-07-26T09:06:32.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:32 smithi133 ceph-mon[37053]: pgmap v1568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:32 smithi043 ceph-mon[32384]: pgmap v1568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:32 smithi063 ceph-mon[36747]: pgmap v1568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:34 smithi043 ceph-mon[32384]: pgmap v1569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:34 smithi133 ceph-mon[37053]: pgmap v1569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:34 smithi063 ceph-mon[36747]: pgmap v1569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1841.747346 secs 2024-07-26T09:06:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:36 smithi043 ceph-mon[32384]: pgmap v1570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1857.232607 secs 2024-07-26T09:06:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1841.747346 secs 2024-07-26T09:06:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:36 smithi133 ceph-mon[37053]: pgmap v1570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1857.232607 secs 2024-07-26T09:06:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1841.747346 secs 2024-07-26T09:06:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:36 smithi063 ceph-mon[36747]: pgmap v1570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:06:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1857.232607 secs 2024-07-26T09:06:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:38 smithi043 ceph-mon[32384]: pgmap v1571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:38 smithi133 ceph-mon[37053]: pgmap v1571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:38 smithi063 ceph-mon[36747]: pgmap v1571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:40 smithi043 ceph-mon[32384]: pgmap v1572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:40 smithi133 ceph-mon[37053]: pgmap v1572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:40 smithi063 ceph-mon[36747]: pgmap v1572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1846.747465 secs 2024-07-26T09:06:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1862.232734 secs 2024-07-26T09:06:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1846.747465 secs 2024-07-26T09:06:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1862.232734 secs 2024-07-26T09:06:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1846.747465 secs 2024-07-26T09:06:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1862.232734 secs 2024-07-26T09:06:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:42 smithi043 ceph-mon[32384]: pgmap v1573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:42 smithi133 ceph-mon[37053]: pgmap v1573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:42 smithi063 ceph-mon[36747]: pgmap v1573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:06:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:06:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: pgmap v1574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:06:44.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: pgmap v1574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:06:44.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: pgmap v1574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:06:44.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:06:44.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:06:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:45 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:06:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:45 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:06:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:45 smithi043 ceph-mon[32384]: pgmap v1575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:06:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:45 smithi043 ceph-mon[32384]: pgmap v1576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:06:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:06:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:45 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:06:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:45 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:06:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:45 smithi133 ceph-mon[37053]: pgmap v1575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:06:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:45 smithi133 ceph-mon[37053]: pgmap v1576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:06:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:06:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:45 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:06:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:45 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:06:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:45 smithi063 ceph-mon[36747]: pgmap v1575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:06:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:45 smithi063 ceph-mon[36747]: pgmap v1576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:06:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:06:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1851.747601 secs 2024-07-26T09:06:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1867.232878 secs 2024-07-26T09:06:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1851.747601 secs 2024-07-26T09:06:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1867.232878 secs 2024-07-26T09:06:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1851.747601 secs 2024-07-26T09:06:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1867.232878 secs 2024-07-26T09:06:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:47 smithi133 ceph-mon[37053]: pgmap v1577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:06:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:47 smithi063 ceph-mon[36747]: pgmap v1577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:06:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:47 smithi043 ceph-mon[32384]: pgmap v1577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:06:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:49 smithi133 ceph-mon[37053]: pgmap v1578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:06:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:49 smithi063 ceph-mon[36747]: pgmap v1578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:06:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:49 smithi043 ceph-mon[32384]: pgmap v1578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:06:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1856.747692 secs 2024-07-26T09:06:51.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1856.747692 secs 2024-07-26T09:06:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1856.747692 secs 2024-07-26T09:06:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:51 smithi133 ceph-mon[37053]: pgmap v1579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:06:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1872.232965 secs 2024-07-26T09:06:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:51 smithi063 ceph-mon[36747]: pgmap v1579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:06:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1872.232965 secs 2024-07-26T09:06:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:51 smithi043 ceph-mon[32384]: pgmap v1579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:06:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1872.232965 secs 2024-07-26T09:06:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:53 smithi063 ceph-mon[36747]: pgmap v1580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:06:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:53 smithi043 ceph-mon[32384]: pgmap v1580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:06:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:53 smithi133 ceph-mon[37053]: pgmap v1580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:06:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:55 smithi063 ceph-mon[36747]: pgmap v1581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:06:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1861.747805 secs 2024-07-26T09:06:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:55 smithi043 ceph-mon[32384]: pgmap v1581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:06:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1861.747805 secs 2024-07-26T09:06:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:55 smithi133 ceph-mon[37053]: pgmap v1581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:06:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1861.747805 secs 2024-07-26T09:06:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1877.233087 secs 2024-07-26T09:06:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1877.233087 secs 2024-07-26T09:06:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1877.233087 secs 2024-07-26T09:06:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:57 smithi063 ceph-mon[36747]: pgmap v1582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:58.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:57 smithi043 ceph-mon[32384]: pgmap v1582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:06:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:57 smithi133 ceph-mon[37053]: pgmap v1582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:06:59 smithi063 ceph-mon[36747]: pgmap v1583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:06:59 smithi043 ceph-mon[32384]: pgmap v1583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:06:59 smithi133 ceph-mon[37053]: pgmap v1583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1866.747928 secs 2024-07-26T09:07:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1882.233174 secs 2024-07-26T09:07:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1866.747928 secs 2024-07-26T09:07:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1882.233174 secs 2024-07-26T09:07:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1866.747928 secs 2024-07-26T09:07:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1882.233174 secs 2024-07-26T09:07:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:01 smithi063 ceph-mon[36747]: pgmap v1584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:02.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:01 smithi133 ceph-mon[37053]: pgmap v1584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:01 smithi043 ceph-mon[32384]: pgmap v1584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:03 smithi063 ceph-mon[36747]: pgmap v1585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:03 smithi043 ceph-mon[32384]: pgmap v1585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:03 smithi133 ceph-mon[37053]: pgmap v1585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:05 smithi043 ceph-mon[32384]: pgmap v1586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1871.748061 secs 2024-07-26T09:07:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1887.233239 secs 2024-07-26T09:07:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:05 smithi133 ceph-mon[37053]: pgmap v1586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1871.748061 secs 2024-07-26T09:07:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1887.233239 secs 2024-07-26T09:07:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:05 smithi063 ceph-mon[36747]: pgmap v1586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1871.748061 secs 2024-07-26T09:07:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1887.233239 secs 2024-07-26T09:07:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:07 smithi043 ceph-mon[32384]: pgmap v1587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:07 smithi133 ceph-mon[37053]: pgmap v1587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:07 smithi063 ceph-mon[36747]: pgmap v1587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:09 smithi043 ceph-mon[32384]: pgmap v1588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:09 smithi133 ceph-mon[37053]: pgmap v1588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:09 smithi063 ceph-mon[36747]: pgmap v1588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1876.748181 secs 2024-07-26T09:07:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1892.233324 secs 2024-07-26T09:07:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1876.748181 secs 2024-07-26T09:07:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1892.233324 secs 2024-07-26T09:07:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1876.748181 secs 2024-07-26T09:07:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1892.233324 secs 2024-07-26T09:07:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:11 smithi043 ceph-mon[32384]: pgmap v1589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:11 smithi133 ceph-mon[37053]: pgmap v1589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:11 smithi063 ceph-mon[36747]: pgmap v1589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:13 smithi043 ceph-mon[32384]: pgmap v1590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:13 smithi133 ceph-mon[37053]: pgmap v1590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:13 smithi063 ceph-mon[36747]: pgmap v1590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:16.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:15 smithi043 ceph-mon[32384]: pgmap v1591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:16.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1881.748299 secs 2024-07-26T09:07:16.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1897.233443 secs 2024-07-26T09:07:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:15 smithi133 ceph-mon[37053]: pgmap v1591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1881.748299 secs 2024-07-26T09:07:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1897.233443 secs 2024-07-26T09:07:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:15 smithi063 ceph-mon[36747]: pgmap v1591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1881.748299 secs 2024-07-26T09:07:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1897.233443 secs 2024-07-26T09:07:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:17 smithi043 ceph-mon[32384]: pgmap v1592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:17 smithi133 ceph-mon[37053]: pgmap v1592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:17 smithi063 ceph-mon[36747]: pgmap v1592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:19 smithi043 ceph-mon[32384]: pgmap v1593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:19 smithi133 ceph-mon[37053]: pgmap v1593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:19 smithi063 ceph-mon[36747]: pgmap v1593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1886.748440 secs 2024-07-26T09:07:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1902.233541 secs 2024-07-26T09:07:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1886.748440 secs 2024-07-26T09:07:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1902.233541 secs 2024-07-26T09:07:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1886.748440 secs 2024-07-26T09:07:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1902.233541 secs 2024-07-26T09:07:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:21 smithi043 ceph-mon[32384]: pgmap v1594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:21 smithi133 ceph-mon[37053]: pgmap v1594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:21 smithi063 ceph-mon[36747]: pgmap v1594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:23 smithi043 ceph-mon[32384]: pgmap v1595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:23 smithi133 ceph-mon[37053]: pgmap v1595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:23 smithi063 ceph-mon[36747]: pgmap v1595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:25 smithi043 ceph-mon[32384]: pgmap v1596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1891.748559 secs 2024-07-26T09:07:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1907.233665 secs 2024-07-26T09:07:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:25 smithi133 ceph-mon[37053]: pgmap v1596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1891.748559 secs 2024-07-26T09:07:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1907.233665 secs 2024-07-26T09:07:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:25 smithi063 ceph-mon[36747]: pgmap v1596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1891.748559 secs 2024-07-26T09:07:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1907.233665 secs 2024-07-26T09:07:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:27 smithi043 ceph-mon[32384]: pgmap v1597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:27 smithi133 ceph-mon[37053]: pgmap v1597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:27 smithi063 ceph-mon[36747]: pgmap v1597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:30.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:29 smithi043 ceph-mon[32384]: pgmap v1598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:29 smithi133 ceph-mon[37053]: pgmap v1598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:29 smithi063 ceph-mon[36747]: pgmap v1598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1896.748634 secs 2024-07-26T09:07:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1912.233814 secs 2024-07-26T09:07:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1896.748634 secs 2024-07-26T09:07:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1912.233814 secs 2024-07-26T09:07:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1896.748634 secs 2024-07-26T09:07:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1912.233814 secs 2024-07-26T09:07:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:31 smithi043 ceph-mon[32384]: pgmap v1599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:31 smithi133 ceph-mon[37053]: pgmap v1599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:31 smithi063 ceph-mon[36747]: pgmap v1599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:33 smithi043 ceph-mon[32384]: pgmap v1600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:33 smithi133 ceph-mon[37053]: pgmap v1600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:33 smithi063 ceph-mon[36747]: pgmap v1600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:35 smithi043 ceph-mon[32384]: pgmap v1601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1901.748757 secs 2024-07-26T09:07:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1917.233947 secs 2024-07-26T09:07:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:35 smithi133 ceph-mon[37053]: pgmap v1601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1901.748757 secs 2024-07-26T09:07:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1917.233947 secs 2024-07-26T09:07:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:35 smithi063 ceph-mon[36747]: pgmap v1601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1901.748757 secs 2024-07-26T09:07:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1917.233947 secs 2024-07-26T09:07:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:36 smithi043 ceph-mon[32384]: pgmap v1602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:36 smithi133 ceph-mon[37053]: pgmap v1602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:36 smithi063 ceph-mon[36747]: pgmap v1602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:07:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:39 smithi043 ceph-mon[32384]: pgmap v1603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:39 smithi133 ceph-mon[37053]: pgmap v1603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:39 smithi063 ceph-mon[36747]: pgmap v1603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1906.748898 secs 2024-07-26T09:07:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1906.748898 secs 2024-07-26T09:07:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1906.748898 secs 2024-07-26T09:07:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:41 smithi043 ceph-mon[32384]: pgmap v1604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1922.234017 secs 2024-07-26T09:07:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:41 smithi133 ceph-mon[37053]: pgmap v1604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1922.234017 secs 2024-07-26T09:07:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:41 smithi063 ceph-mon[36747]: pgmap v1604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:07:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1922.234017 secs 2024-07-26T09:07:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:43 smithi043 ceph-mon[32384]: pgmap v1605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:43 smithi133 ceph-mon[37053]: pgmap v1605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:43 smithi063 ceph-mon[36747]: pgmap v1605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: pgmap v1606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1911.749053 secs 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: pgmap v1606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:07:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1911.749053 secs 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: pgmap v1606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:07:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1911.749053 secs 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:45.820 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:07:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1927.234101 secs 2024-07-26T09:07:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:07:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:07:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: pgmap v1607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:07:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: pgmap v1608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:07:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1927.234101 secs 2024-07-26T09:07:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:07:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:07:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: pgmap v1607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:07:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: pgmap v1608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:07:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:07:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1927.234101 secs 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: pgmap v1607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: pgmap v1608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:07:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:48 smithi133 ceph-mon[37053]: pgmap v1609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:48 smithi063 ceph-mon[36747]: pgmap v1609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:48 smithi043 ceph-mon[32384]: pgmap v1609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:50 smithi133 ceph-mon[37053]: pgmap v1610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1916.749171 secs 2024-07-26T09:07:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:50 smithi063 ceph-mon[36747]: pgmap v1610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1916.749171 secs 2024-07-26T09:07:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:50 smithi043 ceph-mon[32384]: pgmap v1610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1916.749171 secs 2024-07-26T09:07:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1932.234183 secs 2024-07-26T09:07:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1932.234183 secs 2024-07-26T09:07:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1932.234183 secs 2024-07-26T09:07:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:52 smithi133 ceph-mon[37053]: pgmap v1611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:07:53.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:52 smithi063 ceph-mon[36747]: pgmap v1611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:07:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:52 smithi043 ceph-mon[32384]: pgmap v1611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:07:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:54 smithi063 ceph-mon[36747]: pgmap v1612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:54 smithi043 ceph-mon[32384]: pgmap v1612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:54 smithi133 ceph-mon[37053]: pgmap v1612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:07:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1921.749301 secs 2024-07-26T09:07:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1921.749301 secs 2024-07-26T09:07:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1921.749301 secs 2024-07-26T09:07:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1937.234306 secs 2024-07-26T09:07:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:56 smithi063 ceph-mon[36747]: pgmap v1613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:07:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1937.234306 secs 2024-07-26T09:07:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:56 smithi043 ceph-mon[32384]: pgmap v1613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:07:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1937.234306 secs 2024-07-26T09:07:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:56 smithi133 ceph-mon[37053]: pgmap v1613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:07:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:07:58 smithi063 ceph-mon[36747]: pgmap v1614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:07:58 smithi043 ceph-mon[32384]: pgmap v1614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:07:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:07:58 smithi133 ceph-mon[37053]: pgmap v1614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:00 smithi063 ceph-mon[36747]: pgmap v1615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1926.749431 secs 2024-07-26T09:08:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1942.234453 secs 2024-07-26T09:08:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:00 smithi043 ceph-mon[32384]: pgmap v1615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1926.749431 secs 2024-07-26T09:08:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1942.234453 secs 2024-07-26T09:08:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:00 smithi133 ceph-mon[37053]: pgmap v1615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1926.749431 secs 2024-07-26T09:08:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1942.234453 secs 2024-07-26T09:08:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:02 smithi063 ceph-mon[36747]: pgmap v1616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:03.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:02 smithi133 ceph-mon[37053]: pgmap v1616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:02 smithi043 ceph-mon[32384]: pgmap v1616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:04 smithi063 ceph-mon[36747]: pgmap v1617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:04 smithi043 ceph-mon[32384]: pgmap v1617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:04 smithi133 ceph-mon[37053]: pgmap v1617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1931.749545 secs 2024-07-26T09:08:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1947.234582 secs 2024-07-26T09:08:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1931.749545 secs 2024-07-26T09:08:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1947.234582 secs 2024-07-26T09:08:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1931.749545 secs 2024-07-26T09:08:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1947.234582 secs 2024-07-26T09:08:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:06 smithi043 ceph-mon[32384]: pgmap v1618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:06 smithi133 ceph-mon[37053]: pgmap v1618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:06 smithi063 ceph-mon[36747]: pgmap v1618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:08 smithi043 ceph-mon[32384]: pgmap v1619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:08 smithi133 ceph-mon[37053]: pgmap v1619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:08 smithi063 ceph-mon[36747]: pgmap v1619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:10 smithi043 ceph-mon[32384]: pgmap v1620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1936.749664 secs 2024-07-26T09:08:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1952.234704 secs 2024-07-26T09:08:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:10 smithi133 ceph-mon[37053]: pgmap v1620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1936.749664 secs 2024-07-26T09:08:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1952.234704 secs 2024-07-26T09:08:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:10 smithi063 ceph-mon[36747]: pgmap v1620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1936.749664 secs 2024-07-26T09:08:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1952.234704 secs 2024-07-26T09:08:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:12 smithi043 ceph-mon[32384]: pgmap v1621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:12 smithi133 ceph-mon[37053]: pgmap v1621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:12 smithi063 ceph-mon[36747]: pgmap v1621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:14 smithi043 ceph-mon[32384]: pgmap v1622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:14 smithi133 ceph-mon[37053]: pgmap v1622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:14 smithi063 ceph-mon[36747]: pgmap v1622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1941.749799 secs 2024-07-26T09:08:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1957.234768 secs 2024-07-26T09:08:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1941.749799 secs 2024-07-26T09:08:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1957.234768 secs 2024-07-26T09:08:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1941.749799 secs 2024-07-26T09:08:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1957.234768 secs 2024-07-26T09:08:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:16 smithi043 ceph-mon[32384]: pgmap v1623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:16 smithi133 ceph-mon[37053]: pgmap v1623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:16 smithi063 ceph-mon[36747]: pgmap v1623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:18 smithi043 ceph-mon[32384]: pgmap v1624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:18 smithi133 ceph-mon[37053]: pgmap v1624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:18 smithi063 ceph-mon[36747]: pgmap v1624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:20 smithi043 ceph-mon[32384]: pgmap v1625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1946.749915 secs 2024-07-26T09:08:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1962.234875 secs 2024-07-26T09:08:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:20 smithi133 ceph-mon[37053]: pgmap v1625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1946.749915 secs 2024-07-26T09:08:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1962.234875 secs 2024-07-26T09:08:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:20 smithi063 ceph-mon[36747]: pgmap v1625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1946.749915 secs 2024-07-26T09:08:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1962.234875 secs 2024-07-26T09:08:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:22 smithi043 ceph-mon[32384]: pgmap v1626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:22 smithi133 ceph-mon[37053]: pgmap v1626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:22 smithi063 ceph-mon[36747]: pgmap v1626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:24 smithi043 ceph-mon[32384]: pgmap v1627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:24 smithi133 ceph-mon[37053]: pgmap v1627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:24 smithi063 ceph-mon[36747]: pgmap v1627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1951.750055 secs 2024-07-26T09:08:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1967.234961 secs 2024-07-26T09:08:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1951.750055 secs 2024-07-26T09:08:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1967.234961 secs 2024-07-26T09:08:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1951.750055 secs 2024-07-26T09:08:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1967.234961 secs 2024-07-26T09:08:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:26 smithi043 ceph-mon[32384]: pgmap v1628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:26 smithi133 ceph-mon[37053]: pgmap v1628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:26 smithi063 ceph-mon[36747]: pgmap v1628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:28 smithi043 ceph-mon[32384]: pgmap v1629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:28 smithi133 ceph-mon[37053]: pgmap v1629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:28 smithi063 ceph-mon[36747]: pgmap v1629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:30 smithi043 ceph-mon[32384]: pgmap v1630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1956.750193 secs 2024-07-26T09:08:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1972.235027 secs 2024-07-26T09:08:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:30 smithi133 ceph-mon[37053]: pgmap v1630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1956.750193 secs 2024-07-26T09:08:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1972.235027 secs 2024-07-26T09:08:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:30 smithi063 ceph-mon[36747]: pgmap v1630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1956.750193 secs 2024-07-26T09:08:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1972.235027 secs 2024-07-26T09:08:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:32 smithi043 ceph-mon[32384]: pgmap v1631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:32 smithi133 ceph-mon[37053]: pgmap v1631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:32 smithi063 ceph-mon[36747]: pgmap v1631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:34 smithi043 ceph-mon[32384]: pgmap v1632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:34 smithi133 ceph-mon[37053]: pgmap v1632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:34 smithi063 ceph-mon[36747]: pgmap v1632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1961.750310 secs 2024-07-26T09:08:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1977.235154 secs 2024-07-26T09:08:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1961.750310 secs 2024-07-26T09:08:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1977.235154 secs 2024-07-26T09:08:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1961.750310 secs 2024-07-26T09:08:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1977.235154 secs 2024-07-26T09:08:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:36 smithi043 ceph-mon[32384]: pgmap v1633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:36 smithi133 ceph-mon[37053]: pgmap v1633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:36 smithi063 ceph-mon[36747]: pgmap v1633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:38 smithi043 ceph-mon[32384]: pgmap v1634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:38 smithi133 ceph-mon[37053]: pgmap v1634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:38 smithi063 ceph-mon[36747]: pgmap v1634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:40 smithi043 ceph-mon[32384]: pgmap v1635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1966.750430 secs 2024-07-26T09:08:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1982.235274 secs 2024-07-26T09:08:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:40 smithi133 ceph-mon[37053]: pgmap v1635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1966.750430 secs 2024-07-26T09:08:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1982.235274 secs 2024-07-26T09:08:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:40 smithi063 ceph-mon[36747]: pgmap v1635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:08:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1966.750430 secs 2024-07-26T09:08:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1982.235274 secs 2024-07-26T09:08:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:41 smithi043 ceph-mon[32384]: pgmap v1636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:41 smithi133 ceph-mon[37053]: pgmap v1636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:41 smithi063 ceph-mon[36747]: pgmap v1636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:44 smithi063 ceph-mon[36747]: pgmap v1637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:44 smithi043 ceph-mon[32384]: pgmap v1637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:44 smithi133 ceph-mon[37053]: pgmap v1637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:08:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1971.750509 secs 2024-07-26T09:08:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1971.750509 secs 2024-07-26T09:08:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1971.750509 secs 2024-07-26T09:08:47.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1987.235412 secs 2024-07-26T09:08:47.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:46 smithi063 ceph-mon[36747]: pgmap v1638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:47.071 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:08:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1987.235412 secs 2024-07-26T09:08:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:46 smithi043 ceph-mon[32384]: pgmap v1638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:08:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1987.235412 secs 2024-07-26T09:08:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:46 smithi133 ceph-mon[37053]: pgmap v1638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:08:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:08:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:08:48.109 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:08:48.110 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:08:48.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:08:48.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:08:48.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:08:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:08:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:08:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:08:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:48 smithi063 ceph-mon[36747]: pgmap v1639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:08:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:48 smithi063 ceph-mon[36747]: pgmap v1640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:08:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:48 smithi043 ceph-mon[32384]: pgmap v1639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:08:49.345 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:48 smithi043 ceph-mon[32384]: pgmap v1640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:08:49.346 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:48 smithi133 ceph-mon[37053]: pgmap v1639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:08:49.346 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:48 smithi133 ceph-mon[37053]: pgmap v1640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:08:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:50 smithi063 ceph-mon[36747]: pgmap v1641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:08:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1976.750609 secs 2024-07-26T09:08:51.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1992.235539 secs 2024-07-26T09:08:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:50 smithi043 ceph-mon[32384]: pgmap v1641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:08:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1976.750609 secs 2024-07-26T09:08:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1992.235539 secs 2024-07-26T09:08:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:50 smithi133 ceph-mon[37053]: pgmap v1641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:08:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1976.750609 secs 2024-07-26T09:08:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1992.235539 secs 2024-07-26T09:08:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:52 smithi043 ceph-mon[32384]: pgmap v1642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:08:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:52 smithi133 ceph-mon[37053]: pgmap v1642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:08:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:52 smithi063 ceph-mon[36747]: pgmap v1642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:08:55.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:54 smithi043 ceph-mon[32384]: pgmap v1643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:08:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:54 smithi133 ceph-mon[37053]: pgmap v1643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:08:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:54 smithi063 ceph-mon[36747]: pgmap v1643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:08:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1981.750745 secs 2024-07-26T09:08:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 1997.235634 secs 2024-07-26T09:08:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1981.750745 secs 2024-07-26T09:08:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 1997.235634 secs 2024-07-26T09:08:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1981.750745 secs 2024-07-26T09:08:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 1997.235634 secs 2024-07-26T09:08:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:56 smithi043 ceph-mon[32384]: pgmap v1644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:08:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:56 smithi133 ceph-mon[37053]: pgmap v1644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:08:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:56 smithi063 ceph-mon[36747]: pgmap v1644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:08:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:08:58 smithi043 ceph-mon[32384]: pgmap v1645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:08:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:08:58 smithi133 ceph-mon[37053]: pgmap v1645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:08:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:08:58 smithi063 ceph-mon[36747]: pgmap v1645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:00 smithi063 ceph-mon[36747]: pgmap v1646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1986.750884 secs 2024-07-26T09:09:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2002.235730 secs 2024-07-26T09:09:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:00 smithi043 ceph-mon[32384]: pgmap v1646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1986.750884 secs 2024-07-26T09:09:01.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2002.235730 secs 2024-07-26T09:09:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:00 smithi133 ceph-mon[37053]: pgmap v1646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1986.750884 secs 2024-07-26T09:09:01.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2002.235730 secs 2024-07-26T09:09:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:02 smithi043 ceph-mon[32384]: pgmap v1647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:02 smithi133 ceph-mon[37053]: pgmap v1647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:02 smithi063 ceph-mon[36747]: pgmap v1647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:04 smithi043 ceph-mon[32384]: pgmap v1648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:04 smithi133 ceph-mon[37053]: pgmap v1648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:04 smithi063 ceph-mon[36747]: pgmap v1648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1991.751013 secs 2024-07-26T09:09:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2007.235882 secs 2024-07-26T09:09:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1991.751013 secs 2024-07-26T09:09:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2007.235882 secs 2024-07-26T09:09:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1991.751013 secs 2024-07-26T09:09:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2007.235882 secs 2024-07-26T09:09:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:06 smithi043 ceph-mon[32384]: pgmap v1649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:06 smithi133 ceph-mon[37053]: pgmap v1649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:07.388 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:06 smithi063 ceph-mon[36747]: pgmap v1649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:08 smithi043 ceph-mon[32384]: pgmap v1650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:09.348 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:08 smithi063 ceph-mon[36747]: pgmap v1650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:09.348 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:08 smithi133 ceph-mon[37053]: pgmap v1650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:10 smithi043 ceph-mon[32384]: pgmap v1651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 1996.751170 secs 2024-07-26T09:09:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2012.236026 secs 2024-07-26T09:09:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:10 smithi133 ceph-mon[37053]: pgmap v1651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 1996.751170 secs 2024-07-26T09:09:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2012.236026 secs 2024-07-26T09:09:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:10 smithi063 ceph-mon[36747]: pgmap v1651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 1996.751170 secs 2024-07-26T09:09:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2012.236026 secs 2024-07-26T09:09:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:12 smithi043 ceph-mon[32384]: pgmap v1652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:12 smithi133 ceph-mon[37053]: pgmap v1652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:12 smithi063 ceph-mon[36747]: pgmap v1652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:14 smithi043 ceph-mon[32384]: pgmap v1653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:14 smithi133 ceph-mon[37053]: pgmap v1653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:14 smithi063 ceph-mon[36747]: pgmap v1653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2001.751291 secs 2024-07-26T09:09:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2017.236157 secs 2024-07-26T09:09:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2001.751291 secs 2024-07-26T09:09:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2017.236157 secs 2024-07-26T09:09:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2001.751291 secs 2024-07-26T09:09:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2017.236157 secs 2024-07-26T09:09:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:16 smithi043 ceph-mon[32384]: pgmap v1654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:09:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:16 smithi133 ceph-mon[37053]: pgmap v1654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:09:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:16 smithi063 ceph-mon[36747]: pgmap v1654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:09:19.227 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:18 smithi043 ceph-mon[32384]: pgmap v1655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:18 smithi133 ceph-mon[37053]: pgmap v1655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:18 smithi063 ceph-mon[36747]: pgmap v1655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:20 smithi043 ceph-mon[32384]: pgmap v1656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2006.751429 secs 2024-07-26T09:09:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2022.236288 secs 2024-07-26T09:09:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:20 smithi133 ceph-mon[37053]: pgmap v1656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2006.751429 secs 2024-07-26T09:09:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2022.236288 secs 2024-07-26T09:09:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:20 smithi063 ceph-mon[36747]: pgmap v1656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2006.751429 secs 2024-07-26T09:09:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2022.236288 secs 2024-07-26T09:09:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:22 smithi043 ceph-mon[32384]: pgmap v1657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:22 smithi133 ceph-mon[37053]: pgmap v1657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:22 smithi063 ceph-mon[36747]: pgmap v1657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:09:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:24 smithi043 ceph-mon[32384]: pgmap v1658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:24 smithi133 ceph-mon[37053]: pgmap v1658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:24 smithi063 ceph-mon[36747]: pgmap v1658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2011.751537 secs 2024-07-26T09:09:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2027.236439 secs 2024-07-26T09:09:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2011.751537 secs 2024-07-26T09:09:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2027.236439 secs 2024-07-26T09:09:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2011.751537 secs 2024-07-26T09:09:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2027.236439 secs 2024-07-26T09:09:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:26 smithi043 ceph-mon[32384]: pgmap v1659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:26 smithi133 ceph-mon[37053]: pgmap v1659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:26 smithi063 ceph-mon[36747]: pgmap v1659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:28 smithi043 ceph-mon[32384]: pgmap v1660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:28 smithi133 ceph-mon[37053]: pgmap v1660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:28 smithi063 ceph-mon[36747]: pgmap v1660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:29 smithi043 ceph-mon[32384]: pgmap v1661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:29 smithi133 ceph-mon[37053]: pgmap v1661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:29 smithi063 ceph-mon[36747]: pgmap v1661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2016.751664 secs 2024-07-26T09:09:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2032.236524 secs 2024-07-26T09:09:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2016.751664 secs 2024-07-26T09:09:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2032.236524 secs 2024-07-26T09:09:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2016.751664 secs 2024-07-26T09:09:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2032.236524 secs 2024-07-26T09:09:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:31 smithi133 ceph-mon[37053]: pgmap v1662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:31 smithi063 ceph-mon[36747]: pgmap v1662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:31 smithi043 ceph-mon[32384]: pgmap v1662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:34 smithi063 ceph-mon[36747]: pgmap v1663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:34 smithi043 ceph-mon[32384]: pgmap v1663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:34 smithi133 ceph-mon[37053]: pgmap v1663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:36 smithi063 ceph-mon[36747]: pgmap v1664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2021.751792 secs 2024-07-26T09:09:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2037.236633 secs 2024-07-26T09:09:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:36 smithi043 ceph-mon[32384]: pgmap v1664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2021.751792 secs 2024-07-26T09:09:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2037.236633 secs 2024-07-26T09:09:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:36 smithi133 ceph-mon[37053]: pgmap v1664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2021.751792 secs 2024-07-26T09:09:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2037.236633 secs 2024-07-26T09:09:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:38 smithi063 ceph-mon[36747]: pgmap v1665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:38 smithi043 ceph-mon[32384]: pgmap v1665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:38 smithi133 ceph-mon[37053]: pgmap v1665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:40 smithi043 ceph-mon[32384]: pgmap v1666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:40 smithi133 ceph-mon[37053]: pgmap v1666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:40 smithi063 ceph-mon[36747]: pgmap v1666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2026.751916 secs 2024-07-26T09:09:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2042.236699 secs 2024-07-26T09:09:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2026.751916 secs 2024-07-26T09:09:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2042.236699 secs 2024-07-26T09:09:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2026.751916 secs 2024-07-26T09:09:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2042.236699 secs 2024-07-26T09:09:42.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:42 smithi043 ceph-mon[32384]: pgmap v1667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:42 smithi133 ceph-mon[37053]: pgmap v1667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:42 smithi063 ceph-mon[36747]: pgmap v1667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:44 smithi043 ceph-mon[32384]: pgmap v1668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:44 smithi133 ceph-mon[37053]: pgmap v1668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:44 smithi063 ceph-mon[36747]: pgmap v1668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:46 smithi043 ceph-mon[32384]: pgmap v1669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2031.752010 secs 2024-07-26T09:09:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2047.236840 secs 2024-07-26T09:09:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:46 smithi133 ceph-mon[37053]: pgmap v1669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2031.752010 secs 2024-07-26T09:09:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2047.236840 secs 2024-07-26T09:09:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:46 smithi063 ceph-mon[36747]: pgmap v1669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:09:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2031.752010 secs 2024-07-26T09:09:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2047.236840 secs 2024-07-26T09:09:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:48 smithi043 ceph-mon[32384]: pgmap v1670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:09:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:48 smithi133 ceph-mon[37053]: pgmap v1670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:09:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:48 smithi063 ceph-mon[36747]: pgmap v1670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:09:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:09:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:09:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:09:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:49 smithi043 ceph-mon[32384]: pgmap v1671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:49 smithi043 ceph-mon[32384]: pgmap v1672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:09:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:09:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:49 smithi133 ceph-mon[37053]: pgmap v1671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:49.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:49 smithi133 ceph-mon[37053]: pgmap v1672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:49.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:09:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:09:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:49 smithi063 ceph-mon[36747]: pgmap v1671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:09:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:49 smithi063 ceph-mon[36747]: pgmap v1672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:09:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2036.752170 secs 2024-07-26T09:09:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2036.752170 secs 2024-07-26T09:09:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2036.752170 secs 2024-07-26T09:09:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2052.236965 secs 2024-07-26T09:09:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:51 smithi133 ceph-mon[37053]: pgmap v1673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2052.236965 secs 2024-07-26T09:09:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:51 smithi063 ceph-mon[36747]: pgmap v1673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2052.236965 secs 2024-07-26T09:09:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:51 smithi043 ceph-mon[32384]: pgmap v1673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:09:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:53 smithi133 ceph-mon[37053]: pgmap v1674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:53 smithi063 ceph-mon[36747]: pgmap v1674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:53 smithi043 ceph-mon[32384]: pgmap v1674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:55 smithi133 ceph-mon[37053]: pgmap v1675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:55 smithi063 ceph-mon[36747]: pgmap v1675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:55 smithi043 ceph-mon[32384]: pgmap v1675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2041.752237 secs 2024-07-26T09:09:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2057.237082 secs 2024-07-26T09:09:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2041.752237 secs 2024-07-26T09:09:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2057.237082 secs 2024-07-26T09:09:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2041.752237 secs 2024-07-26T09:09:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2057.237082 secs 2024-07-26T09:09:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:57 smithi063 ceph-mon[36747]: pgmap v1676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:57 smithi043 ceph-mon[32384]: pgmap v1676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:57 smithi133 ceph-mon[37053]: pgmap v1676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:09:59 smithi133 ceph-mon[37053]: pgmap v1677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:09:59 smithi063 ceph-mon[36747]: pgmap v1677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:09:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:09:59 smithi043 ceph-mon[32384]: pgmap v1677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:10:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:10:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:10:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:10:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2046.752339 secs 2024-07-26T09:10:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2062.237189 secs 2024-07-26T09:10:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:01 smithi063 ceph-mon[36747]: pgmap v1678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:10:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2046.752339 secs 2024-07-26T09:10:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2062.237189 secs 2024-07-26T09:10:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:01 smithi043 ceph-mon[32384]: pgmap v1678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:10:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2046.752339 secs 2024-07-26T09:10:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2062.237189 secs 2024-07-26T09:10:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:01 smithi133 ceph-mon[37053]: pgmap v1678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:10:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:03 smithi133 ceph-mon[37053]: pgmap v1679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:10:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:03 smithi063 ceph-mon[36747]: pgmap v1679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:10:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:03 smithi043 ceph-mon[32384]: pgmap v1679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:10:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:05 smithi133 ceph-mon[37053]: pgmap v1680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:05.307 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:05 smithi043 ceph-mon[32384]: pgmap v1680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:05 smithi063 ceph-mon[36747]: pgmap v1680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2051.752466 secs 2024-07-26T09:10:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2067.237312 secs 2024-07-26T09:10:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2051.752466 secs 2024-07-26T09:10:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2067.237312 secs 2024-07-26T09:10:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2051.752466 secs 2024-07-26T09:10:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2067.237312 secs 2024-07-26T09:10:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:07 smithi063 ceph-mon[36747]: pgmap v1681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:07 smithi043 ceph-mon[32384]: pgmap v1681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:07 smithi133 ceph-mon[37053]: pgmap v1681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:09 smithi133 ceph-mon[37053]: pgmap v1682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:09 smithi063 ceph-mon[36747]: pgmap v1682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:09 smithi043 ceph-mon[32384]: pgmap v1682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2056.752585 secs 2024-07-26T09:10:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2056.752585 secs 2024-07-26T09:10:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2056.752585 secs 2024-07-26T09:10:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2072.237411 secs 2024-07-26T09:10:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:11 smithi133 ceph-mon[37053]: pgmap v1683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2072.237411 secs 2024-07-26T09:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:11 smithi063 ceph-mon[36747]: pgmap v1683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2072.237411 secs 2024-07-26T09:10:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:11 smithi043 ceph-mon[32384]: pgmap v1683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:13 smithi133 ceph-mon[37053]: pgmap v1684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:13 smithi063 ceph-mon[36747]: pgmap v1684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:13 smithi043 ceph-mon[32384]: pgmap v1684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:15 smithi063 ceph-mon[36747]: pgmap v1685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:15 smithi043 ceph-mon[32384]: pgmap v1685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:15 smithi133 ceph-mon[37053]: pgmap v1685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2061.752723 secs 2024-07-26T09:10:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2077.237547 secs 2024-07-26T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2061.752723 secs 2024-07-26T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2077.237547 secs 2024-07-26T09:10:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2061.752723 secs 2024-07-26T09:10:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2077.237547 secs 2024-07-26T09:10:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:17 smithi063 ceph-mon[36747]: pgmap v1686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:17 smithi043 ceph-mon[32384]: pgmap v1686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:17 smithi133 ceph-mon[37053]: pgmap v1686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:19 smithi063 ceph-mon[36747]: pgmap v1687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:19 smithi043 ceph-mon[32384]: pgmap v1687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:19 smithi133 ceph-mon[37053]: pgmap v1687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2066.752786 secs 2024-07-26T09:10:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2066.752786 secs 2024-07-26T09:10:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2066.752786 secs 2024-07-26T09:10:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2082.237624 secs 2024-07-26T09:10:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:21 smithi133 ceph-mon[37053]: pgmap v1688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2082.237624 secs 2024-07-26T09:10:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:21 smithi063 ceph-mon[36747]: pgmap v1688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2082.237624 secs 2024-07-26T09:10:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:21 smithi043 ceph-mon[32384]: pgmap v1688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:23 smithi063 ceph-mon[36747]: pgmap v1689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:23 smithi043 ceph-mon[32384]: pgmap v1689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:23 smithi133 ceph-mon[37053]: pgmap v1689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:25 smithi063 ceph-mon[36747]: pgmap v1690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:25 smithi043 ceph-mon[32384]: pgmap v1690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:25 smithi133 ceph-mon[37053]: pgmap v1690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2071.752949 secs 2024-07-26T09:10:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2087.237692 secs 2024-07-26T09:10:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2071.752949 secs 2024-07-26T09:10:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2087.237692 secs 2024-07-26T09:10:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2071.752949 secs 2024-07-26T09:10:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2087.237692 secs 2024-07-26T09:10:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:27 smithi063 ceph-mon[36747]: pgmap v1691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:27 smithi043 ceph-mon[32384]: pgmap v1691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:27 smithi133 ceph-mon[37053]: pgmap v1691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:29 smithi063 ceph-mon[36747]: pgmap v1692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:29 smithi043 ceph-mon[32384]: pgmap v1692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:29 smithi133 ceph-mon[37053]: pgmap v1692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2076.753087 secs 2024-07-26T09:10:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2076.753087 secs 2024-07-26T09:10:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2076.753087 secs 2024-07-26T09:10:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2092.237788 secs 2024-07-26T09:10:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:31 smithi133 ceph-mon[37053]: pgmap v1693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2092.237788 secs 2024-07-26T09:10:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:31 smithi063 ceph-mon[36747]: pgmap v1693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2092.237788 secs 2024-07-26T09:10:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:31 smithi043 ceph-mon[32384]: pgmap v1693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:33 smithi063 ceph-mon[36747]: pgmap v1694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:33 smithi043 ceph-mon[32384]: pgmap v1694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:33 smithi133 ceph-mon[37053]: pgmap v1694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:35 smithi063 ceph-mon[36747]: pgmap v1695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:35.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:35 smithi133 ceph-mon[37053]: pgmap v1695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:35 smithi043 ceph-mon[32384]: pgmap v1695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2081.753220 secs 2024-07-26T09:10:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2097.237919 secs 2024-07-26T09:10:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2081.753220 secs 2024-07-26T09:10:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2097.237919 secs 2024-07-26T09:10:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2081.753220 secs 2024-07-26T09:10:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2097.237919 secs 2024-07-26T09:10:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:37 smithi063 ceph-mon[36747]: pgmap v1696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:37 smithi043 ceph-mon[32384]: pgmap v1696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:37 smithi133 ceph-mon[37053]: pgmap v1696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:39 smithi063 ceph-mon[36747]: pgmap v1697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:39 smithi043 ceph-mon[32384]: pgmap v1697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:39 smithi133 ceph-mon[37053]: pgmap v1697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2086.753325 secs 2024-07-26T09:10:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2086.753325 secs 2024-07-26T09:10:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2086.753325 secs 2024-07-26T09:10:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2102.237991 secs 2024-07-26T09:10:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:41 smithi133 ceph-mon[37053]: pgmap v1698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2102.237991 secs 2024-07-26T09:10:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:41 smithi063 ceph-mon[36747]: pgmap v1698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2102.237991 secs 2024-07-26T09:10:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:41 smithi043 ceph-mon[32384]: pgmap v1698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:43 smithi063 ceph-mon[36747]: pgmap v1699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:43 smithi043 ceph-mon[32384]: pgmap v1699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:43 smithi133 ceph-mon[37053]: pgmap v1699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:45 smithi063 ceph-mon[36747]: pgmap v1700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:45 smithi043 ceph-mon[32384]: pgmap v1700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:45 smithi133 ceph-mon[37053]: pgmap v1700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:10:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2091.753442 secs 2024-07-26T09:10:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2107.238117 secs 2024-07-26T09:10:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2091.753442 secs 2024-07-26T09:10:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2107.238117 secs 2024-07-26T09:10:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2091.753442 secs 2024-07-26T09:10:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2107.238117 secs 2024-07-26T09:10:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:47 smithi063 ceph-mon[36747]: pgmap v1701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:47 smithi043 ceph-mon[32384]: pgmap v1701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:47 smithi133 ceph-mon[37053]: pgmap v1701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:49 smithi063 ceph-mon[36747]: pgmap v1702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:49.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:49 smithi043 ceph-mon[32384]: pgmap v1702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:49 smithi133 ceph-mon[37053]: pgmap v1702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:50.282 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:10:50.282 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.282 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.282 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.282 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:10:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:10:50.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:50.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2096.753521 secs 2024-07-26T09:10:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2112.238183 secs 2024-07-26T09:10:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:51 smithi063 ceph-mon[36747]: pgmap v1703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2096.753521 secs 2024-07-26T09:10:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2112.238183 secs 2024-07-26T09:10:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:51 smithi043 ceph-mon[32384]: pgmap v1703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2096.753521 secs 2024-07-26T09:10:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2112.238183 secs 2024-07-26T09:10:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:51 smithi133 ceph-mon[37053]: pgmap v1703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:10:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:53 smithi043 ceph-mon[32384]: pgmap v1704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:53 smithi133 ceph-mon[37053]: pgmap v1704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:53 smithi063 ceph-mon[36747]: pgmap v1704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:10:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:10:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:10:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:10:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:10:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:10:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:10:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:10:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:55 smithi043 ceph-mon[32384]: pgmap v1705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:10:55.594 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:55 smithi043 ceph-mon[32384]: pgmap v1706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:10:55.595 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:55 smithi063 ceph-mon[36747]: pgmap v1705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:10:55.595 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:55 smithi063 ceph-mon[36747]: pgmap v1706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:10:55.595 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:55 smithi133 ceph-mon[37053]: pgmap v1705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:10:55.595 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:55 smithi133 ceph-mon[37053]: pgmap v1706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:10:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2101.753666 secs 2024-07-26T09:10:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2117.238301 secs 2024-07-26T09:10:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2101.753666 secs 2024-07-26T09:10:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2117.238301 secs 2024-07-26T09:10:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2101.753666 secs 2024-07-26T09:10:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2117.238301 secs 2024-07-26T09:10:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:57 smithi043 ceph-mon[32384]: pgmap v1707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:10:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:57 smithi133 ceph-mon[37053]: pgmap v1707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:10:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:57 smithi063 ceph-mon[36747]: pgmap v1707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:10:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:10:59 smithi043 ceph-mon[32384]: pgmap v1708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:10:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:10:59 smithi133 ceph-mon[37053]: pgmap v1708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:10:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:10:59 smithi063 ceph-mon[36747]: pgmap v1708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:11:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:01 smithi043 ceph-mon[32384]: pgmap v1709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2106.753746 secs 2024-07-26T09:11:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2122.238446 secs 2024-07-26T09:11:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:01 smithi133 ceph-mon[37053]: pgmap v1709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2106.753746 secs 2024-07-26T09:11:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2122.238446 secs 2024-07-26T09:11:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:01 smithi063 ceph-mon[36747]: pgmap v1709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2106.753746 secs 2024-07-26T09:11:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2122.238446 secs 2024-07-26T09:11:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:03 smithi133 ceph-mon[37053]: pgmap v1710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:03 smithi063 ceph-mon[36747]: pgmap v1710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:03 smithi043 ceph-mon[32384]: pgmap v1710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:05 smithi133 ceph-mon[37053]: pgmap v1711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:11:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:05 smithi063 ceph-mon[36747]: pgmap v1711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:11:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:05 smithi043 ceph-mon[32384]: pgmap v1711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:11:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2111.753863 secs 2024-07-26T09:11:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2127.238517 secs 2024-07-26T09:11:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2111.753863 secs 2024-07-26T09:11:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2127.238517 secs 2024-07-26T09:11:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2111.753863 secs 2024-07-26T09:11:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2127.238517 secs 2024-07-26T09:11:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:07 smithi133 ceph-mon[37053]: pgmap v1712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:07 smithi063 ceph-mon[36747]: pgmap v1712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:07 smithi043 ceph-mon[32384]: pgmap v1712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:09 smithi133 ceph-mon[37053]: pgmap v1713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:09 smithi063 ceph-mon[36747]: pgmap v1713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:09 smithi043 ceph-mon[32384]: pgmap v1713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:11 smithi063 ceph-mon[36747]: pgmap v1714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2116.753983 secs 2024-07-26T09:11:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2132.238642 secs 2024-07-26T09:11:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:11 smithi043 ceph-mon[32384]: pgmap v1714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2116.753983 secs 2024-07-26T09:11:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2132.238642 secs 2024-07-26T09:11:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:11 smithi133 ceph-mon[37053]: pgmap v1714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2116.753983 secs 2024-07-26T09:11:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2132.238642 secs 2024-07-26T09:11:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:13 smithi063 ceph-mon[36747]: pgmap v1715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:13 smithi043 ceph-mon[32384]: pgmap v1715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:13 smithi133 ceph-mon[37053]: pgmap v1715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:15 smithi063 ceph-mon[36747]: pgmap v1716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:15 smithi043 ceph-mon[32384]: pgmap v1716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:15 smithi133 ceph-mon[37053]: pgmap v1716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:16.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2121.754113 secs 2024-07-26T09:11:16.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2137.238765 secs 2024-07-26T09:11:16.595 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2121.754113 secs 2024-07-26T09:11:16.595 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2137.238765 secs 2024-07-26T09:11:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2121.754113 secs 2024-07-26T09:11:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2137.238765 secs 2024-07-26T09:11:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:17 smithi063 ceph-mon[36747]: pgmap v1717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:17 smithi043 ceph-mon[32384]: pgmap v1717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:17 smithi133 ceph-mon[37053]: pgmap v1717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:19 smithi063 ceph-mon[36747]: pgmap v1718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:19 smithi043 ceph-mon[32384]: pgmap v1718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:19 smithi133 ceph-mon[37053]: pgmap v1718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:21 smithi063 ceph-mon[36747]: pgmap v1719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2126.754229 secs 2024-07-26T09:11:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2142.238898 secs 2024-07-26T09:11:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:21 smithi043 ceph-mon[32384]: pgmap v1719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2126.754229 secs 2024-07-26T09:11:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2142.238898 secs 2024-07-26T09:11:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:21 smithi133 ceph-mon[37053]: pgmap v1719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2126.754229 secs 2024-07-26T09:11:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2142.238898 secs 2024-07-26T09:11:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:23 smithi043 ceph-mon[32384]: pgmap v1720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:23 smithi063 ceph-mon[36747]: pgmap v1720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:23 smithi133 ceph-mon[37053]: pgmap v1720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:25.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:25 smithi063 ceph-mon[36747]: pgmap v1721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:25 smithi043 ceph-mon[32384]: pgmap v1721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:25 smithi133 ceph-mon[37053]: pgmap v1721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2131.754326 secs 2024-07-26T09:11:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2147.238985 secs 2024-07-26T09:11:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2131.754326 secs 2024-07-26T09:11:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2147.238985 secs 2024-07-26T09:11:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2131.754326 secs 2024-07-26T09:11:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2147.238985 secs 2024-07-26T09:11:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:27 smithi043 ceph-mon[32384]: pgmap v1722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:27 smithi133 ceph-mon[37053]: pgmap v1722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:27 smithi063 ceph-mon[36747]: pgmap v1722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:29 smithi043 ceph-mon[32384]: pgmap v1723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:29 smithi133 ceph-mon[37053]: pgmap v1723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:29 smithi063 ceph-mon[36747]: pgmap v1723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:31.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:31 smithi063 ceph-mon[36747]: pgmap v1724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:31.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2136.754441 secs 2024-07-26T09:11:31.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2152.239102 secs 2024-07-26T09:11:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:31 smithi043 ceph-mon[32384]: pgmap v1724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2136.754441 secs 2024-07-26T09:11:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2152.239102 secs 2024-07-26T09:11:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:31 smithi133 ceph-mon[37053]: pgmap v1724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2136.754441 secs 2024-07-26T09:11:31.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2152.239102 secs 2024-07-26T09:11:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:33 smithi043 ceph-mon[32384]: pgmap v1725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:33 smithi133 ceph-mon[37053]: pgmap v1725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:33 smithi063 ceph-mon[36747]: pgmap v1725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:35 smithi043 ceph-mon[32384]: pgmap v1726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:35 smithi133 ceph-mon[37053]: pgmap v1726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:35 smithi063 ceph-mon[36747]: pgmap v1726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2141.754511 secs 2024-07-26T09:11:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2157.239190 secs 2024-07-26T09:11:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2141.754511 secs 2024-07-26T09:11:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2157.239190 secs 2024-07-26T09:11:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2141.754511 secs 2024-07-26T09:11:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2157.239190 secs 2024-07-26T09:11:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:37 smithi043 ceph-mon[32384]: pgmap v1727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:37 smithi133 ceph-mon[37053]: pgmap v1727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:37 smithi063 ceph-mon[36747]: pgmap v1727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:39 smithi043 ceph-mon[32384]: pgmap v1728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:39 smithi133 ceph-mon[37053]: pgmap v1728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:39 smithi063 ceph-mon[36747]: pgmap v1728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:41 smithi043 ceph-mon[32384]: pgmap v1729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2146.754632 secs 2024-07-26T09:11:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2162.239313 secs 2024-07-26T09:11:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:41 smithi133 ceph-mon[37053]: pgmap v1729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2146.754632 secs 2024-07-26T09:11:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2162.239313 secs 2024-07-26T09:11:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:41 smithi063 ceph-mon[36747]: pgmap v1729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2146.754632 secs 2024-07-26T09:11:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2162.239313 secs 2024-07-26T09:11:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:43 smithi043 ceph-mon[32384]: pgmap v1730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:43.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:43 smithi133 ceph-mon[37053]: pgmap v1730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:43 smithi063 ceph-mon[36747]: pgmap v1730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:45 smithi043 ceph-mon[32384]: pgmap v1731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:45 smithi133 ceph-mon[37053]: pgmap v1731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:45 smithi063 ceph-mon[36747]: pgmap v1731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2151.754728 secs 2024-07-26T09:11:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2167.239462 secs 2024-07-26T09:11:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2151.754728 secs 2024-07-26T09:11:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2167.239462 secs 2024-07-26T09:11:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2151.754728 secs 2024-07-26T09:11:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2167.239462 secs 2024-07-26T09:11:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:47 smithi043 ceph-mon[32384]: pgmap v1732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:47 smithi133 ceph-mon[37053]: pgmap v1732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:47 smithi063 ceph-mon[36747]: pgmap v1732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:49 smithi043 ceph-mon[32384]: pgmap v1733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:49 smithi133 ceph-mon[37053]: pgmap v1733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:49 smithi063 ceph-mon[36747]: pgmap v1733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:51 smithi043 ceph-mon[32384]: pgmap v1734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2156.754861 secs 2024-07-26T09:11:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2172.239607 secs 2024-07-26T09:11:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:51 smithi133 ceph-mon[37053]: pgmap v1734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2156.754861 secs 2024-07-26T09:11:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2172.239607 secs 2024-07-26T09:11:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:51 smithi063 ceph-mon[36747]: pgmap v1734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:11:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2156.754861 secs 2024-07-26T09:11:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2172.239607 secs 2024-07-26T09:11:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:53 smithi043 ceph-mon[32384]: pgmap v1735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:53 smithi133 ceph-mon[37053]: pgmap v1735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:53 smithi063 ceph-mon[36747]: pgmap v1735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:11:54.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:11:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:11:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:11:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:55 smithi043 ceph-mon[32384]: pgmap v1736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:55.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:11:55.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:11:55.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:11:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:55 smithi133 ceph-mon[37053]: pgmap v1736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:11:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:11:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:11:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:55 smithi063 ceph-mon[36747]: pgmap v1736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:11:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:11:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:11:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:11:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2161.754981 secs 2024-07-26T09:11:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:56 smithi043 ceph-mon[32384]: pgmap v1737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:11:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:56 smithi043 ceph-mon[32384]: pgmap v1738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:11:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2177.239686 secs 2024-07-26T09:11:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2161.754981 secs 2024-07-26T09:11:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:56 smithi133 ceph-mon[37053]: pgmap v1737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:11:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:56 smithi133 ceph-mon[37053]: pgmap v1738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:11:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2177.239686 secs 2024-07-26T09:11:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2161.754981 secs 2024-07-26T09:11:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:56 smithi063 ceph-mon[36747]: pgmap v1737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:11:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:56 smithi063 ceph-mon[36747]: pgmap v1738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:11:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2177.239686 secs 2024-07-26T09:11:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:11:58 smithi043 ceph-mon[32384]: pgmap v1739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:11:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:11:58 smithi133 ceph-mon[37053]: pgmap v1739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:11:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:11:58 smithi063 ceph-mon[36747]: pgmap v1739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:12:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:00 smithi043 ceph-mon[32384]: pgmap v1740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2166.755123 secs 2024-07-26T09:12:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:00 smithi133 ceph-mon[37053]: pgmap v1740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2166.755123 secs 2024-07-26T09:12:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:00 smithi063 ceph-mon[36747]: pgmap v1740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2166.755123 secs 2024-07-26T09:12:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2182.239788 secs 2024-07-26T09:12:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2182.239788 secs 2024-07-26T09:12:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2182.239788 secs 2024-07-26T09:12:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:02 smithi043 ceph-mon[32384]: pgmap v1741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:02 smithi133 ceph-mon[37053]: pgmap v1741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:02 smithi063 ceph-mon[36747]: pgmap v1741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:04 smithi043 ceph-mon[32384]: pgmap v1742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:12:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:04 smithi133 ceph-mon[37053]: pgmap v1742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:12:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:04 smithi063 ceph-mon[36747]: pgmap v1742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:12:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2171.755228 secs 2024-07-26T09:12:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2171.755228 secs 2024-07-26T09:12:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2171.755228 secs 2024-07-26T09:12:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:06 smithi133 ceph-mon[37053]: pgmap v1743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:12:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2187.239889 secs 2024-07-26T09:12:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:06 smithi063 ceph-mon[36747]: pgmap v1743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:12:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2187.239889 secs 2024-07-26T09:12:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:06 smithi043 ceph-mon[32384]: pgmap v1743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:12:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2187.239889 secs 2024-07-26T09:12:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:08 smithi133 ceph-mon[37053]: pgmap v1744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:08 smithi063 ceph-mon[36747]: pgmap v1744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:08 smithi043 ceph-mon[32384]: pgmap v1744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:10 smithi133 ceph-mon[37053]: pgmap v1745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2176.755294 secs 2024-07-26T09:12:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:10 smithi063 ceph-mon[36747]: pgmap v1745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:10.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2176.755294 secs 2024-07-26T09:12:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:10 smithi043 ceph-mon[32384]: pgmap v1745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2176.755294 secs 2024-07-26T09:12:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2192.239952 secs 2024-07-26T09:12:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2192.239952 secs 2024-07-26T09:12:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2192.239952 secs 2024-07-26T09:12:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:12 smithi063 ceph-mon[36747]: pgmap v1746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:12 smithi043 ceph-mon[32384]: pgmap v1746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:12 smithi133 ceph-mon[37053]: pgmap v1746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:14 smithi063 ceph-mon[36747]: pgmap v1747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:14 smithi043 ceph-mon[32384]: pgmap v1747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:14 smithi133 ceph-mon[37053]: pgmap v1747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2181.755384 secs 2024-07-26T09:12:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2181.755384 secs 2024-07-26T09:12:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2181.755384 secs 2024-07-26T09:12:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:16 smithi063 ceph-mon[36747]: pgmap v1748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2197.240094 secs 2024-07-26T09:12:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:16 smithi043 ceph-mon[32384]: pgmap v1748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2197.240094 secs 2024-07-26T09:12:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:16 smithi133 ceph-mon[37053]: pgmap v1748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2197.240094 secs 2024-07-26T09:12:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:18 smithi063 ceph-mon[36747]: pgmap v1749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:18 smithi043 ceph-mon[32384]: pgmap v1749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:18 smithi133 ceph-mon[37053]: pgmap v1749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:20 smithi063 ceph-mon[36747]: pgmap v1750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2186.755468 secs 2024-07-26T09:12:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:20 smithi043 ceph-mon[32384]: pgmap v1750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2186.755468 secs 2024-07-26T09:12:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:20 smithi133 ceph-mon[37053]: pgmap v1750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2186.755468 secs 2024-07-26T09:12:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2202.240161 secs 2024-07-26T09:12:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2202.240161 secs 2024-07-26T09:12:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2202.240161 secs 2024-07-26T09:12:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:22 smithi063 ceph-mon[36747]: pgmap v1751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:22 smithi043 ceph-mon[32384]: pgmap v1751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:22 smithi133 ceph-mon[37053]: pgmap v1751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:24 smithi063 ceph-mon[36747]: pgmap v1752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:24 smithi043 ceph-mon[32384]: pgmap v1752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:24 smithi133 ceph-mon[37053]: pgmap v1752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2191.755576 secs 2024-07-26T09:12:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2191.755576 secs 2024-07-26T09:12:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2191.755576 secs 2024-07-26T09:12:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:26 smithi043 ceph-mon[32384]: pgmap v1753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2207.240286 secs 2024-07-26T09:12:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:26 smithi133 ceph-mon[37053]: pgmap v1753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2207.240286 secs 2024-07-26T09:12:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:26 smithi063 ceph-mon[36747]: pgmap v1753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2207.240286 secs 2024-07-26T09:12:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:28 smithi043 ceph-mon[32384]: pgmap v1754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:28 smithi133 ceph-mon[37053]: pgmap v1754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:28 smithi063 ceph-mon[36747]: pgmap v1754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:30 smithi043 ceph-mon[32384]: pgmap v1755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2196.755732 secs 2024-07-26T09:12:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:30 smithi133 ceph-mon[37053]: pgmap v1755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2196.755732 secs 2024-07-26T09:12:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:30 smithi063 ceph-mon[36747]: pgmap v1755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2196.755732 secs 2024-07-26T09:12:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2212.240369 secs 2024-07-26T09:12:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2212.240369 secs 2024-07-26T09:12:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2212.240369 secs 2024-07-26T09:12:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:32 smithi043 ceph-mon[32384]: pgmap v1756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:32 smithi133 ceph-mon[37053]: pgmap v1756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:32 smithi063 ceph-mon[36747]: pgmap v1756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:34 smithi043 ceph-mon[32384]: pgmap v1757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:34 smithi133 ceph-mon[37053]: pgmap v1757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:34 smithi063 ceph-mon[36747]: pgmap v1757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:35.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2201.755881 secs 2024-07-26T09:12:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2201.755881 secs 2024-07-26T09:12:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2201.755881 secs 2024-07-26T09:12:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:36 smithi043 ceph-mon[32384]: pgmap v1758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2217.240488 secs 2024-07-26T09:12:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:36 smithi133 ceph-mon[37053]: pgmap v1758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2217.240488 secs 2024-07-26T09:12:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:36 smithi063 ceph-mon[36747]: pgmap v1758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2217.240488 secs 2024-07-26T09:12:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:38 smithi043 ceph-mon[32384]: pgmap v1759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:38 smithi133 ceph-mon[37053]: pgmap v1759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:38 smithi063 ceph-mon[36747]: pgmap v1759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:40 smithi043 ceph-mon[32384]: pgmap v1760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2206.755994 secs 2024-07-26T09:12:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:40 smithi133 ceph-mon[37053]: pgmap v1760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2206.755994 secs 2024-07-26T09:12:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:40 smithi063 ceph-mon[36747]: pgmap v1760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2206.755994 secs 2024-07-26T09:12:41.979 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2222.240639 secs 2024-07-26T09:12:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2222.240639 secs 2024-07-26T09:12:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2222.240639 secs 2024-07-26T09:12:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:42 smithi043 ceph-mon[32384]: pgmap v1761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:43.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:42 smithi133 ceph-mon[37053]: pgmap v1761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:42 smithi063 ceph-mon[36747]: pgmap v1761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:44 smithi043 ceph-mon[32384]: pgmap v1762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:44 smithi133 ceph-mon[37053]: pgmap v1762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:44 smithi063 ceph-mon[36747]: pgmap v1762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2211.756089 secs 2024-07-26T09:12:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2211.756089 secs 2024-07-26T09:12:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2211.756089 secs 2024-07-26T09:12:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:46 smithi043 ceph-mon[32384]: pgmap v1763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2227.240781 secs 2024-07-26T09:12:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:46 smithi133 ceph-mon[37053]: pgmap v1763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2227.240781 secs 2024-07-26T09:12:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:46 smithi063 ceph-mon[36747]: pgmap v1763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2227.240781 secs 2024-07-26T09:12:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:48 smithi043 ceph-mon[32384]: pgmap v1764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:48 smithi133 ceph-mon[37053]: pgmap v1764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:48 smithi063 ceph-mon[36747]: pgmap v1764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:50 smithi043 ceph-mon[32384]: pgmap v1765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2216.756157 secs 2024-07-26T09:12:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:50 smithi133 ceph-mon[37053]: pgmap v1765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2216.756157 secs 2024-07-26T09:12:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:50 smithi063 ceph-mon[36747]: pgmap v1765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2216.756157 secs 2024-07-26T09:12:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2232.240932 secs 2024-07-26T09:12:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2232.240932 secs 2024-07-26T09:12:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2232.240932 secs 2024-07-26T09:12:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:52 smithi043 ceph-mon[32384]: pgmap v1766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:52 smithi133 ceph-mon[37053]: pgmap v1766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:52 smithi063 ceph-mon[36747]: pgmap v1766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:12:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:54 smithi043 ceph-mon[32384]: pgmap v1767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:54 smithi133 ceph-mon[37053]: pgmap v1767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:54 smithi063 ceph-mon[36747]: pgmap v1767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:12:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2221.756278 secs 2024-07-26T09:12:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:12:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2221.756278 secs 2024-07-26T09:12:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:12:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2221.756278 secs 2024-07-26T09:12:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:12:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:56 smithi043 ceph-mon[32384]: pgmap v1768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2237.240999 secs 2024-07-26T09:12:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:12:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:12:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:12:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:56 smithi133 ceph-mon[37053]: pgmap v1768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2237.240999 secs 2024-07-26T09:12:57.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:12:57.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:12:57.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:12:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:56 smithi063 ceph-mon[36747]: pgmap v1768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:12:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2237.240999 secs 2024-07-26T09:12:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:12:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:12:57.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:12:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:57 smithi043 ceph-mon[32384]: pgmap v1769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:12:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:57 smithi043 ceph-mon[32384]: pgmap v1770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:57 smithi133 ceph-mon[37053]: pgmap v1769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:12:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:57 smithi133 ceph-mon[37053]: pgmap v1770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:12:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:57 smithi063 ceph-mon[36747]: pgmap v1769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:12:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:57 smithi063 ceph-mon[36747]: pgmap v1770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:12:59 smithi133 ceph-mon[37053]: pgmap v1771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:12:59 smithi063 ceph-mon[36747]: pgmap v1771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:12:59 smithi043 ceph-mon[32384]: pgmap v1771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2226.756368 secs 2024-07-26T09:13:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2226.756368 secs 2024-07-26T09:13:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2226.756368 secs 2024-07-26T09:13:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2242.241081 secs 2024-07-26T09:13:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:01 smithi133 ceph-mon[37053]: pgmap v1772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2242.241081 secs 2024-07-26T09:13:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:01 smithi063 ceph-mon[36747]: pgmap v1772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2242.241081 secs 2024-07-26T09:13:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:01 smithi043 ceph-mon[32384]: pgmap v1772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:03 smithi133 ceph-mon[37053]: pgmap v1773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:13:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:03 smithi063 ceph-mon[36747]: pgmap v1773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:13:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:03 smithi043 ceph-mon[32384]: pgmap v1773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:13:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:05 smithi063 ceph-mon[36747]: pgmap v1774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2231.756435 secs 2024-07-26T09:13:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:05 smithi043 ceph-mon[32384]: pgmap v1774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2231.756435 secs 2024-07-26T09:13:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:05 smithi133 ceph-mon[37053]: pgmap v1774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:13:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2231.756435 secs 2024-07-26T09:13:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2247.241156 secs 2024-07-26T09:13:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2247.241156 secs 2024-07-26T09:13:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2247.241156 secs 2024-07-26T09:13:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:07 smithi043 ceph-mon[32384]: pgmap v1775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:07 smithi133 ceph-mon[37053]: pgmap v1775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:07 smithi063 ceph-mon[36747]: pgmap v1775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:09 smithi043 ceph-mon[32384]: pgmap v1776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:09 smithi133 ceph-mon[37053]: pgmap v1776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:09 smithi063 ceph-mon[36747]: pgmap v1776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2236.756578 secs 2024-07-26T09:13:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2252.241255 secs 2024-07-26T09:13:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2236.756578 secs 2024-07-26T09:13:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2252.241255 secs 2024-07-26T09:13:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2236.756578 secs 2024-07-26T09:13:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2252.241255 secs 2024-07-26T09:13:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:11 smithi043 ceph-mon[32384]: pgmap v1777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:11 smithi133 ceph-mon[37053]: pgmap v1777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:11 smithi063 ceph-mon[36747]: pgmap v1777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:13 smithi043 ceph-mon[32384]: pgmap v1778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:13 smithi133 ceph-mon[37053]: pgmap v1778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:13 smithi063 ceph-mon[36747]: pgmap v1778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:15 smithi043 ceph-mon[32384]: pgmap v1779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2241.756714 secs 2024-07-26T09:13:16.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2257.241371 secs 2024-07-26T09:13:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:15 smithi133 ceph-mon[37053]: pgmap v1779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2241.756714 secs 2024-07-26T09:13:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2257.241371 secs 2024-07-26T09:13:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:15 smithi063 ceph-mon[36747]: pgmap v1779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2241.756714 secs 2024-07-26T09:13:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2257.241371 secs 2024-07-26T09:13:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:17 smithi043 ceph-mon[32384]: pgmap v1780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:17 smithi133 ceph-mon[37053]: pgmap v1780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:17 smithi063 ceph-mon[36747]: pgmap v1780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:20.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:19 smithi043 ceph-mon[32384]: pgmap v1781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:19 smithi133 ceph-mon[37053]: pgmap v1781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:19 smithi063 ceph-mon[36747]: pgmap v1781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2246.756826 secs 2024-07-26T09:13:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2262.241484 secs 2024-07-26T09:13:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2246.756826 secs 2024-07-26T09:13:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2262.241484 secs 2024-07-26T09:13:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2246.756826 secs 2024-07-26T09:13:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2262.241484 secs 2024-07-26T09:13:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:21 smithi133 ceph-mon[37053]: pgmap v1782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:21 smithi063 ceph-mon[36747]: pgmap v1782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:21 smithi043 ceph-mon[32384]: pgmap v1782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:23 smithi133 ceph-mon[37053]: pgmap v1783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:23 smithi063 ceph-mon[36747]: pgmap v1783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:23 smithi043 ceph-mon[32384]: pgmap v1783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:26 smithi133 ceph-mon[37053]: pgmap v1784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2251.756960 secs 2024-07-26T09:13:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2267.241605 secs 2024-07-26T09:13:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:26 smithi063 ceph-mon[36747]: pgmap v1784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2251.756960 secs 2024-07-26T09:13:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2267.241605 secs 2024-07-26T09:13:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:26 smithi043 ceph-mon[32384]: pgmap v1784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2251.756960 secs 2024-07-26T09:13:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2267.241605 secs 2024-07-26T09:13:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:27 smithi133 ceph-mon[37053]: pgmap v1785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:27 smithi063 ceph-mon[36747]: pgmap v1785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:27 smithi043 ceph-mon[32384]: pgmap v1785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:29 smithi043 ceph-mon[32384]: pgmap v1786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:29 smithi133 ceph-mon[37053]: pgmap v1786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:29 smithi063 ceph-mon[36747]: pgmap v1786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2256.757098 secs 2024-07-26T09:13:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2256.757098 secs 2024-07-26T09:13:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2256.757098 secs 2024-07-26T09:13:31.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2272.241726 secs 2024-07-26T09:13:31.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:31 smithi063 ceph-mon[36747]: pgmap v1787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2272.241726 secs 2024-07-26T09:13:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:31 smithi043 ceph-mon[32384]: pgmap v1787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2272.241726 secs 2024-07-26T09:13:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:31 smithi133 ceph-mon[37053]: pgmap v1787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:33 smithi043 ceph-mon[32384]: pgmap v1788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:33 smithi133 ceph-mon[37053]: pgmap v1788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:33 smithi063 ceph-mon[36747]: pgmap v1788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:35 smithi043 ceph-mon[32384]: pgmap v1789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2261.757183 secs 2024-07-26T09:13:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:35 smithi133 ceph-mon[37053]: pgmap v1789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2261.757183 secs 2024-07-26T09:13:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:35 smithi063 ceph-mon[36747]: pgmap v1789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2261.757183 secs 2024-07-26T09:13:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2277.241830 secs 2024-07-26T09:13:37.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2277.241830 secs 2024-07-26T09:13:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2277.241830 secs 2024-07-26T09:13:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:37 smithi043 ceph-mon[32384]: pgmap v1790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:37 smithi133 ceph-mon[37053]: pgmap v1790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:37 smithi063 ceph-mon[36747]: pgmap v1790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:39 smithi043 ceph-mon[32384]: pgmap v1791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:39 smithi133 ceph-mon[37053]: pgmap v1791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:39 smithi063 ceph-mon[36747]: pgmap v1791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2266.757315 secs 2024-07-26T09:13:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2266.757315 secs 2024-07-26T09:13:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2266.757315 secs 2024-07-26T09:13:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2282.241953 secs 2024-07-26T09:13:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:41 smithi043 ceph-mon[32384]: pgmap v1792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2282.241953 secs 2024-07-26T09:13:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:41 smithi133 ceph-mon[37053]: pgmap v1792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2282.241953 secs 2024-07-26T09:13:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:41 smithi063 ceph-mon[36747]: pgmap v1792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:43 smithi043 ceph-mon[32384]: pgmap v1793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:43 smithi133 ceph-mon[37053]: pgmap v1793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:43 smithi063 ceph-mon[36747]: pgmap v1793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:45 smithi043 ceph-mon[32384]: pgmap v1794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2271.757382 secs 2024-07-26T09:13:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:45 smithi133 ceph-mon[37053]: pgmap v1794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2271.757382 secs 2024-07-26T09:13:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:45 smithi063 ceph-mon[36747]: pgmap v1794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2271.757382 secs 2024-07-26T09:13:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2287.242030 secs 2024-07-26T09:13:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2287.242030 secs 2024-07-26T09:13:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2287.242030 secs 2024-07-26T09:13:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:47 smithi133 ceph-mon[37053]: pgmap v1795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:47 smithi063 ceph-mon[36747]: pgmap v1795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:47 smithi043 ceph-mon[32384]: pgmap v1795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:49 smithi133 ceph-mon[37053]: pgmap v1796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:49 smithi063 ceph-mon[36747]: pgmap v1796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:49 smithi043 ceph-mon[32384]: pgmap v1796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2276.757501 secs 2024-07-26T09:13:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2276.757501 secs 2024-07-26T09:13:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2276.757501 secs 2024-07-26T09:13:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2292.242129 secs 2024-07-26T09:13:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:51 smithi133 ceph-mon[37053]: pgmap v1797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2292.242129 secs 2024-07-26T09:13:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:51 smithi063 ceph-mon[36747]: pgmap v1797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2292.242129 secs 2024-07-26T09:13:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:51 smithi043 ceph-mon[32384]: pgmap v1797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:13:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:53 smithi133 ceph-mon[37053]: pgmap v1798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:53 smithi063 ceph-mon[36747]: pgmap v1798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:53 smithi043 ceph-mon[32384]: pgmap v1798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:13:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:55 smithi063 ceph-mon[36747]: pgmap v1799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2281.757591 secs 2024-07-26T09:13:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:55 smithi043 ceph-mon[32384]: pgmap v1799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2281.757591 secs 2024-07-26T09:13:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:55 smithi133 ceph-mon[37053]: pgmap v1799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2281.757591 secs 2024-07-26T09:13:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2297.242233 secs 2024-07-26T09:13:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2297.242233 secs 2024-07-26T09:13:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2297.242233 secs 2024-07-26T09:13:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:57 smithi063 ceph-mon[36747]: pgmap v1800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:13:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:57 smithi043 ceph-mon[32384]: pgmap v1800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:13:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:57 smithi133 ceph-mon[37053]: pgmap v1800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:13:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:13:59.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:13:59.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:58 smithi063 ceph-mon[36747]: pgmap v1801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:59.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:58 smithi063 ceph-mon[36747]: pgmap v1802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:59.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:13:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:13:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:13:59.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:13:59.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:58 smithi043 ceph-mon[32384]: pgmap v1801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:59.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:58 smithi043 ceph-mon[32384]: pgmap v1802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:59.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:13:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:13:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:13:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:13:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:58 smithi133 ceph-mon[37053]: pgmap v1801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:13:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:58 smithi133 ceph-mon[37053]: pgmap v1802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:13:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:13:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:14:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:00 smithi043 ceph-mon[32384]: pgmap v1803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:14:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2286.757716 secs 2024-07-26T09:14:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2302.242332 secs 2024-07-26T09:14:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:00 smithi133 ceph-mon[37053]: pgmap v1803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:14:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2286.757716 secs 2024-07-26T09:14:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2302.242332 secs 2024-07-26T09:14:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:00 smithi063 ceph-mon[36747]: pgmap v1803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:14:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2286.757716 secs 2024-07-26T09:14:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2302.242332 secs 2024-07-26T09:14:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:02 smithi043 ceph-mon[32384]: pgmap v1804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:14:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:02 smithi133 ceph-mon[37053]: pgmap v1804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:14:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:02 smithi063 ceph-mon[36747]: pgmap v1804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:14:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:04 smithi043 ceph-mon[32384]: pgmap v1805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:14:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:04 smithi133 ceph-mon[37053]: pgmap v1805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:14:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:04 smithi063 ceph-mon[36747]: pgmap v1805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:14:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2291.757777 secs 2024-07-26T09:14:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2307.242417 secs 2024-07-26T09:14:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2291.757777 secs 2024-07-26T09:14:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2307.242417 secs 2024-07-26T09:14:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2291.757777 secs 2024-07-26T09:14:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2307.242417 secs 2024-07-26T09:14:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:06 smithi043 ceph-mon[32384]: pgmap v1806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:14:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:06 smithi133 ceph-mon[37053]: pgmap v1806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:14:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:06 smithi063 ceph-mon[36747]: pgmap v1806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:14:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:08 smithi043 ceph-mon[32384]: pgmap v1807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:14:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:08 smithi133 ceph-mon[37053]: pgmap v1807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:14:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:08 smithi063 ceph-mon[36747]: pgmap v1807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:14:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:10 smithi043 ceph-mon[32384]: pgmap v1808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:11.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2296.757918 secs 2024-07-26T09:14:11.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2312.242526 secs 2024-07-26T09:14:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:10 smithi133 ceph-mon[37053]: pgmap v1808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2296.757918 secs 2024-07-26T09:14:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2312.242526 secs 2024-07-26T09:14:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:10 smithi063 ceph-mon[36747]: pgmap v1808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2296.757918 secs 2024-07-26T09:14:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2312.242526 secs 2024-07-26T09:14:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:12 smithi043 ceph-mon[32384]: pgmap v1809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:12 smithi133 ceph-mon[37053]: pgmap v1809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:12 smithi063 ceph-mon[36747]: pgmap v1809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:14 smithi133 ceph-mon[37053]: pgmap v1810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:14 smithi063 ceph-mon[36747]: pgmap v1810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:14 smithi043 ceph-mon[32384]: pgmap v1810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2301.758029 secs 2024-07-26T09:14:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2317.242642 secs 2024-07-26T09:14:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2301.758029 secs 2024-07-26T09:14:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2317.242642 secs 2024-07-26T09:14:16.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2301.758029 secs 2024-07-26T09:14:16.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2317.242642 secs 2024-07-26T09:14:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:16 smithi133 ceph-mon[37053]: pgmap v1811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:16 smithi063 ceph-mon[36747]: pgmap v1811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:16 smithi043 ceph-mon[32384]: pgmap v1811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:19 smithi133 ceph-mon[37053]: pgmap v1812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:19 smithi063 ceph-mon[36747]: pgmap v1812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:19 smithi043 ceph-mon[32384]: pgmap v1812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:21 smithi133 ceph-mon[37053]: pgmap v1813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2306.758129 secs 2024-07-26T09:14:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2322.242781 secs 2024-07-26T09:14:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:21 smithi063 ceph-mon[36747]: pgmap v1813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2306.758129 secs 2024-07-26T09:14:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2322.242781 secs 2024-07-26T09:14:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:21 smithi043 ceph-mon[32384]: pgmap v1813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2306.758129 secs 2024-07-26T09:14:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2322.242781 secs 2024-07-26T09:14:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:23 smithi063 ceph-mon[36747]: pgmap v1814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:23 smithi043 ceph-mon[32384]: pgmap v1814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:23 smithi133 ceph-mon[37053]: pgmap v1814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:24 smithi043 ceph-mon[32384]: pgmap v1815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:24 smithi133 ceph-mon[37053]: pgmap v1815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:24 smithi063 ceph-mon[36747]: pgmap v1815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2311.758230 secs 2024-07-26T09:14:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2311.758230 secs 2024-07-26T09:14:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2311.758230 secs 2024-07-26T09:14:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2327.242924 secs 2024-07-26T09:14:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:26 smithi063 ceph-mon[36747]: pgmap v1816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2327.242924 secs 2024-07-26T09:14:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:26 smithi043 ceph-mon[32384]: pgmap v1816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2327.242924 secs 2024-07-26T09:14:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:26 smithi133 ceph-mon[37053]: pgmap v1816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:28 smithi043 ceph-mon[32384]: pgmap v1817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:28 smithi133 ceph-mon[37053]: pgmap v1817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:28 smithi063 ceph-mon[36747]: pgmap v1817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:30 smithi043 ceph-mon[32384]: pgmap v1818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2316.758312 secs 2024-07-26T09:14:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2332.243023 secs 2024-07-26T09:14:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:30 smithi133 ceph-mon[37053]: pgmap v1818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2316.758312 secs 2024-07-26T09:14:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2332.243023 secs 2024-07-26T09:14:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:30 smithi063 ceph-mon[36747]: pgmap v1818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2316.758312 secs 2024-07-26T09:14:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2332.243023 secs 2024-07-26T09:14:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:32 smithi043 ceph-mon[32384]: pgmap v1819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:32 smithi133 ceph-mon[37053]: pgmap v1819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:32 smithi063 ceph-mon[36747]: pgmap v1819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:34 smithi043 ceph-mon[32384]: pgmap v1820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:34 smithi133 ceph-mon[37053]: pgmap v1820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:34 smithi063 ceph-mon[36747]: pgmap v1820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2321.758426 secs 2024-07-26T09:14:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2337.243162 secs 2024-07-26T09:14:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2321.758426 secs 2024-07-26T09:14:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2337.243162 secs 2024-07-26T09:14:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2321.758426 secs 2024-07-26T09:14:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2337.243162 secs 2024-07-26T09:14:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:36 smithi133 ceph-mon[37053]: pgmap v1821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:36 smithi063 ceph-mon[36747]: pgmap v1821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:36 smithi043 ceph-mon[32384]: pgmap v1821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:38 smithi133 ceph-mon[37053]: pgmap v1822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:38 smithi063 ceph-mon[36747]: pgmap v1822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:38 smithi043 ceph-mon[32384]: pgmap v1822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:40 smithi133 ceph-mon[37053]: pgmap v1823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2326.758569 secs 2024-07-26T09:14:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2342.243279 secs 2024-07-26T09:14:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:40 smithi063 ceph-mon[36747]: pgmap v1823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2326.758569 secs 2024-07-26T09:14:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2342.243279 secs 2024-07-26T09:14:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:40 smithi043 ceph-mon[32384]: pgmap v1823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2326.758569 secs 2024-07-26T09:14:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2342.243279 secs 2024-07-26T09:14:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:43 smithi133 ceph-mon[37053]: pgmap v1824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:43 smithi063 ceph-mon[36747]: pgmap v1824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:43 smithi043 ceph-mon[32384]: pgmap v1824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:45 smithi133 ceph-mon[37053]: pgmap v1825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:45 smithi063 ceph-mon[36747]: pgmap v1825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:45 smithi043 ceph-mon[32384]: pgmap v1825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2331.758713 secs 2024-07-26T09:14:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2347.243385 secs 2024-07-26T09:14:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2331.758713 secs 2024-07-26T09:14:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2347.243385 secs 2024-07-26T09:14:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2331.758713 secs 2024-07-26T09:14:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2347.243385 secs 2024-07-26T09:14:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:47 smithi063 ceph-mon[36747]: pgmap v1826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:47 smithi043 ceph-mon[32384]: pgmap v1826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:47 smithi133 ceph-mon[37053]: pgmap v1826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:48 smithi063 ceph-mon[36747]: pgmap v1827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:48 smithi043 ceph-mon[32384]: pgmap v1827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:48 smithi133 ceph-mon[37053]: pgmap v1827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:50 smithi043 ceph-mon[32384]: pgmap v1828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2336.758864 secs 2024-07-26T09:14:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2352.243508 secs 2024-07-26T09:14:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:50 smithi133 ceph-mon[37053]: pgmap v1828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2336.758864 secs 2024-07-26T09:14:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2352.243508 secs 2024-07-26T09:14:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:50 smithi063 ceph-mon[36747]: pgmap v1828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:14:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2336.758864 secs 2024-07-26T09:14:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2352.243508 secs 2024-07-26T09:14:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:52 smithi043 ceph-mon[32384]: pgmap v1829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:52 smithi133 ceph-mon[37053]: pgmap v1829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:52 smithi063 ceph-mon[36747]: pgmap v1829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:54 smithi043 ceph-mon[32384]: pgmap v1830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:54 smithi133 ceph-mon[37053]: pgmap v1830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:54 smithi063 ceph-mon[36747]: pgmap v1830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2341.758936 secs 2024-07-26T09:14:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2357.243627 secs 2024-07-26T09:14:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2341.758936 secs 2024-07-26T09:14:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2357.243627 secs 2024-07-26T09:14:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2341.758936 secs 2024-07-26T09:14:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2357.243627 secs 2024-07-26T09:14:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:56 smithi133 ceph-mon[37053]: pgmap v1831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:56 smithi063 ceph-mon[36747]: pgmap v1831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:56 smithi043 ceph-mon[32384]: pgmap v1831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:14:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:59 smithi133 ceph-mon[37053]: pgmap v1832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:14:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:14:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:59 smithi063 ceph-mon[36747]: pgmap v1832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:14:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:59 smithi043 ceph-mon[32384]: pgmap v1832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:14:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:15:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:15:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:15:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:15:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:15:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:15:00.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:15:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:15:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:15:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:15:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:01 smithi063 ceph-mon[36747]: pgmap v1833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:15:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:01 smithi063 ceph-mon[36747]: pgmap v1834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:15:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2346.759058 secs 2024-07-26T09:15:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2362.243725 secs 2024-07-26T09:15:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:01 smithi043 ceph-mon[32384]: pgmap v1833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:15:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:01 smithi043 ceph-mon[32384]: pgmap v1834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:15:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2346.759058 secs 2024-07-26T09:15:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2362.243725 secs 2024-07-26T09:15:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:01 smithi133 ceph-mon[37053]: pgmap v1833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:15:01.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:01 smithi133 ceph-mon[37053]: pgmap v1834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:15:01.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2346.759058 secs 2024-07-26T09:15:01.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2362.243725 secs 2024-07-26T09:15:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:03 smithi063 ceph-mon[36747]: pgmap v1835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:15:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:03 smithi043 ceph-mon[32384]: pgmap v1835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:15:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:03 smithi133 ceph-mon[37053]: pgmap v1835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:15:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:05 smithi063 ceph-mon[36747]: pgmap v1836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:15:05.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:05 smithi133 ceph-mon[37053]: pgmap v1836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:15:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:05 smithi043 ceph-mon[32384]: pgmap v1836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:15:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2351.759154 secs 2024-07-26T09:15:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:06 smithi063 ceph-mon[36747]: pgmap v1837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:15:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2367.243808 secs 2024-07-26T09:15:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2351.759154 secs 2024-07-26T09:15:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:06 smithi043 ceph-mon[32384]: pgmap v1837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:15:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2367.243808 secs 2024-07-26T09:15:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2351.759154 secs 2024-07-26T09:15:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:06 smithi133 ceph-mon[37053]: pgmap v1837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:15:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2367.243808 secs 2024-07-26T09:15:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:08 smithi043 ceph-mon[32384]: pgmap v1838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:15:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:08 smithi133 ceph-mon[37053]: pgmap v1838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:15:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:08 smithi063 ceph-mon[36747]: pgmap v1838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:15:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:10 smithi043 ceph-mon[32384]: pgmap v1839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:15:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:10 smithi133 ceph-mon[37053]: pgmap v1839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:15:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:10 smithi063 ceph-mon[36747]: pgmap v1839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:15:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2356.759294 secs 2024-07-26T09:15:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2372.243955 secs 2024-07-26T09:15:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2356.759294 secs 2024-07-26T09:15:11.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2372.243955 secs 2024-07-26T09:15:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2356.759294 secs 2024-07-26T09:15:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2372.243955 secs 2024-07-26T09:15:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:12 smithi133 ceph-mon[37053]: pgmap v1840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:12 smithi063 ceph-mon[36747]: pgmap v1840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:12 smithi043 ceph-mon[32384]: pgmap v1840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:14 smithi133 ceph-mon[37053]: pgmap v1841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:14 smithi063 ceph-mon[36747]: pgmap v1841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:14 smithi043 ceph-mon[32384]: pgmap v1841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2361.759417 secs 2024-07-26T09:15:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:16 smithi133 ceph-mon[37053]: pgmap v1842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2377.244071 secs 2024-07-26T09:15:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2361.759417 secs 2024-07-26T09:15:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:16 smithi063 ceph-mon[36747]: pgmap v1842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2377.244071 secs 2024-07-26T09:15:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2361.759417 secs 2024-07-26T09:15:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:16 smithi043 ceph-mon[32384]: pgmap v1842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2377.244071 secs 2024-07-26T09:15:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:18 smithi133 ceph-mon[37053]: pgmap v1843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:18 smithi063 ceph-mon[36747]: pgmap v1843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:18 smithi043 ceph-mon[32384]: pgmap v1843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:20 smithi133 ceph-mon[37053]: pgmap v1844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:20 smithi063 ceph-mon[36747]: pgmap v1844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:20 smithi043 ceph-mon[32384]: pgmap v1844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2366.759535 secs 2024-07-26T09:15:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2382.244203 secs 2024-07-26T09:15:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2366.759535 secs 2024-07-26T09:15:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2382.244203 secs 2024-07-26T09:15:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2366.759535 secs 2024-07-26T09:15:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2382.244203 secs 2024-07-26T09:15:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:22 smithi063 ceph-mon[36747]: pgmap v1845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:22 smithi043 ceph-mon[32384]: pgmap v1845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:22 smithi133 ceph-mon[37053]: pgmap v1845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:24 smithi063 ceph-mon[36747]: pgmap v1846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:24 smithi043 ceph-mon[32384]: pgmap v1846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:24 smithi133 ceph-mon[37053]: pgmap v1846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2371.759650 secs 2024-07-26T09:15:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:26 smithi063 ceph-mon[36747]: pgmap v1847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2387.244265 secs 2024-07-26T09:15:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2371.759650 secs 2024-07-26T09:15:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:26 smithi043 ceph-mon[32384]: pgmap v1847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2387.244265 secs 2024-07-26T09:15:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2371.759650 secs 2024-07-26T09:15:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:26 smithi133 ceph-mon[37053]: pgmap v1847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2387.244265 secs 2024-07-26T09:15:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:28 smithi063 ceph-mon[36747]: pgmap v1848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:28 smithi043 ceph-mon[32384]: pgmap v1848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:28 smithi133 ceph-mon[37053]: pgmap v1848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:30 smithi063 ceph-mon[36747]: pgmap v1849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:30 smithi043 ceph-mon[32384]: pgmap v1849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:30 smithi133 ceph-mon[37053]: pgmap v1849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2376.759752 secs 2024-07-26T09:15:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2392.244422 secs 2024-07-26T09:15:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2376.759752 secs 2024-07-26T09:15:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2392.244422 secs 2024-07-26T09:15:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2376.759752 secs 2024-07-26T09:15:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2392.244422 secs 2024-07-26T09:15:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:32 smithi063 ceph-mon[36747]: pgmap v1850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:32 smithi043 ceph-mon[32384]: pgmap v1850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:32 smithi133 ceph-mon[37053]: pgmap v1850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:34 smithi063 ceph-mon[36747]: pgmap v1851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:34 smithi043 ceph-mon[32384]: pgmap v1851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:34 smithi133 ceph-mon[37053]: pgmap v1851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2381.759852 secs 2024-07-26T09:15:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:36 smithi043 ceph-mon[32384]: pgmap v1852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2397.244562 secs 2024-07-26T09:15:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2381.759852 secs 2024-07-26T09:15:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:36 smithi133 ceph-mon[37053]: pgmap v1852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2397.244562 secs 2024-07-26T09:15:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2381.759852 secs 2024-07-26T09:15:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:36 smithi063 ceph-mon[36747]: pgmap v1852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2397.244562 secs 2024-07-26T09:15:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:38 smithi043 ceph-mon[32384]: pgmap v1853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:38 smithi133 ceph-mon[37053]: pgmap v1853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:38 smithi063 ceph-mon[36747]: pgmap v1853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:40 smithi043 ceph-mon[32384]: pgmap v1854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:40 smithi133 ceph-mon[37053]: pgmap v1854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:40 smithi063 ceph-mon[36747]: pgmap v1854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2386.759991 secs 2024-07-26T09:15:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2402.244656 secs 2024-07-26T09:15:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2386.759991 secs 2024-07-26T09:15:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2402.244656 secs 2024-07-26T09:15:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2386.759991 secs 2024-07-26T09:15:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2402.244656 secs 2024-07-26T09:15:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:42 smithi043 ceph-mon[32384]: pgmap v1855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:42 smithi133 ceph-mon[37053]: pgmap v1855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:42 smithi063 ceph-mon[36747]: pgmap v1855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:44 smithi043 ceph-mon[32384]: pgmap v1856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:44 smithi133 ceph-mon[37053]: pgmap v1856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:44 smithi063 ceph-mon[36747]: pgmap v1856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2391.760123 secs 2024-07-26T09:15:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:46 smithi043 ceph-mon[32384]: pgmap v1857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2407.244725 secs 2024-07-26T09:15:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2391.760123 secs 2024-07-26T09:15:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:46 smithi133 ceph-mon[37053]: pgmap v1857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2407.244725 secs 2024-07-26T09:15:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2391.760123 secs 2024-07-26T09:15:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:46 smithi063 ceph-mon[36747]: pgmap v1857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2407.244725 secs 2024-07-26T09:15:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:48 smithi043 ceph-mon[32384]: pgmap v1858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:48 smithi133 ceph-mon[37053]: pgmap v1858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:48 smithi063 ceph-mon[36747]: pgmap v1858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:50 smithi043 ceph-mon[32384]: pgmap v1859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:50 smithi133 ceph-mon[37053]: pgmap v1859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:50 smithi063 ceph-mon[36747]: pgmap v1859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2396.760204 secs 2024-07-26T09:15:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2412.244839 secs 2024-07-26T09:15:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2396.760204 secs 2024-07-26T09:15:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2412.244839 secs 2024-07-26T09:15:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2396.760204 secs 2024-07-26T09:15:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2412.244839 secs 2024-07-26T09:15:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:52 smithi043 ceph-mon[32384]: pgmap v1860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:52 smithi133 ceph-mon[37053]: pgmap v1860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:52 smithi063 ceph-mon[36747]: pgmap v1860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:54 smithi043 ceph-mon[32384]: pgmap v1861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:54 smithi133 ceph-mon[37053]: pgmap v1861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:54 smithi063 ceph-mon[36747]: pgmap v1861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:15:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2401.760299 secs 2024-07-26T09:15:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:56 smithi043 ceph-mon[32384]: pgmap v1862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2417.244879 secs 2024-07-26T09:15:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2401.760299 secs 2024-07-26T09:15:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:56 smithi133 ceph-mon[37053]: pgmap v1862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2417.244879 secs 2024-07-26T09:15:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2401.760299 secs 2024-07-26T09:15:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:56 smithi063 ceph-mon[36747]: pgmap v1862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:15:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2417.244879 secs 2024-07-26T09:15:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:58 smithi043 ceph-mon[32384]: pgmap v1863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:58 smithi133 ceph-mon[37053]: pgmap v1863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:58 smithi063 ceph-mon[36747]: pgmap v1863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:15:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:15:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:15:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:15:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:15:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:15:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:16:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:00 smithi043 ceph-mon[32384]: pgmap v1864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:00 smithi133 ceph-mon[37053]: pgmap v1864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:00 smithi063 ceph-mon[36747]: pgmap v1864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2406.760413 secs 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: pgmap v1865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: pgmap v1866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:16:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2422.244917 secs 2024-07-26T09:16:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2406.760413 secs 2024-07-26T09:16:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:16:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:16:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: pgmap v1865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:16:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: pgmap v1866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:16:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2422.244917 secs 2024-07-26T09:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2406.760413 secs 2024-07-26T09:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: pgmap v1865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: pgmap v1866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:16:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2422.244917 secs 2024-07-26T09:16:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:03 smithi063 ceph-mon[36747]: pgmap v1867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:16:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:03 smithi043 ceph-mon[32384]: pgmap v1867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:16:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:03 smithi133 ceph-mon[37053]: pgmap v1867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:16:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:05 smithi063 ceph-mon[36747]: pgmap v1868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2411.760494 secs 2024-07-26T09:16:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:05 smithi043 ceph-mon[32384]: pgmap v1868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2411.760494 secs 2024-07-26T09:16:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:05 smithi133 ceph-mon[37053]: pgmap v1868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2411.760494 secs 2024-07-26T09:16:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2427.244999 secs 2024-07-26T09:16:06.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2427.244999 secs 2024-07-26T09:16:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2427.244999 secs 2024-07-26T09:16:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:07 smithi063 ceph-mon[36747]: pgmap v1869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:07 smithi043 ceph-mon[32384]: pgmap v1869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:07 smithi133 ceph-mon[37053]: pgmap v1869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:16:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:09 smithi063 ceph-mon[36747]: pgmap v1870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:16:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:09 smithi043 ceph-mon[32384]: pgmap v1870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:16:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:09 smithi133 ceph-mon[37053]: pgmap v1870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:16:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2416.760580 secs 2024-07-26T09:16:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2416.760580 secs 2024-07-26T09:16:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2416.760580 secs 2024-07-26T09:16:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:11 smithi063 ceph-mon[36747]: pgmap v1871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:16:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2432.245124 secs 2024-07-26T09:16:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:11 smithi043 ceph-mon[32384]: pgmap v1871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:16:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2432.245124 secs 2024-07-26T09:16:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:11 smithi133 ceph-mon[37053]: pgmap v1871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:16:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2432.245124 secs 2024-07-26T09:16:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:13 smithi063 ceph-mon[36747]: pgmap v1872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:13 smithi043 ceph-mon[32384]: pgmap v1872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:13 smithi133 ceph-mon[37053]: pgmap v1872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:15 smithi043 ceph-mon[32384]: pgmap v1873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2421.760716 secs 2024-07-26T09:16:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:15 smithi133 ceph-mon[37053]: pgmap v1873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2421.760716 secs 2024-07-26T09:16:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:15 smithi063 ceph-mon[36747]: pgmap v1873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2421.760716 secs 2024-07-26T09:16:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2437.245250 secs 2024-07-26T09:16:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2437.245250 secs 2024-07-26T09:16:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2437.245250 secs 2024-07-26T09:16:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:17 smithi043 ceph-mon[32384]: pgmap v1874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:17 smithi133 ceph-mon[37053]: pgmap v1874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:17 smithi063 ceph-mon[36747]: pgmap v1874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:19 smithi043 ceph-mon[32384]: pgmap v1875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:19 smithi133 ceph-mon[37053]: pgmap v1875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:19 smithi063 ceph-mon[36747]: pgmap v1875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2426.760856 secs 2024-07-26T09:16:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2426.760856 secs 2024-07-26T09:16:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2426.760856 secs 2024-07-26T09:16:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:21 smithi043 ceph-mon[32384]: pgmap v1876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2442.245349 secs 2024-07-26T09:16:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:21 smithi133 ceph-mon[37053]: pgmap v1876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2442.245349 secs 2024-07-26T09:16:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:21 smithi063 ceph-mon[36747]: pgmap v1876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2442.245349 secs 2024-07-26T09:16:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:23 smithi043 ceph-mon[32384]: pgmap v1877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:23 smithi133 ceph-mon[37053]: pgmap v1877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:23 smithi063 ceph-mon[36747]: pgmap v1877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:25 smithi043 ceph-mon[32384]: pgmap v1878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2431.760989 secs 2024-07-26T09:16:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:25 smithi133 ceph-mon[37053]: pgmap v1878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2431.760989 secs 2024-07-26T09:16:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:25 smithi063 ceph-mon[36747]: pgmap v1878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2431.760989 secs 2024-07-26T09:16:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2447.245426 secs 2024-07-26T09:16:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2447.245426 secs 2024-07-26T09:16:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2447.245426 secs 2024-07-26T09:16:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:27 smithi043 ceph-mon[32384]: pgmap v1879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:27 smithi133 ceph-mon[37053]: pgmap v1879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:27 smithi063 ceph-mon[36747]: pgmap v1879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:29 smithi043 ceph-mon[32384]: pgmap v1880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:29 smithi133 ceph-mon[37053]: pgmap v1880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:29 smithi063 ceph-mon[36747]: pgmap v1880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2436.761147 secs 2024-07-26T09:16:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2436.761147 secs 2024-07-26T09:16:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2436.761147 secs 2024-07-26T09:16:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:31 smithi063 ceph-mon[36747]: pgmap v1881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:31.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2452.245569 secs 2024-07-26T09:16:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:31 smithi043 ceph-mon[32384]: pgmap v1881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2452.245569 secs 2024-07-26T09:16:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:31 smithi133 ceph-mon[37053]: pgmap v1881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2452.245569 secs 2024-07-26T09:16:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:33 smithi043 ceph-mon[32384]: pgmap v1882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:33 smithi133 ceph-mon[37053]: pgmap v1882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:33 smithi063 ceph-mon[36747]: pgmap v1882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:35 smithi043 ceph-mon[32384]: pgmap v1883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2441.761262 secs 2024-07-26T09:16:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:35 smithi133 ceph-mon[37053]: pgmap v1883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2441.761262 secs 2024-07-26T09:16:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:35 smithi063 ceph-mon[36747]: pgmap v1883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2441.761262 secs 2024-07-26T09:16:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2457.245683 secs 2024-07-26T09:16:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2457.245683 secs 2024-07-26T09:16:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2457.245683 secs 2024-07-26T09:16:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:37 smithi043 ceph-mon[32384]: pgmap v1884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:37 smithi133 ceph-mon[37053]: pgmap v1884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:37 smithi063 ceph-mon[36747]: pgmap v1884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:39 smithi043 ceph-mon[32384]: pgmap v1885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:39 smithi133 ceph-mon[37053]: pgmap v1885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:39 smithi063 ceph-mon[36747]: pgmap v1885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2446.761380 secs 2024-07-26T09:16:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2446.761380 secs 2024-07-26T09:16:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2446.761380 secs 2024-07-26T09:16:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:41 smithi043 ceph-mon[32384]: pgmap v1886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2462.245827 secs 2024-07-26T09:16:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:41 smithi133 ceph-mon[37053]: pgmap v1886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2462.245827 secs 2024-07-26T09:16:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:41 smithi063 ceph-mon[36747]: pgmap v1886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2462.245827 secs 2024-07-26T09:16:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:43 smithi043 ceph-mon[32384]: pgmap v1887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:43 smithi133 ceph-mon[37053]: pgmap v1887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:43 smithi063 ceph-mon[36747]: pgmap v1887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:45 smithi043 ceph-mon[32384]: pgmap v1888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2451.761498 secs 2024-07-26T09:16:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:45 smithi133 ceph-mon[37053]: pgmap v1888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2451.761498 secs 2024-07-26T09:16:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:45 smithi063 ceph-mon[36747]: pgmap v1888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2451.761498 secs 2024-07-26T09:16:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2467.245913 secs 2024-07-26T09:16:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2467.245913 secs 2024-07-26T09:16:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2467.245913 secs 2024-07-26T09:16:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:47 smithi133 ceph-mon[37053]: pgmap v1889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:47 smithi063 ceph-mon[36747]: pgmap v1889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:47 smithi043 ceph-mon[32384]: pgmap v1889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:49 smithi133 ceph-mon[37053]: pgmap v1890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:49 smithi063 ceph-mon[36747]: pgmap v1890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:49 smithi043 ceph-mon[32384]: pgmap v1890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:51.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2456.761596 secs 2024-07-26T09:16:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2456.761596 secs 2024-07-26T09:16:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2456.761596 secs 2024-07-26T09:16:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:51 smithi133 ceph-mon[37053]: pgmap v1891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2472.245981 secs 2024-07-26T09:16:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:51 smithi063 ceph-mon[36747]: pgmap v1891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2472.245981 secs 2024-07-26T09:16:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:51 smithi043 ceph-mon[32384]: pgmap v1891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2472.245981 secs 2024-07-26T09:16:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:53 smithi133 ceph-mon[37053]: pgmap v1892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:53 smithi063 ceph-mon[36747]: pgmap v1892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:53 smithi043 ceph-mon[32384]: pgmap v1892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:16:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:55 smithi133 ceph-mon[37053]: pgmap v1893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:56.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2461.761693 secs 2024-07-26T09:16:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:55 smithi063 ceph-mon[36747]: pgmap v1893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2461.761693 secs 2024-07-26T09:16:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:55 smithi043 ceph-mon[32384]: pgmap v1893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:16:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2461.761693 secs 2024-07-26T09:16:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2477.246064 secs 2024-07-26T09:16:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2477.246064 secs 2024-07-26T09:16:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2477.246064 secs 2024-07-26T09:16:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:57 smithi063 ceph-mon[36747]: pgmap v1894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:57 smithi043 ceph-mon[32384]: pgmap v1894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:16:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:57 smithi133 ceph-mon[37053]: pgmap v1894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:16:59 smithi063 ceph-mon[36747]: pgmap v1895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:16:59 smithi043 ceph-mon[32384]: pgmap v1895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:16:59 smithi133 ceph-mon[37053]: pgmap v1895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2466.761814 secs 2024-07-26T09:17:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:17:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2466.761814 secs 2024-07-26T09:17:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:17:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2466.761814 secs 2024-07-26T09:17:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:17:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: pgmap v1896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2482.246149 secs 2024-07-26T09:17:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:17:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: pgmap v1896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2482.246149 secs 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:17:02.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:17:02.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:17:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: pgmap v1896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2482.246149 secs 2024-07-26T09:17:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:17:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:17:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:02 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:17:03.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:02 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:17:03.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:02 smithi063 ceph-mon[36747]: pgmap v1897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:17:03.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:02 smithi063 ceph-mon[36747]: pgmap v1898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:17:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:02 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:17:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:02 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:17:03.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:02 smithi043 ceph-mon[32384]: pgmap v1897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:17:03.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:02 smithi043 ceph-mon[32384]: pgmap v1898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:17:03.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:02 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:17:03.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:02 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:17:03.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:02 smithi133 ceph-mon[37053]: pgmap v1897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:17:03.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:02 smithi133 ceph-mon[37053]: pgmap v1898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:17:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:04 smithi063 ceph-mon[36747]: pgmap v1899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:17:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:04 smithi043 ceph-mon[32384]: pgmap v1899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:17:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:04 smithi133 ceph-mon[37053]: pgmap v1899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:17:06.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2471.761877 secs 2024-07-26T09:17:06.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2471.761877 secs 2024-07-26T09:17:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2471.761877 secs 2024-07-26T09:17:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2487.246272 secs 2024-07-26T09:17:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:06 smithi043 ceph-mon[32384]: pgmap v1900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:17:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2487.246272 secs 2024-07-26T09:17:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:06 smithi133 ceph-mon[37053]: pgmap v1900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:17:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2487.246272 secs 2024-07-26T09:17:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:06 smithi063 ceph-mon[36747]: pgmap v1900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:17:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:08 smithi043 ceph-mon[32384]: pgmap v1901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:17:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:08 smithi133 ceph-mon[37053]: pgmap v1901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:17:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:08 smithi063 ceph-mon[36747]: pgmap v1901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:17:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:10 smithi043 ceph-mon[32384]: pgmap v1902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:17:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2476.762001 secs 2024-07-26T09:17:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:10 smithi133 ceph-mon[37053]: pgmap v1902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:17:11.388 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2476.762001 secs 2024-07-26T09:17:11.388 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:10 smithi063 ceph-mon[36747]: pgmap v1902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:17:11.389 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2476.762001 secs 2024-07-26T09:17:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2492.246398 secs 2024-07-26T09:17:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2492.246398 secs 2024-07-26T09:17:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2492.246398 secs 2024-07-26T09:17:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:12 smithi043 ceph-mon[32384]: pgmap v1903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:12 smithi133 ceph-mon[37053]: pgmap v1903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:12 smithi063 ceph-mon[36747]: pgmap v1903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:14 smithi043 ceph-mon[32384]: pgmap v1904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:14 smithi133 ceph-mon[37053]: pgmap v1904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:14 smithi063 ceph-mon[36747]: pgmap v1904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2481.762068 secs 2024-07-26T09:17:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2481.762068 secs 2024-07-26T09:17:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2481.762068 secs 2024-07-26T09:17:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2497.246517 secs 2024-07-26T09:17:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:16 smithi043 ceph-mon[32384]: pgmap v1905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2497.246517 secs 2024-07-26T09:17:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:16 smithi133 ceph-mon[37053]: pgmap v1905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2497.246517 secs 2024-07-26T09:17:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:16 smithi063 ceph-mon[36747]: pgmap v1905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:18 smithi043 ceph-mon[32384]: pgmap v1906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:18 smithi133 ceph-mon[37053]: pgmap v1906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:18 smithi063 ceph-mon[36747]: pgmap v1906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:20 smithi043 ceph-mon[32384]: pgmap v1907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2486.762186 secs 2024-07-26T09:17:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2502.246669 secs 2024-07-26T09:17:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:20 smithi133 ceph-mon[37053]: pgmap v1907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2486.762186 secs 2024-07-26T09:17:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2502.246669 secs 2024-07-26T09:17:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:20 smithi063 ceph-mon[36747]: pgmap v1907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2486.762186 secs 2024-07-26T09:17:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2502.246669 secs 2024-07-26T09:17:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:22 smithi043 ceph-mon[32384]: pgmap v1908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:22 smithi133 ceph-mon[37053]: pgmap v1908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:22 smithi063 ceph-mon[36747]: pgmap v1908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:24 smithi043 ceph-mon[32384]: pgmap v1909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:24 smithi133 ceph-mon[37053]: pgmap v1909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:24 smithi063 ceph-mon[36747]: pgmap v1909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2491.762287 secs 2024-07-26T09:17:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2507.246766 secs 2024-07-26T09:17:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2491.762287 secs 2024-07-26T09:17:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2507.246766 secs 2024-07-26T09:17:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2491.762287 secs 2024-07-26T09:17:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2507.246766 secs 2024-07-26T09:17:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:26 smithi043 ceph-mon[32384]: pgmap v1910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:26 smithi133 ceph-mon[37053]: pgmap v1910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:26 smithi063 ceph-mon[36747]: pgmap v1910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:28 smithi043 ceph-mon[32384]: pgmap v1911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:28 smithi133 ceph-mon[37053]: pgmap v1911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:28 smithi063 ceph-mon[36747]: pgmap v1911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:30 smithi043 ceph-mon[32384]: pgmap v1912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:17:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2496.762373 secs 2024-07-26T09:17:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2512.246887 secs 2024-07-26T09:17:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:30 smithi133 ceph-mon[37053]: pgmap v1912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:17:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2496.762373 secs 2024-07-26T09:17:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2512.246887 secs 2024-07-26T09:17:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:30 smithi063 ceph-mon[36747]: pgmap v1912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:17:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2496.762373 secs 2024-07-26T09:17:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2512.246887 secs 2024-07-26T09:17:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:32 smithi043 ceph-mon[32384]: pgmap v1913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:32 smithi133 ceph-mon[37053]: pgmap v1913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:32 smithi063 ceph-mon[36747]: pgmap v1913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:34 smithi043 ceph-mon[32384]: pgmap v1914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:34 smithi133 ceph-mon[37053]: pgmap v1914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:34 smithi063 ceph-mon[36747]: pgmap v1914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2501.762468 secs 2024-07-26T09:17:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2517.247005 secs 2024-07-26T09:17:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2501.762468 secs 2024-07-26T09:17:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2517.247005 secs 2024-07-26T09:17:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2501.762468 secs 2024-07-26T09:17:36.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2517.247005 secs 2024-07-26T09:17:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:36 smithi043 ceph-mon[32384]: pgmap v1915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:36 smithi133 ceph-mon[37053]: pgmap v1915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:36 smithi063 ceph-mon[36747]: pgmap v1915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:17:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:38 smithi043 ceph-mon[32384]: pgmap v1916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:38 smithi133 ceph-mon[37053]: pgmap v1916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:38 smithi063 ceph-mon[36747]: pgmap v1916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:17:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:40 smithi043 ceph-mon[32384]: pgmap v1917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2506.762610 secs 2024-07-26T09:17:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2522.247104 secs 2024-07-26T09:17:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:40 smithi133 ceph-mon[37053]: pgmap v1917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2506.762610 secs 2024-07-26T09:17:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2522.247104 secs 2024-07-26T09:17:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:40 smithi063 ceph-mon[36747]: pgmap v1917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2506.762610 secs 2024-07-26T09:17:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2522.247104 secs 2024-07-26T09:17:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:42 smithi043 ceph-mon[32384]: pgmap v1918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:42 smithi133 ceph-mon[37053]: pgmap v1918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:42 smithi063 ceph-mon[36747]: pgmap v1918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:44 smithi043 ceph-mon[32384]: pgmap v1919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:44 smithi133 ceph-mon[37053]: pgmap v1919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:44 smithi063 ceph-mon[36747]: pgmap v1919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2511.762729 secs 2024-07-26T09:17:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2527.247220 secs 2024-07-26T09:17:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2511.762729 secs 2024-07-26T09:17:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2527.247220 secs 2024-07-26T09:17:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2511.762729 secs 2024-07-26T09:17:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2527.247220 secs 2024-07-26T09:17:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:46 smithi133 ceph-mon[37053]: pgmap v1920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:46 smithi063 ceph-mon[36747]: pgmap v1920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:46 smithi043 ceph-mon[32384]: pgmap v1920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:48 smithi133 ceph-mon[37053]: pgmap v1921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:48 smithi063 ceph-mon[36747]: pgmap v1921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:48 smithi043 ceph-mon[32384]: pgmap v1921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:50 smithi133 ceph-mon[37053]: pgmap v1922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:51.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2516.762855 secs 2024-07-26T09:17:51.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2532.247337 secs 2024-07-26T09:17:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:50 smithi063 ceph-mon[36747]: pgmap v1922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2516.762855 secs 2024-07-26T09:17:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2532.247337 secs 2024-07-26T09:17:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:50 smithi043 ceph-mon[32384]: pgmap v1922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:17:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2516.762855 secs 2024-07-26T09:17:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2532.247337 secs 2024-07-26T09:17:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:53 smithi133 ceph-mon[37053]: pgmap v1923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:53 smithi063 ceph-mon[36747]: pgmap v1923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:53 smithi043 ceph-mon[32384]: pgmap v1923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:55 smithi133 ceph-mon[37053]: pgmap v1924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:55 smithi063 ceph-mon[36747]: pgmap v1924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:55 smithi043 ceph-mon[32384]: pgmap v1924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2521.763002 secs 2024-07-26T09:17:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2537.247427 secs 2024-07-26T09:17:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2521.763002 secs 2024-07-26T09:17:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2537.247427 secs 2024-07-26T09:17:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2521.763002 secs 2024-07-26T09:17:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2537.247427 secs 2024-07-26T09:17:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:57 smithi063 ceph-mon[36747]: pgmap v1925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:57 smithi043 ceph-mon[32384]: pgmap v1925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:57 smithi133 ceph-mon[37053]: pgmap v1925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:17:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:17:59 smithi063 ceph-mon[36747]: pgmap v1926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:17:59 smithi043 ceph-mon[32384]: pgmap v1926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:17:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:17:59 smithi133 ceph-mon[37053]: pgmap v1926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:01.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:01 smithi043 ceph-mon[32384]: pgmap v1927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:01.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2526.763144 secs 2024-07-26T09:18:01.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2542.247526 secs 2024-07-26T09:18:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:01 smithi063 ceph-mon[36747]: pgmap v1927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2526.763144 secs 2024-07-26T09:18:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2542.247526 secs 2024-07-26T09:18:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:01 smithi133 ceph-mon[37053]: pgmap v1927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2526.763144 secs 2024-07-26T09:18:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2542.247526 secs 2024-07-26T09:18:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:18:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:18:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: pgmap v1928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:18:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: pgmap v1928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:18:03.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:18:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: pgmap v1928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:18:03.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:18:03.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:18:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:18:04.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:18:04.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:18:04.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:18:04.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: pgmap v1929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:04.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: pgmap v1930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:18:04.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: pgmap v1929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: pgmap v1930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:18:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: pgmap v1929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: pgmap v1930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:06 smithi063 ceph-mon[36747]: pgmap v1931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2531.763213 secs 2024-07-26T09:18:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2547.247594 secs 2024-07-26T09:18:06.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:06 smithi133 ceph-mon[37053]: pgmap v1931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:18:06.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2531.763213 secs 2024-07-26T09:18:06.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2547.247594 secs 2024-07-26T09:18:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:06 smithi043 ceph-mon[32384]: pgmap v1931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:18:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2531.763213 secs 2024-07-26T09:18:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2547.247594 secs 2024-07-26T09:18:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:08 smithi063 ceph-mon[36747]: pgmap v1932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:18:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:08 smithi043 ceph-mon[32384]: pgmap v1932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:18:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:08 smithi133 ceph-mon[37053]: pgmap v1932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:18:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:09 smithi043 ceph-mon[32384]: pgmap v1933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:09 smithi133 ceph-mon[37053]: pgmap v1933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:09 smithi063 ceph-mon[36747]: pgmap v1933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:10.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2536.763278 secs 2024-07-26T09:18:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2536.763278 secs 2024-07-26T09:18:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2536.763278 secs 2024-07-26T09:18:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2552.247736 secs 2024-07-26T09:18:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:11 smithi043 ceph-mon[32384]: pgmap v1934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2552.247736 secs 2024-07-26T09:18:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:11 smithi133 ceph-mon[37053]: pgmap v1934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2552.247736 secs 2024-07-26T09:18:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:11 smithi063 ceph-mon[36747]: pgmap v1934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:18:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:13 smithi043 ceph-mon[32384]: pgmap v1935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:18:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:13 smithi133 ceph-mon[37053]: pgmap v1935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:18:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:13 smithi063 ceph-mon[36747]: pgmap v1935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:18:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:15 smithi043 ceph-mon[32384]: pgmap v1936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:15 smithi133 ceph-mon[37053]: pgmap v1936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:15 smithi063 ceph-mon[36747]: pgmap v1936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2541.763401 secs 2024-07-26T09:18:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2557.247882 secs 2024-07-26T09:18:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2541.763401 secs 2024-07-26T09:18:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2557.247882 secs 2024-07-26T09:18:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2541.763401 secs 2024-07-26T09:18:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2557.247882 secs 2024-07-26T09:18:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:17 smithi043 ceph-mon[32384]: pgmap v1937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:17 smithi133 ceph-mon[37053]: pgmap v1937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:17 smithi063 ceph-mon[36747]: pgmap v1937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:19 smithi043 ceph-mon[32384]: pgmap v1938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:19 smithi133 ceph-mon[37053]: pgmap v1938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:19 smithi063 ceph-mon[36747]: pgmap v1938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2546.763516 secs 2024-07-26T09:18:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2546.763516 secs 2024-07-26T09:18:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2546.763516 secs 2024-07-26T09:18:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2562.247981 secs 2024-07-26T09:18:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:21 smithi043 ceph-mon[32384]: pgmap v1939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2562.247981 secs 2024-07-26T09:18:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:21 smithi133 ceph-mon[37053]: pgmap v1939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2562.247981 secs 2024-07-26T09:18:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:21 smithi063 ceph-mon[36747]: pgmap v1939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:23 smithi043 ceph-mon[32384]: pgmap v1940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:23 smithi133 ceph-mon[37053]: pgmap v1940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:23 smithi063 ceph-mon[36747]: pgmap v1940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:25 smithi043 ceph-mon[32384]: pgmap v1941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:25 smithi133 ceph-mon[37053]: pgmap v1941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:25 smithi063 ceph-mon[36747]: pgmap v1941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2551.763637 secs 2024-07-26T09:18:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2567.248106 secs 2024-07-26T09:18:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2551.763637 secs 2024-07-26T09:18:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2567.248106 secs 2024-07-26T09:18:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2551.763637 secs 2024-07-26T09:18:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2567.248106 secs 2024-07-26T09:18:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:27 smithi043 ceph-mon[32384]: pgmap v1942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:27 smithi133 ceph-mon[37053]: pgmap v1942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:27 smithi063 ceph-mon[36747]: pgmap v1942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:29 smithi043 ceph-mon[32384]: pgmap v1943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:29 smithi133 ceph-mon[37053]: pgmap v1943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:29 smithi063 ceph-mon[36747]: pgmap v1943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2556.763793 secs 2024-07-26T09:18:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2556.763793 secs 2024-07-26T09:18:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2556.763793 secs 2024-07-26T09:18:31.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2572.248179 secs 2024-07-26T09:18:31.887 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:31 smithi043 ceph-mon[32384]: pgmap v1944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2572.248179 secs 2024-07-26T09:18:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:31 smithi133 ceph-mon[37053]: pgmap v1944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2572.248179 secs 2024-07-26T09:18:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:31 smithi063 ceph-mon[36747]: pgmap v1944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:33 smithi043 ceph-mon[32384]: pgmap v1945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:33 smithi133 ceph-mon[37053]: pgmap v1945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:33 smithi063 ceph-mon[36747]: pgmap v1945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:35 smithi043 ceph-mon[32384]: pgmap v1946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:35 smithi133 ceph-mon[37053]: pgmap v1946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:35 smithi063 ceph-mon[36747]: pgmap v1946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:36.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2561.763891 secs 2024-07-26T09:18:36.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2577.248323 secs 2024-07-26T09:18:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2561.763891 secs 2024-07-26T09:18:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2577.248323 secs 2024-07-26T09:18:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2561.763891 secs 2024-07-26T09:18:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2577.248323 secs 2024-07-26T09:18:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:37 smithi043 ceph-mon[32384]: pgmap v1947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:37 smithi133 ceph-mon[37053]: pgmap v1947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:37 smithi063 ceph-mon[36747]: pgmap v1947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:39 smithi043 ceph-mon[32384]: pgmap v1948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:39 smithi133 ceph-mon[37053]: pgmap v1948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:39 smithi063 ceph-mon[36747]: pgmap v1948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2566.764019 secs 2024-07-26T09:18:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2566.764019 secs 2024-07-26T09:18:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2566.764019 secs 2024-07-26T09:18:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2582.248461 secs 2024-07-26T09:18:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:41 smithi063 ceph-mon[36747]: pgmap v1949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2582.248461 secs 2024-07-26T09:18:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:41 smithi043 ceph-mon[32384]: pgmap v1949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2582.248461 secs 2024-07-26T09:18:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:41 smithi133 ceph-mon[37053]: pgmap v1949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:43 smithi043 ceph-mon[32384]: pgmap v1950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:43 smithi133 ceph-mon[37053]: pgmap v1950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:43 smithi063 ceph-mon[36747]: pgmap v1950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:45 smithi043 ceph-mon[32384]: pgmap v1951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:45 smithi133 ceph-mon[37053]: pgmap v1951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:45 smithi063 ceph-mon[36747]: pgmap v1951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2571.764140 secs 2024-07-26T09:18:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2587.248606 secs 2024-07-26T09:18:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2571.764140 secs 2024-07-26T09:18:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2587.248606 secs 2024-07-26T09:18:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2571.764140 secs 2024-07-26T09:18:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2587.248606 secs 2024-07-26T09:18:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:47 smithi043 ceph-mon[32384]: pgmap v1952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:47 smithi133 ceph-mon[37053]: pgmap v1952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:47 smithi063 ceph-mon[36747]: pgmap v1952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:49 smithi043 ceph-mon[32384]: pgmap v1953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:49 smithi133 ceph-mon[37053]: pgmap v1953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:49 smithi063 ceph-mon[36747]: pgmap v1953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2576.764259 secs 2024-07-26T09:18:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2576.764259 secs 2024-07-26T09:18:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2576.764259 secs 2024-07-26T09:18:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2592.248727 secs 2024-07-26T09:18:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:51 smithi043 ceph-mon[32384]: pgmap v1954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2592.248727 secs 2024-07-26T09:18:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:51 smithi133 ceph-mon[37053]: pgmap v1954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2592.248727 secs 2024-07-26T09:18:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:51 smithi063 ceph-mon[36747]: pgmap v1954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:53 smithi043 ceph-mon[32384]: pgmap v1955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:53 smithi133 ceph-mon[37053]: pgmap v1955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:53 smithi063 ceph-mon[36747]: pgmap v1955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:55 smithi043 ceph-mon[32384]: pgmap v1956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:55 smithi133 ceph-mon[37053]: pgmap v1956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:55 smithi063 ceph-mon[36747]: pgmap v1956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:18:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2581.764360 secs 2024-07-26T09:18:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2597.248873 secs 2024-07-26T09:18:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2581.764360 secs 2024-07-26T09:18:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2597.248873 secs 2024-07-26T09:18:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2581.764360 secs 2024-07-26T09:18:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2597.248873 secs 2024-07-26T09:18:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:57 smithi043 ceph-mon[32384]: pgmap v1957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:57 smithi133 ceph-mon[37053]: pgmap v1957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:57 smithi063 ceph-mon[36747]: pgmap v1957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:18:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:18:59 smithi043 ceph-mon[32384]: pgmap v1958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:18:59 smithi133 ceph-mon[37053]: pgmap v1958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:18:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:18:59 smithi063 ceph-mon[36747]: pgmap v1958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2586.764478 secs 2024-07-26T09:19:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2586.764478 secs 2024-07-26T09:19:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2586.764478 secs 2024-07-26T09:19:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2602.249000 secs 2024-07-26T09:19:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:01 smithi043 ceph-mon[32384]: pgmap v1959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2602.249000 secs 2024-07-26T09:19:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:01 smithi133 ceph-mon[37053]: pgmap v1959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2602.249000 secs 2024-07-26T09:19:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:01 smithi063 ceph-mon[36747]: pgmap v1959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:04 smithi043 ceph-mon[32384]: pgmap v1960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:04.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:19:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:04 smithi133 ceph-mon[37053]: pgmap v1960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:19:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:04 smithi063 ceph-mon[36747]: pgmap v1960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:19:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:19:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:19:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:05 smithi043 ceph-mon[32384]: pgmap v1961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:19:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:05 smithi043 ceph-mon[32384]: pgmap v1962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:19:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:19:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:19:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:19:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:05 smithi133 ceph-mon[37053]: pgmap v1961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:19:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:05 smithi133 ceph-mon[37053]: pgmap v1962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:19:05.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:19:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:19:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:19:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:05 smithi063 ceph-mon[36747]: pgmap v1961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:19:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:05 smithi063 ceph-mon[36747]: pgmap v1962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:19:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:19:06.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2591.764627 secs 2024-07-26T09:19:06.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2607.249096 secs 2024-07-26T09:19:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2591.764627 secs 2024-07-26T09:19:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2607.249096 secs 2024-07-26T09:19:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2591.764627 secs 2024-07-26T09:19:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2607.249096 secs 2024-07-26T09:19:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:07 smithi043 ceph-mon[32384]: pgmap v1963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:19:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:07 smithi133 ceph-mon[37053]: pgmap v1963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:19:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:07 smithi063 ceph-mon[36747]: pgmap v1963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:19:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:09 smithi043 ceph-mon[32384]: pgmap v1964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:19:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:09 smithi133 ceph-mon[37053]: pgmap v1964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:19:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:09 smithi063 ceph-mon[36747]: pgmap v1964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:19:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2596.764755 secs 2024-07-26T09:19:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:11 smithi043 ceph-mon[32384]: pgmap v1965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:19:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2612.249170 secs 2024-07-26T09:19:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2596.764755 secs 2024-07-26T09:19:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:11 smithi133 ceph-mon[37053]: pgmap v1965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:19:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2612.249170 secs 2024-07-26T09:19:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2596.764755 secs 2024-07-26T09:19:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:11 smithi063 ceph-mon[36747]: pgmap v1965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:19:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2612.249170 secs 2024-07-26T09:19:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:13 smithi043 ceph-mon[32384]: pgmap v1966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:19:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:13 smithi133 ceph-mon[37053]: pgmap v1966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:19:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:13 smithi063 ceph-mon[36747]: pgmap v1966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:19:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:15 smithi043 ceph-mon[32384]: pgmap v1967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:15 smithi133 ceph-mon[37053]: pgmap v1967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:15 smithi063 ceph-mon[36747]: pgmap v1967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2601.764897 secs 2024-07-26T09:19:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2617.249287 secs 2024-07-26T09:19:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2601.764897 secs 2024-07-26T09:19:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2617.249287 secs 2024-07-26T09:19:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2601.764897 secs 2024-07-26T09:19:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2617.249287 secs 2024-07-26T09:19:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:17 smithi043 ceph-mon[32384]: pgmap v1968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:17 smithi133 ceph-mon[37053]: pgmap v1968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:17 smithi063 ceph-mon[36747]: pgmap v1968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:19 smithi043 ceph-mon[32384]: pgmap v1969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:19 smithi133 ceph-mon[37053]: pgmap v1969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:19 smithi063 ceph-mon[36747]: pgmap v1969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2606.765028 secs 2024-07-26T09:19:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:21 smithi043 ceph-mon[32384]: pgmap v1970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2622.249391 secs 2024-07-26T09:19:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2606.765028 secs 2024-07-26T09:19:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:21 smithi133 ceph-mon[37053]: pgmap v1970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2622.249391 secs 2024-07-26T09:19:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2606.765028 secs 2024-07-26T09:19:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:21 smithi063 ceph-mon[36747]: pgmap v1970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2622.249391 secs 2024-07-26T09:19:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:23 smithi043 ceph-mon[32384]: pgmap v1971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:23 smithi133 ceph-mon[37053]: pgmap v1971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:23 smithi063 ceph-mon[36747]: pgmap v1971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:25 smithi043 ceph-mon[32384]: pgmap v1972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:25 smithi133 ceph-mon[37053]: pgmap v1972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:25 smithi063 ceph-mon[36747]: pgmap v1972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2611.765161 secs 2024-07-26T09:19:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2627.249518 secs 2024-07-26T09:19:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2611.765161 secs 2024-07-26T09:19:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2627.249518 secs 2024-07-26T09:19:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2611.765161 secs 2024-07-26T09:19:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2627.249518 secs 2024-07-26T09:19:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:27 smithi043 ceph-mon[32384]: pgmap v1973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:27 smithi133 ceph-mon[37053]: pgmap v1973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:27 smithi063 ceph-mon[36747]: pgmap v1973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:29 smithi043 ceph-mon[32384]: pgmap v1974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:29 smithi133 ceph-mon[37053]: pgmap v1974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:29 smithi063 ceph-mon[36747]: pgmap v1974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2616.765281 secs 2024-07-26T09:19:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:31 smithi043 ceph-mon[32384]: pgmap v1975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2632.249661 secs 2024-07-26T09:19:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2616.765281 secs 2024-07-26T09:19:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:31 smithi133 ceph-mon[37053]: pgmap v1975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2632.249661 secs 2024-07-26T09:19:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2616.765281 secs 2024-07-26T09:19:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:31 smithi063 ceph-mon[36747]: pgmap v1975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2632.249661 secs 2024-07-26T09:19:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:33 smithi133 ceph-mon[37053]: pgmap v1976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:33 smithi063 ceph-mon[36747]: pgmap v1976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:33 smithi043 ceph-mon[32384]: pgmap v1976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:35 smithi133 ceph-mon[37053]: pgmap v1977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:35 smithi063 ceph-mon[36747]: pgmap v1977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:35 smithi043 ceph-mon[32384]: pgmap v1977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2621.765377 secs 2024-07-26T09:19:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2637.249800 secs 2024-07-26T09:19:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2621.765377 secs 2024-07-26T09:19:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2637.249800 secs 2024-07-26T09:19:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2621.765377 secs 2024-07-26T09:19:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2637.249800 secs 2024-07-26T09:19:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:37 smithi133 ceph-mon[37053]: pgmap v1978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:37 smithi063 ceph-mon[36747]: pgmap v1978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:37 smithi043 ceph-mon[32384]: pgmap v1978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:39 smithi133 ceph-mon[37053]: pgmap v1979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:39 smithi063 ceph-mon[36747]: pgmap v1979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:39 smithi043 ceph-mon[32384]: pgmap v1979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2626.765507 secs 2024-07-26T09:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:41 smithi133 ceph-mon[37053]: pgmap v1980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2642.249941 secs 2024-07-26T09:19:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2626.765507 secs 2024-07-26T09:19:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:41 smithi063 ceph-mon[36747]: pgmap v1980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2642.249941 secs 2024-07-26T09:19:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2626.765507 secs 2024-07-26T09:19:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:41 smithi043 ceph-mon[32384]: pgmap v1980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2642.249941 secs 2024-07-26T09:19:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:43 smithi133 ceph-mon[37053]: pgmap v1981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:43 smithi063 ceph-mon[36747]: pgmap v1981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:43 smithi043 ceph-mon[32384]: pgmap v1981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:45 smithi063 ceph-mon[36747]: pgmap v1982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:45 smithi043 ceph-mon[32384]: pgmap v1982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:45 smithi133 ceph-mon[37053]: pgmap v1982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2631.765612 secs 2024-07-26T09:19:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2647.250024 secs 2024-07-26T09:19:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2631.765612 secs 2024-07-26T09:19:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2647.250024 secs 2024-07-26T09:19:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2631.765612 secs 2024-07-26T09:19:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2647.250024 secs 2024-07-26T09:19:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:47 smithi063 ceph-mon[36747]: pgmap v1983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:47 smithi043 ceph-mon[32384]: pgmap v1983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:47 smithi133 ceph-mon[37053]: pgmap v1983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:19:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:49 smithi063 ceph-mon[36747]: pgmap v1984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:49 smithi043 ceph-mon[32384]: pgmap v1984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:49 smithi133 ceph-mon[37053]: pgmap v1984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:19:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2636.765700 secs 2024-07-26T09:19:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2636.765700 secs 2024-07-26T09:19:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2636.765700 secs 2024-07-26T09:19:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:51 smithi063 ceph-mon[36747]: pgmap v1985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2652.250117 secs 2024-07-26T09:19:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:51 smithi043 ceph-mon[32384]: pgmap v1985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2652.250117 secs 2024-07-26T09:19:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:51 smithi133 ceph-mon[37053]: pgmap v1985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:19:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2652.250117 secs 2024-07-26T09:19:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:53 smithi063 ceph-mon[36747]: pgmap v1986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:53 smithi043 ceph-mon[32384]: pgmap v1986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:53 smithi133 ceph-mon[37053]: pgmap v1986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:55 smithi063 ceph-mon[36747]: pgmap v1987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:19:55.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2641.765841 secs 2024-07-26T09:19:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:55 smithi043 ceph-mon[32384]: pgmap v1987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:19:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2641.765841 secs 2024-07-26T09:19:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:55 smithi133 ceph-mon[37053]: pgmap v1987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:19:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2641.765841 secs 2024-07-26T09:19:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2657.250234 secs 2024-07-26T09:19:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2657.250234 secs 2024-07-26T09:19:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2657.250234 secs 2024-07-26T09:19:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:57 smithi043 ceph-mon[32384]: pgmap v1988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:57 smithi133 ceph-mon[37053]: pgmap v1988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:57 smithi063 ceph-mon[36747]: pgmap v1988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:19:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:19:59 smithi043 ceph-mon[32384]: pgmap v1989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:19:59 smithi133 ceph-mon[37053]: pgmap v1989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:19:59 smithi063 ceph-mon[36747]: pgmap v1989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:20:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2646.765979 secs 2024-07-26T09:20:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:20:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2646.765979 secs 2024-07-26T09:20:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:20:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2646.765979 secs 2024-07-26T09:20:01.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:01 smithi043 ceph-mon[32384]: pgmap v1990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:20:01.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2662.250371 secs 2024-07-26T09:20:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:01 smithi063 ceph-mon[36747]: pgmap v1990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:20:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2662.250371 secs 2024-07-26T09:20:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:01 smithi133 ceph-mon[37053]: pgmap v1990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:20:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2662.250371 secs 2024-07-26T09:20:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:03 smithi043 ceph-mon[32384]: pgmap v1991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:03 smithi133 ceph-mon[37053]: pgmap v1991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:03 smithi063 ceph-mon[36747]: pgmap v1991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:20:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:20:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:20:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:05 smithi043 ceph-mon[32384]: pgmap v1992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2651.766128 secs 2024-07-26T09:20:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:05 smithi133 ceph-mon[37053]: pgmap v1992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2651.766128 secs 2024-07-26T09:20:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:05 smithi063 ceph-mon[36747]: pgmap v1992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2651.766128 secs 2024-07-26T09:20:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:06.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2667.250465 secs 2024-07-26T09:20:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:20:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:20:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2667.250465 secs 2024-07-26T09:20:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:20:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:20:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2667.250465 secs 2024-07-26T09:20:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:20:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:07 smithi043 ceph-mon[32384]: pgmap v1993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:07 smithi043 ceph-mon[32384]: pgmap v1994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:07.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:07 smithi043 ceph-mon[32384]: pgmap v1995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:20:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:07 smithi133 ceph-mon[37053]: pgmap v1993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:07 smithi133 ceph-mon[37053]: pgmap v1994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:08.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:07 smithi133 ceph-mon[37053]: pgmap v1995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:07 smithi063 ceph-mon[36747]: pgmap v1993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:07 smithi063 ceph-mon[36747]: pgmap v1994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:07 smithi063 ceph-mon[36747]: pgmap v1995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:20:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:09 smithi043 ceph-mon[32384]: pgmap v1996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:20:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:09 smithi133 ceph-mon[37053]: pgmap v1996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:20:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:09 smithi063 ceph-mon[36747]: pgmap v1996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:20:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2656.766245 secs 2024-07-26T09:20:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2656.766245 secs 2024-07-26T09:20:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2656.766245 secs 2024-07-26T09:20:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:11 smithi043 ceph-mon[32384]: pgmap v1997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T09:20:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2672.250529 secs 2024-07-26T09:20:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:11 smithi133 ceph-mon[37053]: pgmap v1997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T09:20:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2672.250529 secs 2024-07-26T09:20:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:11 smithi063 ceph-mon[36747]: pgmap v1997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T09:20:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2672.250529 secs 2024-07-26T09:20:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:13 smithi043 ceph-mon[32384]: pgmap v1998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:20:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:13 smithi133 ceph-mon[37053]: pgmap v1998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:20:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:13 smithi063 ceph-mon[36747]: pgmap v1998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:15 smithi043 ceph-mon[32384]: pgmap v1999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T09:20:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2661.766373 secs 2024-07-26T09:20:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:15 smithi133 ceph-mon[37053]: pgmap v1999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T09:20:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2661.766373 secs 2024-07-26T09:20:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:15 smithi063 ceph-mon[36747]: pgmap v1999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T09:20:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2661.766373 secs 2024-07-26T09:20:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2677.250674 secs 2024-07-26T09:20:17.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2677.250674 secs 2024-07-26T09:20:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2677.250674 secs 2024-07-26T09:20:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:17 smithi043 ceph-mon[32384]: pgmap v2000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:17 smithi133 ceph-mon[37053]: pgmap v2000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:17 smithi063 ceph-mon[36747]: pgmap v2000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:20:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:19 smithi043 ceph-mon[32384]: pgmap v2001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:19 smithi133 ceph-mon[37053]: pgmap v2001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:19 smithi063 ceph-mon[36747]: pgmap v2001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2666.766492 secs 2024-07-26T09:20:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2666.766492 secs 2024-07-26T09:20:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2666.766492 secs 2024-07-26T09:20:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:21 smithi043 ceph-mon[32384]: pgmap v2002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2682.250811 secs 2024-07-26T09:20:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:21 smithi133 ceph-mon[37053]: pgmap v2002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2682.250811 secs 2024-07-26T09:20:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:21 smithi063 ceph-mon[36747]: pgmap v2002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2682.250811 secs 2024-07-26T09:20:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:23 smithi043 ceph-mon[32384]: pgmap v2003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:23 smithi133 ceph-mon[37053]: pgmap v2003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:23 smithi063 ceph-mon[36747]: pgmap v2003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:25 smithi043 ceph-mon[32384]: pgmap v2004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2671.766620 secs 2024-07-26T09:20:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:25 smithi133 ceph-mon[37053]: pgmap v2004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2671.766620 secs 2024-07-26T09:20:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:25 smithi063 ceph-mon[36747]: pgmap v2004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2671.766620 secs 2024-07-26T09:20:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2687.250931 secs 2024-07-26T09:20:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2687.250931 secs 2024-07-26T09:20:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2687.250931 secs 2024-07-26T09:20:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:27 smithi043 ceph-mon[32384]: pgmap v2005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:27 smithi133 ceph-mon[37053]: pgmap v2005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:27 smithi063 ceph-mon[36747]: pgmap v2005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:29 smithi133 ceph-mon[37053]: pgmap v2006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:29 smithi063 ceph-mon[36747]: pgmap v2006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:29 smithi043 ceph-mon[32384]: pgmap v2006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2676.766683 secs 2024-07-26T09:20:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2676.766683 secs 2024-07-26T09:20:31.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2676.766683 secs 2024-07-26T09:20:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:31 smithi133 ceph-mon[37053]: pgmap v2007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2692.251000 secs 2024-07-26T09:20:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:31 smithi063 ceph-mon[36747]: pgmap v2007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2692.251000 secs 2024-07-26T09:20:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:31 smithi043 ceph-mon[32384]: pgmap v2007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2692.251000 secs 2024-07-26T09:20:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:33 smithi133 ceph-mon[37053]: pgmap v2008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:33 smithi063 ceph-mon[36747]: pgmap v2008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:33 smithi043 ceph-mon[32384]: pgmap v2008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:35 smithi133 ceph-mon[37053]: pgmap v2009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2681.766812 secs 2024-07-26T09:20:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:35 smithi063 ceph-mon[36747]: pgmap v2009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:36.210 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2681.766812 secs 2024-07-26T09:20:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:35 smithi043 ceph-mon[32384]: pgmap v2009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2681.766812 secs 2024-07-26T09:20:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2697.251117 secs 2024-07-26T09:20:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2697.251117 secs 2024-07-26T09:20:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2697.251117 secs 2024-07-26T09:20:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:37 smithi063 ceph-mon[36747]: pgmap v2010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:37 smithi043 ceph-mon[32384]: pgmap v2010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:37 smithi133 ceph-mon[37053]: pgmap v2010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:39 smithi063 ceph-mon[36747]: pgmap v2011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:39 smithi043 ceph-mon[32384]: pgmap v2011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:39 smithi133 ceph-mon[37053]: pgmap v2011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2686.766940 secs 2024-07-26T09:20:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2686.766940 secs 2024-07-26T09:20:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2686.766940 secs 2024-07-26T09:20:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:41 smithi063 ceph-mon[36747]: pgmap v2012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2702.251237 secs 2024-07-26T09:20:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:41 smithi043 ceph-mon[32384]: pgmap v2012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2702.251237 secs 2024-07-26T09:20:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:41 smithi133 ceph-mon[37053]: pgmap v2012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2702.251237 secs 2024-07-26T09:20:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:43 smithi063 ceph-mon[36747]: pgmap v2013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:43 smithi043 ceph-mon[32384]: pgmap v2013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:43 smithi133 ceph-mon[37053]: pgmap v2013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:45 smithi063 ceph-mon[36747]: pgmap v2014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2691.767083 secs 2024-07-26T09:20:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:45 smithi043 ceph-mon[32384]: pgmap v2014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2691.767083 secs 2024-07-26T09:20:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:45 smithi133 ceph-mon[37053]: pgmap v2014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2691.767083 secs 2024-07-26T09:20:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2707.251375 secs 2024-07-26T09:20:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2707.251375 secs 2024-07-26T09:20:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2707.251375 secs 2024-07-26T09:20:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:47 smithi043 ceph-mon[32384]: pgmap v2015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:47 smithi133 ceph-mon[37053]: pgmap v2015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:47 smithi063 ceph-mon[36747]: pgmap v2015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:49 smithi043 ceph-mon[32384]: pgmap v2016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:49 smithi133 ceph-mon[37053]: pgmap v2016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:49 smithi063 ceph-mon[36747]: pgmap v2016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2696.767215 secs 2024-07-26T09:20:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2696.767215 secs 2024-07-26T09:20:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2696.767215 secs 2024-07-26T09:20:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:51 smithi043 ceph-mon[32384]: pgmap v2017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2712.251494 secs 2024-07-26T09:20:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:51 smithi133 ceph-mon[37053]: pgmap v2017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2712.251494 secs 2024-07-26T09:20:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:51 smithi063 ceph-mon[36747]: pgmap v2017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:20:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2712.251494 secs 2024-07-26T09:20:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:53 smithi043 ceph-mon[32384]: pgmap v2018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:53 smithi133 ceph-mon[37053]: pgmap v2018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:53 smithi063 ceph-mon[36747]: pgmap v2018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:55 smithi043 ceph-mon[32384]: pgmap v2019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2701.767366 secs 2024-07-26T09:20:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:55 smithi133 ceph-mon[37053]: pgmap v2019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2701.767366 secs 2024-07-26T09:20:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:55 smithi063 ceph-mon[36747]: pgmap v2019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:20:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2701.767366 secs 2024-07-26T09:20:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2717.251620 secs 2024-07-26T09:20:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2717.251620 secs 2024-07-26T09:20:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2717.251620 secs 2024-07-26T09:20:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:57 smithi043 ceph-mon[32384]: pgmap v2020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:57 smithi133 ceph-mon[37053]: pgmap v2020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:20:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:57 smithi063 ceph-mon[36747]: pgmap v2020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:00.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:20:59 smithi043 ceph-mon[32384]: pgmap v2021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:20:59 smithi133 ceph-mon[37053]: pgmap v2021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:20:59 smithi063 ceph-mon[36747]: pgmap v2021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:01.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2706.767470 secs 2024-07-26T09:21:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2706.767470 secs 2024-07-26T09:21:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2706.767470 secs 2024-07-26T09:21:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:01 smithi043 ceph-mon[32384]: pgmap v2022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2722.251745 secs 2024-07-26T09:21:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:01 smithi133 ceph-mon[37053]: pgmap v2022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2722.251745 secs 2024-07-26T09:21:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:01 smithi063 ceph-mon[36747]: pgmap v2022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2722.251745 secs 2024-07-26T09:21:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:03 smithi043 ceph-mon[32384]: pgmap v2023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:03 smithi133 ceph-mon[37053]: pgmap v2023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:03 smithi063 ceph-mon[36747]: pgmap v2023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:05 smithi043 ceph-mon[32384]: pgmap v2024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2711.767590 secs 2024-07-26T09:21:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:05 smithi133 ceph-mon[37053]: pgmap v2024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2711.767590 secs 2024-07-26T09:21:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:05 smithi063 ceph-mon[36747]: pgmap v2024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2711.767590 secs 2024-07-26T09:21:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2727.251894 secs 2024-07-26T09:21:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:21:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2727.251894 secs 2024-07-26T09:21:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:21:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2727.251894 secs 2024-07-26T09:21:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:21:08.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:08 smithi043 ceph-mon[32384]: pgmap v2025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:08.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:08 smithi063 ceph-mon[36747]: pgmap v2025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:08 smithi133 ceph-mon[37053]: pgmap v2025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: pgmap v2026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: pgmap v2026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: pgmap v2026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:10.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2716.767701 secs 2024-07-26T09:21:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2732.251957 secs 2024-07-26T09:21:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2716.767701 secs 2024-07-26T09:21:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2732.251957 secs 2024-07-26T09:21:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2716.767701 secs 2024-07-26T09:21:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2732.251957 secs 2024-07-26T09:21:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:12 smithi043 ceph-mon[32384]: pgmap v2027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:12 smithi133 ceph-mon[37053]: pgmap v2027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:12 smithi063 ceph-mon[36747]: pgmap v2027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:21:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:21:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: pgmap v2028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: pgmap v2029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:21:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:21:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: pgmap v2028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: pgmap v2029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:13.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:21:13.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:21:13.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: pgmap v2028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:13.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: pgmap v2029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:13.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:21:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:15 smithi043 ceph-mon[32384]: pgmap v2030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:15 smithi133 ceph-mon[37053]: pgmap v2030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:15 smithi063 ceph-mon[36747]: pgmap v2030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2721.767816 secs 2024-07-26T09:21:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2737.252117 secs 2024-07-26T09:21:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2721.767816 secs 2024-07-26T09:21:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2737.252117 secs 2024-07-26T09:21:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2721.767816 secs 2024-07-26T09:21:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2737.252117 secs 2024-07-26T09:21:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:17 smithi043 ceph-mon[32384]: pgmap v2031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:17 smithi133 ceph-mon[37053]: pgmap v2031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:17 smithi063 ceph-mon[36747]: pgmap v2031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:19.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:19 smithi043 ceph-mon[32384]: pgmap v2032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:19 smithi133 ceph-mon[37053]: pgmap v2032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:19 smithi063 ceph-mon[36747]: pgmap v2032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2726.767962 secs 2024-07-26T09:21:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:21 smithi043 ceph-mon[32384]: pgmap v2033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2742.252240 secs 2024-07-26T09:21:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2726.767962 secs 2024-07-26T09:21:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:21 smithi133 ceph-mon[37053]: pgmap v2033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2742.252240 secs 2024-07-26T09:21:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2726.767962 secs 2024-07-26T09:21:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:21 smithi063 ceph-mon[36747]: pgmap v2033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:21:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2742.252240 secs 2024-07-26T09:21:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:23 smithi043 ceph-mon[32384]: pgmap v2034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:21:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:23 smithi133 ceph-mon[37053]: pgmap v2034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:21:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:23 smithi063 ceph-mon[36747]: pgmap v2034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:21:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:25 smithi043 ceph-mon[32384]: pgmap v2035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:25 smithi133 ceph-mon[37053]: pgmap v2035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:25 smithi063 ceph-mon[36747]: pgmap v2035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2731.768130 secs 2024-07-26T09:21:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2747.252377 secs 2024-07-26T09:21:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2731.768130 secs 2024-07-26T09:21:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2747.252377 secs 2024-07-26T09:21:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2731.768130 secs 2024-07-26T09:21:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2747.252377 secs 2024-07-26T09:21:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:27 smithi133 ceph-mon[37053]: pgmap v2036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:27 smithi063 ceph-mon[36747]: pgmap v2036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:27 smithi043 ceph-mon[32384]: pgmap v2036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:29 smithi133 ceph-mon[37053]: pgmap v2037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:29 smithi063 ceph-mon[36747]: pgmap v2037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:29 smithi043 ceph-mon[32384]: pgmap v2037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2736.768223 secs 2024-07-26T09:21:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:31 smithi133 ceph-mon[37053]: pgmap v2038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2752.252459 secs 2024-07-26T09:21:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2736.768223 secs 2024-07-26T09:21:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:31 smithi063 ceph-mon[36747]: pgmap v2038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2752.252459 secs 2024-07-26T09:21:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2736.768223 secs 2024-07-26T09:21:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:31 smithi043 ceph-mon[32384]: pgmap v2038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2752.252459 secs 2024-07-26T09:21:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:33 smithi133 ceph-mon[37053]: pgmap v2039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:33 smithi063 ceph-mon[36747]: pgmap v2039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:33 smithi043 ceph-mon[32384]: pgmap v2039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:35 smithi063 ceph-mon[36747]: pgmap v2040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:35 smithi043 ceph-mon[32384]: pgmap v2040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:36.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:35 smithi133 ceph-mon[37053]: pgmap v2040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2741.768314 secs 2024-07-26T09:21:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2757.252582 secs 2024-07-26T09:21:36.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2741.768314 secs 2024-07-26T09:21:36.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2757.252582 secs 2024-07-26T09:21:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2741.768314 secs 2024-07-26T09:21:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2757.252582 secs 2024-07-26T09:21:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:37 smithi063 ceph-mon[36747]: pgmap v2041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:37.933 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:37 smithi133 ceph-mon[37053]: pgmap v2041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:37 smithi043 ceph-mon[32384]: pgmap v2041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:39 smithi063 ceph-mon[36747]: pgmap v2042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:39 smithi043 ceph-mon[32384]: pgmap v2042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:39 smithi133 ceph-mon[37053]: pgmap v2042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2746.768439 secs 2024-07-26T09:21:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2746.768439 secs 2024-07-26T09:21:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2746.768439 secs 2024-07-26T09:21:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:41 smithi043 ceph-mon[32384]: pgmap v2043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2762.252706 secs 2024-07-26T09:21:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:41 smithi133 ceph-mon[37053]: pgmap v2043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2762.252706 secs 2024-07-26T09:21:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:41 smithi063 ceph-mon[36747]: pgmap v2043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2762.252706 secs 2024-07-26T09:21:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:43 smithi043 ceph-mon[32384]: pgmap v2044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:43 smithi133 ceph-mon[37053]: pgmap v2044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:43 smithi063 ceph-mon[36747]: pgmap v2044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:45 smithi043 ceph-mon[32384]: pgmap v2045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:45.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2751.768558 secs 2024-07-26T09:21:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:45 smithi133 ceph-mon[37053]: pgmap v2045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2751.768558 secs 2024-07-26T09:21:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:45 smithi063 ceph-mon[36747]: pgmap v2045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2751.768558 secs 2024-07-26T09:21:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2767.252847 secs 2024-07-26T09:21:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2767.252847 secs 2024-07-26T09:21:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2767.252847 secs 2024-07-26T09:21:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:47 smithi043 ceph-mon[32384]: pgmap v2046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:47 smithi133 ceph-mon[37053]: pgmap v2046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:47 smithi063 ceph-mon[36747]: pgmap v2046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:49 smithi043 ceph-mon[32384]: pgmap v2047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:49 smithi133 ceph-mon[37053]: pgmap v2047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:49 smithi063 ceph-mon[36747]: pgmap v2047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2756.768684 secs 2024-07-26T09:21:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2756.768684 secs 2024-07-26T09:21:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2756.768684 secs 2024-07-26T09:21:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:51 smithi043 ceph-mon[32384]: pgmap v2048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2772.252963 secs 2024-07-26T09:21:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:51 smithi133 ceph-mon[37053]: pgmap v2048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2772.252963 secs 2024-07-26T09:21:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:51 smithi063 ceph-mon[36747]: pgmap v2048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:21:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2772.252963 secs 2024-07-26T09:21:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:53 smithi043 ceph-mon[32384]: pgmap v2049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:53 smithi133 ceph-mon[37053]: pgmap v2049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:53 smithi063 ceph-mon[36747]: pgmap v2049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:55 smithi043 ceph-mon[32384]: pgmap v2050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2761.768837 secs 2024-07-26T09:21:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:55 smithi133 ceph-mon[37053]: pgmap v2050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2761.768837 secs 2024-07-26T09:21:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:55 smithi063 ceph-mon[36747]: pgmap v2050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:21:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2761.768837 secs 2024-07-26T09:21:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2777.253074 secs 2024-07-26T09:21:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2777.253074 secs 2024-07-26T09:21:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2777.253074 secs 2024-07-26T09:21:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:57 smithi043 ceph-mon[32384]: pgmap v2051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:57 smithi133 ceph-mon[37053]: pgmap v2051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:57 smithi063 ceph-mon[36747]: pgmap v2051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:21:59.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:21:59 smithi043 ceph-mon[32384]: pgmap v2052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:21:59 smithi133 ceph-mon[37053]: pgmap v2052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:21:59 smithi063 ceph-mon[36747]: pgmap v2052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2766.768953 secs 2024-07-26T09:22:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2766.768953 secs 2024-07-26T09:22:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2766.768953 secs 2024-07-26T09:22:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:01 smithi063 ceph-mon[36747]: pgmap v2053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2782.253165 secs 2024-07-26T09:22:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:01 smithi043 ceph-mon[32384]: pgmap v2053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2782.253165 secs 2024-07-26T09:22:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:01 smithi133 ceph-mon[37053]: pgmap v2053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2782.253165 secs 2024-07-26T09:22:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:03 smithi043 ceph-mon[32384]: pgmap v2054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:03 smithi133 ceph-mon[37053]: pgmap v2054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:03 smithi063 ceph-mon[36747]: pgmap v2054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:05 smithi043 ceph-mon[32384]: pgmap v2055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:05.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2771.769069 secs 2024-07-26T09:22:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:05 smithi133 ceph-mon[37053]: pgmap v2055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2771.769069 secs 2024-07-26T09:22:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:05 smithi063 ceph-mon[36747]: pgmap v2055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2771.769069 secs 2024-07-26T09:22:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2787.253250 secs 2024-07-26T09:22:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2787.253250 secs 2024-07-26T09:22:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2787.253250 secs 2024-07-26T09:22:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:07 smithi043 ceph-mon[32384]: pgmap v2056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:07 smithi133 ceph-mon[37053]: pgmap v2056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:07 smithi063 ceph-mon[36747]: pgmap v2056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:09 smithi043 ceph-mon[32384]: pgmap v2057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:09 smithi133 ceph-mon[37053]: pgmap v2057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:09 smithi063 ceph-mon[36747]: pgmap v2057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2776.769185 secs 2024-07-26T09:22:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2776.769185 secs 2024-07-26T09:22:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2776.769185 secs 2024-07-26T09:22:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:11 smithi043 ceph-mon[32384]: pgmap v2058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2792.253370 secs 2024-07-26T09:22:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:11 smithi133 ceph-mon[37053]: pgmap v2058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2792.253370 secs 2024-07-26T09:22:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:11 smithi063 ceph-mon[36747]: pgmap v2058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2792.253370 secs 2024-07-26T09:22:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:22:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:22:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:22:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:13 smithi133 ceph-mon[37053]: pgmap v2059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:22:14.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:22:14.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:22:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:13 smithi063 ceph-mon[36747]: pgmap v2059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:22:14.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:22:14.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:22:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:13 smithi043 ceph-mon[32384]: pgmap v2059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:14.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:22:14.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:22:14.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:22:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:14 smithi133 ceph-mon[37053]: pgmap v2060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:15.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:14 smithi133 ceph-mon[37053]: pgmap v2061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:14 smithi063 ceph-mon[36747]: pgmap v2060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:14 smithi063 ceph-mon[36747]: pgmap v2061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:14 smithi043 ceph-mon[32384]: pgmap v2060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:15.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:14 smithi043 ceph-mon[32384]: pgmap v2061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2781.769297 secs 2024-07-26T09:22:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2781.769297 secs 2024-07-26T09:22:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2781.769297 secs 2024-07-26T09:22:17.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2797.253497 secs 2024-07-26T09:22:17.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:16 smithi133 ceph-mon[37053]: pgmap v2062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2797.253497 secs 2024-07-26T09:22:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:16 smithi063 ceph-mon[36747]: pgmap v2062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:17.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2797.253497 secs 2024-07-26T09:22:17.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:16 smithi043 ceph-mon[32384]: pgmap v2062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:18 smithi063 ceph-mon[36747]: pgmap v2063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:22:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:18 smithi043 ceph-mon[32384]: pgmap v2063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:22:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:18 smithi133 ceph-mon[37053]: pgmap v2063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:22:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:20 smithi063 ceph-mon[36747]: pgmap v2064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2786.769360 secs 2024-07-26T09:22:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:20 smithi043 ceph-mon[32384]: pgmap v2064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2786.769360 secs 2024-07-26T09:22:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:20 smithi133 ceph-mon[37053]: pgmap v2064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2786.769360 secs 2024-07-26T09:22:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2802.253618 secs 2024-07-26T09:22:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2802.253618 secs 2024-07-26T09:22:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2802.253618 secs 2024-07-26T09:22:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:22 smithi063 ceph-mon[36747]: pgmap v2065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:22 smithi043 ceph-mon[32384]: pgmap v2065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:22 smithi133 ceph-mon[37053]: pgmap v2065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:22:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:24 smithi063 ceph-mon[36747]: pgmap v2066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:22:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:24 smithi043 ceph-mon[32384]: pgmap v2066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:22:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:24 smithi133 ceph-mon[37053]: pgmap v2066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:22:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2791.769445 secs 2024-07-26T09:22:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2791.769445 secs 2024-07-26T09:22:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2791.769445 secs 2024-07-26T09:22:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2807.253758 secs 2024-07-26T09:22:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:26 smithi063 ceph-mon[36747]: pgmap v2067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2807.253758 secs 2024-07-26T09:22:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:26 smithi043 ceph-mon[32384]: pgmap v2067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2807.253758 secs 2024-07-26T09:22:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:26 smithi133 ceph-mon[37053]: pgmap v2067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:28 smithi063 ceph-mon[36747]: pgmap v2068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:28 smithi043 ceph-mon[32384]: pgmap v2068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:28 smithi133 ceph-mon[37053]: pgmap v2068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:30 smithi043 ceph-mon[32384]: pgmap v2069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2796.769559 secs 2024-07-26T09:22:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:30 smithi133 ceph-mon[37053]: pgmap v2069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2796.769559 secs 2024-07-26T09:22:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:30 smithi063 ceph-mon[36747]: pgmap v2069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2796.769559 secs 2024-07-26T09:22:32.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2812.253823 secs 2024-07-26T09:22:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2812.253823 secs 2024-07-26T09:22:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2812.253823 secs 2024-07-26T09:22:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:32 smithi043 ceph-mon[32384]: pgmap v2070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:32 smithi133 ceph-mon[37053]: pgmap v2070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:32 smithi063 ceph-mon[36747]: pgmap v2070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:34 smithi043 ceph-mon[32384]: pgmap v2071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:34 smithi133 ceph-mon[37053]: pgmap v2071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:34 smithi063 ceph-mon[36747]: pgmap v2071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:36.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2801.769680 secs 2024-07-26T09:22:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2801.769680 secs 2024-07-26T09:22:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2801.769680 secs 2024-07-26T09:22:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2817.253926 secs 2024-07-26T09:22:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:36 smithi043 ceph-mon[32384]: pgmap v2072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2817.253926 secs 2024-07-26T09:22:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:36 smithi133 ceph-mon[37053]: pgmap v2072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2817.253926 secs 2024-07-26T09:22:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:36 smithi063 ceph-mon[36747]: pgmap v2072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:38 smithi043 ceph-mon[32384]: pgmap v2073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:38 smithi133 ceph-mon[37053]: pgmap v2073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:38 smithi063 ceph-mon[36747]: pgmap v2073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:40 smithi043 ceph-mon[32384]: pgmap v2074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2806.769740 secs 2024-07-26T09:22:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:40 smithi133 ceph-mon[37053]: pgmap v2074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2806.769740 secs 2024-07-26T09:22:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:40 smithi063 ceph-mon[36747]: pgmap v2074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2806.769740 secs 2024-07-26T09:22:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2822.254048 secs 2024-07-26T09:22:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2822.254048 secs 2024-07-26T09:22:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2822.254048 secs 2024-07-26T09:22:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:42 smithi043 ceph-mon[32384]: pgmap v2075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:42 smithi133 ceph-mon[37053]: pgmap v2075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:42 smithi063 ceph-mon[36747]: pgmap v2075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:44 smithi043 ceph-mon[32384]: pgmap v2076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:44 smithi133 ceph-mon[37053]: pgmap v2076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:44 smithi063 ceph-mon[36747]: pgmap v2076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2811.769865 secs 2024-07-26T09:22:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2811.769865 secs 2024-07-26T09:22:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2811.769865 secs 2024-07-26T09:22:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2827.254164 secs 2024-07-26T09:22:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:46 smithi043 ceph-mon[32384]: pgmap v2077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2827.254164 secs 2024-07-26T09:22:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:46 smithi133 ceph-mon[37053]: pgmap v2077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2827.254164 secs 2024-07-26T09:22:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:46 smithi063 ceph-mon[36747]: pgmap v2077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:48 smithi043 ceph-mon[32384]: pgmap v2078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:48 smithi133 ceph-mon[37053]: pgmap v2078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:48 smithi063 ceph-mon[36747]: pgmap v2078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:50 smithi043 ceph-mon[32384]: pgmap v2079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2816.770003 secs 2024-07-26T09:22:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:50 smithi133 ceph-mon[37053]: pgmap v2079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2816.770003 secs 2024-07-26T09:22:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:50 smithi063 ceph-mon[36747]: pgmap v2079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2816.770003 secs 2024-07-26T09:22:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2832.254260 secs 2024-07-26T09:22:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2832.254260 secs 2024-07-26T09:22:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2832.254260 secs 2024-07-26T09:22:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:52 smithi043 ceph-mon[32384]: pgmap v2080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:52 smithi133 ceph-mon[37053]: pgmap v2080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:52 smithi063 ceph-mon[36747]: pgmap v2080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:54 smithi043 ceph-mon[32384]: pgmap v2081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:54 smithi133 ceph-mon[37053]: pgmap v2081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:54 smithi063 ceph-mon[36747]: pgmap v2081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:22:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2821.770135 secs 2024-07-26T09:22:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2837.254386 secs 2024-07-26T09:22:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2821.770135 secs 2024-07-26T09:22:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2837.254386 secs 2024-07-26T09:22:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2821.770135 secs 2024-07-26T09:22:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2837.254386 secs 2024-07-26T09:22:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:56 smithi043 ceph-mon[32384]: pgmap v2082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:56 smithi133 ceph-mon[37053]: pgmap v2082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:56 smithi063 ceph-mon[36747]: pgmap v2082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:22:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:22:58 smithi043 ceph-mon[32384]: pgmap v2083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:22:58 smithi133 ceph-mon[37053]: pgmap v2083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:22:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:22:58 smithi063 ceph-mon[36747]: pgmap v2083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:01.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:00 smithi043 ceph-mon[32384]: pgmap v2084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:01.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2826.770258 secs 2024-07-26T09:23:01.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2842.254501 secs 2024-07-26T09:23:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:00 smithi133 ceph-mon[37053]: pgmap v2084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:01.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2826.770258 secs 2024-07-26T09:23:01.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2842.254501 secs 2024-07-26T09:23:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:00 smithi063 ceph-mon[36747]: pgmap v2084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2826.770258 secs 2024-07-26T09:23:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2842.254501 secs 2024-07-26T09:23:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:02 smithi043 ceph-mon[32384]: pgmap v2085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:02 smithi133 ceph-mon[37053]: pgmap v2085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:02 smithi063 ceph-mon[36747]: pgmap v2085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:04 smithi043 ceph-mon[32384]: pgmap v2086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:04 smithi133 ceph-mon[37053]: pgmap v2086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:04 smithi063 ceph-mon[36747]: pgmap v2086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2831.770383 secs 2024-07-26T09:23:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2847.254631 secs 2024-07-26T09:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2831.770383 secs 2024-07-26T09:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2847.254631 secs 2024-07-26T09:23:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2831.770383 secs 2024-07-26T09:23:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2847.254631 secs 2024-07-26T09:23:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:06 smithi043 ceph-mon[32384]: pgmap v2087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:06 smithi133 ceph-mon[37053]: pgmap v2087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:06 smithi063 ceph-mon[36747]: pgmap v2087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:08 smithi133 ceph-mon[37053]: pgmap v2088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:08 smithi063 ceph-mon[36747]: pgmap v2088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:08 smithi043 ceph-mon[32384]: pgmap v2088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:10 smithi133 ceph-mon[37053]: pgmap v2089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:11.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2836.770514 secs 2024-07-26T09:23:11.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2852.254767 secs 2024-07-26T09:23:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:10 smithi063 ceph-mon[36747]: pgmap v2089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2836.770514 secs 2024-07-26T09:23:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2852.254767 secs 2024-07-26T09:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:10 smithi043 ceph-mon[32384]: pgmap v2089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2836.770514 secs 2024-07-26T09:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2852.254767 secs 2024-07-26T09:23:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:12 smithi133 ceph-mon[37053]: pgmap v2090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:12 smithi063 ceph-mon[36747]: pgmap v2090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:12 smithi043 ceph-mon[32384]: pgmap v2090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:14 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:23:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:14 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:23:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:14 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:23:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:15 smithi063 ceph-mon[36747]: pgmap v2091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:23:15.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:23:15.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:23:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:15 smithi043 ceph-mon[32384]: pgmap v2091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:23:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:23:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:23:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:15 smithi133 ceph-mon[37053]: pgmap v2091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:23:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:23:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:23:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:16 smithi063 ceph-mon[36747]: pgmap v2092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:23:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:16 smithi063 ceph-mon[36747]: pgmap v2093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:23:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2841.770635 secs 2024-07-26T09:23:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2857.254889 secs 2024-07-26T09:23:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:16 smithi043 ceph-mon[32384]: pgmap v2092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:23:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:16 smithi043 ceph-mon[32384]: pgmap v2093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:23:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2841.770635 secs 2024-07-26T09:23:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2857.254889 secs 2024-07-26T09:23:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:16 smithi133 ceph-mon[37053]: pgmap v2092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:23:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:16 smithi133 ceph-mon[37053]: pgmap v2093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:23:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2841.770635 secs 2024-07-26T09:23:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2857.254889 secs 2024-07-26T09:23:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:18 smithi063 ceph-mon[36747]: pgmap v2094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:23:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:18 smithi043 ceph-mon[32384]: pgmap v2094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:23:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:18 smithi133 ceph-mon[37053]: pgmap v2094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:23:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:20 smithi063 ceph-mon[36747]: pgmap v2095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:23:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:20 smithi043 ceph-mon[32384]: pgmap v2095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:23:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:20 smithi133 ceph-mon[37053]: pgmap v2095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:23:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2846.770765 secs 2024-07-26T09:23:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2862.255009 secs 2024-07-26T09:23:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2846.770765 secs 2024-07-26T09:23:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2862.255009 secs 2024-07-26T09:23:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2846.770765 secs 2024-07-26T09:23:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2862.255009 secs 2024-07-26T09:23:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:22 smithi063 ceph-mon[36747]: pgmap v2096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:23:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:22 smithi043 ceph-mon[32384]: pgmap v2096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:23:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:22 smithi133 ceph-mon[37053]: pgmap v2096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:23:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:24 smithi063 ceph-mon[36747]: pgmap v2097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:23:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:24 smithi043 ceph-mon[32384]: pgmap v2097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:23:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:24 smithi133 ceph-mon[37053]: pgmap v2097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:23:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:26 smithi063 ceph-mon[36747]: pgmap v2098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:23:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2851.770890 secs 2024-07-26T09:23:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2867.255074 secs 2024-07-26T09:23:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:26 smithi043 ceph-mon[32384]: pgmap v2098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2851.770890 secs 2024-07-26T09:23:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2867.255074 secs 2024-07-26T09:23:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:26 smithi133 ceph-mon[37053]: pgmap v2098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:23:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2851.770890 secs 2024-07-26T09:23:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2867.255074 secs 2024-07-26T09:23:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:28 smithi043 ceph-mon[32384]: pgmap v2099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:28 smithi133 ceph-mon[37053]: pgmap v2099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:28 smithi063 ceph-mon[36747]: pgmap v2099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:30 smithi043 ceph-mon[32384]: pgmap v2100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:30 smithi133 ceph-mon[37053]: pgmap v2100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:30 smithi063 ceph-mon[36747]: pgmap v2100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:31.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2856.771053 secs 2024-07-26T09:23:31.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2872.255134 secs 2024-07-26T09:23:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2856.771053 secs 2024-07-26T09:23:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2872.255134 secs 2024-07-26T09:23:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2856.771053 secs 2024-07-26T09:23:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2872.255134 secs 2024-07-26T09:23:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:32 smithi043 ceph-mon[32384]: pgmap v2101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:32 smithi133 ceph-mon[37053]: pgmap v2101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:32 smithi063 ceph-mon[36747]: pgmap v2101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:34.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:34 smithi063 ceph-mon[36747]: pgmap v2102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:34 smithi043 ceph-mon[32384]: pgmap v2102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:34 smithi133 ceph-mon[37053]: pgmap v2102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:36 smithi043 ceph-mon[32384]: pgmap v2103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2861.771182 secs 2024-07-26T09:23:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2877.255255 secs 2024-07-26T09:23:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:36 smithi133 ceph-mon[37053]: pgmap v2103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2861.771182 secs 2024-07-26T09:23:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2877.255255 secs 2024-07-26T09:23:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:36 smithi063 ceph-mon[36747]: pgmap v2103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2861.771182 secs 2024-07-26T09:23:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2877.255255 secs 2024-07-26T09:23:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:38 smithi043 ceph-mon[32384]: pgmap v2104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:38 smithi133 ceph-mon[37053]: pgmap v2104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:38 smithi063 ceph-mon[36747]: pgmap v2104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:40 smithi043 ceph-mon[32384]: pgmap v2105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:40 smithi133 ceph-mon[37053]: pgmap v2105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:40 smithi063 ceph-mon[36747]: pgmap v2105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2866.771273 secs 2024-07-26T09:23:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:41 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 2882.255369 secs 2024-07-26T09:23:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:41 smithi043 ceph-mon[32384]: slow request 2882.255368 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T09:23:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2866.771273 secs 2024-07-26T09:23:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:41 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 2882.255369 secs 2024-07-26T09:23:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:41 smithi133 ceph-mon[37053]: slow request 2882.255368 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T09:23:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2866.771273 secs 2024-07-26T09:23:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:41 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 2882.255369 secs 2024-07-26T09:23:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:41 smithi063 ceph-mon[36747]: slow request 2882.255368 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T09:23:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:42 smithi043 ceph-mon[32384]: pgmap v2106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:42 smithi133 ceph-mon[37053]: pgmap v2106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:42 smithi063 ceph-mon[36747]: pgmap v2106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:44 smithi043 ceph-mon[32384]: pgmap v2107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:44 smithi133 ceph-mon[37053]: pgmap v2107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:44 smithi063 ceph-mon[36747]: pgmap v2107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:46 smithi043 ceph-mon[32384]: pgmap v2108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2871.771391 secs 2024-07-26T09:23:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2887.255497 secs 2024-07-26T09:23:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:46 smithi133 ceph-mon[37053]: pgmap v2108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2871.771391 secs 2024-07-26T09:23:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2887.255497 secs 2024-07-26T09:23:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:46 smithi063 ceph-mon[36747]: pgmap v2108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2871.771391 secs 2024-07-26T09:23:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2887.255497 secs 2024-07-26T09:23:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:47 smithi043 ceph-mon[32384]: pgmap v2109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:47 smithi133 ceph-mon[37053]: pgmap v2109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:47 smithi063 ceph-mon[36747]: pgmap v2109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:50 smithi063 ceph-mon[36747]: pgmap v2110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:50 smithi043 ceph-mon[32384]: pgmap v2110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:50 smithi133 ceph-mon[37053]: pgmap v2110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2876.771517 secs 2024-07-26T09:23:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2892.255591 secs 2024-07-26T09:23:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2876.771517 secs 2024-07-26T09:23:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2892.255591 secs 2024-07-26T09:23:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2876.771517 secs 2024-07-26T09:23:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2892.255591 secs 2024-07-26T09:23:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:52 smithi043 ceph-mon[32384]: pgmap v2111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:52 smithi133 ceph-mon[37053]: pgmap v2111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:52 smithi063 ceph-mon[36747]: pgmap v2111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:54 smithi043 ceph-mon[32384]: pgmap v2112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:54 smithi133 ceph-mon[37053]: pgmap v2112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:54 smithi063 ceph-mon[36747]: pgmap v2112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:23:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:56 smithi043 ceph-mon[32384]: pgmap v2113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:56 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 2881.771649 secs 2024-07-26T09:23:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:56 smithi043 ceph-mon[32384]: slow request 2881.771648 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T09:23:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2897.255716 secs 2024-07-26T09:23:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:56 smithi133 ceph-mon[37053]: pgmap v2113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:56 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 2881.771649 secs 2024-07-26T09:23:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:56 smithi133 ceph-mon[37053]: slow request 2881.771648 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T09:23:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2897.255716 secs 2024-07-26T09:23:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:56 smithi063 ceph-mon[36747]: pgmap v2113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:23:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:56 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 2881.771649 secs 2024-07-26T09:23:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:56 smithi063 ceph-mon[36747]: slow request 2881.771648 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T09:23:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2897.255716 secs 2024-07-26T09:23:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:23:58 smithi043 ceph-mon[32384]: pgmap v2114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:23:58 smithi133 ceph-mon[37053]: pgmap v2114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:23:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:23:58 smithi063 ceph-mon[36747]: pgmap v2114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:00 smithi043 ceph-mon[32384]: pgmap v2115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:00 smithi133 ceph-mon[37053]: pgmap v2115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:00 smithi063 ceph-mon[36747]: pgmap v2115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2886.771791 secs 2024-07-26T09:24:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2902.255835 secs 2024-07-26T09:24:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2886.771791 secs 2024-07-26T09:24:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2902.255835 secs 2024-07-26T09:24:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2886.771791 secs 2024-07-26T09:24:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2902.255835 secs 2024-07-26T09:24:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:02 smithi043 ceph-mon[32384]: pgmap v2116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:02 smithi133 ceph-mon[37053]: pgmap v2116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:02 smithi063 ceph-mon[36747]: pgmap v2116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:04.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:04 smithi063 ceph-mon[36747]: pgmap v2117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:04 smithi043 ceph-mon[32384]: pgmap v2117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:04 smithi133 ceph-mon[37053]: pgmap v2117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:06 smithi043 ceph-mon[32384]: pgmap v2118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:06 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 2891.771937 secs 2024-07-26T09:24:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:06 smithi043 ceph-mon[32384]: slow request 2884.464949 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T09:24:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2907.255956 secs 2024-07-26T09:24:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:06 smithi133 ceph-mon[37053]: pgmap v2118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:06 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 2891.771937 secs 2024-07-26T09:24:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:06 smithi133 ceph-mon[37053]: slow request 2884.464949 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T09:24:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2907.255956 secs 2024-07-26T09:24:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:06 smithi063 ceph-mon[36747]: pgmap v2118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:06 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 2891.771937 secs 2024-07-26T09:24:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:06 smithi063 ceph-mon[36747]: slow request 2884.464949 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T09:24:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2907.255956 secs 2024-07-26T09:24:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:08 smithi043 ceph-mon[32384]: pgmap v2119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:08 smithi133 ceph-mon[37053]: pgmap v2119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:08 smithi063 ceph-mon[36747]: pgmap v2119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:10 smithi043 ceph-mon[32384]: pgmap v2120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:10 smithi133 ceph-mon[37053]: pgmap v2120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:10 smithi063 ceph-mon[36747]: pgmap v2120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2896.772070 secs 2024-07-26T09:24:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2912.256078 secs 2024-07-26T09:24:11.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2896.772070 secs 2024-07-26T09:24:11.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2912.256078 secs 2024-07-26T09:24:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2896.772070 secs 2024-07-26T09:24:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2912.256078 secs 2024-07-26T09:24:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:12 smithi043 ceph-mon[32384]: pgmap v2121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:12 smithi133 ceph-mon[37053]: pgmap v2121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:12 smithi063 ceph-mon[36747]: pgmap v2121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:13 smithi043 ceph-mon[32384]: pgmap v2122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:13 smithi133 ceph-mon[37053]: pgmap v2122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:13 smithi063 ceph-mon[36747]: pgmap v2122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:24:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:16 smithi043 ceph-mon[32384]: pgmap v2123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2901.772196 secs 2024-07-26T09:24:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:24:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2917.256147 secs 2024-07-26T09:24:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:16 smithi133 ceph-mon[37053]: pgmap v2123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2901.772196 secs 2024-07-26T09:24:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:24:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2917.256147 secs 2024-07-26T09:24:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:16 smithi063 ceph-mon[36747]: pgmap v2123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2901.772196 secs 2024-07-26T09:24:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:24:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2917.256147 secs 2024-07-26T09:24:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:24:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:24:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:24:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:24:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:24:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:24:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:24:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:24:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:24:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:18 smithi043 ceph-mon[32384]: pgmap v2124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:24:18.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:18 smithi043 ceph-mon[32384]: pgmap v2125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:24:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:18 smithi133 ceph-mon[37053]: pgmap v2124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:24:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:18 smithi133 ceph-mon[37053]: pgmap v2125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:24:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:18 smithi063 ceph-mon[36747]: pgmap v2124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:24:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:18 smithi063 ceph-mon[36747]: pgmap v2125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:24:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:20 smithi043 ceph-mon[32384]: pgmap v2126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:24:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:20 smithi133 ceph-mon[37053]: pgmap v2126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:24:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:20 smithi063 ceph-mon[36747]: pgmap v2126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:24:21.372 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2906.772280 secs 2024-07-26T09:24:21.372 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2922.256262 secs 2024-07-26T09:24:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2906.772280 secs 2024-07-26T09:24:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2922.256262 secs 2024-07-26T09:24:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2906.772280 secs 2024-07-26T09:24:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2922.256262 secs 2024-07-26T09:24:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:22 smithi043 ceph-mon[32384]: pgmap v2127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:22 smithi133 ceph-mon[37053]: pgmap v2127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:22 smithi063 ceph-mon[36747]: pgmap v2127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:24 smithi043 ceph-mon[32384]: pgmap v2128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:24 smithi133 ceph-mon[37053]: pgmap v2128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:24 smithi063 ceph-mon[36747]: pgmap v2128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:24:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:26 smithi043 ceph-mon[32384]: pgmap v2129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:24:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2911.772358 secs 2024-07-26T09:24:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2927.256379 secs 2024-07-26T09:24:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:26 smithi133 ceph-mon[37053]: pgmap v2129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:24:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2911.772358 secs 2024-07-26T09:24:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2927.256379 secs 2024-07-26T09:24:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:26 smithi063 ceph-mon[36747]: pgmap v2129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:24:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2911.772358 secs 2024-07-26T09:24:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2927.256379 secs 2024-07-26T09:24:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:28 smithi043 ceph-mon[32384]: pgmap v2130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:28 smithi133 ceph-mon[37053]: pgmap v2130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:28 smithi063 ceph-mon[36747]: pgmap v2130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:24:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:30 smithi043 ceph-mon[32384]: pgmap v2131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:30 smithi133 ceph-mon[37053]: pgmap v2131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:30 smithi063 ceph-mon[36747]: pgmap v2131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2916.772476 secs 2024-07-26T09:24:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2932.256502 secs 2024-07-26T09:24:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2916.772476 secs 2024-07-26T09:24:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2932.256502 secs 2024-07-26T09:24:31.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2916.772476 secs 2024-07-26T09:24:31.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2932.256502 secs 2024-07-26T09:24:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:32 smithi043 ceph-mon[32384]: pgmap v2132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:32 smithi133 ceph-mon[37053]: pgmap v2132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:32 smithi063 ceph-mon[36747]: pgmap v2132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:33 smithi043 ceph-mon[32384]: pgmap v2133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:33 smithi133 ceph-mon[37053]: pgmap v2133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:33 smithi063 ceph-mon[36747]: pgmap v2133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:35 smithi043 ceph-mon[32384]: pgmap v2134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:35 smithi133 ceph-mon[37053]: pgmap v2134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:35 smithi063 ceph-mon[36747]: pgmap v2134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:36.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2921.772576 secs 2024-07-26T09:24:36.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2937.256645 secs 2024-07-26T09:24:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2921.772576 secs 2024-07-26T09:24:36.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2937.256645 secs 2024-07-26T09:24:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2921.772576 secs 2024-07-26T09:24:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2937.256645 secs 2024-07-26T09:24:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:37 smithi043 ceph-mon[32384]: pgmap v2135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:37 smithi133 ceph-mon[37053]: pgmap v2135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:37 smithi063 ceph-mon[36747]: pgmap v2135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:39 smithi043 ceph-mon[32384]: pgmap v2136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:39 smithi133 ceph-mon[37053]: pgmap v2136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:39 smithi063 ceph-mon[36747]: pgmap v2136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2926.772640 secs 2024-07-26T09:24:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:41 smithi043 ceph-mon[32384]: pgmap v2137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2942.256771 secs 2024-07-26T09:24:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2926.772640 secs 2024-07-26T09:24:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:41 smithi133 ceph-mon[37053]: pgmap v2137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2942.256771 secs 2024-07-26T09:24:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2926.772640 secs 2024-07-26T09:24:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:41 smithi063 ceph-mon[36747]: pgmap v2137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2942.256771 secs 2024-07-26T09:24:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:43 smithi043 ceph-mon[32384]: pgmap v2138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:43 smithi133 ceph-mon[37053]: pgmap v2138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:43 smithi063 ceph-mon[36747]: pgmap v2138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:45 smithi043 ceph-mon[32384]: pgmap v2139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:45 smithi133 ceph-mon[37053]: pgmap v2139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:45 smithi063 ceph-mon[36747]: pgmap v2139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:46 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 2931.772756 secs 2024-07-26T09:24:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:46 smithi043 ceph-mon[32384]: slow request 2880.282453 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T09:24:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2947.256932 secs 2024-07-26T09:24:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:46 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 2931.772756 secs 2024-07-26T09:24:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:46 smithi133 ceph-mon[37053]: slow request 2880.282453 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T09:24:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2947.256932 secs 2024-07-26T09:24:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:46 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 2931.772756 secs 2024-07-26T09:24:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:46 smithi063 ceph-mon[36747]: slow request 2880.282453 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T09:24:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2947.256932 secs 2024-07-26T09:24:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:47 smithi043 ceph-mon[32384]: pgmap v2140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:47 smithi133 ceph-mon[37053]: pgmap v2140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:47 smithi063 ceph-mon[36747]: pgmap v2140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:49 smithi043 ceph-mon[32384]: pgmap v2141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:49 smithi133 ceph-mon[37053]: pgmap v2141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:49 smithi063 ceph-mon[36747]: pgmap v2141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2936.772878 secs 2024-07-26T09:24:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:51 smithi043 ceph-mon[32384]: pgmap v2142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2952.256996 secs 2024-07-26T09:24:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2936.772878 secs 2024-07-26T09:24:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:51 smithi133 ceph-mon[37053]: pgmap v2142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2952.256996 secs 2024-07-26T09:24:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2936.772878 secs 2024-07-26T09:24:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:51 smithi063 ceph-mon[36747]: pgmap v2142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:24:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2952.256996 secs 2024-07-26T09:24:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:53 smithi043 ceph-mon[32384]: pgmap v2143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:53 smithi133 ceph-mon[37053]: pgmap v2143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:53 smithi063 ceph-mon[36747]: pgmap v2143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:55 smithi043 ceph-mon[32384]: pgmap v2144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:55 smithi133 ceph-mon[37053]: pgmap v2144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:55 smithi063 ceph-mon[36747]: pgmap v2144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2941.772996 secs 2024-07-26T09:24:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2957.257082 secs 2024-07-26T09:24:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2941.772996 secs 2024-07-26T09:24:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2957.257082 secs 2024-07-26T09:24:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2941.772996 secs 2024-07-26T09:24:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2957.257082 secs 2024-07-26T09:24:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:57 smithi043 ceph-mon[32384]: pgmap v2145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:57 smithi133 ceph-mon[37053]: pgmap v2145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:57 smithi063 ceph-mon[36747]: pgmap v2145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:24:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:24:59 smithi043 ceph-mon[32384]: pgmap v2146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:24:59 smithi133 ceph-mon[37053]: pgmap v2146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:24:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:24:59 smithi063 ceph-mon[36747]: pgmap v2146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2946.773136 secs 2024-07-26T09:25:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:01 smithi043 ceph-mon[32384]: pgmap v2147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2962.257202 secs 2024-07-26T09:25:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2946.773136 secs 2024-07-26T09:25:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:01 smithi133 ceph-mon[37053]: pgmap v2147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2962.257202 secs 2024-07-26T09:25:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2946.773136 secs 2024-07-26T09:25:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:01 smithi063 ceph-mon[36747]: pgmap v2147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2962.257202 secs 2024-07-26T09:25:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:03 smithi043 ceph-mon[32384]: pgmap v2148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:03 smithi133 ceph-mon[37053]: pgmap v2148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:03 smithi063 ceph-mon[36747]: pgmap v2148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:05 smithi043 ceph-mon[32384]: pgmap v2149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:05 smithi133 ceph-mon[37053]: pgmap v2149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:05 smithi063 ceph-mon[36747]: pgmap v2149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2951.773262 secs 2024-07-26T09:25:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2967.257304 secs 2024-07-26T09:25:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2951.773262 secs 2024-07-26T09:25:06.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2967.257304 secs 2024-07-26T09:25:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2951.773262 secs 2024-07-26T09:25:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2967.257304 secs 2024-07-26T09:25:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:07 smithi043 ceph-mon[32384]: pgmap v2150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:07 smithi133 ceph-mon[37053]: pgmap v2150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:07 smithi063 ceph-mon[36747]: pgmap v2150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:09 smithi043 ceph-mon[32384]: pgmap v2151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:09 smithi133 ceph-mon[37053]: pgmap v2151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:09 smithi063 ceph-mon[36747]: pgmap v2151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2956.773378 secs 2024-07-26T09:25:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:11 smithi043 ceph-mon[32384]: pgmap v2152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2972.257384 secs 2024-07-26T09:25:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2956.773378 secs 2024-07-26T09:25:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:11 smithi133 ceph-mon[37053]: pgmap v2152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2972.257384 secs 2024-07-26T09:25:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2956.773378 secs 2024-07-26T09:25:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:11 smithi063 ceph-mon[36747]: pgmap v2152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2972.257384 secs 2024-07-26T09:25:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:13 smithi133 ceph-mon[37053]: pgmap v2153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:13 smithi063 ceph-mon[36747]: pgmap v2153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:13 smithi043 ceph-mon[32384]: pgmap v2153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:15 smithi133 ceph-mon[37053]: pgmap v2154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:15 smithi063 ceph-mon[36747]: pgmap v2154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:15 smithi043 ceph-mon[32384]: pgmap v2154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2961.773461 secs 2024-07-26T09:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2977.257521 secs 2024-07-26T09:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2961.773461 secs 2024-07-26T09:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2977.257521 secs 2024-07-26T09:25:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2961.773461 secs 2024-07-26T09:25:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2977.257521 secs 2024-07-26T09:25:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:17 smithi133 ceph-mon[37053]: pgmap v2155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:25:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:17 smithi063 ceph-mon[36747]: pgmap v2155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:25:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:17 smithi043 ceph-mon[32384]: pgmap v2155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:25:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:25:18.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:25:18.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:18 smithi063 ceph-mon[36747]: pgmap v2156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:18.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:18 smithi063 ceph-mon[36747]: pgmap v2157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:18.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:25:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:25:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:25:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:18 smithi043 ceph-mon[32384]: pgmap v2156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:18 smithi043 ceph-mon[32384]: pgmap v2157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:25:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:25:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:25:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:18 smithi133 ceph-mon[37053]: pgmap v2156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:18 smithi133 ceph-mon[37053]: pgmap v2157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:25:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:20 smithi043 ceph-mon[32384]: pgmap v2158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2966.773571 secs 2024-07-26T09:25:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:20 smithi133 ceph-mon[37053]: pgmap v2158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2966.773571 secs 2024-07-26T09:25:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:20 smithi063 ceph-mon[36747]: pgmap v2158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2966.773571 secs 2024-07-26T09:25:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2982.257641 secs 2024-07-26T09:25:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2982.257641 secs 2024-07-26T09:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2982.257641 secs 2024-07-26T09:25:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:22 smithi043 ceph-mon[32384]: pgmap v2159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:25:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:22 smithi133 ceph-mon[37053]: pgmap v2159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:25:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:22 smithi063 ceph-mon[36747]: pgmap v2159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:25:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:24 smithi043 ceph-mon[32384]: pgmap v2160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:24 smithi133 ceph-mon[37053]: pgmap v2160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:24 smithi063 ceph-mon[36747]: pgmap v2160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2971.773713 secs 2024-07-26T09:25:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2971.773713 secs 2024-07-26T09:25:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2971.773713 secs 2024-07-26T09:25:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2987.257736 secs 2024-07-26T09:25:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:26 smithi043 ceph-mon[32384]: pgmap v2161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2987.257736 secs 2024-07-26T09:25:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:26 smithi133 ceph-mon[37053]: pgmap v2161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2987.257736 secs 2024-07-26T09:25:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:26 smithi063 ceph-mon[36747]: pgmap v2161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:25:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:28 smithi043 ceph-mon[32384]: pgmap v2162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:28 smithi133 ceph-mon[37053]: pgmap v2162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:28 smithi063 ceph-mon[36747]: pgmap v2162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:30 smithi043 ceph-mon[32384]: pgmap v2163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2976.773856 secs 2024-07-26T09:25:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:30 smithi133 ceph-mon[37053]: pgmap v2163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2976.773856 secs 2024-07-26T09:25:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:30 smithi063 ceph-mon[36747]: pgmap v2163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2976.773856 secs 2024-07-26T09:25:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2992.257856 secs 2024-07-26T09:25:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2992.257856 secs 2024-07-26T09:25:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2992.257856 secs 2024-07-26T09:25:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:32 smithi043 ceph-mon[32384]: pgmap v2164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:32 smithi133 ceph-mon[37053]: pgmap v2164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:32 smithi063 ceph-mon[36747]: pgmap v2164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:34 smithi043 ceph-mon[32384]: pgmap v2165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:34 smithi133 ceph-mon[37053]: pgmap v2165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:34 smithi063 ceph-mon[36747]: pgmap v2165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:35.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2981.773974 secs 2024-07-26T09:25:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2981.773974 secs 2024-07-26T09:25:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2981.773974 secs 2024-07-26T09:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 2997.257968 secs 2024-07-26T09:25:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:36 smithi043 ceph-mon[32384]: pgmap v2166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 2997.257968 secs 2024-07-26T09:25:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:36 smithi133 ceph-mon[37053]: pgmap v2166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 2997.257968 secs 2024-07-26T09:25:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:36 smithi063 ceph-mon[36747]: pgmap v2166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:38 smithi043 ceph-mon[32384]: pgmap v2167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:38 smithi133 ceph-mon[37053]: pgmap v2167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:38 smithi063 ceph-mon[36747]: pgmap v2167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:40 smithi043 ceph-mon[32384]: pgmap v2168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2986.774068 secs 2024-07-26T09:25:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:40 smithi133 ceph-mon[37053]: pgmap v2168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2986.774068 secs 2024-07-26T09:25:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:40 smithi063 ceph-mon[36747]: pgmap v2168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2986.774068 secs 2024-07-26T09:25:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3002.258110 secs 2024-07-26T09:25:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3002.258110 secs 2024-07-26T09:25:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3002.258110 secs 2024-07-26T09:25:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:42 smithi043 ceph-mon[32384]: pgmap v2169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:42 smithi133 ceph-mon[37053]: pgmap v2169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:42 smithi063 ceph-mon[36747]: pgmap v2169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:44 smithi043 ceph-mon[32384]: pgmap v2170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:44 smithi133 ceph-mon[37053]: pgmap v2170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:44 smithi063 ceph-mon[36747]: pgmap v2170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2991.774215 secs 2024-07-26T09:25:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2991.774215 secs 2024-07-26T09:25:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2991.774215 secs 2024-07-26T09:25:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3007.258226 secs 2024-07-26T09:25:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:46 smithi043 ceph-mon[32384]: pgmap v2171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3007.258226 secs 2024-07-26T09:25:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:46 smithi133 ceph-mon[37053]: pgmap v2171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3007.258226 secs 2024-07-26T09:25:47.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:46 smithi063 ceph-mon[36747]: pgmap v2171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:25:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:48 smithi043 ceph-mon[32384]: pgmap v2172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:48 smithi133 ceph-mon[37053]: pgmap v2172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:48 smithi063 ceph-mon[36747]: pgmap v2172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:25:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:50 smithi043 ceph-mon[32384]: pgmap v2173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 2996.774296 secs 2024-07-26T09:25:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:50 smithi133 ceph-mon[37053]: pgmap v2173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 2996.774296 secs 2024-07-26T09:25:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:50 smithi063 ceph-mon[36747]: pgmap v2173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:25:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 2996.774296 secs 2024-07-26T09:25:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3012.258310 secs 2024-07-26T09:25:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3012.258310 secs 2024-07-26T09:25:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3012.258310 secs 2024-07-26T09:25:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:52 smithi133 ceph-mon[37053]: pgmap v2174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:52 smithi063 ceph-mon[36747]: pgmap v2174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:52 smithi043 ceph-mon[32384]: pgmap v2174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:54 smithi133 ceph-mon[37053]: pgmap v2175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:25:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:54 smithi063 ceph-mon[36747]: pgmap v2175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:25:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:54 smithi043 ceph-mon[32384]: pgmap v2175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:25:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3001.774405 secs 2024-07-26T09:25:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3001.774405 secs 2024-07-26T09:25:56.092 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3001.774405 secs 2024-07-26T09:25:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3017.258423 secs 2024-07-26T09:25:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:56 smithi133 ceph-mon[37053]: pgmap v2176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3017.258423 secs 2024-07-26T09:25:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:56 smithi063 ceph-mon[36747]: pgmap v2176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3017.258423 secs 2024-07-26T09:25:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:56 smithi043 ceph-mon[32384]: pgmap v2176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:25:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:25:58 smithi133 ceph-mon[37053]: pgmap v2177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:25:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:25:58 smithi063 ceph-mon[36747]: pgmap v2177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:25:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:25:58 smithi043 ceph-mon[32384]: pgmap v2177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:26:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:00 smithi133 ceph-mon[37053]: pgmap v2178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3006.774483 secs 2024-07-26T09:26:01.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:00 smithi043 ceph-mon[32384]: pgmap v2178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:01.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3006.774483 secs 2024-07-26T09:26:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:00 smithi063 ceph-mon[36747]: pgmap v2178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3006.774483 secs 2024-07-26T09:26:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3022.258542 secs 2024-07-26T09:26:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3022.258542 secs 2024-07-26T09:26:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3022.258542 secs 2024-07-26T09:26:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:02 smithi063 ceph-mon[36747]: pgmap v2179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:26:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:02 smithi043 ceph-mon[32384]: pgmap v2179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:26:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:02 smithi133 ceph-mon[37053]: pgmap v2179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:26:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:04 smithi063 ceph-mon[36747]: pgmap v2180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:04 smithi043 ceph-mon[32384]: pgmap v2180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:04 smithi133 ceph-mon[37053]: pgmap v2180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3011.774565 secs 2024-07-26T09:26:06.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3011.774565 secs 2024-07-26T09:26:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3011.774565 secs 2024-07-26T09:26:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3027.258665 secs 2024-07-26T09:26:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:06 smithi063 ceph-mon[36747]: pgmap v2181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3027.258665 secs 2024-07-26T09:26:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:06 smithi043 ceph-mon[32384]: pgmap v2181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3027.258665 secs 2024-07-26T09:26:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:06 smithi133 ceph-mon[37053]: pgmap v2181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:08 smithi063 ceph-mon[36747]: pgmap v2182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:08 smithi043 ceph-mon[32384]: pgmap v2182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:08 smithi133 ceph-mon[37053]: pgmap v2182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:10 smithi063 ceph-mon[36747]: pgmap v2183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3016.774709 secs 2024-07-26T09:26:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:10 smithi043 ceph-mon[32384]: pgmap v2183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3016.774709 secs 2024-07-26T09:26:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:10 smithi133 ceph-mon[37053]: pgmap v2183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3016.774709 secs 2024-07-26T09:26:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3032.258791 secs 2024-07-26T09:26:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3032.258791 secs 2024-07-26T09:26:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3032.258791 secs 2024-07-26T09:26:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:12 smithi043 ceph-mon[32384]: pgmap v2184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:12 smithi133 ceph-mon[37053]: pgmap v2184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:12 smithi063 ceph-mon[36747]: pgmap v2184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:14 smithi043 ceph-mon[32384]: pgmap v2185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:14 smithi133 ceph-mon[37053]: pgmap v2185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:14 smithi063 ceph-mon[36747]: pgmap v2185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3021.774843 secs 2024-07-26T09:26:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3021.774843 secs 2024-07-26T09:26:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3021.774843 secs 2024-07-26T09:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3037.258856 secs 2024-07-26T09:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:16 smithi043 ceph-mon[32384]: pgmap v2186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3037.258856 secs 2024-07-26T09:26:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:16 smithi133 ceph-mon[37053]: pgmap v2186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3037.258856 secs 2024-07-26T09:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:16 smithi063 ceph-mon[36747]: pgmap v2186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:26:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:26:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:26:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:18 smithi043 ceph-mon[32384]: pgmap v2187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:26:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:26:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:26:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:18 smithi133 ceph-mon[37053]: pgmap v2187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:26:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:26:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:26:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:18 smithi063 ceph-mon[36747]: pgmap v2187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:26:19.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:26:19.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:19 smithi043 ceph-mon[32384]: pgmap v2188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:19 smithi043 ceph-mon[32384]: pgmap v2189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:26:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:19 smithi133 ceph-mon[37053]: pgmap v2188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:26:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:19 smithi133 ceph-mon[37053]: pgmap v2189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:26:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:19 smithi063 ceph-mon[36747]: pgmap v2188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:26:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:19 smithi063 ceph-mon[36747]: pgmap v2189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:26:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3026.774958 secs 2024-07-26T09:26:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3026.774958 secs 2024-07-26T09:26:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3026.774958 secs 2024-07-26T09:26:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3042.258966 secs 2024-07-26T09:26:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:21 smithi043 ceph-mon[32384]: pgmap v2190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:26:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3042.258966 secs 2024-07-26T09:26:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:21 smithi133 ceph-mon[37053]: pgmap v2190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:26:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3042.258966 secs 2024-07-26T09:26:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:21 smithi063 ceph-mon[36747]: pgmap v2190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:26:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:23 smithi043 ceph-mon[32384]: pgmap v2191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:26:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:23 smithi133 ceph-mon[37053]: pgmap v2191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:26:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:23 smithi063 ceph-mon[36747]: pgmap v2191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:26:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:25 smithi043 ceph-mon[32384]: pgmap v2192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3031.775123 secs 2024-07-26T09:26:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:25 smithi133 ceph-mon[37053]: pgmap v2192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3031.775123 secs 2024-07-26T09:26:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:25 smithi063 ceph-mon[36747]: pgmap v2192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3031.775123 secs 2024-07-26T09:26:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3047.259092 secs 2024-07-26T09:26:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3047.259092 secs 2024-07-26T09:26:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3047.259092 secs 2024-07-26T09:26:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:27 smithi043 ceph-mon[32384]: pgmap v2193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:27 smithi133 ceph-mon[37053]: pgmap v2193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:27 smithi063 ceph-mon[36747]: pgmap v2193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:26:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:29 smithi043 ceph-mon[32384]: pgmap v2194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:26:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:29 smithi133 ceph-mon[37053]: pgmap v2194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:26:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:29 smithi063 ceph-mon[36747]: pgmap v2194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:26:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3036.775237 secs 2024-07-26T09:26:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3036.775237 secs 2024-07-26T09:26:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3036.775237 secs 2024-07-26T09:26:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3052.259178 secs 2024-07-26T09:26:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:31 smithi043 ceph-mon[32384]: pgmap v2195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3052.259178 secs 2024-07-26T09:26:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:31 smithi133 ceph-mon[37053]: pgmap v2195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3052.259178 secs 2024-07-26T09:26:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:31 smithi063 ceph-mon[36747]: pgmap v2195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:33 smithi043 ceph-mon[32384]: pgmap v2196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:33 smithi133 ceph-mon[37053]: pgmap v2196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:33 smithi063 ceph-mon[36747]: pgmap v2196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:35 smithi043 ceph-mon[32384]: pgmap v2197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3041.775354 secs 2024-07-26T09:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:35 smithi133 ceph-mon[37053]: pgmap v2197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3041.775354 secs 2024-07-26T09:26:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:35 smithi063 ceph-mon[36747]: pgmap v2197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3041.775354 secs 2024-07-26T09:26:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3057.259297 secs 2024-07-26T09:26:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3057.259297 secs 2024-07-26T09:26:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3057.259297 secs 2024-07-26T09:26:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:37 smithi043 ceph-mon[32384]: pgmap v2198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:37 smithi133 ceph-mon[37053]: pgmap v2198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:37 smithi063 ceph-mon[36747]: pgmap v2198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:39 smithi043 ceph-mon[32384]: pgmap v2199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:39 smithi133 ceph-mon[37053]: pgmap v2199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:39 smithi063 ceph-mon[36747]: pgmap v2199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3046.775474 secs 2024-07-26T09:26:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3062.259419 secs 2024-07-26T09:26:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3046.775474 secs 2024-07-26T09:26:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3062.259419 secs 2024-07-26T09:26:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3046.775474 secs 2024-07-26T09:26:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3062.259419 secs 2024-07-26T09:26:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:41 smithi043 ceph-mon[32384]: pgmap v2200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:41 smithi133 ceph-mon[37053]: pgmap v2200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:41 smithi063 ceph-mon[36747]: pgmap v2200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:43 smithi043 ceph-mon[32384]: pgmap v2201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:43 smithi133 ceph-mon[37053]: pgmap v2201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:43 smithi063 ceph-mon[36747]: pgmap v2201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:45 smithi133 ceph-mon[37053]: pgmap v2202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:46.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3051.775593 secs 2024-07-26T09:26:46.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3067.259545 secs 2024-07-26T09:26:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:45 smithi063 ceph-mon[36747]: pgmap v2202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3051.775593 secs 2024-07-26T09:26:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3067.259545 secs 2024-07-26T09:26:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:45 smithi043 ceph-mon[32384]: pgmap v2202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3051.775593 secs 2024-07-26T09:26:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3067.259545 secs 2024-07-26T09:26:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:47 smithi133 ceph-mon[37053]: pgmap v2203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:47 smithi063 ceph-mon[36747]: pgmap v2203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:47 smithi043 ceph-mon[32384]: pgmap v2203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:49 smithi133 ceph-mon[37053]: pgmap v2204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:49 smithi063 ceph-mon[36747]: pgmap v2204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:49 smithi043 ceph-mon[32384]: pgmap v2204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3056.775746 secs 2024-07-26T09:26:51.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3072.259665 secs 2024-07-26T09:26:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3056.775746 secs 2024-07-26T09:26:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3072.259665 secs 2024-07-26T09:26:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3056.775746 secs 2024-07-26T09:26:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3072.259665 secs 2024-07-26T09:26:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:52 smithi133 ceph-mon[37053]: pgmap v2205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:52 smithi063 ceph-mon[36747]: pgmap v2205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:52 smithi043 ceph-mon[32384]: pgmap v2205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:54 smithi133 ceph-mon[37053]: pgmap v2206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:54 smithi063 ceph-mon[36747]: pgmap v2206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:54 smithi043 ceph-mon[32384]: pgmap v2206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:26:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:56 smithi063 ceph-mon[36747]: pgmap v2207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3061.775863 secs 2024-07-26T09:26:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3077.259804 secs 2024-07-26T09:26:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:56 smithi043 ceph-mon[32384]: pgmap v2207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3061.775863 secs 2024-07-26T09:26:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3077.259804 secs 2024-07-26T09:26:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:56 smithi133 ceph-mon[37053]: pgmap v2207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:26:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3061.775863 secs 2024-07-26T09:26:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3077.259804 secs 2024-07-26T09:26:58.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:26:58 smithi043 ceph-mon[32384]: pgmap v2208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:26:58 smithi063 ceph-mon[36747]: pgmap v2208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:26:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:26:58 smithi133 ceph-mon[37053]: pgmap v2208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:00 smithi063 ceph-mon[36747]: pgmap v2209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:00 smithi043 ceph-mon[32384]: pgmap v2209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:00 smithi133 ceph-mon[37053]: pgmap v2209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3066.775984 secs 2024-07-26T09:27:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3082.259922 secs 2024-07-26T09:27:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3066.775984 secs 2024-07-26T09:27:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3082.259922 secs 2024-07-26T09:27:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3066.775984 secs 2024-07-26T09:27:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3082.259922 secs 2024-07-26T09:27:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:02 smithi063 ceph-mon[36747]: pgmap v2210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:02 smithi043 ceph-mon[32384]: pgmap v2210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:02 smithi133 ceph-mon[37053]: pgmap v2210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:04 smithi063 ceph-mon[36747]: pgmap v2211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:04 smithi043 ceph-mon[32384]: pgmap v2211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:04 smithi133 ceph-mon[37053]: pgmap v2211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:06.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:06 smithi133 ceph-mon[37053]: pgmap v2212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:06.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3071.776082 secs 2024-07-26T09:27:06.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3087.260042 secs 2024-07-26T09:27:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:06 smithi063 ceph-mon[36747]: pgmap v2212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3071.776082 secs 2024-07-26T09:27:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3087.260042 secs 2024-07-26T09:27:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:06 smithi043 ceph-mon[32384]: pgmap v2212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3071.776082 secs 2024-07-26T09:27:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3087.260042 secs 2024-07-26T09:27:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:08 smithi063 ceph-mon[36747]: pgmap v2213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:08 smithi043 ceph-mon[32384]: pgmap v2213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:08 smithi133 ceph-mon[37053]: pgmap v2213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:10 smithi043 ceph-mon[32384]: pgmap v2214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:10 smithi133 ceph-mon[37053]: pgmap v2214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:10 smithi063 ceph-mon[36747]: pgmap v2214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3076.776203 secs 2024-07-26T09:27:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3092.260113 secs 2024-07-26T09:27:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3076.776203 secs 2024-07-26T09:27:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3092.260113 secs 2024-07-26T09:27:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3076.776203 secs 2024-07-26T09:27:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3092.260113 secs 2024-07-26T09:27:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:12 smithi043 ceph-mon[32384]: pgmap v2215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:12 smithi133 ceph-mon[37053]: pgmap v2215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:12 smithi063 ceph-mon[36747]: pgmap v2215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:14 smithi043 ceph-mon[32384]: pgmap v2216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:14 smithi133 ceph-mon[37053]: pgmap v2216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:14 smithi063 ceph-mon[36747]: pgmap v2216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:16 smithi043 ceph-mon[32384]: pgmap v2217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3081.776346 secs 2024-07-26T09:27:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3097.260236 secs 2024-07-26T09:27:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:16 smithi133 ceph-mon[37053]: pgmap v2217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3081.776346 secs 2024-07-26T09:27:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3097.260236 secs 2024-07-26T09:27:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:16 smithi063 ceph-mon[36747]: pgmap v2217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3081.776346 secs 2024-07-26T09:27:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3097.260236 secs 2024-07-26T09:27:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:18 smithi043 ceph-mon[32384]: pgmap v2218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:18 smithi133 ceph-mon[37053]: pgmap v2218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:18 smithi063 ceph-mon[36747]: pgmap v2218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:27:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:27:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:27:20.249 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:20 smithi063 ceph-mon[36747]: pgmap v2219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:20 smithi043 ceph-mon[32384]: pgmap v2219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:20 smithi133 ceph-mon[37053]: pgmap v2219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:21.178 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3086.776492 secs 2024-07-26T09:27:21.178 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3102.260322 secs 2024-07-26T09:27:21.306 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3086.776492 secs 2024-07-26T09:27:21.306 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3102.260322 secs 2024-07-26T09:27:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3086.776492 secs 2024-07-26T09:27:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3102.260322 secs 2024-07-26T09:27:22.438 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:22 smithi063 ceph-mon[36747]: pgmap v2220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:22 smithi043 ceph-mon[32384]: pgmap v2220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:22 smithi133 ceph-mon[37053]: pgmap v2220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:23 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:23 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:23 smithi063 ceph-mon[36747]: pgmap v2221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:23 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:24.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:23 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:24.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:23 smithi043 ceph-mon[32384]: pgmap v2221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:23 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:23 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:23 smithi133 ceph-mon[37053]: pgmap v2221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: pgmap v2222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3091.776613 secs 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:27:26.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:25 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: pgmap v2222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3091.776613 secs 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:27:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:25 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: pgmap v2222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3091.776613 secs 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:27:26.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:27:26.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:27:26.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:25 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:27:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3107.260444 secs 2024-07-26T09:27:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:26 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:27:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:26 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:27:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:26 smithi043 ceph-mon[32384]: pgmap v2223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:26 smithi043 ceph-mon[32384]: pgmap v2224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3107.260444 secs 2024-07-26T09:27:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:26 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:27:27.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:26 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:27:27.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:26 smithi133 ceph-mon[37053]: pgmap v2223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:27.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:26 smithi133 ceph-mon[37053]: pgmap v2224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3107.260444 secs 2024-07-26T09:27:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:26 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:27:27.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:26 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:27:27.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:26 smithi063 ceph-mon[36747]: pgmap v2223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:27.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:26 smithi063 ceph-mon[36747]: pgmap v2224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:28 smithi043 ceph-mon[32384]: pgmap v2225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-07-26T09:27:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:28 smithi133 ceph-mon[37053]: pgmap v2225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-07-26T09:27:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:28 smithi063 ceph-mon[36747]: pgmap v2225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-07-26T09:27:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:30 smithi043 ceph-mon[32384]: pgmap v2226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3096.776712 secs 2024-07-26T09:27:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:30 smithi133 ceph-mon[37053]: pgmap v2226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3096.776712 secs 2024-07-26T09:27:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:30 smithi063 ceph-mon[36747]: pgmap v2226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3096.776712 secs 2024-07-26T09:27:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3112.260542 secs 2024-07-26T09:27:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3112.260542 secs 2024-07-26T09:27:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3112.260542 secs 2024-07-26T09:27:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:32 smithi043 ceph-mon[32384]: pgmap v2227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:32 smithi133 ceph-mon[37053]: pgmap v2227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:32 smithi063 ceph-mon[36747]: pgmap v2227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:34 smithi043 ceph-mon[32384]: pgmap v2228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:34 smithi133 ceph-mon[37053]: pgmap v2228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:34 smithi063 ceph-mon[36747]: pgmap v2228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:27:36.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3101.776841 secs 2024-07-26T09:27:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3101.776841 secs 2024-07-26T09:27:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3101.776841 secs 2024-07-26T09:27:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3117.260665 secs 2024-07-26T09:27:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:36 smithi043 ceph-mon[32384]: pgmap v2229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:27:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3117.260665 secs 2024-07-26T09:27:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:36 smithi133 ceph-mon[37053]: pgmap v2229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:27:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3117.260665 secs 2024-07-26T09:27:37.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:36 smithi063 ceph-mon[36747]: pgmap v2229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:27:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:38 smithi043 ceph-mon[32384]: pgmap v2230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:38 smithi133 ceph-mon[37053]: pgmap v2230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:38 smithi063 ceph-mon[36747]: pgmap v2230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:40 smithi043 ceph-mon[32384]: pgmap v2231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3106.776915 secs 2024-07-26T09:27:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:40 smithi133 ceph-mon[37053]: pgmap v2231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3106.776915 secs 2024-07-26T09:27:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:40 smithi063 ceph-mon[36747]: pgmap v2231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3106.776915 secs 2024-07-26T09:27:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3122.260784 secs 2024-07-26T09:27:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3122.260784 secs 2024-07-26T09:27:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3122.260784 secs 2024-07-26T09:27:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:42 smithi043 ceph-mon[32384]: pgmap v2232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:42 smithi133 ceph-mon[37053]: pgmap v2232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:42 smithi063 ceph-mon[36747]: pgmap v2232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:44 smithi043 ceph-mon[32384]: pgmap v2233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:44 smithi133 ceph-mon[37053]: pgmap v2233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:44 smithi063 ceph-mon[36747]: pgmap v2233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3111.777004 secs 2024-07-26T09:27:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3127.260898 secs 2024-07-26T09:27:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3111.777004 secs 2024-07-26T09:27:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3127.260898 secs 2024-07-26T09:27:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3111.777004 secs 2024-07-26T09:27:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3127.260898 secs 2024-07-26T09:27:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:46 smithi133 ceph-mon[37053]: pgmap v2234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:46 smithi063 ceph-mon[36747]: pgmap v2234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:46 smithi043 ceph-mon[32384]: pgmap v2234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:48 smithi133 ceph-mon[37053]: pgmap v2235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:48 smithi063 ceph-mon[36747]: pgmap v2235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:48 smithi043 ceph-mon[32384]: pgmap v2235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:51.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:51 smithi133 ceph-mon[37053]: pgmap v2236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:51.291 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3116.777123 secs 2024-07-26T09:27:51.291 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3132.260961 secs 2024-07-26T09:27:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:51 smithi063 ceph-mon[36747]: pgmap v2236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3116.777123 secs 2024-07-26T09:27:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3132.260961 secs 2024-07-26T09:27:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:51 smithi043 ceph-mon[32384]: pgmap v2236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:27:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3116.777123 secs 2024-07-26T09:27:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3132.260961 secs 2024-07-26T09:27:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:53 smithi133 ceph-mon[37053]: pgmap v2237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:53 smithi063 ceph-mon[36747]: pgmap v2237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:53 smithi043 ceph-mon[32384]: pgmap v2237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:55 smithi063 ceph-mon[36747]: pgmap v2238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:55 smithi043 ceph-mon[32384]: pgmap v2238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:55 smithi133 ceph-mon[37053]: pgmap v2238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3121.777239 secs 2024-07-26T09:27:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3137.261041 secs 2024-07-26T09:27:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3121.777239 secs 2024-07-26T09:27:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3137.261041 secs 2024-07-26T09:27:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3121.777239 secs 2024-07-26T09:27:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3137.261041 secs 2024-07-26T09:27:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:57 smithi063 ceph-mon[36747]: pgmap v2239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:57 smithi043 ceph-mon[32384]: pgmap v2239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:57 smithi133 ceph-mon[37053]: pgmap v2239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:27:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:27:59 smithi063 ceph-mon[36747]: pgmap v2240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:27:59 smithi043 ceph-mon[32384]: pgmap v2240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:27:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:27:59 smithi133 ceph-mon[37053]: pgmap v2240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:01 smithi063 ceph-mon[36747]: pgmap v2241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3126.777360 secs 2024-07-26T09:28:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3142.261139 secs 2024-07-26T09:28:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:01 smithi043 ceph-mon[32384]: pgmap v2241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3126.777360 secs 2024-07-26T09:28:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3142.261139 secs 2024-07-26T09:28:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:01 smithi133 ceph-mon[37053]: pgmap v2241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3126.777360 secs 2024-07-26T09:28:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3142.261139 secs 2024-07-26T09:28:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:03 smithi063 ceph-mon[36747]: pgmap v2242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:03 smithi043 ceph-mon[32384]: pgmap v2242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:03 smithi133 ceph-mon[37053]: pgmap v2242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:05 smithi063 ceph-mon[36747]: pgmap v2243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:05 smithi043 ceph-mon[32384]: pgmap v2243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:05 smithi133 ceph-mon[37053]: pgmap v2243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3131.777439 secs 2024-07-26T09:28:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3147.261216 secs 2024-07-26T09:28:06.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3131.777439 secs 2024-07-26T09:28:06.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3147.261216 secs 2024-07-26T09:28:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3131.777439 secs 2024-07-26T09:28:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3147.261216 secs 2024-07-26T09:28:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:07 smithi063 ceph-mon[36747]: pgmap v2244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:07 smithi043 ceph-mon[32384]: pgmap v2244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:07 smithi133 ceph-mon[37053]: pgmap v2244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:09 smithi043 ceph-mon[32384]: pgmap v2245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:09 smithi133 ceph-mon[37053]: pgmap v2245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:09 smithi063 ceph-mon[36747]: pgmap v2245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:11 smithi043 ceph-mon[32384]: pgmap v2246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3136.777562 secs 2024-07-26T09:28:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3152.261332 secs 2024-07-26T09:28:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:11 smithi133 ceph-mon[37053]: pgmap v2246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3136.777562 secs 2024-07-26T09:28:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3152.261332 secs 2024-07-26T09:28:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:11 smithi063 ceph-mon[36747]: pgmap v2246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3136.777562 secs 2024-07-26T09:28:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3152.261332 secs 2024-07-26T09:28:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:13 smithi043 ceph-mon[32384]: pgmap v2247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:13 smithi133 ceph-mon[37053]: pgmap v2247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:13 smithi063 ceph-mon[36747]: pgmap v2247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:15.355 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:15 smithi043 ceph-mon[32384]: pgmap v2248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:15 smithi133 ceph-mon[37053]: pgmap v2248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:15 smithi063 ceph-mon[36747]: pgmap v2248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3141.777700 secs 2024-07-26T09:28:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3157.261453 secs 2024-07-26T09:28:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3141.777700 secs 2024-07-26T09:28:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3157.261453 secs 2024-07-26T09:28:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3141.777700 secs 2024-07-26T09:28:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3157.261453 secs 2024-07-26T09:28:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:17 smithi043 ceph-mon[32384]: pgmap v2249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:17 smithi133 ceph-mon[37053]: pgmap v2249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:17.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:17 smithi063 ceph-mon[36747]: pgmap v2249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:19 smithi043 ceph-mon[32384]: pgmap v2250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:19 smithi133 ceph-mon[37053]: pgmap v2250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:19 smithi063 ceph-mon[36747]: pgmap v2250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:21 smithi043 ceph-mon[32384]: pgmap v2251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3146.777790 secs 2024-07-26T09:28:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3162.261571 secs 2024-07-26T09:28:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:21 smithi133 ceph-mon[37053]: pgmap v2251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3146.777790 secs 2024-07-26T09:28:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3162.261571 secs 2024-07-26T09:28:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:21 smithi063 ceph-mon[36747]: pgmap v2251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3146.777790 secs 2024-07-26T09:28:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3162.261571 secs 2024-07-26T09:28:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:23 smithi043 ceph-mon[32384]: pgmap v2252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:23 smithi133 ceph-mon[37053]: pgmap v2252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:23 smithi063 ceph-mon[36747]: pgmap v2252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:25 smithi043 ceph-mon[32384]: pgmap v2253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:25 smithi133 ceph-mon[37053]: pgmap v2253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:25 smithi063 ceph-mon[36747]: pgmap v2253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3151.777870 secs 2024-07-26T09:28:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3167.261688 secs 2024-07-26T09:28:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:28:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3151.777870 secs 2024-07-26T09:28:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3167.261688 secs 2024-07-26T09:28:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:28:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3151.777870 secs 2024-07-26T09:28:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3167.261688 secs 2024-07-26T09:28:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: pgmap v2254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: pgmap v2254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.500 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.501 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.501 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: pgmap v2254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:28.241 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:28 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:28:28.241 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:28 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:28:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:28 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:28:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:28 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:28:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:28 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:28:28.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:28 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:28:29.243 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:29 smithi133 ceph-mon[37053]: pgmap v2255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:29 smithi043 ceph-mon[32384]: pgmap v2255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:29 smithi063 ceph-mon[36747]: pgmap v2255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: pgmap v2256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: pgmap v2257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: pgmap v2256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: pgmap v2257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: pgmap v2256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:31.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: pgmap v2257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:31.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3156.777962 secs 2024-07-26T09:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3172.261752 secs 2024-07-26T09:28:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3156.777962 secs 2024-07-26T09:28:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3172.261752 secs 2024-07-26T09:28:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3156.777962 secs 2024-07-26T09:28:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3172.261752 secs 2024-07-26T09:28:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:32 smithi043 ceph-mon[32384]: pgmap v2258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:32 smithi133 ceph-mon[37053]: pgmap v2258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:32 smithi063 ceph-mon[36747]: pgmap v2258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:34 smithi043 ceph-mon[32384]: pgmap v2259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:34 smithi133 ceph-mon[37053]: pgmap v2259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:34 smithi063 ceph-mon[36747]: pgmap v2259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3161.778118 secs 2024-07-26T09:28:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3161.778118 secs 2024-07-26T09:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3161.778118 secs 2024-07-26T09:28:36.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3177.261876 secs 2024-07-26T09:28:36.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:36 smithi063 ceph-mon[36747]: pgmap v2260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3177.261876 secs 2024-07-26T09:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:36 smithi043 ceph-mon[32384]: pgmap v2260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3177.261876 secs 2024-07-26T09:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:36 smithi133 ceph-mon[37053]: pgmap v2260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:38 smithi043 ceph-mon[32384]: pgmap v2261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:38 smithi133 ceph-mon[37053]: pgmap v2261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:38 smithi063 ceph-mon[36747]: pgmap v2261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:28:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:40 smithi043 ceph-mon[32384]: pgmap v2262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:28:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3166.778221 secs 2024-07-26T09:28:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:40 smithi133 ceph-mon[37053]: pgmap v2262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:28:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3166.778221 secs 2024-07-26T09:28:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:40 smithi063 ceph-mon[36747]: pgmap v2262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:28:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3166.778221 secs 2024-07-26T09:28:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3182.261944 secs 2024-07-26T09:28:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3182.261944 secs 2024-07-26T09:28:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3182.261944 secs 2024-07-26T09:28:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:42 smithi133 ceph-mon[37053]: pgmap v2263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:42 smithi063 ceph-mon[36747]: pgmap v2263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:42 smithi043 ceph-mon[32384]: pgmap v2263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:44 smithi133 ceph-mon[37053]: pgmap v2264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:44 smithi063 ceph-mon[36747]: pgmap v2264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:44 smithi043 ceph-mon[32384]: pgmap v2264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3171.778340 secs 2024-07-26T09:28:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3171.778340 secs 2024-07-26T09:28:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3171.778340 secs 2024-07-26T09:28:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3187.262064 secs 2024-07-26T09:28:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:46 smithi133 ceph-mon[37053]: pgmap v2265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3187.262064 secs 2024-07-26T09:28:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:46 smithi063 ceph-mon[36747]: pgmap v2265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:47.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3187.262064 secs 2024-07-26T09:28:47.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:46 smithi043 ceph-mon[32384]: pgmap v2265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:48 smithi063 ceph-mon[36747]: pgmap v2266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:48 smithi043 ceph-mon[32384]: pgmap v2266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:48 smithi133 ceph-mon[37053]: pgmap v2266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:50 smithi063 ceph-mon[36747]: pgmap v2267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3176.778459 secs 2024-07-26T09:28:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:50 smithi043 ceph-mon[32384]: pgmap v2267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3176.778459 secs 2024-07-26T09:28:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:50 smithi133 ceph-mon[37053]: pgmap v2267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:28:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3176.778459 secs 2024-07-26T09:28:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3192.262184 secs 2024-07-26T09:28:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3192.262184 secs 2024-07-26T09:28:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3192.262184 secs 2024-07-26T09:28:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:52 smithi063 ceph-mon[36747]: pgmap v2268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:52 smithi043 ceph-mon[32384]: pgmap v2268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:52 smithi133 ceph-mon[37053]: pgmap v2268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:54 smithi063 ceph-mon[36747]: pgmap v2269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:54 smithi043 ceph-mon[32384]: pgmap v2269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:54 smithi133 ceph-mon[37053]: pgmap v2269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3181.778539 secs 2024-07-26T09:28:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3181.778539 secs 2024-07-26T09:28:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3181.778539 secs 2024-07-26T09:28:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3197.262302 secs 2024-07-26T09:28:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:56 smithi063 ceph-mon[36747]: pgmap v2270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3197.262302 secs 2024-07-26T09:28:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:56 smithi043 ceph-mon[32384]: pgmap v2270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3197.262302 secs 2024-07-26T09:28:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:56 smithi133 ceph-mon[37053]: pgmap v2270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:28:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:28:58 smithi063 ceph-mon[36747]: pgmap v2271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:28:58 smithi043 ceph-mon[32384]: pgmap v2271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:28:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:28:58 smithi133 ceph-mon[37053]: pgmap v2271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:00 smithi063 ceph-mon[36747]: pgmap v2272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3186.778655 secs 2024-07-26T09:29:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:00 smithi043 ceph-mon[32384]: pgmap v2272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3186.778655 secs 2024-07-26T09:29:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:00 smithi133 ceph-mon[37053]: pgmap v2272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3186.778655 secs 2024-07-26T09:29:02.139 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3202.262429 secs 2024-07-26T09:29:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3202.262429 secs 2024-07-26T09:29:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3202.262429 secs 2024-07-26T09:29:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:02 smithi043 ceph-mon[32384]: pgmap v2273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:02 smithi133 ceph-mon[37053]: pgmap v2273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:02 smithi063 ceph-mon[36747]: pgmap v2273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:04 smithi043 ceph-mon[32384]: pgmap v2274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:04 smithi133 ceph-mon[37053]: pgmap v2274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:04 smithi063 ceph-mon[36747]: pgmap v2274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:06.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3191.778790 secs 2024-07-26T09:29:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3191.778790 secs 2024-07-26T09:29:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3191.778790 secs 2024-07-26T09:29:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3207.262547 secs 2024-07-26T09:29:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:06 smithi043 ceph-mon[32384]: pgmap v2275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3207.262547 secs 2024-07-26T09:29:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:06 smithi133 ceph-mon[37053]: pgmap v2275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3207.262547 secs 2024-07-26T09:29:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:06 smithi063 ceph-mon[36747]: pgmap v2275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:09.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:08 smithi043 ceph-mon[32384]: pgmap v2276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:08 smithi133 ceph-mon[37053]: pgmap v2276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:08 smithi063 ceph-mon[36747]: pgmap v2276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:10 smithi043 ceph-mon[32384]: pgmap v2277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:11.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3196.778909 secs 2024-07-26T09:29:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:10 smithi133 ceph-mon[37053]: pgmap v2277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3196.778909 secs 2024-07-26T09:29:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:10 smithi063 ceph-mon[36747]: pgmap v2277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3196.778909 secs 2024-07-26T09:29:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3212.262614 secs 2024-07-26T09:29:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3212.262614 secs 2024-07-26T09:29:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3212.262614 secs 2024-07-26T09:29:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:12 smithi043 ceph-mon[32384]: pgmap v2278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:12 smithi133 ceph-mon[37053]: pgmap v2278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:12 smithi063 ceph-mon[36747]: pgmap v2278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:14 smithi043 ceph-mon[32384]: pgmap v2279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:14 smithi133 ceph-mon[37053]: pgmap v2279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:14 smithi063 ceph-mon[36747]: pgmap v2279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3201.779047 secs 2024-07-26T09:29:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3201.779047 secs 2024-07-26T09:29:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3201.779047 secs 2024-07-26T09:29:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3217.262733 secs 2024-07-26T09:29:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:16 smithi043 ceph-mon[32384]: pgmap v2280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3217.262733 secs 2024-07-26T09:29:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:16 smithi133 ceph-mon[37053]: pgmap v2280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3217.262733 secs 2024-07-26T09:29:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:16 smithi063 ceph-mon[36747]: pgmap v2280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:18 smithi043 ceph-mon[32384]: pgmap v2281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:18 smithi133 ceph-mon[37053]: pgmap v2281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:18 smithi063 ceph-mon[36747]: pgmap v2281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:20 smithi043 ceph-mon[32384]: pgmap v2282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3206.779169 secs 2024-07-26T09:29:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:20 smithi133 ceph-mon[37053]: pgmap v2282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3206.779169 secs 2024-07-26T09:29:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:20 smithi063 ceph-mon[36747]: pgmap v2282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3206.779169 secs 2024-07-26T09:29:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3222.262889 secs 2024-07-26T09:29:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3222.262889 secs 2024-07-26T09:29:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3222.262889 secs 2024-07-26T09:29:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:22 smithi043 ceph-mon[32384]: pgmap v2283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:22 smithi133 ceph-mon[37053]: pgmap v2283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:22 smithi063 ceph-mon[36747]: pgmap v2283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:24 smithi043 ceph-mon[32384]: pgmap v2284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:24 smithi133 ceph-mon[37053]: pgmap v2284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:24 smithi063 ceph-mon[36747]: pgmap v2284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3211.779288 secs 2024-07-26T09:29:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3211.779288 secs 2024-07-26T09:29:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3211.779288 secs 2024-07-26T09:29:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3227.262980 secs 2024-07-26T09:29:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:26 smithi043 ceph-mon[32384]: pgmap v2285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3227.262980 secs 2024-07-26T09:29:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:26 smithi133 ceph-mon[37053]: pgmap v2285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:27.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3227.262980 secs 2024-07-26T09:29:27.321 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:26 smithi063 ceph-mon[36747]: pgmap v2285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:28 smithi043 ceph-mon[32384]: pgmap v2286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:28 smithi133 ceph-mon[37053]: pgmap v2286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:28 smithi063 ceph-mon[36747]: pgmap v2286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:29:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:29:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:29:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:30 smithi043 ceph-mon[32384]: pgmap v2287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3216.779367 secs 2024-07-26T09:29:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:29:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:29:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:29:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:30 smithi133 ceph-mon[37053]: pgmap v2287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3216.779367 secs 2024-07-26T09:29:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:29:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:29:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:29:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:30 smithi063 ceph-mon[36747]: pgmap v2287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3216.779367 secs 2024-07-26T09:29:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:29:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:29:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:29:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3232.263067 secs 2024-07-26T09:29:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:31 smithi043 ceph-mon[32384]: pgmap v2288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:29:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:31 smithi043 ceph-mon[32384]: pgmap v2289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:29:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3232.263067 secs 2024-07-26T09:29:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:31 smithi133 ceph-mon[37053]: pgmap v2288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:29:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:31 smithi133 ceph-mon[37053]: pgmap v2289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:29:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3232.263067 secs 2024-07-26T09:29:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:31 smithi063 ceph-mon[36747]: pgmap v2288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:29:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:31 smithi063 ceph-mon[36747]: pgmap v2289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:29:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:33 smithi043 ceph-mon[32384]: pgmap v2290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:29:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:33 smithi133 ceph-mon[37053]: pgmap v2290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:29:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:33 smithi063 ceph-mon[36747]: pgmap v2290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:29:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:35 smithi133 ceph-mon[37053]: pgmap v2291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:29:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3221.779484 secs 2024-07-26T09:29:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3237.263193 secs 2024-07-26T09:29:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:35 smithi063 ceph-mon[36747]: pgmap v2291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:29:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3221.779484 secs 2024-07-26T09:29:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3237.263193 secs 2024-07-26T09:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:35 smithi043 ceph-mon[32384]: pgmap v2291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3221.779484 secs 2024-07-26T09:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3237.263193 secs 2024-07-26T09:29:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:37 smithi133 ceph-mon[37053]: pgmap v2292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:29:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:37 smithi063 ceph-mon[36747]: pgmap v2292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:29:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:37 smithi043 ceph-mon[32384]: pgmap v2292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:29:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:39 smithi133 ceph-mon[37053]: pgmap v2293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:29:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:39 smithi063 ceph-mon[36747]: pgmap v2293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:29:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:39 smithi043 ceph-mon[32384]: pgmap v2293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:29:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3226.779600 secs 2024-07-26T09:29:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3242.263277 secs 2024-07-26T09:29:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3226.779600 secs 2024-07-26T09:29:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3242.263277 secs 2024-07-26T09:29:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3226.779600 secs 2024-07-26T09:29:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3242.263277 secs 2024-07-26T09:29:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:42 smithi133 ceph-mon[37053]: pgmap v2294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:29:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:42 smithi063 ceph-mon[36747]: pgmap v2294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:29:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:42 smithi043 ceph-mon[32384]: pgmap v2294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:29:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:44 smithi133 ceph-mon[37053]: pgmap v2295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:44 smithi063 ceph-mon[36747]: pgmap v2295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:44 smithi043 ceph-mon[32384]: pgmap v2295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:46 smithi063 ceph-mon[36747]: pgmap v2296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3231.779723 secs 2024-07-26T09:29:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3247.263403 secs 2024-07-26T09:29:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:46 smithi043 ceph-mon[32384]: pgmap v2296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3231.779723 secs 2024-07-26T09:29:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3247.263403 secs 2024-07-26T09:29:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:46 smithi133 ceph-mon[37053]: pgmap v2296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3231.779723 secs 2024-07-26T09:29:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3247.263403 secs 2024-07-26T09:29:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:48 smithi063 ceph-mon[36747]: pgmap v2297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:48 smithi043 ceph-mon[32384]: pgmap v2297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:48 smithi133 ceph-mon[37053]: pgmap v2297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:50 smithi063 ceph-mon[36747]: pgmap v2298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:50 smithi043 ceph-mon[32384]: pgmap v2298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:50 smithi133 ceph-mon[37053]: pgmap v2298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3236.779851 secs 2024-07-26T09:29:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3252.263484 secs 2024-07-26T09:29:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3236.779851 secs 2024-07-26T09:29:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3252.263484 secs 2024-07-26T09:29:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3236.779851 secs 2024-07-26T09:29:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3252.263484 secs 2024-07-26T09:29:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:52 smithi063 ceph-mon[36747]: pgmap v2299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:52 smithi043 ceph-mon[32384]: pgmap v2299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:52 smithi133 ceph-mon[37053]: pgmap v2299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:54.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:54 smithi063 ceph-mon[36747]: pgmap v2300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:54 smithi043 ceph-mon[32384]: pgmap v2300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:54 smithi133 ceph-mon[37053]: pgmap v2300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:29:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:56 smithi063 ceph-mon[36747]: pgmap v2301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3241.779991 secs 2024-07-26T09:29:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3257.263610 secs 2024-07-26T09:29:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:56 smithi043 ceph-mon[32384]: pgmap v2301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3241.779991 secs 2024-07-26T09:29:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3257.263610 secs 2024-07-26T09:29:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:56 smithi133 ceph-mon[37053]: pgmap v2301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:29:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3241.779991 secs 2024-07-26T09:29:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3257.263610 secs 2024-07-26T09:29:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:29:58 smithi063 ceph-mon[36747]: pgmap v2302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:29:58 smithi043 ceph-mon[32384]: pgmap v2302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:29:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:29:58 smithi133 ceph-mon[37053]: pgmap v2302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:00 smithi063 ceph-mon[36747]: pgmap v2303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:00.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:30:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:00 smithi043 ceph-mon[32384]: pgmap v2303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:30:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:00 smithi133 ceph-mon[37053]: pgmap v2303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:30:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3246.780133 secs 2024-07-26T09:30:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3262.263751 secs 2024-07-26T09:30:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3246.780133 secs 2024-07-26T09:30:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3262.263751 secs 2024-07-26T09:30:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3246.780133 secs 2024-07-26T09:30:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3262.263751 secs 2024-07-26T09:30:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:02 smithi043 ceph-mon[32384]: pgmap v2304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:02 smithi133 ceph-mon[37053]: pgmap v2304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:02 smithi063 ceph-mon[36747]: pgmap v2304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:04 smithi043 ceph-mon[32384]: pgmap v2305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:04 smithi133 ceph-mon[37053]: pgmap v2305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:04 smithi063 ceph-mon[36747]: pgmap v2305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:06 smithi063 ceph-mon[36747]: pgmap v2306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3251.780232 secs 2024-07-26T09:30:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3267.263884 secs 2024-07-26T09:30:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:06 smithi043 ceph-mon[32384]: pgmap v2306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3251.780232 secs 2024-07-26T09:30:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3267.263884 secs 2024-07-26T09:30:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:06 smithi133 ceph-mon[37053]: pgmap v2306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3251.780232 secs 2024-07-26T09:30:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3267.263884 secs 2024-07-26T09:30:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:08 smithi043 ceph-mon[32384]: pgmap v2307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:08 smithi133 ceph-mon[37053]: pgmap v2307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:08 smithi063 ceph-mon[36747]: pgmap v2307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:10 smithi043 ceph-mon[32384]: pgmap v2308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:10 smithi133 ceph-mon[37053]: pgmap v2308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:10 smithi063 ceph-mon[36747]: pgmap v2308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3256.780317 secs 2024-07-26T09:30:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3272.263917 secs 2024-07-26T09:30:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3256.780317 secs 2024-07-26T09:30:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3272.263917 secs 2024-07-26T09:30:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3256.780317 secs 2024-07-26T09:30:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3272.263917 secs 2024-07-26T09:30:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:12 smithi043 ceph-mon[32384]: pgmap v2309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:12 smithi133 ceph-mon[37053]: pgmap v2309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:12 smithi063 ceph-mon[36747]: pgmap v2309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:14 smithi043 ceph-mon[32384]: pgmap v2310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:14 smithi133 ceph-mon[37053]: pgmap v2310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:14 smithi063 ceph-mon[36747]: pgmap v2310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:16 smithi043 ceph-mon[32384]: pgmap v2311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:30:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3261.780412 secs 2024-07-26T09:30:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3277.264002 secs 2024-07-26T09:30:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:16 smithi133 ceph-mon[37053]: pgmap v2311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:30:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3261.780412 secs 2024-07-26T09:30:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3277.264002 secs 2024-07-26T09:30:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:16 smithi063 ceph-mon[36747]: pgmap v2311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:30:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3261.780412 secs 2024-07-26T09:30:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3277.264002 secs 2024-07-26T09:30:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:18 smithi043 ceph-mon[32384]: pgmap v2312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:18 smithi133 ceph-mon[37053]: pgmap v2312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:18 smithi063 ceph-mon[36747]: pgmap v2312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:20 smithi043 ceph-mon[32384]: pgmap v2313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:20 smithi133 ceph-mon[37053]: pgmap v2313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:20 smithi063 ceph-mon[36747]: pgmap v2313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3266.780480 secs 2024-07-26T09:30:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3282.264085 secs 2024-07-26T09:30:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3266.780480 secs 2024-07-26T09:30:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3282.264085 secs 2024-07-26T09:30:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3266.780480 secs 2024-07-26T09:30:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3282.264085 secs 2024-07-26T09:30:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:22 smithi043 ceph-mon[32384]: pgmap v2314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:22 smithi133 ceph-mon[37053]: pgmap v2314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:22 smithi063 ceph-mon[36747]: pgmap v2314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:24 smithi043 ceph-mon[32384]: pgmap v2315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:24 smithi133 ceph-mon[37053]: pgmap v2315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:24 smithi063 ceph-mon[36747]: pgmap v2315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:26 smithi043 ceph-mon[32384]: pgmap v2316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3271.780603 secs 2024-07-26T09:30:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3287.264204 secs 2024-07-26T09:30:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:26 smithi133 ceph-mon[37053]: pgmap v2316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3271.780603 secs 2024-07-26T09:30:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3287.264204 secs 2024-07-26T09:30:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:26 smithi063 ceph-mon[36747]: pgmap v2316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3271.780603 secs 2024-07-26T09:30:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3287.264204 secs 2024-07-26T09:30:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:28 smithi043 ceph-mon[32384]: pgmap v2317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:28 smithi133 ceph-mon[37053]: pgmap v2317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:28 smithi063 ceph-mon[36747]: pgmap v2317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:30 smithi043 ceph-mon[32384]: pgmap v2318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:30 smithi133 ceph-mon[37053]: pgmap v2318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:30 smithi063 ceph-mon[36747]: pgmap v2318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3276.780725 secs 2024-07-26T09:30:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3292.264271 secs 2024-07-26T09:30:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:30:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3276.780725 secs 2024-07-26T09:30:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3292.264271 secs 2024-07-26T09:30:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:30:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3276.780725 secs 2024-07-26T09:30:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3292.264271 secs 2024-07-26T09:30:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:32 smithi043 ceph-mon[32384]: pgmap v2319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:32 smithi133 ceph-mon[37053]: pgmap v2319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:32 smithi063 ceph-mon[36747]: pgmap v2319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:30:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:30:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:30:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:30:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:30:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:30:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:30:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:34 smithi043 ceph-mon[32384]: pgmap v2320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:34 smithi043 ceph-mon[32384]: pgmap v2321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:34 smithi133 ceph-mon[37053]: pgmap v2320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:34 smithi133 ceph-mon[37053]: pgmap v2321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:34 smithi063 ceph-mon[36747]: pgmap v2320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:34 smithi063 ceph-mon[36747]: pgmap v2321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:36 smithi043 ceph-mon[32384]: pgmap v2322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3281.780799 secs 2024-07-26T09:30:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3297.264337 secs 2024-07-26T09:30:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:36 smithi133 ceph-mon[37053]: pgmap v2322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3281.780799 secs 2024-07-26T09:30:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3297.264337 secs 2024-07-26T09:30:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:36 smithi063 ceph-mon[36747]: pgmap v2322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3281.780799 secs 2024-07-26T09:30:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3297.264337 secs 2024-07-26T09:30:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:38 smithi043 ceph-mon[32384]: pgmap v2323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:38 smithi133 ceph-mon[37053]: pgmap v2323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:38 smithi063 ceph-mon[36747]: pgmap v2323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:39 smithi133 ceph-mon[37053]: pgmap v2324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:39 smithi063 ceph-mon[36747]: pgmap v2324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:39 smithi043 ceph-mon[32384]: pgmap v2324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3286.780936 secs 2024-07-26T09:30:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3286.780936 secs 2024-07-26T09:30:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3286.780936 secs 2024-07-26T09:30:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3302.264454 secs 2024-07-26T09:30:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:41 smithi043 ceph-mon[32384]: pgmap v2325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3302.264454 secs 2024-07-26T09:30:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:41 smithi133 ceph-mon[37053]: pgmap v2325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3302.264454 secs 2024-07-26T09:30:42.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:41 smithi063 ceph-mon[36747]: pgmap v2325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:30:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:44 smithi133 ceph-mon[37053]: pgmap v2326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:44 smithi063 ceph-mon[36747]: pgmap v2326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:44 smithi043 ceph-mon[32384]: pgmap v2326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:30:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:46 smithi063 ceph-mon[36747]: pgmap v2327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3291.781067 secs 2024-07-26T09:30:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3307.264579 secs 2024-07-26T09:30:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:46 smithi043 ceph-mon[32384]: pgmap v2327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3291.781067 secs 2024-07-26T09:30:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3307.264579 secs 2024-07-26T09:30:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:46 smithi133 ceph-mon[37053]: pgmap v2327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3291.781067 secs 2024-07-26T09:30:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3307.264579 secs 2024-07-26T09:30:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:48 smithi063 ceph-mon[36747]: pgmap v2328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:48 smithi043 ceph-mon[32384]: pgmap v2328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:48 smithi133 ceph-mon[37053]: pgmap v2328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:50 smithi063 ceph-mon[36747]: pgmap v2329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:50 smithi043 ceph-mon[32384]: pgmap v2329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:50 smithi133 ceph-mon[37053]: pgmap v2329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3296.781196 secs 2024-07-26T09:30:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3312.264721 secs 2024-07-26T09:30:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3296.781196 secs 2024-07-26T09:30:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3312.264721 secs 2024-07-26T09:30:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3296.781196 secs 2024-07-26T09:30:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3312.264721 secs 2024-07-26T09:30:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:52 smithi063 ceph-mon[36747]: pgmap v2330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:52 smithi043 ceph-mon[32384]: pgmap v2330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:52 smithi133 ceph-mon[37053]: pgmap v2330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:54 smithi063 ceph-mon[36747]: pgmap v2331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:54 smithi043 ceph-mon[32384]: pgmap v2331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:54 smithi133 ceph-mon[37053]: pgmap v2331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:30:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:56 smithi063 ceph-mon[36747]: pgmap v2332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3301.781320 secs 2024-07-26T09:30:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3317.264836 secs 2024-07-26T09:30:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:56 smithi043 ceph-mon[32384]: pgmap v2332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3301.781320 secs 2024-07-26T09:30:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3317.264836 secs 2024-07-26T09:30:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:56 smithi133 ceph-mon[37053]: pgmap v2332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:30:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3301.781320 secs 2024-07-26T09:30:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3317.264836 secs 2024-07-26T09:30:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:30:58 smithi063 ceph-mon[36747]: pgmap v2333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:30:58 smithi043 ceph-mon[32384]: pgmap v2333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:30:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:30:58 smithi133 ceph-mon[37053]: pgmap v2333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:00 smithi063 ceph-mon[36747]: pgmap v2334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:00 smithi043 ceph-mon[32384]: pgmap v2334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:00 smithi133 ceph-mon[37053]: pgmap v2334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3306.781411 secs 2024-07-26T09:31:01.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3322.264951 secs 2024-07-26T09:31:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3306.781411 secs 2024-07-26T09:31:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3322.264951 secs 2024-07-26T09:31:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3306.781411 secs 2024-07-26T09:31:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3322.264951 secs 2024-07-26T09:31:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:02 smithi043 ceph-mon[32384]: pgmap v2335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:02 smithi133 ceph-mon[37053]: pgmap v2335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:02 smithi063 ceph-mon[36747]: pgmap v2335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:04 smithi043 ceph-mon[32384]: pgmap v2336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:04 smithi133 ceph-mon[37053]: pgmap v2336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:04 smithi063 ceph-mon[36747]: pgmap v2336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:06.363 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:06 smithi043 ceph-mon[32384]: pgmap v2337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:06.364 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3311.781536 secs 2024-07-26T09:31:06.364 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3327.265069 secs 2024-07-26T09:31:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:06 smithi063 ceph-mon[36747]: pgmap v2337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3311.781536 secs 2024-07-26T09:31:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3327.265069 secs 2024-07-26T09:31:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:06 smithi133 ceph-mon[37053]: pgmap v2337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3311.781536 secs 2024-07-26T09:31:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3327.265069 secs 2024-07-26T09:31:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:08 smithi043 ceph-mon[32384]: pgmap v2338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:08 smithi133 ceph-mon[37053]: pgmap v2338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:08 smithi063 ceph-mon[36747]: pgmap v2338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:10 smithi043 ceph-mon[32384]: pgmap v2339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:10 smithi133 ceph-mon[37053]: pgmap v2339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:10 smithi063 ceph-mon[36747]: pgmap v2339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3316.781633 secs 2024-07-26T09:31:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3332.265149 secs 2024-07-26T09:31:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3316.781633 secs 2024-07-26T09:31:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3332.265149 secs 2024-07-26T09:31:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3316.781633 secs 2024-07-26T09:31:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3332.265149 secs 2024-07-26T09:31:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:12 smithi043 ceph-mon[32384]: pgmap v2340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:12 smithi133 ceph-mon[37053]: pgmap v2340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:12 smithi063 ceph-mon[36747]: pgmap v2340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:14 smithi043 ceph-mon[32384]: pgmap v2341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:14 smithi133 ceph-mon[37053]: pgmap v2341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:14 smithi063 ceph-mon[36747]: pgmap v2341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:16 smithi043 ceph-mon[32384]: pgmap v2342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3321.781761 secs 2024-07-26T09:31:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3337.265273 secs 2024-07-26T09:31:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:16 smithi133 ceph-mon[37053]: pgmap v2342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3321.781761 secs 2024-07-26T09:31:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3337.265273 secs 2024-07-26T09:31:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:16 smithi063 ceph-mon[36747]: pgmap v2342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3321.781761 secs 2024-07-26T09:31:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3337.265273 secs 2024-07-26T09:31:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:18 smithi043 ceph-mon[32384]: pgmap v2343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:18 smithi133 ceph-mon[37053]: pgmap v2343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:18 smithi063 ceph-mon[36747]: pgmap v2343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:20 smithi043 ceph-mon[32384]: pgmap v2344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:20 smithi133 ceph-mon[37053]: pgmap v2344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:20 smithi063 ceph-mon[36747]: pgmap v2344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3326.781900 secs 2024-07-26T09:31:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3342.265413 secs 2024-07-26T09:31:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3326.781900 secs 2024-07-26T09:31:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3342.265413 secs 2024-07-26T09:31:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3326.781900 secs 2024-07-26T09:31:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3342.265413 secs 2024-07-26T09:31:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:22 smithi043 ceph-mon[32384]: pgmap v2345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:22 smithi133 ceph-mon[37053]: pgmap v2345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:22 smithi063 ceph-mon[36747]: pgmap v2345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:24 smithi043 ceph-mon[32384]: pgmap v2346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:24 smithi133 ceph-mon[37053]: pgmap v2346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:24 smithi063 ceph-mon[36747]: pgmap v2346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:26 smithi043 ceph-mon[32384]: pgmap v2347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3331.782015 secs 2024-07-26T09:31:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3347.265535 secs 2024-07-26T09:31:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:26 smithi133 ceph-mon[37053]: pgmap v2347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3331.782015 secs 2024-07-26T09:31:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3347.265535 secs 2024-07-26T09:31:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:26 smithi063 ceph-mon[36747]: pgmap v2347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3331.782015 secs 2024-07-26T09:31:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3347.265535 secs 2024-07-26T09:31:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:28 smithi043 ceph-mon[32384]: pgmap v2348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:28 smithi133 ceph-mon[37053]: pgmap v2348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:28 smithi063 ceph-mon[36747]: pgmap v2348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:30 smithi043 ceph-mon[32384]: pgmap v2349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:30 smithi133 ceph-mon[37053]: pgmap v2349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:30 smithi063 ceph-mon[36747]: pgmap v2349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3336.782131 secs 2024-07-26T09:31:31.495 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3352.265672 secs 2024-07-26T09:31:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3336.782131 secs 2024-07-26T09:31:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3352.265672 secs 2024-07-26T09:31:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3336.782131 secs 2024-07-26T09:31:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3352.265672 secs 2024-07-26T09:31:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:32 smithi043 ceph-mon[32384]: pgmap v2350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:32 smithi133 ceph-mon[37053]: pgmap v2350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:32 smithi063 ceph-mon[36747]: pgmap v2350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:34.446 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:34 smithi133 ceph-mon[37053]: pgmap v2351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:34.446 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:31:34.446 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.446 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.446 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.447 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.458 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:34 smithi063 ceph-mon[36747]: pgmap v2351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:34.458 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:31:34.459 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.459 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.459 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.459 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:34 smithi043 ceph-mon[32384]: pgmap v2351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:31:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:34.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: pgmap v2352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3341.782204 secs 2024-07-26T09:31:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3357.265761 secs 2024-07-26T09:31:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: pgmap v2352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3341.782204 secs 2024-07-26T09:31:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3357.265761 secs 2024-07-26T09:31:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: pgmap v2352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:31:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3341.782204 secs 2024-07-26T09:31:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3357.265761 secs 2024-07-26T09:31:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:38 smithi043 ceph-mon[32384]: pgmap v2353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:38 smithi133 ceph-mon[37053]: pgmap v2353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:38 smithi063 ceph-mon[36747]: pgmap v2353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:31:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:39.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:31:39.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:31:39.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:31:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:31:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:31:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:31:39.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:31:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:40 smithi043 ceph-mon[32384]: pgmap v2354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:31:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:40 smithi043 ceph-mon[32384]: pgmap v2355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:40 smithi133 ceph-mon[37053]: pgmap v2354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:31:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:40 smithi133 ceph-mon[37053]: pgmap v2355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:40 smithi063 ceph-mon[36747]: pgmap v2354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:31:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:40 smithi063 ceph-mon[36747]: pgmap v2355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3346.782336 secs 2024-07-26T09:31:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3362.265826 secs 2024-07-26T09:31:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3346.782336 secs 2024-07-26T09:31:41.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3362.265826 secs 2024-07-26T09:31:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3346.782336 secs 2024-07-26T09:31:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3362.265826 secs 2024-07-26T09:31:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:42 smithi043 ceph-mon[32384]: pgmap v2356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:42 smithi133 ceph-mon[37053]: pgmap v2356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:42 smithi063 ceph-mon[36747]: pgmap v2356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:44 smithi133 ceph-mon[37053]: pgmap v2357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:44 smithi063 ceph-mon[36747]: pgmap v2357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:44 smithi043 ceph-mon[32384]: pgmap v2357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:46 smithi133 ceph-mon[37053]: pgmap v2358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3351.782465 secs 2024-07-26T09:31:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3367.265933 secs 2024-07-26T09:31:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:46 smithi063 ceph-mon[36747]: pgmap v2358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3351.782465 secs 2024-07-26T09:31:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3367.265933 secs 2024-07-26T09:31:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:46 smithi043 ceph-mon[32384]: pgmap v2358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3351.782465 secs 2024-07-26T09:31:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3367.265933 secs 2024-07-26T09:31:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:47 smithi133 ceph-mon[37053]: pgmap v2359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:47 smithi063 ceph-mon[36747]: pgmap v2359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:47 smithi043 ceph-mon[32384]: pgmap v2359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:49 smithi133 ceph-mon[37053]: pgmap v2360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:31:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:49 smithi063 ceph-mon[36747]: pgmap v2360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:31:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:49 smithi043 ceph-mon[32384]: pgmap v2360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:31:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3356.782590 secs 2024-07-26T09:31:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:51 smithi133 ceph-mon[37053]: pgmap v2361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3372.266017 secs 2024-07-26T09:31:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3356.782590 secs 2024-07-26T09:31:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:51 smithi063 ceph-mon[36747]: pgmap v2361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3372.266017 secs 2024-07-26T09:31:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3356.782590 secs 2024-07-26T09:31:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:51 smithi043 ceph-mon[32384]: pgmap v2361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:31:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3372.266017 secs 2024-07-26T09:31:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:53 smithi133 ceph-mon[37053]: pgmap v2362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:53 smithi063 ceph-mon[36747]: pgmap v2362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:53 smithi043 ceph-mon[32384]: pgmap v2362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:55 smithi133 ceph-mon[37053]: pgmap v2363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:55 smithi063 ceph-mon[36747]: pgmap v2363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:55 smithi043 ceph-mon[32384]: pgmap v2363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:31:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3361.782713 secs 2024-07-26T09:31:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3377.266159 secs 2024-07-26T09:31:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3361.782713 secs 2024-07-26T09:31:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3377.266159 secs 2024-07-26T09:31:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3361.782713 secs 2024-07-26T09:31:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3377.266159 secs 2024-07-26T09:31:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:57 smithi063 ceph-mon[36747]: pgmap v2364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:31:57.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:57 smithi043 ceph-mon[32384]: pgmap v2364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:31:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:57 smithi133 ceph-mon[37053]: pgmap v2364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:31:59.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:31:59 smithi063 ceph-mon[36747]: pgmap v2365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:31:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:31:59 smithi043 ceph-mon[32384]: pgmap v2365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:31:59 smithi133 ceph-mon[37053]: pgmap v2365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:01.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3366.782830 secs 2024-07-26T09:32:01.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:01 smithi043 ceph-mon[32384]: pgmap v2366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:01.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3382.266294 secs 2024-07-26T09:32:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3366.782830 secs 2024-07-26T09:32:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:01 smithi063 ceph-mon[36747]: pgmap v2366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3382.266294 secs 2024-07-26T09:32:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3366.782830 secs 2024-07-26T09:32:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:01 smithi133 ceph-mon[37053]: pgmap v2366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:02.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3382.266294 secs 2024-07-26T09:32:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:03 smithi063 ceph-mon[36747]: pgmap v2367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:03 smithi043 ceph-mon[32384]: pgmap v2367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:03 smithi133 ceph-mon[37053]: pgmap v2367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:05 smithi063 ceph-mon[36747]: pgmap v2368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:05 smithi043 ceph-mon[32384]: pgmap v2368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:05 smithi133 ceph-mon[37053]: pgmap v2368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3371.782913 secs 2024-07-26T09:32:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3387.266415 secs 2024-07-26T09:32:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3371.782913 secs 2024-07-26T09:32:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3387.266415 secs 2024-07-26T09:32:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3371.782913 secs 2024-07-26T09:32:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3387.266415 secs 2024-07-26T09:32:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:07 smithi063 ceph-mon[36747]: pgmap v2369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:07 smithi043 ceph-mon[32384]: pgmap v2369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:07 smithi133 ceph-mon[37053]: pgmap v2369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:09 smithi063 ceph-mon[36747]: pgmap v2370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:09 smithi043 ceph-mon[32384]: pgmap v2370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:09 smithi133 ceph-mon[37053]: pgmap v2370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3376.782976 secs 2024-07-26T09:32:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:11 smithi043 ceph-mon[32384]: pgmap v2371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3392.266533 secs 2024-07-26T09:32:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3376.782976 secs 2024-07-26T09:32:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:11 smithi133 ceph-mon[37053]: pgmap v2371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3392.266533 secs 2024-07-26T09:32:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3376.782976 secs 2024-07-26T09:32:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:11 smithi063 ceph-mon[36747]: pgmap v2371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3392.266533 secs 2024-07-26T09:32:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:13 smithi043 ceph-mon[32384]: pgmap v2372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:13 smithi133 ceph-mon[37053]: pgmap v2372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:13 smithi063 ceph-mon[36747]: pgmap v2372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:15 smithi043 ceph-mon[32384]: pgmap v2373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:15 smithi133 ceph-mon[37053]: pgmap v2373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:15 smithi063 ceph-mon[36747]: pgmap v2373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3381.783090 secs 2024-07-26T09:32:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3397.266629 secs 2024-07-26T09:32:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3381.783090 secs 2024-07-26T09:32:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3397.266629 secs 2024-07-26T09:32:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3381.783090 secs 2024-07-26T09:32:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3397.266629 secs 2024-07-26T09:32:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:17 smithi043 ceph-mon[32384]: pgmap v2374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:17 smithi133 ceph-mon[37053]: pgmap v2374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:17 smithi063 ceph-mon[36747]: pgmap v2374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:19 smithi043 ceph-mon[32384]: pgmap v2375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:19 smithi133 ceph-mon[37053]: pgmap v2375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:19 smithi063 ceph-mon[36747]: pgmap v2375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3386.783211 secs 2024-07-26T09:32:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:21 smithi043 ceph-mon[32384]: pgmap v2376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3402.266748 secs 2024-07-26T09:32:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3386.783211 secs 2024-07-26T09:32:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:21 smithi133 ceph-mon[37053]: pgmap v2376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3402.266748 secs 2024-07-26T09:32:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3386.783211 secs 2024-07-26T09:32:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:21 smithi063 ceph-mon[36747]: pgmap v2376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3402.266748 secs 2024-07-26T09:32:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:23 smithi043 ceph-mon[32384]: pgmap v2377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:23 smithi133 ceph-mon[37053]: pgmap v2377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:23 smithi063 ceph-mon[36747]: pgmap v2377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:25 smithi043 ceph-mon[32384]: pgmap v2378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:25 smithi133 ceph-mon[37053]: pgmap v2378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:25 smithi063 ceph-mon[36747]: pgmap v2378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3391.783311 secs 2024-07-26T09:32:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3407.266886 secs 2024-07-26T09:32:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3391.783311 secs 2024-07-26T09:32:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3407.266886 secs 2024-07-26T09:32:27.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3391.783311 secs 2024-07-26T09:32:27.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3407.266886 secs 2024-07-26T09:32:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:27 smithi043 ceph-mon[32384]: pgmap v2379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:27 smithi133 ceph-mon[37053]: pgmap v2379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:27 smithi063 ceph-mon[36747]: pgmap v2379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:29 smithi043 ceph-mon[32384]: pgmap v2380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:29 smithi133 ceph-mon[37053]: pgmap v2380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:29 smithi063 ceph-mon[36747]: pgmap v2380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3396.783435 secs 2024-07-26T09:32:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3396.783435 secs 2024-07-26T09:32:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3396.783435 secs 2024-07-26T09:32:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:31 smithi043 ceph-mon[32384]: pgmap v2381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3412.266977 secs 2024-07-26T09:32:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:31 smithi133 ceph-mon[37053]: pgmap v2381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3412.266977 secs 2024-07-26T09:32:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:31 smithi063 ceph-mon[36747]: pgmap v2381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:32:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3412.266977 secs 2024-07-26T09:32:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:33 smithi043 ceph-mon[32384]: pgmap v2382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:33 smithi133 ceph-mon[37053]: pgmap v2382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:33 smithi063 ceph-mon[36747]: pgmap v2382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:35 smithi043 ceph-mon[32384]: pgmap v2383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3401.783552 secs 2024-07-26T09:32:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:35 smithi133 ceph-mon[37053]: pgmap v2383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3401.783552 secs 2024-07-26T09:32:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:35 smithi063 ceph-mon[36747]: pgmap v2383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3401.783552 secs 2024-07-26T09:32:36.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3417.267073 secs 2024-07-26T09:32:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3417.267073 secs 2024-07-26T09:32:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3417.267073 secs 2024-07-26T09:32:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:37 smithi043 ceph-mon[32384]: pgmap v2384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:37 smithi133 ceph-mon[37053]: pgmap v2384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:37 smithi063 ceph-mon[36747]: pgmap v2384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:32:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:32:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:32:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:39 smithi043 ceph-mon[32384]: pgmap v2385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:39 smithi133 ceph-mon[37053]: pgmap v2385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:39 smithi063 ceph-mon[36747]: pgmap v2385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:32:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:32:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:40 smithi043 ceph-mon[32384]: pgmap v2386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:32:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:40 smithi043 ceph-mon[32384]: pgmap v2387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:32:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3406.783682 secs 2024-07-26T09:32:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:32:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:32:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:40 smithi133 ceph-mon[37053]: pgmap v2386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:32:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:40 smithi133 ceph-mon[37053]: pgmap v2387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:41.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:32:41.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3406.783682 secs 2024-07-26T09:32:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:32:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:32:41.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:40 smithi063 ceph-mon[36747]: pgmap v2386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:32:41.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:40 smithi063 ceph-mon[36747]: pgmap v2387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:41.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:32:41.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3406.783682 secs 2024-07-26T09:32:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3422.267189 secs 2024-07-26T09:32:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3422.267189 secs 2024-07-26T09:32:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3422.267189 secs 2024-07-26T09:32:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:42 smithi043 ceph-mon[32384]: pgmap v2388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:32:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:42 smithi133 ceph-mon[37053]: pgmap v2388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:32:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:42 smithi063 ceph-mon[36747]: pgmap v2388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:32:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:44 smithi043 ceph-mon[32384]: pgmap v2389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:44 smithi133 ceph-mon[37053]: pgmap v2389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:44 smithi063 ceph-mon[36747]: pgmap v2389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3411.783821 secs 2024-07-26T09:32:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3411.783821 secs 2024-07-26T09:32:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3411.783821 secs 2024-07-26T09:32:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3427.267305 secs 2024-07-26T09:32:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:46 smithi133 ceph-mon[37053]: pgmap v2390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3427.267305 secs 2024-07-26T09:32:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:46 smithi063 ceph-mon[36747]: pgmap v2390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3427.267305 secs 2024-07-26T09:32:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:46 smithi043 ceph-mon[32384]: pgmap v2390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:32:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:48 smithi133 ceph-mon[37053]: pgmap v2391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:32:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:48 smithi063 ceph-mon[36747]: pgmap v2391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:32:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:48 smithi043 ceph-mon[32384]: pgmap v2391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:32:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:50 smithi133 ceph-mon[37053]: pgmap v2392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:32:51.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3416.783924 secs 2024-07-26T09:32:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:50 smithi063 ceph-mon[36747]: pgmap v2392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:32:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3416.783924 secs 2024-07-26T09:32:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:50 smithi043 ceph-mon[32384]: pgmap v2392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:32:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3416.783924 secs 2024-07-26T09:32:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3432.267422 secs 2024-07-26T09:32:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3432.267422 secs 2024-07-26T09:32:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3432.267422 secs 2024-07-26T09:32:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:52 smithi063 ceph-mon[36747]: pgmap v2393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:52 smithi043 ceph-mon[32384]: pgmap v2393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:52 smithi133 ceph-mon[37053]: pgmap v2393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:54 smithi063 ceph-mon[36747]: pgmap v2394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:54 smithi043 ceph-mon[32384]: pgmap v2394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:54 smithi133 ceph-mon[37053]: pgmap v2394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3421.784020 secs 2024-07-26T09:32:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3421.784020 secs 2024-07-26T09:32:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3421.784020 secs 2024-07-26T09:32:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3437.267538 secs 2024-07-26T09:32:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:56 smithi063 ceph-mon[36747]: pgmap v2395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3437.267538 secs 2024-07-26T09:32:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:56 smithi043 ceph-mon[32384]: pgmap v2395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3437.267538 secs 2024-07-26T09:32:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:56 smithi133 ceph-mon[37053]: pgmap v2395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:32:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:32:58 smithi063 ceph-mon[36747]: pgmap v2396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:32:58 smithi043 ceph-mon[32384]: pgmap v2396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:32:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:32:58 smithi133 ceph-mon[37053]: pgmap v2396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:00 smithi063 ceph-mon[36747]: pgmap v2397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3426.784141 secs 2024-07-26T09:33:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:00 smithi043 ceph-mon[32384]: pgmap v2397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3426.784141 secs 2024-07-26T09:33:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:00 smithi133 ceph-mon[37053]: pgmap v2397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3426.784141 secs 2024-07-26T09:33:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3442.267673 secs 2024-07-26T09:33:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3442.267673 secs 2024-07-26T09:33:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3442.267673 secs 2024-07-26T09:33:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:02 smithi063 ceph-mon[36747]: pgmap v2398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:02 smithi043 ceph-mon[32384]: pgmap v2398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:02 smithi133 ceph-mon[37053]: pgmap v2398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:04 smithi043 ceph-mon[32384]: pgmap v2399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:04 smithi133 ceph-mon[37053]: pgmap v2399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:04 smithi063 ceph-mon[36747]: pgmap v2399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:06.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3431.784261 secs 2024-07-26T09:33:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3431.784261 secs 2024-07-26T09:33:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3431.784261 secs 2024-07-26T09:33:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3447.267795 secs 2024-07-26T09:33:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:06 smithi043 ceph-mon[32384]: pgmap v2400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3447.267795 secs 2024-07-26T09:33:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:06 smithi133 ceph-mon[37053]: pgmap v2400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3447.267795 secs 2024-07-26T09:33:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:06 smithi063 ceph-mon[36747]: pgmap v2400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:08 smithi043 ceph-mon[32384]: pgmap v2401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:08 smithi133 ceph-mon[37053]: pgmap v2401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:08 smithi063 ceph-mon[36747]: pgmap v2401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:10 smithi043 ceph-mon[32384]: pgmap v2402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3436.784380 secs 2024-07-26T09:33:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:10 smithi133 ceph-mon[37053]: pgmap v2402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3436.784380 secs 2024-07-26T09:33:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:10 smithi063 ceph-mon[36747]: pgmap v2402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3436.784380 secs 2024-07-26T09:33:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3452.267955 secs 2024-07-26T09:33:12.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3452.267955 secs 2024-07-26T09:33:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3452.267955 secs 2024-07-26T09:33:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:12 smithi043 ceph-mon[32384]: pgmap v2403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:12 smithi133 ceph-mon[37053]: pgmap v2403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:12 smithi063 ceph-mon[36747]: pgmap v2403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:14 smithi043 ceph-mon[32384]: pgmap v2404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:14 smithi133 ceph-mon[37053]: pgmap v2404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:14 smithi063 ceph-mon[36747]: pgmap v2404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3441.784496 secs 2024-07-26T09:33:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3441.784496 secs 2024-07-26T09:33:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3441.784496 secs 2024-07-26T09:33:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3457.268048 secs 2024-07-26T09:33:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:16 smithi043 ceph-mon[32384]: pgmap v2405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3457.268048 secs 2024-07-26T09:33:17.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:16 smithi133 ceph-mon[37053]: pgmap v2405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3457.268048 secs 2024-07-26T09:33:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:16 smithi063 ceph-mon[36747]: pgmap v2405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:18 smithi043 ceph-mon[32384]: pgmap v2406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:18 smithi133 ceph-mon[37053]: pgmap v2406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:18 smithi063 ceph-mon[36747]: pgmap v2406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:20 smithi043 ceph-mon[32384]: pgmap v2407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3446.784615 secs 2024-07-26T09:33:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:20 smithi133 ceph-mon[37053]: pgmap v2407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3446.784615 secs 2024-07-26T09:33:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:20 smithi063 ceph-mon[36747]: pgmap v2407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3446.784615 secs 2024-07-26T09:33:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3462.268158 secs 2024-07-26T09:33:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3462.268158 secs 2024-07-26T09:33:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3462.268158 secs 2024-07-26T09:33:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:22 smithi043 ceph-mon[32384]: pgmap v2408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:22 smithi133 ceph-mon[37053]: pgmap v2408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:22 smithi063 ceph-mon[36747]: pgmap v2408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:24 smithi043 ceph-mon[32384]: pgmap v2409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:24 smithi133 ceph-mon[37053]: pgmap v2409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:24 smithi063 ceph-mon[36747]: pgmap v2409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3451.784736 secs 2024-07-26T09:33:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3451.784736 secs 2024-07-26T09:33:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3451.784736 secs 2024-07-26T09:33:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3467.268256 secs 2024-07-26T09:33:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:26 smithi043 ceph-mon[32384]: pgmap v2410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3467.268256 secs 2024-07-26T09:33:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:26 smithi133 ceph-mon[37053]: pgmap v2410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3467.268256 secs 2024-07-26T09:33:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:26 smithi063 ceph-mon[36747]: pgmap v2410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:28 smithi043 ceph-mon[32384]: pgmap v2411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:28 smithi133 ceph-mon[37053]: pgmap v2411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:28 smithi063 ceph-mon[36747]: pgmap v2411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:30 smithi043 ceph-mon[32384]: pgmap v2412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3456.784858 secs 2024-07-26T09:33:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:30 smithi133 ceph-mon[37053]: pgmap v2412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3456.784858 secs 2024-07-26T09:33:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:30 smithi063 ceph-mon[36747]: pgmap v2412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3456.784858 secs 2024-07-26T09:33:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3472.268380 secs 2024-07-26T09:33:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3472.268380 secs 2024-07-26T09:33:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3472.268380 secs 2024-07-26T09:33:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:32 smithi043 ceph-mon[32384]: pgmap v2413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:32 smithi133 ceph-mon[37053]: pgmap v2413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:32 smithi063 ceph-mon[36747]: pgmap v2413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:34 smithi043 ceph-mon[32384]: pgmap v2414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:34 smithi133 ceph-mon[37053]: pgmap v2414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:34 smithi063 ceph-mon[36747]: pgmap v2414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3461.784972 secs 2024-07-26T09:33:36.237 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3461.784972 secs 2024-07-26T09:33:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3461.784972 secs 2024-07-26T09:33:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3477.268500 secs 2024-07-26T09:33:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:36 smithi043 ceph-mon[32384]: pgmap v2415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3477.268500 secs 2024-07-26T09:33:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:36 smithi133 ceph-mon[37053]: pgmap v2415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3477.268500 secs 2024-07-26T09:33:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:36 smithi063 ceph-mon[36747]: pgmap v2415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:38 smithi043 ceph-mon[32384]: pgmap v2416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:38 smithi133 ceph-mon[37053]: pgmap v2416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:38 smithi063 ceph-mon[36747]: pgmap v2416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:33:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:33:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:33:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:40 smithi133 ceph-mon[37053]: pgmap v2417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3466.785063 secs 2024-07-26T09:33:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:33:41.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:33:41.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:33:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:40 smithi063 ceph-mon[36747]: pgmap v2417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3466.785063 secs 2024-07-26T09:33:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:33:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:33:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:33:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:40 smithi043 ceph-mon[32384]: pgmap v2417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3466.785063 secs 2024-07-26T09:33:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:33:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:33:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:33:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3482.268643 secs 2024-07-26T09:33:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:42 smithi133 ceph-mon[37053]: pgmap v2418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3482.268643 secs 2024-07-26T09:33:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:42 smithi063 ceph-mon[36747]: pgmap v2418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:42.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3482.268643 secs 2024-07-26T09:33:42.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:42 smithi043 ceph-mon[32384]: pgmap v2418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:44 smithi133 ceph-mon[37053]: pgmap v2419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:44 smithi063 ceph-mon[36747]: pgmap v2419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:44 smithi043 ceph-mon[32384]: pgmap v2419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:46 smithi133 ceph-mon[37053]: pgmap v2420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:33:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3471.785165 secs 2024-07-26T09:33:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:46 smithi063 ceph-mon[36747]: pgmap v2420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:33:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3471.785165 secs 2024-07-26T09:33:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:46 smithi043 ceph-mon[32384]: pgmap v2420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:33:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3471.785165 secs 2024-07-26T09:33:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3487.268758 secs 2024-07-26T09:33:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3487.268758 secs 2024-07-26T09:33:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3487.268758 secs 2024-07-26T09:33:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:48 smithi063 ceph-mon[36747]: pgmap v2421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:33:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:48 smithi043 ceph-mon[32384]: pgmap v2421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:33:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:48 smithi133 ceph-mon[37053]: pgmap v2421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:33:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:50 smithi063 ceph-mon[36747]: pgmap v2422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:33:50.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:50 smithi043 ceph-mon[32384]: pgmap v2422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:33:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:50 smithi133 ceph-mon[37053]: pgmap v2422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:33:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3476.785280 secs 2024-07-26T09:33:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3492.268935 secs 2024-07-26T09:33:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3476.785280 secs 2024-07-26T09:33:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3492.268935 secs 2024-07-26T09:33:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3476.785280 secs 2024-07-26T09:33:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3492.268935 secs 2024-07-26T09:33:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:52 smithi063 ceph-mon[36747]: pgmap v2423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:52 smithi043 ceph-mon[32384]: pgmap v2423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:52 smithi133 ceph-mon[37053]: pgmap v2423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:33:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:54 smithi063 ceph-mon[36747]: pgmap v2424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:54 smithi043 ceph-mon[32384]: pgmap v2424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:54 smithi133 ceph-mon[37053]: pgmap v2424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:33:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:56 smithi063 ceph-mon[36747]: pgmap v2425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3481.785421 secs 2024-07-26T09:33:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3497.269047 secs 2024-07-26T09:33:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:56 smithi043 ceph-mon[32384]: pgmap v2425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3481.785421 secs 2024-07-26T09:33:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3497.269047 secs 2024-07-26T09:33:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:56 smithi133 ceph-mon[37053]: pgmap v2425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:33:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3481.785421 secs 2024-07-26T09:33:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3497.269047 secs 2024-07-26T09:33:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:33:58 smithi063 ceph-mon[36747]: pgmap v2426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:33:58 smithi043 ceph-mon[32384]: pgmap v2426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:33:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:33:58 smithi133 ceph-mon[37053]: pgmap v2426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:00 smithi043 ceph-mon[32384]: pgmap v2427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:00 smithi133 ceph-mon[37053]: pgmap v2427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:00 smithi063 ceph-mon[36747]: pgmap v2427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:01.387 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3486.785505 secs 2024-07-26T09:34:01.387 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3502.269112 secs 2024-07-26T09:34:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3486.785505 secs 2024-07-26T09:34:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3502.269112 secs 2024-07-26T09:34:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3486.785505 secs 2024-07-26T09:34:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3502.269112 secs 2024-07-26T09:34:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:02 smithi043 ceph-mon[32384]: pgmap v2428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:02 smithi133 ceph-mon[37053]: pgmap v2428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:02.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:02 smithi063 ceph-mon[36747]: pgmap v2428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:04 smithi043 ceph-mon[32384]: pgmap v2429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:04 smithi133 ceph-mon[37053]: pgmap v2429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:04 smithi063 ceph-mon[36747]: pgmap v2429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:06 smithi063 ceph-mon[36747]: pgmap v2430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3491.785590 secs 2024-07-26T09:34:06.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3507.269238 secs 2024-07-26T09:34:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:06 smithi043 ceph-mon[32384]: pgmap v2430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3491.785590 secs 2024-07-26T09:34:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3507.269238 secs 2024-07-26T09:34:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:06 smithi133 ceph-mon[37053]: pgmap v2430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3491.785590 secs 2024-07-26T09:34:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3507.269238 secs 2024-07-26T09:34:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:07 smithi063 ceph-mon[36747]: pgmap v2431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:07 smithi043 ceph-mon[32384]: pgmap v2431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:07 smithi133 ceph-mon[37053]: pgmap v2431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:10 smithi063 ceph-mon[36747]: pgmap v2432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:10 smithi043 ceph-mon[32384]: pgmap v2432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:10 smithi133 ceph-mon[37053]: pgmap v2432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3496.785713 secs 2024-07-26T09:34:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3512.269382 secs 2024-07-26T09:34:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3496.785713 secs 2024-07-26T09:34:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3512.269382 secs 2024-07-26T09:34:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3496.785713 secs 2024-07-26T09:34:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3512.269382 secs 2024-07-26T09:34:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:12 smithi063 ceph-mon[36747]: pgmap v2433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:12 smithi043 ceph-mon[32384]: pgmap v2433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:12 smithi133 ceph-mon[37053]: pgmap v2433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:14 smithi043 ceph-mon[32384]: pgmap v2434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:14 smithi133 ceph-mon[37053]: pgmap v2434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:14 smithi063 ceph-mon[36747]: pgmap v2434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:16 smithi043 ceph-mon[32384]: pgmap v2435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3501.785834 secs 2024-07-26T09:34:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3517.269456 secs 2024-07-26T09:34:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:16 smithi133 ceph-mon[37053]: pgmap v2435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3501.785834 secs 2024-07-26T09:34:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3517.269456 secs 2024-07-26T09:34:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:16 smithi063 ceph-mon[36747]: pgmap v2435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3501.785834 secs 2024-07-26T09:34:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3517.269456 secs 2024-07-26T09:34:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:18 smithi043 ceph-mon[32384]: pgmap v2436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:18 smithi133 ceph-mon[37053]: pgmap v2436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:18 smithi063 ceph-mon[36747]: pgmap v2436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:20 smithi043 ceph-mon[32384]: pgmap v2437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:20 smithi133 ceph-mon[37053]: pgmap v2437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:20 smithi063 ceph-mon[36747]: pgmap v2437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3506.785952 secs 2024-07-26T09:34:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3522.269597 secs 2024-07-26T09:34:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3506.785952 secs 2024-07-26T09:34:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3522.269597 secs 2024-07-26T09:34:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3506.785952 secs 2024-07-26T09:34:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3522.269597 secs 2024-07-26T09:34:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:22 smithi043 ceph-mon[32384]: pgmap v2438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:22 smithi133 ceph-mon[37053]: pgmap v2438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:22.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:22 smithi063 ceph-mon[36747]: pgmap v2438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:24 smithi043 ceph-mon[32384]: pgmap v2439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:24 smithi133 ceph-mon[37053]: pgmap v2439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:24 smithi063 ceph-mon[36747]: pgmap v2439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:26 smithi043 ceph-mon[32384]: pgmap v2440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3511.786075 secs 2024-07-26T09:34:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3527.269736 secs 2024-07-26T09:34:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:26 smithi133 ceph-mon[37053]: pgmap v2440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:26.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3511.786075 secs 2024-07-26T09:34:26.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3527.269736 secs 2024-07-26T09:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:26 smithi063 ceph-mon[36747]: pgmap v2440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3511.786075 secs 2024-07-26T09:34:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3527.269736 secs 2024-07-26T09:34:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:28 smithi043 ceph-mon[32384]: pgmap v2441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:28 smithi133 ceph-mon[37053]: pgmap v2441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:28 smithi063 ceph-mon[36747]: pgmap v2441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:30 smithi043 ceph-mon[32384]: pgmap v2442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:30 smithi133 ceph-mon[37053]: pgmap v2442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:30 smithi063 ceph-mon[36747]: pgmap v2442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3516.786145 secs 2024-07-26T09:34:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3532.269909 secs 2024-07-26T09:34:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3516.786145 secs 2024-07-26T09:34:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3532.269909 secs 2024-07-26T09:34:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3516.786145 secs 2024-07-26T09:34:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3532.269909 secs 2024-07-26T09:34:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:32 smithi043 ceph-mon[32384]: pgmap v2443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:32 smithi133 ceph-mon[37053]: pgmap v2443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:32 smithi063 ceph-mon[36747]: pgmap v2443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:34 smithi043 ceph-mon[32384]: pgmap v2444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:34 smithi133 ceph-mon[37053]: pgmap v2444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:34 smithi063 ceph-mon[36747]: pgmap v2444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:36 smithi043 ceph-mon[32384]: pgmap v2445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3521.786209 secs 2024-07-26T09:34:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3537.269978 secs 2024-07-26T09:34:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:36 smithi133 ceph-mon[37053]: pgmap v2445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3521.786209 secs 2024-07-26T09:34:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3537.269978 secs 2024-07-26T09:34:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:36 smithi063 ceph-mon[36747]: pgmap v2445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:34:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3521.786209 secs 2024-07-26T09:34:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3537.269978 secs 2024-07-26T09:34:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:38 smithi043 ceph-mon[32384]: pgmap v2446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:38 smithi133 ceph-mon[37053]: pgmap v2446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:38 smithi063 ceph-mon[36747]: pgmap v2446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:40 smithi043 ceph-mon[32384]: pgmap v2447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:40 smithi133 ceph-mon[37053]: pgmap v2447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:40 smithi063 ceph-mon[36747]: pgmap v2447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3526.786281 secs 2024-07-26T09:34:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3542.270061 secs 2024-07-26T09:34:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3526.786281 secs 2024-07-26T09:34:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3542.270061 secs 2024-07-26T09:34:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3526.786281 secs 2024-07-26T09:34:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3542.270061 secs 2024-07-26T09:34:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:42 smithi043 ceph-mon[32384]: pgmap v2448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:34:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:42 smithi133 ceph-mon[37053]: pgmap v2448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:34:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:42 smithi063 ceph-mon[36747]: pgmap v2448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:34:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:34:43.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:34:43.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:43 smithi043 ceph-mon[32384]: pgmap v2449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:34:43.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:43 smithi043 ceph-mon[32384]: pgmap v2450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:34:43.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:34:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:34:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:34:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:43 smithi133 ceph-mon[37053]: pgmap v2449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:34:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:43 smithi133 ceph-mon[37053]: pgmap v2450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:34:43.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:34:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:34:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:34:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:43 smithi063 ceph-mon[36747]: pgmap v2449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:34:43.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:43 smithi063 ceph-mon[36747]: pgmap v2450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:34:43.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:34:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:44 smithi043 ceph-mon[32384]: pgmap v2451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:34:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:44 smithi133 ceph-mon[37053]: pgmap v2451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:34:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:44 smithi063 ceph-mon[36747]: pgmap v2451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:34:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3531.786348 secs 2024-07-26T09:34:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3531.786348 secs 2024-07-26T09:34:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3531.786348 secs 2024-07-26T09:34:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3547.270185 secs 2024-07-26T09:34:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:46 smithi043 ceph-mon[32384]: pgmap v2452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:34:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3547.270185 secs 2024-07-26T09:34:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:46 smithi133 ceph-mon[37053]: pgmap v2452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:34:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3547.270185 secs 2024-07-26T09:34:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:46 smithi063 ceph-mon[36747]: pgmap v2452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:34:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:48 smithi043 ceph-mon[32384]: pgmap v2453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:34:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:48 smithi133 ceph-mon[37053]: pgmap v2453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:34:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:48 smithi063 ceph-mon[36747]: pgmap v2453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:34:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:50 smithi043 ceph-mon[32384]: pgmap v2454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:34:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:50 smithi133 ceph-mon[37053]: pgmap v2454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:34:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:50 smithi063 ceph-mon[36747]: pgmap v2454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:34:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3536.786471 secs 2024-07-26T09:34:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3552.270303 secs 2024-07-26T09:34:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3536.786471 secs 2024-07-26T09:34:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3552.270303 secs 2024-07-26T09:34:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3536.786471 secs 2024-07-26T09:34:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3552.270303 secs 2024-07-26T09:34:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:52 smithi043 ceph-mon[32384]: pgmap v2455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:34:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:52 smithi133 ceph-mon[37053]: pgmap v2455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:34:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:52 smithi063 ceph-mon[36747]: pgmap v2455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:34:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:54 smithi043 ceph-mon[32384]: pgmap v2456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:54 smithi133 ceph-mon[37053]: pgmap v2456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:54 smithi063 ceph-mon[36747]: pgmap v2456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3541.786587 secs 2024-07-26T09:34:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3541.786587 secs 2024-07-26T09:34:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3541.786587 secs 2024-07-26T09:34:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3557.270423 secs 2024-07-26T09:34:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:56 smithi043 ceph-mon[32384]: pgmap v2457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3557.270423 secs 2024-07-26T09:34:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:56 smithi133 ceph-mon[37053]: pgmap v2457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3557.270423 secs 2024-07-26T09:34:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:56 smithi063 ceph-mon[36747]: pgmap v2457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:34:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:34:58 smithi043 ceph-mon[32384]: pgmap v2458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:34:58 smithi133 ceph-mon[37053]: pgmap v2458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:34:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:34:58 smithi063 ceph-mon[36747]: pgmap v2458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:00 smithi043 ceph-mon[32384]: pgmap v2459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:00 smithi133 ceph-mon[37053]: pgmap v2459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:00 smithi063 ceph-mon[36747]: pgmap v2459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3546.786712 secs 2024-07-26T09:35:01.642 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3562.270537 secs 2024-07-26T09:35:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3546.786712 secs 2024-07-26T09:35:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3562.270537 secs 2024-07-26T09:35:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3546.786712 secs 2024-07-26T09:35:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3562.270537 secs 2024-07-26T09:35:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:02 smithi043 ceph-mon[32384]: pgmap v2460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:02 smithi133 ceph-mon[37053]: pgmap v2460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:02 smithi063 ceph-mon[36747]: pgmap v2460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:04 smithi043 ceph-mon[32384]: pgmap v2461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:04 smithi133 ceph-mon[37053]: pgmap v2461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:04 smithi063 ceph-mon[36747]: pgmap v2461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3551.786848 secs 2024-07-26T09:35:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3551.786848 secs 2024-07-26T09:35:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3551.786848 secs 2024-07-26T09:35:06.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3567.270600 secs 2024-07-26T09:35:06.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:06 smithi063 ceph-mon[36747]: pgmap v2462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3567.270600 secs 2024-07-26T09:35:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:06 smithi043 ceph-mon[32384]: pgmap v2462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3567.270600 secs 2024-07-26T09:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:06 smithi133 ceph-mon[37053]: pgmap v2462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:08 smithi043 ceph-mon[32384]: pgmap v2463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:08 smithi133 ceph-mon[37053]: pgmap v2463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:08 smithi063 ceph-mon[36747]: pgmap v2463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:10 smithi043 ceph-mon[32384]: pgmap v2464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:10 smithi133 ceph-mon[37053]: pgmap v2464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:10 smithi063 ceph-mon[36747]: pgmap v2464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3556.786936 secs 2024-07-26T09:35:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3572.270721 secs 2024-07-26T09:35:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3556.786936 secs 2024-07-26T09:35:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3572.270721 secs 2024-07-26T09:35:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3556.786936 secs 2024-07-26T09:35:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3572.270721 secs 2024-07-26T09:35:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:12 smithi043 ceph-mon[32384]: pgmap v2465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:12 smithi133 ceph-mon[37053]: pgmap v2465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:12 smithi063 ceph-mon[36747]: pgmap v2465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:14 smithi043 ceph-mon[32384]: pgmap v2466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:14 smithi133 ceph-mon[37053]: pgmap v2466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:14 smithi063 ceph-mon[36747]: pgmap v2466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3561.787071 secs 2024-07-26T09:35:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3561.787071 secs 2024-07-26T09:35:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3561.787071 secs 2024-07-26T09:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3577.270846 secs 2024-07-26T09:35:17.127 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:16 smithi043 ceph-mon[32384]: pgmap v2467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:17.128 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3577.270846 secs 2024-07-26T09:35:17.128 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:16 smithi063 ceph-mon[36747]: pgmap v2467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:17.128 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3577.270846 secs 2024-07-26T09:35:17.129 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:16 smithi133 ceph-mon[37053]: pgmap v2467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:18 smithi043 ceph-mon[32384]: pgmap v2468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:18 smithi133 ceph-mon[37053]: pgmap v2468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:18 smithi063 ceph-mon[36747]: pgmap v2468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:20 smithi043 ceph-mon[32384]: pgmap v2469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:20 smithi133 ceph-mon[37053]: pgmap v2469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:20 smithi063 ceph-mon[36747]: pgmap v2469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3566.787198 secs 2024-07-26T09:35:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3582.270968 secs 2024-07-26T09:35:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3566.787198 secs 2024-07-26T09:35:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3582.270968 secs 2024-07-26T09:35:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3566.787198 secs 2024-07-26T09:35:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3582.270968 secs 2024-07-26T09:35:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:22 smithi043 ceph-mon[32384]: pgmap v2470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:22 smithi133 ceph-mon[37053]: pgmap v2470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:22 smithi063 ceph-mon[36747]: pgmap v2470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:24 smithi043 ceph-mon[32384]: pgmap v2471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:24 smithi133 ceph-mon[37053]: pgmap v2471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:24 smithi063 ceph-mon[36747]: pgmap v2471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3571.787282 secs 2024-07-26T09:35:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3571.787282 secs 2024-07-26T09:35:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3571.787282 secs 2024-07-26T09:35:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3587.271088 secs 2024-07-26T09:35:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:26 smithi043 ceph-mon[32384]: pgmap v2472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3587.271088 secs 2024-07-26T09:35:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:26 smithi133 ceph-mon[37053]: pgmap v2472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3587.271088 secs 2024-07-26T09:35:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:26 smithi063 ceph-mon[36747]: pgmap v2472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:28 smithi043 ceph-mon[32384]: pgmap v2473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:28 smithi133 ceph-mon[37053]: pgmap v2473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:28 smithi063 ceph-mon[36747]: pgmap v2473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:30 smithi043 ceph-mon[32384]: pgmap v2474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:30 smithi133 ceph-mon[37053]: pgmap v2474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:30 smithi063 ceph-mon[36747]: pgmap v2474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3576.787414 secs 2024-07-26T09:35:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3592.271207 secs 2024-07-26T09:35:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3576.787414 secs 2024-07-26T09:35:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3592.271207 secs 2024-07-26T09:35:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3576.787414 secs 2024-07-26T09:35:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3592.271207 secs 2024-07-26T09:35:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:32 smithi043 ceph-mon[32384]: pgmap v2475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:32 smithi133 ceph-mon[37053]: pgmap v2475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:32 smithi063 ceph-mon[36747]: pgmap v2475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:34 smithi043 ceph-mon[32384]: pgmap v2476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:34 smithi133 ceph-mon[37053]: pgmap v2476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:34 smithi063 ceph-mon[36747]: pgmap v2476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3581.787524 secs 2024-07-26T09:35:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3581.787524 secs 2024-07-26T09:35:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3581.787524 secs 2024-07-26T09:35:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3597.271325 secs 2024-07-26T09:35:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:36 smithi043 ceph-mon[32384]: pgmap v2477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3597.271325 secs 2024-07-26T09:35:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:36 smithi133 ceph-mon[37053]: pgmap v2477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3597.271325 secs 2024-07-26T09:35:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:36 smithi063 ceph-mon[36747]: pgmap v2477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:38 smithi043 ceph-mon[32384]: pgmap v2478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:38 smithi133 ceph-mon[37053]: pgmap v2478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:38 smithi063 ceph-mon[36747]: pgmap v2478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:40 smithi043 ceph-mon[32384]: pgmap v2479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:40 smithi133 ceph-mon[37053]: pgmap v2479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:40 smithi063 ceph-mon[36747]: pgmap v2479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3586.787646 secs 2024-07-26T09:35:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3602.271451 secs 2024-07-26T09:35:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3586.787646 secs 2024-07-26T09:35:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3602.271451 secs 2024-07-26T09:35:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3586.787646 secs 2024-07-26T09:35:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3602.271451 secs 2024-07-26T09:35:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:42 smithi043 ceph-mon[32384]: pgmap v2480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:42 smithi133 ceph-mon[37053]: pgmap v2480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:42 smithi063 ceph-mon[36747]: pgmap v2480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:35:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:35:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:35:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:35:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:35:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:35:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:44 smithi043 ceph-mon[32384]: pgmap v2481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:44 smithi043 ceph-mon[32384]: pgmap v2482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:44.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:35:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:35:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:35:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:44 smithi133 ceph-mon[37053]: pgmap v2481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:44.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:44 smithi133 ceph-mon[37053]: pgmap v2482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:44.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:35:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:35:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:35:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:44 smithi063 ceph-mon[36747]: pgmap v2481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:44 smithi063 ceph-mon[36747]: pgmap v2482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:44.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:35:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3591.787747 secs 2024-07-26T09:35:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:46 smithi063 ceph-mon[36747]: pgmap v2483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:35:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3607.271513 secs 2024-07-26T09:35:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3591.787747 secs 2024-07-26T09:35:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:46 smithi043 ceph-mon[32384]: pgmap v2483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:35:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3607.271513 secs 2024-07-26T09:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3591.787747 secs 2024-07-26T09:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:46 smithi133 ceph-mon[37053]: pgmap v2483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3607.271513 secs 2024-07-26T09:35:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:48 smithi063 ceph-mon[36747]: pgmap v2484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:35:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:48 smithi043 ceph-mon[32384]: pgmap v2484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:35:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:48 smithi133 ceph-mon[37053]: pgmap v2484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:35:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:50 smithi063 ceph-mon[36747]: pgmap v2485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:50 smithi043 ceph-mon[32384]: pgmap v2485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:50 smithi133 ceph-mon[37053]: pgmap v2485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3596.787862 secs 2024-07-26T09:35:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3612.271634 secs 2024-07-26T09:35:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3596.787862 secs 2024-07-26T09:35:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3612.271634 secs 2024-07-26T09:35:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3596.787862 secs 2024-07-26T09:35:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3612.271634 secs 2024-07-26T09:35:52.987 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:52 smithi043 ceph-mon[32384]: pgmap v2486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:52 smithi133 ceph-mon[37053]: pgmap v2486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:52 smithi063 ceph-mon[36747]: pgmap v2486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:35:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:54 smithi043 ceph-mon[32384]: pgmap v2487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:35:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:54 smithi133 ceph-mon[37053]: pgmap v2487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:35:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:54 smithi063 ceph-mon[36747]: pgmap v2487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:35:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3601.788002 secs 2024-07-26T09:35:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:56 smithi043 ceph-mon[32384]: pgmap v2488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3617.271734 secs 2024-07-26T09:35:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3601.788002 secs 2024-07-26T09:35:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:56 smithi133 ceph-mon[37053]: pgmap v2488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3617.271734 secs 2024-07-26T09:35:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3601.788002 secs 2024-07-26T09:35:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:56 smithi063 ceph-mon[36747]: pgmap v2488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:35:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3617.271734 secs 2024-07-26T09:35:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:35:58 smithi043 ceph-mon[32384]: pgmap v2489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:35:58 smithi133 ceph-mon[37053]: pgmap v2489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:35:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:35:58 smithi063 ceph-mon[36747]: pgmap v2489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:00 smithi043 ceph-mon[32384]: pgmap v2490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:00 smithi133 ceph-mon[37053]: pgmap v2490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:00 smithi063 ceph-mon[36747]: pgmap v2490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3606.788140 secs 2024-07-26T09:36:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3622.271875 secs 2024-07-26T09:36:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3606.788140 secs 2024-07-26T09:36:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3622.271875 secs 2024-07-26T09:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3606.788140 secs 2024-07-26T09:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3622.271875 secs 2024-07-26T09:36:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:02 smithi043 ceph-mon[32384]: pgmap v2491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:02 smithi133 ceph-mon[37053]: pgmap v2491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:03.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:02 smithi063 ceph-mon[36747]: pgmap v2491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:04 smithi043 ceph-mon[32384]: pgmap v2492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:04 smithi133 ceph-mon[37053]: pgmap v2492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:04 smithi063 ceph-mon[36747]: pgmap v2492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3611.788203 secs 2024-07-26T09:36:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:06 smithi043 ceph-mon[32384]: pgmap v2493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3627.271975 secs 2024-07-26T09:36:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3611.788203 secs 2024-07-26T09:36:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:06 smithi133 ceph-mon[37053]: pgmap v2493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3627.271975 secs 2024-07-26T09:36:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3611.788203 secs 2024-07-26T09:36:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:06 smithi063 ceph-mon[36747]: pgmap v2493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3627.271975 secs 2024-07-26T09:36:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:08 smithi043 ceph-mon[32384]: pgmap v2494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:08 smithi133 ceph-mon[37053]: pgmap v2494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:08 smithi063 ceph-mon[36747]: pgmap v2494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:10 smithi043 ceph-mon[32384]: pgmap v2495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:10 smithi133 ceph-mon[37053]: pgmap v2495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:10 smithi063 ceph-mon[36747]: pgmap v2495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3616.788308 secs 2024-07-26T09:36:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3632.272058 secs 2024-07-26T09:36:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3616.788308 secs 2024-07-26T09:36:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3632.272058 secs 2024-07-26T09:36:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3616.788308 secs 2024-07-26T09:36:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3632.272058 secs 2024-07-26T09:36:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:12 smithi043 ceph-mon[32384]: pgmap v2496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:12 smithi133 ceph-mon[37053]: pgmap v2496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:12 smithi063 ceph-mon[36747]: pgmap v2496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:14 smithi043 ceph-mon[32384]: pgmap v2497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:14 smithi133 ceph-mon[37053]: pgmap v2497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:14 smithi063 ceph-mon[36747]: pgmap v2497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3621.788422 secs 2024-07-26T09:36:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:16 smithi043 ceph-mon[32384]: pgmap v2498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3637.272172 secs 2024-07-26T09:36:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3621.788422 secs 2024-07-26T09:36:17.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:16 smithi133 ceph-mon[37053]: pgmap v2498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:17.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3637.272172 secs 2024-07-26T09:36:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3621.788422 secs 2024-07-26T09:36:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:16 smithi063 ceph-mon[36747]: pgmap v2498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3637.272172 secs 2024-07-26T09:36:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:18 smithi043 ceph-mon[32384]: pgmap v2499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:18 smithi133 ceph-mon[37053]: pgmap v2499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:18 smithi063 ceph-mon[36747]: pgmap v2499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:20 smithi043 ceph-mon[32384]: pgmap v2500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3626.788551 secs 2024-07-26T09:36:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:20 smithi133 ceph-mon[37053]: pgmap v2500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3626.788551 secs 2024-07-26T09:36:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:20 smithi063 ceph-mon[36747]: pgmap v2500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3626.788551 secs 2024-07-26T09:36:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3642.272292 secs 2024-07-26T09:36:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3642.272292 secs 2024-07-26T09:36:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3642.272292 secs 2024-07-26T09:36:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:22 smithi043 ceph-mon[32384]: pgmap v2501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:22 smithi133 ceph-mon[37053]: pgmap v2501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:22 smithi063 ceph-mon[36747]: pgmap v2501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:24 smithi043 ceph-mon[32384]: pgmap v2502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:24 smithi133 ceph-mon[37053]: pgmap v2502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:24 smithi063 ceph-mon[36747]: pgmap v2502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3631.788691 secs 2024-07-26T09:36:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3631.788691 secs 2024-07-26T09:36:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3631.788691 secs 2024-07-26T09:36:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:26 smithi043 ceph-mon[32384]: pgmap v2503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3647.272357 secs 2024-07-26T09:36:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:26 smithi133 ceph-mon[37053]: pgmap v2503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3647.272357 secs 2024-07-26T09:36:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:26 smithi063 ceph-mon[36747]: pgmap v2503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3647.272357 secs 2024-07-26T09:36:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:28 smithi043 ceph-mon[32384]: pgmap v2504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:28 smithi133 ceph-mon[37053]: pgmap v2504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:28 smithi063 ceph-mon[36747]: pgmap v2504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:30 smithi043 ceph-mon[32384]: pgmap v2505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:30.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3636.788794 secs 2024-07-26T09:36:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:30 smithi133 ceph-mon[37053]: pgmap v2505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3636.788794 secs 2024-07-26T09:36:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:30 smithi063 ceph-mon[36747]: pgmap v2505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3636.788794 secs 2024-07-26T09:36:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3652.272478 secs 2024-07-26T09:36:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3652.272478 secs 2024-07-26T09:36:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3652.272478 secs 2024-07-26T09:36:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:32 smithi133 ceph-mon[37053]: pgmap v2506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:33.019 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:32 smithi043 ceph-mon[32384]: pgmap v2506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:32 smithi063 ceph-mon[36747]: pgmap v2506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:34 smithi133 ceph-mon[37053]: pgmap v2507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:34 smithi063 ceph-mon[36747]: pgmap v2507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:34 smithi043 ceph-mon[32384]: pgmap v2507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3641.788933 secs 2024-07-26T09:36:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3641.788933 secs 2024-07-26T09:36:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3641.788933 secs 2024-07-26T09:36:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:36 smithi133 ceph-mon[37053]: pgmap v2508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3657.272576 secs 2024-07-26T09:36:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:36 smithi063 ceph-mon[36747]: pgmap v2508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3657.272576 secs 2024-07-26T09:36:37.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:36 smithi043 ceph-mon[32384]: pgmap v2508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:36:37.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3657.272576 secs 2024-07-26T09:36:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:38 smithi133 ceph-mon[37053]: pgmap v2509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:39.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:38 smithi063 ceph-mon[36747]: pgmap v2509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:38 smithi043 ceph-mon[32384]: pgmap v2509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:40 smithi063 ceph-mon[36747]: pgmap v2510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3646.789075 secs 2024-07-26T09:36:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:40 smithi043 ceph-mon[32384]: pgmap v2510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3646.789075 secs 2024-07-26T09:36:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:40 smithi133 ceph-mon[37053]: pgmap v2510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3646.789075 secs 2024-07-26T09:36:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3662.272718 secs 2024-07-26T09:36:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3662.272718 secs 2024-07-26T09:36:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3662.272718 secs 2024-07-26T09:36:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:42 smithi063 ceph-mon[36747]: pgmap v2511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:42 smithi043 ceph-mon[32384]: pgmap v2511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:42 smithi133 ceph-mon[37053]: pgmap v2511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:36:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:36:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:36:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:44 smithi063 ceph-mon[36747]: pgmap v2512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:45.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:36:45.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:36:45.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:36:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:44 smithi043 ceph-mon[32384]: pgmap v2512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:36:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:36:45.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:36:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:44 smithi133 ceph-mon[37053]: pgmap v2512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:36:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:36:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:36:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:36:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:45 smithi063 ceph-mon[36747]: pgmap v2513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:36:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:45 smithi063 ceph-mon[36747]: pgmap v2514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3651.789222 secs 2024-07-26T09:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:45 smithi043 ceph-mon[32384]: pgmap v2513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:45 smithi043 ceph-mon[32384]: pgmap v2514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3651.789222 secs 2024-07-26T09:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:45 smithi133 ceph-mon[37053]: pgmap v2513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:45 smithi133 ceph-mon[37053]: pgmap v2514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3651.789222 secs 2024-07-26T09:36:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3667.272833 secs 2024-07-26T09:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3667.272833 secs 2024-07-26T09:36:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3667.272833 secs 2024-07-26T09:36:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:47 smithi043 ceph-mon[32384]: pgmap v2515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:36:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:47 smithi133 ceph-mon[37053]: pgmap v2515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:36:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:47 smithi063 ceph-mon[36747]: pgmap v2515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:36:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:49 smithi043 ceph-mon[32384]: pgmap v2516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:49 smithi133 ceph-mon[37053]: pgmap v2516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:49 smithi063 ceph-mon[36747]: pgmap v2516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3656.789342 secs 2024-07-26T09:36:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3656.789342 secs 2024-07-26T09:36:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3656.789342 secs 2024-07-26T09:36:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3672.272934 secs 2024-07-26T09:36:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:51 smithi043 ceph-mon[32384]: pgmap v2517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3672.272934 secs 2024-07-26T09:36:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:51 smithi133 ceph-mon[37053]: pgmap v2517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3672.272934 secs 2024-07-26T09:36:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:51 smithi063 ceph-mon[36747]: pgmap v2517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:36:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:53 smithi043 ceph-mon[32384]: pgmap v2518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:36:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:53 smithi133 ceph-mon[37053]: pgmap v2518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:36:54.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:53 smithi063 ceph-mon[36747]: pgmap v2518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:36:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:55 smithi043 ceph-mon[32384]: pgmap v2519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:36:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3661.789463 secs 2024-07-26T09:36:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:55 smithi133 ceph-mon[37053]: pgmap v2519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:36:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3661.789463 secs 2024-07-26T09:36:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:55 smithi063 ceph-mon[36747]: pgmap v2519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:36:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3661.789463 secs 2024-07-26T09:36:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3677.273019 secs 2024-07-26T09:36:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3677.273019 secs 2024-07-26T09:36:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3677.273019 secs 2024-07-26T09:36:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:57 smithi043 ceph-mon[32384]: pgmap v2520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:57 smithi133 ceph-mon[37053]: pgmap v2520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:36:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:57 smithi063 ceph-mon[36747]: pgmap v2520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:36:59 smithi043 ceph-mon[32384]: pgmap v2521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:36:59 smithi133 ceph-mon[37053]: pgmap v2521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:36:59 smithi063 ceph-mon[36747]: pgmap v2521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3666.789588 secs 2024-07-26T09:37:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3666.789588 secs 2024-07-26T09:37:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3666.789588 secs 2024-07-26T09:37:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3682.273135 secs 2024-07-26T09:37:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:01 smithi043 ceph-mon[32384]: pgmap v2522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3682.273135 secs 2024-07-26T09:37:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:01 smithi133 ceph-mon[37053]: pgmap v2522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3682.273135 secs 2024-07-26T09:37:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:01 smithi063 ceph-mon[36747]: pgmap v2522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:03 smithi043 ceph-mon[32384]: pgmap v2523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:03 smithi133 ceph-mon[37053]: pgmap v2523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:03 smithi063 ceph-mon[36747]: pgmap v2523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:05 smithi043 ceph-mon[32384]: pgmap v2524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3671.789712 secs 2024-07-26T09:37:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:05 smithi133 ceph-mon[37053]: pgmap v2524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3671.789712 secs 2024-07-26T09:37:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:05 smithi063 ceph-mon[36747]: pgmap v2524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3671.789712 secs 2024-07-26T09:37:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3687.273207 secs 2024-07-26T09:37:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3687.273207 secs 2024-07-26T09:37:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3687.273207 secs 2024-07-26T09:37:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:07 smithi043 ceph-mon[32384]: pgmap v2525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:07 smithi133 ceph-mon[37053]: pgmap v2525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:07 smithi063 ceph-mon[36747]: pgmap v2525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:09 smithi043 ceph-mon[32384]: pgmap v2526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:09 smithi133 ceph-mon[37053]: pgmap v2526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:09 smithi063 ceph-mon[36747]: pgmap v2526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3676.789815 secs 2024-07-26T09:37:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3676.789815 secs 2024-07-26T09:37:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3676.789815 secs 2024-07-26T09:37:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3692.273330 secs 2024-07-26T09:37:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:11 smithi043 ceph-mon[32384]: pgmap v2527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3692.273330 secs 2024-07-26T09:37:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:11 smithi133 ceph-mon[37053]: pgmap v2527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3692.273330 secs 2024-07-26T09:37:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:11 smithi063 ceph-mon[36747]: pgmap v2527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:13 smithi043 ceph-mon[32384]: pgmap v2528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:13 smithi133 ceph-mon[37053]: pgmap v2528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:13 smithi063 ceph-mon[36747]: pgmap v2528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:15 smithi043 ceph-mon[32384]: pgmap v2529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3681.789955 secs 2024-07-26T09:37:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:15 smithi133 ceph-mon[37053]: pgmap v2529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3681.789955 secs 2024-07-26T09:37:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:15 smithi063 ceph-mon[36747]: pgmap v2529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3681.789955 secs 2024-07-26T09:37:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3697.273392 secs 2024-07-26T09:37:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3697.273392 secs 2024-07-26T09:37:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3697.273392 secs 2024-07-26T09:37:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:17 smithi043 ceph-mon[32384]: pgmap v2530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:17 smithi133 ceph-mon[37053]: pgmap v2530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:17 smithi063 ceph-mon[36747]: pgmap v2530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:19 smithi043 ceph-mon[32384]: pgmap v2531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:19 smithi133 ceph-mon[37053]: pgmap v2531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:19 smithi063 ceph-mon[36747]: pgmap v2531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3686.790087 secs 2024-07-26T09:37:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3686.790087 secs 2024-07-26T09:37:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3686.790087 secs 2024-07-26T09:37:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3702.273517 secs 2024-07-26T09:37:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:21 smithi043 ceph-mon[32384]: pgmap v2532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3702.273517 secs 2024-07-26T09:37:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:21 smithi133 ceph-mon[37053]: pgmap v2532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3702.273517 secs 2024-07-26T09:37:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:21 smithi063 ceph-mon[36747]: pgmap v2532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:23 smithi043 ceph-mon[32384]: pgmap v2533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:23 smithi133 ceph-mon[37053]: pgmap v2533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:24.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:23 smithi063 ceph-mon[36747]: pgmap v2533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:25 smithi133 ceph-mon[37053]: pgmap v2534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3691.790213 secs 2024-07-26T09:37:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:25 smithi063 ceph-mon[36747]: pgmap v2534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3691.790213 secs 2024-07-26T09:37:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:25 smithi043 ceph-mon[32384]: pgmap v2534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3691.790213 secs 2024-07-26T09:37:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3707.273643 secs 2024-07-26T09:37:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3707.273643 secs 2024-07-26T09:37:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3707.273643 secs 2024-07-26T09:37:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:27 smithi133 ceph-mon[37053]: pgmap v2535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:27 smithi063 ceph-mon[36747]: pgmap v2535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:27 smithi043 ceph-mon[32384]: pgmap v2535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:30 smithi133 ceph-mon[37053]: pgmap v2536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:30 smithi063 ceph-mon[36747]: pgmap v2536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:30 smithi043 ceph-mon[32384]: pgmap v2536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3696.790339 secs 2024-07-26T09:37:31.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3696.790339 secs 2024-07-26T09:37:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3696.790339 secs 2024-07-26T09:37:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3712.273763 secs 2024-07-26T09:37:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:32 smithi063 ceph-mon[36747]: pgmap v2537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:32.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3712.273763 secs 2024-07-26T09:37:32.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:32 smithi043 ceph-mon[32384]: pgmap v2537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3712.273763 secs 2024-07-26T09:37:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:32 smithi133 ceph-mon[37053]: pgmap v2537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:34 smithi063 ceph-mon[36747]: pgmap v2538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:34 smithi043 ceph-mon[32384]: pgmap v2538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:34 smithi133 ceph-mon[37053]: pgmap v2538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:36 smithi063 ceph-mon[36747]: pgmap v2539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3701.790452 secs 2024-07-26T09:37:36.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:36 smithi133 ceph-mon[37053]: pgmap v2539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:36.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3701.790452 secs 2024-07-26T09:37:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:36 smithi043 ceph-mon[32384]: pgmap v2539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3701.790452 secs 2024-07-26T09:37:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3717.273924 secs 2024-07-26T09:37:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3717.273924 secs 2024-07-26T09:37:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3717.273924 secs 2024-07-26T09:37:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:38 smithi063 ceph-mon[36747]: pgmap v2540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:38 smithi043 ceph-mon[32384]: pgmap v2540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:38 smithi133 ceph-mon[37053]: pgmap v2540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:40 smithi063 ceph-mon[36747]: pgmap v2541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:40 smithi043 ceph-mon[32384]: pgmap v2541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:40 smithi133 ceph-mon[37053]: pgmap v2541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3706.790568 secs 2024-07-26T09:37:41.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3722.274029 secs 2024-07-26T09:37:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3706.790568 secs 2024-07-26T09:37:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3722.274029 secs 2024-07-26T09:37:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3706.790568 secs 2024-07-26T09:37:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3722.274029 secs 2024-07-26T09:37:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:42 smithi063 ceph-mon[36747]: pgmap v2542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:42 smithi043 ceph-mon[32384]: pgmap v2542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:42 smithi133 ceph-mon[37053]: pgmap v2542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:44 smithi043 ceph-mon[32384]: pgmap v2543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:44 smithi133 ceph-mon[37053]: pgmap v2543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:44 smithi063 ceph-mon[36747]: pgmap v2543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:37:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: pgmap v2544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3711.790662 secs 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3727.274107 secs 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:37:46.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:37:46.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:37:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: pgmap v2544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3711.790662 secs 2024-07-26T09:37:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3727.274107 secs 2024-07-26T09:37:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:37:46.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:37:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: pgmap v2544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3711.790662 secs 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3727.274107 secs 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:37:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:37:46.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:37:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:47 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:37:47.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:47 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:37:47.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:47 smithi043 ceph-mon[32384]: pgmap v2545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:47.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:47 smithi043 ceph-mon[32384]: pgmap v2546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:47 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:47 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:47 smithi133 ceph-mon[37053]: pgmap v2545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:47 smithi133 ceph-mon[37053]: pgmap v2546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:47 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:47 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:47 smithi063 ceph-mon[36747]: pgmap v2545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:47 smithi063 ceph-mon[36747]: pgmap v2546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:49 smithi043 ceph-mon[32384]: pgmap v2547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:49 smithi133 ceph-mon[37053]: pgmap v2547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:49 smithi063 ceph-mon[36747]: pgmap v2547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:37:51.356 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:51 smithi043 ceph-mon[32384]: pgmap v2548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:37:51.356 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3716.790806 secs 2024-07-26T09:37:51.356 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3732.274207 secs 2024-07-26T09:37:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:51 smithi133 ceph-mon[37053]: pgmap v2548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:37:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3716.790806 secs 2024-07-26T09:37:51.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3732.274207 secs 2024-07-26T09:37:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:51 smithi063 ceph-mon[36747]: pgmap v2548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:37:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3716.790806 secs 2024-07-26T09:37:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3732.274207 secs 2024-07-26T09:37:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:53 smithi043 ceph-mon[32384]: pgmap v2549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:37:53.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:53 smithi133 ceph-mon[37053]: pgmap v2549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:37:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:53 smithi063 ceph-mon[36747]: pgmap v2549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T09:37:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:55 smithi043 ceph-mon[32384]: pgmap v2550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:55 smithi133 ceph-mon[37053]: pgmap v2550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:55 smithi063 ceph-mon[36747]: pgmap v2550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:37:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3721.790926 secs 2024-07-26T09:37:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3737.274325 secs 2024-07-26T09:37:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3721.790926 secs 2024-07-26T09:37:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3737.274325 secs 2024-07-26T09:37:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3721.790926 secs 2024-07-26T09:37:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3737.274325 secs 2024-07-26T09:37:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:57 smithi043 ceph-mon[32384]: pgmap v2551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:37:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:57 smithi133 ceph-mon[37053]: pgmap v2551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:37:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:57 smithi063 ceph-mon[36747]: pgmap v2551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:37:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:37:59 smithi043 ceph-mon[32384]: pgmap v2552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:37:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:37:59 smithi133 ceph-mon[37053]: pgmap v2552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:37:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:37:59 smithi063 ceph-mon[36747]: pgmap v2552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:01 smithi043 ceph-mon[32384]: pgmap v2553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3726.791075 secs 2024-07-26T09:38:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3742.274429 secs 2024-07-26T09:38:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:01 smithi133 ceph-mon[37053]: pgmap v2553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3726.791075 secs 2024-07-26T09:38:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3742.274429 secs 2024-07-26T09:38:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:01 smithi063 ceph-mon[36747]: pgmap v2553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3726.791075 secs 2024-07-26T09:38:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3742.274429 secs 2024-07-26T09:38:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:03 smithi043 ceph-mon[32384]: pgmap v2554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:03 smithi133 ceph-mon[37053]: pgmap v2554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:03 smithi063 ceph-mon[36747]: pgmap v2554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:05 smithi043 ceph-mon[32384]: pgmap v2555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:05 smithi133 ceph-mon[37053]: pgmap v2555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:05 smithi063 ceph-mon[36747]: pgmap v2555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:06.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3731.791140 secs 2024-07-26T09:38:06.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3747.274572 secs 2024-07-26T09:38:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3731.791140 secs 2024-07-26T09:38:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3747.274572 secs 2024-07-26T09:38:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3731.791140 secs 2024-07-26T09:38:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3747.274572 secs 2024-07-26T09:38:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:07 smithi043 ceph-mon[32384]: pgmap v2556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:07 smithi133 ceph-mon[37053]: pgmap v2556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:07 smithi063 ceph-mon[36747]: pgmap v2556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:09 smithi043 ceph-mon[32384]: pgmap v2557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:09 smithi133 ceph-mon[37053]: pgmap v2557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:09 smithi063 ceph-mon[36747]: pgmap v2557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:38:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:11 smithi043 ceph-mon[32384]: pgmap v2558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3736.791204 secs 2024-07-26T09:38:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3752.274692 secs 2024-07-26T09:38:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:11 smithi133 ceph-mon[37053]: pgmap v2558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3736.791204 secs 2024-07-26T09:38:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3752.274692 secs 2024-07-26T09:38:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:11 smithi063 ceph-mon[36747]: pgmap v2558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3736.791204 secs 2024-07-26T09:38:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3752.274692 secs 2024-07-26T09:38:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:13 smithi043 ceph-mon[32384]: pgmap v2559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:13 smithi133 ceph-mon[37053]: pgmap v2559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:13 smithi063 ceph-mon[36747]: pgmap v2559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:15 smithi043 ceph-mon[32384]: pgmap v2560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:15 smithi133 ceph-mon[37053]: pgmap v2560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:15 smithi063 ceph-mon[36747]: pgmap v2560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3741.791321 secs 2024-07-26T09:38:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3757.274819 secs 2024-07-26T09:38:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3741.791321 secs 2024-07-26T09:38:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3757.274819 secs 2024-07-26T09:38:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3741.791321 secs 2024-07-26T09:38:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3757.274819 secs 2024-07-26T09:38:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:17 smithi043 ceph-mon[32384]: pgmap v2561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:17 smithi133 ceph-mon[37053]: pgmap v2561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:17 smithi063 ceph-mon[36747]: pgmap v2561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:19 smithi043 ceph-mon[32384]: pgmap v2562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:19 smithi133 ceph-mon[37053]: pgmap v2562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:19 smithi063 ceph-mon[36747]: pgmap v2562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:21 smithi043 ceph-mon[32384]: pgmap v2563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3746.791444 secs 2024-07-26T09:38:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3762.274931 secs 2024-07-26T09:38:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:21 smithi133 ceph-mon[37053]: pgmap v2563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3746.791444 secs 2024-07-26T09:38:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3762.274931 secs 2024-07-26T09:38:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:21 smithi063 ceph-mon[36747]: pgmap v2563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3746.791444 secs 2024-07-26T09:38:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3762.274931 secs 2024-07-26T09:38:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:23 smithi043 ceph-mon[32384]: pgmap v2564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:23 smithi133 ceph-mon[37053]: pgmap v2564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:23 smithi063 ceph-mon[36747]: pgmap v2564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:25 smithi043 ceph-mon[32384]: pgmap v2565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:25 smithi133 ceph-mon[37053]: pgmap v2565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:25 smithi063 ceph-mon[36747]: pgmap v2565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3751.791564 secs 2024-07-26T09:38:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3767.275060 secs 2024-07-26T09:38:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3751.791564 secs 2024-07-26T09:38:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3767.275060 secs 2024-07-26T09:38:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3751.791564 secs 2024-07-26T09:38:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3767.275060 secs 2024-07-26T09:38:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:27 smithi133 ceph-mon[37053]: pgmap v2566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:27 smithi063 ceph-mon[36747]: pgmap v2566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:27 smithi043 ceph-mon[32384]: pgmap v2566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:29 smithi133 ceph-mon[37053]: pgmap v2567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:29 smithi063 ceph-mon[36747]: pgmap v2567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:29 smithi043 ceph-mon[32384]: pgmap v2567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:31 smithi133 ceph-mon[37053]: pgmap v2568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3756.791645 secs 2024-07-26T09:38:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3772.275186 secs 2024-07-26T09:38:31.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:31 smithi043 ceph-mon[32384]: pgmap v2568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:31.609 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3756.791645 secs 2024-07-26T09:38:31.609 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3772.275186 secs 2024-07-26T09:38:31.610 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:31 smithi063 ceph-mon[36747]: pgmap v2568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:31.610 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3756.791645 secs 2024-07-26T09:38:31.610 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3772.275186 secs 2024-07-26T09:38:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:33 smithi133 ceph-mon[37053]: pgmap v2569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:33 smithi063 ceph-mon[36747]: pgmap v2569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:33 smithi043 ceph-mon[32384]: pgmap v2569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:35 smithi133 ceph-mon[37053]: pgmap v2570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:35 smithi063 ceph-mon[36747]: pgmap v2570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:35 smithi043 ceph-mon[32384]: pgmap v2570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3761.791763 secs 2024-07-26T09:38:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3777.275271 secs 2024-07-26T09:38:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3761.791763 secs 2024-07-26T09:38:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3777.275271 secs 2024-07-26T09:38:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3761.791763 secs 2024-07-26T09:38:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3777.275271 secs 2024-07-26T09:38:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:37 smithi063 ceph-mon[36747]: pgmap v2571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:37 smithi043 ceph-mon[32384]: pgmap v2571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:37 smithi133 ceph-mon[37053]: pgmap v2571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:39 smithi063 ceph-mon[36747]: pgmap v2572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:39 smithi043 ceph-mon[32384]: pgmap v2572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:39 smithi133 ceph-mon[37053]: pgmap v2572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:41 smithi063 ceph-mon[36747]: pgmap v2573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3766.791885 secs 2024-07-26T09:38:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3782.275404 secs 2024-07-26T09:38:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:41 smithi043 ceph-mon[32384]: pgmap v2573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3766.791885 secs 2024-07-26T09:38:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3782.275404 secs 2024-07-26T09:38:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:41 smithi133 ceph-mon[37053]: pgmap v2573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:38:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3766.791885 secs 2024-07-26T09:38:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3782.275404 secs 2024-07-26T09:38:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:43 smithi063 ceph-mon[36747]: pgmap v2574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:43 smithi043 ceph-mon[32384]: pgmap v2574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:43 smithi133 ceph-mon[37053]: pgmap v2574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:45 smithi063 ceph-mon[36747]: pgmap v2575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:45 smithi043 ceph-mon[32384]: pgmap v2575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:45 smithi133 ceph-mon[37053]: pgmap v2575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:38:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3771.791978 secs 2024-07-26T09:38:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3787.275479 secs 2024-07-26T09:38:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:38:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3771.791978 secs 2024-07-26T09:38:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3787.275479 secs 2024-07-26T09:38:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:38:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3771.791978 secs 2024-07-26T09:38:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3787.275479 secs 2024-07-26T09:38:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: pgmap v2576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:38:47.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:38:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: pgmap v2576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:38:47.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:38:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: pgmap v2576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:38:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:38:47.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:38:47.768 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:38:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:48 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:38:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:48 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:38:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:48 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:38:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:48 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:38:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:48 smithi043 ceph-mon[32384]: pgmap v2577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:38:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:48 smithi043 ceph-mon[32384]: pgmap v2578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:48 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:38:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:48 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:38:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:48 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:38:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:48 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:38:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:48 smithi133 ceph-mon[37053]: pgmap v2577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:38:48.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:48 smithi133 ceph-mon[37053]: pgmap v2578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:48 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:38:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:48 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:38:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:48 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:38:48.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:48 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:38:48.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:48 smithi063 ceph-mon[36747]: pgmap v2577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:38:48.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:48 smithi063 ceph-mon[36747]: pgmap v2578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:50 smithi043 ceph-mon[32384]: pgmap v2579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:38:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:50 smithi133 ceph-mon[37053]: pgmap v2579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:38:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:50 smithi063 ceph-mon[36747]: pgmap v2579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:38:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3776.792098 secs 2024-07-26T09:38:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3792.275598 secs 2024-07-26T09:38:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3776.792098 secs 2024-07-26T09:38:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3792.275598 secs 2024-07-26T09:38:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3776.792098 secs 2024-07-26T09:38:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3792.275598 secs 2024-07-26T09:38:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:52 smithi043 ceph-mon[32384]: pgmap v2580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:38:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:52 smithi133 ceph-mon[37053]: pgmap v2580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:38:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:52 smithi063 ceph-mon[36747]: pgmap v2580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:38:53.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:53 smithi043 ceph-mon[32384]: pgmap v2581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:38:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:53 smithi133 ceph-mon[37053]: pgmap v2581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:38:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:53 smithi063 ceph-mon[36747]: pgmap v2581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:38:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3781.792217 secs 2024-07-26T09:38:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:56 smithi063 ceph-mon[36747]: pgmap v2582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3797.275710 secs 2024-07-26T09:38:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3781.792217 secs 2024-07-26T09:38:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:56 smithi043 ceph-mon[32384]: pgmap v2582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3797.275710 secs 2024-07-26T09:38:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3781.792217 secs 2024-07-26T09:38:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:56 smithi133 ceph-mon[37053]: pgmap v2582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:38:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3797.275710 secs 2024-07-26T09:38:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:38:58 smithi063 ceph-mon[36747]: pgmap v2583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:38:58 smithi043 ceph-mon[32384]: pgmap v2583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:38:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:38:58 smithi133 ceph-mon[37053]: pgmap v2583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:39:00.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:00 smithi063 ceph-mon[36747]: pgmap v2584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:00 smithi043 ceph-mon[32384]: pgmap v2584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:00 smithi133 ceph-mon[37053]: pgmap v2584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3786.792339 secs 2024-07-26T09:39:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3802.275829 secs 2024-07-26T09:39:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3786.792339 secs 2024-07-26T09:39:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3802.275829 secs 2024-07-26T09:39:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3786.792339 secs 2024-07-26T09:39:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3802.275829 secs 2024-07-26T09:39:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:02 smithi063 ceph-mon[36747]: pgmap v2585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:02 smithi043 ceph-mon[32384]: pgmap v2585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:02 smithi133 ceph-mon[37053]: pgmap v2585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:04 smithi063 ceph-mon[36747]: pgmap v2586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:04 smithi043 ceph-mon[32384]: pgmap v2586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:04 smithi133 ceph-mon[37053]: pgmap v2586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3791.792476 secs 2024-07-26T09:39:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:06 smithi063 ceph-mon[36747]: pgmap v2587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3807.275924 secs 2024-07-26T09:39:06.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3791.792476 secs 2024-07-26T09:39:06.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:06 smithi133 ceph-mon[37053]: pgmap v2587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:06.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3807.275924 secs 2024-07-26T09:39:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3791.792476 secs 2024-07-26T09:39:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:06 smithi043 ceph-mon[32384]: pgmap v2587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3807.275924 secs 2024-07-26T09:39:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:08 smithi063 ceph-mon[36747]: pgmap v2588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:08 smithi043 ceph-mon[32384]: pgmap v2588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:08 smithi133 ceph-mon[37053]: pgmap v2588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:10 smithi043 ceph-mon[32384]: pgmap v2589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:10 smithi133 ceph-mon[37053]: pgmap v2589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:10 smithi063 ceph-mon[36747]: pgmap v2589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3796.792595 secs 2024-07-26T09:39:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3812.276047 secs 2024-07-26T09:39:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3796.792595 secs 2024-07-26T09:39:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3812.276047 secs 2024-07-26T09:39:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3796.792595 secs 2024-07-26T09:39:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3812.276047 secs 2024-07-26T09:39:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:12 smithi043 ceph-mon[32384]: pgmap v2590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:12 smithi133 ceph-mon[37053]: pgmap v2590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:12 smithi063 ceph-mon[36747]: pgmap v2590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:13 smithi043 ceph-mon[32384]: pgmap v2591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:13 smithi133 ceph-mon[37053]: pgmap v2591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:13 smithi063 ceph-mon[36747]: pgmap v2591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3801.792708 secs 2024-07-26T09:39:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:16 smithi063 ceph-mon[36747]: pgmap v2592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3817.276163 secs 2024-07-26T09:39:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3801.792708 secs 2024-07-26T09:39:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:16 smithi043 ceph-mon[32384]: pgmap v2592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3817.276163 secs 2024-07-26T09:39:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3801.792708 secs 2024-07-26T09:39:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:16 smithi133 ceph-mon[37053]: pgmap v2592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3817.276163 secs 2024-07-26T09:39:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:18 smithi063 ceph-mon[36747]: pgmap v2593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:18 smithi043 ceph-mon[32384]: pgmap v2593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:18 smithi133 ceph-mon[37053]: pgmap v2593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:20 smithi063 ceph-mon[36747]: pgmap v2594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:20 smithi043 ceph-mon[32384]: pgmap v2594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:20 smithi133 ceph-mon[37053]: pgmap v2594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3806.792828 secs 2024-07-26T09:39:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3822.276257 secs 2024-07-26T09:39:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3806.792828 secs 2024-07-26T09:39:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3822.276257 secs 2024-07-26T09:39:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3806.792828 secs 2024-07-26T09:39:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3822.276257 secs 2024-07-26T09:39:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:22 smithi063 ceph-mon[36747]: pgmap v2595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:22 smithi043 ceph-mon[32384]: pgmap v2595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:22 smithi133 ceph-mon[37053]: pgmap v2595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:24 smithi063 ceph-mon[36747]: pgmap v2596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:24 smithi043 ceph-mon[32384]: pgmap v2596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:24 smithi133 ceph-mon[37053]: pgmap v2596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3811.792973 secs 2024-07-26T09:39:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:26 smithi043 ceph-mon[32384]: pgmap v2597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3827.276379 secs 2024-07-26T09:39:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3811.792973 secs 2024-07-26T09:39:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:26 smithi133 ceph-mon[37053]: pgmap v2597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3827.276379 secs 2024-07-26T09:39:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3811.792973 secs 2024-07-26T09:39:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:26 smithi063 ceph-mon[36747]: pgmap v2597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3827.276379 secs 2024-07-26T09:39:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:28 smithi043 ceph-mon[32384]: pgmap v2598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:28 smithi133 ceph-mon[37053]: pgmap v2598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:28 smithi063 ceph-mon[36747]: pgmap v2598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:30 smithi043 ceph-mon[32384]: pgmap v2599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:30 smithi133 ceph-mon[37053]: pgmap v2599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:30 smithi063 ceph-mon[36747]: pgmap v2599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3816.793129 secs 2024-07-26T09:39:31.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3832.276474 secs 2024-07-26T09:39:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3816.793129 secs 2024-07-26T09:39:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3832.276474 secs 2024-07-26T09:39:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3816.793129 secs 2024-07-26T09:39:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3832.276474 secs 2024-07-26T09:39:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:32 smithi043 ceph-mon[32384]: pgmap v2600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:32 smithi133 ceph-mon[37053]: pgmap v2600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:32 smithi063 ceph-mon[36747]: pgmap v2600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:33 smithi043 ceph-mon[32384]: pgmap v2601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:33 smithi133 ceph-mon[37053]: pgmap v2601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:33 smithi063 ceph-mon[36747]: pgmap v2601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3821.793244 secs 2024-07-26T09:39:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:36 smithi063 ceph-mon[36747]: pgmap v2602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3837.276608 secs 2024-07-26T09:39:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3821.793244 secs 2024-07-26T09:39:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:36 smithi043 ceph-mon[32384]: pgmap v2602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3837.276608 secs 2024-07-26T09:39:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3821.793244 secs 2024-07-26T09:39:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:36 smithi133 ceph-mon[37053]: pgmap v2602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3837.276608 secs 2024-07-26T09:39:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:38 smithi063 ceph-mon[36747]: pgmap v2603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:38 smithi043 ceph-mon[32384]: pgmap v2603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:38 smithi133 ceph-mon[37053]: pgmap v2603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:40 smithi063 ceph-mon[36747]: pgmap v2604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:40 smithi043 ceph-mon[32384]: pgmap v2604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:40 smithi133 ceph-mon[37053]: pgmap v2604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3826.793387 secs 2024-07-26T09:39:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3842.276731 secs 2024-07-26T09:39:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3826.793387 secs 2024-07-26T09:39:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3842.276731 secs 2024-07-26T09:39:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3826.793387 secs 2024-07-26T09:39:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3842.276731 secs 2024-07-26T09:39:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:42 smithi043 ceph-mon[32384]: pgmap v2605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:42 smithi133 ceph-mon[37053]: pgmap v2605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:42 smithi063 ceph-mon[36747]: pgmap v2605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:39:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:44 smithi043 ceph-mon[32384]: pgmap v2606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:44 smithi133 ceph-mon[37053]: pgmap v2606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:44 smithi063 ceph-mon[36747]: pgmap v2606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3831.793447 secs 2024-07-26T09:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:46 smithi043 ceph-mon[32384]: pgmap v2607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3847.276849 secs 2024-07-26T09:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3831.793447 secs 2024-07-26T09:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:46 smithi133 ceph-mon[37053]: pgmap v2607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3847.276849 secs 2024-07-26T09:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3831.793447 secs 2024-07-26T09:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:46 smithi063 ceph-mon[36747]: pgmap v2607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:39:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3847.276849 secs 2024-07-26T09:39:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:48 smithi043 ceph-mon[32384]: pgmap v2608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:39:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:48 smithi133 ceph-mon[37053]: pgmap v2608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:39:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:48 smithi063 ceph-mon[36747]: pgmap v2608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:39:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:39:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:39:49.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:39:49.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:39:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:39:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:39:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:39:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:39:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:39:49.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:50 smithi043 ceph-mon[32384]: pgmap v2609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:50 smithi043 ceph-mon[32384]: pgmap v2610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:50 smithi133 ceph-mon[37053]: pgmap v2609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:50 smithi133 ceph-mon[37053]: pgmap v2610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:50 smithi063 ceph-mon[36747]: pgmap v2609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:50 smithi063 ceph-mon[36747]: pgmap v2610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3836.793512 secs 2024-07-26T09:39:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:51 smithi043 ceph-mon[32384]: pgmap v2611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:39:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3852.276937 secs 2024-07-26T09:39:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3836.793512 secs 2024-07-26T09:39:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:51 smithi133 ceph-mon[37053]: pgmap v2611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:39:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3852.276937 secs 2024-07-26T09:39:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3836.793512 secs 2024-07-26T09:39:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:51 smithi063 ceph-mon[36747]: pgmap v2611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:39:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3852.276937 secs 2024-07-26T09:39:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:53 smithi063 ceph-mon[36747]: pgmap v2612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:39:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:53 smithi043 ceph-mon[32384]: pgmap v2612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:39:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:53 smithi133 ceph-mon[37053]: pgmap v2612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:39:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:55 smithi063 ceph-mon[36747]: pgmap v2613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:55 smithi043 ceph-mon[32384]: pgmap v2613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:55 smithi133 ceph-mon[37053]: pgmap v2613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:39:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3841.793631 secs 2024-07-26T09:39:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3857.277015 secs 2024-07-26T09:39:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3841.793631 secs 2024-07-26T09:39:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3857.277015 secs 2024-07-26T09:39:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3841.793631 secs 2024-07-26T09:39:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3857.277015 secs 2024-07-26T09:39:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:57 smithi063 ceph-mon[36747]: pgmap v2614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:39:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:57 smithi043 ceph-mon[32384]: pgmap v2614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:39:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:57 smithi133 ceph-mon[37053]: pgmap v2614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:39:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:39:59 smithi063 ceph-mon[36747]: pgmap v2615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:39:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:39:59 smithi043 ceph-mon[32384]: pgmap v2615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:40:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:39:59 smithi133 ceph-mon[37053]: pgmap v2615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:40:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:40:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:40:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:40:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3846.793779 secs 2024-07-26T09:40:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:01 smithi043 ceph-mon[32384]: pgmap v2616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3862.277095 secs 2024-07-26T09:40:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3846.793779 secs 2024-07-26T09:40:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:01 smithi133 ceph-mon[37053]: pgmap v2616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3862.277095 secs 2024-07-26T09:40:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3846.793779 secs 2024-07-26T09:40:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:01 smithi063 ceph-mon[36747]: pgmap v2616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3862.277095 secs 2024-07-26T09:40:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:03 smithi043 ceph-mon[32384]: pgmap v2617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:03 smithi133 ceph-mon[37053]: pgmap v2617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:03 smithi063 ceph-mon[36747]: pgmap v2617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:05 smithi043 ceph-mon[32384]: pgmap v2618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:05 smithi133 ceph-mon[37053]: pgmap v2618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:05 smithi063 ceph-mon[36747]: pgmap v2618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:06.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3851.793887 secs 2024-07-26T09:40:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3867.277204 secs 2024-07-26T09:40:06.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3851.793887 secs 2024-07-26T09:40:06.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3867.277204 secs 2024-07-26T09:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3851.793887 secs 2024-07-26T09:40:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3867.277204 secs 2024-07-26T09:40:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:07 smithi043 ceph-mon[32384]: pgmap v2619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:07 smithi133 ceph-mon[37053]: pgmap v2619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:07 smithi063 ceph-mon[36747]: pgmap v2619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:09 smithi043 ceph-mon[32384]: pgmap v2620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:09 smithi133 ceph-mon[37053]: pgmap v2620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:09 smithi063 ceph-mon[36747]: pgmap v2620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3856.794027 secs 2024-07-26T09:40:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:11 smithi043 ceph-mon[32384]: pgmap v2621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3872.277329 secs 2024-07-26T09:40:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3856.794027 secs 2024-07-26T09:40:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:11 smithi133 ceph-mon[37053]: pgmap v2621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3872.277329 secs 2024-07-26T09:40:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3856.794027 secs 2024-07-26T09:40:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:11 smithi063 ceph-mon[36747]: pgmap v2621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3872.277329 secs 2024-07-26T09:40:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:13 smithi043 ceph-mon[32384]: pgmap v2622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:13 smithi133 ceph-mon[37053]: pgmap v2622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:13 smithi063 ceph-mon[36747]: pgmap v2622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:15 smithi043 ceph-mon[32384]: pgmap v2623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:15 smithi133 ceph-mon[37053]: pgmap v2623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:15 smithi063 ceph-mon[36747]: pgmap v2623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3861.794144 secs 2024-07-26T09:40:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3877.277426 secs 2024-07-26T09:40:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3861.794144 secs 2024-07-26T09:40:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3877.277426 secs 2024-07-26T09:40:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3861.794144 secs 2024-07-26T09:40:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3877.277426 secs 2024-07-26T09:40:17.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:17 smithi043 ceph-mon[32384]: pgmap v2624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:17 smithi133 ceph-mon[37053]: pgmap v2624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:17 smithi063 ceph-mon[36747]: pgmap v2624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:19 smithi043 ceph-mon[32384]: pgmap v2625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:19 smithi133 ceph-mon[37053]: pgmap v2625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:19 smithi063 ceph-mon[36747]: pgmap v2625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3866.794212 secs 2024-07-26T09:40:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:21 smithi043 ceph-mon[32384]: pgmap v2626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3882.277576 secs 2024-07-26T09:40:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3866.794212 secs 2024-07-26T09:40:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:21 smithi133 ceph-mon[37053]: pgmap v2626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3882.277576 secs 2024-07-26T09:40:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3866.794212 secs 2024-07-26T09:40:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:21 smithi063 ceph-mon[36747]: pgmap v2626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3882.277576 secs 2024-07-26T09:40:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:23 smithi043 ceph-mon[32384]: pgmap v2627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:23 smithi133 ceph-mon[37053]: pgmap v2627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:23 smithi063 ceph-mon[36747]: pgmap v2627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:25.929 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:25 smithi063 ceph-mon[36747]: pgmap v2628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:25 smithi043 ceph-mon[32384]: pgmap v2628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:25 smithi133 ceph-mon[37053]: pgmap v2628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3871.794335 secs 2024-07-26T09:40:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3887.277667 secs 2024-07-26T09:40:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3871.794335 secs 2024-07-26T09:40:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3887.277667 secs 2024-07-26T09:40:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3871.794335 secs 2024-07-26T09:40:27.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3887.277667 secs 2024-07-26T09:40:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:27 smithi043 ceph-mon[32384]: pgmap v2629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:27 smithi133 ceph-mon[37053]: pgmap v2629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:27 smithi063 ceph-mon[36747]: pgmap v2629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:29 smithi043 ceph-mon[32384]: pgmap v2630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:29 smithi133 ceph-mon[37053]: pgmap v2630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:29 smithi063 ceph-mon[36747]: pgmap v2630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3876.794441 secs 2024-07-26T09:40:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:31 smithi043 ceph-mon[32384]: pgmap v2631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3892.277803 secs 2024-07-26T09:40:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3876.794441 secs 2024-07-26T09:40:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:31 smithi133 ceph-mon[37053]: pgmap v2631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3892.277803 secs 2024-07-26T09:40:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3876.794441 secs 2024-07-26T09:40:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:31 smithi063 ceph-mon[36747]: pgmap v2631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3892.277803 secs 2024-07-26T09:40:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:33 smithi043 ceph-mon[32384]: pgmap v2632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:33 smithi133 ceph-mon[37053]: pgmap v2632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:33 smithi063 ceph-mon[36747]: pgmap v2632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:35 smithi043 ceph-mon[32384]: pgmap v2633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3881.794580 secs 2024-07-26T09:40:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:35 smithi133 ceph-mon[37053]: pgmap v2633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3881.794580 secs 2024-07-26T09:40:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:35 smithi063 ceph-mon[36747]: pgmap v2633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3881.794580 secs 2024-07-26T09:40:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3897.277919 secs 2024-07-26T09:40:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3897.277919 secs 2024-07-26T09:40:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3897.277919 secs 2024-07-26T09:40:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:37 smithi043 ceph-mon[32384]: pgmap v2634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:37 smithi133 ceph-mon[37053]: pgmap v2634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:37 smithi063 ceph-mon[36747]: pgmap v2634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:39 smithi043 ceph-mon[32384]: pgmap v2635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:39 smithi133 ceph-mon[37053]: pgmap v2635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:39 smithi063 ceph-mon[36747]: pgmap v2635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3886.794721 secs 2024-07-26T09:40:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3886.794721 secs 2024-07-26T09:40:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3886.794721 secs 2024-07-26T09:40:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:41 smithi133 ceph-mon[37053]: pgmap v2636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3902.277985 secs 2024-07-26T09:40:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:41 smithi063 ceph-mon[36747]: pgmap v2636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3902.277985 secs 2024-07-26T09:40:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:41 smithi043 ceph-mon[32384]: pgmap v2636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3902.277985 secs 2024-07-26T09:40:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:43 smithi133 ceph-mon[37053]: pgmap v2637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:43 smithi063 ceph-mon[36747]: pgmap v2637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:43 smithi043 ceph-mon[32384]: pgmap v2637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:45 smithi133 ceph-mon[37053]: pgmap v2638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3891.794795 secs 2024-07-26T09:40:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:45 smithi063 ceph-mon[36747]: pgmap v2638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3891.794795 secs 2024-07-26T09:40:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:45 smithi043 ceph-mon[32384]: pgmap v2638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3891.794795 secs 2024-07-26T09:40:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3907.278108 secs 2024-07-26T09:40:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3907.278108 secs 2024-07-26T09:40:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3907.278108 secs 2024-07-26T09:40:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:47 smithi133 ceph-mon[37053]: pgmap v2639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:47 smithi063 ceph-mon[36747]: pgmap v2639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:47 smithi043 ceph-mon[32384]: pgmap v2639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:40:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:40:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:40:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:40:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:50 smithi043 ceph-mon[32384]: pgmap v2640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:50.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:50 smithi133 ceph-mon[37053]: pgmap v2640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:50.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:50 smithi063 ceph-mon[36747]: pgmap v2640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:40:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3896.794918 secs 2024-07-26T09:40:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:40:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:40:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3912.278185 secs 2024-07-26T09:40:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3896.794918 secs 2024-07-26T09:40:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:40:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:40:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3912.278185 secs 2024-07-26T09:40:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3896.794918 secs 2024-07-26T09:40:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:40:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:40:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:40:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3912.278185 secs 2024-07-26T09:40:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:52 smithi043 ceph-mon[32384]: pgmap v2641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:52 smithi043 ceph-mon[32384]: pgmap v2642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:52 smithi133 ceph-mon[37053]: pgmap v2641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:52 smithi133 ceph-mon[37053]: pgmap v2642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:52 smithi063 ceph-mon[36747]: pgmap v2641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:40:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:52 smithi063 ceph-mon[36747]: pgmap v2642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:53 smithi043 ceph-mon[32384]: pgmap v2643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:53 smithi133 ceph-mon[37053]: pgmap v2643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:53 smithi063 ceph-mon[36747]: pgmap v2643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:55 smithi133 ceph-mon[37053]: pgmap v2644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:55 smithi063 ceph-mon[36747]: pgmap v2644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:55 smithi043 ceph-mon[32384]: pgmap v2644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3901.795051 secs 2024-07-26T09:40:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3917.278270 secs 2024-07-26T09:40:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3901.795051 secs 2024-07-26T09:40:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3917.278270 secs 2024-07-26T09:40:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3901.795051 secs 2024-07-26T09:40:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3917.278270 secs 2024-07-26T09:40:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:57 smithi063 ceph-mon[36747]: pgmap v2645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:57 smithi043 ceph-mon[32384]: pgmap v2645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:57 smithi133 ceph-mon[37053]: pgmap v2645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:40:59 smithi063 ceph-mon[36747]: pgmap v2646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:40:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:40:59 smithi043 ceph-mon[32384]: pgmap v2646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:41:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:40:59 smithi133 ceph-mon[37053]: pgmap v2646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:41:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3906.795191 secs 2024-07-26T09:41:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:01 smithi063 ceph-mon[36747]: pgmap v2647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:41:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3922.278333 secs 2024-07-26T09:41:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3906.795191 secs 2024-07-26T09:41:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:01 smithi043 ceph-mon[32384]: pgmap v2647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:41:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3922.278333 secs 2024-07-26T09:41:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3906.795191 secs 2024-07-26T09:41:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:01 smithi133 ceph-mon[37053]: pgmap v2647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:41:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3922.278333 secs 2024-07-26T09:41:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:03 smithi063 ceph-mon[36747]: pgmap v2648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:03 smithi043 ceph-mon[32384]: pgmap v2648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:03 smithi133 ceph-mon[37053]: pgmap v2648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:05 smithi063 ceph-mon[36747]: pgmap v2649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:05 smithi043 ceph-mon[32384]: pgmap v2649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:05 smithi133 ceph-mon[37053]: pgmap v2649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3911.795305 secs 2024-07-26T09:41:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3927.278452 secs 2024-07-26T09:41:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3911.795305 secs 2024-07-26T09:41:06.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3927.278452 secs 2024-07-26T09:41:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3911.795305 secs 2024-07-26T09:41:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3927.278452 secs 2024-07-26T09:41:07.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:07 smithi043 ceph-mon[32384]: pgmap v2650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:07 smithi133 ceph-mon[37053]: pgmap v2650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:07 smithi063 ceph-mon[36747]: pgmap v2650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:09 smithi133 ceph-mon[37053]: pgmap v2651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:09 smithi063 ceph-mon[36747]: pgmap v2651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:09 smithi043 ceph-mon[32384]: pgmap v2651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3916.795445 secs 2024-07-26T09:41:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3916.795445 secs 2024-07-26T09:41:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3916.795445 secs 2024-07-26T09:41:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:11 smithi133 ceph-mon[37053]: pgmap v2652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3932.278595 secs 2024-07-26T09:41:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:11 smithi063 ceph-mon[36747]: pgmap v2652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3932.278595 secs 2024-07-26T09:41:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:11 smithi043 ceph-mon[32384]: pgmap v2652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3932.278595 secs 2024-07-26T09:41:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:13 smithi133 ceph-mon[37053]: pgmap v2653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:13 smithi063 ceph-mon[36747]: pgmap v2653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:14.107 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:13 smithi043 ceph-mon[32384]: pgmap v2653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:15 smithi133 ceph-mon[37053]: pgmap v2654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3921.795564 secs 2024-07-26T09:41:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:15 smithi063 ceph-mon[36747]: pgmap v2654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:16.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3921.795564 secs 2024-07-26T09:41:16.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:15 smithi043 ceph-mon[32384]: pgmap v2654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:16.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3921.795564 secs 2024-07-26T09:41:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3937.278730 secs 2024-07-26T09:41:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3937.278730 secs 2024-07-26T09:41:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3937.278730 secs 2024-07-26T09:41:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:17 smithi063 ceph-mon[36747]: pgmap v2655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:17 smithi043 ceph-mon[32384]: pgmap v2655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:17 smithi133 ceph-mon[37053]: pgmap v2655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:19 smithi063 ceph-mon[36747]: pgmap v2656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:19 smithi043 ceph-mon[32384]: pgmap v2656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:19 smithi133 ceph-mon[37053]: pgmap v2656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3926.795628 secs 2024-07-26T09:41:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3926.795628 secs 2024-07-26T09:41:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3926.795628 secs 2024-07-26T09:41:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:21 smithi063 ceph-mon[36747]: pgmap v2657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3942.278846 secs 2024-07-26T09:41:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:21 smithi043 ceph-mon[32384]: pgmap v2657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3942.278846 secs 2024-07-26T09:41:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:21 smithi133 ceph-mon[37053]: pgmap v2657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3942.278846 secs 2024-07-26T09:41:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:23 smithi063 ceph-mon[36747]: pgmap v2658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:23 smithi043 ceph-mon[32384]: pgmap v2658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:23 smithi133 ceph-mon[37053]: pgmap v2658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:25 smithi063 ceph-mon[36747]: pgmap v2659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:26.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3931.795745 secs 2024-07-26T09:41:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:25 smithi043 ceph-mon[32384]: pgmap v2659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3931.795745 secs 2024-07-26T09:41:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:25 smithi133 ceph-mon[37053]: pgmap v2659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3931.795745 secs 2024-07-26T09:41:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3947.278955 secs 2024-07-26T09:41:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3947.278955 secs 2024-07-26T09:41:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3947.278955 secs 2024-07-26T09:41:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:27 smithi043 ceph-mon[32384]: pgmap v2660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:27 smithi133 ceph-mon[37053]: pgmap v2660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:27 smithi063 ceph-mon[36747]: pgmap v2660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:29 smithi043 ceph-mon[32384]: pgmap v2661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:29 smithi133 ceph-mon[37053]: pgmap v2661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:29 smithi063 ceph-mon[36747]: pgmap v2661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:31.139 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3936.795836 secs 2024-07-26T09:41:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3936.795836 secs 2024-07-26T09:41:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3936.795836 secs 2024-07-26T09:41:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:31 smithi043 ceph-mon[32384]: pgmap v2662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3952.279079 secs 2024-07-26T09:41:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:31 smithi133 ceph-mon[37053]: pgmap v2662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3952.279079 secs 2024-07-26T09:41:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:31 smithi063 ceph-mon[36747]: pgmap v2662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3952.279079 secs 2024-07-26T09:41:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:33 smithi043 ceph-mon[32384]: pgmap v2663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:33 smithi133 ceph-mon[37053]: pgmap v2663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:33 smithi063 ceph-mon[36747]: pgmap v2663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:36.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:35 smithi063 ceph-mon[36747]: pgmap v2664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:36.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3941.795953 secs 2024-07-26T09:41:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:35 smithi043 ceph-mon[32384]: pgmap v2664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3941.795953 secs 2024-07-26T09:41:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:35 smithi133 ceph-mon[37053]: pgmap v2664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3941.795953 secs 2024-07-26T09:41:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3957.279197 secs 2024-07-26T09:41:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3957.279197 secs 2024-07-26T09:41:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3957.279197 secs 2024-07-26T09:41:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:37 smithi043 ceph-mon[32384]: pgmap v2665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:37 smithi133 ceph-mon[37053]: pgmap v2665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:37 smithi063 ceph-mon[36747]: pgmap v2665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:39 smithi043 ceph-mon[32384]: pgmap v2666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:39 smithi133 ceph-mon[37053]: pgmap v2666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:39 smithi063 ceph-mon[36747]: pgmap v2666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3946.796070 secs 2024-07-26T09:41:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3946.796070 secs 2024-07-26T09:41:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3946.796070 secs 2024-07-26T09:41:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:41 smithi043 ceph-mon[32384]: pgmap v2667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3962.279313 secs 2024-07-26T09:41:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:41 smithi133 ceph-mon[37053]: pgmap v2667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3962.279313 secs 2024-07-26T09:41:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:41 smithi063 ceph-mon[36747]: pgmap v2667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3962.279313 secs 2024-07-26T09:41:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:43 smithi043 ceph-mon[32384]: pgmap v2668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:43 smithi133 ceph-mon[37053]: pgmap v2668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:43 smithi063 ceph-mon[36747]: pgmap v2668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:45 smithi043 ceph-mon[32384]: pgmap v2669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3951.796188 secs 2024-07-26T09:41:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:45 smithi133 ceph-mon[37053]: pgmap v2669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3951.796188 secs 2024-07-26T09:41:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:45 smithi063 ceph-mon[36747]: pgmap v2669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3951.796188 secs 2024-07-26T09:41:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3967.279395 secs 2024-07-26T09:41:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3967.279395 secs 2024-07-26T09:41:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3967.279395 secs 2024-07-26T09:41:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:47 smithi043 ceph-mon[32384]: pgmap v2670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:47 smithi133 ceph-mon[37053]: pgmap v2670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:47 smithi063 ceph-mon[36747]: pgmap v2670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:49 smithi043 ceph-mon[32384]: pgmap v2671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:49 smithi133 ceph-mon[37053]: pgmap v2671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:49 smithi063 ceph-mon[36747]: pgmap v2671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3956.796304 secs 2024-07-26T09:41:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:41:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3956.796304 secs 2024-07-26T09:41:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:41:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3956.796304 secs 2024-07-26T09:41:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:41:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:52 smithi043 ceph-mon[32384]: pgmap v2672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3972.279477 secs 2024-07-26T09:41:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:52 smithi063 ceph-mon[36747]: pgmap v2672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3972.279477 secs 2024-07-26T09:41:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:52 smithi133 ceph-mon[37053]: pgmap v2672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3972.279477 secs 2024-07-26T09:41:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:53 smithi043 ceph-mon[32384]: pgmap v2673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:53.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:53.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:53.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:53.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:53 smithi133 ceph-mon[37053]: pgmap v2673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:53 smithi063 ceph-mon[36747]: pgmap v2673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:41:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:55 smithi063 ceph-mon[36747]: pgmap v2674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:56.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3961.796419 secs 2024-07-26T09:41:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:55 smithi043 ceph-mon[32384]: pgmap v2674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3961.796419 secs 2024-07-26T09:41:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:55 smithi133 ceph-mon[37053]: pgmap v2674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3961.796419 secs 2024-07-26T09:41:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3977.279596 secs 2024-07-26T09:41:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:41:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:41:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:56 smithi043 ceph-mon[32384]: pgmap v2675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:41:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:56 smithi043 ceph-mon[32384]: pgmap v2676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3977.279596 secs 2024-07-26T09:41:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:41:57.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:41:57.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:56 smithi133 ceph-mon[37053]: pgmap v2675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:41:57.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:56 smithi133 ceph-mon[37053]: pgmap v2676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:57.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3977.279596 secs 2024-07-26T09:41:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:41:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:41:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:56 smithi063 ceph-mon[36747]: pgmap v2675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:41:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:56 smithi063 ceph-mon[36747]: pgmap v2676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:41:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:41:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:41:58 smithi043 ceph-mon[32384]: pgmap v2677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:41:58 smithi133 ceph-mon[37053]: pgmap v2677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:41:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:41:58 smithi063 ceph-mon[36747]: pgmap v2677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:00 smithi043 ceph-mon[32384]: pgmap v2678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3966.796517 secs 2024-07-26T09:42:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:00 smithi133 ceph-mon[37053]: pgmap v2678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3966.796517 secs 2024-07-26T09:42:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:00 smithi063 ceph-mon[36747]: pgmap v2678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3966.796517 secs 2024-07-26T09:42:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3982.279735 secs 2024-07-26T09:42:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3982.279735 secs 2024-07-26T09:42:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3982.279735 secs 2024-07-26T09:42:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:02 smithi133 ceph-mon[37053]: pgmap v2679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:02 smithi063 ceph-mon[36747]: pgmap v2679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:02 smithi043 ceph-mon[32384]: pgmap v2679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:04 smithi133 ceph-mon[37053]: pgmap v2680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:04 smithi063 ceph-mon[36747]: pgmap v2680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:04 smithi043 ceph-mon[32384]: pgmap v2680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3971.796603 secs 2024-07-26T09:42:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3971.796603 secs 2024-07-26T09:42:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3971.796603 secs 2024-07-26T09:42:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3987.279849 secs 2024-07-26T09:42:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:07 smithi133 ceph-mon[37053]: pgmap v2681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3987.279849 secs 2024-07-26T09:42:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:07 smithi063 ceph-mon[36747]: pgmap v2681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3987.279849 secs 2024-07-26T09:42:07.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:07 smithi043 ceph-mon[32384]: pgmap v2681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:09 smithi063 ceph-mon[36747]: pgmap v2682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:09 smithi043 ceph-mon[32384]: pgmap v2682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:09 smithi133 ceph-mon[37053]: pgmap v2682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:11 smithi063 ceph-mon[36747]: pgmap v2683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3976.796697 secs 2024-07-26T09:42:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:11 smithi043 ceph-mon[32384]: pgmap v2683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3976.796697 secs 2024-07-26T09:42:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:11 smithi133 ceph-mon[37053]: pgmap v2683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3976.796697 secs 2024-07-26T09:42:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3992.279969 secs 2024-07-26T09:42:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3992.279969 secs 2024-07-26T09:42:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3992.279969 secs 2024-07-26T09:42:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:13 smithi063 ceph-mon[36747]: pgmap v2684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:13 smithi043 ceph-mon[32384]: pgmap v2684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:13 smithi133 ceph-mon[37053]: pgmap v2684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:15 smithi063 ceph-mon[36747]: pgmap v2685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:15 smithi043 ceph-mon[32384]: pgmap v2685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:15 smithi133 ceph-mon[37053]: pgmap v2685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3981.796827 secs 2024-07-26T09:42:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3981.796827 secs 2024-07-26T09:42:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3981.796827 secs 2024-07-26T09:42:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 3997.280091 secs 2024-07-26T09:42:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:17 smithi063 ceph-mon[36747]: pgmap v2686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 3997.280091 secs 2024-07-26T09:42:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:17 smithi043 ceph-mon[32384]: pgmap v2686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 3997.280091 secs 2024-07-26T09:42:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:17 smithi133 ceph-mon[37053]: pgmap v2686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:19 smithi063 ceph-mon[36747]: pgmap v2687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:19 smithi043 ceph-mon[32384]: pgmap v2687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:19 smithi133 ceph-mon[37053]: pgmap v2687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:21 smithi043 ceph-mon[32384]: pgmap v2688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3986.796951 secs 2024-07-26T09:42:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:21 smithi133 ceph-mon[37053]: pgmap v2688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3986.796951 secs 2024-07-26T09:42:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:21 smithi063 ceph-mon[36747]: pgmap v2688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3986.796951 secs 2024-07-26T09:42:22.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4002.280216 secs 2024-07-26T09:42:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4002.280216 secs 2024-07-26T09:42:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4002.280216 secs 2024-07-26T09:42:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:23 smithi043 ceph-mon[32384]: pgmap v2689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:23 smithi133 ceph-mon[37053]: pgmap v2689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:23 smithi063 ceph-mon[36747]: pgmap v2689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:25 smithi043 ceph-mon[32384]: pgmap v2690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:25 smithi133 ceph-mon[37053]: pgmap v2690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:25 smithi063 ceph-mon[36747]: pgmap v2690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3991.797090 secs 2024-07-26T09:42:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3991.797090 secs 2024-07-26T09:42:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3991.797090 secs 2024-07-26T09:42:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4007.280335 secs 2024-07-26T09:42:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:27 smithi043 ceph-mon[32384]: pgmap v2691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4007.280335 secs 2024-07-26T09:42:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:27 smithi133 ceph-mon[37053]: pgmap v2691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4007.280335 secs 2024-07-26T09:42:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:27 smithi063 ceph-mon[36747]: pgmap v2691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:29 smithi043 ceph-mon[32384]: pgmap v2692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:42:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:29 smithi133 ceph-mon[37053]: pgmap v2692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:42:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:29 smithi063 ceph-mon[36747]: pgmap v2692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:42:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:31 smithi043 ceph-mon[32384]: pgmap v2693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 3996.797183 secs 2024-07-26T09:42:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4012.280463 secs 2024-07-26T09:42:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:31 smithi133 ceph-mon[37053]: pgmap v2693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 3996.797183 secs 2024-07-26T09:42:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4012.280463 secs 2024-07-26T09:42:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:31 smithi063 ceph-mon[36747]: pgmap v2693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 3996.797183 secs 2024-07-26T09:42:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4012.280463 secs 2024-07-26T09:42:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:33 smithi043 ceph-mon[32384]: pgmap v2694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:33 smithi133 ceph-mon[37053]: pgmap v2694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:33 smithi063 ceph-mon[36747]: pgmap v2694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:35 smithi043 ceph-mon[32384]: pgmap v2695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:42:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:35 smithi133 ceph-mon[37053]: pgmap v2695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:42:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:35 smithi063 ceph-mon[36747]: pgmap v2695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:42:36.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4001.797306 secs 2024-07-26T09:42:36.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4017.280583 secs 2024-07-26T09:42:36.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4001.797306 secs 2024-07-26T09:42:36.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4017.280583 secs 2024-07-26T09:42:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4001.797306 secs 2024-07-26T09:42:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4017.280583 secs 2024-07-26T09:42:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:37 smithi043 ceph-mon[32384]: pgmap v2696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:37 smithi133 ceph-mon[37053]: pgmap v2696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:37 smithi063 ceph-mon[36747]: pgmap v2696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:42:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:39 smithi043 ceph-mon[32384]: pgmap v2697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:39 smithi133 ceph-mon[37053]: pgmap v2697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:39 smithi063 ceph-mon[36747]: pgmap v2697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:41 smithi043 ceph-mon[32384]: pgmap v2698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4006.797436 secs 2024-07-26T09:42:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4022.280698 secs 2024-07-26T09:42:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:41 smithi133 ceph-mon[37053]: pgmap v2698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4006.797436 secs 2024-07-26T09:42:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4022.280698 secs 2024-07-26T09:42:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:41 smithi063 ceph-mon[36747]: pgmap v2698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4006.797436 secs 2024-07-26T09:42:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4022.280698 secs 2024-07-26T09:42:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:43 smithi043 ceph-mon[32384]: pgmap v2699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:43 smithi133 ceph-mon[37053]: pgmap v2699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:43 smithi063 ceph-mon[36747]: pgmap v2699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:45 smithi043 ceph-mon[32384]: pgmap v2700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:45 smithi133 ceph-mon[37053]: pgmap v2700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:45 smithi063 ceph-mon[36747]: pgmap v2700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4011.797496 secs 2024-07-26T09:42:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4027.280851 secs 2024-07-26T09:42:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4011.797496 secs 2024-07-26T09:42:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4027.280851 secs 2024-07-26T09:42:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4011.797496 secs 2024-07-26T09:42:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4027.280851 secs 2024-07-26T09:42:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:47 smithi043 ceph-mon[32384]: pgmap v2701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:47 smithi133 ceph-mon[37053]: pgmap v2701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:47 smithi063 ceph-mon[36747]: pgmap v2701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:49 smithi043 ceph-mon[32384]: pgmap v2702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:49 smithi133 ceph-mon[37053]: pgmap v2702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:49 smithi063 ceph-mon[36747]: pgmap v2702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:51 smithi043 ceph-mon[32384]: pgmap v2703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4016.797618 secs 2024-07-26T09:42:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4032.280992 secs 2024-07-26T09:42:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:51 smithi133 ceph-mon[37053]: pgmap v2703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4016.797618 secs 2024-07-26T09:42:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4032.280992 secs 2024-07-26T09:42:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:51 smithi063 ceph-mon[36747]: pgmap v2703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:42:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4016.797618 secs 2024-07-26T09:42:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4032.280992 secs 2024-07-26T09:42:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:53 smithi043 ceph-mon[32384]: pgmap v2704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:53 smithi133 ceph-mon[37053]: pgmap v2704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:53 smithi063 ceph-mon[36747]: pgmap v2704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:55 smithi043 ceph-mon[32384]: pgmap v2705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:55 smithi133 ceph-mon[37053]: pgmap v2705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:55 smithi063 ceph-mon[36747]: pgmap v2705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:42:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4021.797742 secs 2024-07-26T09:42:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4037.281130 secs 2024-07-26T09:42:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4021.797742 secs 2024-07-26T09:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4037.281130 secs 2024-07-26T09:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:42:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4021.797742 secs 2024-07-26T09:42:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4037.281130 secs 2024-07-26T09:42:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:42:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:57 smithi043 ceph-mon[32384]: pgmap v2706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:42:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:42:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:42:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:57 smithi133 ceph-mon[37053]: pgmap v2706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:42:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:42:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:42:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:57 smithi063 ceph-mon[36747]: pgmap v2706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:42:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:42:57.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:42:57.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:42:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:58 smithi043 ceph-mon[32384]: pgmap v2707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:42:58.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:42:58 smithi043 ceph-mon[32384]: pgmap v2708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:58 smithi133 ceph-mon[37053]: pgmap v2707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:42:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:42:58 smithi133 ceph-mon[37053]: pgmap v2708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:42:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:58 smithi063 ceph-mon[36747]: pgmap v2707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:42:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:42:58 smithi063 ceph-mon[36747]: pgmap v2708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:43:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:00 smithi043 ceph-mon[32384]: pgmap v2709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:43:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:00 smithi133 ceph-mon[37053]: pgmap v2709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:43:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:00 smithi063 ceph-mon[36747]: pgmap v2709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:43:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4026.797862 secs 2024-07-26T09:43:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4042.281250 secs 2024-07-26T09:43:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4026.797862 secs 2024-07-26T09:43:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4042.281250 secs 2024-07-26T09:43:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4026.797862 secs 2024-07-26T09:43:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4042.281250 secs 2024-07-26T09:43:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:02 smithi043 ceph-mon[32384]: pgmap v2710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:43:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:02 smithi133 ceph-mon[37053]: pgmap v2710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:43:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:02 smithi063 ceph-mon[36747]: pgmap v2710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:43:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:04 smithi133 ceph-mon[37053]: pgmap v2711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:43:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:04 smithi063 ceph-mon[36747]: pgmap v2711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:43:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:04 smithi043 ceph-mon[32384]: pgmap v2711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:43:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4031.797956 secs 2024-07-26T09:43:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:06 smithi133 ceph-mon[37053]: pgmap v2712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:43:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4047.281363 secs 2024-07-26T09:43:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4031.797956 secs 2024-07-26T09:43:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:06 smithi063 ceph-mon[36747]: pgmap v2712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:43:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4047.281363 secs 2024-07-26T09:43:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4031.797956 secs 2024-07-26T09:43:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:06 smithi043 ceph-mon[32384]: pgmap v2712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:43:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4047.281363 secs 2024-07-26T09:43:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:08 smithi133 ceph-mon[37053]: pgmap v2713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:43:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:08 smithi063 ceph-mon[36747]: pgmap v2713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:43:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:08 smithi043 ceph-mon[32384]: pgmap v2713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:43:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:10 smithi133 ceph-mon[37053]: pgmap v2714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:10 smithi063 ceph-mon[36747]: pgmap v2714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:10 smithi043 ceph-mon[32384]: pgmap v2714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4036.798076 secs 2024-07-26T09:43:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4052.281487 secs 2024-07-26T09:43:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4036.798076 secs 2024-07-26T09:43:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4052.281487 secs 2024-07-26T09:43:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4036.798076 secs 2024-07-26T09:43:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4052.281487 secs 2024-07-26T09:43:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:12 smithi133 ceph-mon[37053]: pgmap v2715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:12 smithi063 ceph-mon[36747]: pgmap v2715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:12 smithi043 ceph-mon[32384]: pgmap v2715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:14 smithi063 ceph-mon[36747]: pgmap v2716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:14 smithi043 ceph-mon[32384]: pgmap v2716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:14 smithi133 ceph-mon[37053]: pgmap v2716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4041.798199 secs 2024-07-26T09:43:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:16 smithi063 ceph-mon[36747]: pgmap v2717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4057.281603 secs 2024-07-26T09:43:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4041.798199 secs 2024-07-26T09:43:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:16 smithi043 ceph-mon[32384]: pgmap v2717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4057.281603 secs 2024-07-26T09:43:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4041.798199 secs 2024-07-26T09:43:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:16 smithi133 ceph-mon[37053]: pgmap v2717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4057.281603 secs 2024-07-26T09:43:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:18 smithi063 ceph-mon[36747]: pgmap v2718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:18 smithi043 ceph-mon[32384]: pgmap v2718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:18 smithi133 ceph-mon[37053]: pgmap v2718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:20 smithi063 ceph-mon[36747]: pgmap v2719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:20 smithi043 ceph-mon[32384]: pgmap v2719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:20 smithi133 ceph-mon[37053]: pgmap v2719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4046.798319 secs 2024-07-26T09:43:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4062.281746 secs 2024-07-26T09:43:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4046.798319 secs 2024-07-26T09:43:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4062.281746 secs 2024-07-26T09:43:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4046.798319 secs 2024-07-26T09:43:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4062.281746 secs 2024-07-26T09:43:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:22 smithi063 ceph-mon[36747]: pgmap v2720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:22 smithi043 ceph-mon[32384]: pgmap v2720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:22 smithi133 ceph-mon[37053]: pgmap v2720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:24 smithi063 ceph-mon[36747]: pgmap v2721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:24.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:24 smithi043 ceph-mon[32384]: pgmap v2721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:24 smithi133 ceph-mon[37053]: pgmap v2721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4051.798437 secs 2024-07-26T09:43:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:26 smithi063 ceph-mon[36747]: pgmap v2722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4067.281902 secs 2024-07-26T09:43:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4051.798437 secs 2024-07-26T09:43:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:26 smithi043 ceph-mon[32384]: pgmap v2722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4067.281902 secs 2024-07-26T09:43:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4051.798437 secs 2024-07-26T09:43:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:26 smithi133 ceph-mon[37053]: pgmap v2722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4067.281902 secs 2024-07-26T09:43:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:28 smithi063 ceph-mon[36747]: pgmap v2723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:28 smithi043 ceph-mon[32384]: pgmap v2723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:28 smithi133 ceph-mon[37053]: pgmap v2723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:30 smithi043 ceph-mon[32384]: pgmap v2724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:30 smithi133 ceph-mon[37053]: pgmap v2724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:30 smithi063 ceph-mon[36747]: pgmap v2724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4056.798556 secs 2024-07-26T09:43:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4072.281994 secs 2024-07-26T09:43:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4056.798556 secs 2024-07-26T09:43:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4072.281994 secs 2024-07-26T09:43:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4056.798556 secs 2024-07-26T09:43:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4072.281994 secs 2024-07-26T09:43:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:32 smithi043 ceph-mon[32384]: pgmap v2725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:32 smithi133 ceph-mon[37053]: pgmap v2725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:32 smithi063 ceph-mon[36747]: pgmap v2725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:34 smithi043 ceph-mon[32384]: pgmap v2726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:34 smithi133 ceph-mon[37053]: pgmap v2726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:34 smithi063 ceph-mon[36747]: pgmap v2726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:36.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4061.798691 secs 2024-07-26T09:43:36.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:36 smithi063 ceph-mon[36747]: pgmap v2727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:36.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4077.282103 secs 2024-07-26T09:43:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4061.798691 secs 2024-07-26T09:43:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:36 smithi043 ceph-mon[32384]: pgmap v2727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4077.282103 secs 2024-07-26T09:43:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4061.798691 secs 2024-07-26T09:43:36.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:36 smithi133 ceph-mon[37053]: pgmap v2727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:36.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4077.282103 secs 2024-07-26T09:43:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:38 smithi043 ceph-mon[32384]: pgmap v2728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:38 smithi133 ceph-mon[37053]: pgmap v2728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:38 smithi063 ceph-mon[36747]: pgmap v2728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:40 smithi043 ceph-mon[32384]: pgmap v2729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:40 smithi133 ceph-mon[37053]: pgmap v2729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:40 smithi063 ceph-mon[36747]: pgmap v2729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4066.798813 secs 2024-07-26T09:43:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4082.282234 secs 2024-07-26T09:43:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4066.798813 secs 2024-07-26T09:43:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4082.282234 secs 2024-07-26T09:43:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4066.798813 secs 2024-07-26T09:43:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4082.282234 secs 2024-07-26T09:43:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:42 smithi043 ceph-mon[32384]: pgmap v2730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:42 smithi133 ceph-mon[37053]: pgmap v2730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:42 smithi063 ceph-mon[36747]: pgmap v2730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:44 smithi043 ceph-mon[32384]: pgmap v2731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:44 smithi133 ceph-mon[37053]: pgmap v2731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:44 smithi063 ceph-mon[36747]: pgmap v2731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4071.798934 secs 2024-07-26T09:43:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:46 smithi043 ceph-mon[32384]: pgmap v2732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4087.282358 secs 2024-07-26T09:43:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4071.798934 secs 2024-07-26T09:43:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:46 smithi133 ceph-mon[37053]: pgmap v2732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4087.282358 secs 2024-07-26T09:43:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4071.798934 secs 2024-07-26T09:43:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:46 smithi063 ceph-mon[36747]: pgmap v2732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4087.282358 secs 2024-07-26T09:43:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:48 smithi043 ceph-mon[32384]: pgmap v2733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:48 smithi133 ceph-mon[37053]: pgmap v2733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:48 smithi063 ceph-mon[36747]: pgmap v2733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:50 smithi043 ceph-mon[32384]: pgmap v2734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:50 smithi133 ceph-mon[37053]: pgmap v2734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:50 smithi063 ceph-mon[36747]: pgmap v2734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4076.799078 secs 2024-07-26T09:43:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4092.282480 secs 2024-07-26T09:43:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4076.799078 secs 2024-07-26T09:43:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4092.282480 secs 2024-07-26T09:43:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4076.799078 secs 2024-07-26T09:43:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4092.282480 secs 2024-07-26T09:43:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:52 smithi043 ceph-mon[32384]: pgmap v2735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:52 smithi133 ceph-mon[37053]: pgmap v2735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:52 smithi063 ceph-mon[36747]: pgmap v2735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:43:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:53 smithi043 ceph-mon[32384]: pgmap v2736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:53 smithi133 ceph-mon[37053]: pgmap v2736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:53 smithi063 ceph-mon[36747]: pgmap v2736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4081.799199 secs 2024-07-26T09:43:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:56 smithi063 ceph-mon[36747]: pgmap v2737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4097.282559 secs 2024-07-26T09:43:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4081.799199 secs 2024-07-26T09:43:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:56 smithi043 ceph-mon[32384]: pgmap v2737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4097.282559 secs 2024-07-26T09:43:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4081.799199 secs 2024-07-26T09:43:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:56 smithi133 ceph-mon[37053]: pgmap v2737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:43:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4097.282559 secs 2024-07-26T09:43:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:58 smithi063 ceph-mon[36747]: pgmap v2738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:58.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:43:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:58 smithi043 ceph-mon[32384]: pgmap v2738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:43:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:58 smithi133 ceph-mon[37053]: pgmap v2738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:43:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:43:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:43:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:43:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:43:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:43:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:43:59.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:43:59.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:43:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:43:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:43:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:43:59.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:43:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:44:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:00 smithi063 ceph-mon[36747]: pgmap v2739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:00.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:00 smithi063 ceph-mon[36747]: pgmap v2740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:44:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:00 smithi043 ceph-mon[32384]: pgmap v2739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:00 smithi043 ceph-mon[32384]: pgmap v2740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:44:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:00 smithi133 ceph-mon[37053]: pgmap v2739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:00 smithi133 ceph-mon[37053]: pgmap v2740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:44:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4086.799329 secs 2024-07-26T09:44:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4102.282703 secs 2024-07-26T09:44:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4086.799329 secs 2024-07-26T09:44:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4102.282703 secs 2024-07-26T09:44:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4086.799329 secs 2024-07-26T09:44:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4102.282703 secs 2024-07-26T09:44:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:02 smithi063 ceph-mon[36747]: pgmap v2741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:02 smithi043 ceph-mon[32384]: pgmap v2741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:02 smithi133 ceph-mon[37053]: pgmap v2741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:04 smithi063 ceph-mon[36747]: pgmap v2742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:44:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:04 smithi043 ceph-mon[32384]: pgmap v2742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:44:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:04 smithi133 ceph-mon[37053]: pgmap v2742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:44:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:06 smithi043 ceph-mon[32384]: pgmap v2743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4091.799442 secs 2024-07-26T09:44:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4107.282846 secs 2024-07-26T09:44:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:06 smithi133 ceph-mon[37053]: pgmap v2743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4091.799442 secs 2024-07-26T09:44:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4107.282846 secs 2024-07-26T09:44:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:06 smithi063 ceph-mon[36747]: pgmap v2743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:44:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4091.799442 secs 2024-07-26T09:44:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4107.282846 secs 2024-07-26T09:44:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:08 smithi043 ceph-mon[32384]: pgmap v2744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:44:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:08 smithi133 ceph-mon[37053]: pgmap v2744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:44:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:08 smithi063 ceph-mon[36747]: pgmap v2744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:44:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:10 smithi043 ceph-mon[32384]: pgmap v2745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:44:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:10 smithi133 ceph-mon[37053]: pgmap v2745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:44:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:10 smithi063 ceph-mon[36747]: pgmap v2745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:44:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4096.799562 secs 2024-07-26T09:44:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4112.282968 secs 2024-07-26T09:44:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4096.799562 secs 2024-07-26T09:44:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4112.282968 secs 2024-07-26T09:44:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4096.799562 secs 2024-07-26T09:44:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4112.282968 secs 2024-07-26T09:44:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:12 smithi043 ceph-mon[32384]: pgmap v2746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:12 smithi133 ceph-mon[37053]: pgmap v2746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:12 smithi063 ceph-mon[36747]: pgmap v2746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:14 smithi043 ceph-mon[32384]: pgmap v2747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:14 smithi133 ceph-mon[37053]: pgmap v2747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:14 smithi063 ceph-mon[36747]: pgmap v2747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:16 smithi043 ceph-mon[32384]: pgmap v2748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4101.799689 secs 2024-07-26T09:44:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4117.283090 secs 2024-07-26T09:44:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:16 smithi133 ceph-mon[37053]: pgmap v2748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4101.799689 secs 2024-07-26T09:44:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4117.283090 secs 2024-07-26T09:44:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:16 smithi063 ceph-mon[36747]: pgmap v2748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4101.799689 secs 2024-07-26T09:44:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4117.283090 secs 2024-07-26T09:44:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:18 smithi043 ceph-mon[32384]: pgmap v2749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:18 smithi133 ceph-mon[37053]: pgmap v2749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:18 smithi063 ceph-mon[36747]: pgmap v2749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:20 smithi043 ceph-mon[32384]: pgmap v2750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:20 smithi133 ceph-mon[37053]: pgmap v2750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:20 smithi063 ceph-mon[36747]: pgmap v2750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4106.799814 secs 2024-07-26T09:44:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4122.283209 secs 2024-07-26T09:44:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4106.799814 secs 2024-07-26T09:44:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4122.283209 secs 2024-07-26T09:44:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4106.799814 secs 2024-07-26T09:44:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4122.283209 secs 2024-07-26T09:44:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:22 smithi043 ceph-mon[32384]: pgmap v2751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:22 smithi133 ceph-mon[37053]: pgmap v2751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:22 smithi063 ceph-mon[36747]: pgmap v2751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:24 smithi043 ceph-mon[32384]: pgmap v2752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:24 smithi133 ceph-mon[37053]: pgmap v2752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:24 smithi063 ceph-mon[36747]: pgmap v2752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:26 smithi043 ceph-mon[32384]: pgmap v2753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4111.799952 secs 2024-07-26T09:44:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4127.283292 secs 2024-07-26T09:44:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:26 smithi133 ceph-mon[37053]: pgmap v2753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4111.799952 secs 2024-07-26T09:44:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4127.283292 secs 2024-07-26T09:44:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:26 smithi063 ceph-mon[36747]: pgmap v2753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4111.799952 secs 2024-07-26T09:44:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4127.283292 secs 2024-07-26T09:44:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:28 smithi043 ceph-mon[32384]: pgmap v2754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:28 smithi133 ceph-mon[37053]: pgmap v2754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:28 smithi063 ceph-mon[36747]: pgmap v2754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:30 smithi043 ceph-mon[32384]: pgmap v2755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:30 smithi133 ceph-mon[37053]: pgmap v2755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:30 smithi063 ceph-mon[36747]: pgmap v2755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4116.800073 secs 2024-07-26T09:44:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4132.283364 secs 2024-07-26T09:44:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4116.800073 secs 2024-07-26T09:44:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4132.283364 secs 2024-07-26T09:44:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4116.800073 secs 2024-07-26T09:44:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4132.283364 secs 2024-07-26T09:44:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:32 smithi043 ceph-mon[32384]: pgmap v2756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:32 smithi133 ceph-mon[37053]: pgmap v2756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:32 smithi063 ceph-mon[36747]: pgmap v2756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:33 smithi043 ceph-mon[32384]: pgmap v2757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:33 smithi133 ceph-mon[37053]: pgmap v2757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:33 smithi063 ceph-mon[36747]: pgmap v2757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:35 smithi063 ceph-mon[36747]: pgmap v2758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:35 smithi043 ceph-mon[32384]: pgmap v2758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:35 smithi133 ceph-mon[37053]: pgmap v2758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4121.800178 secs 2024-07-26T09:44:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4137.283455 secs 2024-07-26T09:44:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4121.800178 secs 2024-07-26T09:44:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4137.283455 secs 2024-07-26T09:44:36.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4121.800178 secs 2024-07-26T09:44:36.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4137.283455 secs 2024-07-26T09:44:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:37 smithi063 ceph-mon[36747]: pgmap v2759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:37 smithi043 ceph-mon[32384]: pgmap v2759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:37 smithi133 ceph-mon[37053]: pgmap v2759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:39 smithi063 ceph-mon[36747]: pgmap v2760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:39 smithi043 ceph-mon[32384]: pgmap v2760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:39 smithi133 ceph-mon[37053]: pgmap v2760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4126.800294 secs 2024-07-26T09:44:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:41 smithi063 ceph-mon[36747]: pgmap v2761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4142.283574 secs 2024-07-26T09:44:41.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4126.800294 secs 2024-07-26T09:44:41.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:41 smithi043 ceph-mon[32384]: pgmap v2761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:41.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4142.283574 secs 2024-07-26T09:44:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4126.800294 secs 2024-07-26T09:44:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:41 smithi133 ceph-mon[37053]: pgmap v2761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4142.283574 secs 2024-07-26T09:44:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:43 smithi063 ceph-mon[36747]: pgmap v2762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:43 smithi043 ceph-mon[32384]: pgmap v2762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:43 smithi133 ceph-mon[37053]: pgmap v2762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:45 smithi043 ceph-mon[32384]: pgmap v2763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:45 smithi133 ceph-mon[37053]: pgmap v2763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:45 smithi063 ceph-mon[36747]: pgmap v2763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4131.800412 secs 2024-07-26T09:44:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4147.283693 secs 2024-07-26T09:44:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4131.800412 secs 2024-07-26T09:44:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4147.283693 secs 2024-07-26T09:44:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4131.800412 secs 2024-07-26T09:44:47.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4147.283693 secs 2024-07-26T09:44:47.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:47 smithi043 ceph-mon[32384]: pgmap v2764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:47 smithi133 ceph-mon[37053]: pgmap v2764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:47 smithi063 ceph-mon[36747]: pgmap v2764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:49 smithi043 ceph-mon[32384]: pgmap v2765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:49 smithi133 ceph-mon[37053]: pgmap v2765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:49 smithi063 ceph-mon[36747]: pgmap v2765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4136.800541 secs 2024-07-26T09:44:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:51 smithi043 ceph-mon[32384]: pgmap v2766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4152.283794 secs 2024-07-26T09:44:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4136.800541 secs 2024-07-26T09:44:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:51 smithi133 ceph-mon[37053]: pgmap v2766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4152.283794 secs 2024-07-26T09:44:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4136.800541 secs 2024-07-26T09:44:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:51 smithi063 ceph-mon[36747]: pgmap v2766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4152.283794 secs 2024-07-26T09:44:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:53 smithi043 ceph-mon[32384]: pgmap v2767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:53 smithi133 ceph-mon[37053]: pgmap v2767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:53 smithi063 ceph-mon[36747]: pgmap v2767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:44:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:55 smithi043 ceph-mon[32384]: pgmap v2768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:55 smithi133 ceph-mon[37053]: pgmap v2768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:55 smithi063 ceph-mon[36747]: pgmap v2768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:44:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4141.800656 secs 2024-07-26T09:44:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4157.283920 secs 2024-07-26T09:44:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4141.800656 secs 2024-07-26T09:44:57.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4157.283920 secs 2024-07-26T09:44:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4141.800656 secs 2024-07-26T09:44:57.085 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4157.283920 secs 2024-07-26T09:44:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:57 smithi043 ceph-mon[32384]: pgmap v2769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:57 smithi133 ceph-mon[37053]: pgmap v2769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:57 smithi063 ceph-mon[36747]: pgmap v2769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:44:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:44:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:44:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:45:00.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:59 smithi043 ceph-mon[32384]: pgmap v2770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:00.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:45:00.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:45:00.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:45:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:59 smithi133 ceph-mon[37053]: pgmap v2770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:00.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:45:00.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:45:00.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:45:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:59 smithi063 ceph-mon[36747]: pgmap v2770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:45:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:45:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:45:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:00 smithi043 ceph-mon[32384]: pgmap v2771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:01.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4146.800774 secs 2024-07-26T09:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:00 smithi133 ceph-mon[37053]: pgmap v2771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4146.800774 secs 2024-07-26T09:45:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:00 smithi063 ceph-mon[36747]: pgmap v2771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4146.800774 secs 2024-07-26T09:45:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4162.284036 secs 2024-07-26T09:45:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4162.284036 secs 2024-07-26T09:45:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4162.284036 secs 2024-07-26T09:45:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:02 smithi043 ceph-mon[32384]: pgmap v2772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:02 smithi133 ceph-mon[37053]: pgmap v2772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:02 smithi063 ceph-mon[36747]: pgmap v2772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:04 smithi043 ceph-mon[32384]: pgmap v2773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:04 smithi133 ceph-mon[37053]: pgmap v2773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:04 smithi063 ceph-mon[36747]: pgmap v2773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:06.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4151.800921 secs 2024-07-26T09:45:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4151.800921 secs 2024-07-26T09:45:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4151.800921 secs 2024-07-26T09:45:07.183 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4167.284153 secs 2024-07-26T09:45:07.183 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:06 smithi133 ceph-mon[37053]: pgmap v2774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4167.284153 secs 2024-07-26T09:45:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:06 smithi043 ceph-mon[32384]: pgmap v2774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4167.284153 secs 2024-07-26T09:45:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:06 smithi063 ceph-mon[36747]: pgmap v2774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:08 smithi043 ceph-mon[32384]: pgmap v2775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:08 smithi133 ceph-mon[37053]: pgmap v2775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:08 smithi063 ceph-mon[36747]: pgmap v2775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:45:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:10 smithi043 ceph-mon[32384]: pgmap v2776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:11.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4156.801078 secs 2024-07-26T09:45:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:10 smithi133 ceph-mon[37053]: pgmap v2776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4156.801078 secs 2024-07-26T09:45:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:10 smithi063 ceph-mon[36747]: pgmap v2776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:45:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4156.801078 secs 2024-07-26T09:45:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4172.284292 secs 2024-07-26T09:45:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4172.284292 secs 2024-07-26T09:45:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4172.284292 secs 2024-07-26T09:45:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:12 smithi043 ceph-mon[32384]: pgmap v2777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:12 smithi133 ceph-mon[37053]: pgmap v2777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:12 smithi063 ceph-mon[36747]: pgmap v2777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:14 smithi043 ceph-mon[32384]: pgmap v2778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:14 smithi133 ceph-mon[37053]: pgmap v2778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:14 smithi063 ceph-mon[36747]: pgmap v2778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4161.801159 secs 2024-07-26T09:45:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4161.801159 secs 2024-07-26T09:45:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4161.801159 secs 2024-07-26T09:45:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4177.284430 secs 2024-07-26T09:45:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:16 smithi043 ceph-mon[32384]: pgmap v2779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4177.284430 secs 2024-07-26T09:45:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:16 smithi133 ceph-mon[37053]: pgmap v2779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4177.284430 secs 2024-07-26T09:45:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:16 smithi063 ceph-mon[36747]: pgmap v2779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:18 smithi043 ceph-mon[32384]: pgmap v2780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:18 smithi133 ceph-mon[37053]: pgmap v2780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:18 smithi063 ceph-mon[36747]: pgmap v2780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:20 smithi043 ceph-mon[32384]: pgmap v2781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4166.801279 secs 2024-07-26T09:45:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:20 smithi133 ceph-mon[37053]: pgmap v2781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4166.801279 secs 2024-07-26T09:45:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:20 smithi063 ceph-mon[36747]: pgmap v2781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4166.801279 secs 2024-07-26T09:45:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4182.284577 secs 2024-07-26T09:45:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4182.284577 secs 2024-07-26T09:45:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4182.284577 secs 2024-07-26T09:45:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:22 smithi043 ceph-mon[32384]: pgmap v2782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:22 smithi133 ceph-mon[37053]: pgmap v2782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:22 smithi063 ceph-mon[36747]: pgmap v2782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:24 smithi043 ceph-mon[32384]: pgmap v2783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:24 smithi133 ceph-mon[37053]: pgmap v2783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:24 smithi063 ceph-mon[36747]: pgmap v2783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4171.801399 secs 2024-07-26T09:45:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4171.801399 secs 2024-07-26T09:45:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4171.801399 secs 2024-07-26T09:45:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4187.284715 secs 2024-07-26T09:45:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:26 smithi043 ceph-mon[32384]: pgmap v2784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4187.284715 secs 2024-07-26T09:45:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:26 smithi133 ceph-mon[37053]: pgmap v2784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4187.284715 secs 2024-07-26T09:45:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:26 smithi063 ceph-mon[36747]: pgmap v2784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:28 smithi043 ceph-mon[32384]: pgmap v2785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:28 smithi133 ceph-mon[37053]: pgmap v2785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:28 smithi063 ceph-mon[36747]: pgmap v2785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:30 smithi133 ceph-mon[37053]: pgmap v2786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4176.801531 secs 2024-07-26T09:45:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:30 smithi063 ceph-mon[36747]: pgmap v2786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4176.801531 secs 2024-07-26T09:45:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:30 smithi043 ceph-mon[32384]: pgmap v2786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4176.801531 secs 2024-07-26T09:45:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4192.284839 secs 2024-07-26T09:45:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4192.284839 secs 2024-07-26T09:45:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4192.284839 secs 2024-07-26T09:45:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:33 smithi133 ceph-mon[37053]: pgmap v2787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:33 smithi063 ceph-mon[36747]: pgmap v2787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:33 smithi043 ceph-mon[32384]: pgmap v2787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:35 smithi133 ceph-mon[37053]: pgmap v2788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:35 smithi063 ceph-mon[36747]: pgmap v2788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:35 smithi043 ceph-mon[32384]: pgmap v2788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4181.801664 secs 2024-07-26T09:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4181.801664 secs 2024-07-26T09:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4181.801664 secs 2024-07-26T09:45:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4197.284938 secs 2024-07-26T09:45:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:37 smithi063 ceph-mon[36747]: pgmap v2789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4197.284938 secs 2024-07-26T09:45:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:37 smithi043 ceph-mon[32384]: pgmap v2789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4197.284938 secs 2024-07-26T09:45:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:37 smithi133 ceph-mon[37053]: pgmap v2789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:39 smithi063 ceph-mon[36747]: pgmap v2790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:39 smithi043 ceph-mon[32384]: pgmap v2790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:39 smithi133 ceph-mon[37053]: pgmap v2790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:41 smithi063 ceph-mon[36747]: pgmap v2791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:45:41.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4186.801804 secs 2024-07-26T09:45:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:41 smithi043 ceph-mon[32384]: pgmap v2791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:45:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4186.801804 secs 2024-07-26T09:45:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:41 smithi133 ceph-mon[37053]: pgmap v2791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:45:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4186.801804 secs 2024-07-26T09:45:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4202.285058 secs 2024-07-26T09:45:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4202.285058 secs 2024-07-26T09:45:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4202.285058 secs 2024-07-26T09:45:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:43 smithi063 ceph-mon[36747]: pgmap v2792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:45:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:43 smithi043 ceph-mon[32384]: pgmap v2792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:45:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:43 smithi133 ceph-mon[37053]: pgmap v2792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:45:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:45 smithi063 ceph-mon[36747]: pgmap v2793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:45 smithi043 ceph-mon[32384]: pgmap v2793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:45 smithi133 ceph-mon[37053]: pgmap v2793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4191.801955 secs 2024-07-26T09:45:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4191.801955 secs 2024-07-26T09:45:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4191.801955 secs 2024-07-26T09:45:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4207.285179 secs 2024-07-26T09:45:47.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:47 smithi063 ceph-mon[36747]: pgmap v2794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4207.285179 secs 2024-07-26T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:47 smithi043 ceph-mon[32384]: pgmap v2794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:45:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4207.285179 secs 2024-07-26T09:45:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:47 smithi133 ceph-mon[37053]: pgmap v2794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:45:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:49 smithi043 ceph-mon[32384]: pgmap v2795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:49 smithi133 ceph-mon[37053]: pgmap v2795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:49 smithi063 ceph-mon[36747]: pgmap v2795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:45:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:51 smithi043 ceph-mon[32384]: pgmap v2796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4196.802084 secs 2024-07-26T09:45:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:51 smithi133 ceph-mon[37053]: pgmap v2796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:51.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4196.802084 secs 2024-07-26T09:45:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:51 smithi063 ceph-mon[36747]: pgmap v2796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:45:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4196.802084 secs 2024-07-26T09:45:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4212.285273 secs 2024-07-26T09:45:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4212.285273 secs 2024-07-26T09:45:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4212.285273 secs 2024-07-26T09:45:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:53 smithi043 ceph-mon[32384]: pgmap v2797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:53 smithi133 ceph-mon[37053]: pgmap v2797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:53 smithi063 ceph-mon[36747]: pgmap v2797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:55 smithi043 ceph-mon[32384]: pgmap v2798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:55 smithi133 ceph-mon[37053]: pgmap v2798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:55 smithi063 ceph-mon[36747]: pgmap v2798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4201.802214 secs 2024-07-26T09:45:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4201.802214 secs 2024-07-26T09:45:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4201.802214 secs 2024-07-26T09:45:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4217.285396 secs 2024-07-26T09:45:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:57 smithi043 ceph-mon[32384]: pgmap v2799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4217.285396 secs 2024-07-26T09:45:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:57 smithi133 ceph-mon[37053]: pgmap v2799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4217.285396 secs 2024-07-26T09:45:57.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:57 smithi063 ceph-mon[36747]: pgmap v2799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:45:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:45:59 smithi043 ceph-mon[32384]: pgmap v2800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:45:59 smithi133 ceph-mon[37053]: pgmap v2800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:45:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:45:59 smithi063 ceph-mon[36747]: pgmap v2800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:46:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:46:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:01 smithi043 ceph-mon[32384]: pgmap v2801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4206.802309 secs 2024-07-26T09:46:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4222.285490 secs 2024-07-26T09:46:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:46:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:46:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:01 smithi133 ceph-mon[37053]: pgmap v2801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4206.802309 secs 2024-07-26T09:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4222.285490 secs 2024-07-26T09:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:46:01.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:46:01.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:01 smithi063 ceph-mon[36747]: pgmap v2801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4206.802309 secs 2024-07-26T09:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4222.285490 secs 2024-07-26T09:46:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:46:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:46:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:46:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:02 smithi043 ceph-mon[32384]: pgmap v2802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:02.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:02 smithi043 ceph-mon[32384]: pgmap v2803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:02 smithi133 ceph-mon[37053]: pgmap v2802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:02 smithi133 ceph-mon[37053]: pgmap v2803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:02 smithi063 ceph-mon[36747]: pgmap v2802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:02 smithi063 ceph-mon[36747]: pgmap v2803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:04 smithi043 ceph-mon[32384]: pgmap v2804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:46:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:04 smithi133 ceph-mon[37053]: pgmap v2804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:46:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:04 smithi063 ceph-mon[36747]: pgmap v2804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:46:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:06 smithi043 ceph-mon[32384]: pgmap v2805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:46:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4211.802404 secs 2024-07-26T09:46:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4227.285593 secs 2024-07-26T09:46:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:06 smithi133 ceph-mon[37053]: pgmap v2805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:46:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4211.802404 secs 2024-07-26T09:46:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4227.285593 secs 2024-07-26T09:46:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:06 smithi063 ceph-mon[36747]: pgmap v2805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:46:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4211.802404 secs 2024-07-26T09:46:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4227.285593 secs 2024-07-26T09:46:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:08 smithi043 ceph-mon[32384]: pgmap v2806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:46:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:08 smithi133 ceph-mon[37053]: pgmap v2806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:46:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:08 smithi063 ceph-mon[36747]: pgmap v2806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:46:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:10 smithi043 ceph-mon[32384]: pgmap v2807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:10 smithi133 ceph-mon[37053]: pgmap v2807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:10 smithi063 ceph-mon[36747]: pgmap v2807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:46:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4216.802523 secs 2024-07-26T09:46:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4232.285669 secs 2024-07-26T09:46:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4216.802523 secs 2024-07-26T09:46:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4232.285669 secs 2024-07-26T09:46:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4216.802523 secs 2024-07-26T09:46:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4232.285669 secs 2024-07-26T09:46:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:12 smithi043 ceph-mon[32384]: pgmap v2808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:46:12.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:12 smithi133 ceph-mon[37053]: pgmap v2808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:46:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:12 smithi063 ceph-mon[36747]: pgmap v2808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:46:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:14 smithi043 ceph-mon[32384]: pgmap v2809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:14 smithi133 ceph-mon[37053]: pgmap v2809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:14 smithi063 ceph-mon[36747]: pgmap v2809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:16 smithi043 ceph-mon[32384]: pgmap v2810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4221.802641 secs 2024-07-26T09:46:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4237.285791 secs 2024-07-26T09:46:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:16 smithi133 ceph-mon[37053]: pgmap v2810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4221.802641 secs 2024-07-26T09:46:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4237.285791 secs 2024-07-26T09:46:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:16 smithi063 ceph-mon[36747]: pgmap v2810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4221.802641 secs 2024-07-26T09:46:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4237.285791 secs 2024-07-26T09:46:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:18 smithi043 ceph-mon[32384]: pgmap v2811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:18 smithi133 ceph-mon[37053]: pgmap v2811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:18 smithi063 ceph-mon[36747]: pgmap v2811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:20 smithi043 ceph-mon[32384]: pgmap v2812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:20 smithi133 ceph-mon[37053]: pgmap v2812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:20 smithi063 ceph-mon[36747]: pgmap v2812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4226.802761 secs 2024-07-26T09:46:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4242.285915 secs 2024-07-26T09:46:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4226.802761 secs 2024-07-26T09:46:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4242.285915 secs 2024-07-26T09:46:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4226.802761 secs 2024-07-26T09:46:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4242.285915 secs 2024-07-26T09:46:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:22 smithi043 ceph-mon[32384]: pgmap v2813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:22 smithi133 ceph-mon[37053]: pgmap v2813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:22 smithi063 ceph-mon[36747]: pgmap v2813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:24 smithi043 ceph-mon[32384]: pgmap v2814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:24 smithi133 ceph-mon[37053]: pgmap v2814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:24 smithi063 ceph-mon[36747]: pgmap v2814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:26 smithi043 ceph-mon[32384]: pgmap v2815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4231.802903 secs 2024-07-26T09:46:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4247.286036 secs 2024-07-26T09:46:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:26 smithi133 ceph-mon[37053]: pgmap v2815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4231.802903 secs 2024-07-26T09:46:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4247.286036 secs 2024-07-26T09:46:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:26 smithi063 ceph-mon[36747]: pgmap v2815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4231.802903 secs 2024-07-26T09:46:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4247.286036 secs 2024-07-26T09:46:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:28 smithi133 ceph-mon[37053]: pgmap v2816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:28 smithi063 ceph-mon[36747]: pgmap v2816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:28 smithi043 ceph-mon[32384]: pgmap v2816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:30 smithi133 ceph-mon[37053]: pgmap v2817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:30 smithi063 ceph-mon[36747]: pgmap v2817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:30 smithi043 ceph-mon[32384]: pgmap v2817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4236.802998 secs 2024-07-26T09:46:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4252.286121 secs 2024-07-26T09:46:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4236.802998 secs 2024-07-26T09:46:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4252.286121 secs 2024-07-26T09:46:31.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4236.802998 secs 2024-07-26T09:46:31.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4252.286121 secs 2024-07-26T09:46:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:32 smithi133 ceph-mon[37053]: pgmap v2818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:32 smithi063 ceph-mon[36747]: pgmap v2818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:32 smithi043 ceph-mon[32384]: pgmap v2818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:34 smithi133 ceph-mon[37053]: pgmap v2819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:34 smithi063 ceph-mon[36747]: pgmap v2819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:34 smithi043 ceph-mon[32384]: pgmap v2819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:36 smithi063 ceph-mon[36747]: pgmap v2820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4241.803096 secs 2024-07-26T09:46:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4257.286198 secs 2024-07-26T09:46:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:36 smithi043 ceph-mon[32384]: pgmap v2820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4241.803096 secs 2024-07-26T09:46:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4257.286198 secs 2024-07-26T09:46:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:36 smithi133 ceph-mon[37053]: pgmap v2820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4241.803096 secs 2024-07-26T09:46:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4257.286198 secs 2024-07-26T09:46:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:38 smithi063 ceph-mon[36747]: pgmap v2821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:38 smithi043 ceph-mon[32384]: pgmap v2821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:38 smithi133 ceph-mon[37053]: pgmap v2821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:40.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:40 smithi043 ceph-mon[32384]: pgmap v2822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:40 smithi063 ceph-mon[36747]: pgmap v2822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:40 smithi133 ceph-mon[37053]: pgmap v2822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4246.803226 secs 2024-07-26T09:46:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4262.286316 secs 2024-07-26T09:46:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4246.803226 secs 2024-07-26T09:46:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4262.286316 secs 2024-07-26T09:46:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4246.803226 secs 2024-07-26T09:46:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4262.286316 secs 2024-07-26T09:46:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:42 smithi063 ceph-mon[36747]: pgmap v2823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:42 smithi043 ceph-mon[32384]: pgmap v2823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:42 smithi133 ceph-mon[37053]: pgmap v2823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:44 smithi063 ceph-mon[36747]: pgmap v2824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:44 smithi043 ceph-mon[32384]: pgmap v2824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:44 smithi133 ceph-mon[37053]: pgmap v2824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:46 smithi063 ceph-mon[36747]: pgmap v2825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4251.803351 secs 2024-07-26T09:46:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4267.286438 secs 2024-07-26T09:46:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:46 smithi043 ceph-mon[32384]: pgmap v2825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4251.803351 secs 2024-07-26T09:46:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4267.286438 secs 2024-07-26T09:46:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:46 smithi133 ceph-mon[37053]: pgmap v2825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4251.803351 secs 2024-07-26T09:46:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4267.286438 secs 2024-07-26T09:46:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:48 smithi063 ceph-mon[36747]: pgmap v2826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:48 smithi043 ceph-mon[32384]: pgmap v2826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:48 smithi133 ceph-mon[37053]: pgmap v2826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:50.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:50 smithi063 ceph-mon[36747]: pgmap v2827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:50 smithi043 ceph-mon[32384]: pgmap v2827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:50 smithi133 ceph-mon[37053]: pgmap v2827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4256.803470 secs 2024-07-26T09:46:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4272.286557 secs 2024-07-26T09:46:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4256.803470 secs 2024-07-26T09:46:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4272.286557 secs 2024-07-26T09:46:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4256.803470 secs 2024-07-26T09:46:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4272.286557 secs 2024-07-26T09:46:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:52 smithi043 ceph-mon[32384]: pgmap v2828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:52 smithi133 ceph-mon[37053]: pgmap v2828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:52 smithi063 ceph-mon[36747]: pgmap v2828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:54 smithi043 ceph-mon[32384]: pgmap v2829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:54 smithi133 ceph-mon[37053]: pgmap v2829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:54 smithi063 ceph-mon[36747]: pgmap v2829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:46:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:56 smithi043 ceph-mon[32384]: pgmap v2830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4261.803590 secs 2024-07-26T09:46:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4277.286645 secs 2024-07-26T09:46:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:56 smithi133 ceph-mon[37053]: pgmap v2830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4261.803590 secs 2024-07-26T09:46:56.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4277.286645 secs 2024-07-26T09:46:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:56 smithi063 ceph-mon[36747]: pgmap v2830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:46:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4261.803590 secs 2024-07-26T09:46:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4277.286645 secs 2024-07-26T09:46:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:46:58 smithi043 ceph-mon[32384]: pgmap v2831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:46:58 smithi133 ceph-mon[37053]: pgmap v2831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:46:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:46:58 smithi063 ceph-mon[36747]: pgmap v2831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:00 smithi043 ceph-mon[32384]: pgmap v2832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:00 smithi133 ceph-mon[37053]: pgmap v2832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:00.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:00 smithi063 ceph-mon[36747]: pgmap v2832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4266.803732 secs 2024-07-26T09:47:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4282.286777 secs 2024-07-26T09:47:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:47:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4266.803732 secs 2024-07-26T09:47:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4282.286777 secs 2024-07-26T09:47:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:47:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4266.803732 secs 2024-07-26T09:47:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4282.286777 secs 2024-07-26T09:47:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:47:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:02 smithi043 ceph-mon[32384]: pgmap v2833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:47:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:47:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:47:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:02 smithi133 ceph-mon[37053]: pgmap v2833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:47:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:47:02.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:47:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:02 smithi063 ceph-mon[36747]: pgmap v2833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:02.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:47:02.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:47:02.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:47:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:03 smithi043 ceph-mon[32384]: pgmap v2834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:47:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:03 smithi043 ceph-mon[32384]: pgmap v2835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:47:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:03 smithi133 ceph-mon[37053]: pgmap v2834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:47:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:03 smithi133 ceph-mon[37053]: pgmap v2835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:47:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:03 smithi063 ceph-mon[36747]: pgmap v2834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:47:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:03 smithi063 ceph-mon[36747]: pgmap v2835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:47:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:05 smithi043 ceph-mon[32384]: pgmap v2836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:47:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:05 smithi133 ceph-mon[37053]: pgmap v2836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:47:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:05 smithi063 ceph-mon[36747]: pgmap v2836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:47:06.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4271.803877 secs 2024-07-26T09:47:06.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4287.286927 secs 2024-07-26T09:47:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4271.803877 secs 2024-07-26T09:47:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4287.286927 secs 2024-07-26T09:47:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4271.803877 secs 2024-07-26T09:47:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4287.286927 secs 2024-07-26T09:47:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:07 smithi043 ceph-mon[32384]: pgmap v2837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:47:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:07 smithi133 ceph-mon[37053]: pgmap v2837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:47:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:07 smithi063 ceph-mon[36747]: pgmap v2837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:47:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:09 smithi043 ceph-mon[32384]: pgmap v2838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:47:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:09 smithi133 ceph-mon[37053]: pgmap v2838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:47:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:09 smithi063 ceph-mon[36747]: pgmap v2838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:47:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4276.803999 secs 2024-07-26T09:47:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:11 smithi043 ceph-mon[32384]: pgmap v2839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:47:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4292.287066 secs 2024-07-26T09:47:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4276.803999 secs 2024-07-26T09:47:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:11 smithi133 ceph-mon[37053]: pgmap v2839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:47:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4292.287066 secs 2024-07-26T09:47:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4276.803999 secs 2024-07-26T09:47:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:11 smithi063 ceph-mon[36747]: pgmap v2839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:47:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4292.287066 secs 2024-07-26T09:47:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:13 smithi043 ceph-mon[32384]: pgmap v2840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:47:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:13 smithi133 ceph-mon[37053]: pgmap v2840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:47:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:13 smithi063 ceph-mon[36747]: pgmap v2840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:47:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:15 smithi043 ceph-mon[32384]: pgmap v2841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:15 smithi133 ceph-mon[37053]: pgmap v2841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:15 smithi063 ceph-mon[36747]: pgmap v2841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4281.804146 secs 2024-07-26T09:47:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4297.287197 secs 2024-07-26T09:47:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4281.804146 secs 2024-07-26T09:47:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4297.287197 secs 2024-07-26T09:47:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4281.804146 secs 2024-07-26T09:47:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4297.287197 secs 2024-07-26T09:47:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:17 smithi043 ceph-mon[32384]: pgmap v2842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:17 smithi133 ceph-mon[37053]: pgmap v2842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:17 smithi063 ceph-mon[36747]: pgmap v2842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:19 smithi043 ceph-mon[32384]: pgmap v2843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:19 smithi133 ceph-mon[37053]: pgmap v2843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:19 smithi063 ceph-mon[36747]: pgmap v2843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4286.804266 secs 2024-07-26T09:47:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:21 smithi043 ceph-mon[32384]: pgmap v2844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4302.287285 secs 2024-07-26T09:47:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4286.804266 secs 2024-07-26T09:47:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:21 smithi133 ceph-mon[37053]: pgmap v2844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4302.287285 secs 2024-07-26T09:47:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4286.804266 secs 2024-07-26T09:47:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:21 smithi063 ceph-mon[36747]: pgmap v2844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4302.287285 secs 2024-07-26T09:47:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:23 smithi043 ceph-mon[32384]: pgmap v2845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:23 smithi133 ceph-mon[37053]: pgmap v2845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:23 smithi063 ceph-mon[36747]: pgmap v2845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:25 smithi043 ceph-mon[32384]: pgmap v2846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:25 smithi133 ceph-mon[37053]: pgmap v2846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:25 smithi063 ceph-mon[36747]: pgmap v2846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4291.804386 secs 2024-07-26T09:47:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4307.287356 secs 2024-07-26T09:47:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4291.804386 secs 2024-07-26T09:47:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4307.287356 secs 2024-07-26T09:47:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4291.804386 secs 2024-07-26T09:47:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4307.287356 secs 2024-07-26T09:47:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:27 smithi043 ceph-mon[32384]: pgmap v2847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:27 smithi133 ceph-mon[37053]: pgmap v2847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:27 smithi063 ceph-mon[36747]: pgmap v2847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:28 smithi043 ceph-mon[32384]: pgmap v2848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:28 smithi133 ceph-mon[37053]: pgmap v2848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:28 smithi063 ceph-mon[36747]: pgmap v2848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4296.804507 secs 2024-07-26T09:47:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:31 smithi043 ceph-mon[32384]: pgmap v2849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4312.287491 secs 2024-07-26T09:47:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4296.804507 secs 2024-07-26T09:47:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:31 smithi133 ceph-mon[37053]: pgmap v2849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4312.287491 secs 2024-07-26T09:47:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4296.804507 secs 2024-07-26T09:47:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:31 smithi063 ceph-mon[36747]: pgmap v2849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4312.287491 secs 2024-07-26T09:47:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:33 smithi043 ceph-mon[32384]: pgmap v2850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:33 smithi133 ceph-mon[37053]: pgmap v2850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:33 smithi063 ceph-mon[36747]: pgmap v2850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:35 smithi043 ceph-mon[32384]: pgmap v2851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:35 smithi133 ceph-mon[37053]: pgmap v2851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:35 smithi063 ceph-mon[36747]: pgmap v2851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:36.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4301.804577 secs 2024-07-26T09:47:36.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4317.287587 secs 2024-07-26T09:47:36.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4301.804577 secs 2024-07-26T09:47:36.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4317.287587 secs 2024-07-26T09:47:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4301.804577 secs 2024-07-26T09:47:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4317.287587 secs 2024-07-26T09:47:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:37 smithi043 ceph-mon[32384]: pgmap v2852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:37 smithi133 ceph-mon[37053]: pgmap v2852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:37 smithi063 ceph-mon[36747]: pgmap v2852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:39 smithi043 ceph-mon[32384]: pgmap v2853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:39 smithi133 ceph-mon[37053]: pgmap v2853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:39 smithi063 ceph-mon[36747]: pgmap v2853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4306.804717 secs 2024-07-26T09:47:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:41 smithi043 ceph-mon[32384]: pgmap v2854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4322.287715 secs 2024-07-26T09:47:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4306.804717 secs 2024-07-26T09:47:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:41 smithi133 ceph-mon[37053]: pgmap v2854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4322.287715 secs 2024-07-26T09:47:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4306.804717 secs 2024-07-26T09:47:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:41 smithi063 ceph-mon[36747]: pgmap v2854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4322.287715 secs 2024-07-26T09:47:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:43 smithi043 ceph-mon[32384]: pgmap v2855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:43 smithi133 ceph-mon[37053]: pgmap v2855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:43 smithi063 ceph-mon[36747]: pgmap v2855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:45 smithi043 ceph-mon[32384]: pgmap v2856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:45 smithi133 ceph-mon[37053]: pgmap v2856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:45 smithi063 ceph-mon[36747]: pgmap v2856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4311.804786 secs 2024-07-26T09:47:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4327.287839 secs 2024-07-26T09:47:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4311.804786 secs 2024-07-26T09:47:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4327.287839 secs 2024-07-26T09:47:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4311.804786 secs 2024-07-26T09:47:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4327.287839 secs 2024-07-26T09:47:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:47 smithi043 ceph-mon[32384]: pgmap v2857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:47 smithi133 ceph-mon[37053]: pgmap v2857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:47 smithi063 ceph-mon[36747]: pgmap v2857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:49 smithi043 ceph-mon[32384]: pgmap v2858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:49 smithi133 ceph-mon[37053]: pgmap v2858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:49 smithi063 ceph-mon[36747]: pgmap v2858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4316.804931 secs 2024-07-26T09:47:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:51 smithi043 ceph-mon[32384]: pgmap v2859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4332.287964 secs 2024-07-26T09:47:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4316.804931 secs 2024-07-26T09:47:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:51 smithi133 ceph-mon[37053]: pgmap v2859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4332.287964 secs 2024-07-26T09:47:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4316.804931 secs 2024-07-26T09:47:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:51 smithi063 ceph-mon[36747]: pgmap v2859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:47:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4332.287964 secs 2024-07-26T09:47:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:53 smithi043 ceph-mon[32384]: pgmap v2860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:53 smithi133 ceph-mon[37053]: pgmap v2860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:53 smithi063 ceph-mon[36747]: pgmap v2860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:55.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:55 smithi043 ceph-mon[32384]: pgmap v2861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:55 smithi133 ceph-mon[37053]: pgmap v2861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:55 smithi063 ceph-mon[36747]: pgmap v2861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4321.805053 secs 2024-07-26T09:47:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4337.288033 secs 2024-07-26T09:47:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4321.805053 secs 2024-07-26T09:47:56.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4337.288033 secs 2024-07-26T09:47:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4321.805053 secs 2024-07-26T09:47:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4337.288033 secs 2024-07-26T09:47:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:57 smithi043 ceph-mon[32384]: pgmap v2862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:57 smithi133 ceph-mon[37053]: pgmap v2862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:57 smithi063 ceph-mon[36747]: pgmap v2862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:47:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:47:59 smithi043 ceph-mon[32384]: pgmap v2863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:47:59 smithi133 ceph-mon[37053]: pgmap v2863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:47:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:47:59 smithi063 ceph-mon[36747]: pgmap v2863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4326.805193 secs 2024-07-26T09:48:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:01 smithi043 ceph-mon[32384]: pgmap v2864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4342.288138 secs 2024-07-26T09:48:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4326.805193 secs 2024-07-26T09:48:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:01 smithi133 ceph-mon[37053]: pgmap v2864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4342.288138 secs 2024-07-26T09:48:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4326.805193 secs 2024-07-26T09:48:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:01 smithi063 ceph-mon[36747]: pgmap v2864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4342.288138 secs 2024-07-26T09:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:03 smithi043 ceph-mon[32384]: pgmap v2865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:03 smithi133 ceph-mon[37053]: pgmap v2865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:48:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:03 smithi063 ceph-mon[36747]: pgmap v2865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:48:04.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:48:04.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:48:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:48:04.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:48:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:48:04.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:48:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:05 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:48:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:05 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:48:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:05 smithi043 ceph-mon[32384]: pgmap v2866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:05 smithi043 ceph-mon[32384]: pgmap v2867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:05 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:48:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:05 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:48:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:05 smithi133 ceph-mon[37053]: pgmap v2866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:05 smithi133 ceph-mon[37053]: pgmap v2867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:05 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:48:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:05 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:48:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:05 smithi063 ceph-mon[36747]: pgmap v2866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:05.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:05 smithi063 ceph-mon[36747]: pgmap v2867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4331.805311 secs 2024-07-26T09:48:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4347.288268 secs 2024-07-26T09:48:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:06 smithi063 ceph-mon[36747]: pgmap v2868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4331.805311 secs 2024-07-26T09:48:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4347.288268 secs 2024-07-26T09:48:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:06 smithi043 ceph-mon[32384]: pgmap v2868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4331.805311 secs 2024-07-26T09:48:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4347.288268 secs 2024-07-26T09:48:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:06 smithi133 ceph-mon[37053]: pgmap v2868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:08 smithi043 ceph-mon[32384]: pgmap v2869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:48:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:08 smithi133 ceph-mon[37053]: pgmap v2869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:48:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:08 smithi063 ceph-mon[36747]: pgmap v2869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:48:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:10 smithi043 ceph-mon[32384]: pgmap v2870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:10 smithi133 ceph-mon[37053]: pgmap v2870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:10 smithi063 ceph-mon[36747]: pgmap v2870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:48:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4336.805439 secs 2024-07-26T09:48:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4352.288349 secs 2024-07-26T09:48:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4336.805439 secs 2024-07-26T09:48:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4352.288349 secs 2024-07-26T09:48:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4336.805439 secs 2024-07-26T09:48:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4352.288349 secs 2024-07-26T09:48:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:12 smithi043 ceph-mon[32384]: pgmap v2871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:48:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:12 smithi133 ceph-mon[37053]: pgmap v2871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:48:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:12 smithi063 ceph-mon[36747]: pgmap v2871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:48:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:14 smithi043 ceph-mon[32384]: pgmap v2872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:14 smithi133 ceph-mon[37053]: pgmap v2872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:14 smithi063 ceph-mon[36747]: pgmap v2872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4341.805534 secs 2024-07-26T09:48:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4357.288461 secs 2024-07-26T09:48:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:16 smithi043 ceph-mon[32384]: pgmap v2873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:17.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4341.805534 secs 2024-07-26T09:48:17.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4357.288461 secs 2024-07-26T09:48:17.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:16 smithi133 ceph-mon[37053]: pgmap v2873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4341.805534 secs 2024-07-26T09:48:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4357.288461 secs 2024-07-26T09:48:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:16 smithi063 ceph-mon[36747]: pgmap v2873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:18 smithi043 ceph-mon[32384]: pgmap v2874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:18 smithi133 ceph-mon[37053]: pgmap v2874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:18 smithi063 ceph-mon[36747]: pgmap v2874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:20 smithi043 ceph-mon[32384]: pgmap v2875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:20 smithi133 ceph-mon[37053]: pgmap v2875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:20 smithi063 ceph-mon[36747]: pgmap v2875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4346.805648 secs 2024-07-26T09:48:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4362.288582 secs 2024-07-26T09:48:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4346.805648 secs 2024-07-26T09:48:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4362.288582 secs 2024-07-26T09:48:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4346.805648 secs 2024-07-26T09:48:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4362.288582 secs 2024-07-26T09:48:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:22 smithi043 ceph-mon[32384]: pgmap v2876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:22 smithi133 ceph-mon[37053]: pgmap v2876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:22 smithi063 ceph-mon[36747]: pgmap v2876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:24 smithi043 ceph-mon[32384]: pgmap v2877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:24 smithi133 ceph-mon[37053]: pgmap v2877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:24 smithi063 ceph-mon[36747]: pgmap v2877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4351.805770 secs 2024-07-26T09:48:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4367.288702 secs 2024-07-26T09:48:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:26 smithi043 ceph-mon[32384]: pgmap v2878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4351.805770 secs 2024-07-26T09:48:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4367.288702 secs 2024-07-26T09:48:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:26 smithi133 ceph-mon[37053]: pgmap v2878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4351.805770 secs 2024-07-26T09:48:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4367.288702 secs 2024-07-26T09:48:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:26 smithi063 ceph-mon[36747]: pgmap v2878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:28 smithi043 ceph-mon[32384]: pgmap v2879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:48:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:28 smithi133 ceph-mon[37053]: pgmap v2879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:48:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:28 smithi063 ceph-mon[36747]: pgmap v2879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:48:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:30 smithi043 ceph-mon[32384]: pgmap v2880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:48:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:30 smithi133 ceph-mon[37053]: pgmap v2880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:48:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:30 smithi063 ceph-mon[36747]: pgmap v2880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:48:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4356.805889 secs 2024-07-26T09:48:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4372.288848 secs 2024-07-26T09:48:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4356.805889 secs 2024-07-26T09:48:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4372.288848 secs 2024-07-26T09:48:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4356.805889 secs 2024-07-26T09:48:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4372.288848 secs 2024-07-26T09:48:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:32 smithi043 ceph-mon[32384]: pgmap v2881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:32 smithi133 ceph-mon[37053]: pgmap v2881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:32 smithi063 ceph-mon[36747]: pgmap v2881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:34 smithi043 ceph-mon[32384]: pgmap v2882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:48:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:34 smithi133 ceph-mon[37053]: pgmap v2882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:48:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:34 smithi063 ceph-mon[36747]: pgmap v2882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:48:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4361.806027 secs 2024-07-26T09:48:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4377.288992 secs 2024-07-26T09:48:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:36 smithi043 ceph-mon[32384]: pgmap v2883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4361.806027 secs 2024-07-26T09:48:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4377.288992 secs 2024-07-26T09:48:37.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:36 smithi133 ceph-mon[37053]: pgmap v2883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4361.806027 secs 2024-07-26T09:48:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4377.288992 secs 2024-07-26T09:48:37.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:36 smithi063 ceph-mon[36747]: pgmap v2883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:48:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:38 smithi043 ceph-mon[32384]: pgmap v2884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:38 smithi133 ceph-mon[37053]: pgmap v2884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:38 smithi063 ceph-mon[36747]: pgmap v2884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:40 smithi043 ceph-mon[32384]: pgmap v2885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:40 smithi133 ceph-mon[37053]: pgmap v2885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:40 smithi063 ceph-mon[36747]: pgmap v2885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4366.806123 secs 2024-07-26T09:48:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4382.289136 secs 2024-07-26T09:48:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4366.806123 secs 2024-07-26T09:48:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4382.289136 secs 2024-07-26T09:48:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4366.806123 secs 2024-07-26T09:48:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4382.289136 secs 2024-07-26T09:48:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:42 smithi133 ceph-mon[37053]: pgmap v2886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:42 smithi063 ceph-mon[36747]: pgmap v2886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:42 smithi043 ceph-mon[32384]: pgmap v2886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:44 smithi133 ceph-mon[37053]: pgmap v2887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:44 smithi063 ceph-mon[36747]: pgmap v2887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:45.179 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:44 smithi043 ceph-mon[32384]: pgmap v2887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4371.806176 secs 2024-07-26T09:48:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4387.289219 secs 2024-07-26T09:48:47.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:46 smithi133 ceph-mon[37053]: pgmap v2888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4371.806176 secs 2024-07-26T09:48:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4387.289219 secs 2024-07-26T09:48:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:46 smithi063 ceph-mon[36747]: pgmap v2888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4371.806176 secs 2024-07-26T09:48:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4387.289219 secs 2024-07-26T09:48:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:46 smithi043 ceph-mon[32384]: pgmap v2888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:48 smithi133 ceph-mon[37053]: pgmap v2889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:48 smithi063 ceph-mon[36747]: pgmap v2889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:48 smithi043 ceph-mon[32384]: pgmap v2889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:50 smithi133 ceph-mon[37053]: pgmap v2890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:50 smithi063 ceph-mon[36747]: pgmap v2890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:50 smithi043 ceph-mon[32384]: pgmap v2890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4376.806271 secs 2024-07-26T09:48:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4392.289341 secs 2024-07-26T09:48:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4376.806271 secs 2024-07-26T09:48:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4392.289341 secs 2024-07-26T09:48:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4376.806271 secs 2024-07-26T09:48:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4392.289341 secs 2024-07-26T09:48:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:52 smithi063 ceph-mon[36747]: pgmap v2891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:52 smithi043 ceph-mon[32384]: pgmap v2891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:52 smithi133 ceph-mon[37053]: pgmap v2891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:54 smithi063 ceph-mon[36747]: pgmap v2892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:54 smithi043 ceph-mon[32384]: pgmap v2892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:54 smithi133 ceph-mon[37053]: pgmap v2892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:48:57.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4381.806382 secs 2024-07-26T09:48:57.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4397.289456 secs 2024-07-26T09:48:57.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:56 smithi063 ceph-mon[36747]: pgmap v2893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4381.806382 secs 2024-07-26T09:48:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4397.289456 secs 2024-07-26T09:48:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:56 smithi043 ceph-mon[32384]: pgmap v2893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4381.806382 secs 2024-07-26T09:48:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4397.289456 secs 2024-07-26T09:48:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:56 smithi133 ceph-mon[37053]: pgmap v2893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:48:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:48:58 smithi063 ceph-mon[36747]: pgmap v2894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:48:58 smithi043 ceph-mon[32384]: pgmap v2894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:48:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:48:58 smithi133 ceph-mon[37053]: pgmap v2894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:01.051 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:00 smithi043 ceph-mon[32384]: pgmap v2895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:01.052 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4386.806504 secs 2024-07-26T09:49:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:00 smithi063 ceph-mon[36747]: pgmap v2895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4386.806504 secs 2024-07-26T09:49:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:00 smithi133 ceph-mon[37053]: pgmap v2895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:01.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4386.806504 secs 2024-07-26T09:49:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4402.289579 secs 2024-07-26T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4402.289579 secs 2024-07-26T09:49:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4402.289579 secs 2024-07-26T09:49:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:02 smithi063 ceph-mon[36747]: pgmap v2896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:02 smithi043 ceph-mon[32384]: pgmap v2896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:02 smithi133 ceph-mon[37053]: pgmap v2896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:49:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:49:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:49:05.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: pgmap v2897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:05.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:49:05.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:49:05.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:49:05.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:04 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:49:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: pgmap v2897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:49:05.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:04 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: pgmap v2897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:49:05.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:04 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:49:06.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:49:06.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:49:06.169 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:05 smithi133 ceph-mon[37053]: pgmap v2898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:49:06.169 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:05 smithi133 ceph-mon[37053]: pgmap v2899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:49:06.169 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:49:06.169 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4391.806623 secs 2024-07-26T09:49:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:49:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:49:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:05 smithi063 ceph-mon[36747]: pgmap v2898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:49:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:05 smithi063 ceph-mon[36747]: pgmap v2899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:49:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:49:06.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4391.806623 secs 2024-07-26T09:49:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:49:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:49:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:05 smithi043 ceph-mon[32384]: pgmap v2898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:49:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:05 smithi043 ceph-mon[32384]: pgmap v2899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:49:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:49:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4391.806623 secs 2024-07-26T09:49:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4407.289727 secs 2024-07-26T09:49:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4407.289727 secs 2024-07-26T09:49:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4407.289727 secs 2024-07-26T09:49:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:07 smithi043 ceph-mon[32384]: pgmap v2900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:49:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:07 smithi133 ceph-mon[37053]: pgmap v2900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:49:08.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:07 smithi063 ceph-mon[36747]: pgmap v2900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:49:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:09 smithi043 ceph-mon[32384]: pgmap v2901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:49:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:09 smithi133 ceph-mon[37053]: pgmap v2901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:49:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:09 smithi063 ceph-mon[36747]: pgmap v2901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:49:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4396.806723 secs 2024-07-26T09:49:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4396.806723 secs 2024-07-26T09:49:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4396.806723 secs 2024-07-26T09:49:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4412.289882 secs 2024-07-26T09:49:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:11 smithi043 ceph-mon[32384]: pgmap v2902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:49:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4412.289882 secs 2024-07-26T09:49:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:11 smithi133 ceph-mon[37053]: pgmap v2902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:49:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4412.289882 secs 2024-07-26T09:49:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:11 smithi063 ceph-mon[36747]: pgmap v2902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:49:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:13 smithi043 ceph-mon[32384]: pgmap v2903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:49:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:13 smithi133 ceph-mon[37053]: pgmap v2903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:49:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:13 smithi063 ceph-mon[36747]: pgmap v2903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:49:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:15 smithi043 ceph-mon[32384]: pgmap v2904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:49:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4401.806827 secs 2024-07-26T09:49:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:15 smithi133 ceph-mon[37053]: pgmap v2904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:49:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4401.806827 secs 2024-07-26T09:49:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:15 smithi063 ceph-mon[36747]: pgmap v2904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:49:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4401.806827 secs 2024-07-26T09:49:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4417.290002 secs 2024-07-26T09:49:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4417.290002 secs 2024-07-26T09:49:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4417.290002 secs 2024-07-26T09:49:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:17 smithi133 ceph-mon[37053]: pgmap v2905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:17 smithi063 ceph-mon[36747]: pgmap v2905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:17 smithi043 ceph-mon[32384]: pgmap v2905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:20 smithi133 ceph-mon[37053]: pgmap v2906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:20 smithi063 ceph-mon[36747]: pgmap v2906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:20 smithi043 ceph-mon[32384]: pgmap v2906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4406.806946 secs 2024-07-26T09:49:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4406.806946 secs 2024-07-26T09:49:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4406.806946 secs 2024-07-26T09:49:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4422.290080 secs 2024-07-26T09:49:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:22 smithi063 ceph-mon[36747]: pgmap v2907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4422.290080 secs 2024-07-26T09:49:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:22 smithi043 ceph-mon[32384]: pgmap v2907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4422.290080 secs 2024-07-26T09:49:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:22 smithi133 ceph-mon[37053]: pgmap v2907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:24 smithi063 ceph-mon[36747]: pgmap v2908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:24 smithi043 ceph-mon[32384]: pgmap v2908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:24 smithi133 ceph-mon[37053]: pgmap v2908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:26 smithi063 ceph-mon[36747]: pgmap v2909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4411.807065 secs 2024-07-26T09:49:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:26 smithi043 ceph-mon[32384]: pgmap v2909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4411.807065 secs 2024-07-26T09:49:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:26 smithi133 ceph-mon[37053]: pgmap v2909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4411.807065 secs 2024-07-26T09:49:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4427.290161 secs 2024-07-26T09:49:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4427.290161 secs 2024-07-26T09:49:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4427.290161 secs 2024-07-26T09:49:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:28 smithi063 ceph-mon[36747]: pgmap v2910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:28 smithi043 ceph-mon[32384]: pgmap v2910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:28 smithi133 ceph-mon[37053]: pgmap v2910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:30 smithi063 ceph-mon[36747]: pgmap v2911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:30 smithi043 ceph-mon[32384]: pgmap v2911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:30 smithi133 ceph-mon[37053]: pgmap v2911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4416.807165 secs 2024-07-26T09:49:31.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4416.807165 secs 2024-07-26T09:49:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4416.807165 secs 2024-07-26T09:49:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4432.290286 secs 2024-07-26T09:49:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:32 smithi063 ceph-mon[36747]: pgmap v2912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:32.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4432.290286 secs 2024-07-26T09:49:32.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:32 smithi043 ceph-mon[32384]: pgmap v2912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4432.290286 secs 2024-07-26T09:49:32.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:32 smithi133 ceph-mon[37053]: pgmap v2912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:34 smithi043 ceph-mon[32384]: pgmap v2913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:34 smithi133 ceph-mon[37053]: pgmap v2913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:34 smithi063 ceph-mon[36747]: pgmap v2913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:36.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:36 smithi063 ceph-mon[36747]: pgmap v2914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:36.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4421.807277 secs 2024-07-26T09:49:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:36 smithi043 ceph-mon[32384]: pgmap v2914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4421.807277 secs 2024-07-26T09:49:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:36 smithi133 ceph-mon[37053]: pgmap v2914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4421.807277 secs 2024-07-26T09:49:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4437.290404 secs 2024-07-26T09:49:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4437.290404 secs 2024-07-26T09:49:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4437.290404 secs 2024-07-26T09:49:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:38 smithi043 ceph-mon[32384]: pgmap v2915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:38 smithi133 ceph-mon[37053]: pgmap v2915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:38 smithi063 ceph-mon[36747]: pgmap v2915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:40 smithi043 ceph-mon[32384]: pgmap v2916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:40 smithi133 ceph-mon[37053]: pgmap v2916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:40 smithi063 ceph-mon[36747]: pgmap v2916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4426.807388 secs 2024-07-26T09:49:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4426.807388 secs 2024-07-26T09:49:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4426.807388 secs 2024-07-26T09:49:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4442.290527 secs 2024-07-26T09:49:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:42 smithi043 ceph-mon[32384]: pgmap v2917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4442.290527 secs 2024-07-26T09:49:42.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:42 smithi133 ceph-mon[37053]: pgmap v2917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4442.290527 secs 2024-07-26T09:49:42.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:42 smithi063 ceph-mon[36747]: pgmap v2917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:44 smithi043 ceph-mon[32384]: pgmap v2918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:44 smithi133 ceph-mon[37053]: pgmap v2918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:44 smithi063 ceph-mon[36747]: pgmap v2918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:46 smithi043 ceph-mon[32384]: pgmap v2919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4431.807488 secs 2024-07-26T09:49:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:46 smithi133 ceph-mon[37053]: pgmap v2919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4431.807488 secs 2024-07-26T09:49:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:46 smithi063 ceph-mon[36747]: pgmap v2919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4431.807488 secs 2024-07-26T09:49:47.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4447.290647 secs 2024-07-26T09:49:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4447.290647 secs 2024-07-26T09:49:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4447.290647 secs 2024-07-26T09:49:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:48 smithi043 ceph-mon[32384]: pgmap v2920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:48 smithi133 ceph-mon[37053]: pgmap v2920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:48 smithi063 ceph-mon[36747]: pgmap v2920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:50 smithi043 ceph-mon[32384]: pgmap v2921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:50 smithi133 ceph-mon[37053]: pgmap v2921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:50 smithi063 ceph-mon[36747]: pgmap v2921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4436.807557 secs 2024-07-26T09:49:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4436.807557 secs 2024-07-26T09:49:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4436.807557 secs 2024-07-26T09:49:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4452.290772 secs 2024-07-26T09:49:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:52 smithi043 ceph-mon[32384]: pgmap v2922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4452.290772 secs 2024-07-26T09:49:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:52 smithi133 ceph-mon[37053]: pgmap v2922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4452.290772 secs 2024-07-26T09:49:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:52 smithi063 ceph-mon[36747]: pgmap v2922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:54 smithi043 ceph-mon[32384]: pgmap v2923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:54 smithi133 ceph-mon[37053]: pgmap v2923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:54 smithi063 ceph-mon[36747]: pgmap v2923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:49:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:56 smithi043 ceph-mon[32384]: pgmap v2924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4441.807621 secs 2024-07-26T09:49:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4457.290901 secs 2024-07-26T09:49:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:56 smithi133 ceph-mon[37053]: pgmap v2924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4441.807621 secs 2024-07-26T09:49:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4457.290901 secs 2024-07-26T09:49:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:56 smithi063 ceph-mon[36747]: pgmap v2924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:49:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4441.807621 secs 2024-07-26T09:49:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4457.290901 secs 2024-07-26T09:49:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:49:58 smithi043 ceph-mon[32384]: pgmap v2925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:49:58 smithi133 ceph-mon[37053]: pgmap v2925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:49:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:49:58 smithi063 ceph-mon[36747]: pgmap v2925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:00 smithi043 ceph-mon[32384]: pgmap v2926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:50:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:00 smithi133 ceph-mon[37053]: pgmap v2926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:50:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:00 smithi063 ceph-mon[36747]: pgmap v2926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:00.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T09:50:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4446.807734 secs 2024-07-26T09:50:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4462.291002 secs 2024-07-26T09:50:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4446.807734 secs 2024-07-26T09:50:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4462.291002 secs 2024-07-26T09:50:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4446.807734 secs 2024-07-26T09:50:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4462.291002 secs 2024-07-26T09:50:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:02 smithi043 ceph-mon[32384]: pgmap v2927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:02 smithi133 ceph-mon[37053]: pgmap v2927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:02 smithi063 ceph-mon[36747]: pgmap v2927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:04 smithi043 ceph-mon[32384]: pgmap v2928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:04 smithi133 ceph-mon[37053]: pgmap v2928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:04 smithi063 ceph-mon[36747]: pgmap v2928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:50:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:50:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:50:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:06 smithi063 ceph-mon[36747]: pgmap v2929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4451.807836 secs 2024-07-26T09:50:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4467.291096 secs 2024-07-26T09:50:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:50:06.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:50:06.471 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:50:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:06 smithi043 ceph-mon[32384]: pgmap v2929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4451.807836 secs 2024-07-26T09:50:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4467.291096 secs 2024-07-26T09:50:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:50:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:50:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:06 smithi133 ceph-mon[37053]: pgmap v2929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4451.807836 secs 2024-07-26T09:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4467.291096 secs 2024-07-26T09:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:50:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:50:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:07 smithi043 ceph-mon[32384]: pgmap v2930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:50:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:07 smithi043 ceph-mon[32384]: pgmap v2931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:50:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:07 smithi133 ceph-mon[37053]: pgmap v2930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:50:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:07 smithi133 ceph-mon[37053]: pgmap v2931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:50:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:07 smithi063 ceph-mon[36747]: pgmap v2930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:50:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:07 smithi063 ceph-mon[36747]: pgmap v2931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:50:09.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:09 smithi043 ceph-mon[32384]: pgmap v2932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:50:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:09 smithi133 ceph-mon[37053]: pgmap v2932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:50:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:09 smithi063 ceph-mon[36747]: pgmap v2932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:50:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4456.807954 secs 2024-07-26T09:50:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:11 smithi043 ceph-mon[32384]: pgmap v2933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:50:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4472.291243 secs 2024-07-26T09:50:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4456.807954 secs 2024-07-26T09:50:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:11 smithi133 ceph-mon[37053]: pgmap v2933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:50:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4472.291243 secs 2024-07-26T09:50:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4456.807954 secs 2024-07-26T09:50:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:11 smithi063 ceph-mon[36747]: pgmap v2933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:50:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4472.291243 secs 2024-07-26T09:50:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:13 smithi133 ceph-mon[37053]: pgmap v2934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:50:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:13 smithi063 ceph-mon[36747]: pgmap v2934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:50:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:13 smithi043 ceph-mon[32384]: pgmap v2934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:50:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:15 smithi133 ceph-mon[37053]: pgmap v2935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:50:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:15 smithi063 ceph-mon[36747]: pgmap v2935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:50:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:15 smithi043 ceph-mon[32384]: pgmap v2935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:50:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4461.808063 secs 2024-07-26T09:50:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4477.291365 secs 2024-07-26T09:50:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4461.808063 secs 2024-07-26T09:50:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4477.291365 secs 2024-07-26T09:50:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4461.808063 secs 2024-07-26T09:50:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4477.291365 secs 2024-07-26T09:50:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:17 smithi133 ceph-mon[37053]: pgmap v2936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:50:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:17 smithi063 ceph-mon[36747]: pgmap v2936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:50:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:17 smithi043 ceph-mon[32384]: pgmap v2936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:50:19.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:19 smithi043 ceph-mon[32384]: pgmap v2937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:19 smithi133 ceph-mon[37053]: pgmap v2937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:19 smithi063 ceph-mon[36747]: pgmap v2937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4466.808206 secs 2024-07-26T09:50:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:21 smithi133 ceph-mon[37053]: pgmap v2938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4482.291464 secs 2024-07-26T09:50:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4466.808206 secs 2024-07-26T09:50:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:21 smithi063 ceph-mon[36747]: pgmap v2938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4482.291464 secs 2024-07-26T09:50:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4466.808206 secs 2024-07-26T09:50:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:21 smithi043 ceph-mon[32384]: pgmap v2938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4482.291464 secs 2024-07-26T09:50:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:23 smithi133 ceph-mon[37053]: pgmap v2939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:23 smithi063 ceph-mon[36747]: pgmap v2939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:23 smithi043 ceph-mon[32384]: pgmap v2939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:25.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:25 smithi043 ceph-mon[32384]: pgmap v2940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:25 smithi133 ceph-mon[37053]: pgmap v2940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:25 smithi063 ceph-mon[36747]: pgmap v2940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4471.808318 secs 2024-07-26T09:50:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4487.291601 secs 2024-07-26T09:50:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4471.808318 secs 2024-07-26T09:50:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4487.291601 secs 2024-07-26T09:50:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4471.808318 secs 2024-07-26T09:50:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4487.291601 secs 2024-07-26T09:50:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:27 smithi133 ceph-mon[37053]: pgmap v2941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:27 smithi063 ceph-mon[36747]: pgmap v2941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:27 smithi043 ceph-mon[32384]: pgmap v2941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:29 smithi133 ceph-mon[37053]: pgmap v2942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:29 smithi063 ceph-mon[36747]: pgmap v2942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:29 smithi043 ceph-mon[32384]: pgmap v2942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4476.808433 secs 2024-07-26T09:50:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:31 smithi133 ceph-mon[37053]: pgmap v2943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4492.291740 secs 2024-07-26T09:50:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4476.808433 secs 2024-07-26T09:50:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:31 smithi063 ceph-mon[36747]: pgmap v2943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4492.291740 secs 2024-07-26T09:50:31.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4476.808433 secs 2024-07-26T09:50:31.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:31 smithi043 ceph-mon[32384]: pgmap v2943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:31.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4492.291740 secs 2024-07-26T09:50:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:33 smithi133 ceph-mon[37053]: pgmap v2944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:33 smithi063 ceph-mon[36747]: pgmap v2944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:33 smithi043 ceph-mon[32384]: pgmap v2944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:35.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:35 smithi133 ceph-mon[37053]: pgmap v2945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:35 smithi063 ceph-mon[36747]: pgmap v2945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:35 smithi043 ceph-mon[32384]: pgmap v2945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4481.808553 secs 2024-07-26T09:50:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4497.291877 secs 2024-07-26T09:50:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4481.808553 secs 2024-07-26T09:50:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4497.291877 secs 2024-07-26T09:50:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4481.808553 secs 2024-07-26T09:50:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4497.291877 secs 2024-07-26T09:50:37.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:37 smithi063 ceph-mon[36747]: pgmap v2946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:37 smithi043 ceph-mon[32384]: pgmap v2946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:37 smithi133 ceph-mon[37053]: pgmap v2946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:39 smithi063 ceph-mon[36747]: pgmap v2947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:39 smithi043 ceph-mon[32384]: pgmap v2947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:39 smithi133 ceph-mon[37053]: pgmap v2947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4486.808707 secs 2024-07-26T09:50:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:41 smithi063 ceph-mon[36747]: pgmap v2948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4502.291967 secs 2024-07-26T09:50:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4486.808707 secs 2024-07-26T09:50:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:41 smithi043 ceph-mon[32384]: pgmap v2948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4502.291967 secs 2024-07-26T09:50:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4486.808707 secs 2024-07-26T09:50:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:41 smithi133 ceph-mon[37053]: pgmap v2948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4502.291967 secs 2024-07-26T09:50:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:43 smithi063 ceph-mon[36747]: pgmap v2949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:43 smithi043 ceph-mon[32384]: pgmap v2949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:43 smithi133 ceph-mon[37053]: pgmap v2949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:45 smithi063 ceph-mon[36747]: pgmap v2950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:45 smithi043 ceph-mon[32384]: pgmap v2950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:45 smithi133 ceph-mon[37053]: pgmap v2950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4491.808821 secs 2024-07-26T09:50:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4507.292081 secs 2024-07-26T09:50:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4491.808821 secs 2024-07-26T09:50:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4507.292081 secs 2024-07-26T09:50:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4491.808821 secs 2024-07-26T09:50:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4507.292081 secs 2024-07-26T09:50:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:47 smithi043 ceph-mon[32384]: pgmap v2951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:47 smithi133 ceph-mon[37053]: pgmap v2951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:47 smithi063 ceph-mon[36747]: pgmap v2951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:49 smithi043 ceph-mon[32384]: pgmap v2952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:49 smithi133 ceph-mon[37053]: pgmap v2952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:49 smithi063 ceph-mon[36747]: pgmap v2952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4496.808955 secs 2024-07-26T09:50:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:51 smithi043 ceph-mon[32384]: pgmap v2953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4512.292203 secs 2024-07-26T09:50:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4496.808955 secs 2024-07-26T09:50:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:51 smithi133 ceph-mon[37053]: pgmap v2953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4512.292203 secs 2024-07-26T09:50:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4496.808955 secs 2024-07-26T09:50:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:51 smithi063 ceph-mon[36747]: pgmap v2953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:50:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4512.292203 secs 2024-07-26T09:50:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:53 smithi043 ceph-mon[32384]: pgmap v2954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:53 smithi133 ceph-mon[37053]: pgmap v2954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:53 smithi063 ceph-mon[36747]: pgmap v2954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:55.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:55 smithi043 ceph-mon[32384]: pgmap v2955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:55 smithi133 ceph-mon[37053]: pgmap v2955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:55 smithi063 ceph-mon[36747]: pgmap v2955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4501.809066 secs 2024-07-26T09:50:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4517.292301 secs 2024-07-26T09:50:56.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4501.809066 secs 2024-07-26T09:50:56.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4517.292301 secs 2024-07-26T09:50:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4501.809066 secs 2024-07-26T09:50:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4517.292301 secs 2024-07-26T09:50:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:57 smithi043 ceph-mon[32384]: pgmap v2956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:57 smithi133 ceph-mon[37053]: pgmap v2956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:57 smithi063 ceph-mon[36747]: pgmap v2956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:50:59.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:50:59 smithi043 ceph-mon[32384]: pgmap v2957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:50:59 smithi133 ceph-mon[37053]: pgmap v2957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:50:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:50:59 smithi063 ceph-mon[36747]: pgmap v2957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4506.809201 secs 2024-07-26T09:51:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:01 smithi043 ceph-mon[32384]: pgmap v2958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4522.292421 secs 2024-07-26T09:51:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4506.809201 secs 2024-07-26T09:51:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:01 smithi133 ceph-mon[37053]: pgmap v2958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4522.292421 secs 2024-07-26T09:51:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4506.809201 secs 2024-07-26T09:51:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:01 smithi063 ceph-mon[36747]: pgmap v2958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4522.292421 secs 2024-07-26T09:51:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:03 smithi043 ceph-mon[32384]: pgmap v2959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:03 smithi133 ceph-mon[37053]: pgmap v2959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:03 smithi063 ceph-mon[36747]: pgmap v2959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:05 smithi043 ceph-mon[32384]: pgmap v2960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:05 smithi133 ceph-mon[37053]: pgmap v2960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:05 smithi063 ceph-mon[36747]: pgmap v2960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:06.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4511.809330 secs 2024-07-26T09:51:06.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4527.292569 secs 2024-07-26T09:51:06.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:51:06.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4511.809330 secs 2024-07-26T09:51:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4527.292569 secs 2024-07-26T09:51:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:51:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4511.809330 secs 2024-07-26T09:51:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4527.292569 secs 2024-07-26T09:51:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:51:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:07 smithi043 ceph-mon[32384]: pgmap v2961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:07 smithi133 ceph-mon[37053]: pgmap v2961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:07.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:07.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:07 smithi063 ceph-mon[36747]: pgmap v2961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:08.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:51:08.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:51:08.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:51:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:51:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:51:08.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:51:08.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:51:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:09 smithi043 ceph-mon[32384]: pgmap v2962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:09 smithi043 ceph-mon[32384]: pgmap v2963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:09 smithi133 ceph-mon[37053]: pgmap v2962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:09 smithi133 ceph-mon[37053]: pgmap v2963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:09 smithi063 ceph-mon[36747]: pgmap v2962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:09 smithi063 ceph-mon[36747]: pgmap v2963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:11 smithi043 ceph-mon[32384]: pgmap v2964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4516.809439 secs 2024-07-26T09:51:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4532.292710 secs 2024-07-26T09:51:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:11 smithi133 ceph-mon[37053]: pgmap v2964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4516.809439 secs 2024-07-26T09:51:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4532.292710 secs 2024-07-26T09:51:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:11 smithi063 ceph-mon[36747]: pgmap v2964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4516.809439 secs 2024-07-26T09:51:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4532.292710 secs 2024-07-26T09:51:13.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:13 smithi043 ceph-mon[32384]: pgmap v2965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:13 smithi133 ceph-mon[37053]: pgmap v2965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:13 smithi063 ceph-mon[36747]: pgmap v2965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:15 smithi043 ceph-mon[32384]: pgmap v2966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:15 smithi133 ceph-mon[37053]: pgmap v2966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:15 smithi063 ceph-mon[36747]: pgmap v2966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4521.809553 secs 2024-07-26T09:51:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4537.292845 secs 2024-07-26T09:51:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4521.809553 secs 2024-07-26T09:51:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4537.292845 secs 2024-07-26T09:51:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4521.809553 secs 2024-07-26T09:51:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4537.292845 secs 2024-07-26T09:51:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:17 smithi043 ceph-mon[32384]: pgmap v2967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:17 smithi133 ceph-mon[37053]: pgmap v2967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:17 smithi063 ceph-mon[36747]: pgmap v2967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:51:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:19 smithi043 ceph-mon[32384]: pgmap v2968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:51:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:19 smithi133 ceph-mon[37053]: pgmap v2968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:51:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:19 smithi063 ceph-mon[36747]: pgmap v2968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:51:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:21 smithi043 ceph-mon[32384]: pgmap v2969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4526.809676 secs 2024-07-26T09:51:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4542.292964 secs 2024-07-26T09:51:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:21 smithi133 ceph-mon[37053]: pgmap v2969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4526.809676 secs 2024-07-26T09:51:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4542.292964 secs 2024-07-26T09:51:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:21 smithi063 ceph-mon[36747]: pgmap v2969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4526.809676 secs 2024-07-26T09:51:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4542.292964 secs 2024-07-26T09:51:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:23 smithi043 ceph-mon[32384]: pgmap v2970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:23 smithi133 ceph-mon[37053]: pgmap v2970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:23 smithi063 ceph-mon[36747]: pgmap v2970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:25.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:25 smithi043 ceph-mon[32384]: pgmap v2971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:25 smithi133 ceph-mon[37053]: pgmap v2971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:25 smithi063 ceph-mon[36747]: pgmap v2971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4531.809789 secs 2024-07-26T09:51:26.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4547.293048 secs 2024-07-26T09:51:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4531.809789 secs 2024-07-26T09:51:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4547.293048 secs 2024-07-26T09:51:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4531.809789 secs 2024-07-26T09:51:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4547.293048 secs 2024-07-26T09:51:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:27 smithi133 ceph-mon[37053]: pgmap v2972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:27 smithi063 ceph-mon[36747]: pgmap v2972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:27 smithi043 ceph-mon[32384]: pgmap v2972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:29 smithi133 ceph-mon[37053]: pgmap v2973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:29 smithi063 ceph-mon[36747]: pgmap v2973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:29.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:29 smithi043 ceph-mon[32384]: pgmap v2973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:31 smithi133 ceph-mon[37053]: pgmap v2974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4536.809915 secs 2024-07-26T09:51:31.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4552.293130 secs 2024-07-26T09:51:31.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:31 smithi043 ceph-mon[32384]: pgmap v2974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:31.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4536.809915 secs 2024-07-26T09:51:31.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4552.293130 secs 2024-07-26T09:51:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:31 smithi063 ceph-mon[36747]: pgmap v2974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4536.809915 secs 2024-07-26T09:51:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4552.293130 secs 2024-07-26T09:51:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:32 smithi063 ceph-mon[36747]: pgmap v2975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:32 smithi043 ceph-mon[32384]: pgmap v2975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:32 smithi133 ceph-mon[37053]: pgmap v2975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:35 smithi043 ceph-mon[32384]: pgmap v2976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:35 smithi133 ceph-mon[37053]: pgmap v2976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:35 smithi063 ceph-mon[36747]: pgmap v2976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4541.810029 secs 2024-07-26T09:51:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4557.293241 secs 2024-07-26T09:51:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4541.810029 secs 2024-07-26T09:51:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4557.293241 secs 2024-07-26T09:51:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4541.810029 secs 2024-07-26T09:51:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4557.293241 secs 2024-07-26T09:51:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:37 smithi043 ceph-mon[32384]: pgmap v2977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:37 smithi133 ceph-mon[37053]: pgmap v2977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:37.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:37 smithi063 ceph-mon[36747]: pgmap v2977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:39 smithi133 ceph-mon[37053]: pgmap v2978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:39 smithi063 ceph-mon[36747]: pgmap v2978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:39 smithi043 ceph-mon[32384]: pgmap v2978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4546.810177 secs 2024-07-26T09:51:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:41 smithi133 ceph-mon[37053]: pgmap v2979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4562.293358 secs 2024-07-26T09:51:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4546.810177 secs 2024-07-26T09:51:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:41 smithi063 ceph-mon[36747]: pgmap v2979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4562.293358 secs 2024-07-26T09:51:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4546.810177 secs 2024-07-26T09:51:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:41 smithi043 ceph-mon[32384]: pgmap v2979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4562.293358 secs 2024-07-26T09:51:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:43 smithi133 ceph-mon[37053]: pgmap v2980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:43 smithi063 ceph-mon[36747]: pgmap v2980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:43 smithi043 ceph-mon[32384]: pgmap v2980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:45 smithi133 ceph-mon[37053]: pgmap v2981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:45 smithi063 ceph-mon[36747]: pgmap v2981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:45 smithi043 ceph-mon[32384]: pgmap v2981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4551.810306 secs 2024-07-26T09:51:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4567.293496 secs 2024-07-26T09:51:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4551.810306 secs 2024-07-26T09:51:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4567.293496 secs 2024-07-26T09:51:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4551.810306 secs 2024-07-26T09:51:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4567.293496 secs 2024-07-26T09:51:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:47 smithi133 ceph-mon[37053]: pgmap v2982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:47 smithi063 ceph-mon[36747]: pgmap v2982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:47 smithi043 ceph-mon[32384]: pgmap v2982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:49 smithi063 ceph-mon[36747]: pgmap v2983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:49 smithi043 ceph-mon[32384]: pgmap v2983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:49 smithi133 ceph-mon[37053]: pgmap v2983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4556.810380 secs 2024-07-26T09:51:51.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:51 smithi063 ceph-mon[36747]: pgmap v2984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:51.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4572.293611 secs 2024-07-26T09:51:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4556.810380 secs 2024-07-26T09:51:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:51 smithi043 ceph-mon[32384]: pgmap v2984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4572.293611 secs 2024-07-26T09:51:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4556.810380 secs 2024-07-26T09:51:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:51 smithi133 ceph-mon[37053]: pgmap v2984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:51:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4572.293611 secs 2024-07-26T09:51:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:53 smithi063 ceph-mon[36747]: pgmap v2985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:53 smithi043 ceph-mon[32384]: pgmap v2985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:53 smithi133 ceph-mon[37053]: pgmap v2985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:55 smithi063 ceph-mon[36747]: pgmap v2986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:55 smithi043 ceph-mon[32384]: pgmap v2986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:55 smithi133 ceph-mon[37053]: pgmap v2986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4561.810499 secs 2024-07-26T09:51:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4577.293751 secs 2024-07-26T09:51:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4561.810499 secs 2024-07-26T09:51:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4577.293751 secs 2024-07-26T09:51:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4561.810499 secs 2024-07-26T09:51:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4577.293751 secs 2024-07-26T09:51:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:57 smithi063 ceph-mon[36747]: pgmap v2987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:57 smithi043 ceph-mon[32384]: pgmap v2987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:57 smithi133 ceph-mon[37053]: pgmap v2987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:51:59.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:51:59 smithi063 ceph-mon[36747]: pgmap v2988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:51:59 smithi043 ceph-mon[32384]: pgmap v2988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:51:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:51:59 smithi133 ceph-mon[37053]: pgmap v2988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4566.810622 secs 2024-07-26T09:52:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:01 smithi063 ceph-mon[36747]: pgmap v2989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4582.293883 secs 2024-07-26T09:52:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4566.810622 secs 2024-07-26T09:52:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:01 smithi043 ceph-mon[32384]: pgmap v2989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4582.293883 secs 2024-07-26T09:52:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4566.810622 secs 2024-07-26T09:52:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:01 smithi133 ceph-mon[37053]: pgmap v2989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4582.293883 secs 2024-07-26T09:52:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:03 smithi063 ceph-mon[36747]: pgmap v2990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:03 smithi043 ceph-mon[32384]: pgmap v2990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:03 smithi133 ceph-mon[37053]: pgmap v2990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:05 smithi043 ceph-mon[32384]: pgmap v2991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:05 smithi133 ceph-mon[37053]: pgmap v2991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:05 smithi063 ceph-mon[36747]: pgmap v2991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:06.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4571.810741 secs 2024-07-26T09:52:06.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4587.294005 secs 2024-07-26T09:52:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4571.810741 secs 2024-07-26T09:52:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4587.294005 secs 2024-07-26T09:52:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4571.810741 secs 2024-07-26T09:52:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4587.294005 secs 2024-07-26T09:52:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:07 smithi043 ceph-mon[32384]: pgmap v2992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:07 smithi133 ceph-mon[37053]: pgmap v2992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:07 smithi063 ceph-mon[36747]: pgmap v2992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:09.672 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:09 smithi133 ceph-mon[37053]: pgmap v2993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:09.672 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:52:09.673 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.673 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.673 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.673 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:09 smithi043 ceph-mon[32384]: pgmap v2993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:09.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:52:09.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.719 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:09 smithi063 ceph-mon[36747]: pgmap v2993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:09.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:52:09.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:09.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4576.810834 secs 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: pgmap v2994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4592.294072 secs 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4576.810834 secs 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: pgmap v2994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4592.294072 secs 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4576.810834 secs 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: pgmap v2994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4592.294072 secs 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:12 smithi043 ceph-mon[32384]: pgmap v2995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:13.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:12 smithi133 ceph-mon[37053]: pgmap v2995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:12 smithi063 ceph-mon[36747]: pgmap v2995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:13.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:13.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: pgmap v2996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: pgmap v2997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:52:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: pgmap v2998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:52:15.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: pgmap v2996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: pgmap v2997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: pgmap v2998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:52:15.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: pgmap v2996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: pgmap v2997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: pgmap v2998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:52:15.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:52:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4581.810950 secs 2024-07-26T09:52:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4597.294196 secs 2024-07-26T09:52:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4581.810950 secs 2024-07-26T09:52:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4597.294196 secs 2024-07-26T09:52:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4581.810950 secs 2024-07-26T09:52:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4597.294196 secs 2024-07-26T09:52:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:17 smithi043 ceph-mon[32384]: pgmap v2999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:52:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:17 smithi133 ceph-mon[37053]: pgmap v2999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:52:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:17 smithi063 ceph-mon[36747]: pgmap v2999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:52:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:19 smithi043 ceph-mon[32384]: pgmap v3000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:52:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:19 smithi133 ceph-mon[37053]: pgmap v3000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:52:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:19 smithi063 ceph-mon[36747]: pgmap v3000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:52:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4586.811095 secs 2024-07-26T09:52:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:21 smithi043 ceph-mon[32384]: pgmap v3001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:52:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4602.294322 secs 2024-07-26T09:52:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4586.811095 secs 2024-07-26T09:52:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:21 smithi133 ceph-mon[37053]: pgmap v3001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:52:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4602.294322 secs 2024-07-26T09:52:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4586.811095 secs 2024-07-26T09:52:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:21 smithi063 ceph-mon[36747]: pgmap v3001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:52:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4602.294322 secs 2024-07-26T09:52:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:23 smithi043 ceph-mon[32384]: pgmap v3002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:52:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:23 smithi133 ceph-mon[37053]: pgmap v3002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:52:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:23 smithi063 ceph-mon[36747]: pgmap v3002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:52:25.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:25 smithi043 ceph-mon[32384]: pgmap v3003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:52:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:25 smithi133 ceph-mon[37053]: pgmap v3003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:52:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:25 smithi063 ceph-mon[36747]: pgmap v3003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:52:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4591.811228 secs 2024-07-26T09:52:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4607.294443 secs 2024-07-26T09:52:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4591.811228 secs 2024-07-26T09:52:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4607.294443 secs 2024-07-26T09:52:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4591.811228 secs 2024-07-26T09:52:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4607.294443 secs 2024-07-26T09:52:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:27 smithi043 ceph-mon[32384]: pgmap v3004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:27 smithi133 ceph-mon[37053]: pgmap v3004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:27 smithi063 ceph-mon[36747]: pgmap v3004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:29 smithi043 ceph-mon[32384]: pgmap v3005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:29 smithi133 ceph-mon[37053]: pgmap v3005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:29 smithi063 ceph-mon[36747]: pgmap v3005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4596.811349 secs 2024-07-26T09:52:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:31 smithi043 ceph-mon[32384]: pgmap v3006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4612.294584 secs 2024-07-26T09:52:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4596.811349 secs 2024-07-26T09:52:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:31 smithi133 ceph-mon[37053]: pgmap v3006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4612.294584 secs 2024-07-26T09:52:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4596.811349 secs 2024-07-26T09:52:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:31 smithi063 ceph-mon[36747]: pgmap v3006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4612.294584 secs 2024-07-26T09:52:33.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:33 smithi043 ceph-mon[32384]: pgmap v3007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:33 smithi133 ceph-mon[37053]: pgmap v3007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:33.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:33 smithi063 ceph-mon[36747]: pgmap v3007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:35 smithi043 ceph-mon[32384]: pgmap v3008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:35 smithi133 ceph-mon[37053]: pgmap v3008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:35 smithi063 ceph-mon[36747]: pgmap v3008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:36.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4601.811429 secs 2024-07-26T09:52:36.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4617.294705 secs 2024-07-26T09:52:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4601.811429 secs 2024-07-26T09:52:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4617.294705 secs 2024-07-26T09:52:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4601.811429 secs 2024-07-26T09:52:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4617.294705 secs 2024-07-26T09:52:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:37 smithi043 ceph-mon[32384]: pgmap v3009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:37 smithi133 ceph-mon[37053]: pgmap v3009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:37 smithi063 ceph-mon[36747]: pgmap v3009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:39 smithi043 ceph-mon[32384]: pgmap v3010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:39 smithi133 ceph-mon[37053]: pgmap v3010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:39 smithi063 ceph-mon[36747]: pgmap v3010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4606.811562 secs 2024-07-26T09:52:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:41 smithi043 ceph-mon[32384]: pgmap v3011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4622.294829 secs 2024-07-26T09:52:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4606.811562 secs 2024-07-26T09:52:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:41 smithi133 ceph-mon[37053]: pgmap v3011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4622.294829 secs 2024-07-26T09:52:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4606.811562 secs 2024-07-26T09:52:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:41 smithi063 ceph-mon[36747]: pgmap v3011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4622.294829 secs 2024-07-26T09:52:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:43 smithi043 ceph-mon[32384]: pgmap v3012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:43 smithi133 ceph-mon[37053]: pgmap v3012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:43 smithi063 ceph-mon[36747]: pgmap v3012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:45.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:45 smithi043 ceph-mon[32384]: pgmap v3013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:45 smithi133 ceph-mon[37053]: pgmap v3013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:45 smithi063 ceph-mon[36747]: pgmap v3013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4611.811699 secs 2024-07-26T09:52:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4627.294952 secs 2024-07-26T09:52:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4611.811699 secs 2024-07-26T09:52:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4627.294952 secs 2024-07-26T09:52:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4611.811699 secs 2024-07-26T09:52:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4627.294952 secs 2024-07-26T09:52:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:47 smithi133 ceph-mon[37053]: pgmap v3014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:47 smithi063 ceph-mon[36747]: pgmap v3014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:47 smithi043 ceph-mon[32384]: pgmap v3014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:49 smithi133 ceph-mon[37053]: pgmap v3015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:49 smithi063 ceph-mon[36747]: pgmap v3015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:49 smithi043 ceph-mon[32384]: pgmap v3015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4616.811806 secs 2024-07-26T09:52:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:51 smithi133 ceph-mon[37053]: pgmap v3016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4632.295069 secs 2024-07-26T09:52:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4616.811806 secs 2024-07-26T09:52:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:51 smithi063 ceph-mon[36747]: pgmap v3016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4632.295069 secs 2024-07-26T09:52:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4616.811806 secs 2024-07-26T09:52:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:51 smithi043 ceph-mon[32384]: pgmap v3016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:52:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4632.295069 secs 2024-07-26T09:52:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:53 smithi133 ceph-mon[37053]: pgmap v3017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:53 smithi063 ceph-mon[36747]: pgmap v3017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:53 smithi043 ceph-mon[32384]: pgmap v3017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:55 smithi063 ceph-mon[36747]: pgmap v3018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:55 smithi043 ceph-mon[32384]: pgmap v3018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:56.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:55 smithi133 ceph-mon[37053]: pgmap v3018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4621.811922 secs 2024-07-26T09:52:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4637.295192 secs 2024-07-26T09:52:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:56 smithi063 ceph-mon[36747]: pgmap v3019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4621.811922 secs 2024-07-26T09:52:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4637.295192 secs 2024-07-26T09:52:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:56 smithi043 ceph-mon[32384]: pgmap v3019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4621.811922 secs 2024-07-26T09:52:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4637.295192 secs 2024-07-26T09:52:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:56 smithi133 ceph-mon[37053]: pgmap v3019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:52:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:52:59 smithi043 ceph-mon[32384]: pgmap v3020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:52:59 smithi133 ceph-mon[37053]: pgmap v3020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:52:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:52:59 smithi063 ceph-mon[36747]: pgmap v3020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4626.812024 secs 2024-07-26T09:53:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:01 smithi043 ceph-mon[32384]: pgmap v3021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4642.295299 secs 2024-07-26T09:53:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4626.812024 secs 2024-07-26T09:53:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:01 smithi133 ceph-mon[37053]: pgmap v3021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4642.295299 secs 2024-07-26T09:53:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4626.812024 secs 2024-07-26T09:53:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:01 smithi063 ceph-mon[36747]: pgmap v3021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4642.295299 secs 2024-07-26T09:53:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:03 smithi043 ceph-mon[32384]: pgmap v3022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:03 smithi133 ceph-mon[37053]: pgmap v3022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:03 smithi063 ceph-mon[36747]: pgmap v3022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:05 smithi043 ceph-mon[32384]: pgmap v3023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:05 smithi133 ceph-mon[37053]: pgmap v3023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:05 smithi063 ceph-mon[36747]: pgmap v3023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4631.812151 secs 2024-07-26T09:53:06.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4647.295421 secs 2024-07-26T09:53:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4631.812151 secs 2024-07-26T09:53:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4647.295421 secs 2024-07-26T09:53:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4631.812151 secs 2024-07-26T09:53:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4647.295421 secs 2024-07-26T09:53:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:07 smithi043 ceph-mon[32384]: pgmap v3024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:07 smithi133 ceph-mon[37053]: pgmap v3024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:07 smithi063 ceph-mon[36747]: pgmap v3024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:09 smithi043 ceph-mon[32384]: pgmap v3025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:09 smithi133 ceph-mon[37053]: pgmap v3025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:09 smithi063 ceph-mon[36747]: pgmap v3025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4636.812256 secs 2024-07-26T09:53:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:11 smithi043 ceph-mon[32384]: pgmap v3026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4652.295545 secs 2024-07-26T09:53:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4636.812256 secs 2024-07-26T09:53:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:11 smithi133 ceph-mon[37053]: pgmap v3026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4652.295545 secs 2024-07-26T09:53:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4636.812256 secs 2024-07-26T09:53:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:11 smithi063 ceph-mon[36747]: pgmap v3026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4652.295545 secs 2024-07-26T09:53:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:13 smithi043 ceph-mon[32384]: pgmap v3027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:13 smithi133 ceph-mon[37053]: pgmap v3027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:13 smithi063 ceph-mon[36747]: pgmap v3027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:15 smithi043 ceph-mon[32384]: pgmap v3028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:15 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:53:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:15 smithi133 ceph-mon[37053]: pgmap v3028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:15 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:53:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:15 smithi063 ceph-mon[36747]: pgmap v3028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:15 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:53:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4641.812356 secs 2024-07-26T09:53:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4657.295680 secs 2024-07-26T09:53:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:53:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:53:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:53:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4641.812356 secs 2024-07-26T09:53:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4657.295680 secs 2024-07-26T09:53:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:53:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:53:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:53:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4641.812356 secs 2024-07-26T09:53:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4657.295680 secs 2024-07-26T09:53:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:53:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:53:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:53:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:17 smithi133 ceph-mon[37053]: pgmap v3029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:53:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:17 smithi133 ceph-mon[37053]: pgmap v3030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:53:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:17 smithi063 ceph-mon[36747]: pgmap v3029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:53:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:17 smithi063 ceph-mon[36747]: pgmap v3030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:53:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:17 smithi043 ceph-mon[32384]: pgmap v3029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:53:17.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:17 smithi043 ceph-mon[32384]: pgmap v3030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:53:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:19 smithi133 ceph-mon[37053]: pgmap v3031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:53:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:19 smithi063 ceph-mon[36747]: pgmap v3031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:53:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:19 smithi043 ceph-mon[32384]: pgmap v3031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:53:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:21 smithi133 ceph-mon[37053]: pgmap v3032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:53:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4646.812479 secs 2024-07-26T09:53:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4662.295778 secs 2024-07-26T09:53:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:21 smithi063 ceph-mon[36747]: pgmap v3032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:53:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4646.812479 secs 2024-07-26T09:53:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4662.295778 secs 2024-07-26T09:53:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:21 smithi043 ceph-mon[32384]: pgmap v3032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:53:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4646.812479 secs 2024-07-26T09:53:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4662.295778 secs 2024-07-26T09:53:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:23 smithi133 ceph-mon[37053]: pgmap v3033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:53:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:23 smithi063 ceph-mon[36747]: pgmap v3033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:53:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:23 smithi043 ceph-mon[32384]: pgmap v3033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:53:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:25 smithi133 ceph-mon[37053]: pgmap v3034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:25 smithi063 ceph-mon[36747]: pgmap v3034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:25 smithi043 ceph-mon[32384]: pgmap v3034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4651.812598 secs 2024-07-26T09:53:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4667.295897 secs 2024-07-26T09:53:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4651.812598 secs 2024-07-26T09:53:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4667.295897 secs 2024-07-26T09:53:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4651.812598 secs 2024-07-26T09:53:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4667.295897 secs 2024-07-26T09:53:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:27 smithi063 ceph-mon[36747]: pgmap v3035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:53:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:27 smithi043 ceph-mon[32384]: pgmap v3035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:53:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:27 smithi133 ceph-mon[37053]: pgmap v3035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:53:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:28 smithi063 ceph-mon[36747]: pgmap v3036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:53:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:28 smithi043 ceph-mon[32384]: pgmap v3036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:53:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:28 smithi133 ceph-mon[37053]: pgmap v3036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:53:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:30 smithi043 ceph-mon[32384]: pgmap v3037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:30 smithi133 ceph-mon[37053]: pgmap v3037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:30 smithi063 ceph-mon[36747]: pgmap v3037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4656.812721 secs 2024-07-26T09:53:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4672.296016 secs 2024-07-26T09:53:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4656.812721 secs 2024-07-26T09:53:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4672.296016 secs 2024-07-26T09:53:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4656.812721 secs 2024-07-26T09:53:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4672.296016 secs 2024-07-26T09:53:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:32 smithi043 ceph-mon[32384]: pgmap v3038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:53:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:32 smithi133 ceph-mon[37053]: pgmap v3038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:53:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:32 smithi063 ceph-mon[36747]: pgmap v3038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:53:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:34 smithi043 ceph-mon[32384]: pgmap v3039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:34 smithi133 ceph-mon[37053]: pgmap v3039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:34 smithi063 ceph-mon[36747]: pgmap v3039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:53:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4661.812881 secs 2024-07-26T09:53:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4677.296079 secs 2024-07-26T09:53:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:36 smithi043 ceph-mon[32384]: pgmap v3040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4661.812881 secs 2024-07-26T09:53:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4677.296079 secs 2024-07-26T09:53:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:36 smithi133 ceph-mon[37053]: pgmap v3040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4661.812881 secs 2024-07-26T09:53:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4677.296079 secs 2024-07-26T09:53:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:36 smithi063 ceph-mon[36747]: pgmap v3040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:38 smithi043 ceph-mon[32384]: pgmap v3041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:38 smithi133 ceph-mon[37053]: pgmap v3041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:38 smithi063 ceph-mon[36747]: pgmap v3041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:40 smithi133 ceph-mon[37053]: pgmap v3042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:40 smithi063 ceph-mon[36747]: pgmap v3042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:41.115 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:40 smithi043 ceph-mon[32384]: pgmap v3042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4666.813001 secs 2024-07-26T09:53:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4682.296146 secs 2024-07-26T09:53:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4666.813001 secs 2024-07-26T09:53:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4682.296146 secs 2024-07-26T09:53:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4666.813001 secs 2024-07-26T09:53:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4682.296146 secs 2024-07-26T09:53:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:42 smithi133 ceph-mon[37053]: pgmap v3043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:42 smithi063 ceph-mon[36747]: pgmap v3043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:42 smithi043 ceph-mon[32384]: pgmap v3043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:44 smithi133 ceph-mon[37053]: pgmap v3044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:44 smithi063 ceph-mon[36747]: pgmap v3044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:44 smithi043 ceph-mon[32384]: pgmap v3044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4671.813152 secs 2024-07-26T09:53:47.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4687.296270 secs 2024-07-26T09:53:47.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:46 smithi133 ceph-mon[37053]: pgmap v3045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4671.813152 secs 2024-07-26T09:53:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4687.296270 secs 2024-07-26T09:53:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:46 smithi063 ceph-mon[36747]: pgmap v3045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4671.813152 secs 2024-07-26T09:53:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4687.296270 secs 2024-07-26T09:53:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:46 smithi043 ceph-mon[32384]: pgmap v3045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:48 smithi063 ceph-mon[36747]: pgmap v3046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:48 smithi043 ceph-mon[32384]: pgmap v3046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:48 smithi133 ceph-mon[37053]: pgmap v3046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:50 smithi063 ceph-mon[36747]: pgmap v3047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:50 smithi043 ceph-mon[32384]: pgmap v3047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:50 smithi133 ceph-mon[37053]: pgmap v3047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4676.813243 secs 2024-07-26T09:53:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4692.296385 secs 2024-07-26T09:53:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4676.813243 secs 2024-07-26T09:53:52.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4692.296385 secs 2024-07-26T09:53:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4676.813243 secs 2024-07-26T09:53:52.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4692.296385 secs 2024-07-26T09:53:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:52 smithi063 ceph-mon[36747]: pgmap v3048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:52 smithi043 ceph-mon[32384]: pgmap v3048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:52 smithi133 ceph-mon[37053]: pgmap v3048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:54 smithi063 ceph-mon[36747]: pgmap v3049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:54 smithi043 ceph-mon[32384]: pgmap v3049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:54 smithi133 ceph-mon[37053]: pgmap v3049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:53:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4681.813328 secs 2024-07-26T09:53:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4697.296532 secs 2024-07-26T09:53:57.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:56 smithi063 ceph-mon[36747]: pgmap v3050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4681.813328 secs 2024-07-26T09:53:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4697.296532 secs 2024-07-26T09:53:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:56 smithi043 ceph-mon[32384]: pgmap v3050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4681.813328 secs 2024-07-26T09:53:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4697.296532 secs 2024-07-26T09:53:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:56 smithi133 ceph-mon[37053]: pgmap v3050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:53:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:53:58 smithi063 ceph-mon[36747]: pgmap v3051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:53:58 smithi043 ceph-mon[32384]: pgmap v3051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:53:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:53:58 smithi133 ceph-mon[37053]: pgmap v3051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:00 smithi063 ceph-mon[36747]: pgmap v3052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:00 smithi043 ceph-mon[32384]: pgmap v3052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:00 smithi133 ceph-mon[37053]: pgmap v3052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4686.813439 secs 2024-07-26T09:54:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4702.296684 secs 2024-07-26T09:54:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4686.813439 secs 2024-07-26T09:54:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4702.296684 secs 2024-07-26T09:54:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4686.813439 secs 2024-07-26T09:54:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4702.296684 secs 2024-07-26T09:54:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:02 smithi043 ceph-mon[32384]: pgmap v3053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:02 smithi133 ceph-mon[37053]: pgmap v3053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:02 smithi063 ceph-mon[36747]: pgmap v3053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:04 smithi043 ceph-mon[32384]: pgmap v3054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:04 smithi133 ceph-mon[37053]: pgmap v3054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:04 smithi063 ceph-mon[36747]: pgmap v3054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:07.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4691.813561 secs 2024-07-26T09:54:07.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4707.296822 secs 2024-07-26T09:54:07.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:06 smithi063 ceph-mon[36747]: pgmap v3055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4691.813561 secs 2024-07-26T09:54:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4707.296822 secs 2024-07-26T09:54:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:06 smithi043 ceph-mon[32384]: pgmap v3055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4691.813561 secs 2024-07-26T09:54:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4707.296822 secs 2024-07-26T09:54:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:06 smithi133 ceph-mon[37053]: pgmap v3055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:08 smithi043 ceph-mon[32384]: pgmap v3056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:08 smithi133 ceph-mon[37053]: pgmap v3056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:08 smithi063 ceph-mon[36747]: pgmap v3056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:10 smithi043 ceph-mon[32384]: pgmap v3057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4696.813702 secs 2024-07-26T09:54:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:10 smithi133 ceph-mon[37053]: pgmap v3057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4696.813702 secs 2024-07-26T09:54:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:10 smithi063 ceph-mon[36747]: pgmap v3057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4696.813702 secs 2024-07-26T09:54:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4712.296942 secs 2024-07-26T09:54:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4712.296942 secs 2024-07-26T09:54:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4712.296942 secs 2024-07-26T09:54:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:12 smithi043 ceph-mon[32384]: pgmap v3058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:12 smithi133 ceph-mon[37053]: pgmap v3058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:12 smithi063 ceph-mon[36747]: pgmap v3058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:14 smithi043 ceph-mon[32384]: pgmap v3059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:14 smithi133 ceph-mon[37053]: pgmap v3059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:14 smithi063 ceph-mon[36747]: pgmap v3059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4701.813761 secs 2024-07-26T09:54:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4701.813761 secs 2024-07-26T09:54:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4701.813761 secs 2024-07-26T09:54:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4717.297080 secs 2024-07-26T09:54:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:16 smithi043 ceph-mon[32384]: pgmap v3060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:54:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4717.297080 secs 2024-07-26T09:54:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:16 smithi133 ceph-mon[37053]: pgmap v3060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:54:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4717.297080 secs 2024-07-26T09:54:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:16 smithi063 ceph-mon[36747]: pgmap v3060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:17.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:54:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:54:18.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:54:18.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:17 smithi043 ceph-mon[32384]: pgmap v3061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:54:18.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:17 smithi043 ceph-mon[32384]: pgmap v3062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:18.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:54:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:54:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:54:18.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:17 smithi133 ceph-mon[37053]: pgmap v3061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:54:18.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:17 smithi133 ceph-mon[37053]: pgmap v3062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:18.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:54:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:54:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:54:18.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:17 smithi063 ceph-mon[36747]: pgmap v3061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:54:18.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:17 smithi063 ceph-mon[36747]: pgmap v3062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:18.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:54:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:20 smithi063 ceph-mon[36747]: pgmap v3063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:54:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:20 smithi043 ceph-mon[32384]: pgmap v3063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:54:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:20 smithi133 ceph-mon[37053]: pgmap v3063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:54:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4706.813883 secs 2024-07-26T09:54:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4706.813883 secs 2024-07-26T09:54:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4706.813883 secs 2024-07-26T09:54:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4722.297150 secs 2024-07-26T09:54:22.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:22 smithi063 ceph-mon[36747]: pgmap v3064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:54:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4722.297150 secs 2024-07-26T09:54:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:22 smithi043 ceph-mon[32384]: pgmap v3064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:54:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4722.297150 secs 2024-07-26T09:54:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:22 smithi133 ceph-mon[37053]: pgmap v3064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:54:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:24 smithi063 ceph-mon[36747]: pgmap v3065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:54:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:24 smithi043 ceph-mon[32384]: pgmap v3065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:54:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:24 smithi133 ceph-mon[37053]: pgmap v3065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:54:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:26 smithi063 ceph-mon[36747]: pgmap v3066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4711.814004 secs 2024-07-26T09:54:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:26 smithi043 ceph-mon[32384]: pgmap v3066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4711.814004 secs 2024-07-26T09:54:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:26 smithi133 ceph-mon[37053]: pgmap v3066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4711.814004 secs 2024-07-26T09:54:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4727.297268 secs 2024-07-26T09:54:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4727.297268 secs 2024-07-26T09:54:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4727.297268 secs 2024-07-26T09:54:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:28 smithi063 ceph-mon[36747]: pgmap v3067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:54:28.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:28 smithi043 ceph-mon[32384]: pgmap v3067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:54:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:28 smithi133 ceph-mon[37053]: pgmap v3067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T09:54:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:30 smithi043 ceph-mon[32384]: pgmap v3068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:54:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:30 smithi133 ceph-mon[37053]: pgmap v3068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:54:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:30 smithi063 ceph-mon[36747]: pgmap v3068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:54:31.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4716.814135 secs 2024-07-26T09:54:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4716.814135 secs 2024-07-26T09:54:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4716.814135 secs 2024-07-26T09:54:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4732.297391 secs 2024-07-26T09:54:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:32 smithi043 ceph-mon[32384]: pgmap v3069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:54:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4732.297391 secs 2024-07-26T09:54:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:32 smithi133 ceph-mon[37053]: pgmap v3069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:54:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4732.297391 secs 2024-07-26T09:54:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:32 smithi063 ceph-mon[36747]: pgmap v3069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:54:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:34 smithi043 ceph-mon[32384]: pgmap v3070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:54:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:34 smithi133 ceph-mon[37053]: pgmap v3070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:54:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:34 smithi063 ceph-mon[36747]: pgmap v3070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:54:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:36 smithi043 ceph-mon[32384]: pgmap v3071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4721.814229 secs 2024-07-26T09:54:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:36 smithi133 ceph-mon[37053]: pgmap v3071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4721.814229 secs 2024-07-26T09:54:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:36 smithi063 ceph-mon[36747]: pgmap v3071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:54:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4721.814229 secs 2024-07-26T09:54:37.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4737.297526 secs 2024-07-26T09:54:37.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4737.297526 secs 2024-07-26T09:54:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4737.297526 secs 2024-07-26T09:54:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:38 smithi043 ceph-mon[32384]: pgmap v3072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:54:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:38 smithi133 ceph-mon[37053]: pgmap v3072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:54:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:38 smithi063 ceph-mon[36747]: pgmap v3072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:54:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:40 smithi043 ceph-mon[32384]: pgmap v3073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:40 smithi133 ceph-mon[37053]: pgmap v3073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:40 smithi063 ceph-mon[36747]: pgmap v3073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4726.814352 secs 2024-07-26T09:54:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4726.814352 secs 2024-07-26T09:54:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4726.814352 secs 2024-07-26T09:54:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4742.297622 secs 2024-07-26T09:54:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:42 smithi043 ceph-mon[32384]: pgmap v3074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4742.297622 secs 2024-07-26T09:54:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:42 smithi133 ceph-mon[37053]: pgmap v3074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4742.297622 secs 2024-07-26T09:54:42.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:42 smithi063 ceph-mon[36747]: pgmap v3074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:44 smithi043 ceph-mon[32384]: pgmap v3075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:44 smithi133 ceph-mon[37053]: pgmap v3075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:44 smithi063 ceph-mon[36747]: pgmap v3075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:46 smithi043 ceph-mon[32384]: pgmap v3076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4731.814414 secs 2024-07-26T09:54:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:46 smithi133 ceph-mon[37053]: pgmap v3076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4731.814414 secs 2024-07-26T09:54:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:46 smithi063 ceph-mon[36747]: pgmap v3076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4731.814414 secs 2024-07-26T09:54:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4747.297709 secs 2024-07-26T09:54:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4747.297709 secs 2024-07-26T09:54:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4747.297709 secs 2024-07-26T09:54:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:48 smithi043 ceph-mon[32384]: pgmap v3077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:48 smithi133 ceph-mon[37053]: pgmap v3077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:48 smithi063 ceph-mon[36747]: pgmap v3077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:50 smithi043 ceph-mon[32384]: pgmap v3078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:50 smithi133 ceph-mon[37053]: pgmap v3078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:50 smithi063 ceph-mon[36747]: pgmap v3078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4736.814507 secs 2024-07-26T09:54:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4736.814507 secs 2024-07-26T09:54:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4736.814507 secs 2024-07-26T09:54:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4752.297825 secs 2024-07-26T09:54:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:52 smithi043 ceph-mon[32384]: pgmap v3079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4752.297825 secs 2024-07-26T09:54:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:52 smithi133 ceph-mon[37053]: pgmap v3079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4752.297825 secs 2024-07-26T09:54:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:52 smithi063 ceph-mon[36747]: pgmap v3079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:54 smithi043 ceph-mon[32384]: pgmap v3080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:54 smithi133 ceph-mon[37053]: pgmap v3080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:54 smithi063 ceph-mon[36747]: pgmap v3080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:54:56.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:56 smithi043 ceph-mon[32384]: pgmap v3081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:56.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4741.814647 secs 2024-07-26T09:54:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:56 smithi133 ceph-mon[37053]: pgmap v3081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4741.814647 secs 2024-07-26T09:54:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:56 smithi063 ceph-mon[36747]: pgmap v3081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:54:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4741.814647 secs 2024-07-26T09:54:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4757.297944 secs 2024-07-26T09:54:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4757.297944 secs 2024-07-26T09:54:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4757.297944 secs 2024-07-26T09:54:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:54:58 smithi043 ceph-mon[32384]: pgmap v3082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:54:58 smithi133 ceph-mon[37053]: pgmap v3082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:54:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:54:58 smithi063 ceph-mon[36747]: pgmap v3082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:00 smithi043 ceph-mon[32384]: pgmap v3083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:00 smithi133 ceph-mon[37053]: pgmap v3083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:00 smithi063 ceph-mon[36747]: pgmap v3083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4746.814801 secs 2024-07-26T09:55:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4762.298084 secs 2024-07-26T09:55:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4746.814801 secs 2024-07-26T09:55:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4762.298084 secs 2024-07-26T09:55:01.547 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4746.814801 secs 2024-07-26T09:55:01.547 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4762.298084 secs 2024-07-26T09:55:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:02 smithi043 ceph-mon[32384]: pgmap v3084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:02 smithi133 ceph-mon[37053]: pgmap v3084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:02 smithi063 ceph-mon[36747]: pgmap v3084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:04 smithi043 ceph-mon[32384]: pgmap v3085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:04 smithi133 ceph-mon[37053]: pgmap v3085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:04 smithi063 ceph-mon[36747]: pgmap v3085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:06 smithi043 ceph-mon[32384]: pgmap v3086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4751.814932 secs 2024-07-26T09:55:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4767.298225 secs 2024-07-26T09:55:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:06 smithi133 ceph-mon[37053]: pgmap v3086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4751.814932 secs 2024-07-26T09:55:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4767.298225 secs 2024-07-26T09:55:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:06 smithi063 ceph-mon[36747]: pgmap v3086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4751.814932 secs 2024-07-26T09:55:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4767.298225 secs 2024-07-26T09:55:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:08 smithi133 ceph-mon[37053]: pgmap v3087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:08 smithi063 ceph-mon[36747]: pgmap v3087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:08 smithi043 ceph-mon[32384]: pgmap v3087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:10 smithi133 ceph-mon[37053]: pgmap v3088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:10 smithi063 ceph-mon[36747]: pgmap v3088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:10 smithi043 ceph-mon[32384]: pgmap v3088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4756.815089 secs 2024-07-26T09:55:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4772.298369 secs 2024-07-26T09:55:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4756.815089 secs 2024-07-26T09:55:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4772.298369 secs 2024-07-26T09:55:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4756.815089 secs 2024-07-26T09:55:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4772.298369 secs 2024-07-26T09:55:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:12 smithi133 ceph-mon[37053]: pgmap v3089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:12 smithi063 ceph-mon[36747]: pgmap v3089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:12 smithi043 ceph-mon[32384]: pgmap v3089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:14 smithi133 ceph-mon[37053]: pgmap v3090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:14 smithi063 ceph-mon[36747]: pgmap v3090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:14 smithi043 ceph-mon[32384]: pgmap v3090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:16 smithi063 ceph-mon[36747]: pgmap v3091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4761.815132 secs 2024-07-26T09:55:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4777.298527 secs 2024-07-26T09:55:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:16 smithi043 ceph-mon[32384]: pgmap v3091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4761.815132 secs 2024-07-26T09:55:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4777.298527 secs 2024-07-26T09:55:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:16 smithi133 ceph-mon[37053]: pgmap v3091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4761.815132 secs 2024-07-26T09:55:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4777.298527 secs 2024-07-26T09:55:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:55:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:55:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:55:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:18 smithi063 ceph-mon[36747]: pgmap v3092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:18.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:55:18.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:55:18.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:55:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:18 smithi043 ceph-mon[32384]: pgmap v3092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:55:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:55:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:55:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:18 smithi133 ceph-mon[37053]: pgmap v3092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:55:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:55:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:55:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:19 smithi063 ceph-mon[36747]: pgmap v3093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:19.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:19 smithi063 ceph-mon[36747]: pgmap v3094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:55:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:19 smithi043 ceph-mon[32384]: pgmap v3093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:19.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:19 smithi043 ceph-mon[32384]: pgmap v3094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:55:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:19 smithi133 ceph-mon[37053]: pgmap v3093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:19.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:19 smithi133 ceph-mon[37053]: pgmap v3094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:55:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4766.815254 secs 2024-07-26T09:55:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:21 smithi063 ceph-mon[36747]: pgmap v3095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:55:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4782.298649 secs 2024-07-26T09:55:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4766.815254 secs 2024-07-26T09:55:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:21 smithi043 ceph-mon[32384]: pgmap v3095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:55:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4782.298649 secs 2024-07-26T09:55:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4766.815254 secs 2024-07-26T09:55:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:21 smithi133 ceph-mon[37053]: pgmap v3095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:55:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4782.298649 secs 2024-07-26T09:55:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:23 smithi063 ceph-mon[36747]: pgmap v3096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:55:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:23 smithi043 ceph-mon[32384]: pgmap v3096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:55:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:23 smithi133 ceph-mon[37053]: pgmap v3096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:55:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:25 smithi063 ceph-mon[36747]: pgmap v3097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:25 smithi043 ceph-mon[32384]: pgmap v3097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:25 smithi133 ceph-mon[37053]: pgmap v3097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4771.815334 secs 2024-07-26T09:55:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4787.298783 secs 2024-07-26T09:55:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4771.815334 secs 2024-07-26T09:55:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4787.298783 secs 2024-07-26T09:55:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4771.815334 secs 2024-07-26T09:55:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4787.298783 secs 2024-07-26T09:55:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:27 smithi063 ceph-mon[36747]: pgmap v3098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:27 smithi043 ceph-mon[32384]: pgmap v3098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:27 smithi133 ceph-mon[37053]: pgmap v3098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:55:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:29 smithi043 ceph-mon[32384]: pgmap v3099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:55:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:29 smithi133 ceph-mon[37053]: pgmap v3099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:55:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:29 smithi063 ceph-mon[36747]: pgmap v3099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:55:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4776.815429 secs 2024-07-26T09:55:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:31 smithi043 ceph-mon[32384]: pgmap v3100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4792.298907 secs 2024-07-26T09:55:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4776.815429 secs 2024-07-26T09:55:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:31 smithi133 ceph-mon[37053]: pgmap v3100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4792.298907 secs 2024-07-26T09:55:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4776.815429 secs 2024-07-26T09:55:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:31 smithi063 ceph-mon[36747]: pgmap v3100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4792.298907 secs 2024-07-26T09:55:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:33 smithi043 ceph-mon[32384]: pgmap v3101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:33 smithi133 ceph-mon[37053]: pgmap v3101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:33 smithi063 ceph-mon[36747]: pgmap v3101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:35 smithi043 ceph-mon[32384]: pgmap v3102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:35 smithi133 ceph-mon[37053]: pgmap v3102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:35 smithi063 ceph-mon[36747]: pgmap v3102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4781.815501 secs 2024-07-26T09:55:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4797.298971 secs 2024-07-26T09:55:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4781.815501 secs 2024-07-26T09:55:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4797.298971 secs 2024-07-26T09:55:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4781.815501 secs 2024-07-26T09:55:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4797.298971 secs 2024-07-26T09:55:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:37 smithi043 ceph-mon[32384]: pgmap v3103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:37 smithi133 ceph-mon[37053]: pgmap v3103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:37 smithi063 ceph-mon[36747]: pgmap v3103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:39.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:39 smithi063 ceph-mon[36747]: pgmap v3104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:39 smithi043 ceph-mon[32384]: pgmap v3104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:39 smithi133 ceph-mon[37053]: pgmap v3104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4786.815619 secs 2024-07-26T09:55:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:41 smithi043 ceph-mon[32384]: pgmap v3105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4802.299090 secs 2024-07-26T09:55:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4786.815619 secs 2024-07-26T09:55:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:41 smithi133 ceph-mon[37053]: pgmap v3105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4802.299090 secs 2024-07-26T09:55:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4786.815619 secs 2024-07-26T09:55:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:41 smithi063 ceph-mon[36747]: pgmap v3105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4802.299090 secs 2024-07-26T09:55:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:43 smithi043 ceph-mon[32384]: pgmap v3106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:43 smithi133 ceph-mon[37053]: pgmap v3106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:43 smithi063 ceph-mon[36747]: pgmap v3106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:45 smithi043 ceph-mon[32384]: pgmap v3107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:45 smithi133 ceph-mon[37053]: pgmap v3107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:45 smithi063 ceph-mon[36747]: pgmap v3107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4791.815737 secs 2024-07-26T09:55:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4807.299216 secs 2024-07-26T09:55:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4791.815737 secs 2024-07-26T09:55:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4807.299216 secs 2024-07-26T09:55:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4791.815737 secs 2024-07-26T09:55:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4807.299216 secs 2024-07-26T09:55:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:47 smithi043 ceph-mon[32384]: pgmap v3108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:47 smithi133 ceph-mon[37053]: pgmap v3108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:47 smithi063 ceph-mon[36747]: pgmap v3108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:49 smithi043 ceph-mon[32384]: pgmap v3109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:49 smithi133 ceph-mon[37053]: pgmap v3109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:49 smithi063 ceph-mon[36747]: pgmap v3109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4796.815875 secs 2024-07-26T09:55:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:51 smithi043 ceph-mon[32384]: pgmap v3110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4812.299332 secs 2024-07-26T09:55:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4796.815875 secs 2024-07-26T09:55:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:51 smithi133 ceph-mon[37053]: pgmap v3110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4812.299332 secs 2024-07-26T09:55:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4796.815875 secs 2024-07-26T09:55:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:51 smithi063 ceph-mon[36747]: pgmap v3110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:55:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4812.299332 secs 2024-07-26T09:55:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:53 smithi043 ceph-mon[32384]: pgmap v3111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:53 smithi133 ceph-mon[37053]: pgmap v3111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:53 smithi063 ceph-mon[36747]: pgmap v3111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:55 smithi043 ceph-mon[32384]: pgmap v3112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:55 smithi133 ceph-mon[37053]: pgmap v3112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:55 smithi063 ceph-mon[36747]: pgmap v3112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4801.816000 secs 2024-07-26T09:55:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4817.299449 secs 2024-07-26T09:55:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4801.816000 secs 2024-07-26T09:55:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4817.299449 secs 2024-07-26T09:55:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4801.816000 secs 2024-07-26T09:55:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4817.299449 secs 2024-07-26T09:55:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:57 smithi043 ceph-mon[32384]: pgmap v3113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:57 smithi133 ceph-mon[37053]: pgmap v3113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:57 smithi063 ceph-mon[36747]: pgmap v3113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:55:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:55:59 smithi043 ceph-mon[32384]: pgmap v3114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:55:59 smithi133 ceph-mon[37053]: pgmap v3114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:55:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:55:59 smithi063 ceph-mon[36747]: pgmap v3114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4806.816148 secs 2024-07-26T09:56:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:01 smithi043 ceph-mon[32384]: pgmap v3115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4822.299593 secs 2024-07-26T09:56:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4806.816148 secs 2024-07-26T09:56:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:01 smithi133 ceph-mon[37053]: pgmap v3115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4822.299593 secs 2024-07-26T09:56:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4806.816148 secs 2024-07-26T09:56:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:01 smithi063 ceph-mon[36747]: pgmap v3115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4822.299593 secs 2024-07-26T09:56:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:03 smithi043 ceph-mon[32384]: pgmap v3116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:03 smithi133 ceph-mon[37053]: pgmap v3116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:03 smithi063 ceph-mon[36747]: pgmap v3116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:05 smithi043 ceph-mon[32384]: pgmap v3117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:05 smithi133 ceph-mon[37053]: pgmap v3117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:05 smithi063 ceph-mon[36747]: pgmap v3117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4811.816269 secs 2024-07-26T09:56:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4827.299675 secs 2024-07-26T09:56:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4811.816269 secs 2024-07-26T09:56:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4827.299675 secs 2024-07-26T09:56:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4811.816269 secs 2024-07-26T09:56:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4827.299675 secs 2024-07-26T09:56:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:07 smithi043 ceph-mon[32384]: pgmap v3118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:07 smithi133 ceph-mon[37053]: pgmap v3118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:07 smithi063 ceph-mon[36747]: pgmap v3118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:09 smithi043 ceph-mon[32384]: pgmap v3119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:09 smithi133 ceph-mon[37053]: pgmap v3119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:09 smithi063 ceph-mon[36747]: pgmap v3119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4816.816369 secs 2024-07-26T09:56:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:11 smithi043 ceph-mon[32384]: pgmap v3120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4832.299795 secs 2024-07-26T09:56:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4816.816369 secs 2024-07-26T09:56:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:11 smithi133 ceph-mon[37053]: pgmap v3120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4832.299795 secs 2024-07-26T09:56:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4816.816369 secs 2024-07-26T09:56:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:11 smithi063 ceph-mon[36747]: pgmap v3120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4832.299795 secs 2024-07-26T09:56:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:13 smithi043 ceph-mon[32384]: pgmap v3121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:13 smithi133 ceph-mon[37053]: pgmap v3121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:13 smithi063 ceph-mon[36747]: pgmap v3121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:15 smithi133 ceph-mon[37053]: pgmap v3122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:15 smithi063 ceph-mon[36747]: pgmap v3122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:15 smithi043 ceph-mon[32384]: pgmap v3122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4821.816468 secs 2024-07-26T09:56:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4837.299933 secs 2024-07-26T09:56:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4821.816468 secs 2024-07-26T09:56:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4837.299933 secs 2024-07-26T09:56:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4821.816468 secs 2024-07-26T09:56:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4837.299933 secs 2024-07-26T09:56:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:17 smithi133 ceph-mon[37053]: pgmap v3123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:17 smithi063 ceph-mon[36747]: pgmap v3123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:17 smithi043 ceph-mon[32384]: pgmap v3123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:56:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:56:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:56:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:19 smithi133 ceph-mon[37053]: pgmap v3124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:19 smithi063 ceph-mon[36747]: pgmap v3124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:19 smithi043 ceph-mon[32384]: pgmap v3124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:56:20.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:56:20.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:20 smithi063 ceph-mon[36747]: pgmap v3125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:56:20.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:20 smithi063 ceph-mon[36747]: pgmap v3126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:20.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:20 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:56:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:56:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:56:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:20 smithi043 ceph-mon[32384]: pgmap v3125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:56:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:20 smithi043 ceph-mon[32384]: pgmap v3126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:20 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:20 smithi133 ceph-mon[37053]: pgmap v3125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:56:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:20 smithi133 ceph-mon[37053]: pgmap v3126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:21.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:20 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:56:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4826.816554 secs 2024-07-26T09:56:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4842.300059 secs 2024-07-26T09:56:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4826.816554 secs 2024-07-26T09:56:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4842.300059 secs 2024-07-26T09:56:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4826.816554 secs 2024-07-26T09:56:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4842.300059 secs 2024-07-26T09:56:22.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:22 smithi063 ceph-mon[36747]: pgmap v3127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:22 smithi043 ceph-mon[32384]: pgmap v3127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:22 smithi133 ceph-mon[37053]: pgmap v3127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:24 smithi063 ceph-mon[36747]: pgmap v3128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:24 smithi043 ceph-mon[32384]: pgmap v3128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:24 smithi133 ceph-mon[37053]: pgmap v3128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4831.816613 secs 2024-07-26T09:56:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:26 smithi063 ceph-mon[36747]: pgmap v3129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4847.300181 secs 2024-07-26T09:56:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4831.816613 secs 2024-07-26T09:56:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:26 smithi043 ceph-mon[32384]: pgmap v3129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4847.300181 secs 2024-07-26T09:56:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4831.816613 secs 2024-07-26T09:56:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:26 smithi133 ceph-mon[37053]: pgmap v3129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4847.300181 secs 2024-07-26T09:56:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:28 smithi063 ceph-mon[36747]: pgmap v3130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:28 smithi043 ceph-mon[32384]: pgmap v3130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:28 smithi133 ceph-mon[37053]: pgmap v3130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:56:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:30 smithi063 ceph-mon[36747]: pgmap v3131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:56:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:30 smithi043 ceph-mon[32384]: pgmap v3131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:56:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:30 smithi133 ceph-mon[37053]: pgmap v3131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:56:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4836.816761 secs 2024-07-26T09:56:31.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4852.300281 secs 2024-07-26T09:56:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4836.816761 secs 2024-07-26T09:56:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4852.300281 secs 2024-07-26T09:56:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4836.816761 secs 2024-07-26T09:56:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4852.300281 secs 2024-07-26T09:56:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:32 smithi043 ceph-mon[32384]: pgmap v3132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:32 smithi133 ceph-mon[37053]: pgmap v3132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:32 smithi063 ceph-mon[36747]: pgmap v3132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:33 smithi043 ceph-mon[32384]: pgmap v3133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:33 smithi133 ceph-mon[37053]: pgmap v3133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:33 smithi063 ceph-mon[36747]: pgmap v3133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:35 smithi043 ceph-mon[32384]: pgmap v3134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:35 smithi133 ceph-mon[37053]: pgmap v3134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:35 smithi063 ceph-mon[36747]: pgmap v3134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4841.816884 secs 2024-07-26T09:56:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4857.300420 secs 2024-07-26T09:56:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4841.816884 secs 2024-07-26T09:56:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4857.300420 secs 2024-07-26T09:56:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4841.816884 secs 2024-07-26T09:56:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4857.300420 secs 2024-07-26T09:56:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:37 smithi043 ceph-mon[32384]: pgmap v3135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:37 smithi133 ceph-mon[37053]: pgmap v3135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:37 smithi063 ceph-mon[36747]: pgmap v3135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:39.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:39 smithi063 ceph-mon[36747]: pgmap v3136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:39 smithi043 ceph-mon[32384]: pgmap v3136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:39 smithi133 ceph-mon[37053]: pgmap v3136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4846.816985 secs 2024-07-26T09:56:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4846.816985 secs 2024-07-26T09:56:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4846.816985 secs 2024-07-26T09:56:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4862.300557 secs 2024-07-26T09:56:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:41 smithi043 ceph-mon[32384]: pgmap v3137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4862.300557 secs 2024-07-26T09:56:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:41 smithi133 ceph-mon[37053]: pgmap v3137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4862.300557 secs 2024-07-26T09:56:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:41 smithi063 ceph-mon[36747]: pgmap v3137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:43 smithi043 ceph-mon[32384]: pgmap v3138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:43 smithi133 ceph-mon[37053]: pgmap v3138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:43 smithi063 ceph-mon[36747]: pgmap v3138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:45 smithi043 ceph-mon[32384]: pgmap v3139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:46.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:45 smithi133 ceph-mon[37053]: pgmap v3139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:45 smithi063 ceph-mon[36747]: pgmap v3139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4851.817133 secs 2024-07-26T09:56:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4867.300631 secs 2024-07-26T09:56:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4851.817133 secs 2024-07-26T09:56:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4867.300631 secs 2024-07-26T09:56:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4851.817133 secs 2024-07-26T09:56:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4867.300631 secs 2024-07-26T09:56:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:47 smithi043 ceph-mon[32384]: pgmap v3140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:47 smithi133 ceph-mon[37053]: pgmap v3140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:47 smithi063 ceph-mon[36747]: pgmap v3140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:49 smithi043 ceph-mon[32384]: pgmap v3141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:49 smithi133 ceph-mon[37053]: pgmap v3141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:49 smithi063 ceph-mon[36747]: pgmap v3141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:56:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4856.817234 secs 2024-07-26T09:56:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4856.817234 secs 2024-07-26T09:56:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4856.817234 secs 2024-07-26T09:56:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4872.300766 secs 2024-07-26T09:56:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:51 smithi043 ceph-mon[32384]: pgmap v3142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4872.300766 secs 2024-07-26T09:56:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:51 smithi133 ceph-mon[37053]: pgmap v3142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4872.300766 secs 2024-07-26T09:56:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:51 smithi063 ceph-mon[36747]: pgmap v3142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:53 smithi043 ceph-mon[32384]: pgmap v3143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:53 smithi133 ceph-mon[37053]: pgmap v3143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:53 smithi063 ceph-mon[36747]: pgmap v3143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:55 smithi043 ceph-mon[32384]: pgmap v3144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:55 smithi133 ceph-mon[37053]: pgmap v3144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:55 smithi063 ceph-mon[36747]: pgmap v3144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:56:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4861.817378 secs 2024-07-26T09:56:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4877.300894 secs 2024-07-26T09:56:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4861.817378 secs 2024-07-26T09:56:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4877.300894 secs 2024-07-26T09:56:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4861.817378 secs 2024-07-26T09:56:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4877.300894 secs 2024-07-26T09:56:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:57 smithi043 ceph-mon[32384]: pgmap v3145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:57 smithi133 ceph-mon[37053]: pgmap v3145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:57 smithi063 ceph-mon[36747]: pgmap v3145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:56:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:56:59 smithi043 ceph-mon[32384]: pgmap v3146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:56:59 smithi133 ceph-mon[37053]: pgmap v3146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:56:59 smithi063 ceph-mon[36747]: pgmap v3146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4866.817497 secs 2024-07-26T09:57:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4866.817497 secs 2024-07-26T09:57:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4866.817497 secs 2024-07-26T09:57:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4882.301009 secs 2024-07-26T09:57:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:01 smithi043 ceph-mon[32384]: pgmap v3147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4882.301009 secs 2024-07-26T09:57:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:01 smithi133 ceph-mon[37053]: pgmap v3147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4882.301009 secs 2024-07-26T09:57:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:01 smithi063 ceph-mon[36747]: pgmap v3147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:03 smithi043 ceph-mon[32384]: pgmap v3148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:03 smithi133 ceph-mon[37053]: pgmap v3148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:03 smithi063 ceph-mon[36747]: pgmap v3148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:05 smithi043 ceph-mon[32384]: pgmap v3149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:05 smithi133 ceph-mon[37053]: pgmap v3149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:05 smithi063 ceph-mon[36747]: pgmap v3149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4871.817581 secs 2024-07-26T09:57:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4887.301083 secs 2024-07-26T09:57:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4871.817581 secs 2024-07-26T09:57:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4887.301083 secs 2024-07-26T09:57:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4871.817581 secs 2024-07-26T09:57:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4887.301083 secs 2024-07-26T09:57:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:08 smithi043 ceph-mon[32384]: pgmap v3150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:08 smithi133 ceph-mon[37053]: pgmap v3150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:08 smithi063 ceph-mon[36747]: pgmap v3150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:09 smithi043 ceph-mon[32384]: pgmap v3151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:09 smithi133 ceph-mon[37053]: pgmap v3151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:09 smithi063 ceph-mon[36747]: pgmap v3151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4876.817646 secs 2024-07-26T09:57:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4876.817646 secs 2024-07-26T09:57:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4876.817646 secs 2024-07-26T09:57:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4892.301166 secs 2024-07-26T09:57:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:11 smithi043 ceph-mon[32384]: pgmap v3152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4892.301166 secs 2024-07-26T09:57:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:11 smithi133 ceph-mon[37053]: pgmap v3152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4892.301166 secs 2024-07-26T09:57:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:11 smithi063 ceph-mon[36747]: pgmap v3152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:13 smithi043 ceph-mon[32384]: pgmap v3153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:13 smithi133 ceph-mon[37053]: pgmap v3153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:13 smithi063 ceph-mon[36747]: pgmap v3153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:15 smithi043 ceph-mon[32384]: pgmap v3154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:15 smithi133 ceph-mon[37053]: pgmap v3154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:15 smithi063 ceph-mon[36747]: pgmap v3154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4881.817802 secs 2024-07-26T09:57:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4897.301282 secs 2024-07-26T09:57:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4881.817802 secs 2024-07-26T09:57:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4897.301282 secs 2024-07-26T09:57:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4881.817802 secs 2024-07-26T09:57:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4897.301282 secs 2024-07-26T09:57:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:17 smithi043 ceph-mon[32384]: pgmap v3155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:17 smithi133 ceph-mon[37053]: pgmap v3155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:17 smithi063 ceph-mon[36747]: pgmap v3155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:19 smithi043 ceph-mon[32384]: pgmap v3156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:19 smithi133 ceph-mon[37053]: pgmap v3156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:19 smithi063 ceph-mon[36747]: pgmap v3156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:57:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:57:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4886.817903 secs 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4902.301419 secs 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: pgmap v3157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: pgmap v3158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:57:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:57:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4886.817903 secs 2024-07-26T09:57:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4902.301419 secs 2024-07-26T09:57:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:57:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:57:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: pgmap v3157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:57:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: pgmap v3158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:57:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:57:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4886.817903 secs 2024-07-26T09:57:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4902.301419 secs 2024-07-26T09:57:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:57:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:57:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: pgmap v3157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:57:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: pgmap v3158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:57:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:57:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:23 smithi043 ceph-mon[32384]: pgmap v3159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:57:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:23 smithi133 ceph-mon[37053]: pgmap v3159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:57:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:23 smithi063 ceph-mon[36747]: pgmap v3159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:57:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:25 smithi043 ceph-mon[32384]: pgmap v3160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:57:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4891.818021 secs 2024-07-26T09:57:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:25 smithi133 ceph-mon[37053]: pgmap v3160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:57:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4891.818021 secs 2024-07-26T09:57:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:25 smithi063 ceph-mon[36747]: pgmap v3160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:57:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4891.818021 secs 2024-07-26T09:57:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4907.301539 secs 2024-07-26T09:57:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4907.301539 secs 2024-07-26T09:57:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4907.301539 secs 2024-07-26T09:57:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:27 smithi043 ceph-mon[32384]: pgmap v3161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:57:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:27 smithi133 ceph-mon[37053]: pgmap v3161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:57:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:27 smithi063 ceph-mon[36747]: pgmap v3161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:57:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:29 smithi043 ceph-mon[32384]: pgmap v3162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:57:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:29 smithi133 ceph-mon[37053]: pgmap v3162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:57:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:29 smithi063 ceph-mon[36747]: pgmap v3162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:57:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4896.818161 secs 2024-07-26T09:57:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4896.818161 secs 2024-07-26T09:57:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4896.818161 secs 2024-07-26T09:57:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4912.301696 secs 2024-07-26T09:57:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:31 smithi043 ceph-mon[32384]: pgmap v3163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:57:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4912.301696 secs 2024-07-26T09:57:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:31 smithi133 ceph-mon[37053]: pgmap v3163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:57:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4912.301696 secs 2024-07-26T09:57:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:31 smithi063 ceph-mon[36747]: pgmap v3163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:57:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:33 smithi043 ceph-mon[32384]: pgmap v3164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:33 smithi133 ceph-mon[37053]: pgmap v3164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:33 smithi063 ceph-mon[36747]: pgmap v3164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:35 smithi043 ceph-mon[32384]: pgmap v3165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4901.818288 secs 2024-07-26T09:57:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:35 smithi133 ceph-mon[37053]: pgmap v3165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4901.818288 secs 2024-07-26T09:57:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:35 smithi063 ceph-mon[36747]: pgmap v3165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4901.818288 secs 2024-07-26T09:57:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4917.301818 secs 2024-07-26T09:57:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4917.301818 secs 2024-07-26T09:57:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4917.301818 secs 2024-07-26T09:57:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:37 smithi043 ceph-mon[32384]: pgmap v3166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:37 smithi133 ceph-mon[37053]: pgmap v3166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:37 smithi063 ceph-mon[36747]: pgmap v3166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:39 smithi043 ceph-mon[32384]: pgmap v3167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:39 smithi133 ceph-mon[37053]: pgmap v3167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:39 smithi063 ceph-mon[36747]: pgmap v3167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4906.818374 secs 2024-07-26T09:57:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4906.818374 secs 2024-07-26T09:57:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4906.818374 secs 2024-07-26T09:57:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4922.301920 secs 2024-07-26T09:57:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:41 smithi043 ceph-mon[32384]: pgmap v3168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4922.301920 secs 2024-07-26T09:57:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:41 smithi133 ceph-mon[37053]: pgmap v3168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4922.301920 secs 2024-07-26T09:57:42.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:41 smithi063 ceph-mon[36747]: pgmap v3168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:44.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:43 smithi043 ceph-mon[32384]: pgmap v3169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:43 smithi133 ceph-mon[37053]: pgmap v3169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:43 smithi063 ceph-mon[36747]: pgmap v3169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:45 smithi043 ceph-mon[32384]: pgmap v3170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4911.818496 secs 2024-07-26T09:57:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:45 smithi133 ceph-mon[37053]: pgmap v3170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4911.818496 secs 2024-07-26T09:57:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:45 smithi063 ceph-mon[36747]: pgmap v3170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4911.818496 secs 2024-07-26T09:57:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4927.302000 secs 2024-07-26T09:57:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4927.302000 secs 2024-07-26T09:57:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4927.302000 secs 2024-07-26T09:57:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:47 smithi043 ceph-mon[32384]: pgmap v3171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:47 smithi133 ceph-mon[37053]: pgmap v3171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:47 smithi063 ceph-mon[36747]: pgmap v3171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:49 smithi043 ceph-mon[32384]: pgmap v3172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:49 smithi133 ceph-mon[37053]: pgmap v3172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:49 smithi063 ceph-mon[36747]: pgmap v3172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4916.818615 secs 2024-07-26T09:57:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4916.818615 secs 2024-07-26T09:57:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4916.818615 secs 2024-07-26T09:57:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4932.302115 secs 2024-07-26T09:57:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:52 smithi133 ceph-mon[37053]: pgmap v3173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4932.302115 secs 2024-07-26T09:57:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:52 smithi063 ceph-mon[36747]: pgmap v3173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4932.302115 secs 2024-07-26T09:57:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:52 smithi043 ceph-mon[32384]: pgmap v3173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:54 smithi063 ceph-mon[36747]: pgmap v3174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:54 smithi043 ceph-mon[32384]: pgmap v3174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:54 smithi133 ceph-mon[37053]: pgmap v3174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:57:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:56 smithi063 ceph-mon[36747]: pgmap v3175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4921.818739 secs 2024-07-26T09:57:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:56 smithi043 ceph-mon[32384]: pgmap v3175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4921.818739 secs 2024-07-26T09:57:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:56 smithi133 ceph-mon[37053]: pgmap v3175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:57:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4921.818739 secs 2024-07-26T09:57:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4937.302236 secs 2024-07-26T09:57:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4937.302236 secs 2024-07-26T09:57:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4937.302236 secs 2024-07-26T09:57:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:57:58 smithi043 ceph-mon[32384]: pgmap v3176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:57:58 smithi133 ceph-mon[37053]: pgmap v3176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:57:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:57:58 smithi063 ceph-mon[36747]: pgmap v3176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:00 smithi043 ceph-mon[32384]: pgmap v3177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:00 smithi133 ceph-mon[37053]: pgmap v3177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:00 smithi063 ceph-mon[36747]: pgmap v3177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4926.818870 secs 2024-07-26T09:58:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4942.302380 secs 2024-07-26T09:58:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4926.818870 secs 2024-07-26T09:58:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4942.302380 secs 2024-07-26T09:58:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4926.818870 secs 2024-07-26T09:58:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4942.302380 secs 2024-07-26T09:58:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:02 smithi133 ceph-mon[37053]: pgmap v3178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:02 smithi063 ceph-mon[36747]: pgmap v3178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:02 smithi043 ceph-mon[32384]: pgmap v3178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:04 smithi133 ceph-mon[37053]: pgmap v3179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:04 smithi063 ceph-mon[36747]: pgmap v3179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:04 smithi043 ceph-mon[32384]: pgmap v3179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:06 smithi133 ceph-mon[37053]: pgmap v3180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4931.818972 secs 2024-07-26T09:58:06.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4947.302494 secs 2024-07-26T09:58:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:06 smithi063 ceph-mon[36747]: pgmap v3180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4931.818972 secs 2024-07-26T09:58:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4947.302494 secs 2024-07-26T09:58:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:06 smithi043 ceph-mon[32384]: pgmap v3180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4931.818972 secs 2024-07-26T09:58:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4947.302494 secs 2024-07-26T09:58:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:08 smithi133 ceph-mon[37053]: pgmap v3181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:08 smithi063 ceph-mon[36747]: pgmap v3181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:08 smithi043 ceph-mon[32384]: pgmap v3181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:10 smithi133 ceph-mon[37053]: pgmap v3182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:10 smithi063 ceph-mon[36747]: pgmap v3182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:10 smithi043 ceph-mon[32384]: pgmap v3182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4936.819098 secs 2024-07-26T09:58:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4952.302611 secs 2024-07-26T09:58:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4936.819098 secs 2024-07-26T09:58:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4952.302611 secs 2024-07-26T09:58:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4936.819098 secs 2024-07-26T09:58:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4952.302611 secs 2024-07-26T09:58:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:12 smithi063 ceph-mon[36747]: pgmap v3183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:12 smithi043 ceph-mon[32384]: pgmap v3183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:12 smithi133 ceph-mon[37053]: pgmap v3183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:14 smithi063 ceph-mon[36747]: pgmap v3184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:14 smithi043 ceph-mon[32384]: pgmap v3184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:14 smithi133 ceph-mon[37053]: pgmap v3184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:16 smithi063 ceph-mon[36747]: pgmap v3185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4941.819117 secs 2024-07-26T09:58:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4957.302691 secs 2024-07-26T09:58:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:16 smithi043 ceph-mon[32384]: pgmap v3185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4941.819117 secs 2024-07-26T09:58:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4957.302691 secs 2024-07-26T09:58:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:16 smithi133 ceph-mon[37053]: pgmap v3185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4941.819117 secs 2024-07-26T09:58:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4957.302691 secs 2024-07-26T09:58:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:18 smithi063 ceph-mon[36747]: pgmap v3186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:18 smithi043 ceph-mon[32384]: pgmap v3186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:18 smithi133 ceph-mon[37053]: pgmap v3186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:20 smithi063 ceph-mon[36747]: pgmap v3187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:20 smithi043 ceph-mon[32384]: pgmap v3187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:20 smithi133 ceph-mon[37053]: pgmap v3187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4946.819204 secs 2024-07-26T09:58:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4962.302757 secs 2024-07-26T09:58:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:58:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4946.819204 secs 2024-07-26T09:58:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4962.302757 secs 2024-07-26T09:58:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:58:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4946.819204 secs 2024-07-26T09:58:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4962.302757 secs 2024-07-26T09:58:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:58:22.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:22 smithi063 ceph-mon[36747]: pgmap v3188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:22 smithi043 ceph-mon[32384]: pgmap v3188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:22 smithi133 ceph-mon[37053]: pgmap v3188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:24 smithi063 ceph-mon[36747]: pgmap v3189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:58:24.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:24 smithi043 ceph-mon[32384]: pgmap v3189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:58:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:24 smithi133 ceph-mon[37053]: pgmap v3189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T09:58:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:26 smithi133 ceph-mon[37053]: pgmap v3190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:58:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4951.819327 secs 2024-07-26T09:58:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:26 smithi063 ceph-mon[36747]: pgmap v3190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:58:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4951.819327 secs 2024-07-26T09:58:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:26 smithi043 ceph-mon[32384]: pgmap v3190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:58:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4951.819327 secs 2024-07-26T09:58:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4967.302826 secs 2024-07-26T09:58:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4967.302826 secs 2024-07-26T09:58:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4967.302826 secs 2024-07-26T09:58:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: pgmap v3191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:58:28.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:58:28.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: pgmap v3191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:58:28.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: pgmap v3191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:58:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:58:28.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:58:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:29 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:58:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:29 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:58:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:29 smithi063 ceph-mon[36747]: pgmap v3192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:58:29.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:29 smithi063 ceph-mon[36747]: pgmap v3193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:58:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:29 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:58:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:29 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:58:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:29 smithi043 ceph-mon[32384]: pgmap v3192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:58:29.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:29 smithi043 ceph-mon[32384]: pgmap v3193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:58:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:29 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T09:58:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:29 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T09:58:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:29 smithi133 ceph-mon[37053]: pgmap v3192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T09:58:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:29 smithi133 ceph-mon[37053]: pgmap v3193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T09:58:31.288 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:31 smithi043 ceph-mon[32384]: pgmap v3194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:58:31.288 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4956.819414 secs 2024-07-26T09:58:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:31 smithi063 ceph-mon[36747]: pgmap v3194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:58:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4956.819414 secs 2024-07-26T09:58:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:31 smithi133 ceph-mon[37053]: pgmap v3194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T09:58:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4956.819414 secs 2024-07-26T09:58:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4972.302894 secs 2024-07-26T09:58:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4972.302894 secs 2024-07-26T09:58:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4972.302894 secs 2024-07-26T09:58:33.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:33 smithi043 ceph-mon[32384]: pgmap v3195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:33 smithi063 ceph-mon[36747]: pgmap v3195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:33.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:33 smithi133 ceph-mon[37053]: pgmap v3195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:35 smithi063 ceph-mon[36747]: pgmap v3196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:58:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:35 smithi043 ceph-mon[32384]: pgmap v3196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:58:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:35 smithi133 ceph-mon[37053]: pgmap v3196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:58:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4961.819494 secs 2024-07-26T09:58:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4961.819494 secs 2024-07-26T09:58:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4961.819494 secs 2024-07-26T09:58:37.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4977.303045 secs 2024-07-26T09:58:37.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:37 smithi043 ceph-mon[32384]: pgmap v3197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:58:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4977.303045 secs 2024-07-26T09:58:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:37 smithi133 ceph-mon[37053]: pgmap v3197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:58:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4977.303045 secs 2024-07-26T09:58:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:37 smithi063 ceph-mon[36747]: pgmap v3197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T09:58:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:39 smithi133 ceph-mon[37053]: pgmap v3198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:58:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:39 smithi063 ceph-mon[36747]: pgmap v3198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:58:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:39 smithi043 ceph-mon[32384]: pgmap v3198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:58:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:41 smithi133 ceph-mon[37053]: pgmap v3199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:41.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4966.819614 secs 2024-07-26T09:58:41.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4982.303169 secs 2024-07-26T09:58:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:41 smithi063 ceph-mon[36747]: pgmap v3199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4966.819614 secs 2024-07-26T09:58:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4982.303169 secs 2024-07-26T09:58:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:41 smithi043 ceph-mon[32384]: pgmap v3199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4966.819614 secs 2024-07-26T09:58:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4982.303169 secs 2024-07-26T09:58:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:43 smithi133 ceph-mon[37053]: pgmap v3200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:43 smithi063 ceph-mon[36747]: pgmap v3200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:43 smithi043 ceph-mon[32384]: pgmap v3200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:45 smithi133 ceph-mon[37053]: pgmap v3201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:45 smithi063 ceph-mon[36747]: pgmap v3201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:45 smithi043 ceph-mon[32384]: pgmap v3201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4971.819759 secs 2024-07-26T09:58:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4987.303305 secs 2024-07-26T09:58:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4971.819759 secs 2024-07-26T09:58:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4987.303305 secs 2024-07-26T09:58:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4971.819759 secs 2024-07-26T09:58:46.786 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4987.303305 secs 2024-07-26T09:58:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:47 smithi063 ceph-mon[36747]: pgmap v3202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:47 smithi043 ceph-mon[32384]: pgmap v3202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:47 smithi133 ceph-mon[37053]: pgmap v3202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:49 smithi063 ceph-mon[36747]: pgmap v3203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:49 smithi043 ceph-mon[32384]: pgmap v3203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:49 smithi133 ceph-mon[37053]: pgmap v3203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:51 smithi063 ceph-mon[36747]: pgmap v3204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4976.819860 secs 2024-07-26T09:58:51.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4992.303447 secs 2024-07-26T09:58:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:51 smithi043 ceph-mon[32384]: pgmap v3204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4976.819860 secs 2024-07-26T09:58:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4992.303447 secs 2024-07-26T09:58:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:51 smithi133 ceph-mon[37053]: pgmap v3204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:58:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4976.819860 secs 2024-07-26T09:58:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4992.303447 secs 2024-07-26T09:58:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:53 smithi063 ceph-mon[36747]: pgmap v3205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:53 smithi043 ceph-mon[32384]: pgmap v3205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:53 smithi133 ceph-mon[37053]: pgmap v3205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:55 smithi063 ceph-mon[36747]: pgmap v3206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:55 smithi043 ceph-mon[32384]: pgmap v3206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:55 smithi133 ceph-mon[37053]: pgmap v3206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4981.820017 secs 2024-07-26T09:58:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 4997.303572 secs 2024-07-26T09:58:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4981.820017 secs 2024-07-26T09:58:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 4997.303572 secs 2024-07-26T09:58:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4981.820017 secs 2024-07-26T09:58:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 4997.303572 secs 2024-07-26T09:58:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:57 smithi043 ceph-mon[32384]: pgmap v3207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:57 smithi133 ceph-mon[37053]: pgmap v3207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:57 smithi063 ceph-mon[36747]: pgmap v3207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:58:59.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:58:59 smithi043 ceph-mon[32384]: pgmap v3208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:58:59 smithi133 ceph-mon[37053]: pgmap v3208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:58:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:58:59 smithi063 ceph-mon[36747]: pgmap v3208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:01 smithi043 ceph-mon[32384]: pgmap v3209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4986.820143 secs 2024-07-26T09:59:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5002.303710 secs 2024-07-26T09:59:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:01 smithi133 ceph-mon[37053]: pgmap v3209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4986.820143 secs 2024-07-26T09:59:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5002.303710 secs 2024-07-26T09:59:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:01 smithi063 ceph-mon[36747]: pgmap v3209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4986.820143 secs 2024-07-26T09:59:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5002.303710 secs 2024-07-26T09:59:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:03 smithi043 ceph-mon[32384]: pgmap v3210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:03 smithi133 ceph-mon[37053]: pgmap v3210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:03 smithi063 ceph-mon[36747]: pgmap v3210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:05 smithi043 ceph-mon[32384]: pgmap v3211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:05 smithi133 ceph-mon[37053]: pgmap v3211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:05 smithi063 ceph-mon[36747]: pgmap v3211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4991.820234 secs 2024-07-26T09:59:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5007.303838 secs 2024-07-26T09:59:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4991.820234 secs 2024-07-26T09:59:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5007.303838 secs 2024-07-26T09:59:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4991.820234 secs 2024-07-26T09:59:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5007.303838 secs 2024-07-26T09:59:07.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:07 smithi043 ceph-mon[32384]: pgmap v3212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:07 smithi133 ceph-mon[37053]: pgmap v3212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:07 smithi063 ceph-mon[36747]: pgmap v3212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:09 smithi043 ceph-mon[32384]: pgmap v3213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:09 smithi133 ceph-mon[37053]: pgmap v3213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:09 smithi063 ceph-mon[36747]: pgmap v3213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:11.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:11 smithi063 ceph-mon[36747]: pgmap v3214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:11.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 4996.820365 secs 2024-07-26T09:59:11.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5012.303884 secs 2024-07-26T09:59:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:11 smithi043 ceph-mon[32384]: pgmap v3214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 4996.820365 secs 2024-07-26T09:59:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5012.303884 secs 2024-07-26T09:59:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:11 smithi133 ceph-mon[37053]: pgmap v3214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 4996.820365 secs 2024-07-26T09:59:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5012.303884 secs 2024-07-26T09:59:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:13 smithi043 ceph-mon[32384]: pgmap v3215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:13 smithi133 ceph-mon[37053]: pgmap v3215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:13 smithi063 ceph-mon[36747]: pgmap v3215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:15 smithi043 ceph-mon[32384]: pgmap v3216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:15 smithi133 ceph-mon[37053]: pgmap v3216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:15 smithi063 ceph-mon[36747]: pgmap v3216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5001.820486 secs 2024-07-26T09:59:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5017.304003 secs 2024-07-26T09:59:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5001.820486 secs 2024-07-26T09:59:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5017.304003 secs 2024-07-26T09:59:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5001.820486 secs 2024-07-26T09:59:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5017.304003 secs 2024-07-26T09:59:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:17 smithi043 ceph-mon[32384]: pgmap v3217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:17 smithi133 ceph-mon[37053]: pgmap v3217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:17 smithi063 ceph-mon[36747]: pgmap v3217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:19 smithi043 ceph-mon[32384]: pgmap v3218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:19 smithi133 ceph-mon[37053]: pgmap v3218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:19 smithi063 ceph-mon[36747]: pgmap v3218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:21 smithi043 ceph-mon[32384]: pgmap v3219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5006.820553 secs 2024-07-26T09:59:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5022.304071 secs 2024-07-26T09:59:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:21 smithi133 ceph-mon[37053]: pgmap v3219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5006.820553 secs 2024-07-26T09:59:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5022.304071 secs 2024-07-26T09:59:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:21 smithi063 ceph-mon[36747]: pgmap v3219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5006.820553 secs 2024-07-26T09:59:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5022.304071 secs 2024-07-26T09:59:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:23 smithi043 ceph-mon[32384]: pgmap v3220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:23 smithi133 ceph-mon[37053]: pgmap v3220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:23 smithi063 ceph-mon[36747]: pgmap v3220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:25 smithi043 ceph-mon[32384]: pgmap v3221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:25 smithi133 ceph-mon[37053]: pgmap v3221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:25 smithi063 ceph-mon[36747]: pgmap v3221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5011.820681 secs 2024-07-26T09:59:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5027.304168 secs 2024-07-26T09:59:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5011.820681 secs 2024-07-26T09:59:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5027.304168 secs 2024-07-26T09:59:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5011.820681 secs 2024-07-26T09:59:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5027.304168 secs 2024-07-26T09:59:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:27 smithi043 ceph-mon[32384]: pgmap v3222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:27 smithi133 ceph-mon[37053]: pgmap v3222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:27 smithi063 ceph-mon[36747]: pgmap v3222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:59:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:59:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T09:59:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:28.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:29 smithi043 ceph-mon[32384]: pgmap v3223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:29.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:29 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:59:29.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:29 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:59:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:29 smithi133 ceph-mon[37053]: pgmap v3223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:29 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:59:29.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:29 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:59:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:29 smithi063 ceph-mon[36747]: pgmap v3223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:29.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:29 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T09:59:29.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:29 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T09:59:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:31 smithi043 ceph-mon[32384]: pgmap v3224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5016.820754 secs 2024-07-26T09:59:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5032.304237 secs 2024-07-26T09:59:31.744 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:31 smithi133 ceph-mon[37053]: pgmap v3224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:31.744 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5016.820754 secs 2024-07-26T09:59:31.744 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5032.304237 secs 2024-07-26T09:59:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:31 smithi063 ceph-mon[36747]: pgmap v3224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5016.820754 secs 2024-07-26T09:59:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5032.304237 secs 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: pgmap v3225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:59:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:59:33.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:59:33.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:59:33.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: pgmap v3226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:59:33.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: pgmap v3227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:59:33.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: pgmap v3225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:33.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: pgmap v3226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: pgmap v3227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:59:33.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: pgmap v3225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: pgmap v3226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:59:33.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: pgmap v3227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:59:33.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T09:59:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:34 smithi043 ceph-mon[32384]: pgmap v3228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:59:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:34 smithi133 ceph-mon[37053]: pgmap v3228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:59:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:34 smithi063 ceph-mon[36747]: pgmap v3228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:59:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5021.820892 secs 2024-07-26T09:59:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5021.820892 secs 2024-07-26T09:59:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5021.820892 secs 2024-07-26T09:59:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5037.304350 secs 2024-07-26T09:59:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:36 smithi043 ceph-mon[32384]: pgmap v3229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:59:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5037.304350 secs 2024-07-26T09:59:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:36 smithi133 ceph-mon[37053]: pgmap v3229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:59:37.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5037.304350 secs 2024-07-26T09:59:37.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:36 smithi063 ceph-mon[36747]: pgmap v3229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T09:59:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:38 smithi043 ceph-mon[32384]: pgmap v3230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:59:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:38 smithi133 ceph-mon[37053]: pgmap v3230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:59:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:38 smithi063 ceph-mon[36747]: pgmap v3230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T09:59:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:40 smithi043 ceph-mon[32384]: pgmap v3231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:59:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5026.821024 secs 2024-07-26T09:59:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:40 smithi133 ceph-mon[37053]: pgmap v3231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:59:41.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5026.821024 secs 2024-07-26T09:59:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:40 smithi063 ceph-mon[36747]: pgmap v3231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T09:59:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5026.821024 secs 2024-07-26T09:59:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5042.304467 secs 2024-07-26T09:59:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5042.304467 secs 2024-07-26T09:59:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5042.304467 secs 2024-07-26T09:59:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:42 smithi043 ceph-mon[32384]: pgmap v3232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:59:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:42 smithi133 ceph-mon[37053]: pgmap v3232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:59:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:42 smithi063 ceph-mon[36747]: pgmap v3232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T09:59:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:44 smithi043 ceph-mon[32384]: pgmap v3233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:44 smithi133 ceph-mon[37053]: pgmap v3233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:44 smithi063 ceph-mon[36747]: pgmap v3233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5031.821121 secs 2024-07-26T09:59:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5031.821121 secs 2024-07-26T09:59:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5031.821121 secs 2024-07-26T09:59:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5047.304584 secs 2024-07-26T09:59:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:46 smithi043 ceph-mon[32384]: pgmap v3234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5047.304584 secs 2024-07-26T09:59:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:46 smithi133 ceph-mon[37053]: pgmap v3234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:47.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5047.304584 secs 2024-07-26T09:59:47.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:46 smithi063 ceph-mon[36747]: pgmap v3234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:48 smithi043 ceph-mon[32384]: pgmap v3235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:48 smithi133 ceph-mon[37053]: pgmap v3235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:48 smithi063 ceph-mon[36747]: pgmap v3235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:50 smithi043 ceph-mon[32384]: pgmap v3236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5036.821252 secs 2024-07-26T09:59:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:50 smithi133 ceph-mon[37053]: pgmap v3236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5036.821252 secs 2024-07-26T09:59:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:50 smithi063 ceph-mon[36747]: pgmap v3236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T09:59:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5036.821252 secs 2024-07-26T09:59:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5052.304651 secs 2024-07-26T09:59:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5052.304651 secs 2024-07-26T09:59:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5052.304651 secs 2024-07-26T09:59:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:52 smithi133 ceph-mon[37053]: pgmap v3237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:52 smithi063 ceph-mon[36747]: pgmap v3237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:52 smithi043 ceph-mon[32384]: pgmap v3237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:54 smithi133 ceph-mon[37053]: pgmap v3238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:54 smithi063 ceph-mon[36747]: pgmap v3238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:54 smithi043 ceph-mon[32384]: pgmap v3238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5041.821344 secs 2024-07-26T09:59:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5041.821344 secs 2024-07-26T09:59:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5041.821344 secs 2024-07-26T09:59:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5057.304777 secs 2024-07-26T09:59:57.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:57 smithi133 ceph-mon[37053]: pgmap v3239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5057.304777 secs 2024-07-26T09:59:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:57 smithi063 ceph-mon[36747]: pgmap v3239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5057.304777 secs 2024-07-26T09:59:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:57 smithi043 ceph-mon[32384]: pgmap v3239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T09:59:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 09:59:59 smithi133 ceph-mon[37053]: pgmap v3240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 09:59:59 smithi063 ceph-mon[36747]: pgmap v3240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T09:59:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 09:59:59 smithi043 ceph-mon[32384]: pgmap v3240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:00:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:00:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:00:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:01 smithi063 ceph-mon[36747]: pgmap v3241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5046.821478 secs 2024-07-26T10:00:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:01 smithi043 ceph-mon[32384]: pgmap v3241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:01.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5046.821478 secs 2024-07-26T10:00:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:01 smithi133 ceph-mon[37053]: pgmap v3241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5046.821478 secs 2024-07-26T10:00:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5062.304897 secs 2024-07-26T10:00:02.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5062.304897 secs 2024-07-26T10:00:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5062.304897 secs 2024-07-26T10:00:03.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:03 smithi063 ceph-mon[36747]: pgmap v3242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:03 smithi043 ceph-mon[32384]: pgmap v3242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:03 smithi133 ceph-mon[37053]: pgmap v3242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:05 smithi063 ceph-mon[36747]: pgmap v3243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:05 smithi043 ceph-mon[32384]: pgmap v3243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:05 smithi133 ceph-mon[37053]: pgmap v3243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5051.821606 secs 2024-07-26T10:00:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5051.821606 secs 2024-07-26T10:00:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5051.821606 secs 2024-07-26T10:00:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5067.305006 secs 2024-07-26T10:00:07.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:07 smithi063 ceph-mon[36747]: pgmap v3244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5067.305006 secs 2024-07-26T10:00:07.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:07 smithi043 ceph-mon[32384]: pgmap v3244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5067.305006 secs 2024-07-26T10:00:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:07 smithi133 ceph-mon[37053]: pgmap v3244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:09 smithi043 ceph-mon[32384]: pgmap v3245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:09 smithi133 ceph-mon[37053]: pgmap v3245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:09 smithi063 ceph-mon[36747]: pgmap v3245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:11.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:11 smithi063 ceph-mon[36747]: pgmap v3246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:11.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5056.821731 secs 2024-07-26T10:00:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:11 smithi043 ceph-mon[32384]: pgmap v3246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5056.821731 secs 2024-07-26T10:00:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:11 smithi133 ceph-mon[37053]: pgmap v3246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5056.821731 secs 2024-07-26T10:00:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5072.305133 secs 2024-07-26T10:00:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5072.305133 secs 2024-07-26T10:00:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5072.305133 secs 2024-07-26T10:00:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:13 smithi043 ceph-mon[32384]: pgmap v3247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:13 smithi133 ceph-mon[37053]: pgmap v3247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:13 smithi063 ceph-mon[36747]: pgmap v3247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:15 smithi043 ceph-mon[32384]: pgmap v3248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:15 smithi133 ceph-mon[37053]: pgmap v3248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:15 smithi063 ceph-mon[36747]: pgmap v3248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5061.821877 secs 2024-07-26T10:00:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5061.821877 secs 2024-07-26T10:00:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5061.821877 secs 2024-07-26T10:00:17.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5077.305251 secs 2024-07-26T10:00:17.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:17 smithi043 ceph-mon[32384]: pgmap v3249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5077.305251 secs 2024-07-26T10:00:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:17 smithi133 ceph-mon[37053]: pgmap v3249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5077.305251 secs 2024-07-26T10:00:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:17 smithi063 ceph-mon[36747]: pgmap v3249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:19 smithi043 ceph-mon[32384]: pgmap v3250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:19 smithi133 ceph-mon[37053]: pgmap v3250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:19 smithi063 ceph-mon[36747]: pgmap v3250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:21 smithi043 ceph-mon[32384]: pgmap v3251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5066.822020 secs 2024-07-26T10:00:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:21 smithi133 ceph-mon[37053]: pgmap v3251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5066.822020 secs 2024-07-26T10:00:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:21 smithi063 ceph-mon[36747]: pgmap v3251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5066.822020 secs 2024-07-26T10:00:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5082.305368 secs 2024-07-26T10:00:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5082.305368 secs 2024-07-26T10:00:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5082.305368 secs 2024-07-26T10:00:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:23 smithi043 ceph-mon[32384]: pgmap v3252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:23 smithi133 ceph-mon[37053]: pgmap v3252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:23 smithi063 ceph-mon[36747]: pgmap v3252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:25 smithi043 ceph-mon[32384]: pgmap v3253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:00:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:25 smithi133 ceph-mon[37053]: pgmap v3253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:00:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:25 smithi063 ceph-mon[36747]: pgmap v3253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:00:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5071.822145 secs 2024-07-26T10:00:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5071.822145 secs 2024-07-26T10:00:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5071.822145 secs 2024-07-26T10:00:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5087.305491 secs 2024-07-26T10:00:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:27 smithi043 ceph-mon[32384]: pgmap v3254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5087.305491 secs 2024-07-26T10:00:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:27 smithi133 ceph-mon[37053]: pgmap v3254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5087.305491 secs 2024-07-26T10:00:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:27 smithi063 ceph-mon[36747]: pgmap v3254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:29 smithi043 ceph-mon[32384]: pgmap v3255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:00:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:29 smithi133 ceph-mon[37053]: pgmap v3255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:00:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:29 smithi063 ceph-mon[36747]: pgmap v3255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:00:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:31 smithi043 ceph-mon[32384]: pgmap v3256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5076.822276 secs 2024-07-26T10:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:31 smithi133 ceph-mon[37053]: pgmap v3256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5076.822276 secs 2024-07-26T10:00:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:31 smithi063 ceph-mon[36747]: pgmap v3256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5076.822276 secs 2024-07-26T10:00:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5092.305573 secs 2024-07-26T10:00:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:00:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5092.305573 secs 2024-07-26T10:00:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:00:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5092.305573 secs 2024-07-26T10:00:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:00:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:33 smithi043 ceph-mon[32384]: pgmap v3257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:00:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:00:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:00:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:33 smithi133 ceph-mon[37053]: pgmap v3257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:00:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:00:33.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:00:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:33 smithi063 ceph-mon[36747]: pgmap v3257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:00:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:00:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:00:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:34 smithi043 ceph-mon[32384]: pgmap v3258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:34 smithi043 ceph-mon[32384]: pgmap v3259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:00:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:34 smithi133 ceph-mon[37053]: pgmap v3258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:34 smithi133 ceph-mon[37053]: pgmap v3259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:00:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:34 smithi063 ceph-mon[36747]: pgmap v3258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:34 smithi063 ceph-mon[36747]: pgmap v3259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:00:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:36 smithi043 ceph-mon[32384]: pgmap v3260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5081.822374 secs 2024-07-26T10:00:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:36 smithi133 ceph-mon[37053]: pgmap v3260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5081.822374 secs 2024-07-26T10:00:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:36 smithi063 ceph-mon[36747]: pgmap v3260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5081.822374 secs 2024-07-26T10:00:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5097.305693 secs 2024-07-26T10:00:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5097.305693 secs 2024-07-26T10:00:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5097.305693 secs 2024-07-26T10:00:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:38 smithi043 ceph-mon[32384]: pgmap v3261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:38 smithi133 ceph-mon[37053]: pgmap v3261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:38 smithi063 ceph-mon[36747]: pgmap v3261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:00:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:40 smithi043 ceph-mon[32384]: pgmap v3262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:40 smithi133 ceph-mon[37053]: pgmap v3262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:40 smithi063 ceph-mon[36747]: pgmap v3262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5086.822489 secs 2024-07-26T10:00:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5086.822489 secs 2024-07-26T10:00:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5086.822489 secs 2024-07-26T10:00:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5102.305814 secs 2024-07-26T10:00:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:42 smithi043 ceph-mon[32384]: pgmap v3263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5102.305814 secs 2024-07-26T10:00:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:42 smithi133 ceph-mon[37053]: pgmap v3263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5102.305814 secs 2024-07-26T10:00:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:42 smithi063 ceph-mon[36747]: pgmap v3263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:00:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:44 smithi133 ceph-mon[37053]: pgmap v3264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:44 smithi063 ceph-mon[36747]: pgmap v3264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:44 smithi043 ceph-mon[32384]: pgmap v3264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:00:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:46 smithi133 ceph-mon[37053]: pgmap v3265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5091.822617 secs 2024-07-26T10:00:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:46 smithi063 ceph-mon[36747]: pgmap v3265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5091.822617 secs 2024-07-26T10:00:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:46 smithi043 ceph-mon[32384]: pgmap v3265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:46.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5091.822617 secs 2024-07-26T10:00:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5107.305939 secs 2024-07-26T10:00:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5107.305939 secs 2024-07-26T10:00:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5107.305939 secs 2024-07-26T10:00:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:48 smithi133 ceph-mon[37053]: pgmap v3266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:48 smithi063 ceph-mon[36747]: pgmap v3266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:48 smithi043 ceph-mon[32384]: pgmap v3266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:50 smithi133 ceph-mon[37053]: pgmap v3267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:50 smithi063 ceph-mon[36747]: pgmap v3267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:50 smithi043 ceph-mon[32384]: pgmap v3267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5096.822761 secs 2024-07-26T10:00:51.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5112.306038 secs 2024-07-26T10:00:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5096.822761 secs 2024-07-26T10:00:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5112.306038 secs 2024-07-26T10:00:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5096.822761 secs 2024-07-26T10:00:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5112.306038 secs 2024-07-26T10:00:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:52 smithi063 ceph-mon[36747]: pgmap v3268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:52 smithi043 ceph-mon[32384]: pgmap v3268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:52 smithi133 ceph-mon[37053]: pgmap v3268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:54 smithi063 ceph-mon[36747]: pgmap v3269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:54 smithi043 ceph-mon[32384]: pgmap v3269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:54 smithi133 ceph-mon[37053]: pgmap v3269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:00:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:56 smithi063 ceph-mon[36747]: pgmap v3270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5101.822906 secs 2024-07-26T10:00:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5117.306152 secs 2024-07-26T10:00:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:56 smithi043 ceph-mon[32384]: pgmap v3270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5101.822906 secs 2024-07-26T10:00:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5117.306152 secs 2024-07-26T10:00:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:56 smithi133 ceph-mon[37053]: pgmap v3270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:00:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5101.822906 secs 2024-07-26T10:00:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5117.306152 secs 2024-07-26T10:00:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:00:58 smithi063 ceph-mon[36747]: pgmap v3271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:00:58 smithi043 ceph-mon[32384]: pgmap v3271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:00:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:00:58 smithi133 ceph-mon[37053]: pgmap v3271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:00 smithi063 ceph-mon[36747]: pgmap v3272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:00 smithi043 ceph-mon[32384]: pgmap v3272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:00 smithi133 ceph-mon[37053]: pgmap v3272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:01.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5106.823052 secs 2024-07-26T10:01:01.567 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5122.306219 secs 2024-07-26T10:01:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5106.823052 secs 2024-07-26T10:01:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5122.306219 secs 2024-07-26T10:01:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5106.823052 secs 2024-07-26T10:01:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5122.306219 secs 2024-07-26T10:01:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:02 smithi063 ceph-mon[36747]: pgmap v3273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:02 smithi043 ceph-mon[32384]: pgmap v3273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:02 smithi133 ceph-mon[37053]: pgmap v3273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:04 smithi043 ceph-mon[32384]: pgmap v3274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:04 smithi133 ceph-mon[37053]: pgmap v3274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:04 smithi063 ceph-mon[36747]: pgmap v3274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:06 smithi043 ceph-mon[32384]: pgmap v3275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5111.823170 secs 2024-07-26T10:01:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5127.306354 secs 2024-07-26T10:01:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:06 smithi133 ceph-mon[37053]: pgmap v3275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5111.823170 secs 2024-07-26T10:01:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5127.306354 secs 2024-07-26T10:01:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:06 smithi063 ceph-mon[36747]: pgmap v3275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5111.823170 secs 2024-07-26T10:01:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5127.306354 secs 2024-07-26T10:01:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:08 smithi043 ceph-mon[32384]: pgmap v3276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:08 smithi133 ceph-mon[37053]: pgmap v3276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:08 smithi063 ceph-mon[36747]: pgmap v3276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:10.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:10 smithi043 ceph-mon[32384]: pgmap v3277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:10 smithi133 ceph-mon[37053]: pgmap v3277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:10 smithi063 ceph-mon[36747]: pgmap v3277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:11.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5116.823303 secs 2024-07-26T10:01:11.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5132.306414 secs 2024-07-26T10:01:11.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5116.823303 secs 2024-07-26T10:01:11.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5132.306414 secs 2024-07-26T10:01:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5116.823303 secs 2024-07-26T10:01:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5132.306414 secs 2024-07-26T10:01:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:12 smithi043 ceph-mon[32384]: pgmap v3278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:12 smithi133 ceph-mon[37053]: pgmap v3278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:12.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:12 smithi063 ceph-mon[36747]: pgmap v3278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:14 smithi043 ceph-mon[32384]: pgmap v3279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:14 smithi133 ceph-mon[37053]: pgmap v3279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:14 smithi063 ceph-mon[36747]: pgmap v3279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:16 smithi043 ceph-mon[32384]: pgmap v3280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5121.823427 secs 2024-07-26T10:01:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5137.306549 secs 2024-07-26T10:01:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:16 smithi133 ceph-mon[37053]: pgmap v3280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5121.823427 secs 2024-07-26T10:01:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5137.306549 secs 2024-07-26T10:01:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:16 smithi063 ceph-mon[36747]: pgmap v3280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5121.823427 secs 2024-07-26T10:01:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5137.306549 secs 2024-07-26T10:01:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:18 smithi043 ceph-mon[32384]: pgmap v3281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:18 smithi133 ceph-mon[37053]: pgmap v3281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:18 smithi063 ceph-mon[36747]: pgmap v3281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:20 smithi043 ceph-mon[32384]: pgmap v3282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:20 smithi133 ceph-mon[37053]: pgmap v3282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:20 smithi063 ceph-mon[36747]: pgmap v3282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5126.823532 secs 2024-07-26T10:01:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5142.306675 secs 2024-07-26T10:01:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5126.823532 secs 2024-07-26T10:01:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5142.306675 secs 2024-07-26T10:01:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5126.823532 secs 2024-07-26T10:01:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5142.306675 secs 2024-07-26T10:01:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:22 smithi043 ceph-mon[32384]: pgmap v3283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:22 smithi133 ceph-mon[37053]: pgmap v3283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:22 smithi063 ceph-mon[36747]: pgmap v3283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:24 smithi043 ceph-mon[32384]: pgmap v3284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:24 smithi133 ceph-mon[37053]: pgmap v3284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:24 smithi063 ceph-mon[36747]: pgmap v3284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:26 smithi043 ceph-mon[32384]: pgmap v3285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5131.823658 secs 2024-07-26T10:01:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5147.306805 secs 2024-07-26T10:01:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:26 smithi133 ceph-mon[37053]: pgmap v3285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5131.823658 secs 2024-07-26T10:01:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5147.306805 secs 2024-07-26T10:01:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:26 smithi063 ceph-mon[36747]: pgmap v3285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5131.823658 secs 2024-07-26T10:01:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5147.306805 secs 2024-07-26T10:01:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:28 smithi043 ceph-mon[32384]: pgmap v3286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:28 smithi133 ceph-mon[37053]: pgmap v3286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:28 smithi063 ceph-mon[36747]: pgmap v3286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:30 smithi043 ceph-mon[32384]: pgmap v3287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:30 smithi133 ceph-mon[37053]: pgmap v3287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:30 smithi063 ceph-mon[36747]: pgmap v3287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5136.823783 secs 2024-07-26T10:01:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5152.306939 secs 2024-07-26T10:01:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5136.823783 secs 2024-07-26T10:01:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5152.306939 secs 2024-07-26T10:01:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5136.823783 secs 2024-07-26T10:01:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5152.306939 secs 2024-07-26T10:01:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:32 smithi043 ceph-mon[32384]: pgmap v3288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:32 smithi133 ceph-mon[37053]: pgmap v3288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:32.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:32 smithi063 ceph-mon[36747]: pgmap v3288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:01:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:01:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:01:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:34 smithi043 ceph-mon[32384]: pgmap v3289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:34 smithi133 ceph-mon[37053]: pgmap v3289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:34 smithi063 ceph-mon[36747]: pgmap v3289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:01:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:01:35.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:01:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:01:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:01:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:01:35.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:01:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:36 smithi043 ceph-mon[32384]: pgmap v3290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:36 smithi043 ceph-mon[32384]: pgmap v3291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5141.823916 secs 2024-07-26T10:01:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5157.307061 secs 2024-07-26T10:01:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:36 smithi133 ceph-mon[37053]: pgmap v3290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:36 smithi133 ceph-mon[37053]: pgmap v3291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:36.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5141.823916 secs 2024-07-26T10:01:36.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5157.307061 secs 2024-07-26T10:01:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:36 smithi063 ceph-mon[36747]: pgmap v3290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:36 smithi063 ceph-mon[36747]: pgmap v3291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5141.823916 secs 2024-07-26T10:01:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5157.307061 secs 2024-07-26T10:01:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:38 smithi043 ceph-mon[32384]: pgmap v3292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:38 smithi133 ceph-mon[37053]: pgmap v3292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:38 smithi063 ceph-mon[36747]: pgmap v3292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:40 smithi043 ceph-mon[32384]: pgmap v3293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:40 smithi133 ceph-mon[37053]: pgmap v3293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:40 smithi063 ceph-mon[36747]: pgmap v3293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5146.824039 secs 2024-07-26T10:01:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5162.307200 secs 2024-07-26T10:01:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5146.824039 secs 2024-07-26T10:01:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5162.307200 secs 2024-07-26T10:01:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5146.824039 secs 2024-07-26T10:01:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5162.307200 secs 2024-07-26T10:01:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:42 smithi133 ceph-mon[37053]: pgmap v3294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:42 smithi063 ceph-mon[36747]: pgmap v3294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:42.908 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:42 smithi043 ceph-mon[32384]: pgmap v3294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:44 smithi133 ceph-mon[37053]: pgmap v3295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:44 smithi063 ceph-mon[36747]: pgmap v3295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:44 smithi043 ceph-mon[32384]: pgmap v3295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:01:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:46 smithi133 ceph-mon[37053]: pgmap v3296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:01:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5151.824164 secs 2024-07-26T10:01:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5167.307339 secs 2024-07-26T10:01:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:46 smithi063 ceph-mon[36747]: pgmap v3296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:01:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5151.824164 secs 2024-07-26T10:01:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5167.307339 secs 2024-07-26T10:01:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:46 smithi043 ceph-mon[32384]: pgmap v3296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:01:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5151.824164 secs 2024-07-26T10:01:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5167.307339 secs 2024-07-26T10:01:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:48 smithi133 ceph-mon[37053]: pgmap v3297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:48 smithi063 ceph-mon[36747]: pgmap v3297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:48 smithi043 ceph-mon[32384]: pgmap v3297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:50 smithi133 ceph-mon[37053]: pgmap v3298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:50 smithi063 ceph-mon[36747]: pgmap v3298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:50 smithi043 ceph-mon[32384]: pgmap v3298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5156.824285 secs 2024-07-26T10:01:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5172.307368 secs 2024-07-26T10:01:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5156.824285 secs 2024-07-26T10:01:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5172.307368 secs 2024-07-26T10:01:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5156.824285 secs 2024-07-26T10:01:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5172.307368 secs 2024-07-26T10:01:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:52 smithi063 ceph-mon[36747]: pgmap v3299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:52 smithi043 ceph-mon[32384]: pgmap v3299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:52 smithi133 ceph-mon[37053]: pgmap v3299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:54 smithi063 ceph-mon[36747]: pgmap v3300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:54 smithi043 ceph-mon[32384]: pgmap v3300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:54 smithi133 ceph-mon[37053]: pgmap v3300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:01:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:56 smithi063 ceph-mon[36747]: pgmap v3301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5161.824369 secs 2024-07-26T10:01:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5177.307488 secs 2024-07-26T10:01:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:56 smithi043 ceph-mon[32384]: pgmap v3301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5161.824369 secs 2024-07-26T10:01:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5177.307488 secs 2024-07-26T10:01:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:56 smithi133 ceph-mon[37053]: pgmap v3301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:01:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5161.824369 secs 2024-07-26T10:01:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5177.307488 secs 2024-07-26T10:01:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:01:58 smithi063 ceph-mon[36747]: pgmap v3302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:01:58 smithi043 ceph-mon[32384]: pgmap v3302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:01:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:01:58 smithi133 ceph-mon[37053]: pgmap v3302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:00 smithi063 ceph-mon[36747]: pgmap v3303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:00 smithi043 ceph-mon[32384]: pgmap v3303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:00 smithi133 ceph-mon[37053]: pgmap v3303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5166.824459 secs 2024-07-26T10:02:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5182.307627 secs 2024-07-26T10:02:01.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5166.824459 secs 2024-07-26T10:02:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5182.307627 secs 2024-07-26T10:02:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5166.824459 secs 2024-07-26T10:02:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5182.307627 secs 2024-07-26T10:02:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:02 smithi063 ceph-mon[36747]: pgmap v3304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:02 smithi043 ceph-mon[32384]: pgmap v3304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:02 smithi133 ceph-mon[37053]: pgmap v3304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:04 smithi063 ceph-mon[36747]: pgmap v3305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:04 smithi043 ceph-mon[32384]: pgmap v3305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:04 smithi133 ceph-mon[37053]: pgmap v3305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:06 smithi043 ceph-mon[32384]: pgmap v3306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5171.824586 secs 2024-07-26T10:02:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5187.307716 secs 2024-07-26T10:02:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:06 smithi133 ceph-mon[37053]: pgmap v3306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5171.824586 secs 2024-07-26T10:02:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5187.307716 secs 2024-07-26T10:02:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:06 smithi063 ceph-mon[36747]: pgmap v3306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5171.824586 secs 2024-07-26T10:02:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5187.307716 secs 2024-07-26T10:02:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:08 smithi043 ceph-mon[32384]: pgmap v3307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:08 smithi133 ceph-mon[37053]: pgmap v3307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:08 smithi063 ceph-mon[36747]: pgmap v3307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:10 smithi043 ceph-mon[32384]: pgmap v3308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:10 smithi133 ceph-mon[37053]: pgmap v3308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:10 smithi063 ceph-mon[36747]: pgmap v3308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:11.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5176.824710 secs 2024-07-26T10:02:11.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5192.307856 secs 2024-07-26T10:02:11.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5176.824710 secs 2024-07-26T10:02:11.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5192.307856 secs 2024-07-26T10:02:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5176.824710 secs 2024-07-26T10:02:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5192.307856 secs 2024-07-26T10:02:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:12 smithi043 ceph-mon[32384]: pgmap v3309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:12 smithi133 ceph-mon[37053]: pgmap v3309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:12 smithi063 ceph-mon[36747]: pgmap v3309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:14 smithi043 ceph-mon[32384]: pgmap v3310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:14 smithi133 ceph-mon[37053]: pgmap v3310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:14 smithi063 ceph-mon[36747]: pgmap v3310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:16 smithi043 ceph-mon[32384]: pgmap v3311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5181.824807 secs 2024-07-26T10:02:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5197.307968 secs 2024-07-26T10:02:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:16 smithi133 ceph-mon[37053]: pgmap v3311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5181.824807 secs 2024-07-26T10:02:17.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5197.307968 secs 2024-07-26T10:02:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:16 smithi063 ceph-mon[36747]: pgmap v3311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5181.824807 secs 2024-07-26T10:02:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5197.307968 secs 2024-07-26T10:02:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:18 smithi043 ceph-mon[32384]: pgmap v3312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:18 smithi133 ceph-mon[37053]: pgmap v3312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:18 smithi063 ceph-mon[36747]: pgmap v3312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:20.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:20 smithi043 ceph-mon[32384]: pgmap v3313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:20 smithi133 ceph-mon[37053]: pgmap v3313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:20 smithi063 ceph-mon[36747]: pgmap v3313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5186.824932 secs 2024-07-26T10:02:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5202.308086 secs 2024-07-26T10:02:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5186.824932 secs 2024-07-26T10:02:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5202.308086 secs 2024-07-26T10:02:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5186.824932 secs 2024-07-26T10:02:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5202.308086 secs 2024-07-26T10:02:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:22 smithi043 ceph-mon[32384]: pgmap v3314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:22 smithi133 ceph-mon[37053]: pgmap v3314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:22 smithi063 ceph-mon[36747]: pgmap v3314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:24 smithi043 ceph-mon[32384]: pgmap v3315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:24 smithi133 ceph-mon[37053]: pgmap v3315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:24 smithi063 ceph-mon[36747]: pgmap v3315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:26 smithi043 ceph-mon[32384]: pgmap v3316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5191.825055 secs 2024-07-26T10:02:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5207.308161 secs 2024-07-26T10:02:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:26 smithi133 ceph-mon[37053]: pgmap v3316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5191.825055 secs 2024-07-26T10:02:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5207.308161 secs 2024-07-26T10:02:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:26 smithi063 ceph-mon[36747]: pgmap v3316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5191.825055 secs 2024-07-26T10:02:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5207.308161 secs 2024-07-26T10:02:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:27 smithi043 ceph-mon[32384]: pgmap v3317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:27 smithi133 ceph-mon[37053]: pgmap v3317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:27 smithi063 ceph-mon[36747]: pgmap v3317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:30 smithi043 ceph-mon[32384]: pgmap v3318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:30 smithi133 ceph-mon[37053]: pgmap v3318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:30 smithi063 ceph-mon[36747]: pgmap v3318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5196.825126 secs 2024-07-26T10:02:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5196.825126 secs 2024-07-26T10:02:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5196.825126 secs 2024-07-26T10:02:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5212.308277 secs 2024-07-26T10:02:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:32 smithi043 ceph-mon[32384]: pgmap v3319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5212.308277 secs 2024-07-26T10:02:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:32 smithi133 ceph-mon[37053]: pgmap v3319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5212.308277 secs 2024-07-26T10:02:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:32 smithi063 ceph-mon[36747]: pgmap v3319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:34 smithi043 ceph-mon[32384]: pgmap v3320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:34 smithi133 ceph-mon[37053]: pgmap v3320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:34 smithi063 ceph-mon[36747]: pgmap v3320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: pgmap v3321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5201.825195 secs 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.476 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.478 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: pgmap v3321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:36.478 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5201.825195 secs 2024-07-26T10:02:36.478 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:02:36.478 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.479 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.479 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.479 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: pgmap v3321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5201.825195 secs 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:36.505 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5217.308369 secs 2024-07-26T10:02:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5217.308369 secs 2024-07-26T10:02:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5217.308369 secs 2024-07-26T10:02:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:38 smithi133 ceph-mon[37053]: pgmap v3322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:38 smithi063 ceph-mon[36747]: pgmap v3322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:38 smithi043 ceph-mon[32384]: pgmap v3322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:38.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:38.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:40 smithi043 ceph-mon[32384]: pgmap v3323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:40 smithi133 ceph-mon[37053]: pgmap v3323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:40 smithi063 ceph-mon[36747]: pgmap v3323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:40.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:41.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5206.825314 secs 2024-07-26T10:02:41.669 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:02:41.669 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:02:41.669 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: pgmap v3324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:02:41.669 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: pgmap v3325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:02:41.669 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:41.669 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5222.308495 secs 2024-07-26T10:02:41.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5206.825314 secs 2024-07-26T10:02:41.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:02:41.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:02:41.721 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: pgmap v3324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:02:41.721 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: pgmap v3325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:02:41.721 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:41.721 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5222.308495 secs 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5206.825314 secs 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: pgmap v3324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: pgmap v3325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:02:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5222.308495 secs 2024-07-26T10:02:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:43 smithi063 ceph-mon[36747]: pgmap v3326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:43 smithi043 ceph-mon[32384]: pgmap v3326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:44.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:43 smithi133 ceph-mon[37053]: pgmap v3326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:45 smithi043 ceph-mon[32384]: pgmap v3327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:45 smithi063 ceph-mon[36747]: pgmap v3327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:45 smithi133 ceph-mon[37053]: pgmap v3327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5211.825436 secs 2024-07-26T10:02:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5227.308566 secs 2024-07-26T10:02:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5211.825436 secs 2024-07-26T10:02:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5227.308566 secs 2024-07-26T10:02:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5211.825436 secs 2024-07-26T10:02:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5227.308566 secs 2024-07-26T10:02:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:47 smithi043 ceph-mon[32384]: pgmap v3328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:47 smithi133 ceph-mon[37053]: pgmap v3328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:47 smithi063 ceph-mon[36747]: pgmap v3328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:49 smithi043 ceph-mon[32384]: pgmap v3329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:49 smithi133 ceph-mon[37053]: pgmap v3329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:49 smithi063 ceph-mon[36747]: pgmap v3329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:02:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5216.825554 secs 2024-07-26T10:02:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:51 smithi043 ceph-mon[32384]: pgmap v3330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:02:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5232.308687 secs 2024-07-26T10:02:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5216.825554 secs 2024-07-26T10:02:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:51 smithi133 ceph-mon[37053]: pgmap v3330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:02:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5232.308687 secs 2024-07-26T10:02:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5216.825554 secs 2024-07-26T10:02:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:51 smithi063 ceph-mon[36747]: pgmap v3330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:02:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5232.308687 secs 2024-07-26T10:02:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:53 smithi043 ceph-mon[32384]: pgmap v3331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:02:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:53 smithi133 ceph-mon[37053]: pgmap v3331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:02:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:53 smithi063 ceph-mon[36747]: pgmap v3331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:02:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:55 smithi043 ceph-mon[32384]: pgmap v3332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:55 smithi133 ceph-mon[37053]: pgmap v3332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:55 smithi063 ceph-mon[36747]: pgmap v3332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:02:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5221.825655 secs 2024-07-26T10:02:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5237.308791 secs 2024-07-26T10:02:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5221.825655 secs 2024-07-26T10:02:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5237.308791 secs 2024-07-26T10:02:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5221.825655 secs 2024-07-26T10:02:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5237.308791 secs 2024-07-26T10:02:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:57 smithi043 ceph-mon[32384]: pgmap v3333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:57 smithi133 ceph-mon[37053]: pgmap v3333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:57 smithi063 ceph-mon[36747]: pgmap v3333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:02:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:02:59 smithi043 ceph-mon[32384]: pgmap v3334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:02:59 smithi133 ceph-mon[37053]: pgmap v3334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:02:59 smithi063 ceph-mon[36747]: pgmap v3334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5226.825803 secs 2024-07-26T10:03:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:01 smithi043 ceph-mon[32384]: pgmap v3335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5242.308937 secs 2024-07-26T10:03:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5226.825803 secs 2024-07-26T10:03:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:01 smithi133 ceph-mon[37053]: pgmap v3335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5242.308937 secs 2024-07-26T10:03:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5226.825803 secs 2024-07-26T10:03:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:01 smithi063 ceph-mon[36747]: pgmap v3335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5242.308937 secs 2024-07-26T10:03:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:03 smithi043 ceph-mon[32384]: pgmap v3336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:03 smithi133 ceph-mon[37053]: pgmap v3336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:03 smithi063 ceph-mon[36747]: pgmap v3336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:05 smithi043 ceph-mon[32384]: pgmap v3337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:05 smithi133 ceph-mon[37053]: pgmap v3337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:05 smithi063 ceph-mon[36747]: pgmap v3337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5231.825935 secs 2024-07-26T10:03:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5247.309020 secs 2024-07-26T10:03:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5231.825935 secs 2024-07-26T10:03:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5247.309020 secs 2024-07-26T10:03:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5231.825935 secs 2024-07-26T10:03:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5247.309020 secs 2024-07-26T10:03:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:07 smithi043 ceph-mon[32384]: pgmap v3338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:07 smithi133 ceph-mon[37053]: pgmap v3338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:07 smithi063 ceph-mon[36747]: pgmap v3338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:08 smithi043 ceph-mon[32384]: pgmap v3339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:08 smithi133 ceph-mon[37053]: pgmap v3339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:08 smithi063 ceph-mon[36747]: pgmap v3339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5236.826070 secs 2024-07-26T10:03:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:11 smithi043 ceph-mon[32384]: pgmap v3340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5252.309133 secs 2024-07-26T10:03:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5236.826070 secs 2024-07-26T10:03:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:11 smithi133 ceph-mon[37053]: pgmap v3340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5252.309133 secs 2024-07-26T10:03:12.054 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5236.826070 secs 2024-07-26T10:03:12.054 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:11 smithi063 ceph-mon[36747]: pgmap v3340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:12.054 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5252.309133 secs 2024-07-26T10:03:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:13 smithi043 ceph-mon[32384]: pgmap v3341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:13 smithi133 ceph-mon[37053]: pgmap v3341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:14.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:13 smithi063 ceph-mon[36747]: pgmap v3341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:15.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:15 smithi043 ceph-mon[32384]: pgmap v3342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:15 smithi133 ceph-mon[37053]: pgmap v3342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:15 smithi063 ceph-mon[36747]: pgmap v3342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5241.826227 secs 2024-07-26T10:03:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5257.309250 secs 2024-07-26T10:03:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5241.826227 secs 2024-07-26T10:03:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5257.309250 secs 2024-07-26T10:03:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5241.826227 secs 2024-07-26T10:03:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5257.309250 secs 2024-07-26T10:03:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:17 smithi043 ceph-mon[32384]: pgmap v3343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:17 smithi133 ceph-mon[37053]: pgmap v3343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:17 smithi063 ceph-mon[36747]: pgmap v3343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:19 smithi043 ceph-mon[32384]: pgmap v3344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:19 smithi133 ceph-mon[37053]: pgmap v3344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:19 smithi063 ceph-mon[36747]: pgmap v3344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5246.826358 secs 2024-07-26T10:03:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:21 smithi043 ceph-mon[32384]: pgmap v3345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5262.309371 secs 2024-07-26T10:03:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5246.826358 secs 2024-07-26T10:03:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:21 smithi133 ceph-mon[37053]: pgmap v3345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5262.309371 secs 2024-07-26T10:03:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5246.826358 secs 2024-07-26T10:03:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:21 smithi063 ceph-mon[36747]: pgmap v3345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5262.309371 secs 2024-07-26T10:03:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:23 smithi043 ceph-mon[32384]: pgmap v3346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:23 smithi133 ceph-mon[37053]: pgmap v3346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:23 smithi063 ceph-mon[36747]: pgmap v3346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:25 smithi043 ceph-mon[32384]: pgmap v3347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:25 smithi133 ceph-mon[37053]: pgmap v3347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:25 smithi063 ceph-mon[36747]: pgmap v3347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5251.826491 secs 2024-07-26T10:03:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5267.309488 secs 2024-07-26T10:03:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5251.826491 secs 2024-07-26T10:03:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5267.309488 secs 2024-07-26T10:03:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5251.826491 secs 2024-07-26T10:03:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5267.309488 secs 2024-07-26T10:03:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:27 smithi043 ceph-mon[32384]: pgmap v3348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:27 smithi133 ceph-mon[37053]: pgmap v3348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:27 smithi063 ceph-mon[36747]: pgmap v3348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:29 smithi043 ceph-mon[32384]: pgmap v3349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:29 smithi133 ceph-mon[37053]: pgmap v3349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:29 smithi063 ceph-mon[36747]: pgmap v3349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5256.826607 secs 2024-07-26T10:03:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:31 smithi043 ceph-mon[32384]: pgmap v3350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5272.309609 secs 2024-07-26T10:03:32.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5256.826607 secs 2024-07-26T10:03:32.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:31 smithi133 ceph-mon[37053]: pgmap v3350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:32.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5272.309609 secs 2024-07-26T10:03:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5256.826607 secs 2024-07-26T10:03:32.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:31 smithi063 ceph-mon[36747]: pgmap v3350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:32.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5272.309609 secs 2024-07-26T10:03:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:33 smithi043 ceph-mon[32384]: pgmap v3351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:33 smithi133 ceph-mon[37053]: pgmap v3351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:33 smithi063 ceph-mon[36747]: pgmap v3351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:03:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:34 smithi043 ceph-mon[32384]: pgmap v3352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:34 smithi133 ceph-mon[37053]: pgmap v3352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:34 smithi063 ceph-mon[36747]: pgmap v3352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5261.826670 secs 2024-07-26T10:03:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5261.826670 secs 2024-07-26T10:03:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5261.826670 secs 2024-07-26T10:03:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5277.309727 secs 2024-07-26T10:03:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:36 smithi133 ceph-mon[37053]: pgmap v3353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5277.309727 secs 2024-07-26T10:03:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:36 smithi063 ceph-mon[36747]: pgmap v3353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5277.309727 secs 2024-07-26T10:03:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:36 smithi043 ceph-mon[32384]: pgmap v3353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:39 smithi043 ceph-mon[32384]: pgmap v3354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:39 smithi133 ceph-mon[37053]: pgmap v3354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:39 smithi063 ceph-mon[36747]: pgmap v3354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:41.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5266.826791 secs 2024-07-26T10:03:41.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:41 smithi063 ceph-mon[36747]: pgmap v3355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:41.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5282.309850 secs 2024-07-26T10:03:41.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:41 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:03:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5266.826791 secs 2024-07-26T10:03:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:41 smithi043 ceph-mon[32384]: pgmap v3355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5282.309850 secs 2024-07-26T10:03:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:41 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5266.826791 secs 2024-07-26T10:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:41 smithi133 ceph-mon[37053]: pgmap v3355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5282.309850 secs 2024-07-26T10:03:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:41 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:03:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:03:42.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:03:42.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:03:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:03:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:03:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:03:43.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:03:43.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:03:43.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:03:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:43 smithi043 ceph-mon[32384]: pgmap v3356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:43 smithi043 ceph-mon[32384]: pgmap v3357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:03:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:43 smithi133 ceph-mon[37053]: pgmap v3356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:43 smithi133 ceph-mon[37053]: pgmap v3357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:03:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:43 smithi063 ceph-mon[36747]: pgmap v3356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:44.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:43 smithi063 ceph-mon[36747]: pgmap v3357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:03:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:45 smithi043 ceph-mon[32384]: pgmap v3358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:45 smithi133 ceph-mon[37053]: pgmap v3358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:45 smithi063 ceph-mon[36747]: pgmap v3358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5271.826908 secs 2024-07-26T10:03:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5287.309937 secs 2024-07-26T10:03:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5271.826908 secs 2024-07-26T10:03:47.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5287.309937 secs 2024-07-26T10:03:47.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5271.826908 secs 2024-07-26T10:03:47.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5287.309937 secs 2024-07-26T10:03:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:47 smithi043 ceph-mon[32384]: pgmap v3359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:47 smithi133 ceph-mon[37053]: pgmap v3359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:47 smithi063 ceph-mon[36747]: pgmap v3359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:49 smithi043 ceph-mon[32384]: pgmap v3360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:03:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:49 smithi133 ceph-mon[37053]: pgmap v3360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:03:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:49 smithi063 ceph-mon[36747]: pgmap v3360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:03:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:51 smithi043 ceph-mon[32384]: pgmap v3361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5276.827058 secs 2024-07-26T10:03:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5292.310021 secs 2024-07-26T10:03:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:51 smithi133 ceph-mon[37053]: pgmap v3361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5276.827058 secs 2024-07-26T10:03:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5292.310021 secs 2024-07-26T10:03:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:51 smithi063 ceph-mon[36747]: pgmap v3361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:03:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5276.827058 secs 2024-07-26T10:03:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5292.310021 secs 2024-07-26T10:03:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:53 smithi043 ceph-mon[32384]: pgmap v3362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:03:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:53 smithi133 ceph-mon[37053]: pgmap v3362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:03:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:53 smithi063 ceph-mon[36747]: pgmap v3362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:03:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:55 smithi043 ceph-mon[32384]: pgmap v3363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:55 smithi133 ceph-mon[37053]: pgmap v3363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:55 smithi063 ceph-mon[36747]: pgmap v3363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5281.827177 secs 2024-07-26T10:03:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5297.310113 secs 2024-07-26T10:03:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5281.827177 secs 2024-07-26T10:03:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5297.310113 secs 2024-07-26T10:03:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5281.827177 secs 2024-07-26T10:03:57.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5297.310113 secs 2024-07-26T10:03:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:57 smithi043 ceph-mon[32384]: pgmap v3364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:57 smithi133 ceph-mon[37053]: pgmap v3364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:57 smithi063 ceph-mon[36747]: pgmap v3364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:03:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:03:58 smithi043 ceph-mon[32384]: pgmap v3365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:03:58 smithi133 ceph-mon[37053]: pgmap v3365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:03:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:03:58 smithi063 ceph-mon[36747]: pgmap v3365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:00 smithi043 ceph-mon[32384]: pgmap v3366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:00 smithi133 ceph-mon[37053]: pgmap v3366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:00 smithi063 ceph-mon[36747]: pgmap v3366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5286.827268 secs 2024-07-26T10:04:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5302.310254 secs 2024-07-26T10:04:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5286.827268 secs 2024-07-26T10:04:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5302.310254 secs 2024-07-26T10:04:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5286.827268 secs 2024-07-26T10:04:02.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5302.310254 secs 2024-07-26T10:04:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:02 smithi043 ceph-mon[32384]: pgmap v3367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:02 smithi133 ceph-mon[37053]: pgmap v3367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:02 smithi063 ceph-mon[36747]: pgmap v3367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:04 smithi043 ceph-mon[32384]: pgmap v3368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:04 smithi133 ceph-mon[37053]: pgmap v3368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:04 smithi063 ceph-mon[36747]: pgmap v3368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5291.827413 secs 2024-07-26T10:04:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5307.310392 secs 2024-07-26T10:04:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:06 smithi043 ceph-mon[32384]: pgmap v3369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5291.827413 secs 2024-07-26T10:04:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5307.310392 secs 2024-07-26T10:04:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:06 smithi133 ceph-mon[37053]: pgmap v3369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5291.827413 secs 2024-07-26T10:04:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5307.310392 secs 2024-07-26T10:04:07.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:06 smithi063 ceph-mon[36747]: pgmap v3369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:08 smithi043 ceph-mon[32384]: pgmap v3370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:08 smithi133 ceph-mon[37053]: pgmap v3370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:08 smithi063 ceph-mon[36747]: pgmap v3370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:10 smithi043 ceph-mon[32384]: pgmap v3371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:10 smithi133 ceph-mon[37053]: pgmap v3371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:10 smithi063 ceph-mon[36747]: pgmap v3371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5296.827534 secs 2024-07-26T10:04:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5312.310513 secs 2024-07-26T10:04:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5296.827534 secs 2024-07-26T10:04:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5312.310513 secs 2024-07-26T10:04:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5296.827534 secs 2024-07-26T10:04:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5312.310513 secs 2024-07-26T10:04:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:12 smithi043 ceph-mon[32384]: pgmap v3372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:12 smithi133 ceph-mon[37053]: pgmap v3372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:12 smithi063 ceph-mon[36747]: pgmap v3372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:15.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:14 smithi043 ceph-mon[32384]: pgmap v3373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:14 smithi133 ceph-mon[37053]: pgmap v3373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:14 smithi063 ceph-mon[36747]: pgmap v3373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5301.827649 secs 2024-07-26T10:04:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5317.310631 secs 2024-07-26T10:04:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:16 smithi043 ceph-mon[32384]: pgmap v3374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5301.827649 secs 2024-07-26T10:04:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5317.310631 secs 2024-07-26T10:04:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:16 smithi133 ceph-mon[37053]: pgmap v3374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5301.827649 secs 2024-07-26T10:04:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5317.310631 secs 2024-07-26T10:04:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:16 smithi063 ceph-mon[36747]: pgmap v3374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:18 smithi043 ceph-mon[32384]: pgmap v3375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:18 smithi133 ceph-mon[37053]: pgmap v3375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:18 smithi063 ceph-mon[36747]: pgmap v3375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:20 smithi043 ceph-mon[32384]: pgmap v3376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:20 smithi133 ceph-mon[37053]: pgmap v3376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:20 smithi063 ceph-mon[36747]: pgmap v3376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5306.827760 secs 2024-07-26T10:04:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5322.310759 secs 2024-07-26T10:04:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5306.827760 secs 2024-07-26T10:04:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5322.310759 secs 2024-07-26T10:04:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5306.827760 secs 2024-07-26T10:04:22.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5322.310759 secs 2024-07-26T10:04:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:22 smithi043 ceph-mon[32384]: pgmap v3377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:22 smithi133 ceph-mon[37053]: pgmap v3377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:23.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:22 smithi063 ceph-mon[36747]: pgmap v3377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:24 smithi043 ceph-mon[32384]: pgmap v3378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:24 smithi133 ceph-mon[37053]: pgmap v3378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:24 smithi063 ceph-mon[36747]: pgmap v3378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5311.827896 secs 2024-07-26T10:04:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5311.827896 secs 2024-07-26T10:04:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5311.827896 secs 2024-07-26T10:04:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5327.310908 secs 2024-07-26T10:04:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:26 smithi043 ceph-mon[32384]: pgmap v3379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5327.310908 secs 2024-07-26T10:04:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:26 smithi133 ceph-mon[37053]: pgmap v3379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5327.310908 secs 2024-07-26T10:04:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:26 smithi063 ceph-mon[36747]: pgmap v3379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:29 smithi043 ceph-mon[32384]: pgmap v3380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:29 smithi133 ceph-mon[37053]: pgmap v3380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:29 smithi063 ceph-mon[36747]: pgmap v3380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:31 smithi043 ceph-mon[32384]: pgmap v3381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5316.827974 secs 2024-07-26T10:04:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5332.311030 secs 2024-07-26T10:04:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:31 smithi133 ceph-mon[37053]: pgmap v3381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5316.827974 secs 2024-07-26T10:04:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5332.311030 secs 2024-07-26T10:04:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:31 smithi063 ceph-mon[36747]: pgmap v3381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5316.827974 secs 2024-07-26T10:04:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5332.311030 secs 2024-07-26T10:04:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:33 smithi043 ceph-mon[32384]: pgmap v3382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:33 smithi133 ceph-mon[37053]: pgmap v3382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:33 smithi063 ceph-mon[36747]: pgmap v3382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:35 smithi043 ceph-mon[32384]: pgmap v3383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:35 smithi133 ceph-mon[37053]: pgmap v3383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:35 smithi063 ceph-mon[36747]: pgmap v3383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5321.828088 secs 2024-07-26T10:04:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5337.311130 secs 2024-07-26T10:04:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5321.828088 secs 2024-07-26T10:04:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5337.311130 secs 2024-07-26T10:04:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5321.828088 secs 2024-07-26T10:04:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5337.311130 secs 2024-07-26T10:04:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:37 smithi043 ceph-mon[32384]: pgmap v3384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:37 smithi133 ceph-mon[37053]: pgmap v3384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:37 smithi063 ceph-mon[36747]: pgmap v3384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:39 smithi043 ceph-mon[32384]: pgmap v3385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:39 smithi133 ceph-mon[37053]: pgmap v3385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:39 smithi063 ceph-mon[36747]: pgmap v3385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:41 smithi043 ceph-mon[32384]: pgmap v3386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5326.828209 secs 2024-07-26T10:04:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5342.311219 secs 2024-07-26T10:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:41 smithi133 ceph-mon[37053]: pgmap v3386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5326.828209 secs 2024-07-26T10:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5342.311219 secs 2024-07-26T10:04:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:41 smithi063 ceph-mon[36747]: pgmap v3386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5326.828209 secs 2024-07-26T10:04:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5342.311219 secs 2024-07-26T10:04:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:04:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:04:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:04:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:43 smithi133 ceph-mon[37053]: pgmap v3387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:04:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:04:43.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:04:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:43 smithi063 ceph-mon[36747]: pgmap v3387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:04:43.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:04:43.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:04:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:43 smithi043 ceph-mon[32384]: pgmap v3387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:43.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:04:43.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:04:43.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:04:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:44 smithi133 ceph-mon[37053]: pgmap v3388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:44.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:44 smithi133 ceph-mon[37053]: pgmap v3389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:04:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:44 smithi063 ceph-mon[36747]: pgmap v3388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:44 smithi063 ceph-mon[36747]: pgmap v3389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:04:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:44 smithi043 ceph-mon[32384]: pgmap v3388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:44 smithi043 ceph-mon[32384]: pgmap v3389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:04:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:46 smithi133 ceph-mon[37053]: pgmap v3390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:04:46.769 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5331.828334 secs 2024-07-26T10:04:46.769 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5347.311293 secs 2024-07-26T10:04:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:46 smithi063 ceph-mon[36747]: pgmap v3390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:04:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5331.828334 secs 2024-07-26T10:04:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5347.311293 secs 2024-07-26T10:04:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:46 smithi043 ceph-mon[32384]: pgmap v3390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:04:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5331.828334 secs 2024-07-26T10:04:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5347.311293 secs 2024-07-26T10:04:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:48 smithi133 ceph-mon[37053]: pgmap v3391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:04:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:48 smithi063 ceph-mon[36747]: pgmap v3391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:04:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:48 smithi043 ceph-mon[32384]: pgmap v3391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:04:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:50 smithi043 ceph-mon[32384]: pgmap v3392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:50 smithi133 ceph-mon[37053]: pgmap v3392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:50 smithi063 ceph-mon[36747]: pgmap v3392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5336.828449 secs 2024-07-26T10:04:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5352.311379 secs 2024-07-26T10:04:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5336.828449 secs 2024-07-26T10:04:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5352.311379 secs 2024-07-26T10:04:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5336.828449 secs 2024-07-26T10:04:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5352.311379 secs 2024-07-26T10:04:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:52 smithi063 ceph-mon[36747]: pgmap v3393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:52 smithi043 ceph-mon[32384]: pgmap v3393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:52 smithi133 ceph-mon[37053]: pgmap v3393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:04:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:54 smithi063 ceph-mon[36747]: pgmap v3394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:04:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:54 smithi043 ceph-mon[32384]: pgmap v3394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:04:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:54 smithi133 ceph-mon[37053]: pgmap v3394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:56 smithi063 ceph-mon[36747]: pgmap v3395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5341.828547 secs 2024-07-26T10:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5357.311504 secs 2024-07-26T10:04:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:56 smithi043 ceph-mon[32384]: pgmap v3395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5341.828547 secs 2024-07-26T10:04:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5357.311504 secs 2024-07-26T10:04:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:56 smithi133 ceph-mon[37053]: pgmap v3395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:04:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5341.828547 secs 2024-07-26T10:04:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5357.311504 secs 2024-07-26T10:04:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:04:58 smithi063 ceph-mon[36747]: pgmap v3396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:04:58 smithi043 ceph-mon[32384]: pgmap v3396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:04:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:04:58 smithi133 ceph-mon[37053]: pgmap v3396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:00 smithi063 ceph-mon[36747]: pgmap v3397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:00 smithi043 ceph-mon[32384]: pgmap v3397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:00 smithi133 ceph-mon[37053]: pgmap v3397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5346.828648 secs 2024-07-26T10:05:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5362.311635 secs 2024-07-26T10:05:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5346.828648 secs 2024-07-26T10:05:01.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5362.311635 secs 2024-07-26T10:05:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5346.828648 secs 2024-07-26T10:05:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5362.311635 secs 2024-07-26T10:05:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:02 smithi063 ceph-mon[36747]: pgmap v3398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:02 smithi043 ceph-mon[32384]: pgmap v3398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:02 smithi133 ceph-mon[37053]: pgmap v3398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:04 smithi063 ceph-mon[36747]: pgmap v3399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:04 smithi043 ceph-mon[32384]: pgmap v3399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:04 smithi133 ceph-mon[37053]: pgmap v3399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:06 smithi063 ceph-mon[36747]: pgmap v3400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5351.828784 secs 2024-07-26T10:05:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5367.311723 secs 2024-07-26T10:05:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:06 smithi043 ceph-mon[32384]: pgmap v3400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5351.828784 secs 2024-07-26T10:05:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5367.311723 secs 2024-07-26T10:05:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:06 smithi133 ceph-mon[37053]: pgmap v3400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5351.828784 secs 2024-07-26T10:05:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5367.311723 secs 2024-07-26T10:05:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:08 smithi043 ceph-mon[32384]: pgmap v3401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:08 smithi133 ceph-mon[37053]: pgmap v3401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:08 smithi063 ceph-mon[36747]: pgmap v3401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:10 smithi043 ceph-mon[32384]: pgmap v3402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:10 smithi133 ceph-mon[37053]: pgmap v3402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:10 smithi063 ceph-mon[36747]: pgmap v3402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:11.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5356.828861 secs 2024-07-26T10:05:11.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5372.311891 secs 2024-07-26T10:05:11.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5356.828861 secs 2024-07-26T10:05:11.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5372.311891 secs 2024-07-26T10:05:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5356.828861 secs 2024-07-26T10:05:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5372.311891 secs 2024-07-26T10:05:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:12 smithi043 ceph-mon[32384]: pgmap v3403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:12 smithi133 ceph-mon[37053]: pgmap v3403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:12 smithi063 ceph-mon[36747]: pgmap v3403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:14.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:14 smithi043 ceph-mon[32384]: pgmap v3404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:14 smithi133 ceph-mon[37053]: pgmap v3404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:14 smithi063 ceph-mon[36747]: pgmap v3404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:16 smithi043 ceph-mon[32384]: pgmap v3405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5361.828978 secs 2024-07-26T10:05:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5377.312018 secs 2024-07-26T10:05:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:16 smithi133 ceph-mon[37053]: pgmap v3405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5361.828978 secs 2024-07-26T10:05:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5377.312018 secs 2024-07-26T10:05:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:16 smithi063 ceph-mon[36747]: pgmap v3405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5361.828978 secs 2024-07-26T10:05:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5377.312018 secs 2024-07-26T10:05:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:18 smithi043 ceph-mon[32384]: pgmap v3406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:18 smithi133 ceph-mon[37053]: pgmap v3406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:18 smithi063 ceph-mon[36747]: pgmap v3406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:20 smithi043 ceph-mon[32384]: pgmap v3407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:20 smithi133 ceph-mon[37053]: pgmap v3407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:20 smithi063 ceph-mon[36747]: pgmap v3407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5366.829095 secs 2024-07-26T10:05:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5382.312123 secs 2024-07-26T10:05:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5366.829095 secs 2024-07-26T10:05:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5382.312123 secs 2024-07-26T10:05:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5366.829095 secs 2024-07-26T10:05:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5382.312123 secs 2024-07-26T10:05:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:22 smithi043 ceph-mon[32384]: pgmap v3408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:22 smithi133 ceph-mon[37053]: pgmap v3408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:22 smithi063 ceph-mon[36747]: pgmap v3408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:24 smithi043 ceph-mon[32384]: pgmap v3409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:24 smithi133 ceph-mon[37053]: pgmap v3409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:24 smithi063 ceph-mon[36747]: pgmap v3409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:26 smithi043 ceph-mon[32384]: pgmap v3410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5371.829213 secs 2024-07-26T10:05:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5387.312247 secs 2024-07-26T10:05:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:26 smithi133 ceph-mon[37053]: pgmap v3410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5371.829213 secs 2024-07-26T10:05:27.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5387.312247 secs 2024-07-26T10:05:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:26 smithi063 ceph-mon[36747]: pgmap v3410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5371.829213 secs 2024-07-26T10:05:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5387.312247 secs 2024-07-26T10:05:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:28 smithi043 ceph-mon[32384]: pgmap v3411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:28 smithi133 ceph-mon[37053]: pgmap v3411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:28 smithi063 ceph-mon[36747]: pgmap v3411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:30 smithi043 ceph-mon[32384]: pgmap v3412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:30 smithi133 ceph-mon[37053]: pgmap v3412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:30 smithi063 ceph-mon[36747]: pgmap v3412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5376.829324 secs 2024-07-26T10:05:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5392.312335 secs 2024-07-26T10:05:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5376.829324 secs 2024-07-26T10:05:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5392.312335 secs 2024-07-26T10:05:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5376.829324 secs 2024-07-26T10:05:32.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5392.312335 secs 2024-07-26T10:05:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:32 smithi043 ceph-mon[32384]: pgmap v3413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:32 smithi133 ceph-mon[37053]: pgmap v3413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:32 smithi063 ceph-mon[36747]: pgmap v3413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:34 smithi043 ceph-mon[32384]: pgmap v3414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:34 smithi133 ceph-mon[37053]: pgmap v3414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:34 smithi063 ceph-mon[36747]: pgmap v3414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:36.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:36 smithi043 ceph-mon[32384]: pgmap v3415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:36.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5381.829448 secs 2024-07-26T10:05:36.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5397.312477 secs 2024-07-26T10:05:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:36 smithi133 ceph-mon[37053]: pgmap v3415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:37.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5381.829448 secs 2024-07-26T10:05:37.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5397.312477 secs 2024-07-26T10:05:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:36 smithi063 ceph-mon[36747]: pgmap v3415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:05:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5381.829448 secs 2024-07-26T10:05:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5397.312477 secs 2024-07-26T10:05:38.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:37 smithi133 ceph-mon[37053]: pgmap v3416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:37 smithi063 ceph-mon[36747]: pgmap v3416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:37 smithi043 ceph-mon[32384]: pgmap v3416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:40 smithi043 ceph-mon[32384]: pgmap v3417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:40 smithi133 ceph-mon[37053]: pgmap v3417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:40 smithi063 ceph-mon[36747]: pgmap v3417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:41.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5386.829566 secs 2024-07-26T10:05:41.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5386.829566 secs 2024-07-26T10:05:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5386.829566 secs 2024-07-26T10:05:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5402.312571 secs 2024-07-26T10:05:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:42 smithi043 ceph-mon[32384]: pgmap v3418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5402.312571 secs 2024-07-26T10:05:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:42 smithi133 ceph-mon[37053]: pgmap v3418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5402.312571 secs 2024-07-26T10:05:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:42 smithi063 ceph-mon[36747]: pgmap v3418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:44 smithi043 ceph-mon[32384]: pgmap v3419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:05:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:44 smithi133 ceph-mon[37053]: pgmap v3419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:05:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:44 smithi063 ceph-mon[36747]: pgmap v3419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:05:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:05:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:05:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:45 smithi043 ceph-mon[32384]: pgmap v3420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:05:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:45 smithi043 ceph-mon[32384]: pgmap v3421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:05:45.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:05:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:05:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:05:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:45 smithi133 ceph-mon[37053]: pgmap v3420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:05:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:45 smithi133 ceph-mon[37053]: pgmap v3421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:05:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:05:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:05:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:05:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:45 smithi063 ceph-mon[36747]: pgmap v3420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:05:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:45 smithi063 ceph-mon[36747]: pgmap v3421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:05:45.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:05:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5391.829711 secs 2024-07-26T10:05:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5391.829711 secs 2024-07-26T10:05:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5391.829711 secs 2024-07-26T10:05:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5407.312691 secs 2024-07-26T10:05:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:47 smithi043 ceph-mon[32384]: pgmap v3422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:05:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5407.312691 secs 2024-07-26T10:05:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:47 smithi133 ceph-mon[37053]: pgmap v3422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:05:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5407.312691 secs 2024-07-26T10:05:47.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:47 smithi063 ceph-mon[36747]: pgmap v3422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:05:49.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:49 smithi043 ceph-mon[32384]: pgmap v3423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:05:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:49 smithi133 ceph-mon[37053]: pgmap v3423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:05:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:49 smithi063 ceph-mon[36747]: pgmap v3423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:05:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5396.829831 secs 2024-07-26T10:05:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:51 smithi043 ceph-mon[32384]: pgmap v3424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:05:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5412.312842 secs 2024-07-26T10:05:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5396.829831 secs 2024-07-26T10:05:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:51 smithi133 ceph-mon[37053]: pgmap v3424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:05:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5412.312842 secs 2024-07-26T10:05:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5396.829831 secs 2024-07-26T10:05:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:51 smithi063 ceph-mon[36747]: pgmap v3424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:05:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5412.312842 secs 2024-07-26T10:05:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:53 smithi043 ceph-mon[32384]: pgmap v3425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:05:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:53 smithi133 ceph-mon[37053]: pgmap v3425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:05:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:53 smithi063 ceph-mon[36747]: pgmap v3425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:05:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:55 smithi043 ceph-mon[32384]: pgmap v3426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:05:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:55 smithi133 ceph-mon[37053]: pgmap v3426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:05:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:55 smithi063 ceph-mon[36747]: pgmap v3426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:05:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5401.829944 secs 2024-07-26T10:05:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5417.312942 secs 2024-07-26T10:05:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5401.829944 secs 2024-07-26T10:05:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5417.312942 secs 2024-07-26T10:05:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5401.829944 secs 2024-07-26T10:05:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5417.312942 secs 2024-07-26T10:05:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:57 smithi043 ceph-mon[32384]: pgmap v3427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:57 smithi133 ceph-mon[37053]: pgmap v3427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:57 smithi063 ceph-mon[36747]: pgmap v3427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:05:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:05:59 smithi043 ceph-mon[32384]: pgmap v3428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:05:59 smithi133 ceph-mon[37053]: pgmap v3428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:05:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:05:59 smithi063 ceph-mon[36747]: pgmap v3428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5406.830062 secs 2024-07-26T10:06:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:01 smithi043 ceph-mon[32384]: pgmap v3429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5422.313061 secs 2024-07-26T10:06:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5406.830062 secs 2024-07-26T10:06:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:01 smithi133 ceph-mon[37053]: pgmap v3429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5422.313061 secs 2024-07-26T10:06:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5406.830062 secs 2024-07-26T10:06:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:01 smithi063 ceph-mon[36747]: pgmap v3429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5422.313061 secs 2024-07-26T10:06:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:03 smithi043 ceph-mon[32384]: pgmap v3430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:03 smithi133 ceph-mon[37053]: pgmap v3430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:03 smithi063 ceph-mon[36747]: pgmap v3430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:05 smithi043 ceph-mon[32384]: pgmap v3431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:05 smithi133 ceph-mon[37053]: pgmap v3431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:05 smithi063 ceph-mon[36747]: pgmap v3431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5411.830180 secs 2024-07-26T10:06:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5427.313213 secs 2024-07-26T10:06:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5411.830180 secs 2024-07-26T10:06:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5427.313213 secs 2024-07-26T10:06:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5411.830180 secs 2024-07-26T10:06:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5427.313213 secs 2024-07-26T10:06:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:07 smithi043 ceph-mon[32384]: pgmap v3432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:07 smithi133 ceph-mon[37053]: pgmap v3432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:07.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:07 smithi063 ceph-mon[36747]: pgmap v3432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:09 smithi043 ceph-mon[32384]: pgmap v3433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:09 smithi133 ceph-mon[37053]: pgmap v3433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:09 smithi063 ceph-mon[36747]: pgmap v3433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5416.830268 secs 2024-07-26T10:06:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:11 smithi043 ceph-mon[32384]: pgmap v3434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5432.313331 secs 2024-07-26T10:06:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5416.830268 secs 2024-07-26T10:06:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:11 smithi133 ceph-mon[37053]: pgmap v3434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5432.313331 secs 2024-07-26T10:06:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5416.830268 secs 2024-07-26T10:06:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:11 smithi063 ceph-mon[36747]: pgmap v3434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5432.313331 secs 2024-07-26T10:06:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:13 smithi043 ceph-mon[32384]: pgmap v3435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:13 smithi133 ceph-mon[37053]: pgmap v3435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:13 smithi063 ceph-mon[36747]: pgmap v3435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:15 smithi043 ceph-mon[32384]: pgmap v3436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:15 smithi133 ceph-mon[37053]: pgmap v3436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:15 smithi063 ceph-mon[36747]: pgmap v3436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5421.830370 secs 2024-07-26T10:06:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5437.313450 secs 2024-07-26T10:06:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5421.830370 secs 2024-07-26T10:06:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5437.313450 secs 2024-07-26T10:06:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5421.830370 secs 2024-07-26T10:06:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5437.313450 secs 2024-07-26T10:06:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:17 smithi043 ceph-mon[32384]: pgmap v3437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:06:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:17 smithi133 ceph-mon[37053]: pgmap v3437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:06:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:17 smithi063 ceph-mon[36747]: pgmap v3437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:06:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:19 smithi043 ceph-mon[32384]: pgmap v3438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:19 smithi133 ceph-mon[37053]: pgmap v3438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:19 smithi063 ceph-mon[36747]: pgmap v3438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5426.830491 secs 2024-07-26T10:06:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:21 smithi043 ceph-mon[32384]: pgmap v3439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:06:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5442.313589 secs 2024-07-26T10:06:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5426.830491 secs 2024-07-26T10:06:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:21 smithi133 ceph-mon[37053]: pgmap v3439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:06:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5442.313589 secs 2024-07-26T10:06:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5426.830491 secs 2024-07-26T10:06:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:21 smithi063 ceph-mon[36747]: pgmap v3439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:06:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5442.313589 secs 2024-07-26T10:06:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:23 smithi043 ceph-mon[32384]: pgmap v3440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:23 smithi133 ceph-mon[37053]: pgmap v3440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:23 smithi063 ceph-mon[36747]: pgmap v3440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:25 smithi043 ceph-mon[32384]: pgmap v3441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T10:06:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:25 smithi133 ceph-mon[37053]: pgmap v3441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T10:06:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:25 smithi063 ceph-mon[36747]: pgmap v3441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T10:06:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5431.830565 secs 2024-07-26T10:06:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5447.313745 secs 2024-07-26T10:06:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5431.830565 secs 2024-07-26T10:06:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5447.313745 secs 2024-07-26T10:06:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5431.830565 secs 2024-07-26T10:06:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5447.313745 secs 2024-07-26T10:06:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:27 smithi133 ceph-mon[37053]: pgmap v3442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:27 smithi063 ceph-mon[36747]: pgmap v3442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:27 smithi043 ceph-mon[32384]: pgmap v3442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:06:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:29 smithi133 ceph-mon[37053]: pgmap v3443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:06:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:29 smithi063 ceph-mon[36747]: pgmap v3443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:06:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:29 smithi043 ceph-mon[32384]: pgmap v3443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:06:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5436.830686 secs 2024-07-26T10:06:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:31 smithi133 ceph-mon[37053]: pgmap v3444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:31.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5452.313887 secs 2024-07-26T10:06:31.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5436.830686 secs 2024-07-26T10:06:31.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:31 smithi043 ceph-mon[32384]: pgmap v3444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:31.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5452.313887 secs 2024-07-26T10:06:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5436.830686 secs 2024-07-26T10:06:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:31 smithi063 ceph-mon[36747]: pgmap v3444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5452.313887 secs 2024-07-26T10:06:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:33 smithi133 ceph-mon[37053]: pgmap v3445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:33 smithi063 ceph-mon[36747]: pgmap v3445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:33 smithi043 ceph-mon[32384]: pgmap v3445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:35 smithi133 ceph-mon[37053]: pgmap v3446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:35 smithi063 ceph-mon[36747]: pgmap v3446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:35 smithi043 ceph-mon[32384]: pgmap v3446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5441.830805 secs 2024-07-26T10:06:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5457.313936 secs 2024-07-26T10:06:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5441.830805 secs 2024-07-26T10:06:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5457.313936 secs 2024-07-26T10:06:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5441.830805 secs 2024-07-26T10:06:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5457.313936 secs 2024-07-26T10:06:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:37 smithi063 ceph-mon[36747]: pgmap v3447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:37 smithi043 ceph-mon[32384]: pgmap v3447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:37 smithi133 ceph-mon[37053]: pgmap v3447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:39 smithi043 ceph-mon[32384]: pgmap v3448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:39 smithi063 ceph-mon[36747]: pgmap v3448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:39 smithi133 ceph-mon[37053]: pgmap v3448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5446.830924 secs 2024-07-26T10:06:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:41 smithi063 ceph-mon[36747]: pgmap v3449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5462.314051 secs 2024-07-26T10:06:41.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5446.830924 secs 2024-07-26T10:06:41.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:41 smithi133 ceph-mon[37053]: pgmap v3449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:41.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5462.314051 secs 2024-07-26T10:06:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5446.830924 secs 2024-07-26T10:06:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:41 smithi043 ceph-mon[32384]: pgmap v3449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:06:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5462.314051 secs 2024-07-26T10:06:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:43 smithi063 ceph-mon[36747]: pgmap v3450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:43 smithi043 ceph-mon[32384]: pgmap v3450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:43 smithi133 ceph-mon[37053]: pgmap v3450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:06:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:06:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:06:45.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:06:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:45 smithi063 ceph-mon[36747]: pgmap v3451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:45 smithi043 ceph-mon[32384]: pgmap v3451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:45 smithi133 ceph-mon[37053]: pgmap v3451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:06:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5451.831060 secs 2024-07-26T10:06:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:06:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:06:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: pgmap v3452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:06:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: pgmap v3453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:06:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5467.314113 secs 2024-07-26T10:06:46.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:06:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5451.831060 secs 2024-07-26T10:06:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:06:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:06:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: pgmap v3452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:06:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: pgmap v3453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:06:46.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5467.314113 secs 2024-07-26T10:06:46.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:06:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5451.831060 secs 2024-07-26T10:06:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:06:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:06:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: pgmap v3452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:06:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: pgmap v3453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:06:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5467.314113 secs 2024-07-26T10:06:47.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:06:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:48 smithi043 ceph-mon[32384]: pgmap v3454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:48 smithi133 ceph-mon[37053]: pgmap v3454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:48 smithi063 ceph-mon[36747]: pgmap v3454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:50 smithi043 ceph-mon[32384]: pgmap v3455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:50 smithi133 ceph-mon[37053]: pgmap v3455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:50 smithi063 ceph-mon[36747]: pgmap v3455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5456.831183 secs 2024-07-26T10:06:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5472.314242 secs 2024-07-26T10:06:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5456.831183 secs 2024-07-26T10:06:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5472.314242 secs 2024-07-26T10:06:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5456.831183 secs 2024-07-26T10:06:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5472.314242 secs 2024-07-26T10:06:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:52 smithi043 ceph-mon[32384]: pgmap v3456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:52 smithi133 ceph-mon[37053]: pgmap v3456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:52 smithi063 ceph-mon[36747]: pgmap v3456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:54 smithi043 ceph-mon[32384]: pgmap v3457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:54 smithi133 ceph-mon[37053]: pgmap v3457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:55.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:54 smithi063 ceph-mon[36747]: pgmap v3457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:06:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5461.831325 secs 2024-07-26T10:06:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:56 smithi043 ceph-mon[32384]: pgmap v3458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:06:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5477.314385 secs 2024-07-26T10:06:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5461.831325 secs 2024-07-26T10:06:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:56 smithi133 ceph-mon[37053]: pgmap v3458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:06:57.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5477.314385 secs 2024-07-26T10:06:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5461.831325 secs 2024-07-26T10:06:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:56 smithi063 ceph-mon[36747]: pgmap v3458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:06:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5477.314385 secs 2024-07-26T10:06:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:06:58 smithi043 ceph-mon[32384]: pgmap v3459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:06:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:06:58 smithi133 ceph-mon[37053]: pgmap v3459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:06:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:06:58 smithi063 ceph-mon[36747]: pgmap v3459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:00 smithi043 ceph-mon[32384]: pgmap v3460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:00 smithi133 ceph-mon[37053]: pgmap v3460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:00 smithi063 ceph-mon[36747]: pgmap v3460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5466.831442 secs 2024-07-26T10:07:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5482.314500 secs 2024-07-26T10:07:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5466.831442 secs 2024-07-26T10:07:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5482.314500 secs 2024-07-26T10:07:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5466.831442 secs 2024-07-26T10:07:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5482.314500 secs 2024-07-26T10:07:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:02 smithi043 ceph-mon[32384]: pgmap v3461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:02 smithi133 ceph-mon[37053]: pgmap v3461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:02 smithi063 ceph-mon[36747]: pgmap v3461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:04 smithi043 ceph-mon[32384]: pgmap v3462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:04 smithi133 ceph-mon[37053]: pgmap v3462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:04 smithi063 ceph-mon[36747]: pgmap v3462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5471.831562 secs 2024-07-26T10:07:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5487.314620 secs 2024-07-26T10:07:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:06 smithi043 ceph-mon[32384]: pgmap v3463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5471.831562 secs 2024-07-26T10:07:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5487.314620 secs 2024-07-26T10:07:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:06 smithi133 ceph-mon[37053]: pgmap v3463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5471.831562 secs 2024-07-26T10:07:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5487.314620 secs 2024-07-26T10:07:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:06 smithi063 ceph-mon[36747]: pgmap v3463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:08 smithi133 ceph-mon[37053]: pgmap v3464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:08 smithi063 ceph-mon[36747]: pgmap v3464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:08 smithi043 ceph-mon[32384]: pgmap v3464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:10 smithi043 ceph-mon[32384]: pgmap v3465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:10 smithi133 ceph-mon[37053]: pgmap v3465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:10 smithi063 ceph-mon[36747]: pgmap v3465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5476.831685 secs 2024-07-26T10:07:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5492.314755 secs 2024-07-26T10:07:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5476.831685 secs 2024-07-26T10:07:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5492.314755 secs 2024-07-26T10:07:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5476.831685 secs 2024-07-26T10:07:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5492.314755 secs 2024-07-26T10:07:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:12 smithi043 ceph-mon[32384]: pgmap v3466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:12 smithi133 ceph-mon[37053]: pgmap v3466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:12 smithi063 ceph-mon[36747]: pgmap v3466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:14 smithi043 ceph-mon[32384]: pgmap v3467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:14 smithi133 ceph-mon[37053]: pgmap v3467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:14 smithi063 ceph-mon[36747]: pgmap v3467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5481.831798 secs 2024-07-26T10:07:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5497.314874 secs 2024-07-26T10:07:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:16 smithi043 ceph-mon[32384]: pgmap v3468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5481.831798 secs 2024-07-26T10:07:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5497.314874 secs 2024-07-26T10:07:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:16 smithi133 ceph-mon[37053]: pgmap v3468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5481.831798 secs 2024-07-26T10:07:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5497.314874 secs 2024-07-26T10:07:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:16 smithi063 ceph-mon[36747]: pgmap v3468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:18 smithi043 ceph-mon[32384]: pgmap v3469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:19.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:18 smithi133 ceph-mon[37053]: pgmap v3469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:18 smithi063 ceph-mon[36747]: pgmap v3469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:07:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:20 smithi043 ceph-mon[32384]: pgmap v3470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:20 smithi133 ceph-mon[37053]: pgmap v3470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:20 smithi063 ceph-mon[36747]: pgmap v3470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5486.831938 secs 2024-07-26T10:07:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5502.314943 secs 2024-07-26T10:07:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5486.831938 secs 2024-07-26T10:07:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5502.314943 secs 2024-07-26T10:07:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5486.831938 secs 2024-07-26T10:07:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5502.314943 secs 2024-07-26T10:07:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:22 smithi043 ceph-mon[32384]: pgmap v3471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:22 smithi133 ceph-mon[37053]: pgmap v3471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:22 smithi063 ceph-mon[36747]: pgmap v3471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:24 smithi043 ceph-mon[32384]: pgmap v3472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:24 smithi133 ceph-mon[37053]: pgmap v3472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:24 smithi063 ceph-mon[36747]: pgmap v3472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5491.832028 secs 2024-07-26T10:07:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5507.315063 secs 2024-07-26T10:07:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:26 smithi043 ceph-mon[32384]: pgmap v3473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5491.832028 secs 2024-07-26T10:07:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5507.315063 secs 2024-07-26T10:07:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:26 smithi133 ceph-mon[37053]: pgmap v3473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5491.832028 secs 2024-07-26T10:07:27.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5507.315063 secs 2024-07-26T10:07:27.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:26 smithi063 ceph-mon[36747]: pgmap v3473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:28 smithi043 ceph-mon[32384]: pgmap v3474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:28 smithi133 ceph-mon[37053]: pgmap v3474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:29.192 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:28 smithi063 ceph-mon[36747]: pgmap v3474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:30 smithi043 ceph-mon[32384]: pgmap v3475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:30 smithi133 ceph-mon[37053]: pgmap v3475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:30 smithi063 ceph-mon[36747]: pgmap v3475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5496.832157 secs 2024-07-26T10:07:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5512.315217 secs 2024-07-26T10:07:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:31 smithi043 ceph-mon[32384]: pgmap v3476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5496.832157 secs 2024-07-26T10:07:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5512.315217 secs 2024-07-26T10:07:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:31 smithi133 ceph-mon[37053]: pgmap v3476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5496.832157 secs 2024-07-26T10:07:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5512.315217 secs 2024-07-26T10:07:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:31 smithi063 ceph-mon[36747]: pgmap v3476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:34 smithi043 ceph-mon[32384]: pgmap v3477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:34 smithi133 ceph-mon[37053]: pgmap v3477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:34 smithi063 ceph-mon[36747]: pgmap v3477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5501.832270 secs 2024-07-26T10:07:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5517.315313 secs 2024-07-26T10:07:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:36 smithi043 ceph-mon[32384]: pgmap v3478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5501.832270 secs 2024-07-26T10:07:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5517.315313 secs 2024-07-26T10:07:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:36 smithi133 ceph-mon[37053]: pgmap v3478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5501.832270 secs 2024-07-26T10:07:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5517.315313 secs 2024-07-26T10:07:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:36 smithi063 ceph-mon[36747]: pgmap v3478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:38 smithi043 ceph-mon[32384]: pgmap v3479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:38 smithi133 ceph-mon[37053]: pgmap v3479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:38 smithi063 ceph-mon[36747]: pgmap v3479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:40 smithi043 ceph-mon[32384]: pgmap v3480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:40 smithi133 ceph-mon[37053]: pgmap v3480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:40 smithi063 ceph-mon[36747]: pgmap v3480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:07:41.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5506.832398 secs 2024-07-26T10:07:41.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5522.315455 secs 2024-07-26T10:07:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5506.832398 secs 2024-07-26T10:07:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5522.315455 secs 2024-07-26T10:07:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5506.832398 secs 2024-07-26T10:07:42.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5522.315455 secs 2024-07-26T10:07:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:42 smithi043 ceph-mon[32384]: pgmap v3481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:42 smithi133 ceph-mon[37053]: pgmap v3481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:42 smithi063 ceph-mon[36747]: pgmap v3481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:44 smithi043 ceph-mon[32384]: pgmap v3482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:44 smithi133 ceph-mon[37053]: pgmap v3482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:44 smithi063 ceph-mon[36747]: pgmap v3482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:07:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5511.832515 secs 2024-07-26T10:07:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5527.315593 secs 2024-07-26T10:07:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:46 smithi043 ceph-mon[32384]: pgmap v3483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:07:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5511.832515 secs 2024-07-26T10:07:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5527.315593 secs 2024-07-26T10:07:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:46 smithi133 ceph-mon[37053]: pgmap v3483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:47.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:07:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5511.832515 secs 2024-07-26T10:07:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5527.315593 secs 2024-07-26T10:07:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:46 smithi063 ceph-mon[36747]: pgmap v3483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:07:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:07:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:07:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:07:47.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:07:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:07:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:07:48.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:07:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:07:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:07:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:07:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:48 smithi043 ceph-mon[32384]: pgmap v3484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:07:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:48 smithi043 ceph-mon[32384]: pgmap v3485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:07:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:48 smithi133 ceph-mon[37053]: pgmap v3484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:07:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:48 smithi133 ceph-mon[37053]: pgmap v3485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:07:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:48 smithi063 ceph-mon[36747]: pgmap v3484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:07:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:48 smithi063 ceph-mon[36747]: pgmap v3485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:07:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:50 smithi043 ceph-mon[32384]: pgmap v3486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:07:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:50 smithi133 ceph-mon[37053]: pgmap v3486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:07:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:50 smithi063 ceph-mon[36747]: pgmap v3486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:07:51.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5516.832637 secs 2024-07-26T10:07:51.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5532.315714 secs 2024-07-26T10:07:51.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:51 smithi043 ceph-mon[32384]: pgmap v3487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:07:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5516.832637 secs 2024-07-26T10:07:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5532.315714 secs 2024-07-26T10:07:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:51 smithi133 ceph-mon[37053]: pgmap v3487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:07:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5516.832637 secs 2024-07-26T10:07:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5532.315714 secs 2024-07-26T10:07:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:51 smithi063 ceph-mon[36747]: pgmap v3487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:07:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:53 smithi043 ceph-mon[32384]: pgmap v3488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:07:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:53 smithi133 ceph-mon[37053]: pgmap v3488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:07:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:53 smithi063 ceph-mon[36747]: pgmap v3488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:07:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:55 smithi043 ceph-mon[32384]: pgmap v3489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:07:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:55 smithi133 ceph-mon[37053]: pgmap v3489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:07:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:55 smithi063 ceph-mon[36747]: pgmap v3489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:07:57.180 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5521.832751 secs 2024-07-26T10:07:57.180 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5537.315831 secs 2024-07-26T10:07:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5521.832751 secs 2024-07-26T10:07:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5537.315831 secs 2024-07-26T10:07:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5521.832751 secs 2024-07-26T10:07:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5537.315831 secs 2024-07-26T10:07:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:57 smithi043 ceph-mon[32384]: pgmap v3490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:07:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:57 smithi133 ceph-mon[37053]: pgmap v3490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:07:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:57 smithi063 ceph-mon[36747]: pgmap v3490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:08:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:07:59 smithi043 ceph-mon[32384]: pgmap v3491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:07:59 smithi133 ceph-mon[37053]: pgmap v3491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:07:59 smithi063 ceph-mon[36747]: pgmap v3491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5526.832852 secs 2024-07-26T10:08:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5542.315983 secs 2024-07-26T10:08:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:01 smithi043 ceph-mon[32384]: pgmap v3492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5526.832852 secs 2024-07-26T10:08:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5542.315983 secs 2024-07-26T10:08:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:01 smithi133 ceph-mon[37053]: pgmap v3492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5526.832852 secs 2024-07-26T10:08:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5542.315983 secs 2024-07-26T10:08:02.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:01 smithi063 ceph-mon[36747]: pgmap v3492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:03 smithi043 ceph-mon[32384]: pgmap v3493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:03 smithi133 ceph-mon[37053]: pgmap v3493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:03 smithi063 ceph-mon[36747]: pgmap v3493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:05 smithi043 ceph-mon[32384]: pgmap v3494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:05 smithi133 ceph-mon[37053]: pgmap v3494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:05 smithi063 ceph-mon[36747]: pgmap v3494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5531.832972 secs 2024-07-26T10:08:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5547.316100 secs 2024-07-26T10:08:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5531.832972 secs 2024-07-26T10:08:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5547.316100 secs 2024-07-26T10:08:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5531.832972 secs 2024-07-26T10:08:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5547.316100 secs 2024-07-26T10:08:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:07 smithi043 ceph-mon[32384]: pgmap v3495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:07 smithi133 ceph-mon[37053]: pgmap v3495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:07 smithi063 ceph-mon[36747]: pgmap v3495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:09 smithi043 ceph-mon[32384]: pgmap v3496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:09 smithi133 ceph-mon[37053]: pgmap v3496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:09 smithi063 ceph-mon[36747]: pgmap v3496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5536.833092 secs 2024-07-26T10:08:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5552.316228 secs 2024-07-26T10:08:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:11 smithi043 ceph-mon[32384]: pgmap v3497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5536.833092 secs 2024-07-26T10:08:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5552.316228 secs 2024-07-26T10:08:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:11 smithi133 ceph-mon[37053]: pgmap v3497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5536.833092 secs 2024-07-26T10:08:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5552.316228 secs 2024-07-26T10:08:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:11 smithi063 ceph-mon[36747]: pgmap v3497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:13 smithi043 ceph-mon[32384]: pgmap v3498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:13 smithi133 ceph-mon[37053]: pgmap v3498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:13 smithi063 ceph-mon[36747]: pgmap v3498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:15 smithi043 ceph-mon[32384]: pgmap v3499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:15 smithi133 ceph-mon[37053]: pgmap v3499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:15 smithi063 ceph-mon[36747]: pgmap v3499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5541.833209 secs 2024-07-26T10:08:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5557.316303 secs 2024-07-26T10:08:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5541.833209 secs 2024-07-26T10:08:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5557.316303 secs 2024-07-26T10:08:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5541.833209 secs 2024-07-26T10:08:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5557.316303 secs 2024-07-26T10:08:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:17 smithi043 ceph-mon[32384]: pgmap v3500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:17 smithi133 ceph-mon[37053]: pgmap v3500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:17 smithi063 ceph-mon[36747]: pgmap v3500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:19 smithi133 ceph-mon[37053]: pgmap v3501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:19 smithi063 ceph-mon[36747]: pgmap v3501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:19 smithi043 ceph-mon[32384]: pgmap v3501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5546.833308 secs 2024-07-26T10:08:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5546.833308 secs 2024-07-26T10:08:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5546.833308 secs 2024-07-26T10:08:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5562.316443 secs 2024-07-26T10:08:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:22 smithi133 ceph-mon[37053]: pgmap v3502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5562.316443 secs 2024-07-26T10:08:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:22 smithi063 ceph-mon[36747]: pgmap v3502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5562.316443 secs 2024-07-26T10:08:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:22 smithi043 ceph-mon[32384]: pgmap v3502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:24 smithi133 ceph-mon[37053]: pgmap v3503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:24 smithi063 ceph-mon[36747]: pgmap v3503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:24 smithi043 ceph-mon[32384]: pgmap v3503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:26 smithi063 ceph-mon[36747]: pgmap v3504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5551.833427 secs 2024-07-26T10:08:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:26 smithi043 ceph-mon[32384]: pgmap v3504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5551.833427 secs 2024-07-26T10:08:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:26 smithi133 ceph-mon[37053]: pgmap v3504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5551.833427 secs 2024-07-26T10:08:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5567.316582 secs 2024-07-26T10:08:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5567.316582 secs 2024-07-26T10:08:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5567.316582 secs 2024-07-26T10:08:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:28 smithi043 ceph-mon[32384]: pgmap v3505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:28 smithi063 ceph-mon[36747]: pgmap v3505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:28 smithi133 ceph-mon[37053]: pgmap v3505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:30 smithi063 ceph-mon[36747]: pgmap v3506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:30 smithi043 ceph-mon[32384]: pgmap v3506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:30 smithi133 ceph-mon[37053]: pgmap v3506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5556.833550 secs 2024-07-26T10:08:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5556.833550 secs 2024-07-26T10:08:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5556.833550 secs 2024-07-26T10:08:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5572.316703 secs 2024-07-26T10:08:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:32 smithi063 ceph-mon[36747]: pgmap v3507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:32.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5572.316703 secs 2024-07-26T10:08:32.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:32 smithi043 ceph-mon[32384]: pgmap v3507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5572.316703 secs 2024-07-26T10:08:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:32 smithi133 ceph-mon[37053]: pgmap v3507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:34 smithi063 ceph-mon[36747]: pgmap v3508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:34 smithi043 ceph-mon[32384]: pgmap v3508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:34 smithi133 ceph-mon[37053]: pgmap v3508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:36 smithi063 ceph-mon[36747]: pgmap v3509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5561.833671 secs 2024-07-26T10:08:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:36 smithi043 ceph-mon[32384]: pgmap v3509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5561.833671 secs 2024-07-26T10:08:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:36 smithi133 ceph-mon[37053]: pgmap v3509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5561.833671 secs 2024-07-26T10:08:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5577.316819 secs 2024-07-26T10:08:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5577.316819 secs 2024-07-26T10:08:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5577.316819 secs 2024-07-26T10:08:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:38 smithi043 ceph-mon[32384]: pgmap v3510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:38 smithi133 ceph-mon[37053]: pgmap v3510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:38 smithi063 ceph-mon[36747]: pgmap v3510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:40 smithi043 ceph-mon[32384]: pgmap v3511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:40 smithi133 ceph-mon[37053]: pgmap v3511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:40 smithi063 ceph-mon[36747]: pgmap v3511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5566.833756 secs 2024-07-26T10:08:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5566.833756 secs 2024-07-26T10:08:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5566.833756 secs 2024-07-26T10:08:42.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5582.316954 secs 2024-07-26T10:08:42.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:42 smithi133 ceph-mon[37053]: pgmap v3512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:42.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5582.316954 secs 2024-07-26T10:08:42.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:42 smithi063 ceph-mon[36747]: pgmap v3512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5582.316954 secs 2024-07-26T10:08:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:42 smithi043 ceph-mon[32384]: pgmap v3512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:44.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:44 smithi043 ceph-mon[32384]: pgmap v3513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:44 smithi133 ceph-mon[37053]: pgmap v3513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:44 smithi063 ceph-mon[36747]: pgmap v3513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:08:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:46 smithi043 ceph-mon[32384]: pgmap v3514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5571.833895 secs 2024-07-26T10:08:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:46 smithi133 ceph-mon[37053]: pgmap v3514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5571.833895 secs 2024-07-26T10:08:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:46 smithi063 ceph-mon[36747]: pgmap v3514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:08:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5571.833895 secs 2024-07-26T10:08:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5587.317072 secs 2024-07-26T10:08:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:08:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5587.317072 secs 2024-07-26T10:08:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:08:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5587.317072 secs 2024-07-26T10:08:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:08:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: pgmap v3515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:08:48.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:08:48.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:08:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: pgmap v3515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:08:48.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:08:48.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:08:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: pgmap v3515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:08:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:08:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:49 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:08:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:49 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:08:49.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:49 smithi043 ceph-mon[32384]: pgmap v3516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:49.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:49 smithi043 ceph-mon[32384]: pgmap v3517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:08:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:49 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:08:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:49 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:08:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:49 smithi133 ceph-mon[37053]: pgmap v3516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:49 smithi133 ceph-mon[37053]: pgmap v3517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:08:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:49 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:08:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:49 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:08:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:49 smithi063 ceph-mon[36747]: pgmap v3516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:49 smithi063 ceph-mon[36747]: pgmap v3517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:08:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:51 smithi043 ceph-mon[32384]: pgmap v3518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:08:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5576.833959 secs 2024-07-26T10:08:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:51 smithi133 ceph-mon[37053]: pgmap v3518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:08:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5576.833959 secs 2024-07-26T10:08:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:51 smithi063 ceph-mon[36747]: pgmap v3518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:08:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5576.833959 secs 2024-07-26T10:08:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5592.317165 secs 2024-07-26T10:08:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5592.317165 secs 2024-07-26T10:08:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5592.317165 secs 2024-07-26T10:08:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:53 smithi043 ceph-mon[32384]: pgmap v3519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:08:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:53 smithi133 ceph-mon[37053]: pgmap v3519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:08:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:53 smithi063 ceph-mon[36747]: pgmap v3519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:08:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:55 smithi043 ceph-mon[32384]: pgmap v3520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:55 smithi133 ceph-mon[37053]: pgmap v3520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:55 smithi063 ceph-mon[36747]: pgmap v3520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5581.834083 secs 2024-07-26T10:08:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5581.834083 secs 2024-07-26T10:08:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5581.834083 secs 2024-07-26T10:08:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5597.317233 secs 2024-07-26T10:08:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:57 smithi043 ceph-mon[32384]: pgmap v3521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5597.317233 secs 2024-07-26T10:08:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:57 smithi133 ceph-mon[37053]: pgmap v3521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5597.317233 secs 2024-07-26T10:08:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:57 smithi063 ceph-mon[36747]: pgmap v3521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:08:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:08:59 smithi043 ceph-mon[32384]: pgmap v3522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:08:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:08:59 smithi133 ceph-mon[37053]: pgmap v3522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:08:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:08:59 smithi063 ceph-mon[36747]: pgmap v3522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:09:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:01 smithi043 ceph-mon[32384]: pgmap v3523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5586.834180 secs 2024-07-26T10:09:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:01 smithi133 ceph-mon[37053]: pgmap v3523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5586.834180 secs 2024-07-26T10:09:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:01 smithi063 ceph-mon[36747]: pgmap v3523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5586.834180 secs 2024-07-26T10:09:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5602.317364 secs 2024-07-26T10:09:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5602.317364 secs 2024-07-26T10:09:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5602.317364 secs 2024-07-26T10:09:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:03 smithi043 ceph-mon[32384]: pgmap v3524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:03 smithi133 ceph-mon[37053]: pgmap v3524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:03 smithi063 ceph-mon[36747]: pgmap v3524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:05 smithi043 ceph-mon[32384]: pgmap v3525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:05 smithi133 ceph-mon[37053]: pgmap v3525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:05 smithi063 ceph-mon[36747]: pgmap v3525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5591.834307 secs 2024-07-26T10:09:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5591.834307 secs 2024-07-26T10:09:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5591.834307 secs 2024-07-26T10:09:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5607.317430 secs 2024-07-26T10:09:07.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:07 smithi043 ceph-mon[32384]: pgmap v3526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5607.317430 secs 2024-07-26T10:09:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:07 smithi133 ceph-mon[37053]: pgmap v3526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5607.317430 secs 2024-07-26T10:09:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:07 smithi063 ceph-mon[36747]: pgmap v3526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:09 smithi063 ceph-mon[36747]: pgmap v3527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:09 smithi043 ceph-mon[32384]: pgmap v3527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:09 smithi133 ceph-mon[37053]: pgmap v3527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:11 smithi063 ceph-mon[36747]: pgmap v3528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5596.834384 secs 2024-07-26T10:09:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5612.317548 secs 2024-07-26T10:09:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:11 smithi043 ceph-mon[32384]: pgmap v3528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5596.834384 secs 2024-07-26T10:09:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5612.317548 secs 2024-07-26T10:09:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:11 smithi133 ceph-mon[37053]: pgmap v3528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:12.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5596.834384 secs 2024-07-26T10:09:12.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5612.317548 secs 2024-07-26T10:09:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:13 smithi063 ceph-mon[36747]: pgmap v3529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:13.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:13 smithi133 ceph-mon[37053]: pgmap v3529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:13 smithi043 ceph-mon[32384]: pgmap v3529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:15 smithi063 ceph-mon[36747]: pgmap v3530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:15 smithi043 ceph-mon[32384]: pgmap v3530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:15 smithi133 ceph-mon[37053]: pgmap v3530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5601.834501 secs 2024-07-26T10:09:16.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5617.317666 secs 2024-07-26T10:09:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5601.834501 secs 2024-07-26T10:09:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5617.317666 secs 2024-07-26T10:09:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5601.834501 secs 2024-07-26T10:09:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5617.317666 secs 2024-07-26T10:09:17.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:17 smithi043 ceph-mon[32384]: pgmap v3531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:17 smithi133 ceph-mon[37053]: pgmap v3531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:17 smithi063 ceph-mon[36747]: pgmap v3531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:19 smithi043 ceph-mon[32384]: pgmap v3532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:19 smithi133 ceph-mon[37053]: pgmap v3532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:19 smithi063 ceph-mon[36747]: pgmap v3532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:21 smithi043 ceph-mon[32384]: pgmap v3533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5606.834620 secs 2024-07-26T10:09:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5622.317785 secs 2024-07-26T10:09:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:21 smithi133 ceph-mon[37053]: pgmap v3533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5606.834620 secs 2024-07-26T10:09:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5622.317785 secs 2024-07-26T10:09:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:21 smithi063 ceph-mon[36747]: pgmap v3533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5606.834620 secs 2024-07-26T10:09:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5622.317785 secs 2024-07-26T10:09:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:23 smithi043 ceph-mon[32384]: pgmap v3534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:23 smithi133 ceph-mon[37053]: pgmap v3534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:23 smithi063 ceph-mon[36747]: pgmap v3534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:25.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:25 smithi043 ceph-mon[32384]: pgmap v3535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:25 smithi133 ceph-mon[37053]: pgmap v3535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:25 smithi063 ceph-mon[36747]: pgmap v3535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:26.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5611.834765 secs 2024-07-26T10:09:26.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5627.317923 secs 2024-07-26T10:09:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5611.834765 secs 2024-07-26T10:09:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5627.317923 secs 2024-07-26T10:09:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5611.834765 secs 2024-07-26T10:09:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5627.317923 secs 2024-07-26T10:09:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:27 smithi043 ceph-mon[32384]: pgmap v3536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:27 smithi133 ceph-mon[37053]: pgmap v3536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:27 smithi063 ceph-mon[36747]: pgmap v3536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:29 smithi043 ceph-mon[32384]: pgmap v3537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:29 smithi133 ceph-mon[37053]: pgmap v3537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:29 smithi063 ceph-mon[36747]: pgmap v3537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:31 smithi043 ceph-mon[32384]: pgmap v3538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5616.834906 secs 2024-07-26T10:09:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5632.318053 secs 2024-07-26T10:09:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:31 smithi133 ceph-mon[37053]: pgmap v3538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5616.834906 secs 2024-07-26T10:09:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5632.318053 secs 2024-07-26T10:09:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:31 smithi063 ceph-mon[36747]: pgmap v3538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:32.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5616.834906 secs 2024-07-26T10:09:32.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5632.318053 secs 2024-07-26T10:09:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:33 smithi043 ceph-mon[32384]: pgmap v3539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:33 smithi133 ceph-mon[37053]: pgmap v3539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:33 smithi063 ceph-mon[36747]: pgmap v3539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:35 smithi043 ceph-mon[32384]: pgmap v3540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:35 smithi133 ceph-mon[37053]: pgmap v3540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:35 smithi063 ceph-mon[36747]: pgmap v3540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5621.835020 secs 2024-07-26T10:09:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5637.318172 secs 2024-07-26T10:09:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5621.835020 secs 2024-07-26T10:09:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5637.318172 secs 2024-07-26T10:09:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5621.835020 secs 2024-07-26T10:09:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5637.318172 secs 2024-07-26T10:09:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:37 smithi043 ceph-mon[32384]: pgmap v3541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:38.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:37 smithi133 ceph-mon[37053]: pgmap v3541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:37 smithi063 ceph-mon[36747]: pgmap v3541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:39 smithi043 ceph-mon[32384]: pgmap v3542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:39 smithi133 ceph-mon[37053]: pgmap v3542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:39 smithi063 ceph-mon[36747]: pgmap v3542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:41 smithi043 ceph-mon[32384]: pgmap v3543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5626.835143 secs 2024-07-26T10:09:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5642.318267 secs 2024-07-26T10:09:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:41 smithi133 ceph-mon[37053]: pgmap v3543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5626.835143 secs 2024-07-26T10:09:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5642.318267 secs 2024-07-26T10:09:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:41 smithi063 ceph-mon[36747]: pgmap v3543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:09:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5626.835143 secs 2024-07-26T10:09:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5642.318267 secs 2024-07-26T10:09:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:43 smithi043 ceph-mon[32384]: pgmap v3544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:43 smithi133 ceph-mon[37053]: pgmap v3544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:43 smithi063 ceph-mon[36747]: pgmap v3544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:45 smithi043 ceph-mon[32384]: pgmap v3545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:45 smithi133 ceph-mon[37053]: pgmap v3545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:45 smithi063 ceph-mon[36747]: pgmap v3545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5631.835264 secs 2024-07-26T10:09:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5647.318386 secs 2024-07-26T10:09:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5631.835264 secs 2024-07-26T10:09:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5647.318386 secs 2024-07-26T10:09:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5631.835264 secs 2024-07-26T10:09:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5647.318386 secs 2024-07-26T10:09:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:47 smithi043 ceph-mon[32384]: pgmap v3546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:47 smithi133 ceph-mon[37053]: pgmap v3546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:47 smithi063 ceph-mon[36747]: pgmap v3546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:09:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:09:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:09:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:09:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: pgmap v3547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:09:49.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:09:49.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: pgmap v3547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:09:50.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: pgmap v3547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:09:50.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:09:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:50 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:09:50.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:50 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:09:50.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:50 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:09:50.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:50 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:09:50.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:50 smithi043 ceph-mon[32384]: pgmap v3548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:09:50.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:50 smithi043 ceph-mon[32384]: pgmap v3549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:09:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:50 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:09:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:50 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:09:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:50 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:09:51.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:50 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:09:51.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:50 smithi133 ceph-mon[37053]: pgmap v3548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:09:51.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:50 smithi133 ceph-mon[37053]: pgmap v3549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:09:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:50 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:09:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:50 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:09:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:50 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:09:51.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:50 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:09:51.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:50 smithi063 ceph-mon[36747]: pgmap v3548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:09:51.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:50 smithi063 ceph-mon[36747]: pgmap v3549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:09:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5636.835380 secs 2024-07-26T10:09:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5652.318538 secs 2024-07-26T10:09:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5636.835380 secs 2024-07-26T10:09:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5652.318538 secs 2024-07-26T10:09:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5636.835380 secs 2024-07-26T10:09:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5652.318538 secs 2024-07-26T10:09:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:52 smithi043 ceph-mon[32384]: pgmap v3550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:09:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:52 smithi133 ceph-mon[37053]: pgmap v3550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:09:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:52 smithi063 ceph-mon[36747]: pgmap v3550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:09:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:54 smithi133 ceph-mon[37053]: pgmap v3551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:09:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:54 smithi063 ceph-mon[36747]: pgmap v3551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:09:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:54 smithi043 ceph-mon[32384]: pgmap v3551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:09:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5641.835480 secs 2024-07-26T10:09:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:56 smithi133 ceph-mon[37053]: pgmap v3552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:09:57.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5657.318636 secs 2024-07-26T10:09:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5641.835480 secs 2024-07-26T10:09:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:56 smithi063 ceph-mon[36747]: pgmap v3552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:09:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5657.318636 secs 2024-07-26T10:09:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5641.835480 secs 2024-07-26T10:09:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:56 smithi043 ceph-mon[32384]: pgmap v3552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:09:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5657.318636 secs 2024-07-26T10:09:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:09:57 smithi133 ceph-mon[37053]: pgmap v3553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:09:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:09:57 smithi063 ceph-mon[36747]: pgmap v3553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:09:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:09:57 smithi043 ceph-mon[32384]: pgmap v3553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:10:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:00 smithi043 ceph-mon[32384]: pgmap v3554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:10:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:10:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:00 smithi133 ceph-mon[37053]: pgmap v3554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:10:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:10:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:00 smithi063 ceph-mon[36747]: pgmap v3554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:10:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:10:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5646.835581 secs 2024-07-26T10:10:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5662.318757 secs 2024-07-26T10:10:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5646.835581 secs 2024-07-26T10:10:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5662.318757 secs 2024-07-26T10:10:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5646.835581 secs 2024-07-26T10:10:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5662.318757 secs 2024-07-26T10:10:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:02 smithi043 ceph-mon[32384]: pgmap v3555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:02 smithi133 ceph-mon[37053]: pgmap v3555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:02 smithi063 ceph-mon[36747]: pgmap v3555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:04 smithi043 ceph-mon[32384]: pgmap v3556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:04 smithi133 ceph-mon[37053]: pgmap v3556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:04 smithi063 ceph-mon[36747]: pgmap v3556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5651.835721 secs 2024-07-26T10:10:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:06 smithi043 ceph-mon[32384]: pgmap v3557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5667.318915 secs 2024-07-26T10:10:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5651.835721 secs 2024-07-26T10:10:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:06 smithi133 ceph-mon[37053]: pgmap v3557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5667.318915 secs 2024-07-26T10:10:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5651.835721 secs 2024-07-26T10:10:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:06 smithi063 ceph-mon[36747]: pgmap v3557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5667.318915 secs 2024-07-26T10:10:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:08 smithi043 ceph-mon[32384]: pgmap v3558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:08 smithi133 ceph-mon[37053]: pgmap v3558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:08 smithi063 ceph-mon[36747]: pgmap v3558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:10 smithi043 ceph-mon[32384]: pgmap v3559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:10 smithi133 ceph-mon[37053]: pgmap v3559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:10 smithi063 ceph-mon[36747]: pgmap v3559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5656.835862 secs 2024-07-26T10:10:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5672.319036 secs 2024-07-26T10:10:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5656.835862 secs 2024-07-26T10:10:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5672.319036 secs 2024-07-26T10:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5656.835862 secs 2024-07-26T10:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5672.319036 secs 2024-07-26T10:10:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:12 smithi043 ceph-mon[32384]: pgmap v3560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:12 smithi133 ceph-mon[37053]: pgmap v3560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:12 smithi063 ceph-mon[36747]: pgmap v3560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:14 smithi043 ceph-mon[32384]: pgmap v3561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:14 smithi133 ceph-mon[37053]: pgmap v3561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:14 smithi063 ceph-mon[36747]: pgmap v3561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5661.835996 secs 2024-07-26T10:10:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:16 smithi133 ceph-mon[37053]: pgmap v3562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5677.319105 secs 2024-07-26T10:10:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5661.835996 secs 2024-07-26T10:10:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:16 smithi063 ceph-mon[36747]: pgmap v3562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5677.319105 secs 2024-07-26T10:10:16.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5661.835996 secs 2024-07-26T10:10:16.957 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:16 smithi043 ceph-mon[32384]: pgmap v3562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:16.957 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5677.319105 secs 2024-07-26T10:10:18.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:18 smithi133 ceph-mon[37053]: pgmap v3563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:18 smithi063 ceph-mon[36747]: pgmap v3563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:18 smithi043 ceph-mon[32384]: pgmap v3563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:20 smithi133 ceph-mon[37053]: pgmap v3564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:20 smithi063 ceph-mon[36747]: pgmap v3564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:20 smithi043 ceph-mon[32384]: pgmap v3564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5666.836121 secs 2024-07-26T10:10:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5682.319203 secs 2024-07-26T10:10:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5666.836121 secs 2024-07-26T10:10:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5682.319203 secs 2024-07-26T10:10:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5666.836121 secs 2024-07-26T10:10:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5682.319203 secs 2024-07-26T10:10:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:22 smithi133 ceph-mon[37053]: pgmap v3565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:22 smithi063 ceph-mon[36747]: pgmap v3565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:22 smithi043 ceph-mon[32384]: pgmap v3565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:24 smithi133 ceph-mon[37053]: pgmap v3566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:24 smithi063 ceph-mon[36747]: pgmap v3566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:24 smithi043 ceph-mon[32384]: pgmap v3566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5671.836262 secs 2024-07-26T10:10:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:26 smithi063 ceph-mon[36747]: pgmap v3567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5687.319317 secs 2024-07-26T10:10:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5671.836262 secs 2024-07-26T10:10:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:26 smithi043 ceph-mon[32384]: pgmap v3567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5687.319317 secs 2024-07-26T10:10:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5671.836262 secs 2024-07-26T10:10:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:26 smithi133 ceph-mon[37053]: pgmap v3567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5687.319317 secs 2024-07-26T10:10:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:28 smithi063 ceph-mon[36747]: pgmap v3568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:28 smithi043 ceph-mon[32384]: pgmap v3568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:28 smithi133 ceph-mon[37053]: pgmap v3568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:30 smithi063 ceph-mon[36747]: pgmap v3569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:30 smithi043 ceph-mon[32384]: pgmap v3569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:30 smithi133 ceph-mon[37053]: pgmap v3569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5676.836387 secs 2024-07-26T10:10:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5692.319437 secs 2024-07-26T10:10:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5676.836387 secs 2024-07-26T10:10:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5692.319437 secs 2024-07-26T10:10:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5676.836387 secs 2024-07-26T10:10:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5692.319437 secs 2024-07-26T10:10:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:32 smithi043 ceph-mon[32384]: pgmap v3570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:32 smithi063 ceph-mon[36747]: pgmap v3570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:32 smithi133 ceph-mon[37053]: pgmap v3570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:34 smithi063 ceph-mon[36747]: pgmap v3571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:34 smithi043 ceph-mon[32384]: pgmap v3571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:34 smithi133 ceph-mon[37053]: pgmap v3571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5681.836529 secs 2024-07-26T10:10:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:36 smithi063 ceph-mon[36747]: pgmap v3572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5697.319559 secs 2024-07-26T10:10:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5681.836529 secs 2024-07-26T10:10:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:36 smithi043 ceph-mon[32384]: pgmap v3572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:36.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5697.319559 secs 2024-07-26T10:10:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5681.836529 secs 2024-07-26T10:10:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:36 smithi133 ceph-mon[37053]: pgmap v3572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5697.319559 secs 2024-07-26T10:10:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:38 smithi063 ceph-mon[36747]: pgmap v3573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:38 smithi043 ceph-mon[32384]: pgmap v3573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:38 smithi133 ceph-mon[37053]: pgmap v3573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:40 smithi043 ceph-mon[32384]: pgmap v3574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:40 smithi133 ceph-mon[37053]: pgmap v3574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:41.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:40 smithi063 ceph-mon[36747]: pgmap v3574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5686.836618 secs 2024-07-26T10:10:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5702.319651 secs 2024-07-26T10:10:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5686.836618 secs 2024-07-26T10:10:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5702.319651 secs 2024-07-26T10:10:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5686.836618 secs 2024-07-26T10:10:42.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5702.319651 secs 2024-07-26T10:10:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:42 smithi043 ceph-mon[32384]: pgmap v3575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:42 smithi133 ceph-mon[37053]: pgmap v3575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:42 smithi063 ceph-mon[36747]: pgmap v3575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:10:44.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:44 smithi063 ceph-mon[36747]: pgmap v3576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:44 smithi043 ceph-mon[32384]: pgmap v3576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:44 smithi133 ceph-mon[37053]: pgmap v3576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5691.836701 secs 2024-07-26T10:10:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:46 smithi043 ceph-mon[32384]: pgmap v3577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5707.319781 secs 2024-07-26T10:10:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5691.836701 secs 2024-07-26T10:10:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:46 smithi133 ceph-mon[37053]: pgmap v3577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5707.319781 secs 2024-07-26T10:10:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5691.836701 secs 2024-07-26T10:10:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:46 smithi063 ceph-mon[36747]: pgmap v3577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:10:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5707.319781 secs 2024-07-26T10:10:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:48 smithi043 ceph-mon[32384]: pgmap v3578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:48 smithi133 ceph-mon[37053]: pgmap v3578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:48 smithi063 ceph-mon[36747]: pgmap v3578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:10:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:10:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:10:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:50 smithi043 ceph-mon[32384]: pgmap v3579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:50 smithi133 ceph-mon[37053]: pgmap v3579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:50 smithi063 ceph-mon[36747]: pgmap v3579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:10:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5696.836774 secs 2024-07-26T10:10:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5712.319839 secs 2024-07-26T10:10:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:10:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:10:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: pgmap v3580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: pgmap v3581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:10:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5696.836774 secs 2024-07-26T10:10:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5712.319839 secs 2024-07-26T10:10:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:10:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:10:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: pgmap v3580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: pgmap v3581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:52.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5696.836774 secs 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5712.319839 secs 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: pgmap v3580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: pgmap v3581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:52.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:10:53.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:53 smithi043 ceph-mon[32384]: pgmap v3582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:53 smithi133 ceph-mon[37053]: pgmap v3582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:53 smithi063 ceph-mon[36747]: pgmap v3582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:55 smithi043 ceph-mon[32384]: pgmap v3583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:55 smithi133 ceph-mon[37053]: pgmap v3583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:55 smithi063 ceph-mon[36747]: pgmap v3583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:10:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5701.836888 secs 2024-07-26T10:10:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5717.319936 secs 2024-07-26T10:10:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5701.836888 secs 2024-07-26T10:10:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5717.319936 secs 2024-07-26T10:10:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5701.836888 secs 2024-07-26T10:10:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5717.319936 secs 2024-07-26T10:10:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:57 smithi043 ceph-mon[32384]: pgmap v3584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:10:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:57 smithi133 ceph-mon[37053]: pgmap v3584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:10:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:57 smithi063 ceph-mon[36747]: pgmap v3584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:10:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:10:59 smithi043 ceph-mon[32384]: pgmap v3585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:11:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:10:59 smithi133 ceph-mon[37053]: pgmap v3585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:11:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:10:59 smithi063 ceph-mon[36747]: pgmap v3585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:11:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5706.837007 secs 2024-07-26T10:11:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5722.320060 secs 2024-07-26T10:11:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:01 smithi043 ceph-mon[32384]: pgmap v3586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:11:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5706.837007 secs 2024-07-26T10:11:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5722.320060 secs 2024-07-26T10:11:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:01 smithi133 ceph-mon[37053]: pgmap v3586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:11:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5706.837007 secs 2024-07-26T10:11:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5722.320060 secs 2024-07-26T10:11:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:01 smithi063 ceph-mon[36747]: pgmap v3586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:11:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:03 smithi043 ceph-mon[32384]: pgmap v3587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:03 smithi133 ceph-mon[37053]: pgmap v3587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:03 smithi063 ceph-mon[36747]: pgmap v3587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:05 smithi133 ceph-mon[37053]: pgmap v3588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:11:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:05 smithi063 ceph-mon[36747]: pgmap v3588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:11:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:05 smithi043 ceph-mon[32384]: pgmap v3588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:11:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5711.837122 secs 2024-07-26T10:11:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5727.320189 secs 2024-07-26T10:11:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5711.837122 secs 2024-07-26T10:11:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5727.320189 secs 2024-07-26T10:11:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5711.837122 secs 2024-07-26T10:11:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5727.320189 secs 2024-07-26T10:11:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:07 smithi133 ceph-mon[37053]: pgmap v3589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:11:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:07 smithi063 ceph-mon[36747]: pgmap v3589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:11:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:07 smithi043 ceph-mon[32384]: pgmap v3589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:11:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:08 smithi063 ceph-mon[36747]: pgmap v3590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:08 smithi043 ceph-mon[32384]: pgmap v3590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:08 smithi133 ceph-mon[37053]: pgmap v3590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5716.837250 secs 2024-07-26T10:11:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5732.320293 secs 2024-07-26T10:11:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:11 smithi043 ceph-mon[32384]: pgmap v3591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:11:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5716.837250 secs 2024-07-26T10:11:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5732.320293 secs 2024-07-26T10:11:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:11 smithi133 ceph-mon[37053]: pgmap v3591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:11:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5716.837250 secs 2024-07-26T10:11:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5732.320293 secs 2024-07-26T10:11:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:11 smithi063 ceph-mon[36747]: pgmap v3591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:11:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:13 smithi043 ceph-mon[32384]: pgmap v3592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:13 smithi133 ceph-mon[37053]: pgmap v3592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:13 smithi063 ceph-mon[36747]: pgmap v3592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:15 smithi043 ceph-mon[32384]: pgmap v3593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:15 smithi133 ceph-mon[37053]: pgmap v3593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:15 smithi063 ceph-mon[36747]: pgmap v3593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5721.837358 secs 2024-07-26T10:11:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5737.320415 secs 2024-07-26T10:11:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5721.837358 secs 2024-07-26T10:11:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5737.320415 secs 2024-07-26T10:11:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5721.837358 secs 2024-07-26T10:11:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5737.320415 secs 2024-07-26T10:11:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:17 smithi043 ceph-mon[32384]: pgmap v3594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:17 smithi133 ceph-mon[37053]: pgmap v3594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:17 smithi063 ceph-mon[36747]: pgmap v3594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:19 smithi043 ceph-mon[32384]: pgmap v3595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:19 smithi133 ceph-mon[37053]: pgmap v3595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:19 smithi063 ceph-mon[36747]: pgmap v3595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5726.837502 secs 2024-07-26T10:11:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5742.320512 secs 2024-07-26T10:11:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:21 smithi133 ceph-mon[37053]: pgmap v3596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5726.837502 secs 2024-07-26T10:11:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5742.320512 secs 2024-07-26T10:11:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:21 smithi063 ceph-mon[36747]: pgmap v3596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5726.837502 secs 2024-07-26T10:11:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5742.320512 secs 2024-07-26T10:11:22.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:21 smithi043 ceph-mon[32384]: pgmap v3596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:23 smithi133 ceph-mon[37053]: pgmap v3597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:23 smithi063 ceph-mon[36747]: pgmap v3597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:23 smithi043 ceph-mon[32384]: pgmap v3597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:25 smithi133 ceph-mon[37053]: pgmap v3598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:25 smithi063 ceph-mon[36747]: pgmap v3598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:25 smithi043 ceph-mon[32384]: pgmap v3598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5731.837562 secs 2024-07-26T10:11:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5747.320634 secs 2024-07-26T10:11:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5731.837562 secs 2024-07-26T10:11:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5747.320634 secs 2024-07-26T10:11:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5731.837562 secs 2024-07-26T10:11:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5747.320634 secs 2024-07-26T10:11:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:27 smithi133 ceph-mon[37053]: pgmap v3599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:27 smithi063 ceph-mon[36747]: pgmap v3599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:27 smithi043 ceph-mon[32384]: pgmap v3599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:28 smithi063 ceph-mon[36747]: pgmap v3600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:28 smithi043 ceph-mon[32384]: pgmap v3600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:28 smithi133 ceph-mon[37053]: pgmap v3600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5736.837730 secs 2024-07-26T10:11:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5752.320755 secs 2024-07-26T10:11:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:31 smithi043 ceph-mon[32384]: pgmap v3601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5736.837730 secs 2024-07-26T10:11:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5752.320755 secs 2024-07-26T10:11:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:31 smithi133 ceph-mon[37053]: pgmap v3601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5736.837730 secs 2024-07-26T10:11:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5752.320755 secs 2024-07-26T10:11:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:31 smithi063 ceph-mon[36747]: pgmap v3601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:33 smithi043 ceph-mon[32384]: pgmap v3602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:33 smithi133 ceph-mon[37053]: pgmap v3602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:33 smithi063 ceph-mon[36747]: pgmap v3602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:35 smithi043 ceph-mon[32384]: pgmap v3603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:35 smithi133 ceph-mon[37053]: pgmap v3603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:35 smithi063 ceph-mon[36747]: pgmap v3603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5741.837856 secs 2024-07-26T10:11:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5757.320913 secs 2024-07-26T10:11:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5741.837856 secs 2024-07-26T10:11:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5757.320913 secs 2024-07-26T10:11:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5741.837856 secs 2024-07-26T10:11:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5757.320913 secs 2024-07-26T10:11:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:37 smithi133 ceph-mon[37053]: pgmap v3604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:37 smithi063 ceph-mon[36747]: pgmap v3604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:37 smithi043 ceph-mon[32384]: pgmap v3604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:39 smithi133 ceph-mon[37053]: pgmap v3605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:39 smithi063 ceph-mon[36747]: pgmap v3605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:39 smithi043 ceph-mon[32384]: pgmap v3605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5746.837983 secs 2024-07-26T10:11:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:41 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 5762.321059 secs 2024-07-26T10:11:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:41 smithi133 ceph-mon[37053]: slow request 5762.321058 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T10:11:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:41 smithi133 ceph-mon[37053]: pgmap v3606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:42.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5746.837983 secs 2024-07-26T10:11:42.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:41 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 5762.321059 secs 2024-07-26T10:11:42.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:41 smithi063 ceph-mon[36747]: slow request 5762.321058 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T10:11:42.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:41 smithi063 ceph-mon[36747]: pgmap v3606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5746.837983 secs 2024-07-26T10:11:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:41 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 5762.321059 secs 2024-07-26T10:11:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:41 smithi043 ceph-mon[32384]: slow request 5762.321058 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T10:11:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:41 smithi043 ceph-mon[32384]: pgmap v3606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:43 smithi133 ceph-mon[37053]: pgmap v3607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:43 smithi063 ceph-mon[36747]: pgmap v3607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:43 smithi043 ceph-mon[32384]: pgmap v3607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:45 smithi133 ceph-mon[37053]: pgmap v3608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:45 smithi063 ceph-mon[36747]: pgmap v3608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:45 smithi043 ceph-mon[32384]: pgmap v3608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:11:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5751.838050 secs 2024-07-26T10:11:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5767.321150 secs 2024-07-26T10:11:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:46 smithi063 ceph-mon[36747]: pgmap v3609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5751.838050 secs 2024-07-26T10:11:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5767.321150 secs 2024-07-26T10:11:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:46 smithi043 ceph-mon[32384]: pgmap v3609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5751.838050 secs 2024-07-26T10:11:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5767.321150 secs 2024-07-26T10:11:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:46 smithi133 ceph-mon[37053]: pgmap v3609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:49 smithi043 ceph-mon[32384]: pgmap v3610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:49 smithi133 ceph-mon[37053]: pgmap v3610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:49 smithi063 ceph-mon[36747]: pgmap v3610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5756.838176 secs 2024-07-26T10:11:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5772.321228 secs 2024-07-26T10:11:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:51 smithi043 ceph-mon[32384]: pgmap v3611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:11:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:51 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5756.838176 secs 2024-07-26T10:11:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5772.321228 secs 2024-07-26T10:11:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:51 smithi133 ceph-mon[37053]: pgmap v3611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:11:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:51 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5756.838176 secs 2024-07-26T10:11:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5772.321228 secs 2024-07-26T10:11:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:51 smithi063 ceph-mon[36747]: pgmap v3611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:11:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:11:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:51 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:11:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:11:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:11:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:11:53.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:11:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:11:53.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:11:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:53 smithi133 ceph-mon[37053]: pgmap v3612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:53 smithi133 ceph-mon[37053]: pgmap v3613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:53 smithi063 ceph-mon[36747]: pgmap v3612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:53 smithi063 ceph-mon[36747]: pgmap v3613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:53 smithi043 ceph-mon[32384]: pgmap v3612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:11:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:53 smithi043 ceph-mon[32384]: pgmap v3613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:55 smithi133 ceph-mon[37053]: pgmap v3614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:55 smithi063 ceph-mon[36747]: pgmap v3614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:55 smithi043 ceph-mon[32384]: pgmap v3614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:56 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 5761.838288 secs 2024-07-26T10:11:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:56 smithi133 ceph-mon[37053]: slow request 5761.838287 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T10:11:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5777.321350 secs 2024-07-26T10:11:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:56 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 5761.838288 secs 2024-07-26T10:11:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:56 smithi063 ceph-mon[36747]: slow request 5761.838287 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T10:11:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5777.321350 secs 2024-07-26T10:11:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:56 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 5761.838288 secs 2024-07-26T10:11:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:56 smithi043 ceph-mon[32384]: slow request 5761.838287 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T10:11:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5777.321350 secs 2024-07-26T10:11:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:57 smithi063 ceph-mon[36747]: pgmap v3615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:57 smithi043 ceph-mon[32384]: pgmap v3615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:57 smithi133 ceph-mon[37053]: pgmap v3615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:11:58 smithi063 ceph-mon[36747]: pgmap v3616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:11:58 smithi043 ceph-mon[32384]: pgmap v3616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:11:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:11:58 smithi133 ceph-mon[37053]: pgmap v3616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:12:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5766.838403 secs 2024-07-26T10:12:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5782.321469 secs 2024-07-26T10:12:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:01 smithi043 ceph-mon[32384]: pgmap v3617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:12:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5766.838403 secs 2024-07-26T10:12:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5782.321469 secs 2024-07-26T10:12:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:01 smithi133 ceph-mon[37053]: pgmap v3617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:12:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5766.838403 secs 2024-07-26T10:12:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5782.321469 secs 2024-07-26T10:12:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:01 smithi063 ceph-mon[36747]: pgmap v3617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:12:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:03 smithi043 ceph-mon[32384]: pgmap v3618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:12:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:03 smithi133 ceph-mon[37053]: pgmap v3618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:12:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:03 smithi063 ceph-mon[36747]: pgmap v3618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:12:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:05 smithi043 ceph-mon[32384]: pgmap v3619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:05 smithi133 ceph-mon[37053]: pgmap v3619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:05 smithi063 ceph-mon[36747]: pgmap v3619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:06 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 5771.838484 secs 2024-07-26T10:12:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:06 smithi043 ceph-mon[32384]: slow request 5764.531496 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T10:12:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5787.321566 secs 2024-07-26T10:12:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:06 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 5771.838484 secs 2024-07-26T10:12:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:06 smithi133 ceph-mon[37053]: slow request 5764.531496 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T10:12:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5787.321566 secs 2024-07-26T10:12:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:06 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 5771.838484 secs 2024-07-26T10:12:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:06 smithi063 ceph-mon[36747]: slow request 5764.531496 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T10:12:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5787.321566 secs 2024-07-26T10:12:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:07 smithi043 ceph-mon[32384]: pgmap v3620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:07 smithi133 ceph-mon[37053]: pgmap v3620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:07 smithi063 ceph-mon[36747]: pgmap v3620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:09 smithi043 ceph-mon[32384]: pgmap v3621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:09 smithi133 ceph-mon[37053]: pgmap v3621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:09 smithi063 ceph-mon[36747]: pgmap v3621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5776.838598 secs 2024-07-26T10:12:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5792.321684 secs 2024-07-26T10:12:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:11 smithi043 ceph-mon[32384]: pgmap v3622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5776.838598 secs 2024-07-26T10:12:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5792.321684 secs 2024-07-26T10:12:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:11 smithi133 ceph-mon[37053]: pgmap v3622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5776.838598 secs 2024-07-26T10:12:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5792.321684 secs 2024-07-26T10:12:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:11 smithi063 ceph-mon[36747]: pgmap v3622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:13 smithi043 ceph-mon[32384]: pgmap v3623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:13 smithi133 ceph-mon[37053]: pgmap v3623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:13 smithi063 ceph-mon[36747]: pgmap v3623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:15 smithi133 ceph-mon[37053]: pgmap v3624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:15 smithi063 ceph-mon[36747]: pgmap v3624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:15 smithi043 ceph-mon[32384]: pgmap v3624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5781.838673 secs 2024-07-26T10:12:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5797.321831 secs 2024-07-26T10:12:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5781.838673 secs 2024-07-26T10:12:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5797.321831 secs 2024-07-26T10:12:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5781.838673 secs 2024-07-26T10:12:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5797.321831 secs 2024-07-26T10:12:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:17 smithi133 ceph-mon[37053]: pgmap v3625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:17 smithi063 ceph-mon[36747]: pgmap v3625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:17 smithi043 ceph-mon[32384]: pgmap v3625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:19 smithi133 ceph-mon[37053]: pgmap v3626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:19 smithi063 ceph-mon[36747]: pgmap v3626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:19 smithi043 ceph-mon[32384]: pgmap v3626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5786.838796 secs 2024-07-26T10:12:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5802.321953 secs 2024-07-26T10:12:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:21 smithi133 ceph-mon[37053]: pgmap v3627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5786.838796 secs 2024-07-26T10:12:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5802.321953 secs 2024-07-26T10:12:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:21 smithi063 ceph-mon[36747]: pgmap v3627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5786.838796 secs 2024-07-26T10:12:22.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5802.321953 secs 2024-07-26T10:12:22.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:21 smithi043 ceph-mon[32384]: pgmap v3627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:23 smithi063 ceph-mon[36747]: pgmap v3628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:23 smithi043 ceph-mon[32384]: pgmap v3628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:23 smithi133 ceph-mon[37053]: pgmap v3628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:24 smithi043 ceph-mon[32384]: pgmap v3629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:24 smithi133 ceph-mon[37053]: pgmap v3629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:24 smithi063 ceph-mon[36747]: pgmap v3629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5791.838936 secs 2024-07-26T10:12:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5791.838936 secs 2024-07-26T10:12:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5791.838936 secs 2024-07-26T10:12:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5807.322036 secs 2024-07-26T10:12:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:27 smithi043 ceph-mon[32384]: pgmap v3630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5807.322036 secs 2024-07-26T10:12:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:27 smithi133 ceph-mon[37053]: pgmap v3630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5807.322036 secs 2024-07-26T10:12:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:27 smithi063 ceph-mon[36747]: pgmap v3630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:29 smithi043 ceph-mon[32384]: pgmap v3631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:29 smithi133 ceph-mon[37053]: pgmap v3631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:29 smithi063 ceph-mon[36747]: pgmap v3631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5796.839035 secs 2024-07-26T10:12:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5812.322137 secs 2024-07-26T10:12:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:31 smithi043 ceph-mon[32384]: pgmap v3632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5796.839035 secs 2024-07-26T10:12:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5812.322137 secs 2024-07-26T10:12:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:31 smithi133 ceph-mon[37053]: pgmap v3632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5796.839035 secs 2024-07-26T10:12:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5812.322137 secs 2024-07-26T10:12:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:31 smithi063 ceph-mon[36747]: pgmap v3632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:33 smithi043 ceph-mon[32384]: pgmap v3633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:33 smithi133 ceph-mon[37053]: pgmap v3633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:33 smithi063 ceph-mon[36747]: pgmap v3633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:35 smithi043 ceph-mon[32384]: pgmap v3634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:35 smithi133 ceph-mon[37053]: pgmap v3634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:35 smithi063 ceph-mon[36747]: pgmap v3634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5801.839130 secs 2024-07-26T10:12:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5817.322261 secs 2024-07-26T10:12:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5801.839130 secs 2024-07-26T10:12:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5817.322261 secs 2024-07-26T10:12:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5801.839130 secs 2024-07-26T10:12:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5817.322261 secs 2024-07-26T10:12:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:37 smithi133 ceph-mon[37053]: pgmap v3635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:37 smithi063 ceph-mon[36747]: pgmap v3635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:37 smithi043 ceph-mon[32384]: pgmap v3635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:39 smithi133 ceph-mon[37053]: pgmap v3636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:39 smithi063 ceph-mon[36747]: pgmap v3636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:39 smithi043 ceph-mon[32384]: pgmap v3636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5806.839173 secs 2024-07-26T10:12:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5822.322328 secs 2024-07-26T10:12:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:41 smithi133 ceph-mon[37053]: pgmap v3637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5806.839173 secs 2024-07-26T10:12:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5822.322328 secs 2024-07-26T10:12:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:41 smithi063 ceph-mon[36747]: pgmap v3637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5806.839173 secs 2024-07-26T10:12:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5822.322328 secs 2024-07-26T10:12:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:41 smithi043 ceph-mon[32384]: pgmap v3637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:43 smithi133 ceph-mon[37053]: pgmap v3638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:43 smithi063 ceph-mon[36747]: pgmap v3638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:43 smithi043 ceph-mon[32384]: pgmap v3638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:45 smithi133 ceph-mon[37053]: pgmap v3639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:45 smithi063 ceph-mon[36747]: pgmap v3639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:45 smithi043 ceph-mon[32384]: pgmap v3639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:46 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 5811.839299 secs 2024-07-26T10:12:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:46 smithi063 ceph-mon[36747]: slow request 5760.348996 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T10:12:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5827.322471 secs 2024-07-26T10:12:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:46 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 5811.839299 secs 2024-07-26T10:12:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:46 smithi043 ceph-mon[32384]: slow request 5760.348996 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T10:12:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5827.322471 secs 2024-07-26T10:12:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:46 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 5811.839299 secs 2024-07-26T10:12:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:46 smithi133 ceph-mon[37053]: slow request 5760.348996 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T10:12:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5827.322471 secs 2024-07-26T10:12:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:47 smithi063 ceph-mon[36747]: pgmap v3640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:47 smithi043 ceph-mon[32384]: pgmap v3640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:47 smithi133 ceph-mon[37053]: pgmap v3640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:49 smithi063 ceph-mon[36747]: pgmap v3641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:49 smithi043 ceph-mon[32384]: pgmap v3641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:49 smithi133 ceph-mon[37053]: pgmap v3641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:50 smithi063 ceph-mon[36747]: pgmap v3642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:50 smithi043 ceph-mon[32384]: pgmap v3642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:50 smithi133 ceph-mon[37053]: pgmap v3642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5816.839418 secs 2024-07-26T10:12:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5832.322601 secs 2024-07-26T10:12:52.092 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5816.839418 secs 2024-07-26T10:12:52.092 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5832.322601 secs 2024-07-26T10:12:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5816.839418 secs 2024-07-26T10:12:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5832.322601 secs 2024-07-26T10:12:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:52 smithi063 ceph-mon[36747]: pgmap v3643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:52 smithi043 ceph-mon[32384]: pgmap v3643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:52 smithi133 ceph-mon[37053]: pgmap v3643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:12:54.067 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:12:54.068 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.068 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.068 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.068 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:12:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:12:54.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.173 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:54.173 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:54 smithi063 ceph-mon[36747]: pgmap v3644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:54 smithi043 ceph-mon[32384]: pgmap v3644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:54 smithi133 ceph-mon[37053]: pgmap v3644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:12:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5821.839491 secs 2024-07-26T10:12:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5837.322700 secs 2024-07-26T10:12:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:56 smithi043 ceph-mon[32384]: pgmap v3645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5821.839491 secs 2024-07-26T10:12:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5837.322700 secs 2024-07-26T10:12:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:56 smithi133 ceph-mon[37053]: pgmap v3645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5821.839491 secs 2024-07-26T10:12:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5837.322700 secs 2024-07-26T10:12:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:56 smithi063 ceph-mon[36747]: pgmap v3645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:12:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:57.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:12:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:12:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:12:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:12:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:12:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:12:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:12:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:58 smithi043 ceph-mon[32384]: pgmap v3646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:12:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:12:58 smithi043 ceph-mon[32384]: pgmap v3647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:12:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:58 smithi133 ceph-mon[37053]: pgmap v3646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:12:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:12:58 smithi133 ceph-mon[37053]: pgmap v3647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:12:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:58 smithi063 ceph-mon[36747]: pgmap v3646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:12:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:12:58 smithi063 ceph-mon[36747]: pgmap v3647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:13:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:00 smithi043 ceph-mon[32384]: pgmap v3648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:13:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:00 smithi133 ceph-mon[37053]: pgmap v3648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:13:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:00 smithi063 ceph-mon[36747]: pgmap v3648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:13:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5826.839587 secs 2024-07-26T10:13:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5842.322835 secs 2024-07-26T10:13:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5826.839587 secs 2024-07-26T10:13:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5842.322835 secs 2024-07-26T10:13:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5826.839587 secs 2024-07-26T10:13:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5842.322835 secs 2024-07-26T10:13:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:02 smithi133 ceph-mon[37053]: pgmap v3649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:13:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:02 smithi063 ceph-mon[36747]: pgmap v3649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:13:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:02 smithi043 ceph-mon[32384]: pgmap v3649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:13:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:04 smithi133 ceph-mon[37053]: pgmap v3650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:13:05.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:04 smithi043 ceph-mon[32384]: pgmap v3650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:13:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:04 smithi063 ceph-mon[36747]: pgmap v3650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:13:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:07 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5831.839667 secs 2024-07-26T10:13:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5847.322954 secs 2024-07-26T10:13:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:07 smithi043 ceph-mon[32384]: pgmap v3651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:13:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:07 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5831.839667 secs 2024-07-26T10:13:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5847.322954 secs 2024-07-26T10:13:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:07 smithi133 ceph-mon[37053]: pgmap v3651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:13:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:07 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5831.839667 secs 2024-07-26T10:13:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5847.322954 secs 2024-07-26T10:13:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:07 smithi063 ceph-mon[36747]: pgmap v3651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:13:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:09 smithi043 ceph-mon[32384]: pgmap v3652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:13:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:09 smithi133 ceph-mon[37053]: pgmap v3652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:13:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:09 smithi063 ceph-mon[36747]: pgmap v3652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:13:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:11 smithi043 ceph-mon[32384]: pgmap v3653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5836.839780 secs 2024-07-26T10:13:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5852.323101 secs 2024-07-26T10:13:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:11 smithi133 ceph-mon[37053]: pgmap v3653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5836.839780 secs 2024-07-26T10:13:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5852.323101 secs 2024-07-26T10:13:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:11 smithi063 ceph-mon[36747]: pgmap v3653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5836.839780 secs 2024-07-26T10:13:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5852.323101 secs 2024-07-26T10:13:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:13 smithi043 ceph-mon[32384]: pgmap v3654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:13 smithi133 ceph-mon[37053]: pgmap v3654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:13 smithi063 ceph-mon[36747]: pgmap v3654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:15 smithi043 ceph-mon[32384]: pgmap v3655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:15 smithi133 ceph-mon[37053]: pgmap v3655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:15 smithi063 ceph-mon[36747]: pgmap v3655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5841.839898 secs 2024-07-26T10:13:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5857.323221 secs 2024-07-26T10:13:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5841.839898 secs 2024-07-26T10:13:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5857.323221 secs 2024-07-26T10:13:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5841.839898 secs 2024-07-26T10:13:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5857.323221 secs 2024-07-26T10:13:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:17 smithi043 ceph-mon[32384]: pgmap v3656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:17 smithi133 ceph-mon[37053]: pgmap v3656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:17 smithi063 ceph-mon[36747]: pgmap v3656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:19 smithi043 ceph-mon[32384]: pgmap v3657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:19 smithi133 ceph-mon[37053]: pgmap v3657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:20.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:19 smithi063 ceph-mon[36747]: pgmap v3657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:21 smithi043 ceph-mon[32384]: pgmap v3658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5846.840019 secs 2024-07-26T10:13:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5862.323341 secs 2024-07-26T10:13:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:21 smithi133 ceph-mon[37053]: pgmap v3658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5846.840019 secs 2024-07-26T10:13:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5862.323341 secs 2024-07-26T10:13:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:21 smithi063 ceph-mon[36747]: pgmap v3658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5846.840019 secs 2024-07-26T10:13:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5862.323341 secs 2024-07-26T10:13:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:23 smithi043 ceph-mon[32384]: pgmap v3659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:23 smithi133 ceph-mon[37053]: pgmap v3659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:23 smithi063 ceph-mon[36747]: pgmap v3659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:25 smithi043 ceph-mon[32384]: pgmap v3660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:25 smithi133 ceph-mon[37053]: pgmap v3660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:25 smithi063 ceph-mon[36747]: pgmap v3660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5851.840171 secs 2024-07-26T10:13:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5867.323464 secs 2024-07-26T10:13:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5851.840171 secs 2024-07-26T10:13:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5867.323464 secs 2024-07-26T10:13:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5851.840171 secs 2024-07-26T10:13:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5867.323464 secs 2024-07-26T10:13:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:27 smithi133 ceph-mon[37053]: pgmap v3661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:27 smithi063 ceph-mon[36747]: pgmap v3661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:27 smithi043 ceph-mon[32384]: pgmap v3661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:29 smithi133 ceph-mon[37053]: pgmap v3662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:29 smithi063 ceph-mon[36747]: pgmap v3662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:29 smithi043 ceph-mon[32384]: pgmap v3662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:31 smithi133 ceph-mon[37053]: pgmap v3663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5856.840243 secs 2024-07-26T10:13:32.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5872.323575 secs 2024-07-26T10:13:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:31 smithi063 ceph-mon[36747]: pgmap v3663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5856.840243 secs 2024-07-26T10:13:32.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5872.323575 secs 2024-07-26T10:13:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:31 smithi043 ceph-mon[32384]: pgmap v3663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5856.840243 secs 2024-07-26T10:13:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5872.323575 secs 2024-07-26T10:13:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:33 smithi133 ceph-mon[37053]: pgmap v3664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:33 smithi063 ceph-mon[36747]: pgmap v3664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:33 smithi043 ceph-mon[32384]: pgmap v3664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:35 smithi133 ceph-mon[37053]: pgmap v3665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:36.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:35 smithi043 ceph-mon[32384]: pgmap v3665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:35 smithi063 ceph-mon[36747]: pgmap v3665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5861.840300 secs 2024-07-26T10:13:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5877.323698 secs 2024-07-26T10:13:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5861.840300 secs 2024-07-26T10:13:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5877.323698 secs 2024-07-26T10:13:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5861.840300 secs 2024-07-26T10:13:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5877.323698 secs 2024-07-26T10:13:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:37 smithi063 ceph-mon[36747]: pgmap v3666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:38.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:37 smithi043 ceph-mon[32384]: pgmap v3666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:37 smithi133 ceph-mon[37053]: pgmap v3666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:39 smithi063 ceph-mon[36747]: pgmap v3667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:39 smithi043 ceph-mon[32384]: pgmap v3667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:39 smithi133 ceph-mon[37053]: pgmap v3667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:41 smithi063 ceph-mon[36747]: pgmap v3668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5866.840386 secs 2024-07-26T10:13:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5882.323818 secs 2024-07-26T10:13:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:41 smithi043 ceph-mon[32384]: pgmap v3668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5866.840386 secs 2024-07-26T10:13:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5882.323818 secs 2024-07-26T10:13:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:41 smithi133 ceph-mon[37053]: pgmap v3668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5866.840386 secs 2024-07-26T10:13:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5882.323818 secs 2024-07-26T10:13:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:42 smithi043 ceph-mon[32384]: pgmap v3669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:42 smithi133 ceph-mon[37053]: pgmap v3669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:42 smithi063 ceph-mon[36747]: pgmap v3669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:45 smithi063 ceph-mon[36747]: pgmap v3670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:45 smithi043 ceph-mon[32384]: pgmap v3670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:45 smithi133 ceph-mon[37053]: pgmap v3670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5871.840484 secs 2024-07-26T10:13:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5871.840484 secs 2024-07-26T10:13:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5871.840484 secs 2024-07-26T10:13:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5887.323956 secs 2024-07-26T10:13:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:47 smithi063 ceph-mon[36747]: pgmap v3671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5887.323956 secs 2024-07-26T10:13:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:47 smithi043 ceph-mon[32384]: pgmap v3671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5887.323956 secs 2024-07-26T10:13:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:47 smithi133 ceph-mon[37053]: pgmap v3671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:49 smithi063 ceph-mon[36747]: pgmap v3672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:49 smithi043 ceph-mon[32384]: pgmap v3672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:49 smithi133 ceph-mon[37053]: pgmap v3672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:13:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:51 smithi063 ceph-mon[36747]: pgmap v3673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5876.840570 secs 2024-07-26T10:13:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:51 smithi043 ceph-mon[32384]: pgmap v3673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5876.840570 secs 2024-07-26T10:13:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:51 smithi133 ceph-mon[37053]: pgmap v3673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:13:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5876.840570 secs 2024-07-26T10:13:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5892.324051 secs 2024-07-26T10:13:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5892.324051 secs 2024-07-26T10:13:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5892.324051 secs 2024-07-26T10:13:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:53 smithi063 ceph-mon[36747]: pgmap v3674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:53 smithi043 ceph-mon[32384]: pgmap v3674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:53 smithi133 ceph-mon[37053]: pgmap v3674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:13:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:55 smithi063 ceph-mon[36747]: pgmap v3675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:13:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:55 smithi043 ceph-mon[32384]: pgmap v3675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:13:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:55 smithi133 ceph-mon[37053]: pgmap v3675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:13:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5881.840683 secs 2024-07-26T10:13:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5881.840683 secs 2024-07-26T10:13:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5881.840683 secs 2024-07-26T10:13:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5897.324173 secs 2024-07-26T10:13:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:57 smithi043 ceph-mon[32384]: pgmap v3676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:13:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5897.324173 secs 2024-07-26T10:13:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:57 smithi133 ceph-mon[37053]: pgmap v3676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:13:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5897.324173 secs 2024-07-26T10:13:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:57 smithi063 ceph-mon[36747]: pgmap v3676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:13:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:59 smithi043 ceph-mon[32384]: pgmap v3677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:13:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:13:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:13:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:59 smithi133 ceph-mon[37053]: pgmap v3677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:13:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:13:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:13:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:59 smithi063 ceph-mon[36747]: pgmap v3677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:13:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:13:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:14:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:14:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:14:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:00 smithi043 ceph-mon[32384]: pgmap v3678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:00 smithi043 ceph-mon[32384]: pgmap v3679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:14:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:14:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:14:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:00 smithi133 ceph-mon[37053]: pgmap v3678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:00 smithi133 ceph-mon[37053]: pgmap v3679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:00.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:14:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:14:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:14:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:00 smithi063 ceph-mon[36747]: pgmap v3678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:00 smithi063 ceph-mon[36747]: pgmap v3679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:14:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5886.840810 secs 2024-07-26T10:14:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5886.840810 secs 2024-07-26T10:14:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5886.840810 secs 2024-07-26T10:14:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5902.324271 secs 2024-07-26T10:14:02.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:02 smithi043 ceph-mon[32384]: pgmap v3680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5902.324271 secs 2024-07-26T10:14:02.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:02 smithi133 ceph-mon[37053]: pgmap v3680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5902.324271 secs 2024-07-26T10:14:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:02 smithi063 ceph-mon[36747]: pgmap v3680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:04 smithi133 ceph-mon[37053]: pgmap v3681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:14:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:04 smithi063 ceph-mon[36747]: pgmap v3681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:14:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:04 smithi043 ceph-mon[32384]: pgmap v3681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:14:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5891.840910 secs 2024-07-26T10:14:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:06 smithi133 ceph-mon[37053]: pgmap v3682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:14:06.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5891.840910 secs 2024-07-26T10:14:06.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:06 smithi043 ceph-mon[32384]: pgmap v3682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:14:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5891.840910 secs 2024-07-26T10:14:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:06 smithi063 ceph-mon[36747]: pgmap v3682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:14:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5907.324369 secs 2024-07-26T10:14:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5907.324369 secs 2024-07-26T10:14:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5907.324369 secs 2024-07-26T10:14:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:08 smithi063 ceph-mon[36747]: pgmap v3683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:14:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:08 smithi043 ceph-mon[32384]: pgmap v3683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:14:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:08 smithi133 ceph-mon[37053]: pgmap v3683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:14:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:10 smithi063 ceph-mon[36747]: pgmap v3684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:14:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:10 smithi043 ceph-mon[32384]: pgmap v3684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:14:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:10 smithi133 ceph-mon[37053]: pgmap v3684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:14:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5896.841035 secs 2024-07-26T10:14:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5896.841035 secs 2024-07-26T10:14:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5896.841035 secs 2024-07-26T10:14:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5912.324490 secs 2024-07-26T10:14:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:12 smithi063 ceph-mon[36747]: pgmap v3685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5912.324490 secs 2024-07-26T10:14:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:12 smithi043 ceph-mon[32384]: pgmap v3685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5912.324490 secs 2024-07-26T10:14:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:12 smithi133 ceph-mon[37053]: pgmap v3685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:14 smithi063 ceph-mon[36747]: pgmap v3686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:14 smithi043 ceph-mon[32384]: pgmap v3686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:14 smithi133 ceph-mon[37053]: pgmap v3686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5901.841160 secs 2024-07-26T10:14:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:16 smithi063 ceph-mon[36747]: pgmap v3687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:16.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5901.841160 secs 2024-07-26T10:14:16.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:16 smithi133 ceph-mon[37053]: pgmap v3687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5901.841160 secs 2024-07-26T10:14:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:16 smithi043 ceph-mon[32384]: pgmap v3687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5917.324613 secs 2024-07-26T10:14:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5917.324613 secs 2024-07-26T10:14:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5917.324613 secs 2024-07-26T10:14:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:18 smithi043 ceph-mon[32384]: pgmap v3688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:18 smithi133 ceph-mon[37053]: pgmap v3688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:18 smithi063 ceph-mon[36747]: pgmap v3688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:20 smithi043 ceph-mon[32384]: pgmap v3689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:20 smithi133 ceph-mon[37053]: pgmap v3689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:20 smithi063 ceph-mon[36747]: pgmap v3689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5906.841290 secs 2024-07-26T10:14:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5906.841290 secs 2024-07-26T10:14:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5906.841290 secs 2024-07-26T10:14:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5922.324762 secs 2024-07-26T10:14:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:22 smithi043 ceph-mon[32384]: pgmap v3690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5922.324762 secs 2024-07-26T10:14:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:22 smithi133 ceph-mon[37053]: pgmap v3690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5922.324762 secs 2024-07-26T10:14:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:22 smithi063 ceph-mon[36747]: pgmap v3690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:24 smithi043 ceph-mon[32384]: pgmap v3691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:24 smithi133 ceph-mon[37053]: pgmap v3691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:24 smithi063 ceph-mon[36747]: pgmap v3691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5911.841364 secs 2024-07-26T10:14:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:26 smithi043 ceph-mon[32384]: pgmap v3692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5911.841364 secs 2024-07-26T10:14:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:26 smithi133 ceph-mon[37053]: pgmap v3692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5911.841364 secs 2024-07-26T10:14:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:26 smithi063 ceph-mon[36747]: pgmap v3692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:27.366 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5927.324904 secs 2024-07-26T10:14:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5927.324904 secs 2024-07-26T10:14:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5927.324904 secs 2024-07-26T10:14:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:28 smithi043 ceph-mon[32384]: pgmap v3693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:28 smithi133 ceph-mon[37053]: pgmap v3693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:28 smithi063 ceph-mon[36747]: pgmap v3693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:30 smithi043 ceph-mon[32384]: pgmap v3694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:30 smithi133 ceph-mon[37053]: pgmap v3694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:30 smithi063 ceph-mon[36747]: pgmap v3694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5916.841492 secs 2024-07-26T10:14:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5916.841492 secs 2024-07-26T10:14:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5916.841492 secs 2024-07-26T10:14:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5932.324969 secs 2024-07-26T10:14:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:32 smithi043 ceph-mon[32384]: pgmap v3695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5932.324969 secs 2024-07-26T10:14:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:32 smithi133 ceph-mon[37053]: pgmap v3695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5932.324969 secs 2024-07-26T10:14:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:32 smithi063 ceph-mon[36747]: pgmap v3695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:34 smithi043 ceph-mon[32384]: pgmap v3696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:34 smithi133 ceph-mon[37053]: pgmap v3696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:34 smithi063 ceph-mon[36747]: pgmap v3696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5921.841622 secs 2024-07-26T10:14:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:36 smithi043 ceph-mon[32384]: pgmap v3697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5937.325037 secs 2024-07-26T10:14:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5921.841622 secs 2024-07-26T10:14:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:36 smithi133 ceph-mon[37053]: pgmap v3697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5937.325037 secs 2024-07-26T10:14:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5921.841622 secs 2024-07-26T10:14:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:36 smithi063 ceph-mon[36747]: pgmap v3697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5937.325037 secs 2024-07-26T10:14:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:38 smithi043 ceph-mon[32384]: pgmap v3698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:38 smithi133 ceph-mon[37053]: pgmap v3698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:38 smithi063 ceph-mon[36747]: pgmap v3698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:40 smithi043 ceph-mon[32384]: pgmap v3699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:40 smithi133 ceph-mon[37053]: pgmap v3699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:40 smithi063 ceph-mon[36747]: pgmap v3699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5926.841740 secs 2024-07-26T10:14:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5942.325151 secs 2024-07-26T10:14:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5926.841740 secs 2024-07-26T10:14:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5942.325151 secs 2024-07-26T10:14:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5926.841740 secs 2024-07-26T10:14:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5942.325151 secs 2024-07-26T10:14:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:42 smithi043 ceph-mon[32384]: pgmap v3700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:42 smithi133 ceph-mon[37053]: pgmap v3700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:42 smithi063 ceph-mon[36747]: pgmap v3700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:44 smithi043 ceph-mon[32384]: pgmap v3701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:44 smithi133 ceph-mon[37053]: pgmap v3701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:44 smithi063 ceph-mon[36747]: pgmap v3701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5931.841883 secs 2024-07-26T10:14:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:46 smithi043 ceph-mon[32384]: pgmap v3702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5947.325264 secs 2024-07-26T10:14:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5931.841883 secs 2024-07-26T10:14:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:46 smithi133 ceph-mon[37053]: pgmap v3702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5947.325264 secs 2024-07-26T10:14:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5931.841883 secs 2024-07-26T10:14:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:46 smithi063 ceph-mon[36747]: pgmap v3702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5947.325264 secs 2024-07-26T10:14:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:48 smithi043 ceph-mon[32384]: pgmap v3703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:48 smithi133 ceph-mon[37053]: pgmap v3703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:48 smithi063 ceph-mon[36747]: pgmap v3703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:50 smithi043 ceph-mon[32384]: pgmap v3704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:50 smithi133 ceph-mon[37053]: pgmap v3704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:50 smithi063 ceph-mon[36747]: pgmap v3704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5936.842009 secs 2024-07-26T10:14:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5952.325387 secs 2024-07-26T10:14:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5936.842009 secs 2024-07-26T10:14:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5952.325387 secs 2024-07-26T10:14:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5936.842009 secs 2024-07-26T10:14:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5952.325387 secs 2024-07-26T10:14:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:52 smithi043 ceph-mon[32384]: pgmap v3705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:52 smithi133 ceph-mon[37053]: pgmap v3705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:52 smithi063 ceph-mon[36747]: pgmap v3705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:14:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:54 smithi043 ceph-mon[32384]: pgmap v3706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:54 smithi133 ceph-mon[37053]: pgmap v3706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:54 smithi063 ceph-mon[36747]: pgmap v3706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5941.842153 secs 2024-07-26T10:14:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:56 smithi043 ceph-mon[32384]: pgmap v3707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5957.325527 secs 2024-07-26T10:14:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5941.842153 secs 2024-07-26T10:14:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:56 smithi133 ceph-mon[37053]: pgmap v3707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5957.325527 secs 2024-07-26T10:14:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5941.842153 secs 2024-07-26T10:14:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:56 smithi063 ceph-mon[36747]: pgmap v3707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:14:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5957.325527 secs 2024-07-26T10:14:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:58 smithi043 ceph-mon[32384]: pgmap v3708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:58 smithi133 ceph-mon[37053]: pgmap v3708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:58 smithi063 ceph-mon[36747]: pgmap v3708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:14:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:14:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:14:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:14:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:14:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:14:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:15:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:00 smithi133 ceph-mon[37053]: pgmap v3709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:00 smithi063 ceph-mon[36747]: pgmap v3709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:00 smithi043 ceph-mon[32384]: pgmap v3709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5946.842272 secs 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: pgmap v3710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: pgmap v3711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:15:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5962.325676 secs 2024-07-26T10:15:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5946.842272 secs 2024-07-26T10:15:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:15:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:15:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: pgmap v3710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:15:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: pgmap v3711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:15:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5962.325676 secs 2024-07-26T10:15:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5946.842272 secs 2024-07-26T10:15:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:15:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:15:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: pgmap v3710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:15:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: pgmap v3711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:15:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5962.325676 secs 2024-07-26T10:15:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:03 smithi063 ceph-mon[36747]: pgmap v3712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:15:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:03 smithi043 ceph-mon[32384]: pgmap v3712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:15:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:03 smithi133 ceph-mon[37053]: pgmap v3712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:15:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:05 smithi043 ceph-mon[32384]: pgmap v3713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:05 smithi133 ceph-mon[37053]: pgmap v3713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:05 smithi063 ceph-mon[36747]: pgmap v3713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:06.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5951.842389 secs 2024-07-26T10:15:06.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5967.325783 secs 2024-07-26T10:15:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5951.842389 secs 2024-07-26T10:15:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5967.325783 secs 2024-07-26T10:15:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5951.842389 secs 2024-07-26T10:15:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5967.325783 secs 2024-07-26T10:15:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:07 smithi043 ceph-mon[32384]: pgmap v3714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:15:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:07 smithi133 ceph-mon[37053]: pgmap v3714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:15:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:07 smithi063 ceph-mon[36747]: pgmap v3714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:15:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:09 smithi043 ceph-mon[32384]: pgmap v3715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:09 smithi133 ceph-mon[37053]: pgmap v3715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:09 smithi063 ceph-mon[36747]: pgmap v3715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:15:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5956.842534 secs 2024-07-26T10:15:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:11 smithi043 ceph-mon[32384]: pgmap v3716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:15:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5972.325900 secs 2024-07-26T10:15:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5956.842534 secs 2024-07-26T10:15:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:11 smithi133 ceph-mon[37053]: pgmap v3716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:15:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5972.325900 secs 2024-07-26T10:15:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5956.842534 secs 2024-07-26T10:15:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:11 smithi063 ceph-mon[36747]: pgmap v3716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:15:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5972.325900 secs 2024-07-26T10:15:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:13 smithi043 ceph-mon[32384]: pgmap v3717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:13 smithi133 ceph-mon[37053]: pgmap v3717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:13 smithi063 ceph-mon[36747]: pgmap v3717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:15 smithi133 ceph-mon[37053]: pgmap v3718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:15 smithi063 ceph-mon[36747]: pgmap v3718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:15 smithi043 ceph-mon[32384]: pgmap v3718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5961.842664 secs 2024-07-26T10:15:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5977.326019 secs 2024-07-26T10:15:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5961.842664 secs 2024-07-26T10:15:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5977.326019 secs 2024-07-26T10:15:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5961.842664 secs 2024-07-26T10:15:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5977.326019 secs 2024-07-26T10:15:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:17 smithi133 ceph-mon[37053]: pgmap v3719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:17 smithi063 ceph-mon[36747]: pgmap v3719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:17 smithi043 ceph-mon[32384]: pgmap v3719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:19 smithi063 ceph-mon[36747]: pgmap v3720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:19 smithi043 ceph-mon[32384]: pgmap v3720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:19 smithi133 ceph-mon[37053]: pgmap v3720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5966.842791 secs 2024-07-26T10:15:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:21 smithi063 ceph-mon[36747]: pgmap v3721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5982.326141 secs 2024-07-26T10:15:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5966.842791 secs 2024-07-26T10:15:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:21 smithi043 ceph-mon[32384]: pgmap v3721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5982.326141 secs 2024-07-26T10:15:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5966.842791 secs 2024-07-26T10:15:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:21 smithi133 ceph-mon[37053]: pgmap v3721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5982.326141 secs 2024-07-26T10:15:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:23 smithi063 ceph-mon[36747]: pgmap v3722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:23 smithi043 ceph-mon[32384]: pgmap v3722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:23 smithi133 ceph-mon[37053]: pgmap v3722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:25 smithi063 ceph-mon[36747]: pgmap v3723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:25 smithi043 ceph-mon[32384]: pgmap v3723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:25 smithi133 ceph-mon[37053]: pgmap v3723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5971.842933 secs 2024-07-26T10:15:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5987.326223 secs 2024-07-26T10:15:27.228 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5971.842933 secs 2024-07-26T10:15:27.228 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5987.326223 secs 2024-07-26T10:15:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5971.842933 secs 2024-07-26T10:15:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5987.326223 secs 2024-07-26T10:15:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:27 smithi063 ceph-mon[36747]: pgmap v3724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:27 smithi043 ceph-mon[32384]: pgmap v3724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:27 smithi133 ceph-mon[37053]: pgmap v3724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:29 smithi063 ceph-mon[36747]: pgmap v3725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:29 smithi043 ceph-mon[32384]: pgmap v3725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:29 smithi133 ceph-mon[37053]: pgmap v3725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5976.843053 secs 2024-07-26T10:15:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:31 smithi063 ceph-mon[36747]: pgmap v3726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5992.326346 secs 2024-07-26T10:15:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5976.843053 secs 2024-07-26T10:15:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:31 smithi043 ceph-mon[32384]: pgmap v3726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5992.326346 secs 2024-07-26T10:15:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5976.843053 secs 2024-07-26T10:15:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:31 smithi133 ceph-mon[37053]: pgmap v3726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5992.326346 secs 2024-07-26T10:15:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:32 smithi043 ceph-mon[32384]: pgmap v3727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:32 smithi133 ceph-mon[37053]: pgmap v3727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:32 smithi063 ceph-mon[36747]: pgmap v3727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:35 smithi043 ceph-mon[32384]: pgmap v3728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:35 smithi133 ceph-mon[37053]: pgmap v3728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:35 smithi063 ceph-mon[36747]: pgmap v3728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:36.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5981.843202 secs 2024-07-26T10:15:36.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 5997.326411 secs 2024-07-26T10:15:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5981.843202 secs 2024-07-26T10:15:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 5997.326411 secs 2024-07-26T10:15:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5981.843202 secs 2024-07-26T10:15:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 5997.326411 secs 2024-07-26T10:15:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:37 smithi043 ceph-mon[32384]: pgmap v3729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:37 smithi133 ceph-mon[37053]: pgmap v3729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:37 smithi063 ceph-mon[36747]: pgmap v3729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:39 smithi043 ceph-mon[32384]: pgmap v3730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:39 smithi133 ceph-mon[37053]: pgmap v3730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:39 smithi063 ceph-mon[36747]: pgmap v3730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5986.843320 secs 2024-07-26T10:15:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:41 smithi043 ceph-mon[32384]: pgmap v3731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6002.326533 secs 2024-07-26T10:15:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5986.843320 secs 2024-07-26T10:15:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:41 smithi133 ceph-mon[37053]: pgmap v3731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6002.326533 secs 2024-07-26T10:15:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5986.843320 secs 2024-07-26T10:15:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:41 smithi063 ceph-mon[36747]: pgmap v3731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6002.326533 secs 2024-07-26T10:15:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:43 smithi043 ceph-mon[32384]: pgmap v3732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:43 smithi133 ceph-mon[37053]: pgmap v3732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:43 smithi063 ceph-mon[36747]: pgmap v3732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:45 smithi043 ceph-mon[32384]: pgmap v3733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:45 smithi133 ceph-mon[37053]: pgmap v3733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:45 smithi063 ceph-mon[36747]: pgmap v3733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:46.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5991.843384 secs 2024-07-26T10:15:46.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6007.326667 secs 2024-07-26T10:15:46.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5991.843384 secs 2024-07-26T10:15:46.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6007.326667 secs 2024-07-26T10:15:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5991.843384 secs 2024-07-26T10:15:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6007.326667 secs 2024-07-26T10:15:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:47 smithi043 ceph-mon[32384]: pgmap v3734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:47 smithi133 ceph-mon[37053]: pgmap v3734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:47 smithi063 ceph-mon[36747]: pgmap v3734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:49 smithi043 ceph-mon[32384]: pgmap v3735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:49 smithi133 ceph-mon[37053]: pgmap v3735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:49 smithi063 ceph-mon[36747]: pgmap v3735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 5996.843512 secs 2024-07-26T10:15:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:51 smithi043 ceph-mon[32384]: pgmap v3736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6012.326746 secs 2024-07-26T10:15:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 5996.843512 secs 2024-07-26T10:15:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:51 smithi133 ceph-mon[37053]: pgmap v3736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6012.326746 secs 2024-07-26T10:15:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 5996.843512 secs 2024-07-26T10:15:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:51 smithi063 ceph-mon[36747]: pgmap v3736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6012.326746 secs 2024-07-26T10:15:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:53 smithi043 ceph-mon[32384]: pgmap v3737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:53 smithi133 ceph-mon[37053]: pgmap v3737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:53 smithi063 ceph-mon[36747]: pgmap v3737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:15:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:55 smithi043 ceph-mon[32384]: pgmap v3738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:55 smithi133 ceph-mon[37053]: pgmap v3738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:55 smithi063 ceph-mon[36747]: pgmap v3738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:15:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6001.843572 secs 2024-07-26T10:15:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6017.326895 secs 2024-07-26T10:15:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6001.843572 secs 2024-07-26T10:15:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6017.326895 secs 2024-07-26T10:15:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6001.843572 secs 2024-07-26T10:15:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6017.326895 secs 2024-07-26T10:15:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:57 smithi043 ceph-mon[32384]: pgmap v3739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:57 smithi133 ceph-mon[37053]: pgmap v3739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:57 smithi063 ceph-mon[36747]: pgmap v3739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:15:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:15:59 smithi043 ceph-mon[32384]: pgmap v3740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:15:59 smithi133 ceph-mon[37053]: pgmap v3740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:15:59 smithi063 ceph-mon[36747]: pgmap v3740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6006.843703 secs 2024-07-26T10:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:01 smithi133 ceph-mon[37053]: pgmap v3741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6022.327016 secs 2024-07-26T10:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:16:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6006.843703 secs 2024-07-26T10:16:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:01 smithi043 ceph-mon[32384]: pgmap v3741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6022.327016 secs 2024-07-26T10:16:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:16:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6006.843703 secs 2024-07-26T10:16:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:01 smithi063 ceph-mon[36747]: pgmap v3741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6022.327016 secs 2024-07-26T10:16:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:16:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:16:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:16:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:02 smithi043 ceph-mon[32384]: pgmap v3742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:16:02.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:02 smithi043 ceph-mon[32384]: pgmap v3743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:16:02.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:16:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:16:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:16:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:02 smithi133 ceph-mon[37053]: pgmap v3742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:16:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:02 smithi133 ceph-mon[37053]: pgmap v3743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:16:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:16:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:16:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:16:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:02 smithi063 ceph-mon[36747]: pgmap v3742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:16:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:02 smithi063 ceph-mon[36747]: pgmap v3743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:16:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:16:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:03 smithi043 ceph-mon[32384]: pgmap v3744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:16:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:03 smithi133 ceph-mon[37053]: pgmap v3744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:16:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:03 smithi063 ceph-mon[36747]: pgmap v3744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:16:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:05 smithi043 ceph-mon[32384]: pgmap v3745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:16:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:05 smithi133 ceph-mon[37053]: pgmap v3745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:16:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:05 smithi063 ceph-mon[36747]: pgmap v3745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:16:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6011.843841 secs 2024-07-26T10:16:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6027.327136 secs 2024-07-26T10:16:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6011.843841 secs 2024-07-26T10:16:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6027.327136 secs 2024-07-26T10:16:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6011.843841 secs 2024-07-26T10:16:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6027.327136 secs 2024-07-26T10:16:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:07 smithi043 ceph-mon[32384]: pgmap v3746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:16:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:07 smithi133 ceph-mon[37053]: pgmap v3746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:16:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:07 smithi063 ceph-mon[36747]: pgmap v3746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:16:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:09 smithi043 ceph-mon[32384]: pgmap v3747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:16:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:09 smithi133 ceph-mon[37053]: pgmap v3747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:16:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:09 smithi063 ceph-mon[36747]: pgmap v3747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:16:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6016.843960 secs 2024-07-26T10:16:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6016.843960 secs 2024-07-26T10:16:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6016.843960 secs 2024-07-26T10:16:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6032.327261 secs 2024-07-26T10:16:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:12 smithi043 ceph-mon[32384]: pgmap v3748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:16:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6032.327261 secs 2024-07-26T10:16:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:12 smithi133 ceph-mon[37053]: pgmap v3748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:16:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6032.327261 secs 2024-07-26T10:16:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:12 smithi063 ceph-mon[36747]: pgmap v3748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:16:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:13 smithi043 ceph-mon[32384]: pgmap v3749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:13 smithi133 ceph-mon[37053]: pgmap v3749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:13 smithi063 ceph-mon[36747]: pgmap v3749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:16.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:15 smithi063 ceph-mon[36747]: pgmap v3750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:15 smithi043 ceph-mon[32384]: pgmap v3750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:15 smithi133 ceph-mon[37053]: pgmap v3750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6021.844076 secs 2024-07-26T10:16:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6037.327359 secs 2024-07-26T10:16:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6021.844076 secs 2024-07-26T10:16:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6037.327359 secs 2024-07-26T10:16:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6021.844076 secs 2024-07-26T10:16:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6037.327359 secs 2024-07-26T10:16:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:17 smithi043 ceph-mon[32384]: pgmap v3751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:17 smithi133 ceph-mon[37053]: pgmap v3751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:17 smithi063 ceph-mon[36747]: pgmap v3751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:19 smithi043 ceph-mon[32384]: pgmap v3752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:19 smithi133 ceph-mon[37053]: pgmap v3752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:19 smithi063 ceph-mon[36747]: pgmap v3752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6026.844175 secs 2024-07-26T10:16:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6026.844175 secs 2024-07-26T10:16:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6026.844175 secs 2024-07-26T10:16:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6042.327487 secs 2024-07-26T10:16:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:22 smithi043 ceph-mon[32384]: pgmap v3753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6042.327487 secs 2024-07-26T10:16:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:22 smithi133 ceph-mon[37053]: pgmap v3753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6042.327487 secs 2024-07-26T10:16:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:22 smithi063 ceph-mon[36747]: pgmap v3753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:23 smithi043 ceph-mon[32384]: pgmap v3754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:23 smithi133 ceph-mon[37053]: pgmap v3754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:23 smithi063 ceph-mon[36747]: pgmap v3754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:25 smithi043 ceph-mon[32384]: pgmap v3755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:25 smithi133 ceph-mon[37053]: pgmap v3755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:25 smithi063 ceph-mon[36747]: pgmap v3755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6031.844311 secs 2024-07-26T10:16:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6047.327636 secs 2024-07-26T10:16:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6031.844311 secs 2024-07-26T10:16:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6047.327636 secs 2024-07-26T10:16:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6031.844311 secs 2024-07-26T10:16:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6047.327636 secs 2024-07-26T10:16:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:27 smithi043 ceph-mon[32384]: pgmap v3756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:27 smithi133 ceph-mon[37053]: pgmap v3756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:27 smithi063 ceph-mon[36747]: pgmap v3756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:30.204 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:29 smithi043 ceph-mon[32384]: pgmap v3757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:29 smithi133 ceph-mon[37053]: pgmap v3757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:29 smithi063 ceph-mon[36747]: pgmap v3757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6036.844467 secs 2024-07-26T10:16:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6036.844467 secs 2024-07-26T10:16:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6036.844467 secs 2024-07-26T10:16:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6052.327771 secs 2024-07-26T10:16:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:32 smithi043 ceph-mon[32384]: pgmap v3758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6052.327771 secs 2024-07-26T10:16:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:32 smithi133 ceph-mon[37053]: pgmap v3758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6052.327771 secs 2024-07-26T10:16:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:32 smithi063 ceph-mon[36747]: pgmap v3758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:33 smithi043 ceph-mon[32384]: pgmap v3759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:33 smithi133 ceph-mon[37053]: pgmap v3759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:33 smithi063 ceph-mon[36747]: pgmap v3759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:35 smithi043 ceph-mon[32384]: pgmap v3760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:35 smithi133 ceph-mon[37053]: pgmap v3760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:35 smithi063 ceph-mon[36747]: pgmap v3760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6041.844599 secs 2024-07-26T10:16:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6057.327873 secs 2024-07-26T10:16:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6041.844599 secs 2024-07-26T10:16:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6057.327873 secs 2024-07-26T10:16:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6041.844599 secs 2024-07-26T10:16:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6057.327873 secs 2024-07-26T10:16:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:37 smithi043 ceph-mon[32384]: pgmap v3761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:37 smithi133 ceph-mon[37053]: pgmap v3761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:37 smithi063 ceph-mon[36747]: pgmap v3761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:39 smithi043 ceph-mon[32384]: pgmap v3762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:39 smithi133 ceph-mon[37053]: pgmap v3762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:39 smithi063 ceph-mon[36747]: pgmap v3762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6046.844682 secs 2024-07-26T10:16:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6046.844682 secs 2024-07-26T10:16:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6046.844682 secs 2024-07-26T10:16:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6062.328017 secs 2024-07-26T10:16:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:42 smithi043 ceph-mon[32384]: pgmap v3763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6062.328017 secs 2024-07-26T10:16:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:42 smithi133 ceph-mon[37053]: pgmap v3763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6062.328017 secs 2024-07-26T10:16:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:42 smithi063 ceph-mon[36747]: pgmap v3763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:43 smithi043 ceph-mon[32384]: pgmap v3764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:43 smithi133 ceph-mon[37053]: pgmap v3764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:43 smithi063 ceph-mon[36747]: pgmap v3764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:45 smithi043 ceph-mon[32384]: pgmap v3765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:45 smithi133 ceph-mon[37053]: pgmap v3765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:45 smithi063 ceph-mon[36747]: pgmap v3765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6051.844822 secs 2024-07-26T10:16:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6067.328137 secs 2024-07-26T10:16:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6051.844822 secs 2024-07-26T10:16:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6067.328137 secs 2024-07-26T10:16:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6051.844822 secs 2024-07-26T10:16:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6067.328137 secs 2024-07-26T10:16:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:47 smithi043 ceph-mon[32384]: pgmap v3766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:47 smithi133 ceph-mon[37053]: pgmap v3766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:47 smithi063 ceph-mon[36747]: pgmap v3766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:49 smithi043 ceph-mon[32384]: pgmap v3767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:49 smithi133 ceph-mon[37053]: pgmap v3767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:49 smithi063 ceph-mon[36747]: pgmap v3767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:16:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6056.844938 secs 2024-07-26T10:16:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6056.844938 secs 2024-07-26T10:16:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6056.844938 secs 2024-07-26T10:16:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6072.328257 secs 2024-07-26T10:16:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:52 smithi043 ceph-mon[32384]: pgmap v3768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6072.328257 secs 2024-07-26T10:16:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:52 smithi133 ceph-mon[37053]: pgmap v3768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6072.328257 secs 2024-07-26T10:16:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:52 smithi063 ceph-mon[36747]: pgmap v3768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:53 smithi043 ceph-mon[32384]: pgmap v3769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:53 smithi133 ceph-mon[37053]: pgmap v3769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:53 smithi063 ceph-mon[36747]: pgmap v3769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:55 smithi043 ceph-mon[32384]: pgmap v3770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:55 smithi133 ceph-mon[37053]: pgmap v3770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:55 smithi063 ceph-mon[36747]: pgmap v3770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:16:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6061.845074 secs 2024-07-26T10:16:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6077.328377 secs 2024-07-26T10:16:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6061.845074 secs 2024-07-26T10:16:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6077.328377 secs 2024-07-26T10:16:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6061.845074 secs 2024-07-26T10:16:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6077.328377 secs 2024-07-26T10:16:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:57 smithi043 ceph-mon[32384]: pgmap v3771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:57 smithi133 ceph-mon[37053]: pgmap v3771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:16:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:57 smithi063 ceph-mon[36747]: pgmap v3771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:16:59 smithi043 ceph-mon[32384]: pgmap v3772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:16:59 smithi133 ceph-mon[37053]: pgmap v3772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:16:59 smithi063 ceph-mon[36747]: pgmap v3772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6066.845180 secs 2024-07-26T10:17:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6066.845180 secs 2024-07-26T10:17:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6066.845180 secs 2024-07-26T10:17:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6082.328490 secs 2024-07-26T10:17:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:02 smithi043 ceph-mon[32384]: pgmap v3773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:17:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:17:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6082.328490 secs 2024-07-26T10:17:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:02 smithi133 ceph-mon[37053]: pgmap v3773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:17:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:17:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6082.328490 secs 2024-07-26T10:17:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:02 smithi063 ceph-mon[36747]: pgmap v3773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:17:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:17:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:17:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:17:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:17:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:17:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:17:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:17:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:17:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:17:03.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:17:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:04 smithi043 ceph-mon[32384]: pgmap v3774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:04 smithi043 ceph-mon[32384]: pgmap v3775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:04 smithi133 ceph-mon[37053]: pgmap v3774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:04 smithi133 ceph-mon[37053]: pgmap v3775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:04 smithi063 ceph-mon[36747]: pgmap v3774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:04 smithi063 ceph-mon[36747]: pgmap v3775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:06 smithi043 ceph-mon[32384]: pgmap v3776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:17:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6071.845249 secs 2024-07-26T10:17:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:06 smithi133 ceph-mon[37053]: pgmap v3776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:17:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6071.845249 secs 2024-07-26T10:17:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:06 smithi063 ceph-mon[36747]: pgmap v3776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:17:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6071.845249 secs 2024-07-26T10:17:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6087.328604 secs 2024-07-26T10:17:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6087.328604 secs 2024-07-26T10:17:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6087.328604 secs 2024-07-26T10:17:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:08 smithi063 ceph-mon[36747]: pgmap v3777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:17:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:08 smithi043 ceph-mon[32384]: pgmap v3777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:17:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:08 smithi133 ceph-mon[37053]: pgmap v3777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:17:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:10 smithi063 ceph-mon[36747]: pgmap v3778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:10 smithi043 ceph-mon[32384]: pgmap v3778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:10 smithi133 ceph-mon[37053]: pgmap v3778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6076.845372 secs 2024-07-26T10:17:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6092.328741 secs 2024-07-26T10:17:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6076.845372 secs 2024-07-26T10:17:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6092.328741 secs 2024-07-26T10:17:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6076.845372 secs 2024-07-26T10:17:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6092.328741 secs 2024-07-26T10:17:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:12 smithi063 ceph-mon[36747]: pgmap v3779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:17:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:12 smithi043 ceph-mon[32384]: pgmap v3779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:17:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:12 smithi133 ceph-mon[37053]: pgmap v3779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:17:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:14 smithi063 ceph-mon[36747]: pgmap v3780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:17:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:14 smithi043 ceph-mon[32384]: pgmap v3780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:17:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:14 smithi133 ceph-mon[37053]: pgmap v3780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:17:17.068 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:16 smithi133 ceph-mon[37053]: pgmap v3781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:17.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6081.845491 secs 2024-07-26T10:17:17.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6097.328879 secs 2024-07-26T10:17:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:16 smithi063 ceph-mon[36747]: pgmap v3781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6081.845491 secs 2024-07-26T10:17:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6097.328879 secs 2024-07-26T10:17:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:16 smithi043 ceph-mon[32384]: pgmap v3781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6081.845491 secs 2024-07-26T10:17:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6097.328879 secs 2024-07-26T10:17:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:18 smithi063 ceph-mon[36747]: pgmap v3782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:18 smithi043 ceph-mon[32384]: pgmap v3782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:18 smithi133 ceph-mon[37053]: pgmap v3782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:20 smithi063 ceph-mon[36747]: pgmap v3783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:20 smithi043 ceph-mon[32384]: pgmap v3783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:20 smithi133 ceph-mon[37053]: pgmap v3783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6086.845635 secs 2024-07-26T10:17:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6102.328972 secs 2024-07-26T10:17:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6086.845635 secs 2024-07-26T10:17:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6102.328972 secs 2024-07-26T10:17:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6086.845635 secs 2024-07-26T10:17:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6102.328972 secs 2024-07-26T10:17:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:22 smithi043 ceph-mon[32384]: pgmap v3784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:22 smithi133 ceph-mon[37053]: pgmap v3784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:22 smithi063 ceph-mon[36747]: pgmap v3784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:24 smithi043 ceph-mon[32384]: pgmap v3785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:24 smithi133 ceph-mon[37053]: pgmap v3785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:24 smithi063 ceph-mon[36747]: pgmap v3785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:25 smithi043 ceph-mon[32384]: pgmap v3786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:25 smithi133 ceph-mon[37053]: pgmap v3786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:25 smithi063 ceph-mon[36747]: pgmap v3786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6091.845763 secs 2024-07-26T10:17:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6107.329086 secs 2024-07-26T10:17:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6091.845763 secs 2024-07-26T10:17:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6107.329086 secs 2024-07-26T10:17:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6091.845763 secs 2024-07-26T10:17:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6107.329086 secs 2024-07-26T10:17:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:27 smithi043 ceph-mon[32384]: pgmap v3787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:27 smithi133 ceph-mon[37053]: pgmap v3787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:27 smithi063 ceph-mon[36747]: pgmap v3787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:30 smithi043 ceph-mon[32384]: pgmap v3788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:30 smithi133 ceph-mon[37053]: pgmap v3788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:30 smithi063 ceph-mon[36747]: pgmap v3788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6096.845915 secs 2024-07-26T10:17:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6096.845915 secs 2024-07-26T10:17:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6096.845915 secs 2024-07-26T10:17:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6112.329198 secs 2024-07-26T10:17:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:32 smithi043 ceph-mon[32384]: pgmap v3789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6112.329198 secs 2024-07-26T10:17:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:32 smithi133 ceph-mon[37053]: pgmap v3789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6112.329198 secs 2024-07-26T10:17:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:32 smithi063 ceph-mon[36747]: pgmap v3789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:34 smithi063 ceph-mon[36747]: pgmap v3790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:34 smithi043 ceph-mon[32384]: pgmap v3790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:34 smithi133 ceph-mon[37053]: pgmap v3790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:36 smithi063 ceph-mon[36747]: pgmap v3791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6101.846036 secs 2024-07-26T10:17:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6117.329266 secs 2024-07-26T10:17:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:36 smithi043 ceph-mon[32384]: pgmap v3791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6101.846036 secs 2024-07-26T10:17:37.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6117.329266 secs 2024-07-26T10:17:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:36 smithi133 ceph-mon[37053]: pgmap v3791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6101.846036 secs 2024-07-26T10:17:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6117.329266 secs 2024-07-26T10:17:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:38 smithi063 ceph-mon[36747]: pgmap v3792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:38 smithi043 ceph-mon[32384]: pgmap v3792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:38 smithi133 ceph-mon[37053]: pgmap v3792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:40 smithi063 ceph-mon[36747]: pgmap v3793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:40 smithi043 ceph-mon[32384]: pgmap v3793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:40 smithi133 ceph-mon[37053]: pgmap v3793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6106.846161 secs 2024-07-26T10:17:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6122.329391 secs 2024-07-26T10:17:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6106.846161 secs 2024-07-26T10:17:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6122.329391 secs 2024-07-26T10:17:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6106.846161 secs 2024-07-26T10:17:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6122.329391 secs 2024-07-26T10:17:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:42 smithi043 ceph-mon[32384]: pgmap v3794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:42 smithi133 ceph-mon[37053]: pgmap v3794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:42 smithi063 ceph-mon[36747]: pgmap v3794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:44 smithi043 ceph-mon[32384]: pgmap v3795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:44 smithi133 ceph-mon[37053]: pgmap v3795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:44 smithi063 ceph-mon[36747]: pgmap v3795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:47.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:46 smithi063 ceph-mon[36747]: pgmap v3796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:47.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6111.846226 secs 2024-07-26T10:17:47.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6127.329511 secs 2024-07-26T10:17:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:46 smithi043 ceph-mon[32384]: pgmap v3796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6111.846226 secs 2024-07-26T10:17:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6127.329511 secs 2024-07-26T10:17:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:46 smithi133 ceph-mon[37053]: pgmap v3796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6111.846226 secs 2024-07-26T10:17:47.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6127.329511 secs 2024-07-26T10:17:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:48 smithi043 ceph-mon[32384]: pgmap v3797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:48 smithi133 ceph-mon[37053]: pgmap v3797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:48 smithi063 ceph-mon[36747]: pgmap v3797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:49 smithi043 ceph-mon[32384]: pgmap v3798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:49 smithi133 ceph-mon[37053]: pgmap v3798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:49 smithi063 ceph-mon[36747]: pgmap v3798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6116.846352 secs 2024-07-26T10:17:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6116.846352 secs 2024-07-26T10:17:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6116.846352 secs 2024-07-26T10:17:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6132.329641 secs 2024-07-26T10:17:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:52 smithi043 ceph-mon[32384]: pgmap v3799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6132.329641 secs 2024-07-26T10:17:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:52 smithi133 ceph-mon[37053]: pgmap v3799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6132.329641 secs 2024-07-26T10:17:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:52 smithi063 ceph-mon[36747]: pgmap v3799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:54 smithi043 ceph-mon[32384]: pgmap v3800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:54 smithi133 ceph-mon[37053]: pgmap v3800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:54 smithi063 ceph-mon[36747]: pgmap v3800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:17:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:56 smithi043 ceph-mon[32384]: pgmap v3801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6121.846437 secs 2024-07-26T10:17:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:56 smithi133 ceph-mon[37053]: pgmap v3801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6121.846437 secs 2024-07-26T10:17:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:56 smithi063 ceph-mon[36747]: pgmap v3801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:17:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6121.846437 secs 2024-07-26T10:17:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6137.329717 secs 2024-07-26T10:17:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6137.329717 secs 2024-07-26T10:17:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6137.329717 secs 2024-07-26T10:17:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:17:58 smithi043 ceph-mon[32384]: pgmap v3802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:17:58 smithi133 ceph-mon[37053]: pgmap v3802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:17:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:17:58 smithi063 ceph-mon[36747]: pgmap v3802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:00 smithi043 ceph-mon[32384]: pgmap v3803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:00 smithi133 ceph-mon[37053]: pgmap v3803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:00 smithi063 ceph-mon[36747]: pgmap v3803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6126.846560 secs 2024-07-26T10:18:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6126.846560 secs 2024-07-26T10:18:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6126.846560 secs 2024-07-26T10:18:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6142.329830 secs 2024-07-26T10:18:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:02 smithi043 ceph-mon[32384]: pgmap v3804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6142.329830 secs 2024-07-26T10:18:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:02 smithi133 ceph-mon[37053]: pgmap v3804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6142.329830 secs 2024-07-26T10:18:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:02 smithi063 ceph-mon[36747]: pgmap v3804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:04 smithi043 ceph-mon[32384]: pgmap v3805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:04 smithi133 ceph-mon[37053]: pgmap v3805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:18:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:04 smithi063 ceph-mon[36747]: pgmap v3805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:18:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:18:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:18:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:05 smithi043 ceph-mon[32384]: pgmap v3806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:18:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:05 smithi043 ceph-mon[32384]: pgmap v3807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:18:05.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:18:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:18:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:18:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:05 smithi133 ceph-mon[37053]: pgmap v3806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:18:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:05 smithi133 ceph-mon[37053]: pgmap v3807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:18:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:18:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:18:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:18:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:05 smithi063 ceph-mon[36747]: pgmap v3806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:18:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:05 smithi063 ceph-mon[36747]: pgmap v3807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:18:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:18:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6131.846688 secs 2024-07-26T10:18:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6131.846688 secs 2024-07-26T10:18:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6131.846688 secs 2024-07-26T10:18:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6147.329935 secs 2024-07-26T10:18:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:07 smithi043 ceph-mon[32384]: pgmap v3808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:18:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6147.329935 secs 2024-07-26T10:18:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:07 smithi133 ceph-mon[37053]: pgmap v3808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:18:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6147.329935 secs 2024-07-26T10:18:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:07 smithi063 ceph-mon[36747]: pgmap v3808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:18:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:09 smithi063 ceph-mon[36747]: pgmap v3809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:18:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:09 smithi043 ceph-mon[32384]: pgmap v3809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:18:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:09 smithi133 ceph-mon[37053]: pgmap v3809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:18:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6136.846792 secs 2024-07-26T10:18:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:11 smithi063 ceph-mon[36747]: pgmap v3810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:18:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6152.330073 secs 2024-07-26T10:18:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6136.846792 secs 2024-07-26T10:18:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:11 smithi043 ceph-mon[32384]: pgmap v3810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:18:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6152.330073 secs 2024-07-26T10:18:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6136.846792 secs 2024-07-26T10:18:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:11 smithi133 ceph-mon[37053]: pgmap v3810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:18:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6152.330073 secs 2024-07-26T10:18:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:13 smithi043 ceph-mon[32384]: pgmap v3811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:18:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:13 smithi133 ceph-mon[37053]: pgmap v3811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:18:14.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:13 smithi063 ceph-mon[36747]: pgmap v3811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:18:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:15 smithi043 ceph-mon[32384]: pgmap v3812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:18:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:15 smithi133 ceph-mon[37053]: pgmap v3812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:18:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:15 smithi063 ceph-mon[36747]: pgmap v3812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:18:17.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6141.846914 secs 2024-07-26T10:18:17.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6157.330186 secs 2024-07-26T10:18:17.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6141.846914 secs 2024-07-26T10:18:17.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6157.330186 secs 2024-07-26T10:18:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6141.846914 secs 2024-07-26T10:18:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6157.330186 secs 2024-07-26T10:18:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:17 smithi043 ceph-mon[32384]: pgmap v3813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:17 smithi133 ceph-mon[37053]: pgmap v3813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:17 smithi063 ceph-mon[36747]: pgmap v3813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:18 smithi043 ceph-mon[32384]: pgmap v3814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:18 smithi133 ceph-mon[37053]: pgmap v3814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:18 smithi063 ceph-mon[36747]: pgmap v3814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6146.847059 secs 2024-07-26T10:18:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:21 smithi043 ceph-mon[32384]: pgmap v3815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6146.847059 secs 2024-07-26T10:18:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:21 smithi133 ceph-mon[37053]: pgmap v3815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6146.847059 secs 2024-07-26T10:18:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:21 smithi063 ceph-mon[36747]: pgmap v3815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6162.330268 secs 2024-07-26T10:18:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6162.330268 secs 2024-07-26T10:18:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6162.330268 secs 2024-07-26T10:18:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:23 smithi043 ceph-mon[32384]: pgmap v3816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:23 smithi133 ceph-mon[37053]: pgmap v3816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:23 smithi063 ceph-mon[36747]: pgmap v3816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:25.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:25 smithi043 ceph-mon[32384]: pgmap v3817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:25 smithi133 ceph-mon[37053]: pgmap v3817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:25 smithi063 ceph-mon[36747]: pgmap v3817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6151.847124 secs 2024-07-26T10:18:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6167.330422 secs 2024-07-26T10:18:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6151.847124 secs 2024-07-26T10:18:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6167.330422 secs 2024-07-26T10:18:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6151.847124 secs 2024-07-26T10:18:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6167.330422 secs 2024-07-26T10:18:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:27 smithi043 ceph-mon[32384]: pgmap v3818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:27 smithi133 ceph-mon[37053]: pgmap v3818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:27 smithi063 ceph-mon[36747]: pgmap v3818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:29 smithi043 ceph-mon[32384]: pgmap v3819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:29 smithi133 ceph-mon[37053]: pgmap v3819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:29 smithi063 ceph-mon[36747]: pgmap v3819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6156.847252 secs 2024-07-26T10:18:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:31 smithi043 ceph-mon[32384]: pgmap v3820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6172.330540 secs 2024-07-26T10:18:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6156.847252 secs 2024-07-26T10:18:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:31 smithi133 ceph-mon[37053]: pgmap v3820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6172.330540 secs 2024-07-26T10:18:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6156.847252 secs 2024-07-26T10:18:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:31 smithi063 ceph-mon[36747]: pgmap v3820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6172.330540 secs 2024-07-26T10:18:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:33 smithi043 ceph-mon[32384]: pgmap v3821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:33 smithi133 ceph-mon[37053]: pgmap v3821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:33 smithi063 ceph-mon[36747]: pgmap v3821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:35 smithi043 ceph-mon[32384]: pgmap v3822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:35 smithi133 ceph-mon[37053]: pgmap v3822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:35 smithi063 ceph-mon[36747]: pgmap v3822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6161.847374 secs 2024-07-26T10:18:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6177.330678 secs 2024-07-26T10:18:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6161.847374 secs 2024-07-26T10:18:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6177.330678 secs 2024-07-26T10:18:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6161.847374 secs 2024-07-26T10:18:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6177.330678 secs 2024-07-26T10:18:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:37 smithi043 ceph-mon[32384]: pgmap v3823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:37 smithi133 ceph-mon[37053]: pgmap v3823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:37 smithi063 ceph-mon[36747]: pgmap v3823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:39 smithi133 ceph-mon[37053]: pgmap v3824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:39 smithi063 ceph-mon[36747]: pgmap v3824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:39 smithi043 ceph-mon[32384]: pgmap v3824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6166.847496 secs 2024-07-26T10:18:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:41 smithi133 ceph-mon[37053]: pgmap v3825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6182.330819 secs 2024-07-26T10:18:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6166.847496 secs 2024-07-26T10:18:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:41 smithi063 ceph-mon[36747]: pgmap v3825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6182.330819 secs 2024-07-26T10:18:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6166.847496 secs 2024-07-26T10:18:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:41 smithi043 ceph-mon[32384]: pgmap v3825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6182.330819 secs 2024-07-26T10:18:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:43 smithi133 ceph-mon[37053]: pgmap v3826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:43 smithi063 ceph-mon[36747]: pgmap v3826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:43 smithi043 ceph-mon[32384]: pgmap v3826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:45 smithi133 ceph-mon[37053]: pgmap v3827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:45 smithi063 ceph-mon[36747]: pgmap v3827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:45 smithi043 ceph-mon[32384]: pgmap v3827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6171.847589 secs 2024-07-26T10:18:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6187.330912 secs 2024-07-26T10:18:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6171.847589 secs 2024-07-26T10:18:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6187.330912 secs 2024-07-26T10:18:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6171.847589 secs 2024-07-26T10:18:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6187.330912 secs 2024-07-26T10:18:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:47 smithi063 ceph-mon[36747]: pgmap v3828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:47.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:47 smithi133 ceph-mon[37053]: pgmap v3828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:47 smithi043 ceph-mon[32384]: pgmap v3828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:49 smithi063 ceph-mon[36747]: pgmap v3829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:49 smithi043 ceph-mon[32384]: pgmap v3829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:49 smithi133 ceph-mon[37053]: pgmap v3829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6176.847728 secs 2024-07-26T10:18:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:51 smithi063 ceph-mon[36747]: pgmap v3830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6192.330983 secs 2024-07-26T10:18:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6176.847728 secs 2024-07-26T10:18:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:51 smithi043 ceph-mon[32384]: pgmap v3830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6192.330983 secs 2024-07-26T10:18:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6176.847728 secs 2024-07-26T10:18:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:51 smithi133 ceph-mon[37053]: pgmap v3830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:18:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6192.330983 secs 2024-07-26T10:18:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:53 smithi063 ceph-mon[36747]: pgmap v3831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:53.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:53 smithi043 ceph-mon[32384]: pgmap v3831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:53 smithi133 ceph-mon[37053]: pgmap v3831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:55 smithi063 ceph-mon[36747]: pgmap v3832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:55 smithi043 ceph-mon[32384]: pgmap v3832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:55 smithi133 ceph-mon[37053]: pgmap v3832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:18:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6181.847849 secs 2024-07-26T10:18:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6197.331056 secs 2024-07-26T10:18:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6181.847849 secs 2024-07-26T10:18:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6197.331056 secs 2024-07-26T10:18:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6181.847849 secs 2024-07-26T10:18:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6197.331056 secs 2024-07-26T10:18:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:57 smithi063 ceph-mon[36747]: pgmap v3833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:57 smithi043 ceph-mon[32384]: pgmap v3833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:57 smithi133 ceph-mon[37053]: pgmap v3833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:18:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:18:59 smithi043 ceph-mon[32384]: pgmap v3834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:18:59 smithi133 ceph-mon[37053]: pgmap v3834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:18:59 smithi063 ceph-mon[36747]: pgmap v3834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6186.847984 secs 2024-07-26T10:19:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:01 smithi043 ceph-mon[32384]: pgmap v3835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6202.331172 secs 2024-07-26T10:19:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6186.847984 secs 2024-07-26T10:19:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:01 smithi133 ceph-mon[37053]: pgmap v3835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6202.331172 secs 2024-07-26T10:19:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6186.847984 secs 2024-07-26T10:19:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:01 smithi063 ceph-mon[36747]: pgmap v3835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6202.331172 secs 2024-07-26T10:19:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:03 smithi043 ceph-mon[32384]: pgmap v3836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:03 smithi133 ceph-mon[37053]: pgmap v3836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:03 smithi063 ceph-mon[36747]: pgmap v3836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:19:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:19:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:19:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:05 smithi043 ceph-mon[32384]: pgmap v3837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:05 smithi133 ceph-mon[37053]: pgmap v3837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:05 smithi063 ceph-mon[36747]: pgmap v3837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6191.848068 secs 2024-07-26T10:19:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6207.331284 secs 2024-07-26T10:19:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:19:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: pgmap v3838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:19:06.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: pgmap v3839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:06.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:19:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6191.848068 secs 2024-07-26T10:19:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6207.331284 secs 2024-07-26T10:19:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:19:07.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: pgmap v3838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:19:07.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: pgmap v3839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:07.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:19:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6191.848068 secs 2024-07-26T10:19:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6207.331284 secs 2024-07-26T10:19:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: pgmap v3838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: pgmap v3839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:19:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:08 smithi133 ceph-mon[37053]: pgmap v3840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:08 smithi063 ceph-mon[36747]: pgmap v3840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:08 smithi043 ceph-mon[32384]: pgmap v3840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:10 smithi063 ceph-mon[36747]: pgmap v3841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:10 smithi043 ceph-mon[32384]: pgmap v3841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:10 smithi133 ceph-mon[37053]: pgmap v3841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6196.848192 secs 2024-07-26T10:19:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6212.331431 secs 2024-07-26T10:19:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6196.848192 secs 2024-07-26T10:19:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6212.331431 secs 2024-07-26T10:19:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6196.848192 secs 2024-07-26T10:19:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6212.331431 secs 2024-07-26T10:19:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:12 smithi063 ceph-mon[36747]: pgmap v3842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:12 smithi043 ceph-mon[32384]: pgmap v3842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:12 smithi133 ceph-mon[37053]: pgmap v3842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:14 smithi063 ceph-mon[36747]: pgmap v3843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:14 smithi043 ceph-mon[32384]: pgmap v3843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:14 smithi133 ceph-mon[37053]: pgmap v3843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6201.848318 secs 2024-07-26T10:19:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6217.331526 secs 2024-07-26T10:19:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:16 smithi063 ceph-mon[36747]: pgmap v3844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:19:17.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6201.848318 secs 2024-07-26T10:19:17.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6217.331526 secs 2024-07-26T10:19:17.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:16 smithi133 ceph-mon[37053]: pgmap v3844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:19:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6201.848318 secs 2024-07-26T10:19:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6217.331526 secs 2024-07-26T10:19:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:16 smithi043 ceph-mon[32384]: pgmap v3844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:19:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:18 smithi063 ceph-mon[36747]: pgmap v3845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:18 smithi043 ceph-mon[32384]: pgmap v3845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:18 smithi133 ceph-mon[37053]: pgmap v3845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:20 smithi063 ceph-mon[36747]: pgmap v3846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:20 smithi043 ceph-mon[32384]: pgmap v3846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:20 smithi133 ceph-mon[37053]: pgmap v3846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6206.848438 secs 2024-07-26T10:19:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6222.331651 secs 2024-07-26T10:19:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6206.848438 secs 2024-07-26T10:19:22.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6222.331651 secs 2024-07-26T10:19:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6206.848438 secs 2024-07-26T10:19:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6222.331651 secs 2024-07-26T10:19:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:22 smithi043 ceph-mon[32384]: pgmap v3847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:22 smithi133 ceph-mon[37053]: pgmap v3847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:22 smithi063 ceph-mon[36747]: pgmap v3847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:24 smithi043 ceph-mon[32384]: pgmap v3848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:24 smithi133 ceph-mon[37053]: pgmap v3848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:24 smithi063 ceph-mon[36747]: pgmap v3848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6211.848560 secs 2024-07-26T10:19:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6227.331749 secs 2024-07-26T10:19:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:26 smithi043 ceph-mon[32384]: pgmap v3849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6211.848560 secs 2024-07-26T10:19:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6227.331749 secs 2024-07-26T10:19:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:26 smithi133 ceph-mon[37053]: pgmap v3849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6211.848560 secs 2024-07-26T10:19:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6227.331749 secs 2024-07-26T10:19:27.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:26 smithi063 ceph-mon[36747]: pgmap v3849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:28 smithi043 ceph-mon[32384]: pgmap v3850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:28 smithi133 ceph-mon[37053]: pgmap v3850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:28 smithi063 ceph-mon[36747]: pgmap v3850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:30 smithi043 ceph-mon[32384]: pgmap v3851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:30 smithi133 ceph-mon[37053]: pgmap v3851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:30 smithi063 ceph-mon[36747]: pgmap v3851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6216.848697 secs 2024-07-26T10:19:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6232.331890 secs 2024-07-26T10:19:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6216.848697 secs 2024-07-26T10:19:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6232.331890 secs 2024-07-26T10:19:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6216.848697 secs 2024-07-26T10:19:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6232.331890 secs 2024-07-26T10:19:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:32 smithi043 ceph-mon[32384]: pgmap v3852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:32 smithi133 ceph-mon[37053]: pgmap v3852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:32 smithi063 ceph-mon[36747]: pgmap v3852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:34 smithi043 ceph-mon[32384]: pgmap v3853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:34 smithi133 ceph-mon[37053]: pgmap v3853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:34 smithi063 ceph-mon[36747]: pgmap v3853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:35 smithi043 ceph-mon[32384]: pgmap v3854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:35 smithi133 ceph-mon[37053]: pgmap v3854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:35 smithi063 ceph-mon[36747]: pgmap v3854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6221.848829 secs 2024-07-26T10:19:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6237.332009 secs 2024-07-26T10:19:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6221.848829 secs 2024-07-26T10:19:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6237.332009 secs 2024-07-26T10:19:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6221.848829 secs 2024-07-26T10:19:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6237.332009 secs 2024-07-26T10:19:38.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:37 smithi043 ceph-mon[32384]: pgmap v3855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:37 smithi133 ceph-mon[37053]: pgmap v3855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:37 smithi063 ceph-mon[36747]: pgmap v3855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:40 smithi063 ceph-mon[36747]: pgmap v3856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:40 smithi043 ceph-mon[32384]: pgmap v3856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:40 smithi133 ceph-mon[37053]: pgmap v3856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6226.848961 secs 2024-07-26T10:19:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6242.332133 secs 2024-07-26T10:19:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6226.848961 secs 2024-07-26T10:19:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6242.332133 secs 2024-07-26T10:19:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6226.848961 secs 2024-07-26T10:19:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6242.332133 secs 2024-07-26T10:19:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:42 smithi063 ceph-mon[36747]: pgmap v3857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:42 smithi043 ceph-mon[32384]: pgmap v3857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:42 smithi133 ceph-mon[37053]: pgmap v3857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:44 smithi063 ceph-mon[36747]: pgmap v3858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:44 smithi043 ceph-mon[32384]: pgmap v3858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:44 smithi133 ceph-mon[37053]: pgmap v3858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6231.849021 secs 2024-07-26T10:19:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6247.332255 secs 2024-07-26T10:19:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:46 smithi063 ceph-mon[36747]: pgmap v3859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:47.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6231.849021 secs 2024-07-26T10:19:47.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6247.332255 secs 2024-07-26T10:19:47.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:46 smithi133 ceph-mon[37053]: pgmap v3859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6231.849021 secs 2024-07-26T10:19:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6247.332255 secs 2024-07-26T10:19:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:46 smithi043 ceph-mon[32384]: pgmap v3859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:48 smithi063 ceph-mon[36747]: pgmap v3860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:48 smithi043 ceph-mon[32384]: pgmap v3860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:48 smithi133 ceph-mon[37053]: pgmap v3860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:50 smithi043 ceph-mon[32384]: pgmap v3861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:50 smithi133 ceph-mon[37053]: pgmap v3861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:50 smithi063 ceph-mon[36747]: pgmap v3861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:19:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6236.849142 secs 2024-07-26T10:19:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6252.332379 secs 2024-07-26T10:19:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6236.849142 secs 2024-07-26T10:19:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6252.332379 secs 2024-07-26T10:19:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6236.849142 secs 2024-07-26T10:19:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6252.332379 secs 2024-07-26T10:19:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:52 smithi043 ceph-mon[32384]: pgmap v3862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:52 smithi133 ceph-mon[37053]: pgmap v3862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:52 smithi063 ceph-mon[36747]: pgmap v3862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:54 smithi043 ceph-mon[32384]: pgmap v3863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:54 smithi133 ceph-mon[37053]: pgmap v3863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:54 smithi063 ceph-mon[36747]: pgmap v3863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6241.849254 secs 2024-07-26T10:19:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6257.332477 secs 2024-07-26T10:19:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:56 smithi043 ceph-mon[32384]: pgmap v3864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6241.849254 secs 2024-07-26T10:19:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6257.332477 secs 2024-07-26T10:19:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:56 smithi133 ceph-mon[37053]: pgmap v3864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6241.849254 secs 2024-07-26T10:19:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6257.332477 secs 2024-07-26T10:19:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:56 smithi063 ceph-mon[36747]: pgmap v3864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:19:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:19:58 smithi043 ceph-mon[32384]: pgmap v3865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:19:58 smithi133 ceph-mon[37053]: pgmap v3865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:19:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:19:58 smithi063 ceph-mon[36747]: pgmap v3865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:00 smithi043 ceph-mon[32384]: pgmap v3866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:20:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:00 smithi133 ceph-mon[37053]: pgmap v3866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:20:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:00 smithi063 ceph-mon[36747]: pgmap v3866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:20:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6246.849399 secs 2024-07-26T10:20:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6262.332629 secs 2024-07-26T10:20:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6246.849399 secs 2024-07-26T10:20:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6262.332629 secs 2024-07-26T10:20:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6246.849399 secs 2024-07-26T10:20:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6262.332629 secs 2024-07-26T10:20:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:02 smithi043 ceph-mon[32384]: pgmap v3867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:02 smithi133 ceph-mon[37053]: pgmap v3867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:02 smithi063 ceph-mon[36747]: pgmap v3867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:03 smithi043 ceph-mon[32384]: pgmap v3868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:03 smithi133 ceph-mon[37053]: pgmap v3868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:03 smithi063 ceph-mon[36747]: pgmap v3868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6251.849540 secs 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6267.332747 secs 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: pgmap v3869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6251.849540 secs 2024-07-26T10:20:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6267.332747 secs 2024-07-26T10:20:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: pgmap v3869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:20:07.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6251.849540 secs 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6267.332747 secs 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: pgmap v3869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:07.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:20:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:20:08.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:20:08.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:20:08.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:20:08.139 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:20:08.140 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:20:08.140 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:20:08.140 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:20:08.140 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:20:08.141 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:20:08.141 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:20:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:20:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:20:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:20:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:20:08.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:20:08.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:20:08.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:20:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:08 smithi063 ceph-mon[36747]: pgmap v3870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:20:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:08 smithi063 ceph-mon[36747]: pgmap v3871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:20:09.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:08 smithi043 ceph-mon[32384]: pgmap v3870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:20:09.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:08 smithi043 ceph-mon[32384]: pgmap v3871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:20:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:08 smithi133 ceph-mon[37053]: pgmap v3870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:20:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:08 smithi133 ceph-mon[37053]: pgmap v3871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:20:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:10 smithi043 ceph-mon[32384]: pgmap v3872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:20:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:10 smithi133 ceph-mon[37053]: pgmap v3872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:20:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:10 smithi063 ceph-mon[36747]: pgmap v3872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:20:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6256.849687 secs 2024-07-26T10:20:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6272.332882 secs 2024-07-26T10:20:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6256.849687 secs 2024-07-26T10:20:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6272.332882 secs 2024-07-26T10:20:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6256.849687 secs 2024-07-26T10:20:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6272.332882 secs 2024-07-26T10:20:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:12 smithi043 ceph-mon[32384]: pgmap v3873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:20:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:12 smithi133 ceph-mon[37053]: pgmap v3873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:20:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:12 smithi063 ceph-mon[36747]: pgmap v3873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:20:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:14 smithi043 ceph-mon[32384]: pgmap v3874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:20:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:14 smithi133 ceph-mon[37053]: pgmap v3874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:20:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:14 smithi063 ceph-mon[36747]: pgmap v3874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:20:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:16 smithi043 ceph-mon[32384]: pgmap v3875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:20:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6261.849817 secs 2024-07-26T10:20:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6277.332999 secs 2024-07-26T10:20:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:16 smithi133 ceph-mon[37053]: pgmap v3875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:20:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6261.849817 secs 2024-07-26T10:20:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6277.332999 secs 2024-07-26T10:20:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:16 smithi063 ceph-mon[36747]: pgmap v3875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:20:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6261.849817 secs 2024-07-26T10:20:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6277.332999 secs 2024-07-26T10:20:19.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:18 smithi063 ceph-mon[36747]: pgmap v3876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:20:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:18 smithi043 ceph-mon[32384]: pgmap v3876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:20:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:18 smithi133 ceph-mon[37053]: pgmap v3876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:20:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:20 smithi043 ceph-mon[32384]: pgmap v3877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:20 smithi133 ceph-mon[37053]: pgmap v3877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:20 smithi063 ceph-mon[36747]: pgmap v3877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:22.139 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6266.849945 secs 2024-07-26T10:20:22.139 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6282.333091 secs 2024-07-26T10:20:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6266.849945 secs 2024-07-26T10:20:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6282.333091 secs 2024-07-26T10:20:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6266.849945 secs 2024-07-26T10:20:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6282.333091 secs 2024-07-26T10:20:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:22 smithi043 ceph-mon[32384]: pgmap v3878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:22 smithi133 ceph-mon[37053]: pgmap v3878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:22 smithi063 ceph-mon[36747]: pgmap v3878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:23 smithi043 ceph-mon[32384]: pgmap v3879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:23 smithi133 ceph-mon[37053]: pgmap v3879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:23 smithi063 ceph-mon[36747]: pgmap v3879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:26 smithi063 ceph-mon[36747]: pgmap v3880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:26.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6271.850008 secs 2024-07-26T10:20:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:26 smithi043 ceph-mon[32384]: pgmap v3880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6271.850008 secs 2024-07-26T10:20:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:26 smithi133 ceph-mon[37053]: pgmap v3880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6271.850008 secs 2024-07-26T10:20:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6287.333204 secs 2024-07-26T10:20:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6287.333204 secs 2024-07-26T10:20:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6287.333204 secs 2024-07-26T10:20:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:28 smithi043 ceph-mon[32384]: pgmap v3881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:28 smithi133 ceph-mon[37053]: pgmap v3881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:28 smithi063 ceph-mon[36747]: pgmap v3881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:30 smithi043 ceph-mon[32384]: pgmap v3882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:30 smithi133 ceph-mon[37053]: pgmap v3882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:30 smithi063 ceph-mon[36747]: pgmap v3882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6276.850143 secs 2024-07-26T10:20:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6276.850143 secs 2024-07-26T10:20:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6276.850143 secs 2024-07-26T10:20:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6292.333318 secs 2024-07-26T10:20:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:32 smithi043 ceph-mon[32384]: pgmap v3883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6292.333318 secs 2024-07-26T10:20:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:32 smithi133 ceph-mon[37053]: pgmap v3883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6292.333318 secs 2024-07-26T10:20:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:32 smithi063 ceph-mon[36747]: pgmap v3883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:34 smithi043 ceph-mon[32384]: pgmap v3884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:34 smithi133 ceph-mon[37053]: pgmap v3884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:34 smithi063 ceph-mon[36747]: pgmap v3884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:36 smithi043 ceph-mon[32384]: pgmap v3885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6281.850228 secs 2024-07-26T10:20:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:36 smithi133 ceph-mon[37053]: pgmap v3885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6281.850228 secs 2024-07-26T10:20:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:36 smithi063 ceph-mon[36747]: pgmap v3885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6281.850228 secs 2024-07-26T10:20:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6297.333416 secs 2024-07-26T10:20:37.566 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6297.333416 secs 2024-07-26T10:20:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6297.333416 secs 2024-07-26T10:20:38.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:38 smithi043 ceph-mon[32384]: pgmap v3886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:38 smithi133 ceph-mon[37053]: pgmap v3886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:38 smithi063 ceph-mon[36747]: pgmap v3886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:40 smithi043 ceph-mon[32384]: pgmap v3887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:40 smithi133 ceph-mon[37053]: pgmap v3887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:40 smithi063 ceph-mon[36747]: pgmap v3887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6286.850303 secs 2024-07-26T10:20:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6286.850303 secs 2024-07-26T10:20:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6286.850303 secs 2024-07-26T10:20:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6302.333538 secs 2024-07-26T10:20:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:42 smithi043 ceph-mon[32384]: pgmap v3888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6302.333538 secs 2024-07-26T10:20:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:42 smithi133 ceph-mon[37053]: pgmap v3888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6302.333538 secs 2024-07-26T10:20:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:42 smithi063 ceph-mon[36747]: pgmap v3888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:44 smithi043 ceph-mon[32384]: pgmap v3889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:44 smithi133 ceph-mon[37053]: pgmap v3889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:44 smithi063 ceph-mon[36747]: pgmap v3889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:46 smithi043 ceph-mon[32384]: pgmap v3890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6291.850368 secs 2024-07-26T10:20:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:46 smithi133 ceph-mon[37053]: pgmap v3890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6291.850368 secs 2024-07-26T10:20:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:46 smithi063 ceph-mon[36747]: pgmap v3890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6291.850368 secs 2024-07-26T10:20:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6307.333654 secs 2024-07-26T10:20:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6307.333654 secs 2024-07-26T10:20:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6307.333654 secs 2024-07-26T10:20:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:48 smithi043 ceph-mon[32384]: pgmap v3891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:48 smithi133 ceph-mon[37053]: pgmap v3891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:48 smithi063 ceph-mon[36747]: pgmap v3891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:50 smithi043 ceph-mon[32384]: pgmap v3892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:50 smithi133 ceph-mon[37053]: pgmap v3892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:50 smithi063 ceph-mon[36747]: pgmap v3892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6296.850456 secs 2024-07-26T10:20:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6296.850456 secs 2024-07-26T10:20:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6296.850456 secs 2024-07-26T10:20:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6312.333789 secs 2024-07-26T10:20:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:52 smithi043 ceph-mon[32384]: pgmap v3893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6312.333789 secs 2024-07-26T10:20:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:52 smithi133 ceph-mon[37053]: pgmap v3893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6312.333789 secs 2024-07-26T10:20:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:52 smithi063 ceph-mon[36747]: pgmap v3893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:54 smithi043 ceph-mon[32384]: pgmap v3894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:54 smithi133 ceph-mon[37053]: pgmap v3894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:54 smithi063 ceph-mon[36747]: pgmap v3894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:20:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:56 smithi043 ceph-mon[32384]: pgmap v3895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6301.850531 secs 2024-07-26T10:20:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:56 smithi133 ceph-mon[37053]: pgmap v3895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6301.850531 secs 2024-07-26T10:20:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:56 smithi063 ceph-mon[36747]: pgmap v3895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:20:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6301.850531 secs 2024-07-26T10:20:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6317.333933 secs 2024-07-26T10:20:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6317.333933 secs 2024-07-26T10:20:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6317.333933 secs 2024-07-26T10:20:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:20:58 smithi133 ceph-mon[37053]: pgmap v3896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:20:58 smithi063 ceph-mon[36747]: pgmap v3896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:20:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:20:58 smithi043 ceph-mon[32384]: pgmap v3896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:00 smithi133 ceph-mon[37053]: pgmap v3897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:00 smithi063 ceph-mon[36747]: pgmap v3897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:00 smithi043 ceph-mon[32384]: pgmap v3897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6306.850649 secs 2024-07-26T10:21:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6306.850649 secs 2024-07-26T10:21:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6306.850649 secs 2024-07-26T10:21:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6322.334062 secs 2024-07-26T10:21:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:02 smithi133 ceph-mon[37053]: pgmap v3898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6322.334062 secs 2024-07-26T10:21:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:02 smithi063 ceph-mon[36747]: pgmap v3898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6322.334062 secs 2024-07-26T10:21:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:02 smithi043 ceph-mon[32384]: pgmap v3898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:04 smithi133 ceph-mon[37053]: pgmap v3899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:04 smithi063 ceph-mon[36747]: pgmap v3899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:04 smithi043 ceph-mon[32384]: pgmap v3899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:06 smithi133 ceph-mon[37053]: pgmap v3900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6311.850758 secs 2024-07-26T10:21:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:06 smithi063 ceph-mon[36747]: pgmap v3900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6311.850758 secs 2024-07-26T10:21:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:06 smithi043 ceph-mon[32384]: pgmap v3900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6311.850758 secs 2024-07-26T10:21:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6327.334195 secs 2024-07-26T10:21:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:21:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6327.334195 secs 2024-07-26T10:21:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:21:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6327.334195 secs 2024-07-26T10:21:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:21:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:08 smithi063 ceph-mon[36747]: pgmap v3901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:21:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:21:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:21:08.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:08 smithi043 ceph-mon[32384]: pgmap v3901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:08.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:21:08.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:21:08.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:21:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:08 smithi133 ceph-mon[37053]: pgmap v3901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:21:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:21:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:21:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:09 smithi063 ceph-mon[36747]: pgmap v3902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:09 smithi043 ceph-mon[32384]: pgmap v3902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:09 smithi133 ceph-mon[37053]: pgmap v3902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6316.850900 secs 2024-07-26T10:21:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:11 smithi063 ceph-mon[36747]: pgmap v3903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:21:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6316.850900 secs 2024-07-26T10:21:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:11 smithi043 ceph-mon[32384]: pgmap v3903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:21:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6316.850900 secs 2024-07-26T10:21:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:11 smithi133 ceph-mon[37053]: pgmap v3903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:21:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6332.334319 secs 2024-07-26T10:21:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6332.334319 secs 2024-07-26T10:21:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6332.334319 secs 2024-07-26T10:21:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:13 smithi063 ceph-mon[36747]: pgmap v3904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:21:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:13 smithi043 ceph-mon[32384]: pgmap v3904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:21:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:13 smithi133 ceph-mon[37053]: pgmap v3904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:21:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:15 smithi063 ceph-mon[36747]: pgmap v3905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:21:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:15 smithi043 ceph-mon[32384]: pgmap v3905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:21:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:15 smithi133 ceph-mon[37053]: pgmap v3905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:21:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6321.851019 secs 2024-07-26T10:21:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6321.851019 secs 2024-07-26T10:21:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6321.851019 secs 2024-07-26T10:21:17.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6337.334436 secs 2024-07-26T10:21:17.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:17 smithi133 ceph-mon[37053]: pgmap v3906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6337.334436 secs 2024-07-26T10:21:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:17 smithi043 ceph-mon[32384]: pgmap v3906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6337.334436 secs 2024-07-26T10:21:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:17 smithi063 ceph-mon[36747]: pgmap v3906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:19 smithi043 ceph-mon[32384]: pgmap v3907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:19 smithi133 ceph-mon[37053]: pgmap v3907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:19 smithi063 ceph-mon[36747]: pgmap v3907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:21:21.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6326.851144 secs 2024-07-26T10:21:21.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:21 smithi063 ceph-mon[36747]: pgmap v3908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6326.851144 secs 2024-07-26T10:21:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:21 smithi043 ceph-mon[32384]: pgmap v3908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6326.851144 secs 2024-07-26T10:21:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:21 smithi133 ceph-mon[37053]: pgmap v3908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6342.334511 secs 2024-07-26T10:21:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6342.334511 secs 2024-07-26T10:21:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6342.334511 secs 2024-07-26T10:21:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:23 smithi043 ceph-mon[32384]: pgmap v3909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:23 smithi133 ceph-mon[37053]: pgmap v3909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:23 smithi063 ceph-mon[36747]: pgmap v3909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:25.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:25 smithi043 ceph-mon[32384]: pgmap v3910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:25 smithi133 ceph-mon[37053]: pgmap v3910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:25 smithi063 ceph-mon[36747]: pgmap v3910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6331.851268 secs 2024-07-26T10:21:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6331.851268 secs 2024-07-26T10:21:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6331.851268 secs 2024-07-26T10:21:27.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6347.334611 secs 2024-07-26T10:21:27.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:27 smithi043 ceph-mon[32384]: pgmap v3911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6347.334611 secs 2024-07-26T10:21:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:27 smithi133 ceph-mon[37053]: pgmap v3911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6347.334611 secs 2024-07-26T10:21:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:27 smithi063 ceph-mon[36747]: pgmap v3911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:29 smithi043 ceph-mon[32384]: pgmap v3912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:29 smithi133 ceph-mon[37053]: pgmap v3912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:29 smithi063 ceph-mon[36747]: pgmap v3912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6336.851381 secs 2024-07-26T10:21:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:31 smithi043 ceph-mon[32384]: pgmap v3913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6336.851381 secs 2024-07-26T10:21:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:31 smithi133 ceph-mon[37053]: pgmap v3913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6336.851381 secs 2024-07-26T10:21:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:31 smithi063 ceph-mon[36747]: pgmap v3913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6352.334767 secs 2024-07-26T10:21:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6352.334767 secs 2024-07-26T10:21:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6352.334767 secs 2024-07-26T10:21:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:33 smithi043 ceph-mon[32384]: pgmap v3914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:33 smithi133 ceph-mon[37053]: pgmap v3914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:33 smithi063 ceph-mon[36747]: pgmap v3914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:35 smithi043 ceph-mon[32384]: pgmap v3915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:35 smithi133 ceph-mon[37053]: pgmap v3915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:35 smithi063 ceph-mon[36747]: pgmap v3915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6341.851472 secs 2024-07-26T10:21:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6341.851472 secs 2024-07-26T10:21:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6341.851472 secs 2024-07-26T10:21:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6357.334890 secs 2024-07-26T10:21:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:37 smithi043 ceph-mon[32384]: pgmap v3916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:21:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6357.334890 secs 2024-07-26T10:21:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:37 smithi133 ceph-mon[37053]: pgmap v3916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:21:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6357.334890 secs 2024-07-26T10:21:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:37 smithi063 ceph-mon[36747]: pgmap v3916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:21:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:39 smithi043 ceph-mon[32384]: pgmap v3917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:39 smithi133 ceph-mon[37053]: pgmap v3917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:39 smithi063 ceph-mon[36747]: pgmap v3917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6346.851601 secs 2024-07-26T10:21:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:41 smithi043 ceph-mon[32384]: pgmap v3918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:21:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6346.851601 secs 2024-07-26T10:21:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:41 smithi133 ceph-mon[37053]: pgmap v3918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:21:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6346.851601 secs 2024-07-26T10:21:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:41 smithi063 ceph-mon[36747]: pgmap v3918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:21:42.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6362.334989 secs 2024-07-26T10:21:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6362.334989 secs 2024-07-26T10:21:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6362.334989 secs 2024-07-26T10:21:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:43 smithi043 ceph-mon[32384]: pgmap v3919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:21:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:43 smithi133 ceph-mon[37053]: pgmap v3919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:21:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:43 smithi063 ceph-mon[36747]: pgmap v3919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:21:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:45 smithi043 ceph-mon[32384]: pgmap v3920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:45 smithi133 ceph-mon[37053]: pgmap v3920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:45 smithi063 ceph-mon[36747]: pgmap v3920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:21:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6351.851724 secs 2024-07-26T10:21:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6367.335109 secs 2024-07-26T10:21:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6351.851724 secs 2024-07-26T10:21:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6367.335109 secs 2024-07-26T10:21:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6351.851724 secs 2024-07-26T10:21:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6367.335109 secs 2024-07-26T10:21:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:47 smithi043 ceph-mon[32384]: pgmap v3921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:47 smithi133 ceph-mon[37053]: pgmap v3921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:47 smithi063 ceph-mon[36747]: pgmap v3921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:49 smithi043 ceph-mon[32384]: pgmap v3922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:49 smithi133 ceph-mon[37053]: pgmap v3922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:49 smithi063 ceph-mon[36747]: pgmap v3922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6356.851847 secs 2024-07-26T10:21:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:51 smithi043 ceph-mon[32384]: pgmap v3923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6372.335231 secs 2024-07-26T10:21:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6356.851847 secs 2024-07-26T10:21:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:51 smithi133 ceph-mon[37053]: pgmap v3923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6372.335231 secs 2024-07-26T10:21:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6356.851847 secs 2024-07-26T10:21:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:51 smithi063 ceph-mon[36747]: pgmap v3923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:21:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6372.335231 secs 2024-07-26T10:21:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:53 smithi043 ceph-mon[32384]: pgmap v3924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:53 smithi133 ceph-mon[37053]: pgmap v3924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:53 smithi063 ceph-mon[36747]: pgmap v3924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:55 smithi043 ceph-mon[32384]: pgmap v3925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:55 smithi133 ceph-mon[37053]: pgmap v3925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:55 smithi063 ceph-mon[36747]: pgmap v3925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6361.851943 secs 2024-07-26T10:21:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6377.335375 secs 2024-07-26T10:21:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6361.851943 secs 2024-07-26T10:21:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6377.335375 secs 2024-07-26T10:21:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6361.851943 secs 2024-07-26T10:21:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6377.335375 secs 2024-07-26T10:21:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:57 smithi133 ceph-mon[37053]: pgmap v3926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:57 smithi063 ceph-mon[36747]: pgmap v3926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:57 smithi043 ceph-mon[32384]: pgmap v3926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:21:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:21:59 smithi133 ceph-mon[37053]: pgmap v3927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:21:59 smithi063 ceph-mon[36747]: pgmap v3927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:21:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:21:59 smithi043 ceph-mon[32384]: pgmap v3927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6366.852046 secs 2024-07-26T10:22:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:01 smithi133 ceph-mon[37053]: pgmap v3928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:01.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6382.335492 secs 2024-07-26T10:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6366.852046 secs 2024-07-26T10:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:01 smithi063 ceph-mon[36747]: pgmap v3928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6382.335492 secs 2024-07-26T10:22:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6366.852046 secs 2024-07-26T10:22:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:01 smithi043 ceph-mon[32384]: pgmap v3928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:01.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6382.335492 secs 2024-07-26T10:22:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:03 smithi133 ceph-mon[37053]: pgmap v3929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:03 smithi063 ceph-mon[36747]: pgmap v3929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:03 smithi043 ceph-mon[32384]: pgmap v3929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:05 smithi063 ceph-mon[36747]: pgmap v3930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:05 smithi043 ceph-mon[32384]: pgmap v3930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:05 smithi133 ceph-mon[37053]: pgmap v3930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6371.852163 secs 2024-07-26T10:22:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6387.335610 secs 2024-07-26T10:22:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6371.852163 secs 2024-07-26T10:22:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6387.335610 secs 2024-07-26T10:22:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6371.852163 secs 2024-07-26T10:22:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6387.335610 secs 2024-07-26T10:22:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:07 smithi063 ceph-mon[36747]: pgmap v3931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:07 smithi043 ceph-mon[32384]: pgmap v3931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:07 smithi133 ceph-mon[37053]: pgmap v3931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:22:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:22:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:22:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:09 smithi063 ceph-mon[36747]: pgmap v3932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:09.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:09 smithi043 ceph-mon[32384]: pgmap v3932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:09.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:09.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:09 smithi133 ceph-mon[37053]: pgmap v3932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:22:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:22:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:22:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:22:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:22:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:22:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:22:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6376.852256 secs 2024-07-26T10:22:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:11 smithi063 ceph-mon[36747]: pgmap v3933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:11 smithi063 ceph-mon[36747]: pgmap v3934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:11.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6392.335743 secs 2024-07-26T10:22:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6376.852256 secs 2024-07-26T10:22:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:11 smithi043 ceph-mon[32384]: pgmap v3933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:11 smithi043 ceph-mon[32384]: pgmap v3934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6392.335743 secs 2024-07-26T10:22:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6376.852256 secs 2024-07-26T10:22:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:11 smithi133 ceph-mon[37053]: pgmap v3933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:11 smithi133 ceph-mon[37053]: pgmap v3934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6392.335743 secs 2024-07-26T10:22:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:13 smithi043 ceph-mon[32384]: pgmap v3935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:13 smithi133 ceph-mon[37053]: pgmap v3935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:13 smithi063 ceph-mon[36747]: pgmap v3935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:15 smithi043 ceph-mon[32384]: pgmap v3936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:15 smithi133 ceph-mon[37053]: pgmap v3936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:15 smithi063 ceph-mon[36747]: pgmap v3936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6381.852410 secs 2024-07-26T10:22:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6397.335810 secs 2024-07-26T10:22:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6381.852410 secs 2024-07-26T10:22:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6397.335810 secs 2024-07-26T10:22:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6381.852410 secs 2024-07-26T10:22:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6397.335810 secs 2024-07-26T10:22:17.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:17 smithi133 ceph-mon[37053]: pgmap v3937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:17 smithi043 ceph-mon[32384]: pgmap v3937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:17 smithi063 ceph-mon[36747]: pgmap v3937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:19 smithi043 ceph-mon[32384]: pgmap v3938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:19 smithi133 ceph-mon[37053]: pgmap v3938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:19 smithi063 ceph-mon[36747]: pgmap v3938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:22:21.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6386.852543 secs 2024-07-26T10:22:21.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:21 smithi063 ceph-mon[36747]: pgmap v3939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:21.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6402.335931 secs 2024-07-26T10:22:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6386.852543 secs 2024-07-26T10:22:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:21 smithi043 ceph-mon[32384]: pgmap v3939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6402.335931 secs 2024-07-26T10:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6386.852543 secs 2024-07-26T10:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:21 smithi133 ceph-mon[37053]: pgmap v3939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:22:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6402.335931 secs 2024-07-26T10:22:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:23 smithi043 ceph-mon[32384]: pgmap v3940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:23 smithi133 ceph-mon[37053]: pgmap v3940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:23 smithi063 ceph-mon[36747]: pgmap v3940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:25 smithi043 ceph-mon[32384]: pgmap v3941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:25 smithi133 ceph-mon[37053]: pgmap v3941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:25 smithi063 ceph-mon[36747]: pgmap v3941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6391.852619 secs 2024-07-26T10:22:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6407.336054 secs 2024-07-26T10:22:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6391.852619 secs 2024-07-26T10:22:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6407.336054 secs 2024-07-26T10:22:27.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6391.852619 secs 2024-07-26T10:22:27.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6407.336054 secs 2024-07-26T10:22:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:27 smithi043 ceph-mon[32384]: pgmap v3942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:27 smithi133 ceph-mon[37053]: pgmap v3942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:27 smithi063 ceph-mon[36747]: pgmap v3942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:29 smithi043 ceph-mon[32384]: pgmap v3943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:29 smithi133 ceph-mon[37053]: pgmap v3943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:29 smithi063 ceph-mon[36747]: pgmap v3943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:31.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6396.852740 secs 2024-07-26T10:22:31.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:31 smithi043 ceph-mon[32384]: pgmap v3944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:31.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6412.336177 secs 2024-07-26T10:22:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6396.852740 secs 2024-07-26T10:22:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:31 smithi133 ceph-mon[37053]: pgmap v3944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6412.336177 secs 2024-07-26T10:22:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6396.852740 secs 2024-07-26T10:22:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:31 smithi063 ceph-mon[36747]: pgmap v3944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6412.336177 secs 2024-07-26T10:22:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:33 smithi043 ceph-mon[32384]: pgmap v3945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:33 smithi133 ceph-mon[37053]: pgmap v3945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:33 smithi063 ceph-mon[36747]: pgmap v3945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:35 smithi043 ceph-mon[32384]: pgmap v3946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:35 smithi133 ceph-mon[37053]: pgmap v3946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:35 smithi063 ceph-mon[36747]: pgmap v3946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6401.852837 secs 2024-07-26T10:22:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6417.336297 secs 2024-07-26T10:22:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6401.852837 secs 2024-07-26T10:22:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6417.336297 secs 2024-07-26T10:22:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6401.852837 secs 2024-07-26T10:22:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6417.336297 secs 2024-07-26T10:22:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:37 smithi043 ceph-mon[32384]: pgmap v3947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:37 smithi133 ceph-mon[37053]: pgmap v3947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:37 smithi063 ceph-mon[36747]: pgmap v3947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:39 smithi043 ceph-mon[32384]: pgmap v3948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:39 smithi133 ceph-mon[37053]: pgmap v3948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:39 smithi063 ceph-mon[36747]: pgmap v3948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6406.852955 secs 2024-07-26T10:22:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:41 smithi043 ceph-mon[32384]: pgmap v3949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6422.336410 secs 2024-07-26T10:22:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6406.852955 secs 2024-07-26T10:22:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:41 smithi133 ceph-mon[37053]: pgmap v3949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:42.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6422.336410 secs 2024-07-26T10:22:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6406.852955 secs 2024-07-26T10:22:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:41 smithi063 ceph-mon[36747]: pgmap v3949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:42.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6422.336410 secs 2024-07-26T10:22:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:43 smithi043 ceph-mon[32384]: pgmap v3950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:43 smithi133 ceph-mon[37053]: pgmap v3950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:43 smithi063 ceph-mon[36747]: pgmap v3950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:45 smithi043 ceph-mon[32384]: pgmap v3951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:45 smithi133 ceph-mon[37053]: pgmap v3951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:45 smithi063 ceph-mon[36747]: pgmap v3951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6411.853088 secs 2024-07-26T10:22:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6427.336508 secs 2024-07-26T10:22:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6411.853088 secs 2024-07-26T10:22:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6427.336508 secs 2024-07-26T10:22:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6411.853088 secs 2024-07-26T10:22:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6427.336508 secs 2024-07-26T10:22:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:47 smithi043 ceph-mon[32384]: pgmap v3952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:47 smithi133 ceph-mon[37053]: pgmap v3952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:47 smithi063 ceph-mon[36747]: pgmap v3952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:49 smithi043 ceph-mon[32384]: pgmap v3953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:49 smithi133 ceph-mon[37053]: pgmap v3953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:49 smithi063 ceph-mon[36747]: pgmap v3953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6416.853227 secs 2024-07-26T10:22:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:51 smithi043 ceph-mon[32384]: pgmap v3954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:51.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6432.336634 secs 2024-07-26T10:22:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6416.853227 secs 2024-07-26T10:22:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:51 smithi133 ceph-mon[37053]: pgmap v3954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6432.336634 secs 2024-07-26T10:22:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6416.853227 secs 2024-07-26T10:22:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:51 smithi063 ceph-mon[36747]: pgmap v3954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:22:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6432.336634 secs 2024-07-26T10:22:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:53 smithi043 ceph-mon[32384]: pgmap v3955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:53 smithi133 ceph-mon[37053]: pgmap v3955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:53 smithi063 ceph-mon[36747]: pgmap v3955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:55 smithi133 ceph-mon[37053]: pgmap v3956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:55 smithi063 ceph-mon[36747]: pgmap v3956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:55 smithi043 ceph-mon[32384]: pgmap v3956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:22:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6421.853339 secs 2024-07-26T10:22:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6437.336750 secs 2024-07-26T10:22:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6421.853339 secs 2024-07-26T10:22:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6437.336750 secs 2024-07-26T10:22:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6421.853339 secs 2024-07-26T10:22:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6437.336750 secs 2024-07-26T10:22:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:57 smithi133 ceph-mon[37053]: pgmap v3957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:57 smithi063 ceph-mon[36747]: pgmap v3957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:22:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:57 smithi043 ceph-mon[32384]: pgmap v3957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:22:59 smithi133 ceph-mon[37053]: pgmap v3958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:22:59 smithi063 ceph-mon[36747]: pgmap v3958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:22:59 smithi043 ceph-mon[32384]: pgmap v3958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6426.853465 secs 2024-07-26T10:23:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:01 smithi133 ceph-mon[37053]: pgmap v3959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6442.336890 secs 2024-07-26T10:23:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6426.853465 secs 2024-07-26T10:23:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:01 smithi063 ceph-mon[36747]: pgmap v3959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:02.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6442.336890 secs 2024-07-26T10:23:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6426.853465 secs 2024-07-26T10:23:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:01 smithi043 ceph-mon[32384]: pgmap v3959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6442.336890 secs 2024-07-26T10:23:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:03 smithi133 ceph-mon[37053]: pgmap v3960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:03 smithi063 ceph-mon[36747]: pgmap v3960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:03 smithi043 ceph-mon[32384]: pgmap v3960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:05 smithi063 ceph-mon[36747]: pgmap v3961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:05 smithi043 ceph-mon[32384]: pgmap v3961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:05 smithi133 ceph-mon[37053]: pgmap v3961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6431.853617 secs 2024-07-26T10:23:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6447.337007 secs 2024-07-26T10:23:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6431.853617 secs 2024-07-26T10:23:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6447.337007 secs 2024-07-26T10:23:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6431.853617 secs 2024-07-26T10:23:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6447.337007 secs 2024-07-26T10:23:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:07 smithi063 ceph-mon[36747]: pgmap v3962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:23:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:07 smithi043 ceph-mon[32384]: pgmap v3962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:23:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:07 smithi133 ceph-mon[37053]: pgmap v3962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:23:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:09 smithi063 ceph-mon[36747]: pgmap v3963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:09 smithi043 ceph-mon[32384]: pgmap v3963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:09 smithi133 ceph-mon[37053]: pgmap v3963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:23:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:23:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6436.853741 secs 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: pgmap v3964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6452.337081 secs 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6436.853741 secs 2024-07-26T10:23:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: pgmap v3964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:23:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6452.337081 secs 2024-07-26T10:23:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6436.853741 secs 2024-07-26T10:23:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: pgmap v3964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:23:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6452.337081 secs 2024-07-26T10:23:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:12.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: pgmap v3965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: pgmap v3965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: pgmap v3965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:14 smithi043 ceph-mon[32384]: pgmap v3966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:14 smithi133 ceph-mon[37053]: pgmap v3966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:15.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:14 smithi063 ceph-mon[36747]: pgmap v3966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:15.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:15.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6441.853871 secs 2024-07-26T10:23:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6441.853871 secs 2024-07-26T10:23:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6441.853871 secs 2024-07-26T10:23:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6457.337186 secs 2024-07-26T10:23:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:23:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:23:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: pgmap v3967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: pgmap v3968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6457.337186 secs 2024-07-26T10:23:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:17.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:23:17.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:23:17.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: pgmap v3967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:17.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: pgmap v3968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:17.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6457.337186 secs 2024-07-26T10:23:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:23:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:23:17.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: pgmap v3967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:17.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: pgmap v3968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:17.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:23:19.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:19 smithi133 ceph-mon[37053]: pgmap v3969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:19 smithi063 ceph-mon[36747]: pgmap v3969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:19 smithi043 ceph-mon[32384]: pgmap v3969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:21 smithi133 ceph-mon[37053]: pgmap v3970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6446.853987 secs 2024-07-26T10:23:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:21 smithi063 ceph-mon[36747]: pgmap v3970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6446.853987 secs 2024-07-26T10:23:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:21 smithi043 ceph-mon[32384]: pgmap v3970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6446.853987 secs 2024-07-26T10:23:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6462.337328 secs 2024-07-26T10:23:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6462.337328 secs 2024-07-26T10:23:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6462.337328 secs 2024-07-26T10:23:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:23 smithi133 ceph-mon[37053]: pgmap v3971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:23 smithi063 ceph-mon[36747]: pgmap v3971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:23 smithi043 ceph-mon[32384]: pgmap v3971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:25 smithi063 ceph-mon[36747]: pgmap v3972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:25 smithi043 ceph-mon[32384]: pgmap v3972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:25 smithi133 ceph-mon[37053]: pgmap v3972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:23:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6451.854152 secs 2024-07-26T10:23:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6451.854152 secs 2024-07-26T10:23:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6451.854152 secs 2024-07-26T10:23:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6467.337429 secs 2024-07-26T10:23:27.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:27 smithi063 ceph-mon[36747]: pgmap v3973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6467.337429 secs 2024-07-26T10:23:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:27 smithi043 ceph-mon[32384]: pgmap v3973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6467.337429 secs 2024-07-26T10:23:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:27 smithi133 ceph-mon[37053]: pgmap v3973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:23:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:29 smithi063 ceph-mon[36747]: pgmap v3974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:29 smithi043 ceph-mon[32384]: pgmap v3974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:29 smithi133 ceph-mon[37053]: pgmap v3974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:31 smithi063 ceph-mon[36747]: pgmap v3975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6456.854244 secs 2024-07-26T10:23:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:31 smithi043 ceph-mon[32384]: pgmap v3975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6456.854244 secs 2024-07-26T10:23:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:31 smithi133 ceph-mon[37053]: pgmap v3975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6456.854244 secs 2024-07-26T10:23:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6472.337506 secs 2024-07-26T10:23:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6472.337506 secs 2024-07-26T10:23:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6472.337506 secs 2024-07-26T10:23:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:33 smithi063 ceph-mon[36747]: pgmap v3976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:33 smithi043 ceph-mon[32384]: pgmap v3976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:33 smithi133 ceph-mon[37053]: pgmap v3976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:35 smithi063 ceph-mon[36747]: pgmap v3977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:35 smithi043 ceph-mon[32384]: pgmap v3977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:35 smithi133 ceph-mon[37053]: pgmap v3977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6461.854337 secs 2024-07-26T10:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6461.854337 secs 2024-07-26T10:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6461.854337 secs 2024-07-26T10:23:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6477.337626 secs 2024-07-26T10:23:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:37 smithi043 ceph-mon[32384]: pgmap v3978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6477.337626 secs 2024-07-26T10:23:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:37 smithi133 ceph-mon[37053]: pgmap v3978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6477.337626 secs 2024-07-26T10:23:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:37 smithi063 ceph-mon[36747]: pgmap v3978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:39 smithi043 ceph-mon[32384]: pgmap v3979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:39 smithi133 ceph-mon[37053]: pgmap v3979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:39 smithi063 ceph-mon[36747]: pgmap v3979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:41 smithi043 ceph-mon[32384]: pgmap v3980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6466.854405 secs 2024-07-26T10:23:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:41 smithi133 ceph-mon[37053]: pgmap v3980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6466.854405 secs 2024-07-26T10:23:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:41 smithi063 ceph-mon[36747]: pgmap v3980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6466.854405 secs 2024-07-26T10:23:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6482.337693 secs 2024-07-26T10:23:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6482.337693 secs 2024-07-26T10:23:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6482.337693 secs 2024-07-26T10:23:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:43 smithi043 ceph-mon[32384]: pgmap v3981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:43 smithi133 ceph-mon[37053]: pgmap v3981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:43 smithi063 ceph-mon[36747]: pgmap v3981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:45 smithi043 ceph-mon[32384]: pgmap v3982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:45 smithi133 ceph-mon[37053]: pgmap v3982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:45 smithi063 ceph-mon[36747]: pgmap v3982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6471.854540 secs 2024-07-26T10:23:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6471.854540 secs 2024-07-26T10:23:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6471.854540 secs 2024-07-26T10:23:47.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6487.337844 secs 2024-07-26T10:23:47.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:47 smithi133 ceph-mon[37053]: pgmap v3983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6487.337844 secs 2024-07-26T10:23:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:47 smithi043 ceph-mon[32384]: pgmap v3983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6487.337844 secs 2024-07-26T10:23:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:47 smithi063 ceph-mon[36747]: pgmap v3983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:49 smithi043 ceph-mon[32384]: pgmap v3984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:49 smithi133 ceph-mon[37053]: pgmap v3984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:49 smithi063 ceph-mon[36747]: pgmap v3984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6476.854677 secs 2024-07-26T10:23:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:51 smithi043 ceph-mon[32384]: pgmap v3985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6476.854677 secs 2024-07-26T10:23:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:51 smithi133 ceph-mon[37053]: pgmap v3985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6476.854677 secs 2024-07-26T10:23:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:51 smithi063 ceph-mon[36747]: pgmap v3985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:23:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6492.337957 secs 2024-07-26T10:23:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6492.337957 secs 2024-07-26T10:23:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6492.337957 secs 2024-07-26T10:23:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:53 smithi043 ceph-mon[32384]: pgmap v3986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:53 smithi133 ceph-mon[37053]: pgmap v3986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:53 smithi063 ceph-mon[36747]: pgmap v3986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:55 smithi043 ceph-mon[32384]: pgmap v3987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:55 smithi133 ceph-mon[37053]: pgmap v3987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:55 smithi063 ceph-mon[36747]: pgmap v3987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6481.854738 secs 2024-07-26T10:23:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6481.854738 secs 2024-07-26T10:23:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6481.854738 secs 2024-07-26T10:23:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6497.338041 secs 2024-07-26T10:23:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:57 smithi043 ceph-mon[32384]: pgmap v3988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6497.338041 secs 2024-07-26T10:23:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:57 smithi133 ceph-mon[37053]: pgmap v3988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6497.338041 secs 2024-07-26T10:23:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:57 smithi063 ceph-mon[36747]: pgmap v3988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:23:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:23:58 smithi133 ceph-mon[37053]: pgmap v3989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:23:58 smithi063 ceph-mon[36747]: pgmap v3989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:23:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:23:58 smithi043 ceph-mon[32384]: pgmap v3989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6486.854853 secs 2024-07-26T10:24:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:01 smithi063 ceph-mon[36747]: pgmap v3990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6486.854853 secs 2024-07-26T10:24:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:01 smithi043 ceph-mon[32384]: pgmap v3990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6486.854853 secs 2024-07-26T10:24:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:01 smithi133 ceph-mon[37053]: pgmap v3990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6502.338161 secs 2024-07-26T10:24:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6502.338161 secs 2024-07-26T10:24:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6502.338161 secs 2024-07-26T10:24:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:03 smithi063 ceph-mon[36747]: pgmap v3991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:03 smithi043 ceph-mon[32384]: pgmap v3991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:03 smithi133 ceph-mon[37053]: pgmap v3991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:05 smithi063 ceph-mon[36747]: pgmap v3992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:05 smithi043 ceph-mon[32384]: pgmap v3992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:05 smithi133 ceph-mon[37053]: pgmap v3992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6491.854975 secs 2024-07-26T10:24:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6491.854975 secs 2024-07-26T10:24:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6491.854975 secs 2024-07-26T10:24:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6507.338284 secs 2024-07-26T10:24:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:07 smithi063 ceph-mon[36747]: pgmap v3993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6507.338284 secs 2024-07-26T10:24:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:07 smithi043 ceph-mon[32384]: pgmap v3993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6507.338284 secs 2024-07-26T10:24:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:07 smithi133 ceph-mon[37053]: pgmap v3993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:09 smithi063 ceph-mon[36747]: pgmap v3994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:09 smithi043 ceph-mon[32384]: pgmap v3994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:09 smithi133 ceph-mon[37053]: pgmap v3994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6496.855119 secs 2024-07-26T10:24:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:11 smithi063 ceph-mon[36747]: pgmap v3995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6496.855119 secs 2024-07-26T10:24:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:11 smithi043 ceph-mon[32384]: pgmap v3995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6496.855119 secs 2024-07-26T10:24:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:11 smithi133 ceph-mon[37053]: pgmap v3995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6512.338403 secs 2024-07-26T10:24:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6512.338403 secs 2024-07-26T10:24:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6512.338403 secs 2024-07-26T10:24:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:13 smithi043 ceph-mon[32384]: pgmap v3996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:13 smithi133 ceph-mon[37053]: pgmap v3996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:13 smithi063 ceph-mon[36747]: pgmap v3996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:15 smithi043 ceph-mon[32384]: pgmap v3997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:15 smithi133 ceph-mon[37053]: pgmap v3997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:15 smithi063 ceph-mon[36747]: pgmap v3997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6501.855184 secs 2024-07-26T10:24:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6501.855184 secs 2024-07-26T10:24:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6501.855184 secs 2024-07-26T10:24:17.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6517.338538 secs 2024-07-26T10:24:17.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:17 smithi133 ceph-mon[37053]: pgmap v3998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:17.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:24:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6517.338538 secs 2024-07-26T10:24:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:17 smithi043 ceph-mon[32384]: pgmap v3998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:24:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6517.338538 secs 2024-07-26T10:24:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:17 smithi063 ceph-mon[36747]: pgmap v3998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:24:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:24:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:24:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:18 smithi043 ceph-mon[32384]: pgmap v3999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:18 smithi043 ceph-mon[32384]: pgmap v4000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:18.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:24:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:24:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:24:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:18 smithi133 ceph-mon[37053]: pgmap v3999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:18 smithi133 ceph-mon[37053]: pgmap v4000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:24:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:24:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:24:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:18 smithi063 ceph-mon[36747]: pgmap v3999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:18 smithi063 ceph-mon[36747]: pgmap v4000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:24:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:20 smithi063 ceph-mon[36747]: pgmap v4001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:20 smithi043 ceph-mon[32384]: pgmap v4001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:20 smithi133 ceph-mon[37053]: pgmap v4001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6506.855315 secs 2024-07-26T10:24:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6522.338655 secs 2024-07-26T10:24:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6506.855315 secs 2024-07-26T10:24:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6522.338655 secs 2024-07-26T10:24:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6506.855315 secs 2024-07-26T10:24:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6522.338655 secs 2024-07-26T10:24:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:22 smithi043 ceph-mon[32384]: pgmap v4002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:24:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:22 smithi133 ceph-mon[37053]: pgmap v4002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:24:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:22 smithi063 ceph-mon[36747]: pgmap v4002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:24:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:24 smithi043 ceph-mon[32384]: pgmap v4003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:24:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:24 smithi133 ceph-mon[37053]: pgmap v4003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:24:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:24 smithi063 ceph-mon[36747]: pgmap v4003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:24:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6511.855436 secs 2024-07-26T10:24:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:26 smithi043 ceph-mon[32384]: pgmap v4004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6527.338802 secs 2024-07-26T10:24:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6511.855436 secs 2024-07-26T10:24:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:26 smithi133 ceph-mon[37053]: pgmap v4004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6527.338802 secs 2024-07-26T10:24:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6511.855436 secs 2024-07-26T10:24:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:26 smithi063 ceph-mon[36747]: pgmap v4004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:24:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6527.338802 secs 2024-07-26T10:24:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:28 smithi043 ceph-mon[32384]: pgmap v4005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:24:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:28 smithi133 ceph-mon[37053]: pgmap v4005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:24:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:28 smithi063 ceph-mon[36747]: pgmap v4005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:24:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:30 smithi043 ceph-mon[32384]: pgmap v4006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:30 smithi133 ceph-mon[37053]: pgmap v4006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:30 smithi063 ceph-mon[36747]: pgmap v4006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6516.855548 secs 2024-07-26T10:24:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6532.338920 secs 2024-07-26T10:24:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6516.855548 secs 2024-07-26T10:24:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6532.338920 secs 2024-07-26T10:24:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6516.855548 secs 2024-07-26T10:24:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6532.338920 secs 2024-07-26T10:24:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:32 smithi043 ceph-mon[32384]: pgmap v4007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:32 smithi133 ceph-mon[37053]: pgmap v4007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:32 smithi063 ceph-mon[36747]: pgmap v4007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:34 smithi043 ceph-mon[32384]: pgmap v4008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:34 smithi133 ceph-mon[37053]: pgmap v4008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:34 smithi063 ceph-mon[36747]: pgmap v4008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6521.855667 secs 2024-07-26T10:24:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:36 smithi043 ceph-mon[32384]: pgmap v4009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6537.339034 secs 2024-07-26T10:24:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6521.855667 secs 2024-07-26T10:24:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:36 smithi133 ceph-mon[37053]: pgmap v4009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6537.339034 secs 2024-07-26T10:24:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6521.855667 secs 2024-07-26T10:24:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:36 smithi063 ceph-mon[36747]: pgmap v4009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6537.339034 secs 2024-07-26T10:24:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:38 smithi043 ceph-mon[32384]: pgmap v4010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:38 smithi133 ceph-mon[37053]: pgmap v4010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:38 smithi063 ceph-mon[36747]: pgmap v4010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:40 smithi043 ceph-mon[32384]: pgmap v4011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:40 smithi133 ceph-mon[37053]: pgmap v4011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:40 smithi063 ceph-mon[36747]: pgmap v4011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6526.855786 secs 2024-07-26T10:24:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6542.339156 secs 2024-07-26T10:24:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6526.855786 secs 2024-07-26T10:24:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6542.339156 secs 2024-07-26T10:24:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6526.855786 secs 2024-07-26T10:24:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6542.339156 secs 2024-07-26T10:24:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:42 smithi043 ceph-mon[32384]: pgmap v4012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:42 smithi133 ceph-mon[37053]: pgmap v4012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:42 smithi063 ceph-mon[36747]: pgmap v4012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:44.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:44 smithi043 ceph-mon[32384]: pgmap v4013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:44 smithi133 ceph-mon[37053]: pgmap v4013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:44 smithi063 ceph-mon[36747]: pgmap v4013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6531.855901 secs 2024-07-26T10:24:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:46 smithi043 ceph-mon[32384]: pgmap v4014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6547.339295 secs 2024-07-26T10:24:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6531.855901 secs 2024-07-26T10:24:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:46 smithi133 ceph-mon[37053]: pgmap v4014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6547.339295 secs 2024-07-26T10:24:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6531.855901 secs 2024-07-26T10:24:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:46 smithi063 ceph-mon[36747]: pgmap v4014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6547.339295 secs 2024-07-26T10:24:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:48 smithi043 ceph-mon[32384]: pgmap v4015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:48 smithi133 ceph-mon[37053]: pgmap v4015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:48 smithi063 ceph-mon[36747]: pgmap v4015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:50 smithi043 ceph-mon[32384]: pgmap v4016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:50 smithi133 ceph-mon[37053]: pgmap v4016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:50 smithi063 ceph-mon[36747]: pgmap v4016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:24:51.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6536.856020 secs 2024-07-26T10:24:51.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6552.339409 secs 2024-07-26T10:24:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6536.856020 secs 2024-07-26T10:24:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6552.339409 secs 2024-07-26T10:24:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6536.856020 secs 2024-07-26T10:24:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6552.339409 secs 2024-07-26T10:24:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:52 smithi043 ceph-mon[32384]: pgmap v4017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:52 smithi133 ceph-mon[37053]: pgmap v4017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:52 smithi063 ceph-mon[36747]: pgmap v4017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:24:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:54 smithi043 ceph-mon[32384]: pgmap v4018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:54 smithi133 ceph-mon[37053]: pgmap v4018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:54 smithi063 ceph-mon[36747]: pgmap v4018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6541.856088 secs 2024-07-26T10:24:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:56 smithi043 ceph-mon[32384]: pgmap v4019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6557.339563 secs 2024-07-26T10:24:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6541.856088 secs 2024-07-26T10:24:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:56 smithi133 ceph-mon[37053]: pgmap v4019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6557.339563 secs 2024-07-26T10:24:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6541.856088 secs 2024-07-26T10:24:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:56 smithi063 ceph-mon[36747]: pgmap v4019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6557.339563 secs 2024-07-26T10:24:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:24:58 smithi043 ceph-mon[32384]: pgmap v4020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:24:58 smithi133 ceph-mon[37053]: pgmap v4020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:24:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:24:58 smithi063 ceph-mon[36747]: pgmap v4020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:00 smithi043 ceph-mon[32384]: pgmap v4021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:00 smithi133 ceph-mon[37053]: pgmap v4021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:00 smithi063 ceph-mon[36747]: pgmap v4021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:01.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6546.856182 secs 2024-07-26T10:25:01.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6562.339710 secs 2024-07-26T10:25:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6546.856182 secs 2024-07-26T10:25:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6562.339710 secs 2024-07-26T10:25:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6546.856182 secs 2024-07-26T10:25:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6562.339710 secs 2024-07-26T10:25:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:02 smithi043 ceph-mon[32384]: pgmap v4022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:02 smithi133 ceph-mon[37053]: pgmap v4022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:02 smithi063 ceph-mon[36747]: pgmap v4022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:04 smithi043 ceph-mon[32384]: pgmap v4023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:04 smithi133 ceph-mon[37053]: pgmap v4023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:04 smithi063 ceph-mon[36747]: pgmap v4023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6551.856301 secs 2024-07-26T10:25:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:06 smithi133 ceph-mon[37053]: pgmap v4024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6567.339824 secs 2024-07-26T10:25:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6551.856301 secs 2024-07-26T10:25:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:06 smithi063 ceph-mon[36747]: pgmap v4024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6567.339824 secs 2024-07-26T10:25:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6551.856301 secs 2024-07-26T10:25:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:06 smithi043 ceph-mon[32384]: pgmap v4024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6567.339824 secs 2024-07-26T10:25:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:08 smithi133 ceph-mon[37053]: pgmap v4025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:08 smithi063 ceph-mon[36747]: pgmap v4025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:08 smithi043 ceph-mon[32384]: pgmap v4025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:10 smithi133 ceph-mon[37053]: pgmap v4026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:11.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:10 smithi043 ceph-mon[32384]: pgmap v4026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:10 smithi063 ceph-mon[36747]: pgmap v4026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6556.856423 secs 2024-07-26T10:25:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6572.339953 secs 2024-07-26T10:25:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6556.856423 secs 2024-07-26T10:25:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6572.339953 secs 2024-07-26T10:25:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6556.856423 secs 2024-07-26T10:25:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6572.339953 secs 2024-07-26T10:25:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:12 smithi133 ceph-mon[37053]: pgmap v4027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:12 smithi063 ceph-mon[36747]: pgmap v4027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:12 smithi043 ceph-mon[32384]: pgmap v4027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:14 smithi133 ceph-mon[37053]: pgmap v4028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:14 smithi063 ceph-mon[36747]: pgmap v4028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:14 smithi043 ceph-mon[32384]: pgmap v4028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6561.856550 secs 2024-07-26T10:25:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:16 smithi063 ceph-mon[36747]: pgmap v4029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:17.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6577.340073 secs 2024-07-26T10:25:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6561.856550 secs 2024-07-26T10:25:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:16 smithi043 ceph-mon[32384]: pgmap v4029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6577.340073 secs 2024-07-26T10:25:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6561.856550 secs 2024-07-26T10:25:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:16 smithi133 ceph-mon[37053]: pgmap v4029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6577.340073 secs 2024-07-26T10:25:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:25:18.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:25:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:25:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:18 smithi063 ceph-mon[36747]: pgmap v4030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:25:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:25:19.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:25:19.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:18 smithi043 ceph-mon[32384]: pgmap v4030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:19.100 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:25:19.101 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:25:19.101 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:25:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:18 smithi133 ceph-mon[37053]: pgmap v4030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:25:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:25:19.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:25:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:19 smithi063 ceph-mon[36747]: pgmap v4031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:25:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:19 smithi063 ceph-mon[36747]: pgmap v4032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:25:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:19 smithi043 ceph-mon[32384]: pgmap v4031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:25:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:19 smithi043 ceph-mon[32384]: pgmap v4032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:19 smithi133 ceph-mon[37053]: pgmap v4031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:19 smithi133 ceph-mon[37053]: pgmap v4032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6566.856651 secs 2024-07-26T10:25:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6582.340194 secs 2024-07-26T10:25:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:21 smithi063 ceph-mon[36747]: pgmap v4033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:25:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6566.856651 secs 2024-07-26T10:25:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6582.340194 secs 2024-07-26T10:25:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:21 smithi043 ceph-mon[32384]: pgmap v4033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:25:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6566.856651 secs 2024-07-26T10:25:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6582.340194 secs 2024-07-26T10:25:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:21 smithi133 ceph-mon[37053]: pgmap v4033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:25:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:23 smithi063 ceph-mon[36747]: pgmap v4034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:25:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:23 smithi043 ceph-mon[32384]: pgmap v4034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:25:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:23 smithi133 ceph-mon[37053]: pgmap v4034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:25:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:25 smithi063 ceph-mon[36747]: pgmap v4035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:25:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:25 smithi043 ceph-mon[32384]: pgmap v4035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:25:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:25 smithi133 ceph-mon[37053]: pgmap v4035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6571.856771 secs 2024-07-26T10:25:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6587.340315 secs 2024-07-26T10:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6571.856771 secs 2024-07-26T10:25:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6587.340315 secs 2024-07-26T10:25:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6571.856771 secs 2024-07-26T10:25:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6587.340315 secs 2024-07-26T10:25:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:27 smithi043 ceph-mon[32384]: pgmap v4036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:25:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:27 smithi133 ceph-mon[37053]: pgmap v4036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:25:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:27 smithi063 ceph-mon[36747]: pgmap v4036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:25:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:29 smithi043 ceph-mon[32384]: pgmap v4037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:25:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:29 smithi133 ceph-mon[37053]: pgmap v4037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:25:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:29 smithi063 ceph-mon[36747]: pgmap v4037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:25:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6576.856914 secs 2024-07-26T10:25:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6592.340388 secs 2024-07-26T10:25:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:31 smithi043 ceph-mon[32384]: pgmap v4038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6576.856914 secs 2024-07-26T10:25:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6592.340388 secs 2024-07-26T10:25:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:31 smithi133 ceph-mon[37053]: pgmap v4038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6576.856914 secs 2024-07-26T10:25:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6592.340388 secs 2024-07-26T10:25:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:31 smithi063 ceph-mon[36747]: pgmap v4038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:33 smithi043 ceph-mon[32384]: pgmap v4039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:33 smithi133 ceph-mon[37053]: pgmap v4039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:33 smithi063 ceph-mon[36747]: pgmap v4039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:35 smithi043 ceph-mon[32384]: pgmap v4040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:35 smithi133 ceph-mon[37053]: pgmap v4040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:35 smithi063 ceph-mon[36747]: pgmap v4040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6581.857046 secs 2024-07-26T10:25:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6597.340517 secs 2024-07-26T10:25:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6581.857046 secs 2024-07-26T10:25:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6597.340517 secs 2024-07-26T10:25:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6581.857046 secs 2024-07-26T10:25:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6597.340517 secs 2024-07-26T10:25:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:37 smithi043 ceph-mon[32384]: pgmap v4041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:37 smithi133 ceph-mon[37053]: pgmap v4041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:37 smithi063 ceph-mon[36747]: pgmap v4041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:39 smithi043 ceph-mon[32384]: pgmap v4042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:39 smithi133 ceph-mon[37053]: pgmap v4042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:39 smithi063 ceph-mon[36747]: pgmap v4042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6586.857163 secs 2024-07-26T10:25:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6602.340644 secs 2024-07-26T10:25:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:41 smithi043 ceph-mon[32384]: pgmap v4043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6586.857163 secs 2024-07-26T10:25:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6602.340644 secs 2024-07-26T10:25:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:41 smithi133 ceph-mon[37053]: pgmap v4043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6586.857163 secs 2024-07-26T10:25:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6602.340644 secs 2024-07-26T10:25:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:41 smithi063 ceph-mon[36747]: pgmap v4043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:43 smithi043 ceph-mon[32384]: pgmap v4044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:43 smithi133 ceph-mon[37053]: pgmap v4044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:43 smithi063 ceph-mon[36747]: pgmap v4044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:45 smithi043 ceph-mon[32384]: pgmap v4045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:45 smithi133 ceph-mon[37053]: pgmap v4045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:45 smithi063 ceph-mon[36747]: pgmap v4045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6591.857298 secs 2024-07-26T10:25:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6607.340785 secs 2024-07-26T10:25:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6591.857298 secs 2024-07-26T10:25:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6607.340785 secs 2024-07-26T10:25:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6591.857298 secs 2024-07-26T10:25:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6607.340785 secs 2024-07-26T10:25:48.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:47 smithi133 ceph-mon[37053]: pgmap v4046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:47 smithi043 ceph-mon[32384]: pgmap v4046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:47 smithi063 ceph-mon[36747]: pgmap v4046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:49 smithi043 ceph-mon[32384]: pgmap v4047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:49 smithi133 ceph-mon[37053]: pgmap v4047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:49 smithi063 ceph-mon[36747]: pgmap v4047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6596.857418 secs 2024-07-26T10:25:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6612.340899 secs 2024-07-26T10:25:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:51 smithi043 ceph-mon[32384]: pgmap v4048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6596.857418 secs 2024-07-26T10:25:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6612.340899 secs 2024-07-26T10:25:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:51 smithi133 ceph-mon[37053]: pgmap v4048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6596.857418 secs 2024-07-26T10:25:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6612.340899 secs 2024-07-26T10:25:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:51 smithi063 ceph-mon[36747]: pgmap v4048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:53 smithi043 ceph-mon[32384]: pgmap v4049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:53 smithi133 ceph-mon[37053]: pgmap v4049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:53 smithi063 ceph-mon[36747]: pgmap v4049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:55 smithi043 ceph-mon[32384]: pgmap v4050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:55 smithi133 ceph-mon[37053]: pgmap v4050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:55 smithi063 ceph-mon[36747]: pgmap v4050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:25:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6601.857567 secs 2024-07-26T10:25:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6617.341014 secs 2024-07-26T10:25:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6601.857567 secs 2024-07-26T10:25:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6617.341014 secs 2024-07-26T10:25:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6601.857567 secs 2024-07-26T10:25:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6617.341014 secs 2024-07-26T10:25:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:57 smithi043 ceph-mon[32384]: pgmap v4051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:57 smithi133 ceph-mon[37053]: pgmap v4051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:57 smithi063 ceph-mon[36747]: pgmap v4051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:25:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:25:58 smithi043 ceph-mon[32384]: pgmap v4052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:25:58 smithi133 ceph-mon[37053]: pgmap v4052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:25:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:25:58 smithi063 ceph-mon[36747]: pgmap v4052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6606.857700 secs 2024-07-26T10:26:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6622.341139 secs 2024-07-26T10:26:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:01 smithi043 ceph-mon[32384]: pgmap v4053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6606.857700 secs 2024-07-26T10:26:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6622.341139 secs 2024-07-26T10:26:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:01 smithi133 ceph-mon[37053]: pgmap v4053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6606.857700 secs 2024-07-26T10:26:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6622.341139 secs 2024-07-26T10:26:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:01 smithi063 ceph-mon[36747]: pgmap v4053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:03 smithi043 ceph-mon[32384]: pgmap v4054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:03 smithi133 ceph-mon[37053]: pgmap v4054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:03 smithi063 ceph-mon[36747]: pgmap v4054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:05 smithi043 ceph-mon[32384]: pgmap v4055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:05 smithi133 ceph-mon[37053]: pgmap v4055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:05 smithi063 ceph-mon[36747]: pgmap v4055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6611.857829 secs 2024-07-26T10:26:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6627.341262 secs 2024-07-26T10:26:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6611.857829 secs 2024-07-26T10:26:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6627.341262 secs 2024-07-26T10:26:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6611.857829 secs 2024-07-26T10:26:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6627.341262 secs 2024-07-26T10:26:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:07 smithi043 ceph-mon[32384]: pgmap v4056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:07 smithi133 ceph-mon[37053]: pgmap v4056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:07 smithi063 ceph-mon[36747]: pgmap v4056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:09 smithi043 ceph-mon[32384]: pgmap v4057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:09 smithi133 ceph-mon[37053]: pgmap v4057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:09 smithi063 ceph-mon[36747]: pgmap v4057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6616.857909 secs 2024-07-26T10:26:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6632.341326 secs 2024-07-26T10:26:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:11 smithi043 ceph-mon[32384]: pgmap v4058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6616.857909 secs 2024-07-26T10:26:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6632.341326 secs 2024-07-26T10:26:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:11 smithi133 ceph-mon[37053]: pgmap v4058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6616.857909 secs 2024-07-26T10:26:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6632.341326 secs 2024-07-26T10:26:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:11 smithi063 ceph-mon[36747]: pgmap v4058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:13 smithi043 ceph-mon[32384]: pgmap v4059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:13 smithi133 ceph-mon[37053]: pgmap v4059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:13 smithi063 ceph-mon[36747]: pgmap v4059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:15 smithi043 ceph-mon[32384]: pgmap v4060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:15 smithi133 ceph-mon[37053]: pgmap v4060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:15 smithi063 ceph-mon[36747]: pgmap v4060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6621.858032 secs 2024-07-26T10:26:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6637.341442 secs 2024-07-26T10:26:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6621.858032 secs 2024-07-26T10:26:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6637.341442 secs 2024-07-26T10:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6621.858032 secs 2024-07-26T10:26:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6637.341442 secs 2024-07-26T10:26:18.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:17 smithi133 ceph-mon[37053]: pgmap v4061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:17 smithi043 ceph-mon[32384]: pgmap v4061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:17 smithi063 ceph-mon[36747]: pgmap v4061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:19 smithi043 ceph-mon[32384]: pgmap v4062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:26:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:19 smithi133 ceph-mon[37053]: pgmap v4062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:26:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:19 smithi063 ceph-mon[36747]: pgmap v4062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:26:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:26:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:26:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:26:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:26:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:26:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:26:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:26:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:26:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:26:22.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:21 smithi063 ceph-mon[36747]: pgmap v4063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:26:22.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:21 smithi063 ceph-mon[36747]: pgmap v4064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:26:22.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6626.858095 secs 2024-07-26T10:26:22.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6642.341584 secs 2024-07-26T10:26:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:21 smithi043 ceph-mon[32384]: pgmap v4063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:26:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:21 smithi043 ceph-mon[32384]: pgmap v4064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:26:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6626.858095 secs 2024-07-26T10:26:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6642.341584 secs 2024-07-26T10:26:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:21 smithi133 ceph-mon[37053]: pgmap v4063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:26:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:21 smithi133 ceph-mon[37053]: pgmap v4064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:26:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6626.858095 secs 2024-07-26T10:26:22.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6642.341584 secs 2024-07-26T10:26:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:23 smithi043 ceph-mon[32384]: pgmap v4065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:26:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:23 smithi133 ceph-mon[37053]: pgmap v4065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:26:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:23 smithi063 ceph-mon[36747]: pgmap v4065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:26:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:25 smithi043 ceph-mon[32384]: pgmap v4066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:26:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:25 smithi133 ceph-mon[37053]: pgmap v4066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:26:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:25 smithi063 ceph-mon[36747]: pgmap v4066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:26:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6631.858236 secs 2024-07-26T10:26:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6647.341685 secs 2024-07-26T10:26:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6631.858236 secs 2024-07-26T10:26:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6647.341685 secs 2024-07-26T10:26:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6631.858236 secs 2024-07-26T10:26:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6647.341685 secs 2024-07-26T10:26:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:27 smithi043 ceph-mon[32384]: pgmap v4067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:26:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:27 smithi133 ceph-mon[37053]: pgmap v4067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:26:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:27 smithi063 ceph-mon[36747]: pgmap v4067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:26:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:28 smithi043 ceph-mon[32384]: pgmap v4068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:28 smithi133 ceph-mon[37053]: pgmap v4068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:28 smithi063 ceph-mon[36747]: pgmap v4068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:31 smithi043 ceph-mon[32384]: pgmap v4069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:26:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:31 smithi133 ceph-mon[37053]: pgmap v4069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:26:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:31 smithi063 ceph-mon[36747]: pgmap v4069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:26:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:32 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6636.858362 secs 2024-07-26T10:26:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6652.341821 secs 2024-07-26T10:26:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:32 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6636.858362 secs 2024-07-26T10:26:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6652.341821 secs 2024-07-26T10:26:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:32 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6636.858362 secs 2024-07-26T10:26:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6652.341821 secs 2024-07-26T10:26:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:33 smithi043 ceph-mon[32384]: pgmap v4070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:26:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:33 smithi133 ceph-mon[37053]: pgmap v4070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:33 smithi063 ceph-mon[36747]: pgmap v4070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:26:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:35 smithi043 ceph-mon[32384]: pgmap v4071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:26:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:35 smithi133 ceph-mon[37053]: pgmap v4071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:26:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:35 smithi063 ceph-mon[36747]: pgmap v4071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:26:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:37 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6641.858462 secs 2024-07-26T10:26:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6657.341961 secs 2024-07-26T10:26:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:37 smithi043 ceph-mon[32384]: pgmap v4072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:26:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:37 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6641.858462 secs 2024-07-26T10:26:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6657.341961 secs 2024-07-26T10:26:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:37 smithi133 ceph-mon[37053]: pgmap v4072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:26:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:37 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6641.858462 secs 2024-07-26T10:26:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6657.341961 secs 2024-07-26T10:26:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:37 smithi063 ceph-mon[36747]: pgmap v4072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:26:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:39 smithi043 ceph-mon[32384]: pgmap v4073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:26:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:39 smithi133 ceph-mon[37053]: pgmap v4073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:26:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:39 smithi063 ceph-mon[36747]: pgmap v4073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:26:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:41 smithi043 ceph-mon[32384]: pgmap v4074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:41 smithi133 ceph-mon[37053]: pgmap v4074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:41 smithi063 ceph-mon[36747]: pgmap v4074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:42.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:42 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6646.858589 secs 2024-07-26T10:26:42.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6662.342081 secs 2024-07-26T10:26:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:42 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6646.858589 secs 2024-07-26T10:26:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6662.342081 secs 2024-07-26T10:26:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:42 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6646.858589 secs 2024-07-26T10:26:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6662.342081 secs 2024-07-26T10:26:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:43 smithi043 ceph-mon[32384]: pgmap v4075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:43 smithi133 ceph-mon[37053]: pgmap v4075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:43 smithi063 ceph-mon[36747]: pgmap v4075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:45 smithi043 ceph-mon[32384]: pgmap v4076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:45 smithi133 ceph-mon[37053]: pgmap v4076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:45 smithi063 ceph-mon[36747]: pgmap v4076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6651.858735 secs 2024-07-26T10:26:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6651.858735 secs 2024-07-26T10:26:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6651.858735 secs 2024-07-26T10:26:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6667.342199 secs 2024-07-26T10:26:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:47 smithi043 ceph-mon[32384]: pgmap v4077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6667.342199 secs 2024-07-26T10:26:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:47 smithi133 ceph-mon[37053]: pgmap v4077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6667.342199 secs 2024-07-26T10:26:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:47 smithi063 ceph-mon[36747]: pgmap v4077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:49 smithi043 ceph-mon[32384]: pgmap v4078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:49 smithi133 ceph-mon[37053]: pgmap v4078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:49 smithi063 ceph-mon[36747]: pgmap v4078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:51 smithi043 ceph-mon[32384]: pgmap v4079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6656.858884 secs 2024-07-26T10:26:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:51 smithi133 ceph-mon[37053]: pgmap v4079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6656.858884 secs 2024-07-26T10:26:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:51 smithi063 ceph-mon[36747]: pgmap v4079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:26:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6656.858884 secs 2024-07-26T10:26:52.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6672.342319 secs 2024-07-26T10:26:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6672.342319 secs 2024-07-26T10:26:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6672.342319 secs 2024-07-26T10:26:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:53 smithi043 ceph-mon[32384]: pgmap v4080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:53 smithi133 ceph-mon[37053]: pgmap v4080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:53 smithi063 ceph-mon[36747]: pgmap v4080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:55 smithi043 ceph-mon[32384]: pgmap v4081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:55 smithi133 ceph-mon[37053]: pgmap v4081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:55 smithi063 ceph-mon[36747]: pgmap v4081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6661.858985 secs 2024-07-26T10:26:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6661.858985 secs 2024-07-26T10:26:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6661.858985 secs 2024-07-26T10:26:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6677.342383 secs 2024-07-26T10:26:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:57 smithi043 ceph-mon[32384]: pgmap v4082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6677.342383 secs 2024-07-26T10:26:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:57 smithi133 ceph-mon[37053]: pgmap v4082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6677.342383 secs 2024-07-26T10:26:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:57 smithi063 ceph-mon[36747]: pgmap v4082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:26:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:26:59 smithi043 ceph-mon[32384]: pgmap v4083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:26:59 smithi133 ceph-mon[37053]: pgmap v4083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:26:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:26:59 smithi063 ceph-mon[36747]: pgmap v4083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:01 smithi043 ceph-mon[32384]: pgmap v4084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6666.859051 secs 2024-07-26T10:27:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:01 smithi133 ceph-mon[37053]: pgmap v4084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6666.859051 secs 2024-07-26T10:27:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:01 smithi063 ceph-mon[36747]: pgmap v4084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6666.859051 secs 2024-07-26T10:27:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6682.342525 secs 2024-07-26T10:27:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6682.342525 secs 2024-07-26T10:27:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6682.342525 secs 2024-07-26T10:27:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:03 smithi043 ceph-mon[32384]: pgmap v4085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:03 smithi133 ceph-mon[37053]: pgmap v4085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:03 smithi063 ceph-mon[36747]: pgmap v4085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:05 smithi043 ceph-mon[32384]: pgmap v4086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:05 smithi133 ceph-mon[37053]: pgmap v4086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:05 smithi063 ceph-mon[36747]: pgmap v4086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6671.859175 secs 2024-07-26T10:27:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6671.859175 secs 2024-07-26T10:27:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6671.859175 secs 2024-07-26T10:27:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6687.342645 secs 2024-07-26T10:27:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:07 smithi043 ceph-mon[32384]: pgmap v4087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6687.342645 secs 2024-07-26T10:27:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:07 smithi133 ceph-mon[37053]: pgmap v4087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6687.342645 secs 2024-07-26T10:27:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:07 smithi063 ceph-mon[36747]: pgmap v4087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:09 smithi133 ceph-mon[37053]: pgmap v4088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:09 smithi063 ceph-mon[36747]: pgmap v4088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:09 smithi043 ceph-mon[32384]: pgmap v4088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:11 smithi133 ceph-mon[37053]: pgmap v4089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6676.859272 secs 2024-07-26T10:27:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:11 smithi063 ceph-mon[36747]: pgmap v4089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6676.859272 secs 2024-07-26T10:27:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:11 smithi043 ceph-mon[32384]: pgmap v4089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6676.859272 secs 2024-07-26T10:27:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6692.342744 secs 2024-07-26T10:27:12.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6692.342744 secs 2024-07-26T10:27:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6692.342744 secs 2024-07-26T10:27:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:13 smithi063 ceph-mon[36747]: pgmap v4090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:13 smithi043 ceph-mon[32384]: pgmap v4090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:13 smithi133 ceph-mon[37053]: pgmap v4090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:15 smithi063 ceph-mon[36747]: pgmap v4091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:15 smithi043 ceph-mon[32384]: pgmap v4091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:15 smithi133 ceph-mon[37053]: pgmap v4091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6681.859392 secs 2024-07-26T10:27:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6681.859392 secs 2024-07-26T10:27:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6681.859392 secs 2024-07-26T10:27:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6697.342823 secs 2024-07-26T10:27:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:17 smithi063 ceph-mon[36747]: pgmap v4092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6697.342823 secs 2024-07-26T10:27:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:17 smithi043 ceph-mon[32384]: pgmap v4092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6697.342823 secs 2024-07-26T10:27:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:17 smithi133 ceph-mon[37053]: pgmap v4092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:19 smithi063 ceph-mon[36747]: pgmap v4093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:19.568 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:19 smithi133 ceph-mon[37053]: pgmap v4093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:19 smithi043 ceph-mon[32384]: pgmap v4093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:27:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:27:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:27:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:21 smithi063 ceph-mon[36747]: pgmap v4094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6686.859458 secs 2024-07-26T10:27:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:21 smithi043 ceph-mon[32384]: pgmap v4094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6686.859458 secs 2024-07-26T10:27:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:21 smithi133 ceph-mon[37053]: pgmap v4094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6686.859458 secs 2024-07-26T10:27:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6702.342901 secs 2024-07-26T10:27:22.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:27:22.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:27:22.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:22 smithi043 ceph-mon[32384]: pgmap v4095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:27:22.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:22 smithi043 ceph-mon[32384]: pgmap v4096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:27:22.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:22 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6702.342901 secs 2024-07-26T10:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:22 smithi133 ceph-mon[37053]: pgmap v4095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:27:22.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:22 smithi133 ceph-mon[37053]: pgmap v4096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:27:22.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:22 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6702.342901 secs 2024-07-26T10:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:27:22.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:27:22.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:22 smithi063 ceph-mon[36747]: pgmap v4095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:27:22.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:22 smithi063 ceph-mon[36747]: pgmap v4096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:27:22.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:22 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:27:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:24 smithi043 ceph-mon[32384]: pgmap v4097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:27:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:24 smithi133 ceph-mon[37053]: pgmap v4097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:27:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:24 smithi063 ceph-mon[36747]: pgmap v4097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:27:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6691.859588 secs 2024-07-26T10:27:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:26 smithi043 ceph-mon[32384]: pgmap v4098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:27:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6691.859588 secs 2024-07-26T10:27:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:26 smithi133 ceph-mon[37053]: pgmap v4098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:27:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6691.859588 secs 2024-07-26T10:27:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:26 smithi063 ceph-mon[36747]: pgmap v4098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:27:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6707.342983 secs 2024-07-26T10:27:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6707.342983 secs 2024-07-26T10:27:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6707.342983 secs 2024-07-26T10:27:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:28 smithi043 ceph-mon[32384]: pgmap v4099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:27:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:28 smithi133 ceph-mon[37053]: pgmap v4099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:27:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:28 smithi063 ceph-mon[36747]: pgmap v4099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:27:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:30 smithi043 ceph-mon[32384]: pgmap v4100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:27:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:30 smithi133 ceph-mon[37053]: pgmap v4100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:27:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:30 smithi063 ceph-mon[36747]: pgmap v4100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:27:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6696.859687 secs 2024-07-26T10:27:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6696.859687 secs 2024-07-26T10:27:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6696.859687 secs 2024-07-26T10:27:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6712.343102 secs 2024-07-26T10:27:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:32 smithi043 ceph-mon[32384]: pgmap v4101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:27:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6712.343102 secs 2024-07-26T10:27:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:32 smithi133 ceph-mon[37053]: pgmap v4101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:27:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6712.343102 secs 2024-07-26T10:27:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:32 smithi063 ceph-mon[36747]: pgmap v4101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:27:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:34 smithi043 ceph-mon[32384]: pgmap v4102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:34 smithi133 ceph-mon[37053]: pgmap v4102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:34 smithi063 ceph-mon[36747]: pgmap v4102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6701.859805 secs 2024-07-26T10:27:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:36 smithi043 ceph-mon[32384]: pgmap v4103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6701.859805 secs 2024-07-26T10:27:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:36 smithi133 ceph-mon[37053]: pgmap v4103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6701.859805 secs 2024-07-26T10:27:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:36 smithi063 ceph-mon[36747]: pgmap v4103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6717.343184 secs 2024-07-26T10:27:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6717.343184 secs 2024-07-26T10:27:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6717.343184 secs 2024-07-26T10:27:38.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:38 smithi043 ceph-mon[32384]: pgmap v4104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:38 smithi133 ceph-mon[37053]: pgmap v4104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:38 smithi063 ceph-mon[36747]: pgmap v4104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:40 smithi043 ceph-mon[32384]: pgmap v4105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:40 smithi133 ceph-mon[37053]: pgmap v4105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:40 smithi063 ceph-mon[36747]: pgmap v4105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6706.859961 secs 2024-07-26T10:27:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6706.859961 secs 2024-07-26T10:27:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6706.859961 secs 2024-07-26T10:27:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6722.343253 secs 2024-07-26T10:27:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:42 smithi043 ceph-mon[32384]: pgmap v4106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6722.343253 secs 2024-07-26T10:27:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:42 smithi133 ceph-mon[37053]: pgmap v4106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6722.343253 secs 2024-07-26T10:27:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:42 smithi063 ceph-mon[36747]: pgmap v4106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:44 smithi043 ceph-mon[32384]: pgmap v4107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:44 smithi133 ceph-mon[37053]: pgmap v4107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:44 smithi063 ceph-mon[36747]: pgmap v4107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6711.860091 secs 2024-07-26T10:27:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:46 smithi133 ceph-mon[37053]: pgmap v4108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6711.860091 secs 2024-07-26T10:27:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:46 smithi063 ceph-mon[36747]: pgmap v4108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6711.860091 secs 2024-07-26T10:27:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:46 smithi043 ceph-mon[32384]: pgmap v4108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6727.343363 secs 2024-07-26T10:27:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6727.343363 secs 2024-07-26T10:27:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6727.343363 secs 2024-07-26T10:27:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:48 smithi133 ceph-mon[37053]: pgmap v4109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:48 smithi063 ceph-mon[36747]: pgmap v4109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:48 smithi043 ceph-mon[32384]: pgmap v4109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:50 smithi133 ceph-mon[37053]: pgmap v4110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:50 smithi063 ceph-mon[36747]: pgmap v4110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:50 smithi043 ceph-mon[32384]: pgmap v4110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6716.860252 secs 2024-07-26T10:27:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6732.343498 secs 2024-07-26T10:27:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6716.860252 secs 2024-07-26T10:27:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6732.343498 secs 2024-07-26T10:27:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6716.860252 secs 2024-07-26T10:27:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6732.343498 secs 2024-07-26T10:27:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:52 smithi063 ceph-mon[36747]: pgmap v4111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:52 smithi043 ceph-mon[32384]: pgmap v4111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:52 smithi133 ceph-mon[37053]: pgmap v4111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:27:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:54 smithi063 ceph-mon[36747]: pgmap v4112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:54 smithi043 ceph-mon[32384]: pgmap v4112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:54 smithi133 ceph-mon[37053]: pgmap v4112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6721.860382 secs 2024-07-26T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:56 smithi063 ceph-mon[36747]: pgmap v4113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6737.343619 secs 2024-07-26T10:27:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6721.860382 secs 2024-07-26T10:27:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:56 smithi043 ceph-mon[32384]: pgmap v4113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6737.343619 secs 2024-07-26T10:27:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6721.860382 secs 2024-07-26T10:27:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:56 smithi133 ceph-mon[37053]: pgmap v4113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:27:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6737.343619 secs 2024-07-26T10:27:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:27:58 smithi063 ceph-mon[36747]: pgmap v4114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:27:58 smithi043 ceph-mon[32384]: pgmap v4114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:27:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:27:58 smithi133 ceph-mon[37053]: pgmap v4114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:00 smithi063 ceph-mon[36747]: pgmap v4115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:00 smithi043 ceph-mon[32384]: pgmap v4115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:00 smithi133 ceph-mon[37053]: pgmap v4115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6726.860497 secs 2024-07-26T10:28:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6742.343690 secs 2024-07-26T10:28:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6726.860497 secs 2024-07-26T10:28:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6742.343690 secs 2024-07-26T10:28:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6726.860497 secs 2024-07-26T10:28:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6742.343690 secs 2024-07-26T10:28:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:02 smithi063 ceph-mon[36747]: pgmap v4116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:02 smithi043 ceph-mon[32384]: pgmap v4116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:02 smithi133 ceph-mon[37053]: pgmap v4116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:04 smithi063 ceph-mon[36747]: pgmap v4117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:04 smithi043 ceph-mon[32384]: pgmap v4117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:04 smithi133 ceph-mon[37053]: pgmap v4117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6731.860623 secs 2024-07-26T10:28:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:06 smithi063 ceph-mon[36747]: pgmap v4118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6747.343828 secs 2024-07-26T10:28:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6731.860623 secs 2024-07-26T10:28:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:06 smithi043 ceph-mon[32384]: pgmap v4118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6747.343828 secs 2024-07-26T10:28:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6731.860623 secs 2024-07-26T10:28:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:06 smithi133 ceph-mon[37053]: pgmap v4118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6747.343828 secs 2024-07-26T10:28:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:08 smithi043 ceph-mon[32384]: pgmap v4119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:08 smithi133 ceph-mon[37053]: pgmap v4119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:08 smithi063 ceph-mon[36747]: pgmap v4119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:10 smithi043 ceph-mon[32384]: pgmap v4120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:10 smithi133 ceph-mon[37053]: pgmap v4120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:10 smithi063 ceph-mon[36747]: pgmap v4120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6736.860759 secs 2024-07-26T10:28:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6752.343942 secs 2024-07-26T10:28:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6736.860759 secs 2024-07-26T10:28:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6752.343942 secs 2024-07-26T10:28:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6736.860759 secs 2024-07-26T10:28:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6752.343942 secs 2024-07-26T10:28:12.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:12 smithi043 ceph-mon[32384]: pgmap v4121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:12 smithi133 ceph-mon[37053]: pgmap v4121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:12 smithi063 ceph-mon[36747]: pgmap v4121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:14 smithi043 ceph-mon[32384]: pgmap v4122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:14 smithi133 ceph-mon[37053]: pgmap v4122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:14 smithi063 ceph-mon[36747]: pgmap v4122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6741.860892 secs 2024-07-26T10:28:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:16 smithi043 ceph-mon[32384]: pgmap v4123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6757.344010 secs 2024-07-26T10:28:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6741.860892 secs 2024-07-26T10:28:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:16 smithi133 ceph-mon[37053]: pgmap v4123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6757.344010 secs 2024-07-26T10:28:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6741.860892 secs 2024-07-26T10:28:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:16 smithi063 ceph-mon[36747]: pgmap v4123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6757.344010 secs 2024-07-26T10:28:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:18 smithi043 ceph-mon[32384]: pgmap v4124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:18 smithi133 ceph-mon[37053]: pgmap v4124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:18 smithi063 ceph-mon[36747]: pgmap v4124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:20 smithi043 ceph-mon[32384]: pgmap v4125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:20 smithi133 ceph-mon[37053]: pgmap v4125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:20 smithi063 ceph-mon[36747]: pgmap v4125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6746.861013 secs 2024-07-26T10:28:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6762.344101 secs 2024-07-26T10:28:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:28:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6746.861013 secs 2024-07-26T10:28:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6762.344101 secs 2024-07-26T10:28:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:28:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6746.861013 secs 2024-07-26T10:28:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6762.344101 secs 2024-07-26T10:28:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:28:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:22 smithi063 ceph-mon[36747]: pgmap v4126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:28:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:28:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:22 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:28:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:22 smithi043 ceph-mon[32384]: pgmap v4126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:28:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:28:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:22 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:28:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:22 smithi133 ceph-mon[37053]: pgmap v4126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:28:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:28:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:22 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:28:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:23 smithi043 ceph-mon[32384]: pgmap v4127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:23 smithi043 ceph-mon[32384]: pgmap v4128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:28:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:23 smithi133 ceph-mon[37053]: pgmap v4127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:23 smithi133 ceph-mon[37053]: pgmap v4128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:28:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:23 smithi063 ceph-mon[36747]: pgmap v4127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:23 smithi063 ceph-mon[36747]: pgmap v4128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:28:25.979 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:25 smithi043 ceph-mon[32384]: pgmap v4129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:25 smithi133 ceph-mon[37053]: pgmap v4129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:25 smithi063 ceph-mon[36747]: pgmap v4129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6751.861132 secs 2024-07-26T10:28:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6767.344224 secs 2024-07-26T10:28:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6751.861132 secs 2024-07-26T10:28:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6767.344224 secs 2024-07-26T10:28:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6751.861132 secs 2024-07-26T10:28:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6767.344224 secs 2024-07-26T10:28:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:27 smithi043 ceph-mon[32384]: pgmap v4130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:28:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:27 smithi133 ceph-mon[37053]: pgmap v4130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:28:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:27 smithi063 ceph-mon[36747]: pgmap v4130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:28:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:29 smithi043 ceph-mon[32384]: pgmap v4131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:29 smithi133 ceph-mon[37053]: pgmap v4131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:29 smithi063 ceph-mon[36747]: pgmap v4131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6756.861257 secs 2024-07-26T10:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:31 smithi043 ceph-mon[32384]: pgmap v4132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6772.344347 secs 2024-07-26T10:28:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6756.861257 secs 2024-07-26T10:28:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:31 smithi133 ceph-mon[37053]: pgmap v4132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6772.344347 secs 2024-07-26T10:28:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6756.861257 secs 2024-07-26T10:28:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:31 smithi063 ceph-mon[36747]: pgmap v4132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:28:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6772.344347 secs 2024-07-26T10:28:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:33 smithi043 ceph-mon[32384]: pgmap v4133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:28:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:33 smithi133 ceph-mon[37053]: pgmap v4133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:28:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:33 smithi063 ceph-mon[36747]: pgmap v4133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:28:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:35 smithi043 ceph-mon[32384]: pgmap v4134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:35 smithi133 ceph-mon[37053]: pgmap v4134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:35 smithi063 ceph-mon[36747]: pgmap v4134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6761.861342 secs 2024-07-26T10:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6777.344464 secs 2024-07-26T10:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6761.861342 secs 2024-07-26T10:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6777.344464 secs 2024-07-26T10:28:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6761.861342 secs 2024-07-26T10:28:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6777.344464 secs 2024-07-26T10:28:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:37 smithi043 ceph-mon[32384]: pgmap v4135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:37 smithi133 ceph-mon[37053]: pgmap v4135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:37 smithi063 ceph-mon[36747]: pgmap v4135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:39 smithi043 ceph-mon[32384]: pgmap v4136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:39 smithi133 ceph-mon[37053]: pgmap v4136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:39 smithi063 ceph-mon[36747]: pgmap v4136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6766.861465 secs 2024-07-26T10:28:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:41 smithi043 ceph-mon[32384]: pgmap v4137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6782.344538 secs 2024-07-26T10:28:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6766.861465 secs 2024-07-26T10:28:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:41 smithi133 ceph-mon[37053]: pgmap v4137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6782.344538 secs 2024-07-26T10:28:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6766.861465 secs 2024-07-26T10:28:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:41 smithi063 ceph-mon[36747]: pgmap v4137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6782.344538 secs 2024-07-26T10:28:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:43 smithi043 ceph-mon[32384]: pgmap v4138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:43 smithi133 ceph-mon[37053]: pgmap v4138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:43 smithi063 ceph-mon[36747]: pgmap v4138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:45 smithi043 ceph-mon[32384]: pgmap v4139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:45 smithi133 ceph-mon[37053]: pgmap v4139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:45 smithi063 ceph-mon[36747]: pgmap v4139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6771.861587 secs 2024-07-26T10:28:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6787.344675 secs 2024-07-26T10:28:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6771.861587 secs 2024-07-26T10:28:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6787.344675 secs 2024-07-26T10:28:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6771.861587 secs 2024-07-26T10:28:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6787.344675 secs 2024-07-26T10:28:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:47 smithi043 ceph-mon[32384]: pgmap v4140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:47 smithi133 ceph-mon[37053]: pgmap v4140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:47 smithi063 ceph-mon[36747]: pgmap v4140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:49 smithi043 ceph-mon[32384]: pgmap v4141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:49 smithi133 ceph-mon[37053]: pgmap v4141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:49 smithi063 ceph-mon[36747]: pgmap v4141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6776.861726 secs 2024-07-26T10:28:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6792.344795 secs 2024-07-26T10:28:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:51 smithi133 ceph-mon[37053]: pgmap v4142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6776.861726 secs 2024-07-26T10:28:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6792.344795 secs 2024-07-26T10:28:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:51 smithi063 ceph-mon[36747]: pgmap v4142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6776.861726 secs 2024-07-26T10:28:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6792.344795 secs 2024-07-26T10:28:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:51 smithi043 ceph-mon[32384]: pgmap v4142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:53 smithi133 ceph-mon[37053]: pgmap v4143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:53 smithi063 ceph-mon[36747]: pgmap v4143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:53 smithi043 ceph-mon[32384]: pgmap v4143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:28:56.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:55 smithi133 ceph-mon[37053]: pgmap v4144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:55 smithi063 ceph-mon[36747]: pgmap v4144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:55 smithi043 ceph-mon[32384]: pgmap v4144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:28:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6781.861844 secs 2024-07-26T10:28:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6797.344888 secs 2024-07-26T10:28:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6781.861844 secs 2024-07-26T10:28:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6797.344888 secs 2024-07-26T10:28:57.211 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6781.861844 secs 2024-07-26T10:28:57.211 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6797.344888 secs 2024-07-26T10:28:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:57 smithi133 ceph-mon[37053]: pgmap v4145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:57 smithi063 ceph-mon[36747]: pgmap v4145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:28:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:57 smithi043 ceph-mon[32384]: pgmap v4145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:28:59 smithi063 ceph-mon[36747]: pgmap v4146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:28:59 smithi043 ceph-mon[32384]: pgmap v4146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:28:59 smithi133 ceph-mon[37053]: pgmap v4146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6786.861985 secs 2024-07-26T10:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6802.345012 secs 2024-07-26T10:29:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:01 smithi063 ceph-mon[36747]: pgmap v4147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6786.861985 secs 2024-07-26T10:29:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6802.345012 secs 2024-07-26T10:29:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:01 smithi043 ceph-mon[32384]: pgmap v4147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6786.861985 secs 2024-07-26T10:29:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6802.345012 secs 2024-07-26T10:29:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:01 smithi133 ceph-mon[37053]: pgmap v4147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:03 smithi063 ceph-mon[36747]: pgmap v4148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:29:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:03 smithi043 ceph-mon[32384]: pgmap v4148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:29:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:03 smithi133 ceph-mon[37053]: pgmap v4148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:29:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:05 smithi063 ceph-mon[36747]: pgmap v4149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:29:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:05 smithi043 ceph-mon[32384]: pgmap v4149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:29:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:05 smithi133 ceph-mon[37053]: pgmap v4149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:29:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6791.862127 secs 2024-07-26T10:29:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6807.345117 secs 2024-07-26T10:29:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6791.862127 secs 2024-07-26T10:29:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6807.345117 secs 2024-07-26T10:29:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6791.862127 secs 2024-07-26T10:29:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6807.345117 secs 2024-07-26T10:29:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:07 smithi063 ceph-mon[36747]: pgmap v4150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:07 smithi043 ceph-mon[32384]: pgmap v4150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:07 smithi133 ceph-mon[37053]: pgmap v4150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:09 smithi043 ceph-mon[32384]: pgmap v4151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:29:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:09 smithi133 ceph-mon[37053]: pgmap v4151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:29:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:09 smithi063 ceph-mon[36747]: pgmap v4151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:29:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6796.862208 secs 2024-07-26T10:29:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6812.345237 secs 2024-07-26T10:29:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:11 smithi043 ceph-mon[32384]: pgmap v4152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6796.862208 secs 2024-07-26T10:29:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6812.345237 secs 2024-07-26T10:29:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:11 smithi133 ceph-mon[37053]: pgmap v4152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6796.862208 secs 2024-07-26T10:29:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6812.345237 secs 2024-07-26T10:29:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:11 smithi063 ceph-mon[36747]: pgmap v4152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:13 smithi043 ceph-mon[32384]: pgmap v4153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:13 smithi133 ceph-mon[37053]: pgmap v4153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:13 smithi063 ceph-mon[36747]: pgmap v4153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:15 smithi043 ceph-mon[32384]: pgmap v4154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:15 smithi133 ceph-mon[37053]: pgmap v4154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:15 smithi063 ceph-mon[36747]: pgmap v4154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6801.862332 secs 2024-07-26T10:29:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6817.345359 secs 2024-07-26T10:29:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6801.862332 secs 2024-07-26T10:29:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6817.345359 secs 2024-07-26T10:29:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6801.862332 secs 2024-07-26T10:29:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6817.345359 secs 2024-07-26T10:29:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:17 smithi043 ceph-mon[32384]: pgmap v4155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:17 smithi133 ceph-mon[37053]: pgmap v4155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:17 smithi063 ceph-mon[36747]: pgmap v4155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:19.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:19 smithi043 ceph-mon[32384]: pgmap v4156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:19 smithi133 ceph-mon[37053]: pgmap v4156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:19 smithi063 ceph-mon[36747]: pgmap v4156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6806.862459 secs 2024-07-26T10:29:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6822.345500 secs 2024-07-26T10:29:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:21 smithi043 ceph-mon[32384]: pgmap v4157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6806.862459 secs 2024-07-26T10:29:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6822.345500 secs 2024-07-26T10:29:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:21 smithi133 ceph-mon[37053]: pgmap v4157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6806.862459 secs 2024-07-26T10:29:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6822.345500 secs 2024-07-26T10:29:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:21 smithi063 ceph-mon[36747]: pgmap v4157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:23 smithi043 ceph-mon[32384]: pgmap v4158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:29:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:23 smithi133 ceph-mon[37053]: pgmap v4158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:29:24.023 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:23 smithi063 ceph-mon[36747]: pgmap v4158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:24.023 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:29:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:25 smithi043 ceph-mon[32384]: pgmap v4159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:25 smithi133 ceph-mon[37053]: pgmap v4159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:26.063 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:25 smithi063 ceph-mon[36747]: pgmap v4159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6811.862537 secs 2024-07-26T10:29:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6827.345630 secs 2024-07-26T10:29:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6811.862537 secs 2024-07-26T10:29:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6827.345630 secs 2024-07-26T10:29:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6811.862537 secs 2024-07-26T10:29:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6827.345630 secs 2024-07-26T10:29:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:27 smithi133 ceph-mon[37053]: pgmap v4160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:27 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:27 smithi063 ceph-mon[36747]: pgmap v4160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:27 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:27 smithi043 ceph-mon[32384]: pgmap v4160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:27 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: pgmap v4161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:29:30.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:29 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: pgmap v4161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:29:30.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:29 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: pgmap v4161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:30.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:30.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:29:30.238 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:29 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:29:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:30 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:29:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:30 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:29:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:30 smithi133 ceph-mon[37053]: pgmap v4162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:29:31.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:30 smithi133 ceph-mon[37053]: pgmap v4163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T10:29:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:30 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:29:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:30 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:29:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:30 smithi063 ceph-mon[36747]: pgmap v4162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:29:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:30 smithi063 ceph-mon[36747]: pgmap v4163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T10:29:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:30 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:29:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:30 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:29:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:30 smithi043 ceph-mon[32384]: pgmap v4162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:29:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:30 smithi043 ceph-mon[32384]: pgmap v4163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T10:29:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6816.862663 secs 2024-07-26T10:29:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6832.345769 secs 2024-07-26T10:29:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6816.862663 secs 2024-07-26T10:29:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6832.345769 secs 2024-07-26T10:29:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6816.862663 secs 2024-07-26T10:29:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6832.345769 secs 2024-07-26T10:29:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:32 smithi063 ceph-mon[36747]: pgmap v4164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:32 smithi043 ceph-mon[32384]: pgmap v4164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:32 smithi133 ceph-mon[37053]: pgmap v4164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:34 smithi063 ceph-mon[36747]: pgmap v4165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T10:29:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:34 smithi043 ceph-mon[32384]: pgmap v4165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T10:29:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:34 smithi133 ceph-mon[37053]: pgmap v4165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T10:29:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6821.862751 secs 2024-07-26T10:29:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:36 smithi063 ceph-mon[36747]: pgmap v4166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T10:29:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6837.345873 secs 2024-07-26T10:29:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6821.862751 secs 2024-07-26T10:29:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:36 smithi043 ceph-mon[32384]: pgmap v4166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T10:29:37.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6837.345873 secs 2024-07-26T10:29:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6821.862751 secs 2024-07-26T10:29:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:36 smithi133 ceph-mon[37053]: pgmap v4166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T10:29:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6837.345873 secs 2024-07-26T10:29:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:38 smithi063 ceph-mon[36747]: pgmap v4167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:38 smithi043 ceph-mon[32384]: pgmap v4167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:38 smithi133 ceph-mon[37053]: pgmap v4167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:40 smithi063 ceph-mon[36747]: pgmap v4168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:40 smithi043 ceph-mon[32384]: pgmap v4168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:40 smithi133 ceph-mon[37053]: pgmap v4168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:29:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6826.862875 secs 2024-07-26T10:29:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6842.345985 secs 2024-07-26T10:29:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6826.862875 secs 2024-07-26T10:29:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6842.345985 secs 2024-07-26T10:29:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6826.862875 secs 2024-07-26T10:29:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6842.345985 secs 2024-07-26T10:29:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:42 smithi063 ceph-mon[36747]: pgmap v4169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:43.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:42 smithi043 ceph-mon[32384]: pgmap v4169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:42 smithi133 ceph-mon[37053]: pgmap v4169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:44 smithi063 ceph-mon[36747]: pgmap v4170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:44 smithi043 ceph-mon[32384]: pgmap v4170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:44 smithi133 ceph-mon[37053]: pgmap v4170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6831.862988 secs 2024-07-26T10:29:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:46 smithi063 ceph-mon[36747]: pgmap v4171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6847.346106 secs 2024-07-26T10:29:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6831.862988 secs 2024-07-26T10:29:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:46 smithi043 ceph-mon[32384]: pgmap v4171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6847.346106 secs 2024-07-26T10:29:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6831.862988 secs 2024-07-26T10:29:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:46 smithi133 ceph-mon[37053]: pgmap v4171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6847.346106 secs 2024-07-26T10:29:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:48 smithi043 ceph-mon[32384]: pgmap v4172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:48 smithi133 ceph-mon[37053]: pgmap v4172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:48 smithi063 ceph-mon[36747]: pgmap v4172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:50 smithi043 ceph-mon[32384]: pgmap v4173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:50 smithi133 ceph-mon[37053]: pgmap v4173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:50 smithi063 ceph-mon[36747]: pgmap v4173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6836.863126 secs 2024-07-26T10:29:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6852.346225 secs 2024-07-26T10:29:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6836.863126 secs 2024-07-26T10:29:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6852.346225 secs 2024-07-26T10:29:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6836.863126 secs 2024-07-26T10:29:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6852.346225 secs 2024-07-26T10:29:53.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:52 smithi063 ceph-mon[36747]: pgmap v4174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:52 smithi043 ceph-mon[32384]: pgmap v4174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:52 smithi133 ceph-mon[37053]: pgmap v4174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:29:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:54 smithi043 ceph-mon[32384]: pgmap v4175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:54 smithi133 ceph-mon[37053]: pgmap v4175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:54 smithi063 ceph-mon[36747]: pgmap v4175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6841.863263 secs 2024-07-26T10:29:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:56 smithi043 ceph-mon[32384]: pgmap v4176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6857.346306 secs 2024-07-26T10:29:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6841.863263 secs 2024-07-26T10:29:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:56 smithi133 ceph-mon[37053]: pgmap v4176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6857.346306 secs 2024-07-26T10:29:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6841.863263 secs 2024-07-26T10:29:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:56 smithi063 ceph-mon[36747]: pgmap v4176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:29:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6857.346306 secs 2024-07-26T10:29:59.164 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:29:58 smithi043 ceph-mon[32384]: pgmap v4177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:29:58 smithi133 ceph-mon[37053]: pgmap v4177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:29:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:29:58 smithi063 ceph-mon[36747]: pgmap v4177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:00 smithi043 ceph-mon[32384]: pgmap v4178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:01.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:30:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:00 smithi133 ceph-mon[37053]: pgmap v4178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:30:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:00 smithi063 ceph-mon[36747]: pgmap v4178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:30:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6846.863403 secs 2024-07-26T10:30:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6862.346425 secs 2024-07-26T10:30:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6846.863403 secs 2024-07-26T10:30:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6862.346425 secs 2024-07-26T10:30:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6846.863403 secs 2024-07-26T10:30:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6862.346425 secs 2024-07-26T10:30:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:02 smithi043 ceph-mon[32384]: pgmap v4179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:02 smithi133 ceph-mon[37053]: pgmap v4179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:02 smithi063 ceph-mon[36747]: pgmap v4179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:04 smithi043 ceph-mon[32384]: pgmap v4180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:04 smithi133 ceph-mon[37053]: pgmap v4180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:04 smithi063 ceph-mon[36747]: pgmap v4180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6851.863517 secs 2024-07-26T10:30:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:06 smithi043 ceph-mon[32384]: pgmap v4181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6867.346559 secs 2024-07-26T10:30:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6851.863517 secs 2024-07-26T10:30:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:06 smithi133 ceph-mon[37053]: pgmap v4181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6867.346559 secs 2024-07-26T10:30:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6851.863517 secs 2024-07-26T10:30:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:06 smithi063 ceph-mon[36747]: pgmap v4181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6867.346559 secs 2024-07-26T10:30:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:08 smithi043 ceph-mon[32384]: pgmap v4182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:08 smithi133 ceph-mon[37053]: pgmap v4182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:08 smithi063 ceph-mon[36747]: pgmap v4182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:10 smithi043 ceph-mon[32384]: pgmap v4183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:10 smithi133 ceph-mon[37053]: pgmap v4183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:10 smithi063 ceph-mon[36747]: pgmap v4183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6856.863656 secs 2024-07-26T10:30:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6872.346694 secs 2024-07-26T10:30:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6856.863656 secs 2024-07-26T10:30:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6872.346694 secs 2024-07-26T10:30:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6856.863656 secs 2024-07-26T10:30:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6872.346694 secs 2024-07-26T10:30:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:12 smithi043 ceph-mon[32384]: pgmap v4184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:12 smithi133 ceph-mon[37053]: pgmap v4184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:12 smithi063 ceph-mon[36747]: pgmap v4184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:14 smithi043 ceph-mon[32384]: pgmap v4185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:14 smithi133 ceph-mon[37053]: pgmap v4185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:14 smithi063 ceph-mon[36747]: pgmap v4185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6861.863792 secs 2024-07-26T10:30:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:16 smithi043 ceph-mon[32384]: pgmap v4186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6877.346830 secs 2024-07-26T10:30:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6861.863792 secs 2024-07-26T10:30:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:16 smithi133 ceph-mon[37053]: pgmap v4186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6877.346830 secs 2024-07-26T10:30:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6861.863792 secs 2024-07-26T10:30:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:16 smithi063 ceph-mon[36747]: pgmap v4186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6877.346830 secs 2024-07-26T10:30:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:18 smithi043 ceph-mon[32384]: pgmap v4187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:18 smithi133 ceph-mon[37053]: pgmap v4187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:18 smithi063 ceph-mon[36747]: pgmap v4187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:20 smithi043 ceph-mon[32384]: pgmap v4188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:20 smithi133 ceph-mon[37053]: pgmap v4188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:20 smithi063 ceph-mon[36747]: pgmap v4188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6866.863947 secs 2024-07-26T10:30:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6882.346957 secs 2024-07-26T10:30:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6866.863947 secs 2024-07-26T10:30:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6882.346957 secs 2024-07-26T10:30:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6866.863947 secs 2024-07-26T10:30:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6882.346957 secs 2024-07-26T10:30:23.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:22 smithi063 ceph-mon[36747]: pgmap v4189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:22 smithi043 ceph-mon[32384]: pgmap v4189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:22 smithi133 ceph-mon[37053]: pgmap v4189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:24 smithi043 ceph-mon[32384]: pgmap v4190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:24 smithi133 ceph-mon[37053]: pgmap v4190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:24 smithi063 ceph-mon[36747]: pgmap v4190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6871.864082 secs 2024-07-26T10:30:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:26 smithi043 ceph-mon[32384]: pgmap v4191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6887.347037 secs 2024-07-26T10:30:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6871.864082 secs 2024-07-26T10:30:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:26 smithi133 ceph-mon[37053]: pgmap v4191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6887.347037 secs 2024-07-26T10:30:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6871.864082 secs 2024-07-26T10:30:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:26 smithi063 ceph-mon[36747]: pgmap v4191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6887.347037 secs 2024-07-26T10:30:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:28 smithi043 ceph-mon[32384]: pgmap v4192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:28 smithi133 ceph-mon[37053]: pgmap v4192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:28 smithi063 ceph-mon[36747]: pgmap v4192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:29 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:30:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:29 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:30:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:29 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:30:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: pgmap v4193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: pgmap v4193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: pgmap v4193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:32.116 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:31 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:30:32.116 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:31 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:30:32.116 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6876.864177 secs 2024-07-26T10:30:32.116 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6892.347119 secs 2024-07-26T10:30:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:31 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:30:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:31 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:30:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6876.864177 secs 2024-07-26T10:30:32.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6892.347119 secs 2024-07-26T10:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:31 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:31 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6876.864177 secs 2024-07-26T10:30:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6892.347119 secs 2024-07-26T10:30:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:32 smithi133 ceph-mon[37053]: pgmap v4194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:32 smithi063 ceph-mon[36747]: pgmap v4194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:32 smithi043 ceph-mon[32384]: pgmap v4194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: pgmap v4195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: pgmap v4196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: pgmap v4197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:34.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:34 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: pgmap v4195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: pgmap v4196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: pgmap v4197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:34.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:34 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: pgmap v4195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: pgmap v4196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: pgmap v4197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:34 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:30:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6881.864284 secs 2024-07-26T10:30:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:36 smithi063 ceph-mon[36747]: pgmap v4198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:30:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6897.347201 secs 2024-07-26T10:30:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6881.864284 secs 2024-07-26T10:30:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:36 smithi043 ceph-mon[32384]: pgmap v4198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:30:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6897.347201 secs 2024-07-26T10:30:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6881.864284 secs 2024-07-26T10:30:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:36 smithi133 ceph-mon[37053]: pgmap v4198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:30:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6897.347201 secs 2024-07-26T10:30:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:38 smithi063 ceph-mon[36747]: pgmap v4199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:38 smithi043 ceph-mon[32384]: pgmap v4199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:38 smithi133 ceph-mon[37053]: pgmap v4199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:40 smithi063 ceph-mon[36747]: pgmap v4200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T10:30:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:40 smithi043 ceph-mon[32384]: pgmap v4200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T10:30:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:40 smithi133 ceph-mon[37053]: pgmap v4200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T10:30:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6886.864406 secs 2024-07-26T10:30:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6902.347284 secs 2024-07-26T10:30:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6886.864406 secs 2024-07-26T10:30:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6902.347284 secs 2024-07-26T10:30:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6886.864406 secs 2024-07-26T10:30:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6902.347284 secs 2024-07-26T10:30:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:42 smithi043 ceph-mon[32384]: pgmap v4201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:30:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:42 smithi133 ceph-mon[37053]: pgmap v4201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:30:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:42 smithi063 ceph-mon[36747]: pgmap v4201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:30:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:44 smithi043 ceph-mon[32384]: pgmap v4202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:30:45.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:44 smithi133 ceph-mon[37053]: pgmap v4202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:30:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:44 smithi063 ceph-mon[36747]: pgmap v4202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:30:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6891.864524 secs 2024-07-26T10:30:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:46 smithi043 ceph-mon[32384]: pgmap v4203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:46.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6907.347368 secs 2024-07-26T10:30:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6891.864524 secs 2024-07-26T10:30:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:46 smithi133 ceph-mon[37053]: pgmap v4203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6907.347368 secs 2024-07-26T10:30:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6891.864524 secs 2024-07-26T10:30:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:46 smithi063 ceph-mon[36747]: pgmap v4203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6907.347368 secs 2024-07-26T10:30:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:48 smithi043 ceph-mon[32384]: pgmap v4204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:48 smithi133 ceph-mon[37053]: pgmap v4204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:48 smithi063 ceph-mon[36747]: pgmap v4204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:50 smithi043 ceph-mon[32384]: pgmap v4205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:50 smithi133 ceph-mon[37053]: pgmap v4205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:50 smithi063 ceph-mon[36747]: pgmap v4205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:51.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6896.864644 secs 2024-07-26T10:30:51.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6912.347461 secs 2024-07-26T10:30:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6896.864644 secs 2024-07-26T10:30:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6912.347461 secs 2024-07-26T10:30:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6896.864644 secs 2024-07-26T10:30:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6912.347461 secs 2024-07-26T10:30:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:52 smithi043 ceph-mon[32384]: pgmap v4206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:52 smithi133 ceph-mon[37053]: pgmap v4206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:52 smithi063 ceph-mon[36747]: pgmap v4206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:30:54.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:54 smithi063 ceph-mon[36747]: pgmap v4207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:54 smithi043 ceph-mon[32384]: pgmap v4207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:54 smithi133 ceph-mon[37053]: pgmap v4207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:30:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6901.864756 secs 2024-07-26T10:30:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:56 smithi043 ceph-mon[32384]: pgmap v4208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6917.347547 secs 2024-07-26T10:30:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6901.864756 secs 2024-07-26T10:30:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:56 smithi133 ceph-mon[37053]: pgmap v4208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6917.347547 secs 2024-07-26T10:30:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6901.864756 secs 2024-07-26T10:30:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:56 smithi063 ceph-mon[36747]: pgmap v4208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:30:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6917.347547 secs 2024-07-26T10:30:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:30:58 smithi043 ceph-mon[32384]: pgmap v4209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:30:58 smithi133 ceph-mon[37053]: pgmap v4209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:30:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:30:58 smithi063 ceph-mon[36747]: pgmap v4209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:00 smithi043 ceph-mon[32384]: pgmap v4210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:00 smithi133 ceph-mon[37053]: pgmap v4210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:00 smithi063 ceph-mon[36747]: pgmap v4210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:01.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6906.864860 secs 2024-07-26T10:31:01.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6922.347666 secs 2024-07-26T10:31:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6906.864860 secs 2024-07-26T10:31:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6922.347666 secs 2024-07-26T10:31:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6906.864860 secs 2024-07-26T10:31:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6922.347666 secs 2024-07-26T10:31:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:02 smithi043 ceph-mon[32384]: pgmap v4211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:02 smithi133 ceph-mon[37053]: pgmap v4211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:02 smithi063 ceph-mon[36747]: pgmap v4211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:04 smithi043 ceph-mon[32384]: pgmap v4212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:04 smithi133 ceph-mon[37053]: pgmap v4212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:04 smithi063 ceph-mon[36747]: pgmap v4212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6911.865016 secs 2024-07-26T10:31:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:06 smithi043 ceph-mon[32384]: pgmap v4213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6927.347792 secs 2024-07-26T10:31:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6911.865016 secs 2024-07-26T10:31:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:06 smithi133 ceph-mon[37053]: pgmap v4213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6927.347792 secs 2024-07-26T10:31:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6911.865016 secs 2024-07-26T10:31:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:06 smithi063 ceph-mon[36747]: pgmap v4213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6927.347792 secs 2024-07-26T10:31:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:08 smithi043 ceph-mon[32384]: pgmap v4214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:08 smithi133 ceph-mon[37053]: pgmap v4214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:08 smithi063 ceph-mon[36747]: pgmap v4214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:10 smithi043 ceph-mon[32384]: pgmap v4215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:10 smithi133 ceph-mon[37053]: pgmap v4215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:10 smithi063 ceph-mon[36747]: pgmap v4215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6916.865117 secs 2024-07-26T10:31:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6932.347902 secs 2024-07-26T10:31:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6916.865117 secs 2024-07-26T10:31:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6932.347902 secs 2024-07-26T10:31:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6916.865117 secs 2024-07-26T10:31:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6932.347902 secs 2024-07-26T10:31:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:12 smithi043 ceph-mon[32384]: pgmap v4216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:12 smithi133 ceph-mon[37053]: pgmap v4216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:12 smithi063 ceph-mon[36747]: pgmap v4216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:14 smithi043 ceph-mon[32384]: pgmap v4217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:14 smithi133 ceph-mon[37053]: pgmap v4217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:14 smithi063 ceph-mon[36747]: pgmap v4217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6921.865212 secs 2024-07-26T10:31:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:16 smithi043 ceph-mon[32384]: pgmap v4218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6937.348012 secs 2024-07-26T10:31:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6921.865212 secs 2024-07-26T10:31:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:16 smithi133 ceph-mon[37053]: pgmap v4218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6937.348012 secs 2024-07-26T10:31:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6921.865212 secs 2024-07-26T10:31:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:16 smithi063 ceph-mon[36747]: pgmap v4218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6937.348012 secs 2024-07-26T10:31:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:18 smithi043 ceph-mon[32384]: pgmap v4219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:18 smithi133 ceph-mon[37053]: pgmap v4219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:18 smithi063 ceph-mon[36747]: pgmap v4219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:20.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:20 smithi043 ceph-mon[32384]: pgmap v4220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:20 smithi133 ceph-mon[37053]: pgmap v4220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:20 smithi063 ceph-mon[36747]: pgmap v4220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6926.865379 secs 2024-07-26T10:31:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6942.348137 secs 2024-07-26T10:31:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6926.865379 secs 2024-07-26T10:31:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6942.348137 secs 2024-07-26T10:31:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6926.865379 secs 2024-07-26T10:31:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6942.348137 secs 2024-07-26T10:31:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:22 smithi043 ceph-mon[32384]: pgmap v4221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:22 smithi133 ceph-mon[37053]: pgmap v4221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:22 smithi063 ceph-mon[36747]: pgmap v4221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:24 smithi043 ceph-mon[32384]: pgmap v4222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:24 smithi133 ceph-mon[37053]: pgmap v4222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:24 smithi063 ceph-mon[36747]: pgmap v4222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6931.865534 secs 2024-07-26T10:31:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:26 smithi043 ceph-mon[32384]: pgmap v4223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6947.348285 secs 2024-07-26T10:31:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6931.865534 secs 2024-07-26T10:31:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:26 smithi133 ceph-mon[37053]: pgmap v4223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6947.348285 secs 2024-07-26T10:31:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6931.865534 secs 2024-07-26T10:31:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:26 smithi063 ceph-mon[36747]: pgmap v4223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6947.348285 secs 2024-07-26T10:31:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:28 smithi133 ceph-mon[37053]: pgmap v4224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:28 smithi063 ceph-mon[36747]: pgmap v4224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:28 smithi043 ceph-mon[32384]: pgmap v4224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:31:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:30 smithi133 ceph-mon[37053]: pgmap v4225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:30 smithi063 ceph-mon[36747]: pgmap v4225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:30 smithi043 ceph-mon[32384]: pgmap v4225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6936.865627 secs 2024-07-26T10:31:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6952.348424 secs 2024-07-26T10:31:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6936.865627 secs 2024-07-26T10:31:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6952.348424 secs 2024-07-26T10:31:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6936.865627 secs 2024-07-26T10:31:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6952.348424 secs 2024-07-26T10:31:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:32 smithi133 ceph-mon[37053]: pgmap v4226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:32 smithi063 ceph-mon[36747]: pgmap v4226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:32 smithi043 ceph-mon[32384]: pgmap v4226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:31:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:31:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:31:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:34 smithi063 ceph-mon[36747]: pgmap v4227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:31:35.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:34 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:31:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:34 smithi043 ceph-mon[32384]: pgmap v4227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:31:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:34 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:31:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:34 smithi133 ceph-mon[37053]: pgmap v4227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:31:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:34 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:31:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:35 smithi063 ceph-mon[36747]: pgmap v4228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:31:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:35 smithi063 ceph-mon[36747]: pgmap v4229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:31:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:35 smithi043 ceph-mon[32384]: pgmap v4228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:31:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:35 smithi043 ceph-mon[32384]: pgmap v4229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:31:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:35 smithi133 ceph-mon[37053]: pgmap v4228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:31:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:35 smithi133 ceph-mon[37053]: pgmap v4229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:31:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6941.865745 secs 2024-07-26T10:31:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6957.348564 secs 2024-07-26T10:31:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6941.865745 secs 2024-07-26T10:31:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6957.348564 secs 2024-07-26T10:31:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6941.865745 secs 2024-07-26T10:31:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6957.348564 secs 2024-07-26T10:31:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:37 smithi063 ceph-mon[36747]: pgmap v4230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:31:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:37 smithi043 ceph-mon[32384]: pgmap v4230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:31:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:37 smithi133 ceph-mon[37053]: pgmap v4230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:31:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:39 smithi043 ceph-mon[32384]: pgmap v4231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:39 smithi133 ceph-mon[37053]: pgmap v4231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:39 smithi063 ceph-mon[36747]: pgmap v4231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6946.865837 secs 2024-07-26T10:31:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6962.348678 secs 2024-07-26T10:31:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:41 smithi043 ceph-mon[32384]: pgmap v4232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6946.865837 secs 2024-07-26T10:31:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6962.348678 secs 2024-07-26T10:31:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:41 smithi133 ceph-mon[37053]: pgmap v4232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6946.865837 secs 2024-07-26T10:31:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6962.348678 secs 2024-07-26T10:31:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:41 smithi063 ceph-mon[36747]: pgmap v4232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:31:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:43 smithi043 ceph-mon[32384]: pgmap v4233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:31:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:43 smithi133 ceph-mon[37053]: pgmap v4233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:31:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:43 smithi063 ceph-mon[36747]: pgmap v4233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:31:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:45 smithi043 ceph-mon[32384]: pgmap v4234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:31:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:45 smithi133 ceph-mon[37053]: pgmap v4234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:31:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:45 smithi063 ceph-mon[36747]: pgmap v4234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:31:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6951.865953 secs 2024-07-26T10:31:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6967.348775 secs 2024-07-26T10:31:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6951.865953 secs 2024-07-26T10:31:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6967.348775 secs 2024-07-26T10:31:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6951.865953 secs 2024-07-26T10:31:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6967.348775 secs 2024-07-26T10:31:48.219 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:47 smithi043 ceph-mon[32384]: pgmap v4235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:47 smithi133 ceph-mon[37053]: pgmap v4235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:47 smithi063 ceph-mon[36747]: pgmap v4235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:49 smithi043 ceph-mon[32384]: pgmap v4236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:49 smithi133 ceph-mon[37053]: pgmap v4236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:49 smithi063 ceph-mon[36747]: pgmap v4236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6956.866049 secs 2024-07-26T10:31:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6972.348899 secs 2024-07-26T10:31:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:51 smithi043 ceph-mon[32384]: pgmap v4237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6956.866049 secs 2024-07-26T10:31:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6972.348899 secs 2024-07-26T10:31:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:51 smithi133 ceph-mon[37053]: pgmap v4237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6956.866049 secs 2024-07-26T10:31:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6972.348899 secs 2024-07-26T10:31:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:51 smithi063 ceph-mon[36747]: pgmap v4237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:54.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:53 smithi063 ceph-mon[36747]: pgmap v4238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:53 smithi043 ceph-mon[32384]: pgmap v4238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:53 smithi133 ceph-mon[37053]: pgmap v4238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:31:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:55 smithi043 ceph-mon[32384]: pgmap v4239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:55 smithi133 ceph-mon[37053]: pgmap v4239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:55 smithi063 ceph-mon[36747]: pgmap v4239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:31:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6961.866179 secs 2024-07-26T10:31:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6977.349017 secs 2024-07-26T10:31:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6961.866179 secs 2024-07-26T10:31:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6977.349017 secs 2024-07-26T10:31:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6961.866179 secs 2024-07-26T10:31:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6977.349017 secs 2024-07-26T10:31:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:57 smithi043 ceph-mon[32384]: pgmap v4240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:57 smithi133 ceph-mon[37053]: pgmap v4240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:31:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:57 smithi063 ceph-mon[36747]: pgmap v4240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:31:59 smithi043 ceph-mon[32384]: pgmap v4241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:31:59 smithi133 ceph-mon[37053]: pgmap v4241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:31:59 smithi063 ceph-mon[36747]: pgmap v4241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6966.866305 secs 2024-07-26T10:32:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6982.349140 secs 2024-07-26T10:32:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:01 smithi043 ceph-mon[32384]: pgmap v4242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6966.866305 secs 2024-07-26T10:32:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6982.349140 secs 2024-07-26T10:32:02.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:01 smithi133 ceph-mon[37053]: pgmap v4242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6966.866305 secs 2024-07-26T10:32:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6982.349140 secs 2024-07-26T10:32:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:01 smithi063 ceph-mon[36747]: pgmap v4242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:03 smithi043 ceph-mon[32384]: pgmap v4243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:03 smithi133 ceph-mon[37053]: pgmap v4243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:03 smithi063 ceph-mon[36747]: pgmap v4243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:05 smithi043 ceph-mon[32384]: pgmap v4244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:05 smithi133 ceph-mon[37053]: pgmap v4244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:05 smithi063 ceph-mon[36747]: pgmap v4244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6971.866423 secs 2024-07-26T10:32:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6987.349282 secs 2024-07-26T10:32:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6971.866423 secs 2024-07-26T10:32:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6987.349282 secs 2024-07-26T10:32:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6971.866423 secs 2024-07-26T10:32:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6987.349282 secs 2024-07-26T10:32:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:07 smithi043 ceph-mon[32384]: pgmap v4245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:07 smithi133 ceph-mon[37053]: pgmap v4245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:07 smithi063 ceph-mon[36747]: pgmap v4245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:09 smithi043 ceph-mon[32384]: pgmap v4246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:09 smithi133 ceph-mon[37053]: pgmap v4246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:09 smithi063 ceph-mon[36747]: pgmap v4246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6976.866536 secs 2024-07-26T10:32:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6992.349384 secs 2024-07-26T10:32:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:11 smithi043 ceph-mon[32384]: pgmap v4247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6976.866536 secs 2024-07-26T10:32:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6992.349384 secs 2024-07-26T10:32:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:11 smithi133 ceph-mon[37053]: pgmap v4247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6976.866536 secs 2024-07-26T10:32:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6992.349384 secs 2024-07-26T10:32:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:11 smithi063 ceph-mon[36747]: pgmap v4247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:13 smithi043 ceph-mon[32384]: pgmap v4248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:13 smithi133 ceph-mon[37053]: pgmap v4248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:13 smithi063 ceph-mon[36747]: pgmap v4248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:15 smithi043 ceph-mon[32384]: pgmap v4249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:15 smithi133 ceph-mon[37053]: pgmap v4249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:15 smithi063 ceph-mon[36747]: pgmap v4249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6981.866675 secs 2024-07-26T10:32:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 6997.349519 secs 2024-07-26T10:32:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6981.866675 secs 2024-07-26T10:32:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 6997.349519 secs 2024-07-26T10:32:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6981.866675 secs 2024-07-26T10:32:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 6997.349519 secs 2024-07-26T10:32:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:17 smithi043 ceph-mon[32384]: pgmap v4250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:17 smithi133 ceph-mon[37053]: pgmap v4250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:17 smithi063 ceph-mon[36747]: pgmap v4250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:19 smithi043 ceph-mon[32384]: pgmap v4251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:19 smithi133 ceph-mon[37053]: pgmap v4251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:19 smithi063 ceph-mon[36747]: pgmap v4251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6986.866791 secs 2024-07-26T10:32:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7002.349659 secs 2024-07-26T10:32:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:21 smithi043 ceph-mon[32384]: pgmap v4252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6986.866791 secs 2024-07-26T10:32:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7002.349659 secs 2024-07-26T10:32:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:21 smithi133 ceph-mon[37053]: pgmap v4252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6986.866791 secs 2024-07-26T10:32:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7002.349659 secs 2024-07-26T10:32:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:21 smithi063 ceph-mon[36747]: pgmap v4252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:23 smithi043 ceph-mon[32384]: pgmap v4253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:23 smithi133 ceph-mon[37053]: pgmap v4253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:23 smithi063 ceph-mon[36747]: pgmap v4253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:25 smithi043 ceph-mon[32384]: pgmap v4254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:25 smithi133 ceph-mon[37053]: pgmap v4254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:25 smithi063 ceph-mon[36747]: pgmap v4254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6991.866946 secs 2024-07-26T10:32:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7007.349801 secs 2024-07-26T10:32:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6991.866946 secs 2024-07-26T10:32:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7007.349801 secs 2024-07-26T10:32:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6991.866946 secs 2024-07-26T10:32:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7007.349801 secs 2024-07-26T10:32:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:27 smithi133 ceph-mon[37053]: pgmap v4255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:27 smithi063 ceph-mon[36747]: pgmap v4255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:27 smithi043 ceph-mon[32384]: pgmap v4255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:29 smithi133 ceph-mon[37053]: pgmap v4256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:29 smithi063 ceph-mon[36747]: pgmap v4256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:29 smithi043 ceph-mon[32384]: pgmap v4256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:32 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 6996.867022 secs 2024-07-26T10:32:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7012.349894 secs 2024-07-26T10:32:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:32 smithi133 ceph-mon[37053]: pgmap v4257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:32 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 6996.867022 secs 2024-07-26T10:32:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7012.349894 secs 2024-07-26T10:32:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:32 smithi063 ceph-mon[36747]: pgmap v4257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:32 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 6996.867022 secs 2024-07-26T10:32:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7012.349894 secs 2024-07-26T10:32:32.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:32 smithi043 ceph-mon[32384]: pgmap v4257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:34 smithi133 ceph-mon[37053]: pgmap v4258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:34.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:34 smithi043 ceph-mon[32384]: pgmap v4258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:34 smithi063 ceph-mon[36747]: pgmap v4258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:32:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:32:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:32:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:36 smithi063 ceph-mon[36747]: pgmap v4259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:36 smithi043 ceph-mon[32384]: pgmap v4259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:36 smithi133 ceph-mon[37053]: pgmap v4259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:37 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7001.867134 secs 2024-07-26T10:32:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7017.349959 secs 2024-07-26T10:32:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:32:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:32:37.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:37 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7001.867134 secs 2024-07-26T10:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7017.349959 secs 2024-07-26T10:32:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:32:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:32:37.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:37 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7001.867134 secs 2024-07-26T10:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7017.349959 secs 2024-07-26T10:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:32:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:38 smithi063 ceph-mon[36747]: pgmap v4260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:38.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:38 smithi063 ceph-mon[36747]: pgmap v4261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:38 smithi043 ceph-mon[32384]: pgmap v4260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:38 smithi043 ceph-mon[32384]: pgmap v4261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:38 smithi133 ceph-mon[37053]: pgmap v4260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:38 smithi133 ceph-mon[37053]: pgmap v4261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:39 smithi063 ceph-mon[36747]: pgmap v4262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:39 smithi043 ceph-mon[32384]: pgmap v4262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:39 smithi133 ceph-mon[37053]: pgmap v4262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7006.867226 secs 2024-07-26T10:32:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7022.350027 secs 2024-07-26T10:32:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:41 smithi133 ceph-mon[37053]: pgmap v4263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7006.867226 secs 2024-07-26T10:32:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7022.350027 secs 2024-07-26T10:32:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:41 smithi063 ceph-mon[36747]: pgmap v4263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7006.867226 secs 2024-07-26T10:32:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7022.350027 secs 2024-07-26T10:32:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:41 smithi043 ceph-mon[32384]: pgmap v4263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:44.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:43 smithi043 ceph-mon[32384]: pgmap v4264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:43 smithi063 ceph-mon[36747]: pgmap v4264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:43 smithi133 ceph-mon[37053]: pgmap v4264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:45 smithi063 ceph-mon[36747]: pgmap v4265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:45 smithi043 ceph-mon[32384]: pgmap v4265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:45 smithi133 ceph-mon[37053]: pgmap v4265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:32:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7011.867348 secs 2024-07-26T10:32:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7027.350176 secs 2024-07-26T10:32:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7011.867348 secs 2024-07-26T10:32:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7027.350176 secs 2024-07-26T10:32:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7011.867348 secs 2024-07-26T10:32:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7027.350176 secs 2024-07-26T10:32:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:47 smithi063 ceph-mon[36747]: pgmap v4266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:32:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:47 smithi043 ceph-mon[32384]: pgmap v4266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:32:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:47 smithi133 ceph-mon[37053]: pgmap v4266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:32:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:49 smithi063 ceph-mon[36747]: pgmap v4267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:50.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:49 smithi043 ceph-mon[32384]: pgmap v4267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:49 smithi133 ceph-mon[37053]: pgmap v4267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7016.867464 secs 2024-07-26T10:32:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7032.350304 secs 2024-07-26T10:32:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:51 smithi063 ceph-mon[36747]: pgmap v4268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:52.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7016.867464 secs 2024-07-26T10:32:52.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7032.350304 secs 2024-07-26T10:32:52.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:51 smithi133 ceph-mon[37053]: pgmap v4268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7016.867464 secs 2024-07-26T10:32:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7032.350304 secs 2024-07-26T10:32:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:51 smithi043 ceph-mon[32384]: pgmap v4268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:53 smithi063 ceph-mon[36747]: pgmap v4269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:53 smithi043 ceph-mon[32384]: pgmap v4269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:53 smithi133 ceph-mon[37053]: pgmap v4269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:32:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:55 smithi063 ceph-mon[36747]: pgmap v4270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:55 smithi043 ceph-mon[32384]: pgmap v4270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:55 smithi133 ceph-mon[37053]: pgmap v4270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:32:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7021.867583 secs 2024-07-26T10:32:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7037.350425 secs 2024-07-26T10:32:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7021.867583 secs 2024-07-26T10:32:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7037.350425 secs 2024-07-26T10:32:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7021.867583 secs 2024-07-26T10:32:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7037.350425 secs 2024-07-26T10:32:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:57 smithi043 ceph-mon[32384]: pgmap v4271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:57 smithi133 ceph-mon[37053]: pgmap v4271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:32:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:57 smithi063 ceph-mon[36747]: pgmap v4271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:32:59 smithi043 ceph-mon[32384]: pgmap v4272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:32:59 smithi133 ceph-mon[37053]: pgmap v4272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:32:59 smithi063 ceph-mon[36747]: pgmap v4272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7026.867662 secs 2024-07-26T10:33:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7042.350548 secs 2024-07-26T10:33:02.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:01 smithi043 ceph-mon[32384]: pgmap v4273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7026.867662 secs 2024-07-26T10:33:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7042.350548 secs 2024-07-26T10:33:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:01 smithi133 ceph-mon[37053]: pgmap v4273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7026.867662 secs 2024-07-26T10:33:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7042.350548 secs 2024-07-26T10:33:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:01 smithi063 ceph-mon[36747]: pgmap v4273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:03 smithi043 ceph-mon[32384]: pgmap v4274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:03 smithi133 ceph-mon[37053]: pgmap v4274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:03 smithi063 ceph-mon[36747]: pgmap v4274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:05 smithi043 ceph-mon[32384]: pgmap v4275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:05 smithi133 ceph-mon[37053]: pgmap v4275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:05 smithi063 ceph-mon[36747]: pgmap v4275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7031.867804 secs 2024-07-26T10:33:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7047.350668 secs 2024-07-26T10:33:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7031.867804 secs 2024-07-26T10:33:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7047.350668 secs 2024-07-26T10:33:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7031.867804 secs 2024-07-26T10:33:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7047.350668 secs 2024-07-26T10:33:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:07 smithi043 ceph-mon[32384]: pgmap v4276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:07 smithi133 ceph-mon[37053]: pgmap v4276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:07 smithi063 ceph-mon[36747]: pgmap v4276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:09 smithi133 ceph-mon[37053]: pgmap v4277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:09 smithi063 ceph-mon[36747]: pgmap v4277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:09 smithi043 ceph-mon[32384]: pgmap v4277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7036.867945 secs 2024-07-26T10:33:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7052.350789 secs 2024-07-26T10:33:12.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:11 smithi063 ceph-mon[36747]: pgmap v4278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7036.867945 secs 2024-07-26T10:33:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7052.350789 secs 2024-07-26T10:33:12.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:11 smithi043 ceph-mon[32384]: pgmap v4278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7036.867945 secs 2024-07-26T10:33:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7052.350789 secs 2024-07-26T10:33:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:11 smithi133 ceph-mon[37053]: pgmap v4278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:13 smithi063 ceph-mon[36747]: pgmap v4279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:13 smithi043 ceph-mon[32384]: pgmap v4279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:13 smithi133 ceph-mon[37053]: pgmap v4279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:15 smithi063 ceph-mon[36747]: pgmap v4280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:15 smithi043 ceph-mon[32384]: pgmap v4280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:15 smithi133 ceph-mon[37053]: pgmap v4280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7041.868095 secs 2024-07-26T10:33:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7057.350911 secs 2024-07-26T10:33:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7041.868095 secs 2024-07-26T10:33:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7057.350911 secs 2024-07-26T10:33:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7041.868095 secs 2024-07-26T10:33:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7057.350911 secs 2024-07-26T10:33:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:17 smithi063 ceph-mon[36747]: pgmap v4281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:17 smithi043 ceph-mon[32384]: pgmap v4281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:17 smithi133 ceph-mon[37053]: pgmap v4281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:19 smithi063 ceph-mon[36747]: pgmap v4282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:19 smithi043 ceph-mon[32384]: pgmap v4282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:19 smithi133 ceph-mon[37053]: pgmap v4282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7046.868211 secs 2024-07-26T10:33:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7062.351008 secs 2024-07-26T10:33:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:21 smithi043 ceph-mon[32384]: pgmap v4283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7046.868211 secs 2024-07-26T10:33:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7062.351008 secs 2024-07-26T10:33:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:21 smithi133 ceph-mon[37053]: pgmap v4283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7046.868211 secs 2024-07-26T10:33:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7062.351008 secs 2024-07-26T10:33:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:21 smithi063 ceph-mon[36747]: pgmap v4283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:23 smithi043 ceph-mon[32384]: pgmap v4284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:23 smithi133 ceph-mon[37053]: pgmap v4284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:23 smithi063 ceph-mon[36747]: pgmap v4284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:26.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:25 smithi063 ceph-mon[36747]: pgmap v4285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:25 smithi043 ceph-mon[32384]: pgmap v4285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:25 smithi133 ceph-mon[37053]: pgmap v4285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7051.868329 secs 2024-07-26T10:33:27.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7067.351132 secs 2024-07-26T10:33:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7051.868329 secs 2024-07-26T10:33:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7067.351132 secs 2024-07-26T10:33:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7051.868329 secs 2024-07-26T10:33:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7067.351132 secs 2024-07-26T10:33:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:27 smithi043 ceph-mon[32384]: pgmap v4286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:27 smithi133 ceph-mon[37053]: pgmap v4286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:27 smithi063 ceph-mon[36747]: pgmap v4286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:29 smithi043 ceph-mon[32384]: pgmap v4287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:29 smithi133 ceph-mon[37053]: pgmap v4287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:29 smithi063 ceph-mon[36747]: pgmap v4287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7056.868449 secs 2024-07-26T10:33:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7072.351252 secs 2024-07-26T10:33:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:31 smithi043 ceph-mon[32384]: pgmap v4288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7056.868449 secs 2024-07-26T10:33:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7072.351252 secs 2024-07-26T10:33:32.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:31 smithi133 ceph-mon[37053]: pgmap v4288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7056.868449 secs 2024-07-26T10:33:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7072.351252 secs 2024-07-26T10:33:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:31 smithi063 ceph-mon[36747]: pgmap v4288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:33 smithi043 ceph-mon[32384]: pgmap v4289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:34.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:33 smithi133 ceph-mon[37053]: pgmap v4289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:33 smithi063 ceph-mon[36747]: pgmap v4289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:35 smithi043 ceph-mon[32384]: pgmap v4290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:35 smithi133 ceph-mon[37053]: pgmap v4290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:35 smithi063 ceph-mon[36747]: pgmap v4290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:33:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7061.868573 secs 2024-07-26T10:33:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7077.351365 secs 2024-07-26T10:33:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7061.868573 secs 2024-07-26T10:33:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7077.351365 secs 2024-07-26T10:33:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7061.868573 secs 2024-07-26T10:33:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7077.351365 secs 2024-07-26T10:33:38.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:37 smithi063 ceph-mon[36747]: pgmap v4291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:38.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:33:38.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.222 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.226 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:37 smithi133 ceph-mon[37053]: pgmap v4291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:38.226 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:33:38.226 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.227 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.227 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.227 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:37 smithi043 ceph-mon[32384]: pgmap v4291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:33:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:38.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:40 smithi133 ceph-mon[37053]: pgmap v4292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:40 smithi063 ceph-mon[36747]: pgmap v4292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:40 smithi043 ceph-mon[32384]: pgmap v4292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:40.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:42 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7066.868710 secs 2024-07-26T10:33:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7082.351489 secs 2024-07-26T10:33:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:42 smithi063 ceph-mon[36747]: pgmap v4293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:42.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:42 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:42 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7066.868710 secs 2024-07-26T10:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7082.351489 secs 2024-07-26T10:33:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:42 smithi043 ceph-mon[32384]: pgmap v4293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:42.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:42 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:42 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7066.868710 secs 2024-07-26T10:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7082.351489 secs 2024-07-26T10:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:42 smithi133 ceph-mon[37053]: pgmap v4293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:42 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:33:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:33:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:33:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:33:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:33:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:33:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:33:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:44 smithi063 ceph-mon[36747]: pgmap v4294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:33:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:44 smithi063 ceph-mon[36747]: pgmap v4295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:33:44.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:44 smithi043 ceph-mon[32384]: pgmap v4294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:33:44.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:44 smithi043 ceph-mon[32384]: pgmap v4295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:33:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:44 smithi133 ceph-mon[37053]: pgmap v4294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:33:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:44 smithi133 ceph-mon[37053]: pgmap v4295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:33:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:46 smithi063 ceph-mon[36747]: pgmap v4296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:46 smithi043 ceph-mon[32384]: pgmap v4296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:46 smithi133 ceph-mon[37053]: pgmap v4296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:47 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7071.868828 secs 2024-07-26T10:33:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7087.351606 secs 2024-07-26T10:33:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:47 smithi063 ceph-mon[36747]: pgmap v4297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:47 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7071.868828 secs 2024-07-26T10:33:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7087.351606 secs 2024-07-26T10:33:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:47 smithi043 ceph-mon[32384]: pgmap v4297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:47 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7071.868828 secs 2024-07-26T10:33:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7087.351606 secs 2024-07-26T10:33:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:47 smithi133 ceph-mon[37053]: pgmap v4297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:49 smithi043 ceph-mon[32384]: pgmap v4298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:49 smithi133 ceph-mon[37053]: pgmap v4298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:49 smithi063 ceph-mon[36747]: pgmap v4298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:51 smithi043 ceph-mon[32384]: pgmap v4299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:33:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:51 smithi133 ceph-mon[37053]: pgmap v4299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:33:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:51 smithi063 ceph-mon[36747]: pgmap v4299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:33:52.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:52 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7076.868966 secs 2024-07-26T10:33:52.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7092.351728 secs 2024-07-26T10:33:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:52 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7076.868966 secs 2024-07-26T10:33:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7092.351728 secs 2024-07-26T10:33:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:52 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7076.868966 secs 2024-07-26T10:33:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7092.351728 secs 2024-07-26T10:33:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:53 smithi043 ceph-mon[32384]: pgmap v4300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:33:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:53 smithi133 ceph-mon[37053]: pgmap v4300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:33:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:53 smithi063 ceph-mon[36747]: pgmap v4300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:33:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:55 smithi043 ceph-mon[32384]: pgmap v4301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:55 smithi133 ceph-mon[37053]: pgmap v4301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:55 smithi063 ceph-mon[36747]: pgmap v4301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7081.869110 secs 2024-07-26T10:33:56.483 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7081.869110 secs 2024-07-26T10:33:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7081.869110 secs 2024-07-26T10:33:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7097.351834 secs 2024-07-26T10:33:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:57 smithi043 ceph-mon[32384]: pgmap v4302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7097.351834 secs 2024-07-26T10:33:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:57 smithi133 ceph-mon[37053]: pgmap v4302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7097.351834 secs 2024-07-26T10:33:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:57 smithi063 ceph-mon[36747]: pgmap v4302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:33:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:33:59 smithi043 ceph-mon[32384]: pgmap v4303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:33:59 smithi133 ceph-mon[37053]: pgmap v4303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:33:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:33:59 smithi063 ceph-mon[36747]: pgmap v4303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:01 smithi133 ceph-mon[37053]: pgmap v4304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7086.869231 secs 2024-07-26T10:34:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:01 smithi063 ceph-mon[36747]: pgmap v4304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7086.869231 secs 2024-07-26T10:34:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:01 smithi043 ceph-mon[32384]: pgmap v4304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7086.869231 secs 2024-07-26T10:34:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7102.351931 secs 2024-07-26T10:34:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7102.351931 secs 2024-07-26T10:34:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7102.351931 secs 2024-07-26T10:34:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:03 smithi133 ceph-mon[37053]: pgmap v4305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:03 smithi063 ceph-mon[36747]: pgmap v4305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:03 smithi043 ceph-mon[32384]: pgmap v4305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:05 smithi133 ceph-mon[37053]: pgmap v4306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:05 smithi063 ceph-mon[36747]: pgmap v4306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:05.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:05 smithi043 ceph-mon[32384]: pgmap v4306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7091.869366 secs 2024-07-26T10:34:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7091.869366 secs 2024-07-26T10:34:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7091.869366 secs 2024-07-26T10:34:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7107.352050 secs 2024-07-26T10:34:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:07 smithi063 ceph-mon[36747]: pgmap v4307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7107.352050 secs 2024-07-26T10:34:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:07 smithi043 ceph-mon[32384]: pgmap v4307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7107.352050 secs 2024-07-26T10:34:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:07 smithi133 ceph-mon[37053]: pgmap v4307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:09 smithi063 ceph-mon[36747]: pgmap v4308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:09 smithi043 ceph-mon[32384]: pgmap v4308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:09 smithi133 ceph-mon[37053]: pgmap v4308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:11 smithi063 ceph-mon[36747]: pgmap v4309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7096.869462 secs 2024-07-26T10:34:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:11 smithi043 ceph-mon[32384]: pgmap v4309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7096.869462 secs 2024-07-26T10:34:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:11 smithi133 ceph-mon[37053]: pgmap v4309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7096.869462 secs 2024-07-26T10:34:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7112.352170 secs 2024-07-26T10:34:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7112.352170 secs 2024-07-26T10:34:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7112.352170 secs 2024-07-26T10:34:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:13 smithi063 ceph-mon[36747]: pgmap v4310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:13 smithi043 ceph-mon[32384]: pgmap v4310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:13 smithi133 ceph-mon[37053]: pgmap v4310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:15 smithi063 ceph-mon[36747]: pgmap v4311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:15 smithi043 ceph-mon[32384]: pgmap v4311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:15 smithi133 ceph-mon[37053]: pgmap v4311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7101.869600 secs 2024-07-26T10:34:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7101.869600 secs 2024-07-26T10:34:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7101.869600 secs 2024-07-26T10:34:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7117.352292 secs 2024-07-26T10:34:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:17 smithi043 ceph-mon[32384]: pgmap v4312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7117.352292 secs 2024-07-26T10:34:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:17 smithi133 ceph-mon[37053]: pgmap v4312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7117.352292 secs 2024-07-26T10:34:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:17 smithi063 ceph-mon[36747]: pgmap v4312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:19 smithi043 ceph-mon[32384]: pgmap v4313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:19 smithi133 ceph-mon[37053]: pgmap v4313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:19 smithi063 ceph-mon[36747]: pgmap v4313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:21 smithi043 ceph-mon[32384]: pgmap v4314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7106.869737 secs 2024-07-26T10:34:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:21 smithi133 ceph-mon[37053]: pgmap v4314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7106.869737 secs 2024-07-26T10:34:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:21 smithi063 ceph-mon[36747]: pgmap v4314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7106.869737 secs 2024-07-26T10:34:22.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7122.352406 secs 2024-07-26T10:34:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7122.352406 secs 2024-07-26T10:34:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7122.352406 secs 2024-07-26T10:34:23.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:23 smithi043 ceph-mon[32384]: pgmap v4315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:23 smithi133 ceph-mon[37053]: pgmap v4315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:23 smithi063 ceph-mon[36747]: pgmap v4315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:25 smithi043 ceph-mon[32384]: pgmap v4316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:25 smithi133 ceph-mon[37053]: pgmap v4316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:25 smithi063 ceph-mon[36747]: pgmap v4316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:26.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7111.869860 secs 2024-07-26T10:34:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7111.869860 secs 2024-07-26T10:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7111.869860 secs 2024-07-26T10:34:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7127.352521 secs 2024-07-26T10:34:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:27 smithi043 ceph-mon[32384]: pgmap v4317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7127.352521 secs 2024-07-26T10:34:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:27 smithi133 ceph-mon[37053]: pgmap v4317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7127.352521 secs 2024-07-26T10:34:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:27 smithi063 ceph-mon[36747]: pgmap v4317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:29 smithi043 ceph-mon[32384]: pgmap v4318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:29 smithi133 ceph-mon[37053]: pgmap v4318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:29 smithi063 ceph-mon[36747]: pgmap v4318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:34:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:31 smithi043 ceph-mon[32384]: pgmap v4319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7116.869979 secs 2024-07-26T10:34:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:31 smithi133 ceph-mon[37053]: pgmap v4319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7116.869979 secs 2024-07-26T10:34:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:31 smithi063 ceph-mon[36747]: pgmap v4319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7116.869979 secs 2024-07-26T10:34:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7132.352638 secs 2024-07-26T10:34:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7132.352638 secs 2024-07-26T10:34:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7132.352638 secs 2024-07-26T10:34:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:33 smithi043 ceph-mon[32384]: pgmap v4320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:33 smithi133 ceph-mon[37053]: pgmap v4320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:33 smithi063 ceph-mon[36747]: pgmap v4320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:35 smithi043 ceph-mon[32384]: pgmap v4321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:35 smithi133 ceph-mon[37053]: pgmap v4321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:35 smithi063 ceph-mon[36747]: pgmap v4321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7121.870098 secs 2024-07-26T10:34:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7121.870098 secs 2024-07-26T10:34:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7121.870098 secs 2024-07-26T10:34:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7137.352759 secs 2024-07-26T10:34:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:37 smithi043 ceph-mon[32384]: pgmap v4322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7137.352759 secs 2024-07-26T10:34:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:37 smithi133 ceph-mon[37053]: pgmap v4322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7137.352759 secs 2024-07-26T10:34:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:37 smithi063 ceph-mon[36747]: pgmap v4322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:39 smithi043 ceph-mon[32384]: pgmap v4323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:39 smithi133 ceph-mon[37053]: pgmap v4323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:39 smithi063 ceph-mon[36747]: pgmap v4323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:41 smithi043 ceph-mon[32384]: pgmap v4324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7126.870213 secs 2024-07-26T10:34:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:41 smithi133 ceph-mon[37053]: pgmap v4324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7126.870213 secs 2024-07-26T10:34:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:41 smithi063 ceph-mon[36747]: pgmap v4324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7126.870213 secs 2024-07-26T10:34:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7142.352896 secs 2024-07-26T10:34:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:42 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:34:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7142.352896 secs 2024-07-26T10:34:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:42 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:34:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7142.352896 secs 2024-07-26T10:34:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:42 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:34:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:43 smithi043 ceph-mon[32384]: pgmap v4325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:34:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:34:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:34:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:43 smithi133 ceph-mon[37053]: pgmap v4325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:34:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:34:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:34:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:43 smithi063 ceph-mon[36747]: pgmap v4325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:34:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:34:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:34:43.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:34:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:44 smithi043 ceph-mon[32384]: pgmap v4326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:44 smithi043 ceph-mon[32384]: pgmap v4327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:44 smithi133 ceph-mon[37053]: pgmap v4326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:44 smithi133 ceph-mon[37053]: pgmap v4327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:44 smithi063 ceph-mon[36747]: pgmap v4326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:44 smithi063 ceph-mon[36747]: pgmap v4327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7131.870309 secs 2024-07-26T10:34:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:46 smithi043 ceph-mon[32384]: pgmap v4328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7131.870309 secs 2024-07-26T10:34:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:46 smithi133 ceph-mon[37053]: pgmap v4328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7131.870309 secs 2024-07-26T10:34:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:46 smithi063 ceph-mon[36747]: pgmap v4328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7147.353033 secs 2024-07-26T10:34:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7147.353033 secs 2024-07-26T10:34:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7147.353033 secs 2024-07-26T10:34:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:48 smithi043 ceph-mon[32384]: pgmap v4329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:48 smithi133 ceph-mon[37053]: pgmap v4329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:48 smithi063 ceph-mon[36747]: pgmap v4329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:34:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:50 smithi043 ceph-mon[32384]: pgmap v4330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:50 smithi133 ceph-mon[37053]: pgmap v4330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:50 smithi063 ceph-mon[36747]: pgmap v4330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7136.870424 secs 2024-07-26T10:34:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7136.870424 secs 2024-07-26T10:34:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7136.870424 secs 2024-07-26T10:34:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7152.353179 secs 2024-07-26T10:34:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:52 smithi133 ceph-mon[37053]: pgmap v4331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7152.353179 secs 2024-07-26T10:34:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:52 smithi063 ceph-mon[36747]: pgmap v4331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7152.353179 secs 2024-07-26T10:34:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:52 smithi043 ceph-mon[32384]: pgmap v4331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:34:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:54 smithi133 ceph-mon[37053]: pgmap v4332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:54 smithi063 ceph-mon[36747]: pgmap v4332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:54 smithi043 ceph-mon[32384]: pgmap v4332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:34:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7141.870539 secs 2024-07-26T10:34:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:56 smithi133 ceph-mon[37053]: pgmap v4333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7141.870539 secs 2024-07-26T10:34:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:56 smithi063 ceph-mon[36747]: pgmap v4333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7141.870539 secs 2024-07-26T10:34:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:56 smithi043 ceph-mon[32384]: pgmap v4333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:34:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7157.353319 secs 2024-07-26T10:34:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7157.353319 secs 2024-07-26T10:34:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7157.353319 secs 2024-07-26T10:34:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:34:58 smithi063 ceph-mon[36747]: pgmap v4334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:34:58 smithi043 ceph-mon[32384]: pgmap v4334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:34:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:34:58 smithi133 ceph-mon[37053]: pgmap v4334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:00 smithi063 ceph-mon[36747]: pgmap v4335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:00 smithi043 ceph-mon[32384]: pgmap v4335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:00 smithi133 ceph-mon[37053]: pgmap v4335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7146.870654 secs 2024-07-26T10:35:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7146.870654 secs 2024-07-26T10:35:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7146.870654 secs 2024-07-26T10:35:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7162.353438 secs 2024-07-26T10:35:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:02 smithi063 ceph-mon[36747]: pgmap v4336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7162.353438 secs 2024-07-26T10:35:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:02 smithi043 ceph-mon[32384]: pgmap v4336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7162.353438 secs 2024-07-26T10:35:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:02 smithi133 ceph-mon[37053]: pgmap v4336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:04 smithi063 ceph-mon[36747]: pgmap v4337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:04 smithi043 ceph-mon[32384]: pgmap v4337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:04 smithi133 ceph-mon[37053]: pgmap v4337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7151.870791 secs 2024-07-26T10:35:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:06 smithi063 ceph-mon[36747]: pgmap v4338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:35:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7151.870791 secs 2024-07-26T10:35:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:06 smithi043 ceph-mon[32384]: pgmap v4338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7151.870791 secs 2024-07-26T10:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:06 smithi133 ceph-mon[37053]: pgmap v4338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:35:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7167.353575 secs 2024-07-26T10:35:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7167.353575 secs 2024-07-26T10:35:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7167.353575 secs 2024-07-26T10:35:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:08 smithi063 ceph-mon[36747]: pgmap v4339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:08 smithi043 ceph-mon[32384]: pgmap v4339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:08 smithi133 ceph-mon[37053]: pgmap v4339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:10 smithi043 ceph-mon[32384]: pgmap v4340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:10 smithi133 ceph-mon[37053]: pgmap v4340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:10 smithi063 ceph-mon[36747]: pgmap v4340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:35:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7156.870910 secs 2024-07-26T10:35:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7172.353699 secs 2024-07-26T10:35:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7156.870910 secs 2024-07-26T10:35:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7172.353699 secs 2024-07-26T10:35:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7156.870910 secs 2024-07-26T10:35:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7172.353699 secs 2024-07-26T10:35:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:12 smithi043 ceph-mon[32384]: pgmap v4341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:12 smithi133 ceph-mon[37053]: pgmap v4341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:12 smithi063 ceph-mon[36747]: pgmap v4341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:14 smithi043 ceph-mon[32384]: pgmap v4342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:14 smithi133 ceph-mon[37053]: pgmap v4342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:14 smithi063 ceph-mon[36747]: pgmap v4342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7161.871023 secs 2024-07-26T10:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:16 smithi043 ceph-mon[32384]: pgmap v4343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7177.353822 secs 2024-07-26T10:35:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7161.871023 secs 2024-07-26T10:35:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:16 smithi133 ceph-mon[37053]: pgmap v4343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7177.353822 secs 2024-07-26T10:35:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7161.871023 secs 2024-07-26T10:35:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:16 smithi063 ceph-mon[36747]: pgmap v4343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7177.353822 secs 2024-07-26T10:35:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:18 smithi043 ceph-mon[32384]: pgmap v4344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:18 smithi133 ceph-mon[37053]: pgmap v4344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:18 smithi063 ceph-mon[36747]: pgmap v4344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:20 smithi043 ceph-mon[32384]: pgmap v4345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:20 smithi133 ceph-mon[37053]: pgmap v4345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:20 smithi063 ceph-mon[36747]: pgmap v4345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7166.871145 secs 2024-07-26T10:35:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7182.353897 secs 2024-07-26T10:35:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7166.871145 secs 2024-07-26T10:35:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7182.353897 secs 2024-07-26T10:35:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7166.871145 secs 2024-07-26T10:35:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7182.353897 secs 2024-07-26T10:35:22.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:22 smithi133 ceph-mon[37053]: pgmap v4346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:22 smithi043 ceph-mon[32384]: pgmap v4346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:22 smithi063 ceph-mon[36747]: pgmap v4346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:24 smithi043 ceph-mon[32384]: pgmap v4347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:24 smithi133 ceph-mon[37053]: pgmap v4347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:24 smithi063 ceph-mon[36747]: pgmap v4347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7171.871255 secs 2024-07-26T10:35:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:26 smithi043 ceph-mon[32384]: pgmap v4348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7187.353935 secs 2024-07-26T10:35:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7171.871255 secs 2024-07-26T10:35:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:26 smithi133 ceph-mon[37053]: pgmap v4348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7187.353935 secs 2024-07-26T10:35:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7171.871255 secs 2024-07-26T10:35:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:26 smithi063 ceph-mon[36747]: pgmap v4348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:27.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7187.353935 secs 2024-07-26T10:35:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:28 smithi043 ceph-mon[32384]: pgmap v4349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:28 smithi133 ceph-mon[37053]: pgmap v4349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:28 smithi063 ceph-mon[36747]: pgmap v4349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:30 smithi043 ceph-mon[32384]: pgmap v4350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:30 smithi133 ceph-mon[37053]: pgmap v4350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:30 smithi063 ceph-mon[36747]: pgmap v4350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7176.871368 secs 2024-07-26T10:35:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7192.354053 secs 2024-07-26T10:35:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7176.871368 secs 2024-07-26T10:35:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7192.354053 secs 2024-07-26T10:35:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7176.871368 secs 2024-07-26T10:35:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7192.354053 secs 2024-07-26T10:35:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:32 smithi043 ceph-mon[32384]: pgmap v4351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:32 smithi133 ceph-mon[37053]: pgmap v4351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:32 smithi063 ceph-mon[36747]: pgmap v4351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:34 smithi043 ceph-mon[32384]: pgmap v4352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:34 smithi133 ceph-mon[37053]: pgmap v4352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:34 smithi063 ceph-mon[36747]: pgmap v4352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7181.871492 secs 2024-07-26T10:35:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:36 smithi043 ceph-mon[32384]: pgmap v4353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7197.354171 secs 2024-07-26T10:35:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7181.871492 secs 2024-07-26T10:35:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:36 smithi133 ceph-mon[37053]: pgmap v4353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7197.354171 secs 2024-07-26T10:35:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7181.871492 secs 2024-07-26T10:35:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:36 smithi063 ceph-mon[36747]: pgmap v4353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:35:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7197.354171 secs 2024-07-26T10:35:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:38 smithi043 ceph-mon[32384]: pgmap v4354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:38 smithi133 ceph-mon[37053]: pgmap v4354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:38 smithi063 ceph-mon[36747]: pgmap v4354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:40 smithi043 ceph-mon[32384]: pgmap v4355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:40 smithi133 ceph-mon[37053]: pgmap v4355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:40 smithi063 ceph-mon[36747]: pgmap v4355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7186.871616 secs 2024-07-26T10:35:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7202.354269 secs 2024-07-26T10:35:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7186.871616 secs 2024-07-26T10:35:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7202.354269 secs 2024-07-26T10:35:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7186.871616 secs 2024-07-26T10:35:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7202.354269 secs 2024-07-26T10:35:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:42 smithi043 ceph-mon[32384]: pgmap v4356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:42 smithi133 ceph-mon[37053]: pgmap v4356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:42 smithi063 ceph-mon[36747]: pgmap v4356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:43 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:35:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:43 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:35:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:43 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:44 smithi043 ceph-mon[32384]: pgmap v4357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:44 smithi133 ceph-mon[37053]: pgmap v4357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:44 smithi063 ceph-mon[36747]: pgmap v4357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:35:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:45 smithi043 ceph-mon[32384]: pgmap v4358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:35:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:45 smithi043 ceph-mon[32384]: pgmap v4359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:45 smithi133 ceph-mon[37053]: pgmap v4358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:35:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:45 smithi133 ceph-mon[37053]: pgmap v4359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:45 smithi063 ceph-mon[36747]: pgmap v4358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:35:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:45 smithi063 ceph-mon[36747]: pgmap v4359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7191.871739 secs 2024-07-26T10:35:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7207.354389 secs 2024-07-26T10:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7191.871739 secs 2024-07-26T10:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7207.354389 secs 2024-07-26T10:35:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7191.871739 secs 2024-07-26T10:35:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7207.354389 secs 2024-07-26T10:35:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:47 smithi133 ceph-mon[37053]: pgmap v4360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:35:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:47 smithi063 ceph-mon[36747]: pgmap v4360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:35:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:47 smithi043 ceph-mon[32384]: pgmap v4360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:35:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:49 smithi133 ceph-mon[37053]: pgmap v4361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:49 smithi063 ceph-mon[36747]: pgmap v4361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:49 smithi043 ceph-mon[32384]: pgmap v4361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:52.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7196.871880 secs 2024-07-26T10:35:52.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7212.354530 secs 2024-07-26T10:35:52.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:51 smithi133 ceph-mon[37053]: pgmap v4362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7196.871880 secs 2024-07-26T10:35:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7212.354530 secs 2024-07-26T10:35:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:51 smithi063 ceph-mon[36747]: pgmap v4362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7196.871880 secs 2024-07-26T10:35:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7212.354530 secs 2024-07-26T10:35:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:51 smithi043 ceph-mon[32384]: pgmap v4362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:35:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:53 smithi133 ceph-mon[37053]: pgmap v4363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:35:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:53 smithi063 ceph-mon[36747]: pgmap v4363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:35:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:53 smithi043 ceph-mon[32384]: pgmap v4363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:35:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:55 smithi133 ceph-mon[37053]: pgmap v4364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:55 smithi063 ceph-mon[36747]: pgmap v4364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:55 smithi043 ceph-mon[32384]: pgmap v4364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:35:57.051 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7201.871994 secs 2024-07-26T10:35:57.052 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7217.354664 secs 2024-07-26T10:35:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7201.871994 secs 2024-07-26T10:35:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7217.354664 secs 2024-07-26T10:35:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7201.871994 secs 2024-07-26T10:35:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7217.354664 secs 2024-07-26T10:35:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:57 smithi063 ceph-mon[36747]: pgmap v4365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:57 smithi043 ceph-mon[32384]: pgmap v4365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:35:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:57 smithi133 ceph-mon[37053]: pgmap v4365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:35:59 smithi063 ceph-mon[36747]: pgmap v4366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:35:59 smithi043 ceph-mon[32384]: pgmap v4366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:35:59 smithi133 ceph-mon[37053]: pgmap v4366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7206.872131 secs 2024-07-26T10:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7222.354802 secs 2024-07-26T10:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:01 smithi063 ceph-mon[36747]: pgmap v4367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7206.872131 secs 2024-07-26T10:36:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7222.354802 secs 2024-07-26T10:36:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:01 smithi043 ceph-mon[32384]: pgmap v4367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7206.872131 secs 2024-07-26T10:36:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7222.354802 secs 2024-07-26T10:36:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:01 smithi133 ceph-mon[37053]: pgmap v4367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:03 smithi063 ceph-mon[36747]: pgmap v4368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:03 smithi043 ceph-mon[32384]: pgmap v4368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:03 smithi133 ceph-mon[37053]: pgmap v4368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:05 smithi063 ceph-mon[36747]: pgmap v4369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:05 smithi043 ceph-mon[32384]: pgmap v4369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:05 smithi133 ceph-mon[37053]: pgmap v4369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7211.872243 secs 2024-07-26T10:36:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7227.354911 secs 2024-07-26T10:36:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7211.872243 secs 2024-07-26T10:36:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7227.354911 secs 2024-07-26T10:36:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7211.872243 secs 2024-07-26T10:36:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7227.354911 secs 2024-07-26T10:36:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:07 smithi063 ceph-mon[36747]: pgmap v4370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:07 smithi043 ceph-mon[32384]: pgmap v4370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:07 smithi133 ceph-mon[37053]: pgmap v4370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:09 smithi043 ceph-mon[32384]: pgmap v4371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:09 smithi133 ceph-mon[37053]: pgmap v4371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:09 smithi063 ceph-mon[36747]: pgmap v4371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7216.872366 secs 2024-07-26T10:36:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7232.355006 secs 2024-07-26T10:36:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:11 smithi043 ceph-mon[32384]: pgmap v4372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7216.872366 secs 2024-07-26T10:36:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7232.355006 secs 2024-07-26T10:36:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:11 smithi133 ceph-mon[37053]: pgmap v4372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7216.872366 secs 2024-07-26T10:36:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7232.355006 secs 2024-07-26T10:36:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:11 smithi063 ceph-mon[36747]: pgmap v4372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:13 smithi043 ceph-mon[32384]: pgmap v4373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:13 smithi133 ceph-mon[37053]: pgmap v4373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:13 smithi063 ceph-mon[36747]: pgmap v4373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:15 smithi043 ceph-mon[32384]: pgmap v4374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:15 smithi133 ceph-mon[37053]: pgmap v4374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:15 smithi063 ceph-mon[36747]: pgmap v4374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7221.872483 secs 2024-07-26T10:36:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7237.355145 secs 2024-07-26T10:36:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7221.872483 secs 2024-07-26T10:36:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7237.355145 secs 2024-07-26T10:36:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7221.872483 secs 2024-07-26T10:36:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7237.355145 secs 2024-07-26T10:36:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:17 smithi043 ceph-mon[32384]: pgmap v4375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:17 smithi133 ceph-mon[37053]: pgmap v4375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:17 smithi063 ceph-mon[36747]: pgmap v4375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:19 smithi043 ceph-mon[32384]: pgmap v4376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:19 smithi133 ceph-mon[37053]: pgmap v4376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:19 smithi063 ceph-mon[36747]: pgmap v4376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7226.872596 secs 2024-07-26T10:36:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7242.355262 secs 2024-07-26T10:36:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:21 smithi043 ceph-mon[32384]: pgmap v4377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7226.872596 secs 2024-07-26T10:36:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7242.355262 secs 2024-07-26T10:36:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:21 smithi133 ceph-mon[37053]: pgmap v4377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7226.872596 secs 2024-07-26T10:36:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7242.355262 secs 2024-07-26T10:36:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:21 smithi063 ceph-mon[36747]: pgmap v4377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:23 smithi043 ceph-mon[32384]: pgmap v4378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:23 smithi133 ceph-mon[37053]: pgmap v4378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:23 smithi063 ceph-mon[36747]: pgmap v4378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:25 smithi043 ceph-mon[32384]: pgmap v4379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:25 smithi133 ceph-mon[37053]: pgmap v4379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:25 smithi063 ceph-mon[36747]: pgmap v4379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7231.872712 secs 2024-07-26T10:36:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7247.355394 secs 2024-07-26T10:36:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7231.872712 secs 2024-07-26T10:36:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7247.355394 secs 2024-07-26T10:36:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7231.872712 secs 2024-07-26T10:36:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7247.355394 secs 2024-07-26T10:36:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:27 smithi043 ceph-mon[32384]: pgmap v4380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:27 smithi133 ceph-mon[37053]: pgmap v4380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:27 smithi063 ceph-mon[36747]: pgmap v4380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:29 smithi043 ceph-mon[32384]: pgmap v4381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:29 smithi133 ceph-mon[37053]: pgmap v4381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:29 smithi063 ceph-mon[36747]: pgmap v4381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7236.872836 secs 2024-07-26T10:36:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7252.355499 secs 2024-07-26T10:36:32.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:31 smithi043 ceph-mon[32384]: pgmap v4382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7236.872836 secs 2024-07-26T10:36:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7252.355499 secs 2024-07-26T10:36:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:31 smithi133 ceph-mon[37053]: pgmap v4382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7236.872836 secs 2024-07-26T10:36:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7252.355499 secs 2024-07-26T10:36:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:31 smithi063 ceph-mon[36747]: pgmap v4382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:33 smithi043 ceph-mon[32384]: pgmap v4383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:33 smithi133 ceph-mon[37053]: pgmap v4383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:33 smithi063 ceph-mon[36747]: pgmap v4383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:35 smithi043 ceph-mon[32384]: pgmap v4384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:35 smithi133 ceph-mon[37053]: pgmap v4384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:35 smithi063 ceph-mon[36747]: pgmap v4384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7241.872972 secs 2024-07-26T10:36:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7257.355621 secs 2024-07-26T10:36:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7241.872972 secs 2024-07-26T10:36:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7257.355621 secs 2024-07-26T10:36:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7241.872972 secs 2024-07-26T10:36:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7257.355621 secs 2024-07-26T10:36:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:37 smithi043 ceph-mon[32384]: pgmap v4385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:37 smithi133 ceph-mon[37053]: pgmap v4385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:37 smithi063 ceph-mon[36747]: pgmap v4385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:39 smithi043 ceph-mon[32384]: pgmap v4386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:39 smithi133 ceph-mon[37053]: pgmap v4386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:39 smithi063 ceph-mon[36747]: pgmap v4386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7246.873070 secs 2024-07-26T10:36:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7262.355740 secs 2024-07-26T10:36:42.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:41 smithi043 ceph-mon[32384]: pgmap v4387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7246.873070 secs 2024-07-26T10:36:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7262.355740 secs 2024-07-26T10:36:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:41 smithi133 ceph-mon[37053]: pgmap v4387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7246.873070 secs 2024-07-26T10:36:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7262.355740 secs 2024-07-26T10:36:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:41 smithi063 ceph-mon[36747]: pgmap v4387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:36:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:43 smithi043 ceph-mon[32384]: pgmap v4388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:43 smithi133 ceph-mon[37053]: pgmap v4388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:43 smithi063 ceph-mon[36747]: pgmap v4388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:36:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:36:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:45 smithi043 ceph-mon[32384]: pgmap v4389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:45 smithi133 ceph-mon[37053]: pgmap v4389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:36:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:45 smithi063 ceph-mon[36747]: pgmap v4389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:36:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:36:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:36:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7251.873144 secs 2024-07-26T10:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7267.355857 secs 2024-07-26T10:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:46 smithi043 ceph-mon[32384]: pgmap v4390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:46 smithi043 ceph-mon[32384]: pgmap v4391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7251.873144 secs 2024-07-26T10:36:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7267.355857 secs 2024-07-26T10:36:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:46 smithi133 ceph-mon[37053]: pgmap v4390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:47.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:46 smithi133 ceph-mon[37053]: pgmap v4391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7251.873144 secs 2024-07-26T10:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7267.355857 secs 2024-07-26T10:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:46 smithi063 ceph-mon[36747]: pgmap v4390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:46 smithi063 ceph-mon[36747]: pgmap v4391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:48 smithi043 ceph-mon[32384]: pgmap v4392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:36:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:48 smithi133 ceph-mon[37053]: pgmap v4392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:36:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:48 smithi063 ceph-mon[36747]: pgmap v4392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:36:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:50 smithi043 ceph-mon[32384]: pgmap v4393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:36:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:50 smithi133 ceph-mon[37053]: pgmap v4393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:36:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:50 smithi063 ceph-mon[36747]: pgmap v4393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:36:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7256.873245 secs 2024-07-26T10:36:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7272.355974 secs 2024-07-26T10:36:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7256.873245 secs 2024-07-26T10:36:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7272.355974 secs 2024-07-26T10:36:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7256.873245 secs 2024-07-26T10:36:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7272.355974 secs 2024-07-26T10:36:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:52 smithi133 ceph-mon[37053]: pgmap v4394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:36:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:52 smithi063 ceph-mon[36747]: pgmap v4394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:36:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:52 smithi043 ceph-mon[32384]: pgmap v4394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:36:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:55 smithi133 ceph-mon[37053]: pgmap v4395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:55 smithi063 ceph-mon[36747]: pgmap v4395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:55 smithi043 ceph-mon[32384]: pgmap v4395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:36:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:57 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7261.873357 secs 2024-07-26T10:36:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7277.356092 secs 2024-07-26T10:36:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:57 smithi133 ceph-mon[37053]: pgmap v4396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:36:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:57 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7261.873357 secs 2024-07-26T10:36:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7277.356092 secs 2024-07-26T10:36:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:57 smithi063 ceph-mon[36747]: pgmap v4396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:36:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:57 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7261.873357 secs 2024-07-26T10:36:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7277.356092 secs 2024-07-26T10:36:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:57 smithi043 ceph-mon[32384]: pgmap v4396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:36:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:36:59 smithi133 ceph-mon[37053]: pgmap v4397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:59.285 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:36:59 smithi043 ceph-mon[32384]: pgmap v4397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:36:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:36:59 smithi063 ceph-mon[36747]: pgmap v4397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:01 smithi063 ceph-mon[36747]: pgmap v4398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:01 smithi043 ceph-mon[32384]: pgmap v4398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:01 smithi133 ceph-mon[37053]: pgmap v4398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:02 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7266.873475 secs 2024-07-26T10:37:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7282.356211 secs 2024-07-26T10:37:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:02 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7266.873475 secs 2024-07-26T10:37:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7282.356211 secs 2024-07-26T10:37:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:02 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7266.873475 secs 2024-07-26T10:37:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7282.356211 secs 2024-07-26T10:37:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:03 smithi063 ceph-mon[36747]: pgmap v4399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:03 smithi043 ceph-mon[32384]: pgmap v4399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:03 smithi133 ceph-mon[37053]: pgmap v4399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:05 smithi063 ceph-mon[36747]: pgmap v4400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:05 smithi043 ceph-mon[32384]: pgmap v4400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:05 smithi133 ceph-mon[37053]: pgmap v4400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:07 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7271.873592 secs 2024-07-26T10:37:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7287.356328 secs 2024-07-26T10:37:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:07 smithi063 ceph-mon[36747]: pgmap v4401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:07 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7271.873592 secs 2024-07-26T10:37:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7287.356328 secs 2024-07-26T10:37:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:07 smithi043 ceph-mon[32384]: pgmap v4401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:07 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7271.873592 secs 2024-07-26T10:37:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7287.356328 secs 2024-07-26T10:37:07.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:07 smithi133 ceph-mon[37053]: pgmap v4401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:09 smithi063 ceph-mon[36747]: pgmap v4402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:09.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:09 smithi043 ceph-mon[32384]: pgmap v4402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:09 smithi133 ceph-mon[37053]: pgmap v4402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:11 smithi063 ceph-mon[36747]: pgmap v4403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:11 smithi043 ceph-mon[32384]: pgmap v4403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:11 smithi133 ceph-mon[37053]: pgmap v4403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:12 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7276.873732 secs 2024-07-26T10:37:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7292.356468 secs 2024-07-26T10:37:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:12 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7276.873732 secs 2024-07-26T10:37:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7292.356468 secs 2024-07-26T10:37:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:12 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7276.873732 secs 2024-07-26T10:37:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7292.356468 secs 2024-07-26T10:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:13 smithi043 ceph-mon[32384]: pgmap v4404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:13 smithi133 ceph-mon[37053]: pgmap v4404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:13 smithi063 ceph-mon[36747]: pgmap v4404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:15 smithi043 ceph-mon[32384]: pgmap v4405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:15 smithi133 ceph-mon[37053]: pgmap v4405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:15 smithi063 ceph-mon[36747]: pgmap v4405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:17 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7281.873873 secs 2024-07-26T10:37:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7297.356566 secs 2024-07-26T10:37:17.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:17 smithi043 ceph-mon[32384]: pgmap v4406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:17 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7281.873873 secs 2024-07-26T10:37:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7297.356566 secs 2024-07-26T10:37:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:17 smithi133 ceph-mon[37053]: pgmap v4406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:17 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7281.873873 secs 2024-07-26T10:37:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7297.356566 secs 2024-07-26T10:37:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:17 smithi063 ceph-mon[36747]: pgmap v4406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:19 smithi043 ceph-mon[32384]: pgmap v4407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:19 smithi133 ceph-mon[37053]: pgmap v4407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:19 smithi063 ceph-mon[36747]: pgmap v4407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:20 smithi043 ceph-mon[32384]: pgmap v4408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:20 smithi133 ceph-mon[37053]: pgmap v4408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:20 smithi063 ceph-mon[36747]: pgmap v4408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7286.873995 secs 2024-07-26T10:37:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7286.873995 secs 2024-07-26T10:37:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7286.873995 secs 2024-07-26T10:37:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7302.356693 secs 2024-07-26T10:37:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:22 smithi063 ceph-mon[36747]: pgmap v4409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7302.356693 secs 2024-07-26T10:37:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:22 smithi043 ceph-mon[32384]: pgmap v4409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7302.356693 secs 2024-07-26T10:37:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:22 smithi133 ceph-mon[37053]: pgmap v4409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:25 smithi063 ceph-mon[36747]: pgmap v4410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:25.469 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:25 smithi133 ceph-mon[37053]: pgmap v4410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:25 smithi043 ceph-mon[32384]: pgmap v4410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:27 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7291.874113 secs 2024-07-26T10:37:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7307.356827 secs 2024-07-26T10:37:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:27 smithi063 ceph-mon[36747]: pgmap v4411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:27 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7291.874113 secs 2024-07-26T10:37:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7307.356827 secs 2024-07-26T10:37:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:27 smithi043 ceph-mon[32384]: pgmap v4411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:27 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7291.874113 secs 2024-07-26T10:37:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7307.356827 secs 2024-07-26T10:37:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:27 smithi133 ceph-mon[37053]: pgmap v4411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:29 smithi063 ceph-mon[36747]: pgmap v4412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:29 smithi043 ceph-mon[32384]: pgmap v4412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:29 smithi133 ceph-mon[37053]: pgmap v4412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:31 smithi063 ceph-mon[36747]: pgmap v4413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:31 smithi043 ceph-mon[32384]: pgmap v4413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:31 smithi133 ceph-mon[37053]: pgmap v4413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:32 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7296.874182 secs 2024-07-26T10:37:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7312.356945 secs 2024-07-26T10:37:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:32 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7296.874182 secs 2024-07-26T10:37:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7312.356945 secs 2024-07-26T10:37:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:32 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7296.874182 secs 2024-07-26T10:37:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7312.356945 secs 2024-07-26T10:37:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:33 smithi063 ceph-mon[36747]: pgmap v4414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:33 smithi043 ceph-mon[32384]: pgmap v4414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:33 smithi133 ceph-mon[37053]: pgmap v4414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:35 smithi063 ceph-mon[36747]: pgmap v4415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:35 smithi043 ceph-mon[32384]: pgmap v4415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:35 smithi133 ceph-mon[37053]: pgmap v4415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7301.874302 secs 2024-07-26T10:37:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7301.874302 secs 2024-07-26T10:37:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7301.874302 secs 2024-07-26T10:37:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7317.357064 secs 2024-07-26T10:37:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:37 smithi043 ceph-mon[32384]: pgmap v4416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7317.357064 secs 2024-07-26T10:37:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:37 smithi133 ceph-mon[37053]: pgmap v4416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7317.357064 secs 2024-07-26T10:37:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:37 smithi063 ceph-mon[36747]: pgmap v4416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:39 smithi043 ceph-mon[32384]: pgmap v4417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:39 smithi133 ceph-mon[37053]: pgmap v4417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:39 smithi063 ceph-mon[36747]: pgmap v4417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:41 smithi043 ceph-mon[32384]: pgmap v4418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:41.543 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7306.874418 secs 2024-07-26T10:37:41.544 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:41 smithi133 ceph-mon[37053]: pgmap v4418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:41.544 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7306.874418 secs 2024-07-26T10:37:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:41 smithi063 ceph-mon[36747]: pgmap v4418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:37:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7306.874418 secs 2024-07-26T10:37:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7322.357186 secs 2024-07-26T10:37:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7322.357186 secs 2024-07-26T10:37:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7322.357186 secs 2024-07-26T10:37:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:43 smithi043 ceph-mon[32384]: pgmap v4419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:43 smithi133 ceph-mon[37053]: pgmap v4419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:43 smithi063 ceph-mon[36747]: pgmap v4419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:44 smithi043 ceph-mon[32384]: pgmap v4420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:44 smithi133 ceph-mon[37053]: pgmap v4420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:44 smithi063 ceph-mon[36747]: pgmap v4420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7311.874576 secs 2024-07-26T10:37:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7311.874576 secs 2024-07-26T10:37:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7311.874576 secs 2024-07-26T10:37:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:46 smithi043 ceph-mon[32384]: pgmap v4421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:37:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:46 smithi063 ceph-mon[36747]: pgmap v4421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:37:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:46 smithi133 ceph-mon[37053]: pgmap v4421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:37:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7327.357313 secs 2024-07-26T10:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:37:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7327.357313 secs 2024-07-26T10:37:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:37:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:37:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:37:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7327.357313 secs 2024-07-26T10:37:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:37:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:37:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:48 smithi063 ceph-mon[36747]: pgmap v4422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:48 smithi063 ceph-mon[36747]: pgmap v4423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:37:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:48 smithi043 ceph-mon[32384]: pgmap v4422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:37:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:48 smithi043 ceph-mon[32384]: pgmap v4423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:48 smithi133 ceph-mon[37053]: pgmap v4422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:48 smithi133 ceph-mon[37053]: pgmap v4423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:37:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:50 smithi063 ceph-mon[36747]: pgmap v4424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:37:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7316.874655 secs 2024-07-26T10:37:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:50 smithi043 ceph-mon[32384]: pgmap v4424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:37:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7316.874655 secs 2024-07-26T10:37:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:50 smithi133 ceph-mon[37053]: pgmap v4424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:37:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7316.874655 secs 2024-07-26T10:37:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7332.357410 secs 2024-07-26T10:37:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:52 smithi063 ceph-mon[36747]: pgmap v4425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:37:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7332.357410 secs 2024-07-26T10:37:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:52 smithi043 ceph-mon[32384]: pgmap v4425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:37:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7332.357410 secs 2024-07-26T10:37:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:52 smithi133 ceph-mon[37053]: pgmap v4425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:37:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:54 smithi063 ceph-mon[36747]: pgmap v4426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:37:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:54 smithi043 ceph-mon[32384]: pgmap v4426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:37:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:54 smithi133 ceph-mon[37053]: pgmap v4426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:37:55.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7321.874776 secs 2024-07-26T10:37:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7321.874776 secs 2024-07-26T10:37:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7321.874776 secs 2024-07-26T10:37:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:56 smithi043 ceph-mon[32384]: pgmap v4427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:37:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:56 smithi133 ceph-mon[37053]: pgmap v4427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:37:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:56 smithi063 ceph-mon[36747]: pgmap v4427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:37:57.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7337.357529 secs 2024-07-26T10:37:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7337.357529 secs 2024-07-26T10:37:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7337.357529 secs 2024-07-26T10:37:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:37:58 smithi043 ceph-mon[32384]: pgmap v4428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:37:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:37:58 smithi133 ceph-mon[37053]: pgmap v4428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:37:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:37:58 smithi063 ceph-mon[36747]: pgmap v4428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:38:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:00 smithi043 ceph-mon[32384]: pgmap v4429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7326.874922 secs 2024-07-26T10:38:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:00 smithi133 ceph-mon[37053]: pgmap v4429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7326.874922 secs 2024-07-26T10:38:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:00 smithi063 ceph-mon[36747]: pgmap v4429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7326.874922 secs 2024-07-26T10:38:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7342.357678 secs 2024-07-26T10:38:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:02 smithi043 ceph-mon[32384]: pgmap v4430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7342.357678 secs 2024-07-26T10:38:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:02 smithi133 ceph-mon[37053]: pgmap v4430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7342.357678 secs 2024-07-26T10:38:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:02 smithi063 ceph-mon[36747]: pgmap v4430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:04 smithi043 ceph-mon[32384]: pgmap v4431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:04 smithi133 ceph-mon[37053]: pgmap v4431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:04 smithi063 ceph-mon[36747]: pgmap v4431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7331.875045 secs 2024-07-26T10:38:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7331.875045 secs 2024-07-26T10:38:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7331.875045 secs 2024-07-26T10:38:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:06 smithi043 ceph-mon[32384]: pgmap v4432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:06 smithi133 ceph-mon[37053]: pgmap v4432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:06 smithi063 ceph-mon[36747]: pgmap v4432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7347.357827 secs 2024-07-26T10:38:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7347.357827 secs 2024-07-26T10:38:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7347.357827 secs 2024-07-26T10:38:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:08 smithi043 ceph-mon[32384]: pgmap v4433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:08 smithi133 ceph-mon[37053]: pgmap v4433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:08 smithi063 ceph-mon[36747]: pgmap v4433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:10 smithi043 ceph-mon[32384]: pgmap v4434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7336.875144 secs 2024-07-26T10:38:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:10 smithi133 ceph-mon[37053]: pgmap v4434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7336.875144 secs 2024-07-26T10:38:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:10 smithi063 ceph-mon[36747]: pgmap v4434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7336.875144 secs 2024-07-26T10:38:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7352.357947 secs 2024-07-26T10:38:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:12 smithi043 ceph-mon[32384]: pgmap v4435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7352.357947 secs 2024-07-26T10:38:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:12 smithi133 ceph-mon[37053]: pgmap v4435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7352.357947 secs 2024-07-26T10:38:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:12 smithi063 ceph-mon[36747]: pgmap v4435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:14 smithi043 ceph-mon[32384]: pgmap v4436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:14 smithi133 ceph-mon[37053]: pgmap v4436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:14 smithi063 ceph-mon[36747]: pgmap v4436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7341.875242 secs 2024-07-26T10:38:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7341.875242 secs 2024-07-26T10:38:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7341.875242 secs 2024-07-26T10:38:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:16 smithi043 ceph-mon[32384]: pgmap v4437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:16 smithi133 ceph-mon[37053]: pgmap v4437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:16 smithi063 ceph-mon[36747]: pgmap v4437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:17.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7357.358078 secs 2024-07-26T10:38:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7357.358078 secs 2024-07-26T10:38:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7357.358078 secs 2024-07-26T10:38:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:18 smithi043 ceph-mon[32384]: pgmap v4438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:18 smithi133 ceph-mon[37053]: pgmap v4438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:18 smithi063 ceph-mon[36747]: pgmap v4438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:20 smithi043 ceph-mon[32384]: pgmap v4439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7346.875365 secs 2024-07-26T10:38:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:20 smithi133 ceph-mon[37053]: pgmap v4439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7346.875365 secs 2024-07-26T10:38:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:20 smithi063 ceph-mon[36747]: pgmap v4439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7346.875365 secs 2024-07-26T10:38:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7362.358177 secs 2024-07-26T10:38:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:22 smithi043 ceph-mon[32384]: pgmap v4440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7362.358177 secs 2024-07-26T10:38:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:22 smithi133 ceph-mon[37053]: pgmap v4440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7362.358177 secs 2024-07-26T10:38:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:22 smithi063 ceph-mon[36747]: pgmap v4440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:24 smithi043 ceph-mon[32384]: pgmap v4441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:24 smithi133 ceph-mon[37053]: pgmap v4441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:24 smithi063 ceph-mon[36747]: pgmap v4441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7351.875490 secs 2024-07-26T10:38:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7351.875490 secs 2024-07-26T10:38:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7351.875490 secs 2024-07-26T10:38:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:26 smithi043 ceph-mon[32384]: pgmap v4442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:26 smithi133 ceph-mon[37053]: pgmap v4442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:26 smithi063 ceph-mon[36747]: pgmap v4442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7367.358243 secs 2024-07-26T10:38:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7367.358243 secs 2024-07-26T10:38:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7367.358243 secs 2024-07-26T10:38:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:28 smithi043 ceph-mon[32384]: pgmap v4443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:28 smithi133 ceph-mon[37053]: pgmap v4443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:28 smithi063 ceph-mon[36747]: pgmap v4443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:30 smithi133 ceph-mon[37053]: pgmap v4444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7356.875614 secs 2024-07-26T10:38:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:30 smithi063 ceph-mon[36747]: pgmap v4444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7356.875614 secs 2024-07-26T10:38:30.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:30 smithi043 ceph-mon[32384]: pgmap v4444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:30.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7356.875614 secs 2024-07-26T10:38:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7372.358370 secs 2024-07-26T10:38:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:32 smithi133 ceph-mon[37053]: pgmap v4445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7372.358370 secs 2024-07-26T10:38:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:32 smithi063 ceph-mon[36747]: pgmap v4445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7372.358370 secs 2024-07-26T10:38:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:32 smithi043 ceph-mon[32384]: pgmap v4445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:34 smithi133 ceph-mon[37053]: pgmap v4446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:34 smithi063 ceph-mon[36747]: pgmap v4446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:34 smithi043 ceph-mon[32384]: pgmap v4446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7361.875733 secs 2024-07-26T10:38:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7361.875733 secs 2024-07-26T10:38:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7361.875733 secs 2024-07-26T10:38:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:36 smithi133 ceph-mon[37053]: pgmap v4447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:36 smithi063 ceph-mon[36747]: pgmap v4447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:36 smithi043 ceph-mon[32384]: pgmap v4447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7377.358491 secs 2024-07-26T10:38:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7377.358491 secs 2024-07-26T10:38:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7377.358491 secs 2024-07-26T10:38:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:38 smithi063 ceph-mon[36747]: pgmap v4448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:38 smithi043 ceph-mon[32384]: pgmap v4448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:38 smithi133 ceph-mon[37053]: pgmap v4448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:40 smithi063 ceph-mon[36747]: pgmap v4449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7366.875856 secs 2024-07-26T10:38:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:40 smithi043 ceph-mon[32384]: pgmap v4449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7366.875856 secs 2024-07-26T10:38:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:40 smithi133 ceph-mon[37053]: pgmap v4449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7366.875856 secs 2024-07-26T10:38:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7382.358628 secs 2024-07-26T10:38:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:42 smithi063 ceph-mon[36747]: pgmap v4450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7382.358628 secs 2024-07-26T10:38:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:42 smithi043 ceph-mon[32384]: pgmap v4450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7382.358628 secs 2024-07-26T10:38:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:42 smithi133 ceph-mon[37053]: pgmap v4450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:44 smithi063 ceph-mon[36747]: pgmap v4451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:44 smithi043 ceph-mon[32384]: pgmap v4451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:44 smithi133 ceph-mon[37053]: pgmap v4451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:38:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7371.875916 secs 2024-07-26T10:38:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7371.875916 secs 2024-07-26T10:38:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7371.875916 secs 2024-07-26T10:38:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:46 smithi063 ceph-mon[36747]: pgmap v4452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:46 smithi043 ceph-mon[32384]: pgmap v4452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:46 smithi133 ceph-mon[37053]: pgmap v4452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:38:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7387.358754 secs 2024-07-26T10:38:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:38:47.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7387.358754 secs 2024-07-26T10:38:47.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:38:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7387.358754 secs 2024-07-26T10:38:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:38:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:48 smithi043 ceph-mon[32384]: pgmap v4453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:38:48.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:38:48.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:48 smithi133 ceph-mon[37053]: pgmap v4453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:48 smithi063 ceph-mon[36747]: pgmap v4453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:38:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:49 smithi043 ceph-mon[32384]: pgmap v4454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:49 smithi043 ceph-mon[32384]: pgmap v4455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:49 smithi133 ceph-mon[37053]: pgmap v4454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:49 smithi133 ceph-mon[37053]: pgmap v4455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:49 smithi063 ceph-mon[36747]: pgmap v4454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:49 smithi063 ceph-mon[36747]: pgmap v4455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7376.876012 secs 2024-07-26T10:38:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7376.876012 secs 2024-07-26T10:38:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7376.876012 secs 2024-07-26T10:38:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:51 smithi043 ceph-mon[32384]: pgmap v4456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:38:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:51 smithi133 ceph-mon[37053]: pgmap v4456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:38:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:51 smithi063 ceph-mon[36747]: pgmap v4456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:38:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7392.358891 secs 2024-07-26T10:38:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7392.358891 secs 2024-07-26T10:38:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7392.358891 secs 2024-07-26T10:38:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:53 smithi043 ceph-mon[32384]: pgmap v4457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:38:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:53 smithi133 ceph-mon[37053]: pgmap v4457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:38:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:53 smithi063 ceph-mon[36747]: pgmap v4457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:38:55.987 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:55 smithi043 ceph-mon[32384]: pgmap v4458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:55.988 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7381.876127 secs 2024-07-26T10:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:55 smithi133 ceph-mon[37053]: pgmap v4458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7381.876127 secs 2024-07-26T10:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:55 smithi063 ceph-mon[36747]: pgmap v4458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7381.876127 secs 2024-07-26T10:38:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7397.358956 secs 2024-07-26T10:38:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7397.358956 secs 2024-07-26T10:38:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7397.358956 secs 2024-07-26T10:38:57.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:57 smithi063 ceph-mon[36747]: pgmap v4459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:57 smithi043 ceph-mon[32384]: pgmap v4459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:57 smithi133 ceph-mon[37053]: pgmap v4459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:38:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:38:59 smithi043 ceph-mon[32384]: pgmap v4460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:39:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:38:59 smithi133 ceph-mon[37053]: pgmap v4460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:39:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:38:59 smithi063 ceph-mon[36747]: pgmap v4460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:39:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7386.876250 secs 2024-07-26T10:39:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7386.876250 secs 2024-07-26T10:39:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7386.876250 secs 2024-07-26T10:39:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:01 smithi043 ceph-mon[32384]: pgmap v4461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7402.359069 secs 2024-07-26T10:39:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:01 smithi133 ceph-mon[37053]: pgmap v4461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7402.359069 secs 2024-07-26T10:39:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:01 smithi063 ceph-mon[36747]: pgmap v4461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7402.359069 secs 2024-07-26T10:39:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:03 smithi043 ceph-mon[32384]: pgmap v4462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:03 smithi133 ceph-mon[37053]: pgmap v4462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:03 smithi063 ceph-mon[36747]: pgmap v4462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:05 smithi043 ceph-mon[32384]: pgmap v4463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7391.876372 secs 2024-07-26T10:39:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:05 smithi133 ceph-mon[37053]: pgmap v4463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7391.876372 secs 2024-07-26T10:39:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:05 smithi063 ceph-mon[36747]: pgmap v4463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7391.876372 secs 2024-07-26T10:39:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7407.359135 secs 2024-07-26T10:39:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7407.359135 secs 2024-07-26T10:39:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7407.359135 secs 2024-07-26T10:39:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:07 smithi043 ceph-mon[32384]: pgmap v4464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:07 smithi133 ceph-mon[37053]: pgmap v4464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:07 smithi063 ceph-mon[36747]: pgmap v4464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:09 smithi043 ceph-mon[32384]: pgmap v4465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:09 smithi133 ceph-mon[37053]: pgmap v4465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:09 smithi063 ceph-mon[36747]: pgmap v4465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7396.876495 secs 2024-07-26T10:39:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7396.876495 secs 2024-07-26T10:39:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7396.876495 secs 2024-07-26T10:39:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:11 smithi043 ceph-mon[32384]: pgmap v4466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7412.359255 secs 2024-07-26T10:39:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:11 smithi133 ceph-mon[37053]: pgmap v4466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7412.359255 secs 2024-07-26T10:39:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:11 smithi063 ceph-mon[36747]: pgmap v4466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7412.359255 secs 2024-07-26T10:39:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:13 smithi043 ceph-mon[32384]: pgmap v4467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:13 smithi133 ceph-mon[37053]: pgmap v4467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:13 smithi063 ceph-mon[36747]: pgmap v4467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:15 smithi043 ceph-mon[32384]: pgmap v4468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7401.876645 secs 2024-07-26T10:39:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:15 smithi133 ceph-mon[37053]: pgmap v4468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7401.876645 secs 2024-07-26T10:39:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:15 smithi063 ceph-mon[36747]: pgmap v4468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7401.876645 secs 2024-07-26T10:39:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7417.359392 secs 2024-07-26T10:39:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7417.359392 secs 2024-07-26T10:39:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7417.359392 secs 2024-07-26T10:39:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:17 smithi043 ceph-mon[32384]: pgmap v4469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:17 smithi133 ceph-mon[37053]: pgmap v4469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:17 smithi063 ceph-mon[36747]: pgmap v4469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:19 smithi043 ceph-mon[32384]: pgmap v4470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:19 smithi133 ceph-mon[37053]: pgmap v4470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:19 smithi063 ceph-mon[36747]: pgmap v4470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7406.876723 secs 2024-07-26T10:39:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7406.876723 secs 2024-07-26T10:39:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7406.876723 secs 2024-07-26T10:39:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:21 smithi133 ceph-mon[37053]: pgmap v4471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7422.359490 secs 2024-07-26T10:39:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:21 smithi063 ceph-mon[36747]: pgmap v4471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7422.359490 secs 2024-07-26T10:39:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:21 smithi043 ceph-mon[32384]: pgmap v4471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7422.359490 secs 2024-07-26T10:39:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:23 smithi133 ceph-mon[37053]: pgmap v4472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:23 smithi063 ceph-mon[36747]: pgmap v4472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:23 smithi043 ceph-mon[32384]: pgmap v4472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:25 smithi133 ceph-mon[37053]: pgmap v4473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7411.876843 secs 2024-07-26T10:39:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:25 smithi063 ceph-mon[36747]: pgmap v4473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7411.876843 secs 2024-07-26T10:39:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:25 smithi043 ceph-mon[32384]: pgmap v4473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7411.876843 secs 2024-07-26T10:39:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7427.359607 secs 2024-07-26T10:39:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7427.359607 secs 2024-07-26T10:39:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7427.359607 secs 2024-07-26T10:39:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:27 smithi063 ceph-mon[36747]: pgmap v4474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:27 smithi043 ceph-mon[32384]: pgmap v4474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:27 smithi133 ceph-mon[37053]: pgmap v4474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:29 smithi063 ceph-mon[36747]: pgmap v4475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:29 smithi043 ceph-mon[32384]: pgmap v4475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:29 smithi133 ceph-mon[37053]: pgmap v4475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7416.876958 secs 2024-07-26T10:39:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7416.876958 secs 2024-07-26T10:39:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7416.876958 secs 2024-07-26T10:39:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:31 smithi063 ceph-mon[36747]: pgmap v4476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7432.359729 secs 2024-07-26T10:39:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:31 smithi043 ceph-mon[32384]: pgmap v4476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7432.359729 secs 2024-07-26T10:39:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:31 smithi133 ceph-mon[37053]: pgmap v4476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7432.359729 secs 2024-07-26T10:39:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:33 smithi063 ceph-mon[36747]: pgmap v4477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:34.139 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:33 smithi043 ceph-mon[32384]: pgmap v4477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:33 smithi133 ceph-mon[37053]: pgmap v4477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:35 smithi063 ceph-mon[36747]: pgmap v4478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7421.877122 secs 2024-07-26T10:39:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:35 smithi043 ceph-mon[32384]: pgmap v4478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7421.877122 secs 2024-07-26T10:39:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:35 smithi133 ceph-mon[37053]: pgmap v4478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7421.877122 secs 2024-07-26T10:39:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7437.359849 secs 2024-07-26T10:39:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7437.359849 secs 2024-07-26T10:39:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7437.359849 secs 2024-07-26T10:39:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:37 smithi043 ceph-mon[32384]: pgmap v4479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:37 smithi133 ceph-mon[37053]: pgmap v4479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:37 smithi063 ceph-mon[36747]: pgmap v4479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:39 smithi043 ceph-mon[32384]: pgmap v4480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:39 smithi133 ceph-mon[37053]: pgmap v4480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:39 smithi063 ceph-mon[36747]: pgmap v4480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7426.877251 secs 2024-07-26T10:39:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7426.877251 secs 2024-07-26T10:39:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7426.877251 secs 2024-07-26T10:39:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:41 smithi043 ceph-mon[32384]: pgmap v4481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7442.359969 secs 2024-07-26T10:39:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:41 smithi133 ceph-mon[37053]: pgmap v4481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7442.359969 secs 2024-07-26T10:39:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:41 smithi063 ceph-mon[36747]: pgmap v4481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:39:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7442.359969 secs 2024-07-26T10:39:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:43 smithi043 ceph-mon[32384]: pgmap v4482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:43 smithi133 ceph-mon[37053]: pgmap v4482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:43 smithi063 ceph-mon[36747]: pgmap v4482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:45 smithi043 ceph-mon[32384]: pgmap v4483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7431.877390 secs 2024-07-26T10:39:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:45 smithi133 ceph-mon[37053]: pgmap v4483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7431.877390 secs 2024-07-26T10:39:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:45 smithi063 ceph-mon[36747]: pgmap v4483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7431.877390 secs 2024-07-26T10:39:47.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7447.360064 secs 2024-07-26T10:39:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7447.360064 secs 2024-07-26T10:39:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7447.360064 secs 2024-07-26T10:39:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:47 smithi043 ceph-mon[32384]: pgmap v4484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:47 smithi133 ceph-mon[37053]: pgmap v4484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:47 smithi063 ceph-mon[36747]: pgmap v4484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:39:49.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:39:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:39:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:39:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: pgmap v4485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:39:50.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: pgmap v4485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:39:50.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:39:50.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:39:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: pgmap v4485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:39:50.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:39:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:50 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:39:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:50 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:39:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:50 smithi043 ceph-mon[32384]: pgmap v4486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:39:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:50 smithi043 ceph-mon[32384]: pgmap v4487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7436.877514 secs 2024-07-26T10:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:50 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:50 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:50 smithi133 ceph-mon[37053]: pgmap v4486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:50 smithi133 ceph-mon[37053]: pgmap v4487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:51.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7436.877514 secs 2024-07-26T10:39:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:50 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:39:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:50 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:39:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:50 smithi063 ceph-mon[36747]: pgmap v4486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:39:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:50 smithi063 ceph-mon[36747]: pgmap v4487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7436.877514 secs 2024-07-26T10:39:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7452.360184 secs 2024-07-26T10:39:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7452.360184 secs 2024-07-26T10:39:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7452.360184 secs 2024-07-26T10:39:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:52 smithi043 ceph-mon[32384]: pgmap v4488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:39:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:52 smithi133 ceph-mon[37053]: pgmap v4488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:39:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:52 smithi063 ceph-mon[36747]: pgmap v4488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:39:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:54 smithi043 ceph-mon[32384]: pgmap v4489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:54 smithi133 ceph-mon[37053]: pgmap v4489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:54 smithi063 ceph-mon[36747]: pgmap v4489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7441.877626 secs 2024-07-26T10:39:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7441.877626 secs 2024-07-26T10:39:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7441.877626 secs 2024-07-26T10:39:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:56 smithi043 ceph-mon[32384]: pgmap v4490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:56 smithi133 ceph-mon[37053]: pgmap v4490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:56 smithi063 ceph-mon[36747]: pgmap v4490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:39:57.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7457.360270 secs 2024-07-26T10:39:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7457.360270 secs 2024-07-26T10:39:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7457.360270 secs 2024-07-26T10:39:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:39:58 smithi043 ceph-mon[32384]: pgmap v4491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:39:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:39:58 smithi133 ceph-mon[37053]: pgmap v4491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:39:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:39:58 smithi063 ceph-mon[36747]: pgmap v4491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:40:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:00 smithi133 ceph-mon[37053]: pgmap v4492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:40:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:40:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7446.877762 secs 2024-07-26T10:40:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:00 smithi063 ceph-mon[36747]: pgmap v4492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:40:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:40:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7446.877762 secs 2024-07-26T10:40:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:00 smithi043 ceph-mon[32384]: pgmap v4492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:40:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:40:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7446.877762 secs 2024-07-26T10:40:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7462.360390 secs 2024-07-26T10:40:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7462.360390 secs 2024-07-26T10:40:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7462.360390 secs 2024-07-26T10:40:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:02 smithi133 ceph-mon[37053]: pgmap v4493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:02 smithi063 ceph-mon[36747]: pgmap v4493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:02 smithi043 ceph-mon[32384]: pgmap v4493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:04 smithi063 ceph-mon[36747]: pgmap v4494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:04 smithi043 ceph-mon[32384]: pgmap v4494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:04 smithi133 ceph-mon[37053]: pgmap v4494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7451.877880 secs 2024-07-26T10:40:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7451.877880 secs 2024-07-26T10:40:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7451.877880 secs 2024-07-26T10:40:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7467.360485 secs 2024-07-26T10:40:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:06 smithi063 ceph-mon[36747]: pgmap v4495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7467.360485 secs 2024-07-26T10:40:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:06 smithi043 ceph-mon[32384]: pgmap v4495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7467.360485 secs 2024-07-26T10:40:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:06 smithi133 ceph-mon[37053]: pgmap v4495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:08 smithi063 ceph-mon[36747]: pgmap v4496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:09.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:08 smithi043 ceph-mon[32384]: pgmap v4496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:08 smithi133 ceph-mon[37053]: pgmap v4496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:10 smithi063 ceph-mon[36747]: pgmap v4497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7456.877995 secs 2024-07-26T10:40:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:10 smithi043 ceph-mon[32384]: pgmap v4497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7456.877995 secs 2024-07-26T10:40:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:10 smithi133 ceph-mon[37053]: pgmap v4497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7456.877995 secs 2024-07-26T10:40:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7472.360591 secs 2024-07-26T10:40:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7472.360591 secs 2024-07-26T10:40:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7472.360591 secs 2024-07-26T10:40:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:12 smithi063 ceph-mon[36747]: pgmap v4498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:12 smithi043 ceph-mon[32384]: pgmap v4498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:12 smithi133 ceph-mon[37053]: pgmap v4498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:14 smithi063 ceph-mon[36747]: pgmap v4499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:14 smithi043 ceph-mon[32384]: pgmap v4499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:14 smithi133 ceph-mon[37053]: pgmap v4499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7461.878133 secs 2024-07-26T10:40:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7461.878133 secs 2024-07-26T10:40:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7461.878133 secs 2024-07-26T10:40:17.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7477.360691 secs 2024-07-26T10:40:17.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:16 smithi043 ceph-mon[32384]: pgmap v4500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7477.360691 secs 2024-07-26T10:40:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:16 smithi133 ceph-mon[37053]: pgmap v4500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7477.360691 secs 2024-07-26T10:40:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:16 smithi063 ceph-mon[36747]: pgmap v4500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:18 smithi043 ceph-mon[32384]: pgmap v4501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:18 smithi133 ceph-mon[37053]: pgmap v4501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:18 smithi063 ceph-mon[36747]: pgmap v4501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:20 smithi043 ceph-mon[32384]: pgmap v4502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7466.878218 secs 2024-07-26T10:40:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:20 smithi133 ceph-mon[37053]: pgmap v4502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7466.878218 secs 2024-07-26T10:40:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:20 smithi063 ceph-mon[36747]: pgmap v4502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7466.878218 secs 2024-07-26T10:40:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7482.360791 secs 2024-07-26T10:40:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7482.360791 secs 2024-07-26T10:40:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7482.360791 secs 2024-07-26T10:40:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:22 smithi043 ceph-mon[32384]: pgmap v4503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:22 smithi133 ceph-mon[37053]: pgmap v4503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:22 smithi063 ceph-mon[36747]: pgmap v4503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:24 smithi043 ceph-mon[32384]: pgmap v4504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:24 smithi133 ceph-mon[37053]: pgmap v4504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:24 smithi063 ceph-mon[36747]: pgmap v4504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7471.878282 secs 2024-07-26T10:40:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7471.878282 secs 2024-07-26T10:40:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7471.878282 secs 2024-07-26T10:40:27.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7487.360897 secs 2024-07-26T10:40:27.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:26 smithi063 ceph-mon[36747]: pgmap v4505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7487.360897 secs 2024-07-26T10:40:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:26 smithi043 ceph-mon[32384]: pgmap v4505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7487.360897 secs 2024-07-26T10:40:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:26 smithi133 ceph-mon[37053]: pgmap v4505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:28 smithi043 ceph-mon[32384]: pgmap v4506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:28 smithi133 ceph-mon[37053]: pgmap v4506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:28 smithi063 ceph-mon[36747]: pgmap v4506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:30 smithi043 ceph-mon[32384]: pgmap v4507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7476.878350 secs 2024-07-26T10:40:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:30 smithi133 ceph-mon[37053]: pgmap v4507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7476.878350 secs 2024-07-26T10:40:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:30 smithi063 ceph-mon[36747]: pgmap v4507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7476.878350 secs 2024-07-26T10:40:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7492.361015 secs 2024-07-26T10:40:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7492.361015 secs 2024-07-26T10:40:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7492.361015 secs 2024-07-26T10:40:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:32 smithi043 ceph-mon[32384]: pgmap v4508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:32 smithi133 ceph-mon[37053]: pgmap v4508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:32 smithi063 ceph-mon[36747]: pgmap v4508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:34 smithi043 ceph-mon[32384]: pgmap v4509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:34 smithi133 ceph-mon[37053]: pgmap v4509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:34 smithi063 ceph-mon[36747]: pgmap v4509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7481.878431 secs 2024-07-26T10:40:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7481.878431 secs 2024-07-26T10:40:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7481.878431 secs 2024-07-26T10:40:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7497.361127 secs 2024-07-26T10:40:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:36 smithi043 ceph-mon[32384]: pgmap v4510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7497.361127 secs 2024-07-26T10:40:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:36 smithi133 ceph-mon[37053]: pgmap v4510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7497.361127 secs 2024-07-26T10:40:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:36 smithi063 ceph-mon[36747]: pgmap v4510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:38 smithi043 ceph-mon[32384]: pgmap v4511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:38 smithi133 ceph-mon[37053]: pgmap v4511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:38 smithi063 ceph-mon[36747]: pgmap v4511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:40 smithi043 ceph-mon[32384]: pgmap v4512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7486.878552 secs 2024-07-26T10:40:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:40 smithi133 ceph-mon[37053]: pgmap v4512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7486.878552 secs 2024-07-26T10:40:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:40 smithi063 ceph-mon[36747]: pgmap v4512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7486.878552 secs 2024-07-26T10:40:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7502.361215 secs 2024-07-26T10:40:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7502.361215 secs 2024-07-26T10:40:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7502.361215 secs 2024-07-26T10:40:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:42 smithi043 ceph-mon[32384]: pgmap v4513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:42 smithi133 ceph-mon[37053]: pgmap v4513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:42 smithi063 ceph-mon[36747]: pgmap v4513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:44 smithi043 ceph-mon[32384]: pgmap v4514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:44 smithi133 ceph-mon[37053]: pgmap v4514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:44 smithi063 ceph-mon[36747]: pgmap v4514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7491.878669 secs 2024-07-26T10:40:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7491.878669 secs 2024-07-26T10:40:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7491.878669 secs 2024-07-26T10:40:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7507.361327 secs 2024-07-26T10:40:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:46 smithi043 ceph-mon[32384]: pgmap v4515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7507.361327 secs 2024-07-26T10:40:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:46 smithi133 ceph-mon[37053]: pgmap v4515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7507.361327 secs 2024-07-26T10:40:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:46 smithi063 ceph-mon[36747]: pgmap v4515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:40:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:48 smithi043 ceph-mon[32384]: pgmap v4516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:48 smithi133 ceph-mon[37053]: pgmap v4516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:48 smithi063 ceph-mon[36747]: pgmap v4516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:40:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:40:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:40:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: pgmap v4517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7496.878764 secs 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.270 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:40:51.271 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:40:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: pgmap v4517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7496.878764 secs 2024-07-26T10:40:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:40:51.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:40:51.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: pgmap v4517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7496.878764 secs 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:40:51.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:40:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:40:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:40:52.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:40:52.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:40:52.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7512.361416 secs 2024-07-26T10:40:52.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: pgmap v4518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:40:52.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:51 smithi133 ceph-mon[37053]: pgmap v4519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:40:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:40:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:40:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:40:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:40:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7512.361416 secs 2024-07-26T10:40:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: pgmap v4518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:40:52.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:51 smithi063 ceph-mon[36747]: pgmap v4519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:40:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:40:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7512.361416 secs 2024-07-26T10:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: pgmap v4518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:51 smithi043 ceph-mon[32384]: pgmap v4519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:40:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:54 smithi133 ceph-mon[37053]: pgmap v4520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:40:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:54 smithi063 ceph-mon[36747]: pgmap v4520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:40:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:53 smithi043 ceph-mon[32384]: pgmap v4520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:40:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:56 smithi133 ceph-mon[37053]: pgmap v4521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:40:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7501.878906 secs 2024-07-26T10:40:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:56 smithi063 ceph-mon[36747]: pgmap v4521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:40:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7501.878906 secs 2024-07-26T10:40:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:56 smithi043 ceph-mon[32384]: pgmap v4521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:40:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7501.878906 secs 2024-07-26T10:40:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7517.361535 secs 2024-07-26T10:40:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7517.361535 secs 2024-07-26T10:40:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7517.361535 secs 2024-07-26T10:40:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:40:58 smithi063 ceph-mon[36747]: pgmap v4522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:40:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:40:58 smithi043 ceph-mon[32384]: pgmap v4522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:40:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:40:58 smithi133 ceph-mon[37053]: pgmap v4522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T10:41:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:00 smithi063 ceph-mon[36747]: pgmap v4523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:00 smithi043 ceph-mon[32384]: pgmap v4523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:00 smithi133 ceph-mon[37053]: pgmap v4523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7506.879057 secs 2024-07-26T10:41:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7506.879057 secs 2024-07-26T10:41:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7506.879057 secs 2024-07-26T10:41:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7522.361655 secs 2024-07-26T10:41:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:02 smithi063 ceph-mon[36747]: pgmap v4524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:41:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7522.361655 secs 2024-07-26T10:41:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:02 smithi043 ceph-mon[32384]: pgmap v4524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:41:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7522.361655 secs 2024-07-26T10:41:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:02 smithi133 ceph-mon[37053]: pgmap v4524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T10:41:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:04 smithi063 ceph-mon[36747]: pgmap v4525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:41:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:04 smithi043 ceph-mon[32384]: pgmap v4525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:41:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:04 smithi133 ceph-mon[37053]: pgmap v4525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:41:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:06 smithi063 ceph-mon[36747]: pgmap v4526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:41:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7511.879176 secs 2024-07-26T10:41:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:06 smithi043 ceph-mon[32384]: pgmap v4526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:41:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7511.879176 secs 2024-07-26T10:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:06 smithi133 ceph-mon[37053]: pgmap v4526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:41:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7511.879176 secs 2024-07-26T10:41:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7527.361723 secs 2024-07-26T10:41:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7527.361723 secs 2024-07-26T10:41:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7527.361723 secs 2024-07-26T10:41:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:08 smithi063 ceph-mon[36747]: pgmap v4527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:41:08.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:08 smithi043 ceph-mon[32384]: pgmap v4527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:41:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:08 smithi133 ceph-mon[37053]: pgmap v4527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:41:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:09 smithi043 ceph-mon[32384]: pgmap v4528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:09 smithi133 ceph-mon[37053]: pgmap v4528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:09 smithi063 ceph-mon[36747]: pgmap v4528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7516.879267 secs 2024-07-26T10:41:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7516.879267 secs 2024-07-26T10:41:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7516.879267 secs 2024-07-26T10:41:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:11 smithi043 ceph-mon[32384]: pgmap v4529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:11 smithi133 ceph-mon[37053]: pgmap v4529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:11 smithi063 ceph-mon[36747]: pgmap v4529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7532.361789 secs 2024-07-26T10:41:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7532.361789 secs 2024-07-26T10:41:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7532.361789 secs 2024-07-26T10:41:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:13 smithi133 ceph-mon[37053]: pgmap v4530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:13 smithi063 ceph-mon[36747]: pgmap v4530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:13 smithi043 ceph-mon[32384]: pgmap v4530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:16 smithi063 ceph-mon[36747]: pgmap v4531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7521.879388 secs 2024-07-26T10:41:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:16 smithi043 ceph-mon[32384]: pgmap v4531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7521.879388 secs 2024-07-26T10:41:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:16 smithi133 ceph-mon[37053]: pgmap v4531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7521.879388 secs 2024-07-26T10:41:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7537.361912 secs 2024-07-26T10:41:17.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7537.361912 secs 2024-07-26T10:41:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7537.361912 secs 2024-07-26T10:41:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:18 smithi063 ceph-mon[36747]: pgmap v4532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:18 smithi043 ceph-mon[32384]: pgmap v4532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:18 smithi133 ceph-mon[37053]: pgmap v4532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:20 smithi063 ceph-mon[36747]: pgmap v4533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:20 smithi043 ceph-mon[32384]: pgmap v4533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:20 smithi133 ceph-mon[37053]: pgmap v4533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7526.879479 secs 2024-07-26T10:41:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7526.879479 secs 2024-07-26T10:41:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7526.879479 secs 2024-07-26T10:41:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7542.361990 secs 2024-07-26T10:41:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:22 smithi043 ceph-mon[32384]: pgmap v4534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7542.361990 secs 2024-07-26T10:41:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:22 smithi133 ceph-mon[37053]: pgmap v4534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7542.361990 secs 2024-07-26T10:41:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:22 smithi063 ceph-mon[36747]: pgmap v4534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:24 smithi043 ceph-mon[32384]: pgmap v4535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:24 smithi133 ceph-mon[37053]: pgmap v4535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:24 smithi063 ceph-mon[36747]: pgmap v4535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:26 smithi043 ceph-mon[32384]: pgmap v4536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7531.879603 secs 2024-07-26T10:41:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:26 smithi133 ceph-mon[37053]: pgmap v4536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7531.879603 secs 2024-07-26T10:41:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:26 smithi063 ceph-mon[36747]: pgmap v4536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7531.879603 secs 2024-07-26T10:41:27.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7547.362054 secs 2024-07-26T10:41:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7547.362054 secs 2024-07-26T10:41:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7547.362054 secs 2024-07-26T10:41:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:28 smithi043 ceph-mon[32384]: pgmap v4537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:28 smithi133 ceph-mon[37053]: pgmap v4537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:28 smithi063 ceph-mon[36747]: pgmap v4537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:30 smithi043 ceph-mon[32384]: pgmap v4538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:30 smithi133 ceph-mon[37053]: pgmap v4538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:30 smithi063 ceph-mon[36747]: pgmap v4538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7536.879746 secs 2024-07-26T10:41:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7552.362176 secs 2024-07-26T10:41:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7536.879746 secs 2024-07-26T10:41:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7552.362176 secs 2024-07-26T10:41:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7536.879746 secs 2024-07-26T10:41:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7552.362176 secs 2024-07-26T10:41:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:32 smithi043 ceph-mon[32384]: pgmap v4539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:32 smithi133 ceph-mon[37053]: pgmap v4539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:32 smithi063 ceph-mon[36747]: pgmap v4539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:34 smithi043 ceph-mon[32384]: pgmap v4540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:34 smithi133 ceph-mon[37053]: pgmap v4540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:34 smithi063 ceph-mon[36747]: pgmap v4540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:36 smithi043 ceph-mon[32384]: pgmap v4541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7541.879913 secs 2024-07-26T10:41:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7557.362270 secs 2024-07-26T10:41:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:36 smithi133 ceph-mon[37053]: pgmap v4541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7541.879913 secs 2024-07-26T10:41:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7557.362270 secs 2024-07-26T10:41:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:36 smithi063 ceph-mon[36747]: pgmap v4541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7541.879913 secs 2024-07-26T10:41:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7557.362270 secs 2024-07-26T10:41:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:38 smithi043 ceph-mon[32384]: pgmap v4542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:38 smithi133 ceph-mon[37053]: pgmap v4542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:38 smithi063 ceph-mon[36747]: pgmap v4542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:40 smithi043 ceph-mon[32384]: pgmap v4543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:40 smithi133 ceph-mon[37053]: pgmap v4543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:40 smithi063 ceph-mon[36747]: pgmap v4543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7546.880027 secs 2024-07-26T10:41:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7562.362395 secs 2024-07-26T10:41:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7546.880027 secs 2024-07-26T10:41:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7562.362395 secs 2024-07-26T10:41:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7546.880027 secs 2024-07-26T10:41:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7562.362395 secs 2024-07-26T10:41:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:42 smithi043 ceph-mon[32384]: pgmap v4544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:42.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:42 smithi133 ceph-mon[37053]: pgmap v4544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:42 smithi063 ceph-mon[36747]: pgmap v4544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:43 smithi043 ceph-mon[32384]: pgmap v4545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:43 smithi133 ceph-mon[37053]: pgmap v4545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:43 smithi063 ceph-mon[36747]: pgmap v4545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:46 smithi063 ceph-mon[36747]: pgmap v4546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7551.880146 secs 2024-07-26T10:41:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7567.362463 secs 2024-07-26T10:41:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:46 smithi043 ceph-mon[32384]: pgmap v4546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7551.880146 secs 2024-07-26T10:41:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7567.362463 secs 2024-07-26T10:41:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:46 smithi133 ceph-mon[37053]: pgmap v4546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:41:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7551.880146 secs 2024-07-26T10:41:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7567.362463 secs 2024-07-26T10:41:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:48 smithi063 ceph-mon[36747]: pgmap v4547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:48 smithi043 ceph-mon[32384]: pgmap v4547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:48 smithi133 ceph-mon[37053]: pgmap v4547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:50 smithi043 ceph-mon[32384]: pgmap v4548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:50 smithi133 ceph-mon[37053]: pgmap v4548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:50 smithi063 ceph-mon[36747]: pgmap v4548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:41:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7556.880270 secs 2024-07-26T10:41:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7572.362586 secs 2024-07-26T10:41:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7556.880270 secs 2024-07-26T10:41:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7572.362586 secs 2024-07-26T10:41:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7556.880270 secs 2024-07-26T10:41:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7572.362586 secs 2024-07-26T10:41:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:52 smithi043 ceph-mon[32384]: pgmap v4549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:41:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:52 smithi133 ceph-mon[37053]: pgmap v4549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:41:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:52 smithi063 ceph-mon[36747]: pgmap v4549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:41:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:41:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:41:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:41:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:41:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:41:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:41:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:41:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:41:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:41:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:41:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:54 smithi043 ceph-mon[32384]: pgmap v4550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:41:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:54 smithi043 ceph-mon[32384]: pgmap v4551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:41:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:54 smithi133 ceph-mon[37053]: pgmap v4550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:41:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:54 smithi133 ceph-mon[37053]: pgmap v4551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:41:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:54 smithi063 ceph-mon[36747]: pgmap v4550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:41:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:54 smithi063 ceph-mon[36747]: pgmap v4551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:41:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:56 smithi043 ceph-mon[32384]: pgmap v4552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:41:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7561.880336 secs 2024-07-26T10:41:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7577.362709 secs 2024-07-26T10:41:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:56 smithi133 ceph-mon[37053]: pgmap v4552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:41:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7561.880336 secs 2024-07-26T10:41:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7577.362709 secs 2024-07-26T10:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:56 smithi063 ceph-mon[36747]: pgmap v4552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7561.880336 secs 2024-07-26T10:41:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7577.362709 secs 2024-07-26T10:41:58.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:41:58 smithi063 ceph-mon[36747]: pgmap v4553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:41:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:41:58 smithi043 ceph-mon[32384]: pgmap v4553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:41:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:41:58 smithi133 ceph-mon[37053]: pgmap v4553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:42:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:00 smithi043 ceph-mon[32384]: pgmap v4554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:42:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:00 smithi133 ceph-mon[37053]: pgmap v4554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:42:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:00 smithi063 ceph-mon[36747]: pgmap v4554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:42:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7566.880468 secs 2024-07-26T10:42:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7582.362848 secs 2024-07-26T10:42:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7566.880468 secs 2024-07-26T10:42:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7582.362848 secs 2024-07-26T10:42:01.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7566.880468 secs 2024-07-26T10:42:01.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7582.362848 secs 2024-07-26T10:42:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:02 smithi043 ceph-mon[32384]: pgmap v4555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:42:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:02 smithi133 ceph-mon[37053]: pgmap v4555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:42:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:02 smithi063 ceph-mon[36747]: pgmap v4555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:42:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:04 smithi043 ceph-mon[32384]: pgmap v4556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:04 smithi133 ceph-mon[37053]: pgmap v4556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:04 smithi063 ceph-mon[36747]: pgmap v4556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:06 smithi043 ceph-mon[32384]: pgmap v4557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7571.880590 secs 2024-07-26T10:42:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7587.362928 secs 2024-07-26T10:42:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:06 smithi133 ceph-mon[37053]: pgmap v4557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7571.880590 secs 2024-07-26T10:42:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7587.362928 secs 2024-07-26T10:42:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:06 smithi063 ceph-mon[36747]: pgmap v4557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7571.880590 secs 2024-07-26T10:42:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7587.362928 secs 2024-07-26T10:42:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:08 smithi043 ceph-mon[32384]: pgmap v4558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:08 smithi133 ceph-mon[37053]: pgmap v4558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:08.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:08 smithi063 ceph-mon[36747]: pgmap v4558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:10 smithi043 ceph-mon[32384]: pgmap v4559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:10 smithi133 ceph-mon[37053]: pgmap v4559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:10 smithi063 ceph-mon[36747]: pgmap v4559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7576.880718 secs 2024-07-26T10:42:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7592.363030 secs 2024-07-26T10:42:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7576.880718 secs 2024-07-26T10:42:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7592.363030 secs 2024-07-26T10:42:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7576.880718 secs 2024-07-26T10:42:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7592.363030 secs 2024-07-26T10:42:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:12 smithi043 ceph-mon[32384]: pgmap v4560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:42:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:12 smithi133 ceph-mon[37053]: pgmap v4560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:42:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:12 smithi063 ceph-mon[36747]: pgmap v4560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:42:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:13 smithi043 ceph-mon[32384]: pgmap v4561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:13 smithi133 ceph-mon[37053]: pgmap v4561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:13 smithi063 ceph-mon[36747]: pgmap v4561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:42:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:15 smithi043 ceph-mon[32384]: pgmap v4562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7581.880858 secs 2024-07-26T10:42:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:15 smithi133 ceph-mon[37053]: pgmap v4562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7581.880858 secs 2024-07-26T10:42:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:15 smithi063 ceph-mon[36747]: pgmap v4562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7581.880858 secs 2024-07-26T10:42:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7597.363129 secs 2024-07-26T10:42:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7597.363129 secs 2024-07-26T10:42:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7597.363129 secs 2024-07-26T10:42:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:17 smithi043 ceph-mon[32384]: pgmap v4563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:17 smithi133 ceph-mon[37053]: pgmap v4563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:17 smithi063 ceph-mon[36747]: pgmap v4563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:19 smithi043 ceph-mon[32384]: pgmap v4564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:19 smithi133 ceph-mon[37053]: pgmap v4564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:19 smithi063 ceph-mon[36747]: pgmap v4564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7586.880919 secs 2024-07-26T10:42:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7586.880919 secs 2024-07-26T10:42:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7586.880919 secs 2024-07-26T10:42:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:21 smithi043 ceph-mon[32384]: pgmap v4565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7602.363217 secs 2024-07-26T10:42:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:21 smithi133 ceph-mon[37053]: pgmap v4565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7602.363217 secs 2024-07-26T10:42:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:21 smithi063 ceph-mon[36747]: pgmap v4565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7602.363217 secs 2024-07-26T10:42:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:23 smithi043 ceph-mon[32384]: pgmap v4566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:23 smithi133 ceph-mon[37053]: pgmap v4566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:23 smithi063 ceph-mon[36747]: pgmap v4566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:25 smithi043 ceph-mon[32384]: pgmap v4567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7591.881035 secs 2024-07-26T10:42:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:25 smithi133 ceph-mon[37053]: pgmap v4567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7591.881035 secs 2024-07-26T10:42:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:25 smithi063 ceph-mon[36747]: pgmap v4567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7591.881035 secs 2024-07-26T10:42:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7607.363286 secs 2024-07-26T10:42:26.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7607.363286 secs 2024-07-26T10:42:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7607.363286 secs 2024-07-26T10:42:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:27 smithi043 ceph-mon[32384]: pgmap v4568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:27 smithi133 ceph-mon[37053]: pgmap v4568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:27 smithi063 ceph-mon[36747]: pgmap v4568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:29 smithi043 ceph-mon[32384]: pgmap v4569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:29 smithi133 ceph-mon[37053]: pgmap v4569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:29 smithi063 ceph-mon[36747]: pgmap v4569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7596.881136 secs 2024-07-26T10:42:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7596.881136 secs 2024-07-26T10:42:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7596.881136 secs 2024-07-26T10:42:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:31 smithi043 ceph-mon[32384]: pgmap v4570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7612.363409 secs 2024-07-26T10:42:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:31 smithi133 ceph-mon[37053]: pgmap v4570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7612.363409 secs 2024-07-26T10:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:31 smithi063 ceph-mon[36747]: pgmap v4570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7612.363409 secs 2024-07-26T10:42:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:33 smithi043 ceph-mon[32384]: pgmap v4571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:33 smithi133 ceph-mon[37053]: pgmap v4571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:33 smithi063 ceph-mon[36747]: pgmap v4571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:35 smithi043 ceph-mon[32384]: pgmap v4572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7601.881188 secs 2024-07-26T10:42:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:35 smithi133 ceph-mon[37053]: pgmap v4572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7601.881188 secs 2024-07-26T10:42:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:35 smithi063 ceph-mon[36747]: pgmap v4572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7601.881188 secs 2024-07-26T10:42:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7617.363531 secs 2024-07-26T10:42:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7617.363531 secs 2024-07-26T10:42:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7617.363531 secs 2024-07-26T10:42:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:37 smithi043 ceph-mon[32384]: pgmap v4573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:37 smithi133 ceph-mon[37053]: pgmap v4573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:37 smithi063 ceph-mon[36747]: pgmap v4573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:39 smithi043 ceph-mon[32384]: pgmap v4574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:39 smithi133 ceph-mon[37053]: pgmap v4574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:39 smithi063 ceph-mon[36747]: pgmap v4574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7606.881303 secs 2024-07-26T10:42:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7606.881303 secs 2024-07-26T10:42:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7606.881303 secs 2024-07-26T10:42:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:41 smithi043 ceph-mon[32384]: pgmap v4575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7622.363660 secs 2024-07-26T10:42:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:41 smithi133 ceph-mon[37053]: pgmap v4575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7622.363660 secs 2024-07-26T10:42:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:41 smithi063 ceph-mon[36747]: pgmap v4575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7622.363660 secs 2024-07-26T10:42:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:43 smithi043 ceph-mon[32384]: pgmap v4576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:43 smithi133 ceph-mon[37053]: pgmap v4576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:43 smithi063 ceph-mon[36747]: pgmap v4576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:45 smithi043 ceph-mon[32384]: pgmap v4577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7611.881422 secs 2024-07-26T10:42:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:45 smithi133 ceph-mon[37053]: pgmap v4577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7611.881422 secs 2024-07-26T10:42:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:45 smithi063 ceph-mon[36747]: pgmap v4577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7611.881422 secs 2024-07-26T10:42:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7627.363779 secs 2024-07-26T10:42:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7627.363779 secs 2024-07-26T10:42:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7627.363779 secs 2024-07-26T10:42:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:47 smithi133 ceph-mon[37053]: pgmap v4578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:47 smithi063 ceph-mon[36747]: pgmap v4578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:47 smithi043 ceph-mon[32384]: pgmap v4578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:49 smithi133 ceph-mon[37053]: pgmap v4579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:49.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:49 smithi043 ceph-mon[32384]: pgmap v4579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:49 smithi063 ceph-mon[36747]: pgmap v4579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7616.881561 secs 2024-07-26T10:42:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7616.881561 secs 2024-07-26T10:42:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7616.881561 secs 2024-07-26T10:42:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:51 smithi133 ceph-mon[37053]: pgmap v4580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7632.363900 secs 2024-07-26T10:42:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:51 smithi063 ceph-mon[36747]: pgmap v4580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7632.363900 secs 2024-07-26T10:42:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:51 smithi043 ceph-mon[32384]: pgmap v4580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:42:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7632.363900 secs 2024-07-26T10:42:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:42:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:42:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:42:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:54 smithi043 ceph-mon[32384]: pgmap v4581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:54 smithi133 ceph-mon[37053]: pgmap v4581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:54 smithi063 ceph-mon[36747]: pgmap v4581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:42:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:42:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:42:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:42:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:42:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:42:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:42:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:42:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:56 smithi043 ceph-mon[32384]: pgmap v4582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:56 smithi043 ceph-mon[32384]: pgmap v4583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7621.881680 secs 2024-07-26T10:42:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7637.364021 secs 2024-07-26T10:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:56 smithi133 ceph-mon[37053]: pgmap v4582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:56 smithi133 ceph-mon[37053]: pgmap v4583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7621.881680 secs 2024-07-26T10:42:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7637.364021 secs 2024-07-26T10:42:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:56 smithi063 ceph-mon[36747]: pgmap v4582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:42:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:56 smithi063 ceph-mon[36747]: pgmap v4583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7621.881680 secs 2024-07-26T10:42:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7637.364021 secs 2024-07-26T10:42:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:57 smithi043 ceph-mon[32384]: pgmap v4584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:57 smithi133 ceph-mon[37053]: pgmap v4584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:57 smithi063 ceph-mon[36747]: pgmap v4584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:42:59 smithi043 ceph-mon[32384]: pgmap v4585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:42:59 smithi133 ceph-mon[37053]: pgmap v4585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:42:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:42:59 smithi063 ceph-mon[36747]: pgmap v4585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7626.881816 secs 2024-07-26T10:43:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7626.881816 secs 2024-07-26T10:43:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7626.881816 secs 2024-07-26T10:43:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:01 smithi043 ceph-mon[32384]: pgmap v4586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7642.364104 secs 2024-07-26T10:43:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:01 smithi133 ceph-mon[37053]: pgmap v4586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7642.364104 secs 2024-07-26T10:43:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:01 smithi063 ceph-mon[36747]: pgmap v4586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7642.364104 secs 2024-07-26T10:43:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:03 smithi043 ceph-mon[32384]: pgmap v4587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:03 smithi133 ceph-mon[37053]: pgmap v4587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:03 smithi063 ceph-mon[36747]: pgmap v4587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:43:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:05 smithi063 ceph-mon[36747]: pgmap v4588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:43:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7631.881956 secs 2024-07-26T10:43:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:05 smithi043 ceph-mon[32384]: pgmap v4588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:43:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7631.881956 secs 2024-07-26T10:43:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:05 smithi133 ceph-mon[37053]: pgmap v4588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:43:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7631.881956 secs 2024-07-26T10:43:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7647.364183 secs 2024-07-26T10:43:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7647.364183 secs 2024-07-26T10:43:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7647.364183 secs 2024-07-26T10:43:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:07 smithi063 ceph-mon[36747]: pgmap v4589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:07 smithi043 ceph-mon[32384]: pgmap v4589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:07 smithi133 ceph-mon[37053]: pgmap v4589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:09 smithi063 ceph-mon[36747]: pgmap v4590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:09 smithi043 ceph-mon[32384]: pgmap v4590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:09 smithi133 ceph-mon[37053]: pgmap v4590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7636.882076 secs 2024-07-26T10:43:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7636.882076 secs 2024-07-26T10:43:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7636.882076 secs 2024-07-26T10:43:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:11 smithi063 ceph-mon[36747]: pgmap v4591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7652.364318 secs 2024-07-26T10:43:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:11 smithi043 ceph-mon[32384]: pgmap v4591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7652.364318 secs 2024-07-26T10:43:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:11 smithi133 ceph-mon[37053]: pgmap v4591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7652.364318 secs 2024-07-26T10:43:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:13 smithi063 ceph-mon[36747]: pgmap v4592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:13 smithi043 ceph-mon[32384]: pgmap v4592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:13 smithi133 ceph-mon[37053]: pgmap v4592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:15 smithi043 ceph-mon[32384]: pgmap v4593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7641.882189 secs 2024-07-26T10:43:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:15 smithi133 ceph-mon[37053]: pgmap v4593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7641.882189 secs 2024-07-26T10:43:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:15 smithi063 ceph-mon[36747]: pgmap v4593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7641.882189 secs 2024-07-26T10:43:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7657.364414 secs 2024-07-26T10:43:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7657.364414 secs 2024-07-26T10:43:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7657.364414 secs 2024-07-26T10:43:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:17 smithi043 ceph-mon[32384]: pgmap v4594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:17 smithi133 ceph-mon[37053]: pgmap v4594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:17 smithi063 ceph-mon[36747]: pgmap v4594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:19 smithi043 ceph-mon[32384]: pgmap v4595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:19 smithi133 ceph-mon[37053]: pgmap v4595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:19 smithi063 ceph-mon[36747]: pgmap v4595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7646.882311 secs 2024-07-26T10:43:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7646.882311 secs 2024-07-26T10:43:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7646.882311 secs 2024-07-26T10:43:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:21 smithi043 ceph-mon[32384]: pgmap v4596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7662.364535 secs 2024-07-26T10:43:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:21 smithi133 ceph-mon[37053]: pgmap v4596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7662.364535 secs 2024-07-26T10:43:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:21 smithi063 ceph-mon[36747]: pgmap v4596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7662.364535 secs 2024-07-26T10:43:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:23 smithi043 ceph-mon[32384]: pgmap v4597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:23 smithi133 ceph-mon[37053]: pgmap v4597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:23 smithi063 ceph-mon[36747]: pgmap v4597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:25 smithi043 ceph-mon[32384]: pgmap v4598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7651.882405 secs 2024-07-26T10:43:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:25 smithi133 ceph-mon[37053]: pgmap v4598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7651.882405 secs 2024-07-26T10:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:25 smithi063 ceph-mon[36747]: pgmap v4598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7651.882405 secs 2024-07-26T10:43:26.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7667.364602 secs 2024-07-26T10:43:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7667.364602 secs 2024-07-26T10:43:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7667.364602 secs 2024-07-26T10:43:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:27 smithi043 ceph-mon[32384]: pgmap v4599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:27 smithi133 ceph-mon[37053]: pgmap v4599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:27 smithi063 ceph-mon[36747]: pgmap v4599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:29 smithi043 ceph-mon[32384]: pgmap v4600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:29 smithi133 ceph-mon[37053]: pgmap v4600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:29 smithi063 ceph-mon[36747]: pgmap v4600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7656.882526 secs 2024-07-26T10:43:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7656.882526 secs 2024-07-26T10:43:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7656.882526 secs 2024-07-26T10:43:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:31 smithi043 ceph-mon[32384]: pgmap v4601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7672.364720 secs 2024-07-26T10:43:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:31 smithi133 ceph-mon[37053]: pgmap v4601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7672.364720 secs 2024-07-26T10:43:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:31 smithi063 ceph-mon[36747]: pgmap v4601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7672.364720 secs 2024-07-26T10:43:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:33 smithi043 ceph-mon[32384]: pgmap v4602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:33 smithi133 ceph-mon[37053]: pgmap v4602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:33 smithi063 ceph-mon[36747]: pgmap v4602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:35 smithi043 ceph-mon[32384]: pgmap v4603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7661.882637 secs 2024-07-26T10:43:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7677.364819 secs 2024-07-26T10:43:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:35 smithi133 ceph-mon[37053]: pgmap v4603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7661.882637 secs 2024-07-26T10:43:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7677.364819 secs 2024-07-26T10:43:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:35 smithi063 ceph-mon[36747]: pgmap v4603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7661.882637 secs 2024-07-26T10:43:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7677.364819 secs 2024-07-26T10:43:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:37 smithi043 ceph-mon[32384]: pgmap v4604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:37 smithi133 ceph-mon[37053]: pgmap v4604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:37 smithi063 ceph-mon[36747]: pgmap v4604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:39 smithi043 ceph-mon[32384]: pgmap v4605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:39 smithi133 ceph-mon[37053]: pgmap v4605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:39 smithi063 ceph-mon[36747]: pgmap v4605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7666.882734 secs 2024-07-26T10:43:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7682.364933 secs 2024-07-26T10:43:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7666.882734 secs 2024-07-26T10:43:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7682.364933 secs 2024-07-26T10:43:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7666.882734 secs 2024-07-26T10:43:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7682.364933 secs 2024-07-26T10:43:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:41 smithi043 ceph-mon[32384]: pgmap v4606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:41 smithi133 ceph-mon[37053]: pgmap v4606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:41 smithi063 ceph-mon[36747]: pgmap v4606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:43 smithi043 ceph-mon[32384]: pgmap v4607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:43 smithi133 ceph-mon[37053]: pgmap v4607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:43 smithi063 ceph-mon[36747]: pgmap v4607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:45 smithi043 ceph-mon[32384]: pgmap v4608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7671.882848 secs 2024-07-26T10:43:45.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7687.365025 secs 2024-07-26T10:43:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:45 smithi133 ceph-mon[37053]: pgmap v4608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7671.882848 secs 2024-07-26T10:43:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7687.365025 secs 2024-07-26T10:43:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:45 smithi063 ceph-mon[36747]: pgmap v4608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7671.882848 secs 2024-07-26T10:43:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7687.365025 secs 2024-07-26T10:43:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:47 smithi043 ceph-mon[32384]: pgmap v4609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:47 smithi133 ceph-mon[37053]: pgmap v4609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:47 smithi063 ceph-mon[36747]: pgmap v4609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:49 smithi043 ceph-mon[32384]: pgmap v4610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:49 smithi133 ceph-mon[37053]: pgmap v4610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:49 smithi063 ceph-mon[36747]: pgmap v4610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7676.882964 secs 2024-07-26T10:43:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7692.365146 secs 2024-07-26T10:43:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7676.882964 secs 2024-07-26T10:43:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7692.365146 secs 2024-07-26T10:43:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7676.882964 secs 2024-07-26T10:43:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7692.365146 secs 2024-07-26T10:43:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:51 smithi043 ceph-mon[32384]: pgmap v4611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:51 smithi133 ceph-mon[37053]: pgmap v4611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:51 smithi063 ceph-mon[36747]: pgmap v4611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:43:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:53 smithi043 ceph-mon[32384]: pgmap v4612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:53 smithi133 ceph-mon[37053]: pgmap v4612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:53 smithi063 ceph-mon[36747]: pgmap v4612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:43:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:43:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:43:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: pgmap v4613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7681.883039 secs 2024-07-26T10:43:55.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7697.365241 secs 2024-07-26T10:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: pgmap v4613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7681.883039 secs 2024-07-26T10:43:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7697.365241 secs 2024-07-26T10:43:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: pgmap v4613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7681.883039 secs 2024-07-26T10:43:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7697.365241 secs 2024-07-26T10:43:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:57 smithi043 ceph-mon[32384]: pgmap v4614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:57.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:57 smithi133 ceph-mon[37053]: pgmap v4614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:57 smithi063 ceph-mon[36747]: pgmap v4614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:43:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:58.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:59.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:59 smithi063 ceph-mon[36747]: pgmap v4615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:59.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:59.871 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:43:59 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:59 smithi043 ceph-mon[32384]: pgmap v4615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:43:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:43:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:43:59 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:59 smithi133 ceph-mon[37053]: pgmap v4615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:44:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:43:59 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:44:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:00 smithi043 ceph-mon[32384]: pgmap v4616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:44:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:00 smithi043 ceph-mon[32384]: pgmap v4617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:44:00.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7686.883165 secs 2024-07-26T10:44:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:44:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:44:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:00 smithi133 ceph-mon[37053]: pgmap v4616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:44:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:00 smithi133 ceph-mon[37053]: pgmap v4617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:44:01.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7686.883165 secs 2024-07-26T10:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:00 smithi063 ceph-mon[36747]: pgmap v4616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:00 smithi063 ceph-mon[36747]: pgmap v4617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:44:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7686.883165 secs 2024-07-26T10:44:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7702.365307 secs 2024-07-26T10:44:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7702.365307 secs 2024-07-26T10:44:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7702.365307 secs 2024-07-26T10:44:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:02 smithi043 ceph-mon[32384]: pgmap v4618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:02 smithi133 ceph-mon[37053]: pgmap v4618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:02 smithi063 ceph-mon[36747]: pgmap v4618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:04 smithi063 ceph-mon[36747]: pgmap v4619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:04 smithi043 ceph-mon[32384]: pgmap v4619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:04 smithi133 ceph-mon[37053]: pgmap v4619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7691.883285 secs 2024-07-26T10:44:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7707.365431 secs 2024-07-26T10:44:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7691.883285 secs 2024-07-26T10:44:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7707.365431 secs 2024-07-26T10:44:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7691.883285 secs 2024-07-26T10:44:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7707.365431 secs 2024-07-26T10:44:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:06 smithi063 ceph-mon[36747]: pgmap v4620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:06 smithi043 ceph-mon[32384]: pgmap v4620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:06 smithi133 ceph-mon[37053]: pgmap v4620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:08 smithi063 ceph-mon[36747]: pgmap v4621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:08 smithi043 ceph-mon[32384]: pgmap v4621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:08 smithi133 ceph-mon[37053]: pgmap v4621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:10 smithi063 ceph-mon[36747]: pgmap v4622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:44:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7696.883423 secs 2024-07-26T10:44:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7712.365555 secs 2024-07-26T10:44:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:10 smithi043 ceph-mon[32384]: pgmap v4622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:44:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7696.883423 secs 2024-07-26T10:44:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7712.365555 secs 2024-07-26T10:44:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:10 smithi133 ceph-mon[37053]: pgmap v4622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:44:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7696.883423 secs 2024-07-26T10:44:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7712.365555 secs 2024-07-26T10:44:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:12 smithi063 ceph-mon[36747]: pgmap v4623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:12 smithi043 ceph-mon[32384]: pgmap v4623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:12 smithi133 ceph-mon[37053]: pgmap v4623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:14 smithi063 ceph-mon[36747]: pgmap v4624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:15.228 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:14 smithi043 ceph-mon[32384]: pgmap v4624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:14 smithi133 ceph-mon[37053]: pgmap v4624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7701.883547 secs 2024-07-26T10:44:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7717.365673 secs 2024-07-26T10:44:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7701.883547 secs 2024-07-26T10:44:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7717.365673 secs 2024-07-26T10:44:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7701.883547 secs 2024-07-26T10:44:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7717.365673 secs 2024-07-26T10:44:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:16 smithi043 ceph-mon[32384]: pgmap v4625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:16 smithi133 ceph-mon[37053]: pgmap v4625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:16 smithi063 ceph-mon[36747]: pgmap v4625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:18 smithi043 ceph-mon[32384]: pgmap v4626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:18 smithi133 ceph-mon[37053]: pgmap v4626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:18 smithi063 ceph-mon[36747]: pgmap v4626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:20 smithi043 ceph-mon[32384]: pgmap v4627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7706.883691 secs 2024-07-26T10:44:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7722.365811 secs 2024-07-26T10:44:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:20 smithi133 ceph-mon[37053]: pgmap v4627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7706.883691 secs 2024-07-26T10:44:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7722.365811 secs 2024-07-26T10:44:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:20 smithi063 ceph-mon[36747]: pgmap v4627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7706.883691 secs 2024-07-26T10:44:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7722.365811 secs 2024-07-26T10:44:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:22 smithi043 ceph-mon[32384]: pgmap v4628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:22 smithi133 ceph-mon[37053]: pgmap v4628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:22 smithi063 ceph-mon[36747]: pgmap v4628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:24 smithi043 ceph-mon[32384]: pgmap v4629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:24 smithi133 ceph-mon[37053]: pgmap v4629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:24 smithi063 ceph-mon[36747]: pgmap v4629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7711.883787 secs 2024-07-26T10:44:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7727.365974 secs 2024-07-26T10:44:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7711.883787 secs 2024-07-26T10:44:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7727.365974 secs 2024-07-26T10:44:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7711.883787 secs 2024-07-26T10:44:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7727.365974 secs 2024-07-26T10:44:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:26 smithi043 ceph-mon[32384]: pgmap v4630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:26 smithi133 ceph-mon[37053]: pgmap v4630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:26 smithi063 ceph-mon[36747]: pgmap v4630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:29.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:28 smithi063 ceph-mon[36747]: pgmap v4631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:28 smithi043 ceph-mon[32384]: pgmap v4631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:28 smithi133 ceph-mon[37053]: pgmap v4631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:30 smithi043 ceph-mon[32384]: pgmap v4632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7716.883908 secs 2024-07-26T10:44:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7732.366132 secs 2024-07-26T10:44:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:30 smithi133 ceph-mon[37053]: pgmap v4632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7716.883908 secs 2024-07-26T10:44:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7732.366132 secs 2024-07-26T10:44:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:30 smithi063 ceph-mon[36747]: pgmap v4632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7716.883908 secs 2024-07-26T10:44:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7732.366132 secs 2024-07-26T10:44:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:32 smithi043 ceph-mon[32384]: pgmap v4633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:32 smithi133 ceph-mon[37053]: pgmap v4633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:32 smithi063 ceph-mon[36747]: pgmap v4633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:34 smithi043 ceph-mon[32384]: pgmap v4634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:34 smithi133 ceph-mon[37053]: pgmap v4634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:34 smithi063 ceph-mon[36747]: pgmap v4634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7721.884050 secs 2024-07-26T10:44:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7737.366253 secs 2024-07-26T10:44:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7721.884050 secs 2024-07-26T10:44:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7737.366253 secs 2024-07-26T10:44:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7721.884050 secs 2024-07-26T10:44:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7737.366253 secs 2024-07-26T10:44:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:36 smithi043 ceph-mon[32384]: pgmap v4635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:36 smithi133 ceph-mon[37053]: pgmap v4635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:36 smithi063 ceph-mon[36747]: pgmap v4635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:38 smithi043 ceph-mon[32384]: pgmap v4636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:38 smithi133 ceph-mon[37053]: pgmap v4636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:38 smithi063 ceph-mon[36747]: pgmap v4636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:40 smithi043 ceph-mon[32384]: pgmap v4637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7726.884168 secs 2024-07-26T10:44:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7742.366341 secs 2024-07-26T10:44:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:40 smithi133 ceph-mon[37053]: pgmap v4637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7726.884168 secs 2024-07-26T10:44:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7742.366341 secs 2024-07-26T10:44:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:40 smithi063 ceph-mon[36747]: pgmap v4637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7726.884168 secs 2024-07-26T10:44:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7742.366341 secs 2024-07-26T10:44:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:42 smithi043 ceph-mon[32384]: pgmap v4638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:42 smithi133 ceph-mon[37053]: pgmap v4638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:42 smithi063 ceph-mon[36747]: pgmap v4638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:44 smithi043 ceph-mon[32384]: pgmap v4639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:44 smithi133 ceph-mon[37053]: pgmap v4639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:44 smithi063 ceph-mon[36747]: pgmap v4639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7731.884292 secs 2024-07-26T10:44:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7747.366457 secs 2024-07-26T10:44:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7731.884292 secs 2024-07-26T10:44:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7747.366457 secs 2024-07-26T10:44:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7731.884292 secs 2024-07-26T10:44:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7747.366457 secs 2024-07-26T10:44:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:46 smithi043 ceph-mon[32384]: pgmap v4640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:46 smithi133 ceph-mon[37053]: pgmap v4640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:46 smithi063 ceph-mon[36747]: pgmap v4640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:48 smithi043 ceph-mon[32384]: pgmap v4641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:48 smithi133 ceph-mon[37053]: pgmap v4641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:48 smithi063 ceph-mon[36747]: pgmap v4641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:50 smithi043 ceph-mon[32384]: pgmap v4642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7736.884414 secs 2024-07-26T10:44:51.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7752.366594 secs 2024-07-26T10:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:50 smithi133 ceph-mon[37053]: pgmap v4642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7736.884414 secs 2024-07-26T10:44:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7752.366594 secs 2024-07-26T10:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:50 smithi063 ceph-mon[36747]: pgmap v4642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7736.884414 secs 2024-07-26T10:44:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7752.366594 secs 2024-07-26T10:44:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:52 smithi043 ceph-mon[32384]: pgmap v4643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:52 smithi133 ceph-mon[37053]: pgmap v4643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:52 smithi063 ceph-mon[36747]: pgmap v4643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:54 smithi043 ceph-mon[32384]: pgmap v4644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:54 smithi133 ceph-mon[37053]: pgmap v4644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:54 smithi063 ceph-mon[36747]: pgmap v4644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7741.884502 secs 2024-07-26T10:44:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7757.366689 secs 2024-07-26T10:44:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7741.884502 secs 2024-07-26T10:44:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7757.366689 secs 2024-07-26T10:44:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7741.884502 secs 2024-07-26T10:44:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7757.366689 secs 2024-07-26T10:44:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:56 smithi043 ceph-mon[32384]: pgmap v4645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:56 smithi133 ceph-mon[37053]: pgmap v4645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:56 smithi063 ceph-mon[36747]: pgmap v4645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:44:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:58 smithi043 ceph-mon[32384]: pgmap v4646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:58 smithi133 ceph-mon[37053]: pgmap v4646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:44:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:58 smithi063 ceph-mon[36747]: pgmap v4646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:44:59 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:45:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:44:59 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:45:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:44:59 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:00 smithi133 ceph-mon[37053]: pgmap v4647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7746.884571 secs 2024-07-26T10:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7762.366752 secs 2024-07-26T10:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:00 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:45:01.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:00 smithi043 ceph-mon[32384]: pgmap v4647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:01.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7746.884571 secs 2024-07-26T10:45:01.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7762.366752 secs 2024-07-26T10:45:01.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:45:01.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:00 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:45:01.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:45:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:00 smithi063 ceph-mon[36747]: pgmap v4647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7746.884571 secs 2024-07-26T10:45:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7762.366752 secs 2024-07-26T10:45:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:45:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:00 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:45:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:45:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:01 smithi133 ceph-mon[37053]: pgmap v4648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:01 smithi133 ceph-mon[37053]: pgmap v4649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:02 smithi063 ceph-mon[36747]: pgmap v4648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:02 smithi063 ceph-mon[36747]: pgmap v4649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:01 smithi043 ceph-mon[32384]: pgmap v4648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:01 smithi043 ceph-mon[32384]: pgmap v4649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:04 smithi133 ceph-mon[37053]: pgmap v4650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:45:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:04 smithi063 ceph-mon[36747]: pgmap v4650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:45:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:04 smithi043 ceph-mon[32384]: pgmap v4650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:45:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:06 smithi133 ceph-mon[37053]: pgmap v4651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:06.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7751.884654 secs 2024-07-26T10:45:06.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7767.366917 secs 2024-07-26T10:45:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:06 smithi063 ceph-mon[36747]: pgmap v4651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7751.884654 secs 2024-07-26T10:45:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7767.366917 secs 2024-07-26T10:45:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:06 smithi043 ceph-mon[32384]: pgmap v4651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7751.884654 secs 2024-07-26T10:45:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7767.366917 secs 2024-07-26T10:45:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:08 smithi063 ceph-mon[36747]: pgmap v4652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:08 smithi043 ceph-mon[32384]: pgmap v4652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:08 smithi133 ceph-mon[37053]: pgmap v4652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:09 smithi043 ceph-mon[32384]: pgmap v4653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:09 smithi133 ceph-mon[37053]: pgmap v4653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:09 smithi063 ceph-mon[36747]: pgmap v4653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:45:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7756.884787 secs 2024-07-26T10:45:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7756.884787 secs 2024-07-26T10:45:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7756.884787 secs 2024-07-26T10:45:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7772.367055 secs 2024-07-26T10:45:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:11 smithi043 ceph-mon[32384]: pgmap v4654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7772.367055 secs 2024-07-26T10:45:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:11 smithi133 ceph-mon[37053]: pgmap v4654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7772.367055 secs 2024-07-26T10:45:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:11 smithi063 ceph-mon[36747]: pgmap v4654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:14 smithi133 ceph-mon[37053]: pgmap v4655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:14 smithi063 ceph-mon[36747]: pgmap v4655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:14 smithi043 ceph-mon[32384]: pgmap v4655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:16 smithi133 ceph-mon[37053]: pgmap v4656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7761.884925 secs 2024-07-26T10:45:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7777.367183 secs 2024-07-26T10:45:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:16 smithi063 ceph-mon[36747]: pgmap v4656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7761.884925 secs 2024-07-26T10:45:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7777.367183 secs 2024-07-26T10:45:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:16 smithi043 ceph-mon[32384]: pgmap v4656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7761.884925 secs 2024-07-26T10:45:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7777.367183 secs 2024-07-26T10:45:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:18 smithi133 ceph-mon[37053]: pgmap v4657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:18 smithi063 ceph-mon[36747]: pgmap v4657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:18 smithi043 ceph-mon[32384]: pgmap v4657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:20.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:20 smithi043 ceph-mon[32384]: pgmap v4658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:20 smithi063 ceph-mon[36747]: pgmap v4658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:20 smithi133 ceph-mon[37053]: pgmap v4658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7766.885052 secs 2024-07-26T10:45:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7782.367332 secs 2024-07-26T10:45:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7766.885052 secs 2024-07-26T10:45:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7782.367332 secs 2024-07-26T10:45:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7766.885052 secs 2024-07-26T10:45:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7782.367332 secs 2024-07-26T10:45:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:22 smithi063 ceph-mon[36747]: pgmap v4659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:22 smithi043 ceph-mon[32384]: pgmap v4659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:22 smithi133 ceph-mon[37053]: pgmap v4659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:24 smithi063 ceph-mon[36747]: pgmap v4660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:24 smithi043 ceph-mon[32384]: pgmap v4660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:24 smithi133 ceph-mon[37053]: pgmap v4660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:26 smithi063 ceph-mon[36747]: pgmap v4661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7771.885202 secs 2024-07-26T10:45:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7787.367463 secs 2024-07-26T10:45:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:26 smithi043 ceph-mon[32384]: pgmap v4661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7771.885202 secs 2024-07-26T10:45:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7787.367463 secs 2024-07-26T10:45:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:26 smithi133 ceph-mon[37053]: pgmap v4661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7771.885202 secs 2024-07-26T10:45:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7787.367463 secs 2024-07-26T10:45:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:28 smithi063 ceph-mon[36747]: pgmap v4662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:28 smithi043 ceph-mon[32384]: pgmap v4662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:28 smithi133 ceph-mon[37053]: pgmap v4662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:30 smithi063 ceph-mon[36747]: pgmap v4663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:30.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:30 smithi133 ceph-mon[37053]: pgmap v4663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:30 smithi043 ceph-mon[32384]: pgmap v4663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7776.885345 secs 2024-07-26T10:45:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7792.367564 secs 2024-07-26T10:45:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7776.885345 secs 2024-07-26T10:45:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7792.367564 secs 2024-07-26T10:45:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7776.885345 secs 2024-07-26T10:45:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7792.367564 secs 2024-07-26T10:45:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:32 smithi043 ceph-mon[32384]: pgmap v4664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:32 smithi133 ceph-mon[37053]: pgmap v4664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:32 smithi063 ceph-mon[36747]: pgmap v4664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:34 smithi043 ceph-mon[32384]: pgmap v4665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:34 smithi133 ceph-mon[37053]: pgmap v4665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:34 smithi063 ceph-mon[36747]: pgmap v4665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:36 smithi043 ceph-mon[32384]: pgmap v4666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7781.885464 secs 2024-07-26T10:45:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7797.367663 secs 2024-07-26T10:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:36 smithi133 ceph-mon[37053]: pgmap v4666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7781.885464 secs 2024-07-26T10:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7797.367663 secs 2024-07-26T10:45:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:36 smithi063 ceph-mon[36747]: pgmap v4666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7781.885464 secs 2024-07-26T10:45:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7797.367663 secs 2024-07-26T10:45:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:38 smithi043 ceph-mon[32384]: pgmap v4667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:38 smithi133 ceph-mon[37053]: pgmap v4667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:38 smithi063 ceph-mon[36747]: pgmap v4667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:40 smithi043 ceph-mon[32384]: pgmap v4668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:40 smithi133 ceph-mon[37053]: pgmap v4668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:40 smithi063 ceph-mon[36747]: pgmap v4668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7786.885608 secs 2024-07-26T10:45:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7802.367801 secs 2024-07-26T10:45:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7786.885608 secs 2024-07-26T10:45:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7802.367801 secs 2024-07-26T10:45:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7786.885608 secs 2024-07-26T10:45:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7802.367801 secs 2024-07-26T10:45:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:42 smithi043 ceph-mon[32384]: pgmap v4669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:42 smithi133 ceph-mon[37053]: pgmap v4669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:42 smithi063 ceph-mon[36747]: pgmap v4669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:45:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:44 smithi043 ceph-mon[32384]: pgmap v4670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:44 smithi133 ceph-mon[37053]: pgmap v4670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:44 smithi063 ceph-mon[36747]: pgmap v4670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:45:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:46 smithi043 ceph-mon[32384]: pgmap v4671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7791.885701 secs 2024-07-26T10:45:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7807.367960 secs 2024-07-26T10:45:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:46 smithi133 ceph-mon[37053]: pgmap v4671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7791.885701 secs 2024-07-26T10:45:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7807.367960 secs 2024-07-26T10:45:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:46 smithi063 ceph-mon[36747]: pgmap v4671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:45:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7791.885701 secs 2024-07-26T10:45:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7807.367960 secs 2024-07-26T10:45:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:48 smithi043 ceph-mon[32384]: pgmap v4672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:48 smithi133 ceph-mon[37053]: pgmap v4672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:48 smithi063 ceph-mon[36747]: pgmap v4672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:50 smithi043 ceph-mon[32384]: pgmap v4673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:45:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:50 smithi133 ceph-mon[37053]: pgmap v4673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:45:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:50 smithi063 ceph-mon[36747]: pgmap v4673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:45:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7796.885801 secs 2024-07-26T10:45:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7812.368096 secs 2024-07-26T10:45:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7796.885801 secs 2024-07-26T10:45:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7812.368096 secs 2024-07-26T10:45:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7796.885801 secs 2024-07-26T10:45:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7812.368096 secs 2024-07-26T10:45:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:52 smithi043 ceph-mon[32384]: pgmap v4674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:52 smithi133 ceph-mon[37053]: pgmap v4674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:52 smithi063 ceph-mon[36747]: pgmap v4674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:54 smithi043 ceph-mon[32384]: pgmap v4675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:54 smithi133 ceph-mon[37053]: pgmap v4675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:54 smithi063 ceph-mon[36747]: pgmap v4675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:56 smithi043 ceph-mon[32384]: pgmap v4676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7801.885927 secs 2024-07-26T10:45:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7817.368195 secs 2024-07-26T10:45:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:56 smithi133 ceph-mon[37053]: pgmap v4676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7801.885927 secs 2024-07-26T10:45:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7817.368195 secs 2024-07-26T10:45:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:56 smithi063 ceph-mon[36747]: pgmap v4676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:45:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7801.885927 secs 2024-07-26T10:45:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7817.368195 secs 2024-07-26T10:45:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:45:58 smithi043 ceph-mon[32384]: pgmap v4677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:45:58 smithi133 ceph-mon[37053]: pgmap v4677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:45:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:45:58 smithi063 ceph-mon[36747]: pgmap v4677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:46:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:00 smithi043 ceph-mon[32384]: pgmap v4678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:00 smithi133 ceph-mon[37053]: pgmap v4678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:00 smithi063 ceph-mon[36747]: pgmap v4678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7806.886047 secs 2024-07-26T10:46:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7822.368316 secs 2024-07-26T10:46:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7806.886047 secs 2024-07-26T10:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7822.368316 secs 2024-07-26T10:46:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7806.886047 secs 2024-07-26T10:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7822.368316 secs 2024-07-26T10:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:46:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:02 smithi043 ceph-mon[32384]: pgmap v4679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:02 smithi133 ceph-mon[37053]: pgmap v4679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:02 smithi063 ceph-mon[36747]: pgmap v4679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:46:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:46:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:46:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:46:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:46:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:46:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:46:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:46:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:46:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:04 smithi043 ceph-mon[32384]: pgmap v4680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:46:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:04 smithi043 ceph-mon[32384]: pgmap v4681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:46:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:04 smithi133 ceph-mon[37053]: pgmap v4680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:46:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:04 smithi133 ceph-mon[37053]: pgmap v4681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:46:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:04 smithi063 ceph-mon[36747]: pgmap v4680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:46:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:04 smithi063 ceph-mon[36747]: pgmap v4681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:46:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:06 smithi043 ceph-mon[32384]: pgmap v4682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:46:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7811.886171 secs 2024-07-26T10:46:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7827.368431 secs 2024-07-26T10:46:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:06 smithi133 ceph-mon[37053]: pgmap v4682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:46:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7811.886171 secs 2024-07-26T10:46:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7827.368431 secs 2024-07-26T10:46:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:06 smithi063 ceph-mon[36747]: pgmap v4682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:46:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7811.886171 secs 2024-07-26T10:46:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7827.368431 secs 2024-07-26T10:46:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:08 smithi043 ceph-mon[32384]: pgmap v4683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:46:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:08 smithi133 ceph-mon[37053]: pgmap v4683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:46:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:08 smithi063 ceph-mon[36747]: pgmap v4683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:46:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:09 smithi043 ceph-mon[32384]: pgmap v4684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:46:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:09 smithi133 ceph-mon[37053]: pgmap v4684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:46:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:09 smithi063 ceph-mon[36747]: pgmap v4684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:46:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:11 smithi063 ceph-mon[36747]: pgmap v4685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:46:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7816.886254 secs 2024-07-26T10:46:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7832.368553 secs 2024-07-26T10:46:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:11 smithi043 ceph-mon[32384]: pgmap v4685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:46:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7816.886254 secs 2024-07-26T10:46:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7832.368553 secs 2024-07-26T10:46:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:11 smithi133 ceph-mon[37053]: pgmap v4685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:46:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7816.886254 secs 2024-07-26T10:46:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7832.368553 secs 2024-07-26T10:46:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:13 smithi063 ceph-mon[36747]: pgmap v4686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:46:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:13 smithi043 ceph-mon[32384]: pgmap v4686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:46:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:13 smithi133 ceph-mon[37053]: pgmap v4686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:46:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:15 smithi063 ceph-mon[36747]: pgmap v4687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:15 smithi043 ceph-mon[32384]: pgmap v4687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:15 smithi133 ceph-mon[37053]: pgmap v4687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7821.886373 secs 2024-07-26T10:46:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7837.368706 secs 2024-07-26T10:46:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7821.886373 secs 2024-07-26T10:46:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7837.368706 secs 2024-07-26T10:46:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7821.886373 secs 2024-07-26T10:46:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7837.368706 secs 2024-07-26T10:46:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:17 smithi063 ceph-mon[36747]: pgmap v4688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:17 smithi043 ceph-mon[32384]: pgmap v4688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:17 smithi133 ceph-mon[37053]: pgmap v4688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:19 smithi043 ceph-mon[32384]: pgmap v4689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:19 smithi063 ceph-mon[36747]: pgmap v4689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:19 smithi133 ceph-mon[37053]: pgmap v4689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7826.886437 secs 2024-07-26T10:46:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7826.886437 secs 2024-07-26T10:46:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7826.886437 secs 2024-07-26T10:46:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:21 smithi043 ceph-mon[32384]: pgmap v4690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7842.368829 secs 2024-07-26T10:46:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:21 smithi133 ceph-mon[37053]: pgmap v4690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7842.368829 secs 2024-07-26T10:46:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:21 smithi063 ceph-mon[36747]: pgmap v4690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7842.368829 secs 2024-07-26T10:46:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:23 smithi043 ceph-mon[32384]: pgmap v4691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:23 smithi133 ceph-mon[37053]: pgmap v4691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:23 smithi063 ceph-mon[36747]: pgmap v4691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:25 smithi043 ceph-mon[32384]: pgmap v4692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7831.886565 secs 2024-07-26T10:46:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:25 smithi133 ceph-mon[37053]: pgmap v4692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7831.886565 secs 2024-07-26T10:46:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:25 smithi063 ceph-mon[36747]: pgmap v4692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7831.886565 secs 2024-07-26T10:46:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7847.368961 secs 2024-07-26T10:46:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7847.368961 secs 2024-07-26T10:46:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7847.368961 secs 2024-07-26T10:46:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:27 smithi043 ceph-mon[32384]: pgmap v4693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:27 smithi133 ceph-mon[37053]: pgmap v4693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:27 smithi063 ceph-mon[36747]: pgmap v4693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:29 smithi043 ceph-mon[32384]: pgmap v4694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:29 smithi133 ceph-mon[37053]: pgmap v4694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:29 smithi063 ceph-mon[36747]: pgmap v4694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:30.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7836.886694 secs 2024-07-26T10:46:30.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7836.886694 secs 2024-07-26T10:46:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7836.886694 secs 2024-07-26T10:46:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:31 smithi043 ceph-mon[32384]: pgmap v4695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7852.369049 secs 2024-07-26T10:46:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:31 smithi133 ceph-mon[37053]: pgmap v4695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7852.369049 secs 2024-07-26T10:46:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:31 smithi063 ceph-mon[36747]: pgmap v4695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7852.369049 secs 2024-07-26T10:46:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:33 smithi043 ceph-mon[32384]: pgmap v4696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:33 smithi133 ceph-mon[37053]: pgmap v4696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:33 smithi063 ceph-mon[36747]: pgmap v4696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:35 smithi043 ceph-mon[32384]: pgmap v4697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7841.886833 secs 2024-07-26T10:46:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:35 smithi133 ceph-mon[37053]: pgmap v4697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7841.886833 secs 2024-07-26T10:46:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:35 smithi063 ceph-mon[36747]: pgmap v4697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7841.886833 secs 2024-07-26T10:46:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7857.369176 secs 2024-07-26T10:46:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7857.369176 secs 2024-07-26T10:46:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7857.369176 secs 2024-07-26T10:46:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:37 smithi043 ceph-mon[32384]: pgmap v4698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:37 smithi133 ceph-mon[37053]: pgmap v4698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:37 smithi063 ceph-mon[36747]: pgmap v4698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:39 smithi043 ceph-mon[32384]: pgmap v4699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:39 smithi133 ceph-mon[37053]: pgmap v4699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:39 smithi063 ceph-mon[36747]: pgmap v4699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7846.886935 secs 2024-07-26T10:46:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7846.886935 secs 2024-07-26T10:46:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7846.886935 secs 2024-07-26T10:46:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:41 smithi043 ceph-mon[32384]: pgmap v4700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7862.369295 secs 2024-07-26T10:46:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:41 smithi133 ceph-mon[37053]: pgmap v4700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7862.369295 secs 2024-07-26T10:46:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:41 smithi063 ceph-mon[36747]: pgmap v4700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7862.369295 secs 2024-07-26T10:46:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:43 smithi043 ceph-mon[32384]: pgmap v4701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:43 smithi133 ceph-mon[37053]: pgmap v4701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:43 smithi063 ceph-mon[36747]: pgmap v4701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:45 smithi043 ceph-mon[32384]: pgmap v4702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7851.887077 secs 2024-07-26T10:46:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:45 smithi133 ceph-mon[37053]: pgmap v4702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7851.887077 secs 2024-07-26T10:46:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:45 smithi063 ceph-mon[36747]: pgmap v4702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7851.887077 secs 2024-07-26T10:46:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7867.369377 secs 2024-07-26T10:46:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7867.369377 secs 2024-07-26T10:46:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7867.369377 secs 2024-07-26T10:46:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:47 smithi043 ceph-mon[32384]: pgmap v4703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:47 smithi133 ceph-mon[37053]: pgmap v4703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:47 smithi063 ceph-mon[36747]: pgmap v4703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:49 smithi043 ceph-mon[32384]: pgmap v4704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:49 smithi133 ceph-mon[37053]: pgmap v4704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:49 smithi063 ceph-mon[36747]: pgmap v4704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:50.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7856.887222 secs 2024-07-26T10:46:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7856.887222 secs 2024-07-26T10:46:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7856.887222 secs 2024-07-26T10:46:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:51 smithi043 ceph-mon[32384]: pgmap v4705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7872.369520 secs 2024-07-26T10:46:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:51 smithi133 ceph-mon[37053]: pgmap v4705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7872.369520 secs 2024-07-26T10:46:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:51 smithi063 ceph-mon[36747]: pgmap v4705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:46:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7872.369520 secs 2024-07-26T10:46:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:53 smithi043 ceph-mon[32384]: pgmap v4706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:53 smithi133 ceph-mon[37053]: pgmap v4706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:53 smithi063 ceph-mon[36747]: pgmap v4706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:55 smithi043 ceph-mon[32384]: pgmap v4707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7861.887310 secs 2024-07-26T10:46:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:55 smithi133 ceph-mon[37053]: pgmap v4707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7861.887310 secs 2024-07-26T10:46:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:55 smithi063 ceph-mon[36747]: pgmap v4707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7861.887310 secs 2024-07-26T10:46:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7877.369599 secs 2024-07-26T10:46:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7877.369599 secs 2024-07-26T10:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7877.369599 secs 2024-07-26T10:46:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:57 smithi133 ceph-mon[37053]: pgmap v4708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:57 smithi063 ceph-mon[36747]: pgmap v4708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:57 smithi043 ceph-mon[32384]: pgmap v4708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:46:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:46:59 smithi133 ceph-mon[37053]: pgmap v4709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:46:59 smithi063 ceph-mon[36747]: pgmap v4709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:46:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:46:59 smithi043 ceph-mon[32384]: pgmap v4709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7866.887436 secs 2024-07-26T10:47:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7866.887436 secs 2024-07-26T10:47:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7866.887436 secs 2024-07-26T10:47:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:01 smithi063 ceph-mon[36747]: pgmap v4710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7882.369723 secs 2024-07-26T10:47:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:01 smithi043 ceph-mon[32384]: pgmap v4710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7882.369723 secs 2024-07-26T10:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:01 smithi133 ceph-mon[37053]: pgmap v4710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7882.369723 secs 2024-07-26T10:47:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:47:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:47:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:47:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:03 smithi063 ceph-mon[36747]: pgmap v4711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:47:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:47:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:47:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:03 smithi043 ceph-mon[32384]: pgmap v4711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:47:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:47:03.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:47:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:03 smithi133 ceph-mon[37053]: pgmap v4711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:47:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:47:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:47:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:04 smithi063 ceph-mon[36747]: pgmap v4712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:04 smithi063 ceph-mon[36747]: pgmap v4713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:04 smithi043 ceph-mon[32384]: pgmap v4712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:04 smithi043 ceph-mon[32384]: pgmap v4713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:04 smithi133 ceph-mon[37053]: pgmap v4712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:04 smithi133 ceph-mon[37053]: pgmap v4713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7871.887570 secs 2024-07-26T10:47:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7871.887570 secs 2024-07-26T10:47:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7871.887570 secs 2024-07-26T10:47:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:06 smithi063 ceph-mon[36747]: pgmap v4714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7887.369845 secs 2024-07-26T10:47:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:06 smithi043 ceph-mon[32384]: pgmap v4714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7887.369845 secs 2024-07-26T10:47:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:06 smithi133 ceph-mon[37053]: pgmap v4714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7887.369845 secs 2024-07-26T10:47:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:08 smithi063 ceph-mon[36747]: pgmap v4715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:47:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:08 smithi043 ceph-mon[32384]: pgmap v4715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:47:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:08 smithi133 ceph-mon[37053]: pgmap v4715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:47:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:10 smithi063 ceph-mon[36747]: pgmap v4716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7876.887688 secs 2024-07-26T10:47:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:10 smithi043 ceph-mon[32384]: pgmap v4716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7876.887688 secs 2024-07-26T10:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:10 smithi133 ceph-mon[37053]: pgmap v4716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7876.887688 secs 2024-07-26T10:47:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7892.369963 secs 2024-07-26T10:47:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7892.369963 secs 2024-07-26T10:47:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7892.369963 secs 2024-07-26T10:47:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:12 smithi043 ceph-mon[32384]: pgmap v4717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:12 smithi133 ceph-mon[37053]: pgmap v4717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:12 smithi063 ceph-mon[36747]: pgmap v4717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:47:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:14 smithi043 ceph-mon[32384]: pgmap v4718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:47:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:14 smithi133 ceph-mon[37053]: pgmap v4718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:47:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:14 smithi063 ceph-mon[36747]: pgmap v4718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:47:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7881.887796 secs 2024-07-26T10:47:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7881.887796 secs 2024-07-26T10:47:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7881.887796 secs 2024-07-26T10:47:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:16 smithi043 ceph-mon[32384]: pgmap v4719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7897.370053 secs 2024-07-26T10:47:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:16 smithi133 ceph-mon[37053]: pgmap v4719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7897.370053 secs 2024-07-26T10:47:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:16 smithi063 ceph-mon[36747]: pgmap v4719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7897.370053 secs 2024-07-26T10:47:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:18 smithi043 ceph-mon[32384]: pgmap v4720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:18 smithi133 ceph-mon[37053]: pgmap v4720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:18 smithi063 ceph-mon[36747]: pgmap v4720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:20 smithi043 ceph-mon[32384]: pgmap v4721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7886.887935 secs 2024-07-26T10:47:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:20 smithi133 ceph-mon[37053]: pgmap v4721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7886.887935 secs 2024-07-26T10:47:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:20 smithi063 ceph-mon[36747]: pgmap v4721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7886.887935 secs 2024-07-26T10:47:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7902.370164 secs 2024-07-26T10:47:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7902.370164 secs 2024-07-26T10:47:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7902.370164 secs 2024-07-26T10:47:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:22 smithi043 ceph-mon[32384]: pgmap v4722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:22 smithi133 ceph-mon[37053]: pgmap v4722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:22 smithi063 ceph-mon[36747]: pgmap v4722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:24 smithi043 ceph-mon[32384]: pgmap v4723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:24 smithi133 ceph-mon[37053]: pgmap v4723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:24 smithi063 ceph-mon[36747]: pgmap v4723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7891.888061 secs 2024-07-26T10:47:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7891.888061 secs 2024-07-26T10:47:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7891.888061 secs 2024-07-26T10:47:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:26 smithi043 ceph-mon[32384]: pgmap v4724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7907.370247 secs 2024-07-26T10:47:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:26 smithi133 ceph-mon[37053]: pgmap v4724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7907.370247 secs 2024-07-26T10:47:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:26 smithi063 ceph-mon[36747]: pgmap v4724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7907.370247 secs 2024-07-26T10:47:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:28 smithi043 ceph-mon[32384]: pgmap v4725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:28 smithi133 ceph-mon[37053]: pgmap v4725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:28 smithi063 ceph-mon[36747]: pgmap v4725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:30 smithi043 ceph-mon[32384]: pgmap v4726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7896.888182 secs 2024-07-26T10:47:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:30 smithi133 ceph-mon[37053]: pgmap v4726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7896.888182 secs 2024-07-26T10:47:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:30 smithi063 ceph-mon[36747]: pgmap v4726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7896.888182 secs 2024-07-26T10:47:31.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7912.370390 secs 2024-07-26T10:47:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7912.370390 secs 2024-07-26T10:47:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7912.370390 secs 2024-07-26T10:47:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:32 smithi043 ceph-mon[32384]: pgmap v4727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:32 smithi133 ceph-mon[37053]: pgmap v4727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:32 smithi063 ceph-mon[36747]: pgmap v4727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:34 smithi043 ceph-mon[32384]: pgmap v4728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:34 smithi133 ceph-mon[37053]: pgmap v4728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:34 smithi063 ceph-mon[36747]: pgmap v4728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7901.888302 secs 2024-07-26T10:47:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7917.370529 secs 2024-07-26T10:47:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7901.888302 secs 2024-07-26T10:47:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7917.370529 secs 2024-07-26T10:47:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7901.888302 secs 2024-07-26T10:47:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7917.370529 secs 2024-07-26T10:47:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:36 smithi043 ceph-mon[32384]: pgmap v4729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:36 smithi133 ceph-mon[37053]: pgmap v4729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:36 smithi063 ceph-mon[36747]: pgmap v4729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:38 smithi043 ceph-mon[32384]: pgmap v4730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:38 smithi133 ceph-mon[37053]: pgmap v4730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:38 smithi063 ceph-mon[36747]: pgmap v4730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:40 smithi043 ceph-mon[32384]: pgmap v4731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7906.888399 secs 2024-07-26T10:47:40.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7922.370646 secs 2024-07-26T10:47:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:40 smithi133 ceph-mon[37053]: pgmap v4731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7906.888399 secs 2024-07-26T10:47:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7922.370646 secs 2024-07-26T10:47:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:40 smithi063 ceph-mon[36747]: pgmap v4731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7906.888399 secs 2024-07-26T10:47:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7922.370646 secs 2024-07-26T10:47:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:42 smithi043 ceph-mon[32384]: pgmap v4732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:42 smithi133 ceph-mon[37053]: pgmap v4732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:42 smithi063 ceph-mon[36747]: pgmap v4732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:44 smithi043 ceph-mon[32384]: pgmap v4733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:44 smithi133 ceph-mon[37053]: pgmap v4733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:44 smithi063 ceph-mon[36747]: pgmap v4733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7911.888503 secs 2024-07-26T10:47:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7927.370758 secs 2024-07-26T10:47:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7911.888503 secs 2024-07-26T10:47:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7927.370758 secs 2024-07-26T10:47:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7911.888503 secs 2024-07-26T10:47:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7927.370758 secs 2024-07-26T10:47:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:46 smithi043 ceph-mon[32384]: pgmap v4734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:46 smithi133 ceph-mon[37053]: pgmap v4734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:46 smithi063 ceph-mon[36747]: pgmap v4734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:48 smithi133 ceph-mon[37053]: pgmap v4735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:48 smithi063 ceph-mon[36747]: pgmap v4735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:48 smithi043 ceph-mon[32384]: pgmap v4735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:50 smithi133 ceph-mon[37053]: pgmap v4736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7916.888625 secs 2024-07-26T10:47:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7932.370854 secs 2024-07-26T10:47:51.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:50 smithi043 ceph-mon[32384]: pgmap v4736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:51.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7916.888625 secs 2024-07-26T10:47:51.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7932.370854 secs 2024-07-26T10:47:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:50 smithi063 ceph-mon[36747]: pgmap v4736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7916.888625 secs 2024-07-26T10:47:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7932.370854 secs 2024-07-26T10:47:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:52 smithi133 ceph-mon[37053]: pgmap v4737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:52 smithi063 ceph-mon[36747]: pgmap v4737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:52 smithi043 ceph-mon[32384]: pgmap v4737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:54 smithi133 ceph-mon[37053]: pgmap v4738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:54 smithi063 ceph-mon[36747]: pgmap v4738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:54 smithi043 ceph-mon[32384]: pgmap v4738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:47:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7921.888738 secs 2024-07-26T10:47:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7937.370973 secs 2024-07-26T10:47:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7921.888738 secs 2024-07-26T10:47:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7937.370973 secs 2024-07-26T10:47:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7921.888738 secs 2024-07-26T10:47:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7937.370973 secs 2024-07-26T10:47:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:56 smithi063 ceph-mon[36747]: pgmap v4739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:56 smithi043 ceph-mon[32384]: pgmap v4739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:56 smithi133 ceph-mon[37053]: pgmap v4739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:47:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:47:58 smithi063 ceph-mon[36747]: pgmap v4740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:47:58 smithi043 ceph-mon[32384]: pgmap v4740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:47:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:47:58 smithi133 ceph-mon[37053]: pgmap v4740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:00 smithi063 ceph-mon[36747]: pgmap v4741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7926.888856 secs 2024-07-26T10:48:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7942.371049 secs 2024-07-26T10:48:01.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:00 smithi133 ceph-mon[37053]: pgmap v4741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:01.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7926.888856 secs 2024-07-26T10:48:01.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7942.371049 secs 2024-07-26T10:48:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:00 smithi043 ceph-mon[32384]: pgmap v4741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7926.888856 secs 2024-07-26T10:48:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7942.371049 secs 2024-07-26T10:48:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:02 smithi063 ceph-mon[36747]: pgmap v4742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:02 smithi043 ceph-mon[32384]: pgmap v4742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:02 smithi133 ceph-mon[37053]: pgmap v4742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:48:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:48:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:48:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:04 smithi063 ceph-mon[36747]: pgmap v4743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:04 smithi043 ceph-mon[32384]: pgmap v4743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:04 smithi133 ceph-mon[37053]: pgmap v4743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:48:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:48:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: pgmap v4744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:48:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: pgmap v4745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:48:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:48:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7931.888972 secs 2024-07-26T10:48:06.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7947.371199 secs 2024-07-26T10:48:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:48:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:48:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: pgmap v4744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:48:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: pgmap v4745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:48:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:48:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7931.888972 secs 2024-07-26T10:48:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7947.371199 secs 2024-07-26T10:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: pgmap v4744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: pgmap v4745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7931.888972 secs 2024-07-26T10:48:06.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7947.371199 secs 2024-07-26T10:48:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:07 smithi043 ceph-mon[32384]: pgmap v4746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:48:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:07 smithi133 ceph-mon[37053]: pgmap v4746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:48:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:07 smithi063 ceph-mon[36747]: pgmap v4746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:48:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:09 smithi043 ceph-mon[32384]: pgmap v4747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:48:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:09 smithi133 ceph-mon[37053]: pgmap v4747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:48:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:09 smithi063 ceph-mon[36747]: pgmap v4747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:48:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7936.889091 secs 2024-07-26T10:48:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7936.889091 secs 2024-07-26T10:48:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7936.889091 secs 2024-07-26T10:48:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7952.371298 secs 2024-07-26T10:48:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:11 smithi043 ceph-mon[32384]: pgmap v4748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:48:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7952.371298 secs 2024-07-26T10:48:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:11 smithi133 ceph-mon[37053]: pgmap v4748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:48:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7952.371298 secs 2024-07-26T10:48:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:11 smithi063 ceph-mon[36747]: pgmap v4748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:48:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:13 smithi043 ceph-mon[32384]: pgmap v4749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:48:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:13 smithi133 ceph-mon[37053]: pgmap v4749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:48:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:13 smithi063 ceph-mon[36747]: pgmap v4749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:48:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:15 smithi043 ceph-mon[32384]: pgmap v4750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:48:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7941.889213 secs 2024-07-26T10:48:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7957.371380 secs 2024-07-26T10:48:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:15 smithi133 ceph-mon[37053]: pgmap v4750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:48:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7941.889213 secs 2024-07-26T10:48:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7957.371380 secs 2024-07-26T10:48:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:15 smithi063 ceph-mon[36747]: pgmap v4750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:48:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7941.889213 secs 2024-07-26T10:48:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7957.371380 secs 2024-07-26T10:48:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:17 smithi043 ceph-mon[32384]: pgmap v4751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:17 smithi133 ceph-mon[37053]: pgmap v4751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:17 smithi063 ceph-mon[36747]: pgmap v4751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:19 smithi043 ceph-mon[32384]: pgmap v4752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:19 smithi133 ceph-mon[37053]: pgmap v4752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:19 smithi063 ceph-mon[36747]: pgmap v4752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7946.889333 secs 2024-07-26T10:48:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7962.371513 secs 2024-07-26T10:48:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7946.889333 secs 2024-07-26T10:48:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7962.371513 secs 2024-07-26T10:48:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7946.889333 secs 2024-07-26T10:48:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7962.371513 secs 2024-07-26T10:48:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:21 smithi043 ceph-mon[32384]: pgmap v4753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:21 smithi133 ceph-mon[37053]: pgmap v4753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:21 smithi063 ceph-mon[36747]: pgmap v4753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:23 smithi043 ceph-mon[32384]: pgmap v4754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:23 smithi133 ceph-mon[37053]: pgmap v4754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:23 smithi063 ceph-mon[36747]: pgmap v4754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:25 smithi043 ceph-mon[32384]: pgmap v4755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7951.889449 secs 2024-07-26T10:48:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7967.371594 secs 2024-07-26T10:48:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:25 smithi133 ceph-mon[37053]: pgmap v4755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7951.889449 secs 2024-07-26T10:48:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7967.371594 secs 2024-07-26T10:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:25 smithi063 ceph-mon[36747]: pgmap v4755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7951.889449 secs 2024-07-26T10:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7967.371594 secs 2024-07-26T10:48:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:27 smithi043 ceph-mon[32384]: pgmap v4756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:27 smithi133 ceph-mon[37053]: pgmap v4756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:27 smithi063 ceph-mon[36747]: pgmap v4756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:29 smithi043 ceph-mon[32384]: pgmap v4757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:29 smithi133 ceph-mon[37053]: pgmap v4757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:29 smithi063 ceph-mon[36747]: pgmap v4757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7956.889547 secs 2024-07-26T10:48:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7972.371748 secs 2024-07-26T10:48:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7956.889547 secs 2024-07-26T10:48:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7972.371748 secs 2024-07-26T10:48:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7956.889547 secs 2024-07-26T10:48:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7972.371748 secs 2024-07-26T10:48:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:31 smithi043 ceph-mon[32384]: pgmap v4758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:32.278 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:31 smithi133 ceph-mon[37053]: pgmap v4758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:31 smithi063 ceph-mon[36747]: pgmap v4758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:33 smithi043 ceph-mon[32384]: pgmap v4759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:33 smithi133 ceph-mon[37053]: pgmap v4759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:33 smithi063 ceph-mon[36747]: pgmap v4759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:35 smithi043 ceph-mon[32384]: pgmap v4760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7961.889628 secs 2024-07-26T10:48:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7977.371891 secs 2024-07-26T10:48:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:35 smithi133 ceph-mon[37053]: pgmap v4760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7961.889628 secs 2024-07-26T10:48:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7977.371891 secs 2024-07-26T10:48:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:35 smithi063 ceph-mon[36747]: pgmap v4760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7961.889628 secs 2024-07-26T10:48:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7977.371891 secs 2024-07-26T10:48:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:37 smithi043 ceph-mon[32384]: pgmap v4761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:37 smithi133 ceph-mon[37053]: pgmap v4761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:37 smithi063 ceph-mon[36747]: pgmap v4761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:39 smithi043 ceph-mon[32384]: pgmap v4762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:39 smithi133 ceph-mon[37053]: pgmap v4762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:39 smithi063 ceph-mon[36747]: pgmap v4762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7966.889748 secs 2024-07-26T10:48:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7982.372010 secs 2024-07-26T10:48:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7966.889748 secs 2024-07-26T10:48:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7982.372010 secs 2024-07-26T10:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7966.889748 secs 2024-07-26T10:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7982.372010 secs 2024-07-26T10:48:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:41 smithi133 ceph-mon[37053]: pgmap v4763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:41 smithi063 ceph-mon[36747]: pgmap v4763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:41 smithi043 ceph-mon[32384]: pgmap v4763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:43 smithi133 ceph-mon[37053]: pgmap v4764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:43 smithi063 ceph-mon[36747]: pgmap v4764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:43 smithi043 ceph-mon[32384]: pgmap v4764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:46 smithi133 ceph-mon[37053]: pgmap v4765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7971.889866 secs 2024-07-26T10:48:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7987.372091 secs 2024-07-26T10:48:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:46 smithi063 ceph-mon[36747]: pgmap v4765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7971.889866 secs 2024-07-26T10:48:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7987.372091 secs 2024-07-26T10:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:46 smithi043 ceph-mon[32384]: pgmap v4765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7971.889866 secs 2024-07-26T10:48:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7987.372091 secs 2024-07-26T10:48:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:48 smithi133 ceph-mon[37053]: pgmap v4766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:48 smithi063 ceph-mon[36747]: pgmap v4766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:48 smithi043 ceph-mon[32384]: pgmap v4766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:50 smithi133 ceph-mon[37053]: pgmap v4767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:50 smithi063 ceph-mon[36747]: pgmap v4767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:50 smithi043 ceph-mon[32384]: pgmap v4767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7976.890005 secs 2024-07-26T10:48:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7992.372172 secs 2024-07-26T10:48:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7976.890005 secs 2024-07-26T10:48:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7992.372172 secs 2024-07-26T10:48:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7976.890005 secs 2024-07-26T10:48:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7992.372172 secs 2024-07-26T10:48:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:52 smithi063 ceph-mon[36747]: pgmap v4768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:52 smithi043 ceph-mon[32384]: pgmap v4768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:52 smithi133 ceph-mon[37053]: pgmap v4768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:54 smithi063 ceph-mon[36747]: pgmap v4769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:54 smithi043 ceph-mon[32384]: pgmap v4769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:54 smithi133 ceph-mon[37053]: pgmap v4769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:48:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:56 smithi063 ceph-mon[36747]: pgmap v4770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7981.890133 secs 2024-07-26T10:48:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 7997.372320 secs 2024-07-26T10:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:56 smithi043 ceph-mon[32384]: pgmap v4770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7981.890133 secs 2024-07-26T10:48:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 7997.372320 secs 2024-07-26T10:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:56 smithi133 ceph-mon[37053]: pgmap v4770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7981.890133 secs 2024-07-26T10:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 7997.372320 secs 2024-07-26T10:48:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:48:58 smithi063 ceph-mon[36747]: pgmap v4771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:48:58 smithi043 ceph-mon[32384]: pgmap v4771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:48:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:48:58 smithi133 ceph-mon[37053]: pgmap v4771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:00 smithi063 ceph-mon[36747]: pgmap v4772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:00 smithi043 ceph-mon[32384]: pgmap v4772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:00 smithi133 ceph-mon[37053]: pgmap v4772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7986.890251 secs 2024-07-26T10:49:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8002.372457 secs 2024-07-26T10:49:01.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7986.890251 secs 2024-07-26T10:49:01.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8002.372457 secs 2024-07-26T10:49:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7986.890251 secs 2024-07-26T10:49:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8002.372457 secs 2024-07-26T10:49:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:02 smithi063 ceph-mon[36747]: pgmap v4773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:02 smithi043 ceph-mon[32384]: pgmap v4773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:02 smithi133 ceph-mon[37053]: pgmap v4773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:04 smithi043 ceph-mon[32384]: pgmap v4774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:04 smithi133 ceph-mon[37053]: pgmap v4774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:04 smithi063 ceph-mon[36747]: pgmap v4774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:49:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:49:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:49:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:06 smithi043 ceph-mon[32384]: pgmap v4775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7991.890317 secs 2024-07-26T10:49:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8007.372558 secs 2024-07-26T10:49:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:06 smithi133 ceph-mon[37053]: pgmap v4775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7991.890317 secs 2024-07-26T10:49:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8007.372558 secs 2024-07-26T10:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:06 smithi063 ceph-mon[36747]: pgmap v4775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7991.890317 secs 2024-07-26T10:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8007.372558 secs 2024-07-26T10:49:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:49:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:49:07.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:07 smithi043 ceph-mon[32384]: pgmap v4776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:07.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:07 smithi043 ceph-mon[32384]: pgmap v4777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:07.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:49:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:49:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:49:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:07 smithi133 ceph-mon[37053]: pgmap v4776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:07 smithi133 ceph-mon[37053]: pgmap v4777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:49:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:49:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:49:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:07 smithi063 ceph-mon[36747]: pgmap v4776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:07 smithi063 ceph-mon[36747]: pgmap v4777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:49:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:09 smithi043 ceph-mon[32384]: pgmap v4778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:49:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:09 smithi133 ceph-mon[37053]: pgmap v4778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:49:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:09 smithi063 ceph-mon[36747]: pgmap v4778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:49:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:11 smithi043 ceph-mon[32384]: pgmap v4779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 7996.890401 secs 2024-07-26T10:49:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8012.372650 secs 2024-07-26T10:49:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:11 smithi133 ceph-mon[37053]: pgmap v4779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 7996.890401 secs 2024-07-26T10:49:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8012.372650 secs 2024-07-26T10:49:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:11 smithi063 ceph-mon[36747]: pgmap v4779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 7996.890401 secs 2024-07-26T10:49:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8012.372650 secs 2024-07-26T10:49:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:13 smithi043 ceph-mon[32384]: pgmap v4780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:13 smithi133 ceph-mon[37053]: pgmap v4780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:13 smithi063 ceph-mon[36747]: pgmap v4780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:15 smithi043 ceph-mon[32384]: pgmap v4781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:15 smithi133 ceph-mon[37053]: pgmap v4781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:15 smithi063 ceph-mon[36747]: pgmap v4781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:49:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8001.890537 secs 2024-07-26T10:49:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8017.372771 secs 2024-07-26T10:49:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8001.890537 secs 2024-07-26T10:49:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8017.372771 secs 2024-07-26T10:49:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8001.890537 secs 2024-07-26T10:49:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8017.372771 secs 2024-07-26T10:49:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:17 smithi043 ceph-mon[32384]: pgmap v4782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:17 smithi133 ceph-mon[37053]: pgmap v4782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:17 smithi063 ceph-mon[36747]: pgmap v4782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:19 smithi043 ceph-mon[32384]: pgmap v4783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:19.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:19 smithi133 ceph-mon[37053]: pgmap v4783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:19 smithi063 ceph-mon[36747]: pgmap v4783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:21 smithi043 ceph-mon[32384]: pgmap v4784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8006.890617 secs 2024-07-26T10:49:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8022.372889 secs 2024-07-26T10:49:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:21 smithi133 ceph-mon[37053]: pgmap v4784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8006.890617 secs 2024-07-26T10:49:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8022.372889 secs 2024-07-26T10:49:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:21 smithi063 ceph-mon[36747]: pgmap v4784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8006.890617 secs 2024-07-26T10:49:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8022.372889 secs 2024-07-26T10:49:23.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:23 smithi043 ceph-mon[32384]: pgmap v4785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:23 smithi133 ceph-mon[37053]: pgmap v4785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:23.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:23 smithi063 ceph-mon[36747]: pgmap v4785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:25 smithi043 ceph-mon[32384]: pgmap v4786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:25 smithi133 ceph-mon[37053]: pgmap v4786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:25 smithi063 ceph-mon[36747]: pgmap v4786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8011.890735 secs 2024-07-26T10:49:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8027.373018 secs 2024-07-26T10:49:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8011.890735 secs 2024-07-26T10:49:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8027.373018 secs 2024-07-26T10:49:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8011.890735 secs 2024-07-26T10:49:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8027.373018 secs 2024-07-26T10:49:27.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:27 smithi043 ceph-mon[32384]: pgmap v4787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:27 smithi133 ceph-mon[37053]: pgmap v4787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:27 smithi063 ceph-mon[36747]: pgmap v4787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:29 smithi043 ceph-mon[32384]: pgmap v4788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:29 smithi133 ceph-mon[37053]: pgmap v4788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:29 smithi063 ceph-mon[36747]: pgmap v4788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:31 smithi133 ceph-mon[37053]: pgmap v4789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8016.890854 secs 2024-07-26T10:49:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8032.373127 secs 2024-07-26T10:49:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:31 smithi063 ceph-mon[36747]: pgmap v4789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8016.890854 secs 2024-07-26T10:49:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8032.373127 secs 2024-07-26T10:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:31 smithi043 ceph-mon[32384]: pgmap v4789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8016.890854 secs 2024-07-26T10:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8032.373127 secs 2024-07-26T10:49:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:33 smithi133 ceph-mon[37053]: pgmap v4790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:33 smithi063 ceph-mon[36747]: pgmap v4790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:33 smithi043 ceph-mon[32384]: pgmap v4790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:34 smithi043 ceph-mon[32384]: pgmap v4791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:34 smithi133 ceph-mon[37053]: pgmap v4791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:35.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:34 smithi063 ceph-mon[36747]: pgmap v4791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8021.890992 secs 2024-07-26T10:49:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8037.373244 secs 2024-07-26T10:49:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8021.890992 secs 2024-07-26T10:49:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8037.373244 secs 2024-07-26T10:49:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8021.890992 secs 2024-07-26T10:49:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8037.373244 secs 2024-07-26T10:49:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:36 smithi133 ceph-mon[37053]: pgmap v4792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:36 smithi063 ceph-mon[36747]: pgmap v4792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:36 smithi043 ceph-mon[32384]: pgmap v4792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:39 smithi043 ceph-mon[32384]: pgmap v4793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:39 smithi133 ceph-mon[37053]: pgmap v4793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:39 smithi063 ceph-mon[36747]: pgmap v4793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:41 smithi043 ceph-mon[32384]: pgmap v4794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8026.891138 secs 2024-07-26T10:49:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8042.373358 secs 2024-07-26T10:49:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:41 smithi133 ceph-mon[37053]: pgmap v4794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8026.891138 secs 2024-07-26T10:49:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8042.373358 secs 2024-07-26T10:49:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:41 smithi063 ceph-mon[36747]: pgmap v4794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:49:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8026.891138 secs 2024-07-26T10:49:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8042.373358 secs 2024-07-26T10:49:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:43 smithi043 ceph-mon[32384]: pgmap v4795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:43 smithi133 ceph-mon[37053]: pgmap v4795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:43 smithi063 ceph-mon[36747]: pgmap v4795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:45 smithi043 ceph-mon[32384]: pgmap v4796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:45 smithi133 ceph-mon[37053]: pgmap v4796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:45 smithi063 ceph-mon[36747]: pgmap v4796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8031.891233 secs 2024-07-26T10:49:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8047.373516 secs 2024-07-26T10:49:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8031.891233 secs 2024-07-26T10:49:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8047.373516 secs 2024-07-26T10:49:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8031.891233 secs 2024-07-26T10:49:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8047.373516 secs 2024-07-26T10:49:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:47 smithi043 ceph-mon[32384]: pgmap v4797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:47 smithi133 ceph-mon[37053]: pgmap v4797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:47 smithi063 ceph-mon[36747]: pgmap v4797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:49 smithi043 ceph-mon[32384]: pgmap v4798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:49 smithi133 ceph-mon[37053]: pgmap v4798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:49 smithi063 ceph-mon[36747]: pgmap v4798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:51 smithi043 ceph-mon[32384]: pgmap v4799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8036.891356 secs 2024-07-26T10:49:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8052.373610 secs 2024-07-26T10:49:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:51 smithi133 ceph-mon[37053]: pgmap v4799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8036.891356 secs 2024-07-26T10:49:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8052.373610 secs 2024-07-26T10:49:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:51 smithi063 ceph-mon[36747]: pgmap v4799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:49:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8036.891356 secs 2024-07-26T10:49:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8052.373610 secs 2024-07-26T10:49:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:53 smithi133 ceph-mon[37053]: pgmap v4800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:53 smithi063 ceph-mon[36747]: pgmap v4800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:53 smithi043 ceph-mon[32384]: pgmap v4800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:49:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:55 smithi133 ceph-mon[37053]: pgmap v4801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:55 smithi063 ceph-mon[36747]: pgmap v4801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:55 smithi043 ceph-mon[32384]: pgmap v4801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:49:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8041.891417 secs 2024-07-26T10:49:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8057.373734 secs 2024-07-26T10:49:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8041.891417 secs 2024-07-26T10:49:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8057.373734 secs 2024-07-26T10:49:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8041.891417 secs 2024-07-26T10:49:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8057.373734 secs 2024-07-26T10:49:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:57 smithi133 ceph-mon[37053]: pgmap v4802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:57 smithi063 ceph-mon[36747]: pgmap v4802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:57.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:57 smithi043 ceph-mon[32384]: pgmap v4802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:49:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:49:58 smithi063 ceph-mon[36747]: pgmap v4803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:49:58 smithi043 ceph-mon[32384]: pgmap v4803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:49:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:49:58 smithi133 ceph-mon[37053]: pgmap v4803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:50:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:50:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T10:50:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:01 smithi063 ceph-mon[36747]: pgmap v4804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8046.891500 secs 2024-07-26T10:50:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8062.373849 secs 2024-07-26T10:50:01.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:01 smithi133 ceph-mon[37053]: pgmap v4804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:01.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8046.891500 secs 2024-07-26T10:50:01.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8062.373849 secs 2024-07-26T10:50:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:01 smithi043 ceph-mon[32384]: pgmap v4804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8046.891500 secs 2024-07-26T10:50:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8062.373849 secs 2024-07-26T10:50:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:03 smithi043 ceph-mon[32384]: pgmap v4805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:03 smithi133 ceph-mon[37053]: pgmap v4805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:03 smithi063 ceph-mon[36747]: pgmap v4805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:05 smithi043 ceph-mon[32384]: pgmap v4806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:05 smithi133 ceph-mon[37053]: pgmap v4806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:05 smithi063 ceph-mon[36747]: pgmap v4806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8051.891621 secs 2024-07-26T10:50:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8067.373967 secs 2024-07-26T10:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8051.891621 secs 2024-07-26T10:50:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8067.373967 secs 2024-07-26T10:50:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8051.891621 secs 2024-07-26T10:50:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8067.373967 secs 2024-07-26T10:50:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:07 smithi043 ceph-mon[32384]: pgmap v4807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:50:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:07 smithi133 ceph-mon[37053]: pgmap v4807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:50:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:07 smithi063 ceph-mon[36747]: pgmap v4807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:50:08.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:50:08.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:50:08.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:50:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:50:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:50:08.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:50:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:09 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:50:09.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:09 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:50:09.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:09 smithi043 ceph-mon[32384]: pgmap v4808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:50:09.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:09 smithi043 ceph-mon[32384]: pgmap v4809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:50:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:09 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:50:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:09 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:50:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:09 smithi133 ceph-mon[37053]: pgmap v4808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:50:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:09 smithi133 ceph-mon[37053]: pgmap v4809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:50:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:09 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T10:50:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:09 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T10:50:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:09 smithi063 ceph-mon[36747]: pgmap v4808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:50:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:09 smithi063 ceph-mon[36747]: pgmap v4809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:50:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:11 smithi133 ceph-mon[37053]: pgmap v4810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:50:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8056.891745 secs 2024-07-26T10:50:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8072.374085 secs 2024-07-26T10:50:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:11 smithi063 ceph-mon[36747]: pgmap v4810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:50:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8056.891745 secs 2024-07-26T10:50:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8072.374085 secs 2024-07-26T10:50:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:11 smithi043 ceph-mon[32384]: pgmap v4810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:50:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8056.891745 secs 2024-07-26T10:50:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8072.374085 secs 2024-07-26T10:50:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:13 smithi043 ceph-mon[32384]: pgmap v4811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:50:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:13 smithi133 ceph-mon[37053]: pgmap v4811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:50:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:13 smithi063 ceph-mon[36747]: pgmap v4811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:50:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:15 smithi133 ceph-mon[37053]: pgmap v4812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:50:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:15 smithi063 ceph-mon[36747]: pgmap v4812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:50:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:15 smithi043 ceph-mon[32384]: pgmap v4812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:50:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8061.891811 secs 2024-07-26T10:50:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8077.374202 secs 2024-07-26T10:50:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8061.891811 secs 2024-07-26T10:50:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8077.374202 secs 2024-07-26T10:50:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8061.891811 secs 2024-07-26T10:50:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8077.374202 secs 2024-07-26T10:50:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:17 smithi133 ceph-mon[37053]: pgmap v4813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:50:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:17 smithi063 ceph-mon[36747]: pgmap v4813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:50:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:17 smithi043 ceph-mon[32384]: pgmap v4813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:50:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:19 smithi133 ceph-mon[37053]: pgmap v4814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:50:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:19 smithi063 ceph-mon[36747]: pgmap v4814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:50:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:19 smithi043 ceph-mon[32384]: pgmap v4814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:50:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:20 smithi063 ceph-mon[36747]: pgmap v4815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:20 smithi043 ceph-mon[32384]: pgmap v4815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:20 smithi133 ceph-mon[37053]: pgmap v4815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8066.891905 secs 2024-07-26T10:50:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8082.374327 secs 2024-07-26T10:50:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8066.891905 secs 2024-07-26T10:50:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8082.374327 secs 2024-07-26T10:50:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8066.891905 secs 2024-07-26T10:50:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8082.374327 secs 2024-07-26T10:50:22.670 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:22 smithi043 ceph-mon[32384]: pgmap v4816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:22 smithi133 ceph-mon[37053]: pgmap v4816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:22 smithi063 ceph-mon[36747]: pgmap v4816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:24 smithi043 ceph-mon[32384]: pgmap v4817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:24 smithi133 ceph-mon[37053]: pgmap v4817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:24 smithi063 ceph-mon[36747]: pgmap v4817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8071.892025 secs 2024-07-26T10:50:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8071.892025 secs 2024-07-26T10:50:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8071.892025 secs 2024-07-26T10:50:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:26 smithi133 ceph-mon[37053]: pgmap v4818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8087.374449 secs 2024-07-26T10:50:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:26 smithi063 ceph-mon[36747]: pgmap v4818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8087.374449 secs 2024-07-26T10:50:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:26 smithi043 ceph-mon[32384]: pgmap v4818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8087.374449 secs 2024-07-26T10:50:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:28 smithi133 ceph-mon[37053]: pgmap v4819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:28 smithi063 ceph-mon[36747]: pgmap v4819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:28 smithi043 ceph-mon[32384]: pgmap v4819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:30 smithi063 ceph-mon[36747]: pgmap v4820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8076.892178 secs 2024-07-26T10:50:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:30 smithi043 ceph-mon[32384]: pgmap v4820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8076.892178 secs 2024-07-26T10:50:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:30 smithi133 ceph-mon[37053]: pgmap v4820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8076.892178 secs 2024-07-26T10:50:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8092.374564 secs 2024-07-26T10:50:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8092.374564 secs 2024-07-26T10:50:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8092.374564 secs 2024-07-26T10:50:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:32 smithi063 ceph-mon[36747]: pgmap v4821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:32.936 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:32 smithi133 ceph-mon[37053]: pgmap v4821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:32 smithi043 ceph-mon[32384]: pgmap v4821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:34 smithi043 ceph-mon[32384]: pgmap v4822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:34 smithi063 ceph-mon[36747]: pgmap v4822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:34 smithi133 ceph-mon[37053]: pgmap v4822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8081.892295 secs 2024-07-26T10:50:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8081.892295 secs 2024-07-26T10:50:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8081.892295 secs 2024-07-26T10:50:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:36 smithi063 ceph-mon[36747]: pgmap v4823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8097.374682 secs 2024-07-26T10:50:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:36 smithi043 ceph-mon[32384]: pgmap v4823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8097.374682 secs 2024-07-26T10:50:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:36 smithi133 ceph-mon[37053]: pgmap v4823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8097.374682 secs 2024-07-26T10:50:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:38 smithi063 ceph-mon[36747]: pgmap v4824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:38 smithi043 ceph-mon[32384]: pgmap v4824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:38 smithi133 ceph-mon[37053]: pgmap v4824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:40 smithi063 ceph-mon[36747]: pgmap v4825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8086.892413 secs 2024-07-26T10:50:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:40 smithi043 ceph-mon[32384]: pgmap v4825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8086.892413 secs 2024-07-26T10:50:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:40 smithi133 ceph-mon[37053]: pgmap v4825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8086.892413 secs 2024-07-26T10:50:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8102.374800 secs 2024-07-26T10:50:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8102.374800 secs 2024-07-26T10:50:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8102.374800 secs 2024-07-26T10:50:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:42 smithi043 ceph-mon[32384]: pgmap v4826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:42 smithi133 ceph-mon[37053]: pgmap v4826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:42 smithi063 ceph-mon[36747]: pgmap v4826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:44 smithi043 ceph-mon[32384]: pgmap v4827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:44 smithi133 ceph-mon[37053]: pgmap v4827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:44 smithi063 ceph-mon[36747]: pgmap v4827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8091.892476 secs 2024-07-26T10:50:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8091.892476 secs 2024-07-26T10:50:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8091.892476 secs 2024-07-26T10:50:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:46 smithi043 ceph-mon[32384]: pgmap v4828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8107.374951 secs 2024-07-26T10:50:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:46 smithi133 ceph-mon[37053]: pgmap v4828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8107.374951 secs 2024-07-26T10:50:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:46 smithi063 ceph-mon[36747]: pgmap v4828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8107.374951 secs 2024-07-26T10:50:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:48 smithi043 ceph-mon[32384]: pgmap v4829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:48 smithi133 ceph-mon[37053]: pgmap v4829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:48 smithi063 ceph-mon[36747]: pgmap v4829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:50 smithi043 ceph-mon[32384]: pgmap v4830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8096.892589 secs 2024-07-26T10:50:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:50 smithi133 ceph-mon[37053]: pgmap v4830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8096.892589 secs 2024-07-26T10:50:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:50 smithi063 ceph-mon[36747]: pgmap v4830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:51.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8096.892589 secs 2024-07-26T10:50:51.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8112.375065 secs 2024-07-26T10:50:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8112.375065 secs 2024-07-26T10:50:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8112.375065 secs 2024-07-26T10:50:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:52 smithi043 ceph-mon[32384]: pgmap v4831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:52 smithi133 ceph-mon[37053]: pgmap v4831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:52 smithi063 ceph-mon[36747]: pgmap v4831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:54 smithi043 ceph-mon[32384]: pgmap v4832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:54 smithi133 ceph-mon[37053]: pgmap v4832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:54 smithi063 ceph-mon[36747]: pgmap v4832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:50:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8101.892706 secs 2024-07-26T10:50:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8101.892706 secs 2024-07-26T10:50:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8101.892706 secs 2024-07-26T10:50:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:56 smithi043 ceph-mon[32384]: pgmap v4833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8117.375129 secs 2024-07-26T10:50:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:56 smithi133 ceph-mon[37053]: pgmap v4833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8117.375129 secs 2024-07-26T10:50:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:56 smithi063 ceph-mon[36747]: pgmap v4833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:50:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8117.375129 secs 2024-07-26T10:50:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:50:58 smithi043 ceph-mon[32384]: pgmap v4834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:59.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:50:58 smithi133 ceph-mon[37053]: pgmap v4834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:50:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:50:58 smithi063 ceph-mon[36747]: pgmap v4834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:00 smithi043 ceph-mon[32384]: pgmap v4835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8106.892827 secs 2024-07-26T10:51:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:00 smithi133 ceph-mon[37053]: pgmap v4835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8106.892827 secs 2024-07-26T10:51:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:00 smithi063 ceph-mon[36747]: pgmap v4835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8106.892827 secs 2024-07-26T10:51:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8122.375258 secs 2024-07-26T10:51:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8122.375258 secs 2024-07-26T10:51:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8122.375258 secs 2024-07-26T10:51:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:02 smithi043 ceph-mon[32384]: pgmap v4836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:02 smithi133 ceph-mon[37053]: pgmap v4836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:02 smithi063 ceph-mon[36747]: pgmap v4836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:04 smithi043 ceph-mon[32384]: pgmap v4837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:04 smithi133 ceph-mon[37053]: pgmap v4837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:04 smithi063 ceph-mon[36747]: pgmap v4837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8111.892923 secs 2024-07-26T10:51:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8111.892923 secs 2024-07-26T10:51:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8111.892923 secs 2024-07-26T10:51:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:06 smithi043 ceph-mon[32384]: pgmap v4838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8127.375378 secs 2024-07-26T10:51:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:06 smithi133 ceph-mon[37053]: pgmap v4838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8127.375378 secs 2024-07-26T10:51:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:06 smithi063 ceph-mon[36747]: pgmap v4838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8127.375378 secs 2024-07-26T10:51:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:51:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:51:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:51:08.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: pgmap v4839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:08.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:51:08.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:51:08.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:51:08.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:51:08.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:08 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:51:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: pgmap v4839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:51:09.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:51:09.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:51:09.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:51:09.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:08 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:51:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: pgmap v4839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T10:51:09.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T10:51:09.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T10:51:09.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T10:51:09.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T10:51:09.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:51:09.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:51:09.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:08 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:51:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:09 smithi133 ceph-mon[37053]: pgmap v4840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:09 smithi133 ceph-mon[37053]: pgmap v4841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:09 smithi063 ceph-mon[36747]: pgmap v4840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:09 smithi063 ceph-mon[36747]: pgmap v4841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:09 smithi043 ceph-mon[32384]: pgmap v4840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:09 smithi043 ceph-mon[32384]: pgmap v4841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8116.893040 secs 2024-07-26T10:51:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8132.375476 secs 2024-07-26T10:51:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8116.893040 secs 2024-07-26T10:51:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8132.375476 secs 2024-07-26T10:51:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8116.893040 secs 2024-07-26T10:51:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8132.375476 secs 2024-07-26T10:51:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:11 smithi133 ceph-mon[37053]: pgmap v4842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:11 smithi063 ceph-mon[36747]: pgmap v4842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:11 smithi043 ceph-mon[32384]: pgmap v4842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:13 smithi063 ceph-mon[36747]: pgmap v4843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:51:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:13 smithi043 ceph-mon[32384]: pgmap v4843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:51:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:13 smithi133 ceph-mon[37053]: pgmap v4843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:51:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:15 smithi063 ceph-mon[36747]: pgmap v4844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8121.893185 secs 2024-07-26T10:51:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8137.375596 secs 2024-07-26T10:51:16.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:15 smithi043 ceph-mon[32384]: pgmap v4844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:16.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8121.893185 secs 2024-07-26T10:51:16.092 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8137.375596 secs 2024-07-26T10:51:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:15 smithi133 ceph-mon[37053]: pgmap v4844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8121.893185 secs 2024-07-26T10:51:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8137.375596 secs 2024-07-26T10:51:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:17 smithi063 ceph-mon[36747]: pgmap v4845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:17 smithi043 ceph-mon[32384]: pgmap v4845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:17 smithi133 ceph-mon[37053]: pgmap v4845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:51:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:19 smithi063 ceph-mon[36747]: pgmap v4846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:19 smithi043 ceph-mon[32384]: pgmap v4846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:19 smithi133 ceph-mon[37053]: pgmap v4846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8126.893312 secs 2024-07-26T10:51:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8142.375717 secs 2024-07-26T10:51:21.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8126.893312 secs 2024-07-26T10:51:21.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8142.375717 secs 2024-07-26T10:51:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8126.893312 secs 2024-07-26T10:51:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8142.375717 secs 2024-07-26T10:51:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:21 smithi063 ceph-mon[36747]: pgmap v4847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:21 smithi043 ceph-mon[32384]: pgmap v4847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:21 smithi133 ceph-mon[37053]: pgmap v4847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:23 smithi063 ceph-mon[36747]: pgmap v4848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:23 smithi043 ceph-mon[32384]: pgmap v4848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:23 smithi133 ceph-mon[37053]: pgmap v4848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:25 smithi063 ceph-mon[36747]: pgmap v4849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8131.893429 secs 2024-07-26T10:51:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8147.375880 secs 2024-07-26T10:51:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:25 smithi043 ceph-mon[32384]: pgmap v4849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8131.893429 secs 2024-07-26T10:51:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8147.375880 secs 2024-07-26T10:51:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:25 smithi133 ceph-mon[37053]: pgmap v4849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8131.893429 secs 2024-07-26T10:51:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8147.375880 secs 2024-07-26T10:51:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:27 smithi063 ceph-mon[36747]: pgmap v4850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:27 smithi043 ceph-mon[32384]: pgmap v4850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:27 smithi133 ceph-mon[37053]: pgmap v4850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:29 smithi043 ceph-mon[32384]: pgmap v4851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:29 smithi133 ceph-mon[37053]: pgmap v4851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:29 smithi063 ceph-mon[36747]: pgmap v4851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:31.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8136.893547 secs 2024-07-26T10:51:31.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8152.376027 secs 2024-07-26T10:51:31.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8136.893547 secs 2024-07-26T10:51:31.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8152.376027 secs 2024-07-26T10:51:31.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8136.893547 secs 2024-07-26T10:51:31.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8152.376027 secs 2024-07-26T10:51:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:31 smithi043 ceph-mon[32384]: pgmap v4852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:31 smithi133 ceph-mon[37053]: pgmap v4852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:31 smithi063 ceph-mon[36747]: pgmap v4852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:33 smithi043 ceph-mon[32384]: pgmap v4853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:33 smithi133 ceph-mon[37053]: pgmap v4853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:33 smithi063 ceph-mon[36747]: pgmap v4853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:35 smithi043 ceph-mon[32384]: pgmap v4854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8141.893616 secs 2024-07-26T10:51:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8157.376141 secs 2024-07-26T10:51:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:35 smithi133 ceph-mon[37053]: pgmap v4854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8141.893616 secs 2024-07-26T10:51:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8157.376141 secs 2024-07-26T10:51:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:35 smithi063 ceph-mon[36747]: pgmap v4854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8141.893616 secs 2024-07-26T10:51:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8157.376141 secs 2024-07-26T10:51:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:37 smithi043 ceph-mon[32384]: pgmap v4855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:37 smithi133 ceph-mon[37053]: pgmap v4855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:37 smithi063 ceph-mon[36747]: pgmap v4855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:39 smithi043 ceph-mon[32384]: pgmap v4856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:39 smithi133 ceph-mon[37053]: pgmap v4856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:39 smithi063 ceph-mon[36747]: pgmap v4856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8146.893735 secs 2024-07-26T10:51:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8162.376263 secs 2024-07-26T10:51:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8146.893735 secs 2024-07-26T10:51:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8162.376263 secs 2024-07-26T10:51:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8146.893735 secs 2024-07-26T10:51:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8162.376263 secs 2024-07-26T10:51:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:41 smithi043 ceph-mon[32384]: pgmap v4857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:41 smithi133 ceph-mon[37053]: pgmap v4857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:41 smithi063 ceph-mon[36747]: pgmap v4857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:43 smithi043 ceph-mon[32384]: pgmap v4858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:51:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:43 smithi133 ceph-mon[37053]: pgmap v4858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:51:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:43 smithi063 ceph-mon[36747]: pgmap v4858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:51:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:45 smithi043 ceph-mon[32384]: pgmap v4859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:51:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8151.893853 secs 2024-07-26T10:51:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8167.376381 secs 2024-07-26T10:51:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:45 smithi133 ceph-mon[37053]: pgmap v4859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:51:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8151.893853 secs 2024-07-26T10:51:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8167.376381 secs 2024-07-26T10:51:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:45 smithi063 ceph-mon[36747]: pgmap v4859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:51:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8151.893853 secs 2024-07-26T10:51:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8167.376381 secs 2024-07-26T10:51:48.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:47 smithi043 ceph-mon[32384]: pgmap v4860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:47 smithi133 ceph-mon[37053]: pgmap v4860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:47 smithi063 ceph-mon[36747]: pgmap v4860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:49 smithi043 ceph-mon[32384]: pgmap v4861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:51:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:49 smithi133 ceph-mon[37053]: pgmap v4861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:51:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:49 smithi063 ceph-mon[36747]: pgmap v4861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:51:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8156.893987 secs 2024-07-26T10:51:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8172.376501 secs 2024-07-26T10:51:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8156.893987 secs 2024-07-26T10:51:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8172.376501 secs 2024-07-26T10:51:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8156.893987 secs 2024-07-26T10:51:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8172.376501 secs 2024-07-26T10:51:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:51 smithi043 ceph-mon[32384]: pgmap v4862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:51 smithi133 ceph-mon[37053]: pgmap v4862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:51 smithi063 ceph-mon[36747]: pgmap v4862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:51:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:53 smithi043 ceph-mon[32384]: pgmap v4863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:53 smithi133 ceph-mon[37053]: pgmap v4863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:53 smithi063 ceph-mon[36747]: pgmap v4863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:51:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:55 smithi043 ceph-mon[32384]: pgmap v4864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8161.894121 secs 2024-07-26T10:51:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8177.376596 secs 2024-07-26T10:51:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:55 smithi133 ceph-mon[37053]: pgmap v4864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8161.894121 secs 2024-07-26T10:51:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8177.376596 secs 2024-07-26T10:51:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:55 smithi063 ceph-mon[36747]: pgmap v4864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:51:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8161.894121 secs 2024-07-26T10:51:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8177.376596 secs 2024-07-26T10:51:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:57 smithi043 ceph-mon[32384]: pgmap v4865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:57 smithi133 ceph-mon[37053]: pgmap v4865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:51:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:57 smithi063 ceph-mon[36747]: pgmap v4865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:51:59 smithi043 ceph-mon[32384]: pgmap v4866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:51:59 smithi133 ceph-mon[37053]: pgmap v4866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:51:59 smithi063 ceph-mon[36747]: pgmap v4866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:01.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8166.894184 secs 2024-07-26T10:52:01.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8182.376695 secs 2024-07-26T10:52:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8166.894184 secs 2024-07-26T10:52:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8182.376695 secs 2024-07-26T10:52:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8166.894184 secs 2024-07-26T10:52:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8182.376695 secs 2024-07-26T10:52:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:01 smithi043 ceph-mon[32384]: pgmap v4867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:01 smithi133 ceph-mon[37053]: pgmap v4867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:01 smithi063 ceph-mon[36747]: pgmap v4867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:03 smithi043 ceph-mon[32384]: pgmap v4868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:03 smithi133 ceph-mon[37053]: pgmap v4868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:03 smithi063 ceph-mon[36747]: pgmap v4868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:05 smithi043 ceph-mon[32384]: pgmap v4869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8171.894278 secs 2024-07-26T10:52:06.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8187.376831 secs 2024-07-26T10:52:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:05 smithi133 ceph-mon[37053]: pgmap v4869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8171.894278 secs 2024-07-26T10:52:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8187.376831 secs 2024-07-26T10:52:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:05 smithi063 ceph-mon[36747]: pgmap v4869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8171.894278 secs 2024-07-26T10:52:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8187.376831 secs 2024-07-26T10:52:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:07 smithi043 ceph-mon[32384]: pgmap v4870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:07 smithi133 ceph-mon[37053]: pgmap v4870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:07 smithi063 ceph-mon[36747]: pgmap v4870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:52:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:52:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:52:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:09 smithi133 ceph-mon[37053]: pgmap v4871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:52:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:52:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:52:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:09 smithi063 ceph-mon[36747]: pgmap v4871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:52:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:52:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:52:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:09 smithi043 ceph-mon[32384]: pgmap v4871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:52:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:52:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:52:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:10 smithi133 ceph-mon[37053]: pgmap v4872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:52:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:10 smithi133 ceph-mon[37053]: pgmap v4873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:52:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8176.894396 secs 2024-07-26T10:52:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8192.376925 secs 2024-07-26T10:52:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:10 smithi063 ceph-mon[36747]: pgmap v4872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:52:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:10 smithi063 ceph-mon[36747]: pgmap v4873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:52:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8176.894396 secs 2024-07-26T10:52:11.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8192.376925 secs 2024-07-26T10:52:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:10 smithi043 ceph-mon[32384]: pgmap v4872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:52:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:10 smithi043 ceph-mon[32384]: pgmap v4873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:52:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8176.894396 secs 2024-07-26T10:52:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8192.376925 secs 2024-07-26T10:52:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:12 smithi133 ceph-mon[37053]: pgmap v4874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:52:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:12 smithi063 ceph-mon[36747]: pgmap v4874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:52:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:12 smithi043 ceph-mon[32384]: pgmap v4874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:52:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:14 smithi133 ceph-mon[37053]: pgmap v4875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:52:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:14 smithi063 ceph-mon[36747]: pgmap v4875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:52:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:14 smithi043 ceph-mon[32384]: pgmap v4875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:52:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8181.894523 secs 2024-07-26T10:52:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8197.377008 secs 2024-07-26T10:52:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8181.894523 secs 2024-07-26T10:52:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8197.377008 secs 2024-07-26T10:52:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8181.894523 secs 2024-07-26T10:52:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8197.377008 secs 2024-07-26T10:52:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:17 smithi133 ceph-mon[37053]: pgmap v4876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:52:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:17 smithi063 ceph-mon[36747]: pgmap v4876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:52:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:17 smithi043 ceph-mon[32384]: pgmap v4876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:52:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:19 smithi063 ceph-mon[36747]: pgmap v4877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:52:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:19 smithi043 ceph-mon[32384]: pgmap v4877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:52:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:19 smithi133 ceph-mon[37053]: pgmap v4877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:52:21.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:21 smithi043 ceph-mon[32384]: pgmap v4878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:52:21.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8186.894642 secs 2024-07-26T10:52:21.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8202.377102 secs 2024-07-26T10:52:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:21 smithi063 ceph-mon[36747]: pgmap v4878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:52:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8186.894642 secs 2024-07-26T10:52:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8202.377102 secs 2024-07-26T10:52:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:21 smithi133 ceph-mon[37053]: pgmap v4878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:52:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8186.894642 secs 2024-07-26T10:52:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8202.377102 secs 2024-07-26T10:52:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:23 smithi063 ceph-mon[36747]: pgmap v4879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:23 smithi043 ceph-mon[32384]: pgmap v4879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:23 smithi133 ceph-mon[37053]: pgmap v4879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:25 smithi063 ceph-mon[36747]: pgmap v4880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:25 smithi043 ceph-mon[32384]: pgmap v4880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:25 smithi133 ceph-mon[37053]: pgmap v4880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8191.894796 secs 2024-07-26T10:52:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8207.377220 secs 2024-07-26T10:52:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8191.894796 secs 2024-07-26T10:52:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8207.377220 secs 2024-07-26T10:52:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8191.894796 secs 2024-07-26T10:52:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8207.377220 secs 2024-07-26T10:52:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:27 smithi063 ceph-mon[36747]: pgmap v4881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:27 smithi043 ceph-mon[32384]: pgmap v4881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:27 smithi133 ceph-mon[37053]: pgmap v4881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:29 smithi063 ceph-mon[36747]: pgmap v4882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:29 smithi043 ceph-mon[32384]: pgmap v4882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:29.519 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:29 smithi133 ceph-mon[37053]: pgmap v4882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:31.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:31 smithi133 ceph-mon[37053]: pgmap v4883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:31.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8196.894894 secs 2024-07-26T10:52:31.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8212.377288 secs 2024-07-26T10:52:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:31 smithi063 ceph-mon[36747]: pgmap v4883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8196.894894 secs 2024-07-26T10:52:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8212.377288 secs 2024-07-26T10:52:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:31 smithi043 ceph-mon[32384]: pgmap v4883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8196.894894 secs 2024-07-26T10:52:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8212.377288 secs 2024-07-26T10:52:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:33 smithi043 ceph-mon[32384]: pgmap v4884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:33 smithi063 ceph-mon[36747]: pgmap v4884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:33 smithi133 ceph-mon[37053]: pgmap v4884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:35 smithi043 ceph-mon[32384]: pgmap v4885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:35 smithi133 ceph-mon[37053]: pgmap v4885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:35 smithi063 ceph-mon[36747]: pgmap v4885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8201.895043 secs 2024-07-26T10:52:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8217.377440 secs 2024-07-26T10:52:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8201.895043 secs 2024-07-26T10:52:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8217.377440 secs 2024-07-26T10:52:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8201.895043 secs 2024-07-26T10:52:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8217.377440 secs 2024-07-26T10:52:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:37 smithi043 ceph-mon[32384]: pgmap v4886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:37 smithi133 ceph-mon[37053]: pgmap v4886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:37 smithi063 ceph-mon[36747]: pgmap v4886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:39 smithi043 ceph-mon[32384]: pgmap v4887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:39 smithi133 ceph-mon[37053]: pgmap v4887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:39 smithi063 ceph-mon[36747]: pgmap v4887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:41 smithi043 ceph-mon[32384]: pgmap v4888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8206.895166 secs 2024-07-26T10:52:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8222.377565 secs 2024-07-26T10:52:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:41 smithi133 ceph-mon[37053]: pgmap v4888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8206.895166 secs 2024-07-26T10:52:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8222.377565 secs 2024-07-26T10:52:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:41 smithi063 ceph-mon[36747]: pgmap v4888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8206.895166 secs 2024-07-26T10:52:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8222.377565 secs 2024-07-26T10:52:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:43 smithi043 ceph-mon[32384]: pgmap v4889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:43 smithi133 ceph-mon[37053]: pgmap v4889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:43 smithi063 ceph-mon[36747]: pgmap v4889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:45 smithi043 ceph-mon[32384]: pgmap v4890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:45 smithi133 ceph-mon[37053]: pgmap v4890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:45 smithi063 ceph-mon[36747]: pgmap v4890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8211.895262 secs 2024-07-26T10:52:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8227.377691 secs 2024-07-26T10:52:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8211.895262 secs 2024-07-26T10:52:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8227.377691 secs 2024-07-26T10:52:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8211.895262 secs 2024-07-26T10:52:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8227.377691 secs 2024-07-26T10:52:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:47 smithi043 ceph-mon[32384]: pgmap v4891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:47 smithi133 ceph-mon[37053]: pgmap v4891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:47 smithi063 ceph-mon[36747]: pgmap v4891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:49 smithi043 ceph-mon[32384]: pgmap v4892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:49 smithi133 ceph-mon[37053]: pgmap v4892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:49 smithi063 ceph-mon[36747]: pgmap v4892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:51 smithi043 ceph-mon[32384]: pgmap v4893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8216.895387 secs 2024-07-26T10:52:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8232.377811 secs 2024-07-26T10:52:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:51 smithi133 ceph-mon[37053]: pgmap v4893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8216.895387 secs 2024-07-26T10:52:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8232.377811 secs 2024-07-26T10:52:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:51 smithi063 ceph-mon[36747]: pgmap v4893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:52:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8216.895387 secs 2024-07-26T10:52:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8232.377811 secs 2024-07-26T10:52:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:53 smithi043 ceph-mon[32384]: pgmap v4894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:53 smithi133 ceph-mon[37053]: pgmap v4894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:53 smithi063 ceph-mon[36747]: pgmap v4894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:55 smithi043 ceph-mon[32384]: pgmap v4895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:55 smithi133 ceph-mon[37053]: pgmap v4895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:55 smithi063 ceph-mon[36747]: pgmap v4895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8221.895482 secs 2024-07-26T10:52:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8237.377931 secs 2024-07-26T10:52:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8221.895482 secs 2024-07-26T10:52:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8237.377931 secs 2024-07-26T10:52:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8221.895482 secs 2024-07-26T10:52:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8237.377931 secs 2024-07-26T10:52:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:57 smithi043 ceph-mon[32384]: pgmap v4896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:57 smithi133 ceph-mon[37053]: pgmap v4896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:57 smithi063 ceph-mon[36747]: pgmap v4896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:52:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:52:59 smithi043 ceph-mon[32384]: pgmap v4897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:52:59 smithi133 ceph-mon[37053]: pgmap v4897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:52:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:52:59 smithi063 ceph-mon[36747]: pgmap v4897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:01 smithi043 ceph-mon[32384]: pgmap v4898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8226.895605 secs 2024-07-26T10:53:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8242.378011 secs 2024-07-26T10:53:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:01 smithi133 ceph-mon[37053]: pgmap v4898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8226.895605 secs 2024-07-26T10:53:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8242.378011 secs 2024-07-26T10:53:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:01 smithi063 ceph-mon[36747]: pgmap v4898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8226.895605 secs 2024-07-26T10:53:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8242.378011 secs 2024-07-26T10:53:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:03 smithi043 ceph-mon[32384]: pgmap v4899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:03 smithi133 ceph-mon[37053]: pgmap v4899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:03 smithi063 ceph-mon[36747]: pgmap v4899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:05 smithi043 ceph-mon[32384]: pgmap v4900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:05 smithi133 ceph-mon[37053]: pgmap v4900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:05 smithi063 ceph-mon[36747]: pgmap v4900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8231.895761 secs 2024-07-26T10:53:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8247.378125 secs 2024-07-26T10:53:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8231.895761 secs 2024-07-26T10:53:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8247.378125 secs 2024-07-26T10:53:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8231.895761 secs 2024-07-26T10:53:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8247.378125 secs 2024-07-26T10:53:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:07 smithi043 ceph-mon[32384]: pgmap v4901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:07 smithi133 ceph-mon[37053]: pgmap v4901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:07 smithi063 ceph-mon[36747]: pgmap v4901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:09 smithi043 ceph-mon[32384]: pgmap v4902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:09 smithi133 ceph-mon[37053]: pgmap v4902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:09 smithi063 ceph-mon[36747]: pgmap v4902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:53:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:53:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:53:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:11 smithi043 ceph-mon[32384]: pgmap v4903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8236.895836 secs 2024-07-26T10:53:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8252.378208 secs 2024-07-26T10:53:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:11 smithi133 ceph-mon[37053]: pgmap v4903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8236.895836 secs 2024-07-26T10:53:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8252.378208 secs 2024-07-26T10:53:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:11 smithi063 ceph-mon[36747]: pgmap v4903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8236.895836 secs 2024-07-26T10:53:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8252.378208 secs 2024-07-26T10:53:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:53:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:53:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:53:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:53:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:53:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:53:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:53:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:13 smithi043 ceph-mon[32384]: pgmap v4904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:13 smithi043 ceph-mon[32384]: pgmap v4905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:13 smithi133 ceph-mon[37053]: pgmap v4904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:13 smithi133 ceph-mon[37053]: pgmap v4905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:13 smithi063 ceph-mon[36747]: pgmap v4904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:13 smithi063 ceph-mon[36747]: pgmap v4905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:15 smithi133 ceph-mon[37053]: pgmap v4906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:15 smithi063 ceph-mon[36747]: pgmap v4906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:15 smithi043 ceph-mon[32384]: pgmap v4906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8241.895952 secs 2024-07-26T10:53:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8257.378326 secs 2024-07-26T10:53:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8241.895952 secs 2024-07-26T10:53:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8257.378326 secs 2024-07-26T10:53:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8241.895952 secs 2024-07-26T10:53:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8257.378326 secs 2024-07-26T10:53:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:17 smithi133 ceph-mon[37053]: pgmap v4907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:17 smithi063 ceph-mon[36747]: pgmap v4907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:17 smithi043 ceph-mon[32384]: pgmap v4907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:19 smithi133 ceph-mon[37053]: pgmap v4908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:19 smithi063 ceph-mon[36747]: pgmap v4908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:19 smithi043 ceph-mon[32384]: pgmap v4908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:21 smithi133 ceph-mon[37053]: pgmap v4909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8246.896066 secs 2024-07-26T10:53:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8262.378450 secs 2024-07-26T10:53:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:21 smithi063 ceph-mon[36747]: pgmap v4909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8246.896066 secs 2024-07-26T10:53:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8262.378450 secs 2024-07-26T10:53:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:21 smithi043 ceph-mon[32384]: pgmap v4909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:53:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8246.896066 secs 2024-07-26T10:53:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8262.378450 secs 2024-07-26T10:53:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:23 smithi133 ceph-mon[37053]: pgmap v4910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:53:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:23 smithi063 ceph-mon[36747]: pgmap v4910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:53:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:23 smithi043 ceph-mon[32384]: pgmap v4910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:53:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:25 smithi063 ceph-mon[36747]: pgmap v4911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:25 smithi043 ceph-mon[32384]: pgmap v4911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:25 smithi133 ceph-mon[37053]: pgmap v4911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8251.896185 secs 2024-07-26T10:53:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8267.378567 secs 2024-07-26T10:53:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8251.896185 secs 2024-07-26T10:53:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8267.378567 secs 2024-07-26T10:53:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8251.896185 secs 2024-07-26T10:53:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8267.378567 secs 2024-07-26T10:53:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:27 smithi063 ceph-mon[36747]: pgmap v4912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:27 smithi043 ceph-mon[32384]: pgmap v4912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:27 smithi133 ceph-mon[37053]: pgmap v4912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:29 smithi063 ceph-mon[36747]: pgmap v4913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:29 smithi043 ceph-mon[32384]: pgmap v4913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:29 smithi133 ceph-mon[37053]: pgmap v4913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:31 smithi063 ceph-mon[36747]: pgmap v4914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8256.896261 secs 2024-07-26T10:53:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8272.378683 secs 2024-07-26T10:53:31.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:31 smithi133 ceph-mon[37053]: pgmap v4914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:31.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8256.896261 secs 2024-07-26T10:53:31.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8272.378683 secs 2024-07-26T10:53:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:31 smithi043 ceph-mon[32384]: pgmap v4914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8256.896261 secs 2024-07-26T10:53:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8272.378683 secs 2024-07-26T10:53:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:32 smithi043 ceph-mon[32384]: pgmap v4915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:32 smithi133 ceph-mon[37053]: pgmap v4915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:32 smithi063 ceph-mon[36747]: pgmap v4915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:34 smithi043 ceph-mon[32384]: pgmap v4916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:34 smithi133 ceph-mon[37053]: pgmap v4916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:34 smithi063 ceph-mon[36747]: pgmap v4916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8261.896372 secs 2024-07-26T10:53:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8277.378804 secs 2024-07-26T10:53:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8261.896372 secs 2024-07-26T10:53:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8277.378804 secs 2024-07-26T10:53:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8261.896372 secs 2024-07-26T10:53:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8277.378804 secs 2024-07-26T10:53:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:36 smithi043 ceph-mon[32384]: pgmap v4917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:36 smithi133 ceph-mon[37053]: pgmap v4917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:36 smithi063 ceph-mon[36747]: pgmap v4917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:38 smithi043 ceph-mon[32384]: pgmap v4918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:38 smithi133 ceph-mon[37053]: pgmap v4918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:38 smithi063 ceph-mon[36747]: pgmap v4918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:40 smithi043 ceph-mon[32384]: pgmap v4919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8266.896487 secs 2024-07-26T10:53:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8282.378922 secs 2024-07-26T10:53:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:40 smithi133 ceph-mon[37053]: pgmap v4919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8266.896487 secs 2024-07-26T10:53:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8282.378922 secs 2024-07-26T10:53:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:40 smithi063 ceph-mon[36747]: pgmap v4919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8266.896487 secs 2024-07-26T10:53:41.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8282.378922 secs 2024-07-26T10:53:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:42 smithi043 ceph-mon[32384]: pgmap v4920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:42 smithi133 ceph-mon[37053]: pgmap v4920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:42 smithi063 ceph-mon[36747]: pgmap v4920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:44 smithi043 ceph-mon[32384]: pgmap v4921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:44 smithi133 ceph-mon[37053]: pgmap v4921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:44 smithi063 ceph-mon[36747]: pgmap v4921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8271.896602 secs 2024-07-26T10:53:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8287.379042 secs 2024-07-26T10:53:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8271.896602 secs 2024-07-26T10:53:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8287.379042 secs 2024-07-26T10:53:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8271.896602 secs 2024-07-26T10:53:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8287.379042 secs 2024-07-26T10:53:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:46 smithi043 ceph-mon[32384]: pgmap v4922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:46 smithi133 ceph-mon[37053]: pgmap v4922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:46 smithi063 ceph-mon[36747]: pgmap v4922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:48 smithi043 ceph-mon[32384]: pgmap v4923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:48 smithi133 ceph-mon[37053]: pgmap v4923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:48 smithi063 ceph-mon[36747]: pgmap v4923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:51.227 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:50 smithi043 ceph-mon[32384]: pgmap v4924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:51.228 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8276.896685 secs 2024-07-26T10:53:51.228 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8292.379164 secs 2024-07-26T10:53:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:50 smithi133 ceph-mon[37053]: pgmap v4924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8276.896685 secs 2024-07-26T10:53:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8292.379164 secs 2024-07-26T10:53:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:50 smithi063 ceph-mon[36747]: pgmap v4924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:53:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8276.896685 secs 2024-07-26T10:53:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8292.379164 secs 2024-07-26T10:53:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:52 smithi043 ceph-mon[32384]: pgmap v4925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:52 smithi133 ceph-mon[37053]: pgmap v4925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:52 smithi063 ceph-mon[36747]: pgmap v4925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:54 smithi043 ceph-mon[32384]: pgmap v4926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:54 smithi133 ceph-mon[37053]: pgmap v4926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:54 smithi063 ceph-mon[36747]: pgmap v4926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8281.896802 secs 2024-07-26T10:53:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8297.379285 secs 2024-07-26T10:53:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8281.896802 secs 2024-07-26T10:53:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8297.379285 secs 2024-07-26T10:53:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8281.896802 secs 2024-07-26T10:53:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8297.379285 secs 2024-07-26T10:53:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:56 smithi043 ceph-mon[32384]: pgmap v4927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:56 smithi133 ceph-mon[37053]: pgmap v4927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:56 smithi063 ceph-mon[36747]: pgmap v4927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:53:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:53:58 smithi133 ceph-mon[37053]: pgmap v4928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:53:58 smithi063 ceph-mon[36747]: pgmap v4928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:53:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:53:58 smithi043 ceph-mon[32384]: pgmap v4928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:00 smithi133 ceph-mon[37053]: pgmap v4929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8286.896938 secs 2024-07-26T10:54:01.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8302.379406 secs 2024-07-26T10:54:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:00 smithi063 ceph-mon[36747]: pgmap v4929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8286.896938 secs 2024-07-26T10:54:01.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8302.379406 secs 2024-07-26T10:54:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:00 smithi043 ceph-mon[32384]: pgmap v4929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8286.896938 secs 2024-07-26T10:54:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8302.379406 secs 2024-07-26T10:54:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:02 smithi133 ceph-mon[37053]: pgmap v4930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:02 smithi063 ceph-mon[36747]: pgmap v4930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:02 smithi043 ceph-mon[32384]: pgmap v4930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:05 smithi133 ceph-mon[37053]: pgmap v4931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:05 smithi063 ceph-mon[36747]: pgmap v4931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:05 smithi043 ceph-mon[32384]: pgmap v4931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8291.897034 secs 2024-07-26T10:54:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8307.379533 secs 2024-07-26T10:54:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8291.897034 secs 2024-07-26T10:54:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8307.379533 secs 2024-07-26T10:54:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8291.897034 secs 2024-07-26T10:54:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8307.379533 secs 2024-07-26T10:54:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:07 smithi063 ceph-mon[36747]: pgmap v4932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:07.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:07 smithi043 ceph-mon[32384]: pgmap v4932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:07 smithi133 ceph-mon[37053]: pgmap v4932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:09 smithi063 ceph-mon[36747]: pgmap v4933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:09 smithi043 ceph-mon[32384]: pgmap v4933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:09 smithi133 ceph-mon[37053]: pgmap v4933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:11 smithi063 ceph-mon[36747]: pgmap v4934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8296.897156 secs 2024-07-26T10:54:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8312.379651 secs 2024-07-26T10:54:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:11 smithi043 ceph-mon[32384]: pgmap v4934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8296.897156 secs 2024-07-26T10:54:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8312.379651 secs 2024-07-26T10:54:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:11 smithi133 ceph-mon[37053]: pgmap v4934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8296.897156 secs 2024-07-26T10:54:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8312.379651 secs 2024-07-26T10:54:13.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:13 smithi133 ceph-mon[37053]: pgmap v4935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:13.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:54:13.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:13 smithi063 ceph-mon[36747]: pgmap v4935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.320 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:13 smithi043 ceph-mon[32384]: pgmap v4935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:13.320 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:54:13.320 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.320 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.320 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:13.320 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: pgmap v4936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:15 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: pgmap v4936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:15 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: pgmap v4936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:15.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:15 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8301.897272 secs 2024-07-26T10:54:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8317.379790 secs 2024-07-26T10:54:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8301.897272 secs 2024-07-26T10:54:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8317.379790 secs 2024-07-26T10:54:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8301.897272 secs 2024-07-26T10:54:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8317.379790 secs 2024-07-26T10:54:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:17 smithi043 ceph-mon[32384]: pgmap v4937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:17 smithi133 ceph-mon[37053]: pgmap v4937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:17 smithi063 ceph-mon[36747]: pgmap v4937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: pgmap v4938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: pgmap v4939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:54:19.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:54:19.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: pgmap v4938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:19.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: pgmap v4939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:19.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:19.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:54:19.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:54:19.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: pgmap v4938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:19.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: pgmap v4939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:19.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:54:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:20 smithi043 ceph-mon[32384]: pgmap v4940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8306.897389 secs 2024-07-26T10:54:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:20 smithi133 ceph-mon[37053]: pgmap v4940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8306.897389 secs 2024-07-26T10:54:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:20 smithi063 ceph-mon[36747]: pgmap v4940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8306.897389 secs 2024-07-26T10:54:21.948 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8322.379942 secs 2024-07-26T10:54:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8322.379942 secs 2024-07-26T10:54:22.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8322.379942 secs 2024-07-26T10:54:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:22 smithi043 ceph-mon[32384]: pgmap v4941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:22 smithi133 ceph-mon[37053]: pgmap v4941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:22 smithi063 ceph-mon[36747]: pgmap v4941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:24 smithi043 ceph-mon[32384]: pgmap v4942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:24 smithi133 ceph-mon[37053]: pgmap v4942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:24 smithi063 ceph-mon[36747]: pgmap v4942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8311.897505 secs 2024-07-26T10:54:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8311.897505 secs 2024-07-26T10:54:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8311.897505 secs 2024-07-26T10:54:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:26 smithi043 ceph-mon[32384]: pgmap v4943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8327.380031 secs 2024-07-26T10:54:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:26 smithi133 ceph-mon[37053]: pgmap v4943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8327.380031 secs 2024-07-26T10:54:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:26 smithi063 ceph-mon[36747]: pgmap v4943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8327.380031 secs 2024-07-26T10:54:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:28 smithi043 ceph-mon[32384]: pgmap v4944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:28 smithi133 ceph-mon[37053]: pgmap v4944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:28 smithi063 ceph-mon[36747]: pgmap v4944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:30 smithi043 ceph-mon[32384]: pgmap v4945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8316.897628 secs 2024-07-26T10:54:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:30 smithi133 ceph-mon[37053]: pgmap v4945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8316.897628 secs 2024-07-26T10:54:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:30 smithi063 ceph-mon[36747]: pgmap v4945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8316.897628 secs 2024-07-26T10:54:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8332.380124 secs 2024-07-26T10:54:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8332.380124 secs 2024-07-26T10:54:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8332.380124 secs 2024-07-26T10:54:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:32 smithi133 ceph-mon[37053]: pgmap v4946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:32 smithi063 ceph-mon[36747]: pgmap v4946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:32 smithi043 ceph-mon[32384]: pgmap v4946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:34 smithi133 ceph-mon[37053]: pgmap v4947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:34 smithi063 ceph-mon[36747]: pgmap v4947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:34 smithi043 ceph-mon[32384]: pgmap v4947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8321.897751 secs 2024-07-26T10:54:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8337.380206 secs 2024-07-26T10:54:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8321.897751 secs 2024-07-26T10:54:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8337.380206 secs 2024-07-26T10:54:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8321.897751 secs 2024-07-26T10:54:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8337.380206 secs 2024-07-26T10:54:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:36 smithi133 ceph-mon[37053]: pgmap v4948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:36 smithi063 ceph-mon[36747]: pgmap v4948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:36 smithi043 ceph-mon[32384]: pgmap v4948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:38 smithi133 ceph-mon[37053]: pgmap v4949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:38 smithi063 ceph-mon[36747]: pgmap v4949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:38 smithi043 ceph-mon[32384]: pgmap v4949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:40 smithi063 ceph-mon[36747]: pgmap v4950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:54:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8326.897891 secs 2024-07-26T10:54:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8342.380326 secs 2024-07-26T10:54:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:40 smithi043 ceph-mon[32384]: pgmap v4950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:54:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8326.897891 secs 2024-07-26T10:54:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8342.380326 secs 2024-07-26T10:54:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:40 smithi133 ceph-mon[37053]: pgmap v4950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:54:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8326.897891 secs 2024-07-26T10:54:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8342.380326 secs 2024-07-26T10:54:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:42 smithi063 ceph-mon[36747]: pgmap v4951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:42 smithi043 ceph-mon[32384]: pgmap v4951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:42 smithi133 ceph-mon[37053]: pgmap v4951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:54:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:44 smithi063 ceph-mon[36747]: pgmap v4952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:44 smithi043 ceph-mon[32384]: pgmap v4952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:44 smithi133 ceph-mon[37053]: pgmap v4952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:54:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8331.898011 secs 2024-07-26T10:54:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8347.380478 secs 2024-07-26T10:54:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8331.898011 secs 2024-07-26T10:54:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8347.380478 secs 2024-07-26T10:54:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8331.898011 secs 2024-07-26T10:54:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8347.380478 secs 2024-07-26T10:54:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:46 smithi063 ceph-mon[36747]: pgmap v4953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:46 smithi043 ceph-mon[32384]: pgmap v4953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:46 smithi133 ceph-mon[37053]: pgmap v4953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:48 smithi063 ceph-mon[36747]: pgmap v4954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:48 smithi043 ceph-mon[32384]: pgmap v4954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:48 smithi133 ceph-mon[37053]: pgmap v4954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:50 smithi063 ceph-mon[36747]: pgmap v4955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8336.898130 secs 2024-07-26T10:54:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8352.380624 secs 2024-07-26T10:54:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:50 smithi043 ceph-mon[32384]: pgmap v4955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8336.898130 secs 2024-07-26T10:54:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8352.380624 secs 2024-07-26T10:54:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:50 smithi133 ceph-mon[37053]: pgmap v4955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:54:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8336.898130 secs 2024-07-26T10:54:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8352.380624 secs 2024-07-26T10:54:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:52 smithi063 ceph-mon[36747]: pgmap v4956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:53.179 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:52 smithi043 ceph-mon[32384]: pgmap v4956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:52 smithi133 ceph-mon[37053]: pgmap v4956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:55.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:54 smithi063 ceph-mon[36747]: pgmap v4957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:54 smithi043 ceph-mon[32384]: pgmap v4957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:54 smithi133 ceph-mon[37053]: pgmap v4957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8341.898247 secs 2024-07-26T10:54:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8357.380745 secs 2024-07-26T10:54:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8341.898247 secs 2024-07-26T10:54:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8357.380745 secs 2024-07-26T10:54:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8341.898247 secs 2024-07-26T10:54:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8357.380745 secs 2024-07-26T10:54:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:56 smithi043 ceph-mon[32384]: pgmap v4958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:56 smithi133 ceph-mon[37053]: pgmap v4958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:56 smithi063 ceph-mon[36747]: pgmap v4958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:54:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:54:58 smithi043 ceph-mon[32384]: pgmap v4959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:54:58 smithi133 ceph-mon[37053]: pgmap v4959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:54:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:54:58 smithi063 ceph-mon[36747]: pgmap v4959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:00 smithi063 ceph-mon[36747]: pgmap v4960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8346.898372 secs 2024-07-26T10:55:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8362.380842 secs 2024-07-26T10:55:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:00 smithi043 ceph-mon[32384]: pgmap v4960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8346.898372 secs 2024-07-26T10:55:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8362.380842 secs 2024-07-26T10:55:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:00 smithi133 ceph-mon[37053]: pgmap v4960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8346.898372 secs 2024-07-26T10:55:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8362.380842 secs 2024-07-26T10:55:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:02 smithi043 ceph-mon[32384]: pgmap v4961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:02 smithi133 ceph-mon[37053]: pgmap v4961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:02 smithi063 ceph-mon[36747]: pgmap v4961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:04 smithi043 ceph-mon[32384]: pgmap v4962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:04 smithi133 ceph-mon[37053]: pgmap v4962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:04 smithi063 ceph-mon[36747]: pgmap v4962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8351.898489 secs 2024-07-26T10:55:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8367.380956 secs 2024-07-26T10:55:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8351.898489 secs 2024-07-26T10:55:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8367.380956 secs 2024-07-26T10:55:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8351.898489 secs 2024-07-26T10:55:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8367.380956 secs 2024-07-26T10:55:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:06 smithi043 ceph-mon[32384]: pgmap v4963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:06 smithi133 ceph-mon[37053]: pgmap v4963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:06 smithi063 ceph-mon[36747]: pgmap v4963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:08 smithi043 ceph-mon[32384]: pgmap v4964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:08 smithi133 ceph-mon[37053]: pgmap v4964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:08 smithi063 ceph-mon[36747]: pgmap v4964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:10 smithi043 ceph-mon[32384]: pgmap v4965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8356.898612 secs 2024-07-26T10:55:11.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8372.381056 secs 2024-07-26T10:55:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:10 smithi133 ceph-mon[37053]: pgmap v4965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8356.898612 secs 2024-07-26T10:55:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8372.381056 secs 2024-07-26T10:55:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:10 smithi063 ceph-mon[36747]: pgmap v4965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8356.898612 secs 2024-07-26T10:55:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8372.381056 secs 2024-07-26T10:55:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:12 smithi043 ceph-mon[32384]: pgmap v4966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:12 smithi133 ceph-mon[37053]: pgmap v4966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:12 smithi063 ceph-mon[36747]: pgmap v4966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:15.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:14 smithi043 ceph-mon[32384]: pgmap v4967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:14 smithi133 ceph-mon[37053]: pgmap v4967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:14 smithi063 ceph-mon[36747]: pgmap v4967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8361.898747 secs 2024-07-26T10:55:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8377.381181 secs 2024-07-26T10:55:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8361.898747 secs 2024-07-26T10:55:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8377.381181 secs 2024-07-26T10:55:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8361.898747 secs 2024-07-26T10:55:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8377.381181 secs 2024-07-26T10:55:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:16 smithi043 ceph-mon[32384]: pgmap v4968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:16 smithi133 ceph-mon[37053]: pgmap v4968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:16 smithi063 ceph-mon[36747]: pgmap v4968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:17 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:55:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:17 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:55:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:17 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:55:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:18 smithi043 ceph-mon[32384]: pgmap v4969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:55:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:18 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:55:19.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:18 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:55:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:18 smithi133 ceph-mon[37053]: pgmap v4969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:55:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:18 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:55:19.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:18 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:55:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:18 smithi063 ceph-mon[36747]: pgmap v4969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:55:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:18 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:55:19.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:18 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:55:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:19 smithi043 ceph-mon[32384]: pgmap v4970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:55:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:19 smithi043 ceph-mon[32384]: pgmap v4971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:55:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:19 smithi133 ceph-mon[37053]: pgmap v4970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:55:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:19 smithi133 ceph-mon[37053]: pgmap v4971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:55:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:19 smithi063 ceph-mon[36747]: pgmap v4970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:55:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:19 smithi063 ceph-mon[36747]: pgmap v4971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:55:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8366.898867 secs 2024-07-26T10:55:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8382.381301 secs 2024-07-26T10:55:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8366.898867 secs 2024-07-26T10:55:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8382.381301 secs 2024-07-26T10:55:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8366.898867 secs 2024-07-26T10:55:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8382.381301 secs 2024-07-26T10:55:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:21 smithi043 ceph-mon[32384]: pgmap v4972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:55:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:21 smithi133 ceph-mon[37053]: pgmap v4972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:55:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:21 smithi063 ceph-mon[36747]: pgmap v4972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:55:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:23 smithi043 ceph-mon[32384]: pgmap v4973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:55:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:23 smithi133 ceph-mon[37053]: pgmap v4973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:55:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:23 smithi063 ceph-mon[36747]: pgmap v4973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:55:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:25 smithi043 ceph-mon[32384]: pgmap v4974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:55:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8371.898983 secs 2024-07-26T10:55:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8387.381377 secs 2024-07-26T10:55:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:25 smithi133 ceph-mon[37053]: pgmap v4974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:55:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8371.898983 secs 2024-07-26T10:55:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8387.381377 secs 2024-07-26T10:55:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:25 smithi063 ceph-mon[36747]: pgmap v4974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:55:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8371.898983 secs 2024-07-26T10:55:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8387.381377 secs 2024-07-26T10:55:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:27 smithi043 ceph-mon[32384]: pgmap v4975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:55:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:27 smithi133 ceph-mon[37053]: pgmap v4975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:55:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:27 smithi063 ceph-mon[36747]: pgmap v4975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:55:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:29 smithi043 ceph-mon[32384]: pgmap v4976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:55:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:29 smithi133 ceph-mon[37053]: pgmap v4976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:55:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:29 smithi063 ceph-mon[36747]: pgmap v4976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:55:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8376.899137 secs 2024-07-26T10:55:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8392.381497 secs 2024-07-26T10:55:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8376.899137 secs 2024-07-26T10:55:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8392.381497 secs 2024-07-26T10:55:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8376.899137 secs 2024-07-26T10:55:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8392.381497 secs 2024-07-26T10:55:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:31 smithi043 ceph-mon[32384]: pgmap v4977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:31 smithi133 ceph-mon[37053]: pgmap v4977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:31 smithi063 ceph-mon[36747]: pgmap v4977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:33 smithi133 ceph-mon[37053]: pgmap v4978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:33 smithi063 ceph-mon[36747]: pgmap v4978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:33 smithi043 ceph-mon[32384]: pgmap v4978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:35 smithi133 ceph-mon[37053]: pgmap v4979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8381.899252 secs 2024-07-26T10:55:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8397.381589 secs 2024-07-26T10:55:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:35 smithi063 ceph-mon[36747]: pgmap v4979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8381.899252 secs 2024-07-26T10:55:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8397.381589 secs 2024-07-26T10:55:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:35 smithi043 ceph-mon[32384]: pgmap v4979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8381.899252 secs 2024-07-26T10:55:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8397.381589 secs 2024-07-26T10:55:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:37 smithi133 ceph-mon[37053]: pgmap v4980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:37 smithi063 ceph-mon[36747]: pgmap v4980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:37 smithi043 ceph-mon[32384]: pgmap v4980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:40 smithi133 ceph-mon[37053]: pgmap v4981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:40 smithi063 ceph-mon[36747]: pgmap v4981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:40 smithi043 ceph-mon[32384]: pgmap v4981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8386.899375 secs 2024-07-26T10:55:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8402.381732 secs 2024-07-26T10:55:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8386.899375 secs 2024-07-26T10:55:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8402.381732 secs 2024-07-26T10:55:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8386.899375 secs 2024-07-26T10:55:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8402.381732 secs 2024-07-26T10:55:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:42 smithi063 ceph-mon[36747]: pgmap v4982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:42 smithi043 ceph-mon[32384]: pgmap v4982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:42 smithi133 ceph-mon[37053]: pgmap v4982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:44 smithi063 ceph-mon[36747]: pgmap v4983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:44 smithi043 ceph-mon[32384]: pgmap v4983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:44 smithi133 ceph-mon[37053]: pgmap v4983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:46 smithi063 ceph-mon[36747]: pgmap v4984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8391.899456 secs 2024-07-26T10:55:46.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8407.381890 secs 2024-07-26T10:55:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:46 smithi043 ceph-mon[32384]: pgmap v4984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8391.899456 secs 2024-07-26T10:55:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8407.381890 secs 2024-07-26T10:55:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:46 smithi133 ceph-mon[37053]: pgmap v4984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8391.899456 secs 2024-07-26T10:55:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8407.381890 secs 2024-07-26T10:55:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:48 smithi063 ceph-mon[36747]: pgmap v4985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:48 smithi043 ceph-mon[32384]: pgmap v4985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:48 smithi133 ceph-mon[37053]: pgmap v4985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:50 smithi063 ceph-mon[36747]: pgmap v4986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:50 smithi043 ceph-mon[32384]: pgmap v4986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:50 smithi133 ceph-mon[37053]: pgmap v4986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8396.899580 secs 2024-07-26T10:55:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8412.382012 secs 2024-07-26T10:55:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8396.899580 secs 2024-07-26T10:55:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8412.382012 secs 2024-07-26T10:55:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8396.899580 secs 2024-07-26T10:55:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8412.382012 secs 2024-07-26T10:55:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:52 smithi063 ceph-mon[36747]: pgmap v4987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:52 smithi043 ceph-mon[32384]: pgmap v4987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:52 smithi133 ceph-mon[37053]: pgmap v4987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:54 smithi063 ceph-mon[36747]: pgmap v4988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:54 smithi043 ceph-mon[32384]: pgmap v4988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:54 smithi133 ceph-mon[37053]: pgmap v4988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:55:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:56 smithi043 ceph-mon[32384]: pgmap v4989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8401.899696 secs 2024-07-26T10:55:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8417.382163 secs 2024-07-26T10:55:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:56 smithi133 ceph-mon[37053]: pgmap v4989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8401.899696 secs 2024-07-26T10:55:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8417.382163 secs 2024-07-26T10:55:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:56 smithi063 ceph-mon[36747]: pgmap v4989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:55:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8401.899696 secs 2024-07-26T10:55:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8417.382163 secs 2024-07-26T10:55:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:55:58 smithi043 ceph-mon[32384]: pgmap v4990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:55:58 smithi133 ceph-mon[37053]: pgmap v4990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:55:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:55:58 smithi063 ceph-mon[36747]: pgmap v4990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:00 smithi043 ceph-mon[32384]: pgmap v4991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:00 smithi133 ceph-mon[37053]: pgmap v4991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:00 smithi063 ceph-mon[36747]: pgmap v4991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:01.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8406.899815 secs 2024-07-26T10:56:01.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8422.382276 secs 2024-07-26T10:56:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8406.899815 secs 2024-07-26T10:56:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8422.382276 secs 2024-07-26T10:56:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8406.899815 secs 2024-07-26T10:56:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8422.382276 secs 2024-07-26T10:56:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:02 smithi043 ceph-mon[32384]: pgmap v4992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:02 smithi133 ceph-mon[37053]: pgmap v4992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:02 smithi063 ceph-mon[36747]: pgmap v4992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:04 smithi043 ceph-mon[32384]: pgmap v4993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:04 smithi133 ceph-mon[37053]: pgmap v4993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:04 smithi063 ceph-mon[36747]: pgmap v4993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:06 smithi043 ceph-mon[32384]: pgmap v4994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8411.899942 secs 2024-07-26T10:56:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8427.382395 secs 2024-07-26T10:56:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:06 smithi133 ceph-mon[37053]: pgmap v4994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8411.899942 secs 2024-07-26T10:56:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8427.382395 secs 2024-07-26T10:56:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:06 smithi063 ceph-mon[36747]: pgmap v4994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8411.899942 secs 2024-07-26T10:56:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8427.382395 secs 2024-07-26T10:56:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:08 smithi043 ceph-mon[32384]: pgmap v4995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:08 smithi133 ceph-mon[37053]: pgmap v4995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:08 smithi063 ceph-mon[36747]: pgmap v4995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:10 smithi043 ceph-mon[32384]: pgmap v4996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:10 smithi133 ceph-mon[37053]: pgmap v4996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:10 smithi063 ceph-mon[36747]: pgmap v4996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:11.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8416.900086 secs 2024-07-26T10:56:11.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8432.382522 secs 2024-07-26T10:56:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8416.900086 secs 2024-07-26T10:56:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8432.382522 secs 2024-07-26T10:56:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8416.900086 secs 2024-07-26T10:56:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8432.382522 secs 2024-07-26T10:56:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:12 smithi043 ceph-mon[32384]: pgmap v4997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:12 smithi133 ceph-mon[37053]: pgmap v4997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:12 smithi063 ceph-mon[36747]: pgmap v4997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:14 smithi043 ceph-mon[32384]: pgmap v4998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:14 smithi133 ceph-mon[37053]: pgmap v4998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:14 smithi063 ceph-mon[36747]: pgmap v4998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:16 smithi043 ceph-mon[32384]: pgmap v4999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8421.900127 secs 2024-07-26T10:56:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8437.382639 secs 2024-07-26T10:56:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:16 smithi133 ceph-mon[37053]: pgmap v4999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8421.900127 secs 2024-07-26T10:56:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8437.382639 secs 2024-07-26T10:56:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:16 smithi063 ceph-mon[36747]: pgmap v4999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8421.900127 secs 2024-07-26T10:56:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8437.382639 secs 2024-07-26T10:56:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:18 smithi043 ceph-mon[32384]: pgmap v5000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:18 smithi133 ceph-mon[37053]: pgmap v5000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:18 smithi063 ceph-mon[36747]: pgmap v5000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:56:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:56:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:56:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:20 smithi043 ceph-mon[32384]: pgmap v5001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:20 smithi133 ceph-mon[37053]: pgmap v5001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:20 smithi063 ceph-mon[36747]: pgmap v5001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:56:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:56:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: pgmap v5002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:56:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: pgmap v5003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:56:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:56:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8426.900200 secs 2024-07-26T10:56:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8442.382763 secs 2024-07-26T10:56:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:56:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:56:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: pgmap v5002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:56:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: pgmap v5003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:56:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:56:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8426.900200 secs 2024-07-26T10:56:21.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8442.382763 secs 2024-07-26T10:56:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:56:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:56:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: pgmap v5002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T10:56:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: pgmap v5003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:56:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:56:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8426.900200 secs 2024-07-26T10:56:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8442.382763 secs 2024-07-26T10:56:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:23 smithi133 ceph-mon[37053]: pgmap v5004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:56:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:23 smithi063 ceph-mon[36747]: pgmap v5004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:56:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:23 smithi043 ceph-mon[32384]: pgmap v5004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:56:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:24 smithi043 ceph-mon[32384]: pgmap v5005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:56:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:24 smithi133 ceph-mon[37053]: pgmap v5005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:56:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:24 smithi063 ceph-mon[36747]: pgmap v5005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:56:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8431.900346 secs 2024-07-26T10:56:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8447.382885 secs 2024-07-26T10:56:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8431.900346 secs 2024-07-26T10:56:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8447.382885 secs 2024-07-26T10:56:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8431.900346 secs 2024-07-26T10:56:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8447.382885 secs 2024-07-26T10:56:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:26 smithi043 ceph-mon[32384]: pgmap v5006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:56:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:26 smithi133 ceph-mon[37053]: pgmap v5006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:56:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:26 smithi063 ceph-mon[36747]: pgmap v5006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:56:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:29 smithi133 ceph-mon[37053]: pgmap v5007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:56:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:29 smithi063 ceph-mon[36747]: pgmap v5007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:56:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:29 smithi043 ceph-mon[32384]: pgmap v5007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:56:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:31 smithi133 ceph-mon[37053]: pgmap v5008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:56:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8436.900469 secs 2024-07-26T10:56:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8452.382947 secs 2024-07-26T10:56:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:31 smithi063 ceph-mon[36747]: pgmap v5008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:56:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8436.900469 secs 2024-07-26T10:56:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8452.382947 secs 2024-07-26T10:56:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:31 smithi043 ceph-mon[32384]: pgmap v5008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:56:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8436.900469 secs 2024-07-26T10:56:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8452.382947 secs 2024-07-26T10:56:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:33 smithi133 ceph-mon[37053]: pgmap v5009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:33 smithi063 ceph-mon[36747]: pgmap v5009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:33 smithi043 ceph-mon[32384]: pgmap v5009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:35 smithi063 ceph-mon[36747]: pgmap v5010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:35 smithi043 ceph-mon[32384]: pgmap v5010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:35 smithi133 ceph-mon[37053]: pgmap v5010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8441.900582 secs 2024-07-26T10:56:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8457.383071 secs 2024-07-26T10:56:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8441.900582 secs 2024-07-26T10:56:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8457.383071 secs 2024-07-26T10:56:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8441.900582 secs 2024-07-26T10:56:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8457.383071 secs 2024-07-26T10:56:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:37 smithi063 ceph-mon[36747]: pgmap v5011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:37 smithi043 ceph-mon[32384]: pgmap v5011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:37 smithi133 ceph-mon[37053]: pgmap v5011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:39 smithi063 ceph-mon[36747]: pgmap v5012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:39 smithi043 ceph-mon[32384]: pgmap v5012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:39 smithi133 ceph-mon[37053]: pgmap v5012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:41 smithi063 ceph-mon[36747]: pgmap v5013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8446.900679 secs 2024-07-26T10:56:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8462.383194 secs 2024-07-26T10:56:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:41 smithi043 ceph-mon[32384]: pgmap v5013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8446.900679 secs 2024-07-26T10:56:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8462.383194 secs 2024-07-26T10:56:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:41 smithi133 ceph-mon[37053]: pgmap v5013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8446.900679 secs 2024-07-26T10:56:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8462.383194 secs 2024-07-26T10:56:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:43 smithi063 ceph-mon[36747]: pgmap v5014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:43 smithi043 ceph-mon[32384]: pgmap v5014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:43 smithi133 ceph-mon[37053]: pgmap v5014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:45 smithi063 ceph-mon[36747]: pgmap v5015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:45 smithi043 ceph-mon[32384]: pgmap v5015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:45 smithi133 ceph-mon[37053]: pgmap v5015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8451.900804 secs 2024-07-26T10:56:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8467.383306 secs 2024-07-26T10:56:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8451.900804 secs 2024-07-26T10:56:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8467.383306 secs 2024-07-26T10:56:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8451.900804 secs 2024-07-26T10:56:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8467.383306 secs 2024-07-26T10:56:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:47 smithi063 ceph-mon[36747]: pgmap v5016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:47 smithi043 ceph-mon[32384]: pgmap v5016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:47 smithi133 ceph-mon[37053]: pgmap v5016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:49 smithi043 ceph-mon[32384]: pgmap v5017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:49 smithi133 ceph-mon[37053]: pgmap v5017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:49 smithi063 ceph-mon[36747]: pgmap v5017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:51 smithi043 ceph-mon[32384]: pgmap v5018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8456.900915 secs 2024-07-26T10:56:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8472.383426 secs 2024-07-26T10:56:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:51 smithi133 ceph-mon[37053]: pgmap v5018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8456.900915 secs 2024-07-26T10:56:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8472.383426 secs 2024-07-26T10:56:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:51 smithi063 ceph-mon[36747]: pgmap v5018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:56:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8456.900915 secs 2024-07-26T10:56:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8472.383426 secs 2024-07-26T10:56:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:53 smithi043 ceph-mon[32384]: pgmap v5019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:53 smithi133 ceph-mon[37053]: pgmap v5019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:53 smithi063 ceph-mon[36747]: pgmap v5019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:55 smithi043 ceph-mon[32384]: pgmap v5020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:55 smithi133 ceph-mon[37053]: pgmap v5020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:55 smithi063 ceph-mon[36747]: pgmap v5020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8461.901034 secs 2024-07-26T10:56:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8477.383545 secs 2024-07-26T10:56:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8461.901034 secs 2024-07-26T10:56:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8477.383545 secs 2024-07-26T10:56:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8461.901034 secs 2024-07-26T10:56:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8477.383545 secs 2024-07-26T10:56:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:57 smithi043 ceph-mon[32384]: pgmap v5021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:57 smithi133 ceph-mon[37053]: pgmap v5021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:57 smithi063 ceph-mon[36747]: pgmap v5021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:56:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:56:58 smithi043 ceph-mon[32384]: pgmap v5022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:56:58 smithi133 ceph-mon[37053]: pgmap v5022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:56:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:56:58 smithi063 ceph-mon[36747]: pgmap v5022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:01 smithi133 ceph-mon[37053]: pgmap v5023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8466.901133 secs 2024-07-26T10:57:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8482.383645 secs 2024-07-26T10:57:01.521 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:01 smithi063 ceph-mon[36747]: pgmap v5023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:01.521 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8466.901133 secs 2024-07-26T10:57:01.521 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8482.383645 secs 2024-07-26T10:57:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:01 smithi043 ceph-mon[32384]: pgmap v5023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8466.901133 secs 2024-07-26T10:57:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8482.383645 secs 2024-07-26T10:57:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:03 smithi133 ceph-mon[37053]: pgmap v5024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:03 smithi063 ceph-mon[36747]: pgmap v5024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:03 smithi043 ceph-mon[32384]: pgmap v5024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:05 smithi063 ceph-mon[36747]: pgmap v5025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:05 smithi043 ceph-mon[32384]: pgmap v5025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:05 smithi133 ceph-mon[37053]: pgmap v5025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8471.901258 secs 2024-07-26T10:57:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8487.383773 secs 2024-07-26T10:57:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8471.901258 secs 2024-07-26T10:57:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8487.383773 secs 2024-07-26T10:57:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8471.901258 secs 2024-07-26T10:57:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8487.383773 secs 2024-07-26T10:57:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:07 smithi063 ceph-mon[36747]: pgmap v5026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:07 smithi043 ceph-mon[32384]: pgmap v5026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:07 smithi133 ceph-mon[37053]: pgmap v5026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:09 smithi063 ceph-mon[36747]: pgmap v5027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:09 smithi043 ceph-mon[32384]: pgmap v5027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:09 smithi133 ceph-mon[37053]: pgmap v5027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:11 smithi063 ceph-mon[36747]: pgmap v5028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8476.901378 secs 2024-07-26T10:57:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8492.383893 secs 2024-07-26T10:57:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:11 smithi043 ceph-mon[32384]: pgmap v5028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8476.901378 secs 2024-07-26T10:57:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8492.383893 secs 2024-07-26T10:57:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:11 smithi133 ceph-mon[37053]: pgmap v5028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8476.901378 secs 2024-07-26T10:57:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8492.383893 secs 2024-07-26T10:57:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:13 smithi063 ceph-mon[36747]: pgmap v5029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:13 smithi043 ceph-mon[32384]: pgmap v5029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:13 smithi133 ceph-mon[37053]: pgmap v5029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:15 smithi063 ceph-mon[36747]: pgmap v5030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:15 smithi043 ceph-mon[32384]: pgmap v5030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:15 smithi133 ceph-mon[37053]: pgmap v5030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8481.901489 secs 2024-07-26T10:57:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8497.384016 secs 2024-07-26T10:57:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8481.901489 secs 2024-07-26T10:57:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8497.384016 secs 2024-07-26T10:57:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8481.901489 secs 2024-07-26T10:57:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8497.384016 secs 2024-07-26T10:57:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:17 smithi043 ceph-mon[32384]: pgmap v5031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:17 smithi133 ceph-mon[37053]: pgmap v5031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:17 smithi063 ceph-mon[36747]: pgmap v5031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:19 smithi043 ceph-mon[32384]: pgmap v5032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:19 smithi133 ceph-mon[37053]: pgmap v5032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:19 smithi063 ceph-mon[36747]: pgmap v5032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:21 smithi043 ceph-mon[32384]: pgmap v5033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8486.901623 secs 2024-07-26T10:57:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:57:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8502.384104 secs 2024-07-26T10:57:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:21 smithi133 ceph-mon[37053]: pgmap v5033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8486.901623 secs 2024-07-26T10:57:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:57:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8502.384104 secs 2024-07-26T10:57:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:21 smithi063 ceph-mon[36747]: pgmap v5033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8486.901623 secs 2024-07-26T10:57:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:57:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8502.384104 secs 2024-07-26T10:57:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:57:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:57:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:22 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:57:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:57:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:57:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:22 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:57:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:57:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:57:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:22 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:57:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:23 smithi043 ceph-mon[32384]: pgmap v5034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:57:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:23 smithi043 ceph-mon[32384]: pgmap v5035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:57:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:23 smithi133 ceph-mon[37053]: pgmap v5034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:57:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:23 smithi133 ceph-mon[37053]: pgmap v5035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:57:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:23 smithi063 ceph-mon[36747]: pgmap v5034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:57:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:23 smithi063 ceph-mon[36747]: pgmap v5035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:57:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:24 smithi043 ceph-mon[32384]: pgmap v5036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:24 smithi133 ceph-mon[37053]: pgmap v5036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:24 smithi063 ceph-mon[36747]: pgmap v5036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8491.901724 secs 2024-07-26T10:57:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8491.901724 secs 2024-07-26T10:57:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8491.901724 secs 2024-07-26T10:57:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:26 smithi043 ceph-mon[32384]: pgmap v5037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8507.384227 secs 2024-07-26T10:57:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:26 smithi133 ceph-mon[37053]: pgmap v5037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8507.384227 secs 2024-07-26T10:57:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:26 smithi063 ceph-mon[36747]: pgmap v5037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8507.384227 secs 2024-07-26T10:57:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:28 smithi063 ceph-mon[36747]: pgmap v5038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:28 smithi043 ceph-mon[32384]: pgmap v5038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:28 smithi133 ceph-mon[37053]: pgmap v5038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:30 smithi063 ceph-mon[36747]: pgmap v5039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:30.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8496.901846 secs 2024-07-26T10:57:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:30 smithi043 ceph-mon[32384]: pgmap v5039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8496.901846 secs 2024-07-26T10:57:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:30 smithi133 ceph-mon[37053]: pgmap v5039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:57:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8496.901846 secs 2024-07-26T10:57:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8512.384350 secs 2024-07-26T10:57:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8512.384350 secs 2024-07-26T10:57:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8512.384350 secs 2024-07-26T10:57:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:32 smithi063 ceph-mon[36747]: pgmap v5040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:57:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:32 smithi043 ceph-mon[32384]: pgmap v5040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:57:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:32 smithi133 ceph-mon[37053]: pgmap v5040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:57:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:34 smithi063 ceph-mon[36747]: pgmap v5041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:34 smithi043 ceph-mon[32384]: pgmap v5041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:34 smithi133 ceph-mon[37053]: pgmap v5041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8501.901964 secs 2024-07-26T10:57:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8501.901964 secs 2024-07-26T10:57:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8501.901964 secs 2024-07-26T10:57:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:36 smithi063 ceph-mon[36747]: pgmap v5042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8517.384488 secs 2024-07-26T10:57:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:36 smithi043 ceph-mon[32384]: pgmap v5042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8517.384488 secs 2024-07-26T10:57:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:36 smithi133 ceph-mon[37053]: pgmap v5042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8517.384488 secs 2024-07-26T10:57:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:38 smithi063 ceph-mon[36747]: pgmap v5043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T10:57:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:38 smithi043 ceph-mon[32384]: pgmap v5043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T10:57:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:38 smithi133 ceph-mon[37053]: pgmap v5043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T10:57:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:40 smithi043 ceph-mon[32384]: pgmap v5044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8506.902042 secs 2024-07-26T10:57:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:40 smithi133 ceph-mon[37053]: pgmap v5044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8506.902042 secs 2024-07-26T10:57:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:40 smithi063 ceph-mon[36747]: pgmap v5044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8506.902042 secs 2024-07-26T10:57:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8522.384628 secs 2024-07-26T10:57:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8522.384628 secs 2024-07-26T10:57:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8522.384628 secs 2024-07-26T10:57:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:42 smithi043 ceph-mon[32384]: pgmap v5045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:57:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:42 smithi133 ceph-mon[37053]: pgmap v5045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:57:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:42 smithi063 ceph-mon[36747]: pgmap v5045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:57:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:44 smithi043 ceph-mon[32384]: pgmap v5046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:57:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:44 smithi133 ceph-mon[37053]: pgmap v5046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:57:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:44 smithi063 ceph-mon[36747]: pgmap v5046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T10:57:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8511.902194 secs 2024-07-26T10:57:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8511.902194 secs 2024-07-26T10:57:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8511.902194 secs 2024-07-26T10:57:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:46 smithi043 ceph-mon[32384]: pgmap v5047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8527.384693 secs 2024-07-26T10:57:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:46 smithi133 ceph-mon[37053]: pgmap v5047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8527.384693 secs 2024-07-26T10:57:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:46 smithi063 ceph-mon[36747]: pgmap v5047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:57:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8527.384693 secs 2024-07-26T10:57:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:48 smithi043 ceph-mon[32384]: pgmap v5048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T10:57:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:48 smithi133 ceph-mon[37053]: pgmap v5048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T10:57:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:48 smithi063 ceph-mon[36747]: pgmap v5048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T10:57:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:50 smithi043 ceph-mon[32384]: pgmap v5049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8516.902315 secs 2024-07-26T10:57:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:50 smithi133 ceph-mon[37053]: pgmap v5049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8516.902315 secs 2024-07-26T10:57:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:50 smithi063 ceph-mon[36747]: pgmap v5049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8516.902315 secs 2024-07-26T10:57:51.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8532.384815 secs 2024-07-26T10:57:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8532.384815 secs 2024-07-26T10:57:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8532.384815 secs 2024-07-26T10:57:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:52 smithi043 ceph-mon[32384]: pgmap v5050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:52 smithi133 ceph-mon[37053]: pgmap v5050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:52 smithi063 ceph-mon[36747]: pgmap v5050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:57:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:54 smithi043 ceph-mon[32384]: pgmap v5051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:54 smithi133 ceph-mon[37053]: pgmap v5051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:54 smithi063 ceph-mon[36747]: pgmap v5051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:57:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8521.902428 secs 2024-07-26T10:57:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8521.902428 secs 2024-07-26T10:57:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8521.902428 secs 2024-07-26T10:57:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:56 smithi043 ceph-mon[32384]: pgmap v5052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8537.384936 secs 2024-07-26T10:57:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:56 smithi133 ceph-mon[37053]: pgmap v5052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8537.384936 secs 2024-07-26T10:57:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:56 smithi063 ceph-mon[36747]: pgmap v5052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:57:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8537.384936 secs 2024-07-26T10:57:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:57:58 smithi043 ceph-mon[32384]: pgmap v5053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:57:59.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:57:58 smithi133 ceph-mon[37053]: pgmap v5053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:57:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:57:58 smithi063 ceph-mon[36747]: pgmap v5053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:00 smithi043 ceph-mon[32384]: pgmap v5054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8526.902552 secs 2024-07-26T10:58:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:00 smithi133 ceph-mon[37053]: pgmap v5054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8526.902552 secs 2024-07-26T10:58:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:00 smithi063 ceph-mon[36747]: pgmap v5054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8526.902552 secs 2024-07-26T10:58:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8542.385077 secs 2024-07-26T10:58:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8542.385077 secs 2024-07-26T10:58:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8542.385077 secs 2024-07-26T10:58:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:02 smithi043 ceph-mon[32384]: pgmap v5055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:02 smithi133 ceph-mon[37053]: pgmap v5055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:02 smithi063 ceph-mon[36747]: pgmap v5055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:04 smithi043 ceph-mon[32384]: pgmap v5056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:04 smithi133 ceph-mon[37053]: pgmap v5056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:04 smithi063 ceph-mon[36747]: pgmap v5056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8531.902673 secs 2024-07-26T10:58:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8531.902673 secs 2024-07-26T10:58:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8531.902673 secs 2024-07-26T10:58:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:06 smithi043 ceph-mon[32384]: pgmap v5057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8547.385160 secs 2024-07-26T10:58:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:06 smithi133 ceph-mon[37053]: pgmap v5057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8547.385160 secs 2024-07-26T10:58:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:06 smithi063 ceph-mon[36747]: pgmap v5057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8547.385160 secs 2024-07-26T10:58:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:08 smithi043 ceph-mon[32384]: pgmap v5058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:08 smithi133 ceph-mon[37053]: pgmap v5058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:08 smithi063 ceph-mon[36747]: pgmap v5058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:10 smithi043 ceph-mon[32384]: pgmap v5059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8536.902830 secs 2024-07-26T10:58:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:10 smithi133 ceph-mon[37053]: pgmap v5059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8536.902830 secs 2024-07-26T10:58:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:10 smithi063 ceph-mon[36747]: pgmap v5059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8536.902830 secs 2024-07-26T10:58:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8552.385302 secs 2024-07-26T10:58:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8552.385302 secs 2024-07-26T10:58:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8552.385302 secs 2024-07-26T10:58:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:12 smithi043 ceph-mon[32384]: pgmap v5060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:12 smithi133 ceph-mon[37053]: pgmap v5060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:12 smithi063 ceph-mon[36747]: pgmap v5060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:14 smithi133 ceph-mon[37053]: pgmap v5061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:14 smithi063 ceph-mon[36747]: pgmap v5061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:14 smithi043 ceph-mon[32384]: pgmap v5061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8541.902967 secs 2024-07-26T10:58:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8541.902967 secs 2024-07-26T10:58:16.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8541.902967 secs 2024-07-26T10:58:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:16 smithi133 ceph-mon[37053]: pgmap v5062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8557.385442 secs 2024-07-26T10:58:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:16 smithi063 ceph-mon[36747]: pgmap v5062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8557.385442 secs 2024-07-26T10:58:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:16 smithi043 ceph-mon[32384]: pgmap v5062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8557.385442 secs 2024-07-26T10:58:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:18 smithi133 ceph-mon[37053]: pgmap v5063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:18 smithi063 ceph-mon[36747]: pgmap v5063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:18 smithi043 ceph-mon[32384]: pgmap v5063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T10:58:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:20 smithi133 ceph-mon[37053]: pgmap v5064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8546.903062 secs 2024-07-26T10:58:21.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:20 smithi043 ceph-mon[32384]: pgmap v5064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:21.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8546.903062 secs 2024-07-26T10:58:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:20 smithi063 ceph-mon[36747]: pgmap v5064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8546.903062 secs 2024-07-26T10:58:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8562.385561 secs 2024-07-26T10:58:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:21 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:58:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8562.385561 secs 2024-07-26T10:58:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:21 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:58:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8562.385561 secs 2024-07-26T10:58:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:21 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:58:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:22 smithi063 ceph-mon[36747]: pgmap v5065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:58:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:58:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:22 smithi043 ceph-mon[32384]: pgmap v5065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:58:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:58:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:22 smithi133 ceph-mon[37053]: pgmap v5065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:58:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:58:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:23 smithi063 ceph-mon[36747]: pgmap v5066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:23 smithi063 ceph-mon[36747]: pgmap v5067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:58:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:23 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:58:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:23 smithi043 ceph-mon[32384]: pgmap v5066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:23 smithi043 ceph-mon[32384]: pgmap v5067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:58:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:23 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:58:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:23 smithi133 ceph-mon[37053]: pgmap v5066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:23 smithi133 ceph-mon[37053]: pgmap v5067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:58:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:23 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:58:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:25 smithi063 ceph-mon[36747]: pgmap v5068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8551.903193 secs 2024-07-26T10:58:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8567.385676 secs 2024-07-26T10:58:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:25 smithi043 ceph-mon[32384]: pgmap v5068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8551.903193 secs 2024-07-26T10:58:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8567.385676 secs 2024-07-26T10:58:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:25 smithi133 ceph-mon[37053]: pgmap v5068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8551.903193 secs 2024-07-26T10:58:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8567.385676 secs 2024-07-26T10:58:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:27 smithi063 ceph-mon[36747]: pgmap v5069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:58:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:27 smithi043 ceph-mon[32384]: pgmap v5069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:58:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:27 smithi133 ceph-mon[37053]: pgmap v5069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:58:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:29 smithi063 ceph-mon[36747]: pgmap v5070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:29 smithi043 ceph-mon[32384]: pgmap v5070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:29 smithi133 ceph-mon[37053]: pgmap v5070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8556.903315 secs 2024-07-26T10:58:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8572.385797 secs 2024-07-26T10:58:31.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8556.903315 secs 2024-07-26T10:58:31.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8572.385797 secs 2024-07-26T10:58:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8556.903315 secs 2024-07-26T10:58:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8572.385797 secs 2024-07-26T10:58:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:31 smithi043 ceph-mon[32384]: pgmap v5071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:31 smithi133 ceph-mon[37053]: pgmap v5071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:31 smithi063 ceph-mon[36747]: pgmap v5071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:58:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:33 smithi043 ceph-mon[32384]: pgmap v5072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:58:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:33 smithi133 ceph-mon[37053]: pgmap v5072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:58:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:33 smithi063 ceph-mon[36747]: pgmap v5072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:58:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:35 smithi043 ceph-mon[32384]: pgmap v5073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8561.903433 secs 2024-07-26T10:58:36.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:35 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8577.385951 secs 2024-07-26T10:58:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:35 smithi133 ceph-mon[37053]: pgmap v5073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8561.903433 secs 2024-07-26T10:58:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:35 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8577.385951 secs 2024-07-26T10:58:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:35 smithi063 ceph-mon[36747]: pgmap v5073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8561.903433 secs 2024-07-26T10:58:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:35 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8577.385951 secs 2024-07-26T10:58:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:37 smithi043 ceph-mon[32384]: pgmap v5074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:37 smithi133 ceph-mon[37053]: pgmap v5074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:37 smithi063 ceph-mon[36747]: pgmap v5074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:39 smithi043 ceph-mon[32384]: pgmap v5075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:39 smithi133 ceph-mon[37053]: pgmap v5075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:39 smithi063 ceph-mon[36747]: pgmap v5075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8566.903554 secs 2024-07-26T10:58:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8582.386098 secs 2024-07-26T10:58:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8566.903554 secs 2024-07-26T10:58:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8582.386098 secs 2024-07-26T10:58:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8566.903554 secs 2024-07-26T10:58:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8582.386098 secs 2024-07-26T10:58:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:41 smithi043 ceph-mon[32384]: pgmap v5076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:41 smithi133 ceph-mon[37053]: pgmap v5076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:41 smithi063 ceph-mon[36747]: pgmap v5076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:43 smithi043 ceph-mon[32384]: pgmap v5077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:43 smithi133 ceph-mon[37053]: pgmap v5077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:43 smithi063 ceph-mon[36747]: pgmap v5077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:45 smithi043 ceph-mon[32384]: pgmap v5078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8571.903673 secs 2024-07-26T10:58:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8587.386195 secs 2024-07-26T10:58:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:45 smithi133 ceph-mon[37053]: pgmap v5078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8571.903673 secs 2024-07-26T10:58:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8587.386195 secs 2024-07-26T10:58:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:45 smithi063 ceph-mon[36747]: pgmap v5078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8571.903673 secs 2024-07-26T10:58:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8587.386195 secs 2024-07-26T10:58:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:47 smithi043 ceph-mon[32384]: pgmap v5079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:47 smithi133 ceph-mon[37053]: pgmap v5079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:47 smithi063 ceph-mon[36747]: pgmap v5079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:49 smithi043 ceph-mon[32384]: pgmap v5080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:49 smithi133 ceph-mon[37053]: pgmap v5080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:49 smithi063 ceph-mon[36747]: pgmap v5080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8576.903793 secs 2024-07-26T10:58:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8592.386320 secs 2024-07-26T10:58:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8576.903793 secs 2024-07-26T10:58:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8592.386320 secs 2024-07-26T10:58:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8576.903793 secs 2024-07-26T10:58:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8592.386320 secs 2024-07-26T10:58:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:51 smithi043 ceph-mon[32384]: pgmap v5081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:51 smithi133 ceph-mon[37053]: pgmap v5081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:51 smithi063 ceph-mon[36747]: pgmap v5081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:53 smithi043 ceph-mon[32384]: pgmap v5082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:53 smithi133 ceph-mon[37053]: pgmap v5082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:53 smithi063 ceph-mon[36747]: pgmap v5082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:58:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:55 smithi043 ceph-mon[32384]: pgmap v5083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8581.903909 secs 2024-07-26T10:58:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8597.386443 secs 2024-07-26T10:58:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:55 smithi133 ceph-mon[37053]: pgmap v5083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8581.903909 secs 2024-07-26T10:58:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8597.386443 secs 2024-07-26T10:58:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:55 smithi063 ceph-mon[36747]: pgmap v5083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:58:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8581.903909 secs 2024-07-26T10:58:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8597.386443 secs 2024-07-26T10:58:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:57 smithi043 ceph-mon[32384]: pgmap v5084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:57 smithi133 ceph-mon[37053]: pgmap v5084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:58:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:57 smithi063 ceph-mon[36747]: pgmap v5084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:58:59 smithi043 ceph-mon[32384]: pgmap v5085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:58:59 smithi133 ceph-mon[37053]: pgmap v5085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:58:59 smithi063 ceph-mon[36747]: pgmap v5085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:01.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8586.904036 secs 2024-07-26T10:59:01.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8602.386535 secs 2024-07-26T10:59:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8586.904036 secs 2024-07-26T10:59:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8602.386535 secs 2024-07-26T10:59:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8586.904036 secs 2024-07-26T10:59:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8602.386535 secs 2024-07-26T10:59:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:01 smithi043 ceph-mon[32384]: pgmap v5086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:01 smithi133 ceph-mon[37053]: pgmap v5086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:01 smithi063 ceph-mon[36747]: pgmap v5086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:03 smithi043 ceph-mon[32384]: pgmap v5087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:03 smithi133 ceph-mon[37053]: pgmap v5087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:03 smithi063 ceph-mon[36747]: pgmap v5087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:05 smithi043 ceph-mon[32384]: pgmap v5088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8591.904160 secs 2024-07-26T10:59:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8607.386645 secs 2024-07-26T10:59:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:05 smithi133 ceph-mon[37053]: pgmap v5088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8591.904160 secs 2024-07-26T10:59:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8607.386645 secs 2024-07-26T10:59:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:05 smithi063 ceph-mon[36747]: pgmap v5088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8591.904160 secs 2024-07-26T10:59:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8607.386645 secs 2024-07-26T10:59:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:07 smithi043 ceph-mon[32384]: pgmap v5089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:07 smithi133 ceph-mon[37053]: pgmap v5089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:07 smithi063 ceph-mon[36747]: pgmap v5089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:09 smithi043 ceph-mon[32384]: pgmap v5090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:09 smithi133 ceph-mon[37053]: pgmap v5090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:09 smithi063 ceph-mon[36747]: pgmap v5090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8596.904285 secs 2024-07-26T10:59:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:10 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8612.386782 secs 2024-07-26T10:59:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8596.904285 secs 2024-07-26T10:59:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:10 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8612.386782 secs 2024-07-26T10:59:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8596.904285 secs 2024-07-26T10:59:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:10 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8612.386782 secs 2024-07-26T10:59:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:11 smithi043 ceph-mon[32384]: pgmap v5091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:11 smithi133 ceph-mon[37053]: pgmap v5091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:11 smithi063 ceph-mon[36747]: pgmap v5091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:13 smithi043 ceph-mon[32384]: pgmap v5092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:13 smithi133 ceph-mon[37053]: pgmap v5092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:13 smithi063 ceph-mon[36747]: pgmap v5092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:15 smithi133 ceph-mon[37053]: pgmap v5093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8601.904406 secs 2024-07-26T10:59:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:15 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8617.386907 secs 2024-07-26T10:59:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:15 smithi063 ceph-mon[36747]: pgmap v5093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8601.904406 secs 2024-07-26T10:59:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:15 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8617.386907 secs 2024-07-26T10:59:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:15 smithi043 ceph-mon[32384]: pgmap v5093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8601.904406 secs 2024-07-26T10:59:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:15 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8617.386907 secs 2024-07-26T10:59:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:17 smithi043 ceph-mon[32384]: pgmap v5094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:17 smithi133 ceph-mon[37053]: pgmap v5094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:17 smithi063 ceph-mon[36747]: pgmap v5094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:19 smithi133 ceph-mon[37053]: pgmap v5095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:19 smithi063 ceph-mon[36747]: pgmap v5095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:19 smithi043 ceph-mon[32384]: pgmap v5095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8606.904495 secs 2024-07-26T10:59:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8622.387035 secs 2024-07-26T10:59:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8606.904495 secs 2024-07-26T10:59:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8622.387035 secs 2024-07-26T10:59:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8606.904495 secs 2024-07-26T10:59:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8622.387035 secs 2024-07-26T10:59:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:22 smithi133 ceph-mon[37053]: pgmap v5096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:22 smithi063 ceph-mon[36747]: pgmap v5096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:22 smithi043 ceph-mon[32384]: pgmap v5096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:59:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:59:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T10:59:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:24 smithi063 ceph-mon[36747]: pgmap v5097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:59:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:59:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:59:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:24 smithi043 ceph-mon[32384]: pgmap v5097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:59:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:59:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:59:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:24 smithi133 ceph-mon[37053]: pgmap v5097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T10:59:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T10:59:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T10:59:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:25 smithi063 ceph-mon[36747]: pgmap v5098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:59:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:25 smithi063 ceph-mon[36747]: pgmap v5099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:59:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:25 smithi043 ceph-mon[32384]: pgmap v5098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:59:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:25 smithi043 ceph-mon[32384]: pgmap v5099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:59:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:25 smithi133 ceph-mon[37053]: pgmap v5098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T10:59:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:25 smithi133 ceph-mon[37053]: pgmap v5099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:59:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8611.904616 secs 2024-07-26T10:59:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8627.387162 secs 2024-07-26T10:59:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8611.904616 secs 2024-07-26T10:59:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8627.387162 secs 2024-07-26T10:59:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8611.904616 secs 2024-07-26T10:59:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8627.387162 secs 2024-07-26T10:59:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:27 smithi063 ceph-mon[36747]: pgmap v5100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:59:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:27 smithi043 ceph-mon[32384]: pgmap v5100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:59:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:27 smithi133 ceph-mon[37053]: pgmap v5100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T10:59:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:29 smithi063 ceph-mon[36747]: pgmap v5101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:59:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:29 smithi043 ceph-mon[32384]: pgmap v5101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:59:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:29 smithi133 ceph-mon[37053]: pgmap v5101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T10:59:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:31 smithi063 ceph-mon[36747]: pgmap v5102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:59:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8616.904755 secs 2024-07-26T10:59:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8632.387284 secs 2024-07-26T10:59:31.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:31 smithi133 ceph-mon[37053]: pgmap v5102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:59:31.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8616.904755 secs 2024-07-26T10:59:31.319 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8632.387284 secs 2024-07-26T10:59:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:31 smithi043 ceph-mon[32384]: pgmap v5102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:59:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8616.904755 secs 2024-07-26T10:59:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8632.387284 secs 2024-07-26T10:59:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:33 smithi043 ceph-mon[32384]: pgmap v5103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:59:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:33 smithi133 ceph-mon[37053]: pgmap v5103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:59:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:33 smithi063 ceph-mon[36747]: pgmap v5103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T10:59:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:35 smithi043 ceph-mon[32384]: pgmap v5104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:59:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:35 smithi133 ceph-mon[37053]: pgmap v5104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:59:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:35 smithi063 ceph-mon[36747]: pgmap v5104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T10:59:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8621.904816 secs 2024-07-26T10:59:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8637.387441 secs 2024-07-26T10:59:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8621.904816 secs 2024-07-26T10:59:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8637.387441 secs 2024-07-26T10:59:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8621.904816 secs 2024-07-26T10:59:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8637.387441 secs 2024-07-26T10:59:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:37 smithi043 ceph-mon[32384]: pgmap v5105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:37 smithi133 ceph-mon[37053]: pgmap v5105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:37 smithi063 ceph-mon[36747]: pgmap v5105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:39 smithi043 ceph-mon[32384]: pgmap v5106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:39 smithi133 ceph-mon[37053]: pgmap v5106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:39 smithi063 ceph-mon[36747]: pgmap v5106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:41 smithi043 ceph-mon[32384]: pgmap v5107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8626.904958 secs 2024-07-26T10:59:41.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8642.387559 secs 2024-07-26T10:59:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:41 smithi133 ceph-mon[37053]: pgmap v5107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8626.904958 secs 2024-07-26T10:59:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8642.387559 secs 2024-07-26T10:59:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:41 smithi063 ceph-mon[36747]: pgmap v5107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8626.904958 secs 2024-07-26T10:59:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8642.387559 secs 2024-07-26T10:59:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:43 smithi043 ceph-mon[32384]: pgmap v5108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:43 smithi133 ceph-mon[37053]: pgmap v5108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:43 smithi063 ceph-mon[36747]: pgmap v5108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:45 smithi043 ceph-mon[32384]: pgmap v5109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:45 smithi133 ceph-mon[37053]: pgmap v5109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:45 smithi063 ceph-mon[36747]: pgmap v5109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8631.905078 secs 2024-07-26T10:59:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8647.387683 secs 2024-07-26T10:59:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8631.905078 secs 2024-07-26T10:59:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8647.387683 secs 2024-07-26T10:59:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8631.905078 secs 2024-07-26T10:59:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8647.387683 secs 2024-07-26T10:59:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:47 smithi043 ceph-mon[32384]: pgmap v5110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:47 smithi133 ceph-mon[37053]: pgmap v5110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:47 smithi063 ceph-mon[36747]: pgmap v5110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:49 smithi043 ceph-mon[32384]: pgmap v5111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:49 smithi133 ceph-mon[37053]: pgmap v5111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:49 smithi063 ceph-mon[36747]: pgmap v5111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:51 smithi043 ceph-mon[32384]: pgmap v5112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8636.905175 secs 2024-07-26T10:59:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8652.387776 secs 2024-07-26T10:59:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:51 smithi133 ceph-mon[37053]: pgmap v5112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8636.905175 secs 2024-07-26T10:59:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8652.387776 secs 2024-07-26T10:59:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:51 smithi063 ceph-mon[36747]: pgmap v5112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T10:59:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8636.905175 secs 2024-07-26T10:59:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8652.387776 secs 2024-07-26T10:59:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:53 smithi043 ceph-mon[32384]: pgmap v5113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:53 smithi133 ceph-mon[37053]: pgmap v5113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:53 smithi063 ceph-mon[36747]: pgmap v5113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:55 smithi043 ceph-mon[32384]: pgmap v5114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:55 smithi133 ceph-mon[37053]: pgmap v5114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:55 smithi063 ceph-mon[36747]: pgmap v5114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8641.905266 secs 2024-07-26T10:59:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8657.387895 secs 2024-07-26T10:59:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8641.905266 secs 2024-07-26T10:59:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8657.387895 secs 2024-07-26T10:59:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8641.905266 secs 2024-07-26T10:59:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8657.387895 secs 2024-07-26T10:59:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:57 smithi043 ceph-mon[32384]: pgmap v5115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:57 smithi133 ceph-mon[37053]: pgmap v5115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:57 smithi063 ceph-mon[36747]: pgmap v5115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T10:59:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 10:59:59 smithi043 ceph-mon[32384]: pgmap v5116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 10:59:59 smithi133 ceph-mon[37053]: pgmap v5116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T10:59:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 10:59:59 smithi063 ceph-mon[36747]: pgmap v5116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:00:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:00:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:00:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:01 smithi063 ceph-mon[36747]: pgmap v5117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:01.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8646.905389 secs 2024-07-26T11:00:01.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8662.388024 secs 2024-07-26T11:00:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:01 smithi043 ceph-mon[32384]: pgmap v5117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8646.905389 secs 2024-07-26T11:00:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8662.388024 secs 2024-07-26T11:00:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:01 smithi133 ceph-mon[37053]: pgmap v5117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8646.905389 secs 2024-07-26T11:00:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8662.388024 secs 2024-07-26T11:00:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:03 smithi043 ceph-mon[32384]: pgmap v5118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:03 smithi133 ceph-mon[37053]: pgmap v5118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:03 smithi063 ceph-mon[36747]: pgmap v5118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:05 smithi043 ceph-mon[32384]: pgmap v5119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:05 smithi133 ceph-mon[37053]: pgmap v5119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:05 smithi063 ceph-mon[36747]: pgmap v5119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8651.905448 secs 2024-07-26T11:00:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8667.388117 secs 2024-07-26T11:00:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8651.905448 secs 2024-07-26T11:00:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8667.388117 secs 2024-07-26T11:00:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8651.905448 secs 2024-07-26T11:00:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8667.388117 secs 2024-07-26T11:00:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:07 smithi043 ceph-mon[32384]: pgmap v5120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:07 smithi133 ceph-mon[37053]: pgmap v5120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:07 smithi063 ceph-mon[36747]: pgmap v5120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:09 smithi043 ceph-mon[32384]: pgmap v5121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:09 smithi133 ceph-mon[37053]: pgmap v5121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:09 smithi063 ceph-mon[36747]: pgmap v5121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:11 smithi043 ceph-mon[32384]: pgmap v5122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8656.905571 secs 2024-07-26T11:00:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8672.388239 secs 2024-07-26T11:00:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:11 smithi133 ceph-mon[37053]: pgmap v5122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8656.905571 secs 2024-07-26T11:00:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8672.388239 secs 2024-07-26T11:00:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:11 smithi063 ceph-mon[36747]: pgmap v5122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8656.905571 secs 2024-07-26T11:00:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8672.388239 secs 2024-07-26T11:00:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:13 smithi133 ceph-mon[37053]: pgmap v5123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:13 smithi063 ceph-mon[36747]: pgmap v5123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:13 smithi043 ceph-mon[32384]: pgmap v5123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:15 smithi133 ceph-mon[37053]: pgmap v5124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:15 smithi063 ceph-mon[36747]: pgmap v5124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:15 smithi043 ceph-mon[32384]: pgmap v5124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8661.905695 secs 2024-07-26T11:00:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8677.388375 secs 2024-07-26T11:00:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8661.905695 secs 2024-07-26T11:00:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8677.388375 secs 2024-07-26T11:00:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8661.905695 secs 2024-07-26T11:00:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8677.388375 secs 2024-07-26T11:00:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:17 smithi133 ceph-mon[37053]: pgmap v5125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:17 smithi063 ceph-mon[36747]: pgmap v5125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:17 smithi043 ceph-mon[32384]: pgmap v5125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:19 smithi133 ceph-mon[37053]: pgmap v5126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:19.537 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:19 smithi043 ceph-mon[32384]: pgmap v5126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:19 smithi063 ceph-mon[36747]: pgmap v5126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:21 smithi063 ceph-mon[36747]: pgmap v5127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8666.905814 secs 2024-07-26T11:00:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8682.388438 secs 2024-07-26T11:00:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:21 smithi043 ceph-mon[32384]: pgmap v5127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8666.905814 secs 2024-07-26T11:00:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8682.388438 secs 2024-07-26T11:00:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:21 smithi133 ceph-mon[37053]: pgmap v5127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8666.905814 secs 2024-07-26T11:00:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8682.388438 secs 2024-07-26T11:00:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:23 smithi063 ceph-mon[36747]: pgmap v5128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:23 smithi043 ceph-mon[32384]: pgmap v5128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:23 smithi133 ceph-mon[37053]: pgmap v5128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:00:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:00:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:00:25.399 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:25 smithi063 ceph-mon[36747]: pgmap v5129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:25 smithi043 ceph-mon[32384]: pgmap v5129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:25 smithi133 ceph-mon[37053]: pgmap v5129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:26.383 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8671.905929 secs 2024-07-26T11:00:26.384 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8687.388566 secs 2024-07-26T11:00:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8671.905929 secs 2024-07-26T11:00:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8687.388566 secs 2024-07-26T11:00:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8671.905929 secs 2024-07-26T11:00:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8687.388566 secs 2024-07-26T11:00:27.535 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:27 smithi063 ceph-mon[36747]: pgmap v5130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:27.705 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:27 smithi043 ceph-mon[32384]: pgmap v5130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:27 smithi133 ceph-mon[37053]: pgmap v5130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:28 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:29.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:28 smithi043 ceph-mon[32384]: pgmap v5131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:28 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:28 smithi133 ceph-mon[37053]: pgmap v5131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:28 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:28 smithi063 ceph-mon[36747]: pgmap v5131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: pgmap v5132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8676.906062 secs 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8692.388706 secs 2024-07-26T11:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: pgmap v5132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8676.906062 secs 2024-07-26T11:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8692.388706 secs 2024-07-26T11:00:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: pgmap v5132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8676.906062 secs 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:00:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8692.388706 secs 2024-07-26T11:00:32.341 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:32 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:00:32.341 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:32 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:00:32.341 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:32 smithi043 ceph-mon[32384]: pgmap v5133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T11:00:32.342 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:32 smithi043 ceph-mon[32384]: pgmap v5134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:32 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:00:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:32 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:00:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:32 smithi133 ceph-mon[37053]: pgmap v5133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T11:00:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:32 smithi133 ceph-mon[37053]: pgmap v5134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:32 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:00:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:32 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:00:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:32 smithi063 ceph-mon[36747]: pgmap v5133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T11:00:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:32 smithi063 ceph-mon[36747]: pgmap v5134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:34 smithi043 ceph-mon[32384]: pgmap v5135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:34 smithi133 ceph-mon[37053]: pgmap v5135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:34 smithi063 ceph-mon[36747]: pgmap v5135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:36 smithi043 ceph-mon[32384]: pgmap v5136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T11:00:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8681.906158 secs 2024-07-26T11:00:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8697.388825 secs 2024-07-26T11:00:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:36 smithi133 ceph-mon[37053]: pgmap v5136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T11:00:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8681.906158 secs 2024-07-26T11:00:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8697.388825 secs 2024-07-26T11:00:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:36 smithi063 ceph-mon[36747]: pgmap v5136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-07-26T11:00:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8681.906158 secs 2024-07-26T11:00:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8697.388825 secs 2024-07-26T11:00:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:38 smithi043 ceph-mon[32384]: pgmap v5137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:38 smithi133 ceph-mon[37053]: pgmap v5137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:38 smithi063 ceph-mon[36747]: pgmap v5137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:40 smithi043 ceph-mon[32384]: pgmap v5138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:40 smithi133 ceph-mon[37053]: pgmap v5138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:40 smithi063 ceph-mon[36747]: pgmap v5138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:00:41.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8686.906273 secs 2024-07-26T11:00:41.487 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8702.388947 secs 2024-07-26T11:00:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8686.906273 secs 2024-07-26T11:00:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8702.388947 secs 2024-07-26T11:00:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8686.906273 secs 2024-07-26T11:00:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8702.388947 secs 2024-07-26T11:00:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:42 smithi043 ceph-mon[32384]: pgmap v5139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:00:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:42 smithi133 ceph-mon[37053]: pgmap v5139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:00:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:42 smithi063 ceph-mon[36747]: pgmap v5139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:00:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:44 smithi043 ceph-mon[32384]: pgmap v5140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:44 smithi133 ceph-mon[37053]: pgmap v5140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:44 smithi063 ceph-mon[36747]: pgmap v5140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:46 smithi043 ceph-mon[32384]: pgmap v5141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8691.906405 secs 2024-07-26T11:00:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8707.389067 secs 2024-07-26T11:00:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:46 smithi133 ceph-mon[37053]: pgmap v5141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8691.906405 secs 2024-07-26T11:00:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8707.389067 secs 2024-07-26T11:00:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:46 smithi063 ceph-mon[36747]: pgmap v5141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8691.906405 secs 2024-07-26T11:00:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8707.389067 secs 2024-07-26T11:00:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:48 smithi043 ceph-mon[32384]: pgmap v5142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:48 smithi133 ceph-mon[37053]: pgmap v5142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:48 smithi063 ceph-mon[36747]: pgmap v5142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:50 smithi043 ceph-mon[32384]: pgmap v5143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:50 smithi133 ceph-mon[37053]: pgmap v5143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:50 smithi063 ceph-mon[36747]: pgmap v5143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8696.906508 secs 2024-07-26T11:00:51.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8712.389152 secs 2024-07-26T11:00:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8696.906508 secs 2024-07-26T11:00:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8712.389152 secs 2024-07-26T11:00:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8696.906508 secs 2024-07-26T11:00:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8712.389152 secs 2024-07-26T11:00:52.422 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:52 smithi043 ceph-mon[32384]: pgmap v5144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:52 smithi133 ceph-mon[37053]: pgmap v5144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:52 smithi063 ceph-mon[36747]: pgmap v5144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:54 smithi043 ceph-mon[32384]: pgmap v5145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:54 smithi133 ceph-mon[37053]: pgmap v5145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:54 smithi063 ceph-mon[36747]: pgmap v5145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:00:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:56 smithi043 ceph-mon[32384]: pgmap v5146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8701.906645 secs 2024-07-26T11:00:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8717.389224 secs 2024-07-26T11:00:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:56 smithi133 ceph-mon[37053]: pgmap v5146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8701.906645 secs 2024-07-26T11:00:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8717.389224 secs 2024-07-26T11:00:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:56 smithi063 ceph-mon[36747]: pgmap v5146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:00:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8701.906645 secs 2024-07-26T11:00:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8717.389224 secs 2024-07-26T11:00:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:00:58 smithi043 ceph-mon[32384]: pgmap v5147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:00:58 smithi133 ceph-mon[37053]: pgmap v5147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:00:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:00:58 smithi063 ceph-mon[36747]: pgmap v5147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:00 smithi043 ceph-mon[32384]: pgmap v5148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:00 smithi133 ceph-mon[37053]: pgmap v5148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:00 smithi063 ceph-mon[36747]: pgmap v5148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:01.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8706.906770 secs 2024-07-26T11:01:01.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8722.389323 secs 2024-07-26T11:01:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8706.906770 secs 2024-07-26T11:01:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8722.389323 secs 2024-07-26T11:01:01.495 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8706.906770 secs 2024-07-26T11:01:01.495 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8722.389323 secs 2024-07-26T11:01:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:02 smithi043 ceph-mon[32384]: pgmap v5149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:02 smithi133 ceph-mon[37053]: pgmap v5149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:02 smithi063 ceph-mon[36747]: pgmap v5149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:04 smithi043 ceph-mon[32384]: pgmap v5150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:04 smithi133 ceph-mon[37053]: pgmap v5150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:04 smithi063 ceph-mon[36747]: pgmap v5150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:06 smithi043 ceph-mon[32384]: pgmap v5151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8711.906889 secs 2024-07-26T11:01:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8727.389420 secs 2024-07-26T11:01:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:06 smithi133 ceph-mon[37053]: pgmap v5151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8711.906889 secs 2024-07-26T11:01:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8727.389420 secs 2024-07-26T11:01:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:06 smithi063 ceph-mon[36747]: pgmap v5151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8711.906889 secs 2024-07-26T11:01:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8727.389420 secs 2024-07-26T11:01:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:08 smithi043 ceph-mon[32384]: pgmap v5152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:08 smithi133 ceph-mon[37053]: pgmap v5152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:08 smithi063 ceph-mon[36747]: pgmap v5152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:10 smithi043 ceph-mon[32384]: pgmap v5153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:10 smithi133 ceph-mon[37053]: pgmap v5153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:10 smithi063 ceph-mon[36747]: pgmap v5153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8716.907012 secs 2024-07-26T11:01:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8732.389544 secs 2024-07-26T11:01:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8716.907012 secs 2024-07-26T11:01:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8732.389544 secs 2024-07-26T11:01:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8716.907012 secs 2024-07-26T11:01:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8732.389544 secs 2024-07-26T11:01:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:12 smithi133 ceph-mon[37053]: pgmap v5154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:12 smithi063 ceph-mon[36747]: pgmap v5154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:12 smithi043 ceph-mon[32384]: pgmap v5154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:14 smithi133 ceph-mon[37053]: pgmap v5155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:14 smithi063 ceph-mon[36747]: pgmap v5155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:14 smithi043 ceph-mon[32384]: pgmap v5155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:16 smithi133 ceph-mon[37053]: pgmap v5156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8721.907171 secs 2024-07-26T11:01:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8737.389680 secs 2024-07-26T11:01:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:16 smithi063 ceph-mon[36747]: pgmap v5156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8721.907171 secs 2024-07-26T11:01:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8737.389680 secs 2024-07-26T11:01:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:16 smithi043 ceph-mon[32384]: pgmap v5156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8721.907171 secs 2024-07-26T11:01:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8737.389680 secs 2024-07-26T11:01:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:18 smithi133 ceph-mon[37053]: pgmap v5157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:18 smithi063 ceph-mon[36747]: pgmap v5157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:18 smithi043 ceph-mon[32384]: pgmap v5157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:20 smithi133 ceph-mon[37053]: pgmap v5158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:20 smithi063 ceph-mon[36747]: pgmap v5158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:20 smithi043 ceph-mon[32384]: pgmap v5158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8726.907263 secs 2024-07-26T11:01:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8742.389827 secs 2024-07-26T11:01:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8726.907263 secs 2024-07-26T11:01:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8742.389827 secs 2024-07-26T11:01:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8726.907263 secs 2024-07-26T11:01:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8742.389827 secs 2024-07-26T11:01:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:22 smithi063 ceph-mon[36747]: pgmap v5159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:22 smithi043 ceph-mon[32384]: pgmap v5159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:22 smithi133 ceph-mon[37053]: pgmap v5159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:24 smithi063 ceph-mon[36747]: pgmap v5160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:24 smithi043 ceph-mon[32384]: pgmap v5160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:24 smithi133 ceph-mon[37053]: pgmap v5160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:26 smithi063 ceph-mon[36747]: pgmap v5161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8731.907408 secs 2024-07-26T11:01:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8747.389940 secs 2024-07-26T11:01:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:26 smithi043 ceph-mon[32384]: pgmap v5161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8731.907408 secs 2024-07-26T11:01:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8747.389940 secs 2024-07-26T11:01:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:26 smithi133 ceph-mon[37053]: pgmap v5161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8731.907408 secs 2024-07-26T11:01:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8747.389940 secs 2024-07-26T11:01:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:28 smithi063 ceph-mon[36747]: pgmap v5162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:28 smithi043 ceph-mon[32384]: pgmap v5162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:28 smithi133 ceph-mon[37053]: pgmap v5162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:30 smithi063 ceph-mon[36747]: pgmap v5163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:30 smithi043 ceph-mon[32384]: pgmap v5163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:30 smithi133 ceph-mon[37053]: pgmap v5163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8736.907547 secs 2024-07-26T11:01:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8752.390040 secs 2024-07-26T11:01:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:31 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:01:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8736.907547 secs 2024-07-26T11:01:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8752.390040 secs 2024-07-26T11:01:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:31 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:01:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8736.907547 secs 2024-07-26T11:01:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8752.390040 secs 2024-07-26T11:01:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:31 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:01:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: pgmap v5164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: pgmap v5164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: pgmap v5164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:32.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:33.382 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:33 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:01:33.382 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:33 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:01:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:33 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:01:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:33 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:01:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:33 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:01:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:33 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:01:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:34 smithi133 ceph-mon[37053]: pgmap v5165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:34 smithi043 ceph-mon[32384]: pgmap v5165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:34 smithi063 ceph-mon[36747]: pgmap v5165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: pgmap v5166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: pgmap v5167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: pgmap v5168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:35.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8741.907609 secs 2024-07-26T11:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: pgmap v5166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: pgmap v5167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: pgmap v5168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:36.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8741.907609 secs 2024-07-26T11:01:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: pgmap v5166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:01:36.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:01:36.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: pgmap v5167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:01:36.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: pgmap v5168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:01:36.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:01:36.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8741.907609 secs 2024-07-26T11:01:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8757.390105 secs 2024-07-26T11:01:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8757.390105 secs 2024-07-26T11:01:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8757.390105 secs 2024-07-26T11:01:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:37 smithi043 ceph-mon[32384]: pgmap v5169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:01:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:37 smithi133 ceph-mon[37053]: pgmap v5169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:01:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:37 smithi063 ceph-mon[36747]: pgmap v5169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:01:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:39 smithi063 ceph-mon[36747]: pgmap v5170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:01:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:39 smithi043 ceph-mon[32384]: pgmap v5170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:01:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:39 smithi133 ceph-mon[37053]: pgmap v5170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:01:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8746.907710 secs 2024-07-26T11:01:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8746.907710 secs 2024-07-26T11:01:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8746.907710 secs 2024-07-26T11:01:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8762.390232 secs 2024-07-26T11:01:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:41 smithi063 ceph-mon[36747]: pgmap v5171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:01:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8762.390232 secs 2024-07-26T11:01:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:41 smithi043 ceph-mon[32384]: pgmap v5171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:01:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8762.390232 secs 2024-07-26T11:01:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:41 smithi133 ceph-mon[37053]: pgmap v5171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:01:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:43 smithi063 ceph-mon[36747]: pgmap v5172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:01:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:43 smithi043 ceph-mon[32384]: pgmap v5172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:01:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:43 smithi133 ceph-mon[37053]: pgmap v5172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:01:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:45 smithi063 ceph-mon[36747]: pgmap v5173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:01:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8751.907829 secs 2024-07-26T11:01:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8767.390300 secs 2024-07-26T11:01:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:45 smithi043 ceph-mon[32384]: pgmap v5173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:01:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8751.907829 secs 2024-07-26T11:01:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8767.390300 secs 2024-07-26T11:01:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:45 smithi133 ceph-mon[37053]: pgmap v5173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:01:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8751.907829 secs 2024-07-26T11:01:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8767.390300 secs 2024-07-26T11:01:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:47 smithi063 ceph-mon[36747]: pgmap v5174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:47 smithi043 ceph-mon[32384]: pgmap v5174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:47 smithi133 ceph-mon[37053]: pgmap v5174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:49 smithi063 ceph-mon[36747]: pgmap v5175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:49 smithi043 ceph-mon[32384]: pgmap v5175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:49 smithi133 ceph-mon[37053]: pgmap v5175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:51.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8756.907916 secs 2024-07-26T11:01:51.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8772.390419 secs 2024-07-26T11:01:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8756.907916 secs 2024-07-26T11:01:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8772.390419 secs 2024-07-26T11:01:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8756.907916 secs 2024-07-26T11:01:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8772.390419 secs 2024-07-26T11:01:52.170 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:51 smithi043 ceph-mon[32384]: pgmap v5176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:51 smithi133 ceph-mon[37053]: pgmap v5176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:51 smithi063 ceph-mon[36747]: pgmap v5176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:53 smithi043 ceph-mon[32384]: pgmap v5177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:53 smithi133 ceph-mon[37053]: pgmap v5177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:53 smithi063 ceph-mon[36747]: pgmap v5177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:01:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:55 smithi043 ceph-mon[32384]: pgmap v5178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8761.908038 secs 2024-07-26T11:01:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8777.390536 secs 2024-07-26T11:01:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:55 smithi133 ceph-mon[37053]: pgmap v5178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8761.908038 secs 2024-07-26T11:01:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8777.390536 secs 2024-07-26T11:01:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:55 smithi063 ceph-mon[36747]: pgmap v5178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:01:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8761.908038 secs 2024-07-26T11:01:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8777.390536 secs 2024-07-26T11:01:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:57 smithi043 ceph-mon[32384]: pgmap v5179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:57 smithi133 ceph-mon[37053]: pgmap v5179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:01:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:57 smithi063 ceph-mon[36747]: pgmap v5179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:01:59 smithi043 ceph-mon[32384]: pgmap v5180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:01:59 smithi133 ceph-mon[37053]: pgmap v5180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:01:59 smithi063 ceph-mon[36747]: pgmap v5180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:01.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8766.908166 secs 2024-07-26T11:02:01.168 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8782.390660 secs 2024-07-26T11:02:01.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8766.908166 secs 2024-07-26T11:02:01.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8782.390660 secs 2024-07-26T11:02:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8766.908166 secs 2024-07-26T11:02:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8782.390660 secs 2024-07-26T11:02:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:01 smithi043 ceph-mon[32384]: pgmap v5181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:01 smithi133 ceph-mon[37053]: pgmap v5181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:01 smithi063 ceph-mon[36747]: pgmap v5181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:03 smithi043 ceph-mon[32384]: pgmap v5182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:03 smithi133 ceph-mon[37053]: pgmap v5182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:03 smithi063 ceph-mon[36747]: pgmap v5182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:05 smithi043 ceph-mon[32384]: pgmap v5183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8771.908286 secs 2024-07-26T11:02:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8787.390776 secs 2024-07-26T11:02:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:05 smithi133 ceph-mon[37053]: pgmap v5183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8771.908286 secs 2024-07-26T11:02:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8787.390776 secs 2024-07-26T11:02:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:05 smithi063 ceph-mon[36747]: pgmap v5183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8771.908286 secs 2024-07-26T11:02:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8787.390776 secs 2024-07-26T11:02:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:07 smithi043 ceph-mon[32384]: pgmap v5184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:07 smithi133 ceph-mon[37053]: pgmap v5184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:07 smithi063 ceph-mon[36747]: pgmap v5184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:10 smithi063 ceph-mon[36747]: pgmap v5185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:10 smithi043 ceph-mon[32384]: pgmap v5185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:10 smithi133 ceph-mon[37053]: pgmap v5185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8776.908382 secs 2024-07-26T11:02:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8792.390930 secs 2024-07-26T11:02:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8776.908382 secs 2024-07-26T11:02:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8792.390930 secs 2024-07-26T11:02:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8776.908382 secs 2024-07-26T11:02:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8792.390930 secs 2024-07-26T11:02:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:12 smithi043 ceph-mon[32384]: pgmap v5186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:12 smithi133 ceph-mon[37053]: pgmap v5186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:12 smithi063 ceph-mon[36747]: pgmap v5186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:14 smithi043 ceph-mon[32384]: pgmap v5187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:14 smithi133 ceph-mon[37053]: pgmap v5187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:14 smithi063 ceph-mon[36747]: pgmap v5187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:16 smithi043 ceph-mon[32384]: pgmap v5188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8781.908506 secs 2024-07-26T11:02:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8797.390996 secs 2024-07-26T11:02:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:16 smithi133 ceph-mon[37053]: pgmap v5188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8781.908506 secs 2024-07-26T11:02:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8797.390996 secs 2024-07-26T11:02:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:16 smithi063 ceph-mon[36747]: pgmap v5188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8781.908506 secs 2024-07-26T11:02:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8797.390996 secs 2024-07-26T11:02:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:18 smithi043 ceph-mon[32384]: pgmap v5189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:18 smithi133 ceph-mon[37053]: pgmap v5189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:18 smithi063 ceph-mon[36747]: pgmap v5189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:20 smithi043 ceph-mon[32384]: pgmap v5190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:20 smithi133 ceph-mon[37053]: pgmap v5190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:20 smithi063 ceph-mon[36747]: pgmap v5190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8786.908570 secs 2024-07-26T11:02:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8802.391081 secs 2024-07-26T11:02:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8786.908570 secs 2024-07-26T11:02:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8802.391081 secs 2024-07-26T11:02:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8786.908570 secs 2024-07-26T11:02:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8802.391081 secs 2024-07-26T11:02:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:22 smithi043 ceph-mon[32384]: pgmap v5191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:22 smithi133 ceph-mon[37053]: pgmap v5191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:22 smithi063 ceph-mon[36747]: pgmap v5191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:24 smithi043 ceph-mon[32384]: pgmap v5192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:24 smithi133 ceph-mon[37053]: pgmap v5192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:24 smithi063 ceph-mon[36747]: pgmap v5192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:26 smithi043 ceph-mon[32384]: pgmap v5193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8791.908650 secs 2024-07-26T11:02:26.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8807.391146 secs 2024-07-26T11:02:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:26 smithi133 ceph-mon[37053]: pgmap v5193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8791.908650 secs 2024-07-26T11:02:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8807.391146 secs 2024-07-26T11:02:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:26 smithi063 ceph-mon[36747]: pgmap v5193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8791.908650 secs 2024-07-26T11:02:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8807.391146 secs 2024-07-26T11:02:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:28 smithi043 ceph-mon[32384]: pgmap v5194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:28 smithi133 ceph-mon[37053]: pgmap v5194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:28 smithi063 ceph-mon[36747]: pgmap v5194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:30 smithi043 ceph-mon[32384]: pgmap v5195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:30 smithi133 ceph-mon[37053]: pgmap v5195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:30 smithi063 ceph-mon[36747]: pgmap v5195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:02:31.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8796.908777 secs 2024-07-26T11:02:31.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8812.391210 secs 2024-07-26T11:02:31.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8796.908777 secs 2024-07-26T11:02:31.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8812.391210 secs 2024-07-26T11:02:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8796.908777 secs 2024-07-26T11:02:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8812.391210 secs 2024-07-26T11:02:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:32 smithi043 ceph-mon[32384]: pgmap v5196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:32 smithi133 ceph-mon[37053]: pgmap v5196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:32 smithi063 ceph-mon[36747]: pgmap v5196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:34 smithi043 ceph-mon[32384]: pgmap v5197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:34 smithi133 ceph-mon[37053]: pgmap v5197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:34 smithi063 ceph-mon[36747]: pgmap v5197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:35 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:02:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:35 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:02:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:35 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:02:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:36 smithi043 ceph-mon[32384]: pgmap v5198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8801.908857 secs 2024-07-26T11:02:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8817.391301 secs 2024-07-26T11:02:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:02:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:02:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:36 smithi133 ceph-mon[37053]: pgmap v5198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8801.908857 secs 2024-07-26T11:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8817.391301 secs 2024-07-26T11:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:02:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:02:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:36 smithi063 ceph-mon[36747]: pgmap v5198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8801.908857 secs 2024-07-26T11:02:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8817.391301 secs 2024-07-26T11:02:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:02:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:02:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:02:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:37 smithi043 ceph-mon[32384]: pgmap v5199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:02:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:37 smithi043 ceph-mon[32384]: pgmap v5200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:02:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:37 smithi133 ceph-mon[37053]: pgmap v5199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:02:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:37 smithi133 ceph-mon[37053]: pgmap v5200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:02:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:37 smithi063 ceph-mon[36747]: pgmap v5199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:02:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:37 smithi063 ceph-mon[36747]: pgmap v5200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:02:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:39 smithi043 ceph-mon[32384]: pgmap v5201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:02:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:39 smithi133 ceph-mon[37053]: pgmap v5201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:02:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:39 smithi063 ceph-mon[36747]: pgmap v5201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:02:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:41 smithi043 ceph-mon[32384]: pgmap v5202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8806.908983 secs 2024-07-26T11:02:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8822.391444 secs 2024-07-26T11:02:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:41 smithi133 ceph-mon[37053]: pgmap v5202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8806.908983 secs 2024-07-26T11:02:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8822.391444 secs 2024-07-26T11:02:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:41 smithi063 ceph-mon[36747]: pgmap v5202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8806.908983 secs 2024-07-26T11:02:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8822.391444 secs 2024-07-26T11:02:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:43 smithi043 ceph-mon[32384]: pgmap v5203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:43 smithi133 ceph-mon[37053]: pgmap v5203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:43 smithi063 ceph-mon[36747]: pgmap v5203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:02:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:45 smithi043 ceph-mon[32384]: pgmap v5204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:02:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:45 smithi133 ceph-mon[37053]: pgmap v5204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:02:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:45 smithi063 ceph-mon[36747]: pgmap v5204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:02:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8811.909047 secs 2024-07-26T11:02:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8827.391581 secs 2024-07-26T11:02:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8811.909047 secs 2024-07-26T11:02:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8827.391581 secs 2024-07-26T11:02:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8811.909047 secs 2024-07-26T11:02:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8827.391581 secs 2024-07-26T11:02:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:47 smithi043 ceph-mon[32384]: pgmap v5205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:47 smithi133 ceph-mon[37053]: pgmap v5205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:47 smithi063 ceph-mon[36747]: pgmap v5205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:02:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:49 smithi043 ceph-mon[32384]: pgmap v5206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:49 smithi133 ceph-mon[37053]: pgmap v5206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:49 smithi063 ceph-mon[36747]: pgmap v5206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:51 smithi043 ceph-mon[32384]: pgmap v5207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8816.909170 secs 2024-07-26T11:02:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8832.391708 secs 2024-07-26T11:02:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:51 smithi133 ceph-mon[37053]: pgmap v5207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8816.909170 secs 2024-07-26T11:02:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8832.391708 secs 2024-07-26T11:02:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:51 smithi063 ceph-mon[36747]: pgmap v5207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:02:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8816.909170 secs 2024-07-26T11:02:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8832.391708 secs 2024-07-26T11:02:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:53 smithi043 ceph-mon[32384]: pgmap v5208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:53 smithi133 ceph-mon[37053]: pgmap v5208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:53 smithi063 ceph-mon[36747]: pgmap v5208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:55 smithi043 ceph-mon[32384]: pgmap v5209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:55 smithi133 ceph-mon[37053]: pgmap v5209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:55 smithi063 ceph-mon[36747]: pgmap v5209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8821.909312 secs 2024-07-26T11:02:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8837.391846 secs 2024-07-26T11:02:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8821.909312 secs 2024-07-26T11:02:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8837.391846 secs 2024-07-26T11:02:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8821.909312 secs 2024-07-26T11:02:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8837.391846 secs 2024-07-26T11:02:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:57 smithi133 ceph-mon[37053]: pgmap v5210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:57 smithi063 ceph-mon[36747]: pgmap v5210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:57 smithi043 ceph-mon[32384]: pgmap v5210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:02:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:02:59 smithi133 ceph-mon[37053]: pgmap v5211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:02:59 smithi063 ceph-mon[36747]: pgmap v5211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:02:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:02:59 smithi043 ceph-mon[32384]: pgmap v5211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:01 smithi133 ceph-mon[37053]: pgmap v5212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8826.909378 secs 2024-07-26T11:03:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8842.391958 secs 2024-07-26T11:03:01.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:01 smithi063 ceph-mon[36747]: pgmap v5212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:01.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8826.909378 secs 2024-07-26T11:03:01.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8842.391958 secs 2024-07-26T11:03:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:01 smithi043 ceph-mon[32384]: pgmap v5212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8826.909378 secs 2024-07-26T11:03:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8842.391958 secs 2024-07-26T11:03:03.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:03 smithi133 ceph-mon[37053]: pgmap v5213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:03 smithi063 ceph-mon[36747]: pgmap v5213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:03 smithi043 ceph-mon[32384]: pgmap v5213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:05 smithi063 ceph-mon[36747]: pgmap v5214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:05 smithi043 ceph-mon[32384]: pgmap v5214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:05 smithi133 ceph-mon[37053]: pgmap v5214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8831.909500 secs 2024-07-26T11:03:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8847.392066 secs 2024-07-26T11:03:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8831.909500 secs 2024-07-26T11:03:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8847.392066 secs 2024-07-26T11:03:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8831.909500 secs 2024-07-26T11:03:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8847.392066 secs 2024-07-26T11:03:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:07 smithi063 ceph-mon[36747]: pgmap v5215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:07 smithi043 ceph-mon[32384]: pgmap v5215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:07 smithi133 ceph-mon[37053]: pgmap v5215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:09 smithi063 ceph-mon[36747]: pgmap v5216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:09 smithi043 ceph-mon[32384]: pgmap v5216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:09 smithi133 ceph-mon[37053]: pgmap v5216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:11 smithi063 ceph-mon[36747]: pgmap v5217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8836.909647 secs 2024-07-26T11:03:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8852.392177 secs 2024-07-26T11:03:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:11 smithi043 ceph-mon[32384]: pgmap v5217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8836.909647 secs 2024-07-26T11:03:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8852.392177 secs 2024-07-26T11:03:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:11 smithi133 ceph-mon[37053]: pgmap v5217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8836.909647 secs 2024-07-26T11:03:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8852.392177 secs 2024-07-26T11:03:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:13 smithi063 ceph-mon[36747]: pgmap v5218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:13 smithi043 ceph-mon[32384]: pgmap v5218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:13 smithi133 ceph-mon[37053]: pgmap v5218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:15 smithi063 ceph-mon[36747]: pgmap v5219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:15 smithi043 ceph-mon[32384]: pgmap v5219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:15 smithi133 ceph-mon[37053]: pgmap v5219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8841.909768 secs 2024-07-26T11:03:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8857.392316 secs 2024-07-26T11:03:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8841.909768 secs 2024-07-26T11:03:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8857.392316 secs 2024-07-26T11:03:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8841.909768 secs 2024-07-26T11:03:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8857.392316 secs 2024-07-26T11:03:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:17 smithi063 ceph-mon[36747]: pgmap v5220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:17 smithi043 ceph-mon[32384]: pgmap v5220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:17 smithi133 ceph-mon[37053]: pgmap v5220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:19 smithi043 ceph-mon[32384]: pgmap v5221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:19 smithi133 ceph-mon[37053]: pgmap v5221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:19 smithi063 ceph-mon[36747]: pgmap v5221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:21 smithi043 ceph-mon[32384]: pgmap v5222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8846.909889 secs 2024-07-26T11:03:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8862.392417 secs 2024-07-26T11:03:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:21 smithi133 ceph-mon[37053]: pgmap v5222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8846.909889 secs 2024-07-26T11:03:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8862.392417 secs 2024-07-26T11:03:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:21 smithi063 ceph-mon[36747]: pgmap v5222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8846.909889 secs 2024-07-26T11:03:21.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8862.392417 secs 2024-07-26T11:03:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:23 smithi043 ceph-mon[32384]: pgmap v5223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:23 smithi133 ceph-mon[37053]: pgmap v5223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:23 smithi063 ceph-mon[36747]: pgmap v5223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:25 smithi043 ceph-mon[32384]: pgmap v5224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:25 smithi133 ceph-mon[37053]: pgmap v5224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:25 smithi063 ceph-mon[36747]: pgmap v5224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8851.909992 secs 2024-07-26T11:03:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8867.392530 secs 2024-07-26T11:03:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8851.909992 secs 2024-07-26T11:03:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8867.392530 secs 2024-07-26T11:03:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8851.909992 secs 2024-07-26T11:03:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8867.392530 secs 2024-07-26T11:03:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:27 smithi043 ceph-mon[32384]: pgmap v5225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:27 smithi133 ceph-mon[37053]: pgmap v5225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:27 smithi063 ceph-mon[36747]: pgmap v5225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:29 smithi043 ceph-mon[32384]: pgmap v5226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:29 smithi133 ceph-mon[37053]: pgmap v5226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:29 smithi063 ceph-mon[36747]: pgmap v5226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:31.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:31 smithi063 ceph-mon[36747]: pgmap v5227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:31.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8856.910087 secs 2024-07-26T11:03:31.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8872.392649 secs 2024-07-26T11:03:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:31 smithi043 ceph-mon[32384]: pgmap v5227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8856.910087 secs 2024-07-26T11:03:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8872.392649 secs 2024-07-26T11:03:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:31 smithi133 ceph-mon[37053]: pgmap v5227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8856.910087 secs 2024-07-26T11:03:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8872.392649 secs 2024-07-26T11:03:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:33 smithi043 ceph-mon[32384]: pgmap v5228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:33 smithi133 ceph-mon[37053]: pgmap v5228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:33 smithi063 ceph-mon[36747]: pgmap v5228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:35 smithi043 ceph-mon[32384]: pgmap v5229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:35 smithi133 ceph-mon[37053]: pgmap v5229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:35 smithi063 ceph-mon[36747]: pgmap v5229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8861.910208 secs 2024-07-26T11:03:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8877.392783 secs 2024-07-26T11:03:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:03:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8861.910208 secs 2024-07-26T11:03:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8877.392783 secs 2024-07-26T11:03:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:03:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8861.910208 secs 2024-07-26T11:03:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8877.392783 secs 2024-07-26T11:03:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:03:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:37 smithi043 ceph-mon[32384]: pgmap v5230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:03:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:37 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:37 smithi133 ceph-mon[37053]: pgmap v5230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:03:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:37 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:37 smithi063 ceph-mon[36747]: pgmap v5230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:03:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:37 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:03:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:03:38.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:03:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:03:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:03:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:03:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:03:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:39 smithi043 ceph-mon[32384]: pgmap v5231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:03:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:39 smithi043 ceph-mon[32384]: pgmap v5232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:39 smithi133 ceph-mon[37053]: pgmap v5231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:03:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:39 smithi133 ceph-mon[37053]: pgmap v5232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:39 smithi063 ceph-mon[36747]: pgmap v5231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:03:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:39 smithi063 ceph-mon[36747]: pgmap v5232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:41 smithi043 ceph-mon[32384]: pgmap v5233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8866.910331 secs 2024-07-26T11:03:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8882.392891 secs 2024-07-26T11:03:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:41 smithi133 ceph-mon[37053]: pgmap v5233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8866.910331 secs 2024-07-26T11:03:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8882.392891 secs 2024-07-26T11:03:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:41 smithi063 ceph-mon[36747]: pgmap v5233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8866.910331 secs 2024-07-26T11:03:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8882.392891 secs 2024-07-26T11:03:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:43 smithi043 ceph-mon[32384]: pgmap v5234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:43 smithi133 ceph-mon[37053]: pgmap v5234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:43 smithi063 ceph-mon[36747]: pgmap v5234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:45 smithi043 ceph-mon[32384]: pgmap v5235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:45 smithi133 ceph-mon[37053]: pgmap v5235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:45 smithi063 ceph-mon[36747]: pgmap v5235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:03:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8871.910451 secs 2024-07-26T11:03:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8887.392981 secs 2024-07-26T11:03:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8871.910451 secs 2024-07-26T11:03:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8887.392981 secs 2024-07-26T11:03:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8871.910451 secs 2024-07-26T11:03:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8887.392981 secs 2024-07-26T11:03:47.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:47 smithi043 ceph-mon[32384]: pgmap v5236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:03:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:47 smithi133 ceph-mon[37053]: pgmap v5236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:03:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:47 smithi063 ceph-mon[36747]: pgmap v5236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:03:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:48 smithi043 ceph-mon[32384]: pgmap v5237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:03:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:48 smithi133 ceph-mon[37053]: pgmap v5237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:03:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:48 smithi063 ceph-mon[36747]: pgmap v5237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:03:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:51 smithi063 ceph-mon[36747]: pgmap v5238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8876.910571 secs 2024-07-26T11:03:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8892.393104 secs 2024-07-26T11:03:51.437 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:51 smithi043 ceph-mon[32384]: pgmap v5238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:51.438 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8876.910571 secs 2024-07-26T11:03:51.438 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8892.393104 secs 2024-07-26T11:03:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:51 smithi133 ceph-mon[37053]: pgmap v5238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:03:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8876.910571 secs 2024-07-26T11:03:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8892.393104 secs 2024-07-26T11:03:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:53 smithi063 ceph-mon[36747]: pgmap v5239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:53 smithi043 ceph-mon[32384]: pgmap v5239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:53 smithi133 ceph-mon[37053]: pgmap v5239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:55 smithi063 ceph-mon[36747]: pgmap v5240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:55 smithi043 ceph-mon[32384]: pgmap v5240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:55 smithi133 ceph-mon[37053]: pgmap v5240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8881.910711 secs 2024-07-26T11:03:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8897.393182 secs 2024-07-26T11:03:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8881.910711 secs 2024-07-26T11:03:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8897.393182 secs 2024-07-26T11:03:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8881.910711 secs 2024-07-26T11:03:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8897.393182 secs 2024-07-26T11:03:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:57 smithi063 ceph-mon[36747]: pgmap v5241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:57 smithi043 ceph-mon[32384]: pgmap v5241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:57 smithi133 ceph-mon[37053]: pgmap v5241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:03:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:03:59 smithi043 ceph-mon[32384]: pgmap v5242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:03:59 smithi133 ceph-mon[37053]: pgmap v5242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:03:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:03:59 smithi063 ceph-mon[36747]: pgmap v5242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:01.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:01 smithi063 ceph-mon[36747]: pgmap v5243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:01.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8886.910832 secs 2024-07-26T11:04:01.371 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8902.393299 secs 2024-07-26T11:04:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:01 smithi043 ceph-mon[32384]: pgmap v5243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8886.910832 secs 2024-07-26T11:04:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8902.393299 secs 2024-07-26T11:04:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:01 smithi133 ceph-mon[37053]: pgmap v5243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8886.910832 secs 2024-07-26T11:04:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8902.393299 secs 2024-07-26T11:04:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:03 smithi043 ceph-mon[32384]: pgmap v5244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:03 smithi133 ceph-mon[37053]: pgmap v5244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:03 smithi063 ceph-mon[36747]: pgmap v5244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:05 smithi043 ceph-mon[32384]: pgmap v5245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:05 smithi133 ceph-mon[37053]: pgmap v5245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:05 smithi063 ceph-mon[36747]: pgmap v5245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8891.910982 secs 2024-07-26T11:04:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8907.393363 secs 2024-07-26T11:04:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8891.910982 secs 2024-07-26T11:04:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8907.393363 secs 2024-07-26T11:04:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8891.910982 secs 2024-07-26T11:04:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8907.393363 secs 2024-07-26T11:04:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:07 smithi043 ceph-mon[32384]: pgmap v5246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:07 smithi133 ceph-mon[37053]: pgmap v5246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:07 smithi063 ceph-mon[36747]: pgmap v5246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:09 smithi043 ceph-mon[32384]: pgmap v5247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:09 smithi133 ceph-mon[37053]: pgmap v5247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:09 smithi063 ceph-mon[36747]: pgmap v5247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:11 smithi043 ceph-mon[32384]: pgmap v5248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8896.911108 secs 2024-07-26T11:04:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8912.393424 secs 2024-07-26T11:04:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:11 smithi133 ceph-mon[37053]: pgmap v5248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8896.911108 secs 2024-07-26T11:04:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8912.393424 secs 2024-07-26T11:04:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:11 smithi063 ceph-mon[36747]: pgmap v5248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8896.911108 secs 2024-07-26T11:04:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8912.393424 secs 2024-07-26T11:04:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:13 smithi043 ceph-mon[32384]: pgmap v5249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:13 smithi133 ceph-mon[37053]: pgmap v5249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:13 smithi063 ceph-mon[36747]: pgmap v5249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:15 smithi043 ceph-mon[32384]: pgmap v5250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:15 smithi133 ceph-mon[37053]: pgmap v5250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:15 smithi063 ceph-mon[36747]: pgmap v5250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8901.911249 secs 2024-07-26T11:04:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8917.393545 secs 2024-07-26T11:04:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8901.911249 secs 2024-07-26T11:04:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8917.393545 secs 2024-07-26T11:04:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8901.911249 secs 2024-07-26T11:04:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8917.393545 secs 2024-07-26T11:04:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:17 smithi043 ceph-mon[32384]: pgmap v5251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:17 smithi133 ceph-mon[37053]: pgmap v5251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:17 smithi063 ceph-mon[36747]: pgmap v5251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:19 smithi043 ceph-mon[32384]: pgmap v5252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:19 smithi133 ceph-mon[37053]: pgmap v5252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:19 smithi063 ceph-mon[36747]: pgmap v5252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:21 smithi043 ceph-mon[32384]: pgmap v5253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8906.911392 secs 2024-07-26T11:04:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8922.393641 secs 2024-07-26T11:04:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:21 smithi133 ceph-mon[37053]: pgmap v5253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8906.911392 secs 2024-07-26T11:04:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8922.393641 secs 2024-07-26T11:04:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:21 smithi063 ceph-mon[36747]: pgmap v5253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8906.911392 secs 2024-07-26T11:04:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8922.393641 secs 2024-07-26T11:04:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:23 smithi043 ceph-mon[32384]: pgmap v5254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:23 smithi133 ceph-mon[37053]: pgmap v5254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:23 smithi063 ceph-mon[36747]: pgmap v5254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:25 smithi043 ceph-mon[32384]: pgmap v5255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:25 smithi133 ceph-mon[37053]: pgmap v5255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:25 smithi063 ceph-mon[36747]: pgmap v5255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8911.911514 secs 2024-07-26T11:04:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8927.393734 secs 2024-07-26T11:04:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8911.911514 secs 2024-07-26T11:04:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8927.393734 secs 2024-07-26T11:04:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8911.911514 secs 2024-07-26T11:04:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8927.393734 secs 2024-07-26T11:04:27.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:27 smithi043 ceph-mon[32384]: pgmap v5256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:27 smithi133 ceph-mon[37053]: pgmap v5256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:27 smithi063 ceph-mon[36747]: pgmap v5256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:29 smithi043 ceph-mon[32384]: pgmap v5257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:29 smithi133 ceph-mon[37053]: pgmap v5257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:29 smithi063 ceph-mon[36747]: pgmap v5257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:31 smithi043 ceph-mon[32384]: pgmap v5258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8916.911597 secs 2024-07-26T11:04:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8932.393832 secs 2024-07-26T11:04:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:31 smithi133 ceph-mon[37053]: pgmap v5258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8916.911597 secs 2024-07-26T11:04:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8932.393832 secs 2024-07-26T11:04:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:31 smithi063 ceph-mon[36747]: pgmap v5258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8916.911597 secs 2024-07-26T11:04:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8932.393832 secs 2024-07-26T11:04:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:33 smithi043 ceph-mon[32384]: pgmap v5259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:33 smithi133 ceph-mon[37053]: pgmap v5259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:33 smithi063 ceph-mon[36747]: pgmap v5259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:35 smithi043 ceph-mon[32384]: pgmap v5260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:35 smithi133 ceph-mon[37053]: pgmap v5260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:35 smithi063 ceph-mon[36747]: pgmap v5260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8921.911719 secs 2024-07-26T11:04:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8937.393956 secs 2024-07-26T11:04:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8921.911719 secs 2024-07-26T11:04:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8937.393956 secs 2024-07-26T11:04:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8921.911719 secs 2024-07-26T11:04:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8937.393956 secs 2024-07-26T11:04:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:37 smithi043 ceph-mon[32384]: pgmap v5261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:37 smithi133 ceph-mon[37053]: pgmap v5261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:37.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:37 smithi063 ceph-mon[36747]: pgmap v5261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:39.468 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:39 smithi063 ceph-mon[36747]: pgmap v5262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:39.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:04:39.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:39 smithi133 ceph-mon[37053]: pgmap v5262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:39.472 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:04:39.473 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.473 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.473 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.473 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:39 smithi043 ceph-mon[32384]: pgmap v5262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:39.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:04:39.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:39.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: pgmap v5263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8926.911804 secs 2024-07-26T11:04:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8942.394024 secs 2024-07-26T11:04:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: pgmap v5263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8926.911804 secs 2024-07-26T11:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8942.394024 secs 2024-07-26T11:04:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: pgmap v5263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8926.911804 secs 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8942.394024 secs 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:43 smithi063 ceph-mon[36747]: pgmap v5264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:43 smithi043 ceph-mon[32384]: pgmap v5264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:43 smithi133 ceph-mon[37053]: pgmap v5264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:04:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:04:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:04:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:04:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:04:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:04:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:04:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:45 smithi063 ceph-mon[36747]: pgmap v5265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:04:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:45 smithi063 ceph-mon[36747]: pgmap v5266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:45 smithi043 ceph-mon[32384]: pgmap v5265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:04:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:45 smithi043 ceph-mon[32384]: pgmap v5266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:45 smithi133 ceph-mon[37053]: pgmap v5265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:04:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:45 smithi133 ceph-mon[37053]: pgmap v5266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8931.911923 secs 2024-07-26T11:04:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8947.394142 secs 2024-07-26T11:04:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8931.911923 secs 2024-07-26T11:04:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8947.394142 secs 2024-07-26T11:04:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8931.911923 secs 2024-07-26T11:04:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8947.394142 secs 2024-07-26T11:04:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:47 smithi063 ceph-mon[36747]: pgmap v5267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:47 smithi043 ceph-mon[32384]: pgmap v5267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:47 smithi133 ceph-mon[37053]: pgmap v5267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:49 smithi063 ceph-mon[36747]: pgmap v5268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:49 smithi043 ceph-mon[32384]: pgmap v5268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:49 smithi133 ceph-mon[37053]: pgmap v5268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:51 smithi063 ceph-mon[36747]: pgmap v5269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8936.912040 secs 2024-07-26T11:04:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8952.394292 secs 2024-07-26T11:04:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:51 smithi043 ceph-mon[32384]: pgmap v5269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8936.912040 secs 2024-07-26T11:04:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8952.394292 secs 2024-07-26T11:04:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:51 smithi133 ceph-mon[37053]: pgmap v5269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8936.912040 secs 2024-07-26T11:04:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8952.394292 secs 2024-07-26T11:04:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:53 smithi043 ceph-mon[32384]: pgmap v5270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:53 smithi133 ceph-mon[37053]: pgmap v5270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:53 smithi063 ceph-mon[36747]: pgmap v5270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:55 smithi043 ceph-mon[32384]: pgmap v5271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:04:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:55 smithi133 ceph-mon[37053]: pgmap v5271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:04:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:55 smithi063 ceph-mon[36747]: pgmap v5271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:04:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8941.912178 secs 2024-07-26T11:04:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8957.394416 secs 2024-07-26T11:04:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8941.912178 secs 2024-07-26T11:04:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8957.394416 secs 2024-07-26T11:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8941.912178 secs 2024-07-26T11:04:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8957.394416 secs 2024-07-26T11:04:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:57 smithi043 ceph-mon[32384]: pgmap v5272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:57 smithi133 ceph-mon[37053]: pgmap v5272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:57 smithi063 ceph-mon[36747]: pgmap v5272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:04:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:04:59 smithi043 ceph-mon[32384]: pgmap v5273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:04:59 smithi133 ceph-mon[37053]: pgmap v5273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:04:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:04:59 smithi063 ceph-mon[36747]: pgmap v5273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:01.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:01 smithi063 ceph-mon[36747]: pgmap v5274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:01.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8946.912303 secs 2024-07-26T11:05:01.620 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8962.394514 secs 2024-07-26T11:05:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:01 smithi043 ceph-mon[32384]: pgmap v5274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8946.912303 secs 2024-07-26T11:05:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8962.394514 secs 2024-07-26T11:05:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:01 smithi133 ceph-mon[37053]: pgmap v5274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8946.912303 secs 2024-07-26T11:05:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8962.394514 secs 2024-07-26T11:05:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:03 smithi043 ceph-mon[32384]: pgmap v5275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:03 smithi133 ceph-mon[37053]: pgmap v5275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:03 smithi063 ceph-mon[36747]: pgmap v5275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:05 smithi043 ceph-mon[32384]: pgmap v5276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:05 smithi133 ceph-mon[37053]: pgmap v5276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:05 smithi063 ceph-mon[36747]: pgmap v5276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8951.912419 secs 2024-07-26T11:05:06.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8967.394654 secs 2024-07-26T11:05:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8951.912419 secs 2024-07-26T11:05:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8967.394654 secs 2024-07-26T11:05:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8951.912419 secs 2024-07-26T11:05:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8967.394654 secs 2024-07-26T11:05:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:07 smithi043 ceph-mon[32384]: pgmap v5277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:07 smithi133 ceph-mon[37053]: pgmap v5277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:07 smithi063 ceph-mon[36747]: pgmap v5277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:09 smithi043 ceph-mon[32384]: pgmap v5278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:09 smithi133 ceph-mon[37053]: pgmap v5278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:09 smithi063 ceph-mon[36747]: pgmap v5278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:11 smithi043 ceph-mon[32384]: pgmap v5279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8956.912537 secs 2024-07-26T11:05:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8972.394792 secs 2024-07-26T11:05:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:11 smithi133 ceph-mon[37053]: pgmap v5279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8956.912537 secs 2024-07-26T11:05:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8972.394792 secs 2024-07-26T11:05:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:11 smithi063 ceph-mon[36747]: pgmap v5279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8956.912537 secs 2024-07-26T11:05:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8972.394792 secs 2024-07-26T11:05:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:13 smithi043 ceph-mon[32384]: pgmap v5280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:13 smithi133 ceph-mon[37053]: pgmap v5280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:13 smithi063 ceph-mon[36747]: pgmap v5280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:15 smithi043 ceph-mon[32384]: pgmap v5281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:15 smithi133 ceph-mon[37053]: pgmap v5281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:15 smithi063 ceph-mon[36747]: pgmap v5281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8961.912601 secs 2024-07-26T11:05:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8977.394911 secs 2024-07-26T11:05:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8961.912601 secs 2024-07-26T11:05:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8977.394911 secs 2024-07-26T11:05:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8961.912601 secs 2024-07-26T11:05:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8977.394911 secs 2024-07-26T11:05:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:17 smithi043 ceph-mon[32384]: pgmap v5282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:17 smithi133 ceph-mon[37053]: pgmap v5282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:17 smithi063 ceph-mon[36747]: pgmap v5282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:19 smithi043 ceph-mon[32384]: pgmap v5283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:19 smithi133 ceph-mon[37053]: pgmap v5283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:19 smithi063 ceph-mon[36747]: pgmap v5283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:21 smithi043 ceph-mon[32384]: pgmap v5284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8966.912735 secs 2024-07-26T11:05:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8982.395027 secs 2024-07-26T11:05:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:21 smithi133 ceph-mon[37053]: pgmap v5284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8966.912735 secs 2024-07-26T11:05:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8982.395027 secs 2024-07-26T11:05:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:21 smithi063 ceph-mon[36747]: pgmap v5284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8966.912735 secs 2024-07-26T11:05:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8982.395027 secs 2024-07-26T11:05:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:23 smithi043 ceph-mon[32384]: pgmap v5285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:23 smithi133 ceph-mon[37053]: pgmap v5285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:23 smithi063 ceph-mon[36747]: pgmap v5285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:25 smithi043 ceph-mon[32384]: pgmap v5286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:25 smithi133 ceph-mon[37053]: pgmap v5286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:25 smithi063 ceph-mon[36747]: pgmap v5286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8971.912870 secs 2024-07-26T11:05:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8987.395145 secs 2024-07-26T11:05:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8971.912870 secs 2024-07-26T11:05:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8987.395145 secs 2024-07-26T11:05:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8971.912870 secs 2024-07-26T11:05:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8987.395145 secs 2024-07-26T11:05:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:27 smithi043 ceph-mon[32384]: pgmap v5287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:27 smithi133 ceph-mon[37053]: pgmap v5287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:27 smithi063 ceph-mon[36747]: pgmap v5287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:28 smithi043 ceph-mon[32384]: pgmap v5288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:28 smithi133 ceph-mon[37053]: pgmap v5288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:28 smithi063 ceph-mon[36747]: pgmap v5288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:30 smithi043 ceph-mon[32384]: pgmap v5289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8976.913011 secs 2024-07-26T11:05:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:30 smithi133 ceph-mon[37053]: pgmap v5289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8976.913011 secs 2024-07-26T11:05:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:30 smithi063 ceph-mon[36747]: pgmap v5289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8976.913011 secs 2024-07-26T11:05:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8992.395268 secs 2024-07-26T11:05:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8992.395268 secs 2024-07-26T11:05:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8992.395268 secs 2024-07-26T11:05:32.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:32 smithi043 ceph-mon[32384]: pgmap v5290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:32 smithi133 ceph-mon[37053]: pgmap v5290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:32 smithi063 ceph-mon[36747]: pgmap v5290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:34 smithi043 ceph-mon[32384]: pgmap v5291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:34 smithi133 ceph-mon[37053]: pgmap v5291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:34 smithi063 ceph-mon[36747]: pgmap v5291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8981.913154 secs 2024-07-26T11:05:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8981.913154 secs 2024-07-26T11:05:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8981.913154 secs 2024-07-26T11:05:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:36 smithi043 ceph-mon[32384]: pgmap v5292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 8997.395388 secs 2024-07-26T11:05:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:36 smithi133 ceph-mon[37053]: pgmap v5292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 8997.395388 secs 2024-07-26T11:05:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:36 smithi063 ceph-mon[36747]: pgmap v5292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 8997.395388 secs 2024-07-26T11:05:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:38 smithi043 ceph-mon[32384]: pgmap v5293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:38 smithi133 ceph-mon[37053]: pgmap v5293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:38 smithi063 ceph-mon[36747]: pgmap v5293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:40 smithi133 ceph-mon[37053]: pgmap v5294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8986.913273 secs 2024-07-26T11:05:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:40 smithi063 ceph-mon[36747]: pgmap v5294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8986.913273 secs 2024-07-26T11:05:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:40 smithi043 ceph-mon[32384]: pgmap v5294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:05:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8986.913273 secs 2024-07-26T11:05:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9002.395514 secs 2024-07-26T11:05:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9002.395514 secs 2024-07-26T11:05:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9002.395514 secs 2024-07-26T11:05:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:42 smithi133 ceph-mon[37053]: pgmap v5295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:42 smithi063 ceph-mon[36747]: pgmap v5295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:42 smithi043 ceph-mon[32384]: pgmap v5295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:44 smithi133 ceph-mon[37053]: pgmap v5296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:44 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:05:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:44 smithi063 ceph-mon[36747]: pgmap v5296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:44 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:05:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:44 smithi043 ceph-mon[32384]: pgmap v5296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:05:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:44 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:05:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:05:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:05:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:45 smithi063 ceph-mon[36747]: pgmap v5297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:05:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8991.913355 secs 2024-07-26T11:05:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:05:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:05:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:45 smithi043 ceph-mon[32384]: pgmap v5297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:05:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8991.913355 secs 2024-07-26T11:05:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:05:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:05:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:45 smithi133 ceph-mon[37053]: pgmap v5297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:05:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8991.913355 secs 2024-07-26T11:05:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9007.395633 secs 2024-07-26T11:05:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9007.395633 secs 2024-07-26T11:05:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9007.395633 secs 2024-07-26T11:05:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:47 smithi063 ceph-mon[36747]: pgmap v5298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:47 smithi043 ceph-mon[32384]: pgmap v5298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:47 smithi133 ceph-mon[37053]: pgmap v5298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:49 smithi043 ceph-mon[32384]: pgmap v5299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:05:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:49 smithi133 ceph-mon[37053]: pgmap v5299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:05:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:49 smithi063 ceph-mon[36747]: pgmap v5299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:05:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 8996.913454 secs 2024-07-26T11:05:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9012.395756 secs 2024-07-26T11:05:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 8996.913454 secs 2024-07-26T11:05:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9012.395756 secs 2024-07-26T11:05:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 8996.913454 secs 2024-07-26T11:05:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9012.395756 secs 2024-07-26T11:05:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:51 smithi043 ceph-mon[32384]: pgmap v5300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:05:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:51 smithi133 ceph-mon[37053]: pgmap v5300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:05:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:51 smithi063 ceph-mon[36747]: pgmap v5300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:05:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:53 smithi043 ceph-mon[32384]: pgmap v5301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:05:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:53 smithi133 ceph-mon[37053]: pgmap v5301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:05:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:53 smithi063 ceph-mon[36747]: pgmap v5301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:05:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:55 smithi043 ceph-mon[32384]: pgmap v5302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9001.913572 secs 2024-07-26T11:05:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9017.395878 secs 2024-07-26T11:05:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:55 smithi133 ceph-mon[37053]: pgmap v5302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9001.913572 secs 2024-07-26T11:05:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9017.395878 secs 2024-07-26T11:05:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:55 smithi063 ceph-mon[36747]: pgmap v5302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:05:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9001.913572 secs 2024-07-26T11:05:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9017.395878 secs 2024-07-26T11:05:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:57 smithi043 ceph-mon[32384]: pgmap v5303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:57 smithi133 ceph-mon[37053]: pgmap v5303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:05:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:57 smithi063 ceph-mon[36747]: pgmap v5303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:05:59 smithi043 ceph-mon[32384]: pgmap v5304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:05:59 smithi133 ceph-mon[37053]: pgmap v5304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:05:59 smithi063 ceph-mon[36747]: pgmap v5304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9006.913690 secs 2024-07-26T11:06:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:00 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9022.395942 secs 2024-07-26T11:06:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9006.913690 secs 2024-07-26T11:06:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:00 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9022.395942 secs 2024-07-26T11:06:01.339 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9006.913690 secs 2024-07-26T11:06:01.340 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:00 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9022.395942 secs 2024-07-26T11:06:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:01 smithi133 ceph-mon[37053]: pgmap v5305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:01 smithi063 ceph-mon[36747]: pgmap v5305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:01 smithi043 ceph-mon[32384]: pgmap v5305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:03 smithi133 ceph-mon[37053]: pgmap v5306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:03 smithi063 ceph-mon[36747]: pgmap v5306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:03 smithi043 ceph-mon[32384]: pgmap v5306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:06 smithi133 ceph-mon[37053]: pgmap v5307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9011.913820 secs 2024-07-26T11:06:06.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9027.396058 secs 2024-07-26T11:06:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:06 smithi063 ceph-mon[36747]: pgmap v5307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9011.913820 secs 2024-07-26T11:06:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9027.396058 secs 2024-07-26T11:06:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:06 smithi043 ceph-mon[32384]: pgmap v5307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9011.913820 secs 2024-07-26T11:06:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9027.396058 secs 2024-07-26T11:06:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:08 smithi133 ceph-mon[37053]: pgmap v5308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:08 smithi063 ceph-mon[36747]: pgmap v5308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:08 smithi043 ceph-mon[32384]: pgmap v5308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:10 smithi133 ceph-mon[37053]: pgmap v5309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:10 smithi063 ceph-mon[36747]: pgmap v5309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:10 smithi043 ceph-mon[32384]: pgmap v5309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9016.913961 secs 2024-07-26T11:06:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9032.396181 secs 2024-07-26T11:06:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9016.913961 secs 2024-07-26T11:06:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9032.396181 secs 2024-07-26T11:06:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9016.913961 secs 2024-07-26T11:06:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9032.396181 secs 2024-07-26T11:06:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:12 smithi063 ceph-mon[36747]: pgmap v5310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:12 smithi043 ceph-mon[32384]: pgmap v5310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:12 smithi133 ceph-mon[37053]: pgmap v5310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:14.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:14 smithi063 ceph-mon[36747]: pgmap v5311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:14 smithi043 ceph-mon[32384]: pgmap v5311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:14 smithi133 ceph-mon[37053]: pgmap v5311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:16 smithi063 ceph-mon[36747]: pgmap v5312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9021.914120 secs 2024-07-26T11:06:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9037.396310 secs 2024-07-26T11:06:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:16 smithi043 ceph-mon[32384]: pgmap v5312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9021.914120 secs 2024-07-26T11:06:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9037.396310 secs 2024-07-26T11:06:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:16 smithi133 ceph-mon[37053]: pgmap v5312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9021.914120 secs 2024-07-26T11:06:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9037.396310 secs 2024-07-26T11:06:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:18 smithi063 ceph-mon[36747]: pgmap v5313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:18 smithi043 ceph-mon[32384]: pgmap v5313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:18 smithi133 ceph-mon[37053]: pgmap v5313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:20 smithi063 ceph-mon[36747]: pgmap v5314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:20 smithi043 ceph-mon[32384]: pgmap v5314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:20 smithi133 ceph-mon[37053]: pgmap v5314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9026.914218 secs 2024-07-26T11:06:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9042.396388 secs 2024-07-26T11:06:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9026.914218 secs 2024-07-26T11:06:21.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9042.396388 secs 2024-07-26T11:06:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9026.914218 secs 2024-07-26T11:06:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9042.396388 secs 2024-07-26T11:06:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:22 smithi063 ceph-mon[36747]: pgmap v5315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:22 smithi043 ceph-mon[32384]: pgmap v5315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:22 smithi133 ceph-mon[37053]: pgmap v5315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:24 smithi043 ceph-mon[32384]: pgmap v5316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:24 smithi133 ceph-mon[37053]: pgmap v5316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:24 smithi063 ceph-mon[36747]: pgmap v5316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:26 smithi043 ceph-mon[32384]: pgmap v5317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9031.914337 secs 2024-07-26T11:06:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9047.396506 secs 2024-07-26T11:06:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:26 smithi133 ceph-mon[37053]: pgmap v5317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9031.914337 secs 2024-07-26T11:06:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9047.396506 secs 2024-07-26T11:06:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:26 smithi063 ceph-mon[36747]: pgmap v5317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9031.914337 secs 2024-07-26T11:06:26.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9047.396506 secs 2024-07-26T11:06:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:28 smithi043 ceph-mon[32384]: pgmap v5318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:28 smithi133 ceph-mon[37053]: pgmap v5318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:28 smithi063 ceph-mon[36747]: pgmap v5318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:30 smithi043 ceph-mon[32384]: pgmap v5319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:30 smithi133 ceph-mon[37053]: pgmap v5319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:30 smithi063 ceph-mon[36747]: pgmap v5319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:31.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9036.914453 secs 2024-07-26T11:06:31.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9052.396626 secs 2024-07-26T11:06:31.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9036.914453 secs 2024-07-26T11:06:31.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9052.396626 secs 2024-07-26T11:06:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9036.914453 secs 2024-07-26T11:06:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9052.396626 secs 2024-07-26T11:06:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:32 smithi043 ceph-mon[32384]: pgmap v5320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:32 smithi133 ceph-mon[37053]: pgmap v5320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:32 smithi063 ceph-mon[36747]: pgmap v5320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:34 smithi043 ceph-mon[32384]: pgmap v5321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:34 smithi133 ceph-mon[37053]: pgmap v5321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:34 smithi063 ceph-mon[36747]: pgmap v5321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:36 smithi043 ceph-mon[32384]: pgmap v5322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9041.914520 secs 2024-07-26T11:06:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9057.396724 secs 2024-07-26T11:06:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:36 smithi133 ceph-mon[37053]: pgmap v5322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9041.914520 secs 2024-07-26T11:06:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9057.396724 secs 2024-07-26T11:06:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:36 smithi063 ceph-mon[36747]: pgmap v5322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9041.914520 secs 2024-07-26T11:06:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9057.396724 secs 2024-07-26T11:06:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:38 smithi043 ceph-mon[32384]: pgmap v5323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:38 smithi133 ceph-mon[37053]: pgmap v5323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:38 smithi063 ceph-mon[36747]: pgmap v5323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:40 smithi043 ceph-mon[32384]: pgmap v5324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:40 smithi133 ceph-mon[37053]: pgmap v5324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:40 smithi063 ceph-mon[36747]: pgmap v5324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9046.914648 secs 2024-07-26T11:06:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9062.396821 secs 2024-07-26T11:06:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9046.914648 secs 2024-07-26T11:06:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9062.396821 secs 2024-07-26T11:06:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9046.914648 secs 2024-07-26T11:06:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9062.396821 secs 2024-07-26T11:06:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:42 smithi043 ceph-mon[32384]: pgmap v5325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:42 smithi133 ceph-mon[37053]: pgmap v5325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:42 smithi063 ceph-mon[36747]: pgmap v5325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:06:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:44 smithi043 ceph-mon[32384]: pgmap v5326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:44 smithi133 ceph-mon[37053]: pgmap v5326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:44 smithi063 ceph-mon[36747]: pgmap v5326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:06:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:06:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:06:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:46 smithi043 ceph-mon[32384]: pgmap v5327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9051.914741 secs 2024-07-26T11:06:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9067.396919 secs 2024-07-26T11:06:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:06:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:06:46.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:06:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:46 smithi133 ceph-mon[37053]: pgmap v5327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9051.914741 secs 2024-07-26T11:06:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9067.396919 secs 2024-07-26T11:06:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:06:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:06:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:06:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:46 smithi063 ceph-mon[36747]: pgmap v5327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:06:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9051.914741 secs 2024-07-26T11:06:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9067.396919 secs 2024-07-26T11:06:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:06:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:06:46.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:06:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:47 smithi043 ceph-mon[32384]: pgmap v5328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:47 smithi043 ceph-mon[32384]: pgmap v5329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:47 smithi133 ceph-mon[37053]: pgmap v5328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:47 smithi133 ceph-mon[37053]: pgmap v5329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:47 smithi063 ceph-mon[36747]: pgmap v5328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:47 smithi063 ceph-mon[36747]: pgmap v5329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:49 smithi043 ceph-mon[32384]: pgmap v5330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:06:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:49 smithi133 ceph-mon[37053]: pgmap v5330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:06:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:49 smithi063 ceph-mon[36747]: pgmap v5330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:06:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:51 smithi043 ceph-mon[32384]: pgmap v5331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:06:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9056.914862 secs 2024-07-26T11:06:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9072.397011 secs 2024-07-26T11:06:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:51 smithi133 ceph-mon[37053]: pgmap v5331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:06:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9056.914862 secs 2024-07-26T11:06:51.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9072.397011 secs 2024-07-26T11:06:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:51 smithi063 ceph-mon[36747]: pgmap v5331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:06:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9056.914862 secs 2024-07-26T11:06:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9072.397011 secs 2024-07-26T11:06:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:53 smithi043 ceph-mon[32384]: pgmap v5332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:06:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:53 smithi133 ceph-mon[37053]: pgmap v5332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:06:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:53 smithi063 ceph-mon[36747]: pgmap v5332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:06:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:55 smithi043 ceph-mon[32384]: pgmap v5333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:55 smithi133 ceph-mon[37053]: pgmap v5333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:55 smithi063 ceph-mon[36747]: pgmap v5333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:06:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9061.914928 secs 2024-07-26T11:06:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9077.397144 secs 2024-07-26T11:06:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9061.914928 secs 2024-07-26T11:06:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9077.397144 secs 2024-07-26T11:06:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9061.914928 secs 2024-07-26T11:06:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9077.397144 secs 2024-07-26T11:06:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:57 smithi043 ceph-mon[32384]: pgmap v5334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:06:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:57 smithi133 ceph-mon[37053]: pgmap v5334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:06:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:57 smithi063 ceph-mon[36747]: pgmap v5334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:06:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:06:59 smithi043 ceph-mon[32384]: pgmap v5335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:06:59 smithi133 ceph-mon[37053]: pgmap v5335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:06:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:06:59 smithi063 ceph-mon[36747]: pgmap v5335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:01 smithi043 ceph-mon[32384]: pgmap v5336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9066.915007 secs 2024-07-26T11:07:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9082.397260 secs 2024-07-26T11:07:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:01 smithi133 ceph-mon[37053]: pgmap v5336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9066.915007 secs 2024-07-26T11:07:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9082.397260 secs 2024-07-26T11:07:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:01 smithi063 ceph-mon[36747]: pgmap v5336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9066.915007 secs 2024-07-26T11:07:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9082.397260 secs 2024-07-26T11:07:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:03 smithi043 ceph-mon[32384]: pgmap v5337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:03 smithi133 ceph-mon[37053]: pgmap v5337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:03 smithi063 ceph-mon[36747]: pgmap v5337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:05 smithi133 ceph-mon[37053]: pgmap v5338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:05 smithi063 ceph-mon[36747]: pgmap v5338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:05 smithi043 ceph-mon[32384]: pgmap v5338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9071.915166 secs 2024-07-26T11:07:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9087.397389 secs 2024-07-26T11:07:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9071.915166 secs 2024-07-26T11:07:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9087.397389 secs 2024-07-26T11:07:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9071.915166 secs 2024-07-26T11:07:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9087.397389 secs 2024-07-26T11:07:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:07 smithi133 ceph-mon[37053]: pgmap v5339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:07 smithi063 ceph-mon[36747]: pgmap v5339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:07 smithi043 ceph-mon[32384]: pgmap v5339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:09 smithi133 ceph-mon[37053]: pgmap v5340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:09 smithi063 ceph-mon[36747]: pgmap v5340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:09 smithi043 ceph-mon[32384]: pgmap v5340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:11 smithi133 ceph-mon[37053]: pgmap v5341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9076.915275 secs 2024-07-26T11:07:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9092.397528 secs 2024-07-26T11:07:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:11 smithi063 ceph-mon[36747]: pgmap v5341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9076.915275 secs 2024-07-26T11:07:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9092.397528 secs 2024-07-26T11:07:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:11 smithi043 ceph-mon[32384]: pgmap v5341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9076.915275 secs 2024-07-26T11:07:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9092.397528 secs 2024-07-26T11:07:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:13 smithi133 ceph-mon[37053]: pgmap v5342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:13.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:13 smithi063 ceph-mon[36747]: pgmap v5342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:13 smithi043 ceph-mon[32384]: pgmap v5342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:15 smithi063 ceph-mon[36747]: pgmap v5343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:15 smithi043 ceph-mon[32384]: pgmap v5343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:15 smithi133 ceph-mon[37053]: pgmap v5343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9081.915390 secs 2024-07-26T11:07:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9097.397657 secs 2024-07-26T11:07:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9081.915390 secs 2024-07-26T11:07:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9097.397657 secs 2024-07-26T11:07:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9081.915390 secs 2024-07-26T11:07:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9097.397657 secs 2024-07-26T11:07:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:17 smithi063 ceph-mon[36747]: pgmap v5344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:17 smithi043 ceph-mon[32384]: pgmap v5344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:17 smithi133 ceph-mon[37053]: pgmap v5344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:19 smithi043 ceph-mon[32384]: pgmap v5345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:19 smithi063 ceph-mon[36747]: pgmap v5345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:19 smithi133 ceph-mon[37053]: pgmap v5345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:21 smithi063 ceph-mon[36747]: pgmap v5346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9086.915508 secs 2024-07-26T11:07:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9102.397786 secs 2024-07-26T11:07:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:21 smithi043 ceph-mon[32384]: pgmap v5346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9086.915508 secs 2024-07-26T11:07:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9102.397786 secs 2024-07-26T11:07:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:21 smithi133 ceph-mon[37053]: pgmap v5346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9086.915508 secs 2024-07-26T11:07:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9102.397786 secs 2024-07-26T11:07:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:23 smithi063 ceph-mon[36747]: pgmap v5347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:23 smithi043 ceph-mon[32384]: pgmap v5347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:23 smithi133 ceph-mon[37053]: pgmap v5347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:25 smithi063 ceph-mon[36747]: pgmap v5348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:25 smithi043 ceph-mon[32384]: pgmap v5348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:25 smithi133 ceph-mon[37053]: pgmap v5348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9091.915645 secs 2024-07-26T11:07:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9107.397885 secs 2024-07-26T11:07:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9091.915645 secs 2024-07-26T11:07:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9107.397885 secs 2024-07-26T11:07:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9091.915645 secs 2024-07-26T11:07:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9107.397885 secs 2024-07-26T11:07:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:27 smithi043 ceph-mon[32384]: pgmap v5349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:27 smithi133 ceph-mon[37053]: pgmap v5349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:27 smithi063 ceph-mon[36747]: pgmap v5349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:29 smithi043 ceph-mon[32384]: pgmap v5350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:29 smithi133 ceph-mon[37053]: pgmap v5350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:29 smithi063 ceph-mon[36747]: pgmap v5350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:31.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:31 smithi063 ceph-mon[36747]: pgmap v5351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:31.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9096.915772 secs 2024-07-26T11:07:31.621 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9112.398029 secs 2024-07-26T11:07:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:31 smithi043 ceph-mon[32384]: pgmap v5351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9096.915772 secs 2024-07-26T11:07:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9112.398029 secs 2024-07-26T11:07:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:31 smithi133 ceph-mon[37053]: pgmap v5351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9096.915772 secs 2024-07-26T11:07:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9112.398029 secs 2024-07-26T11:07:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:33 smithi043 ceph-mon[32384]: pgmap v5352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:33 smithi133 ceph-mon[37053]: pgmap v5352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:33 smithi063 ceph-mon[36747]: pgmap v5352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:35 smithi043 ceph-mon[32384]: pgmap v5353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:35 smithi133 ceph-mon[37053]: pgmap v5353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:35 smithi063 ceph-mon[36747]: pgmap v5353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9101.915895 secs 2024-07-26T11:07:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9117.398152 secs 2024-07-26T11:07:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9101.915895 secs 2024-07-26T11:07:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9117.398152 secs 2024-07-26T11:07:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9101.915895 secs 2024-07-26T11:07:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9117.398152 secs 2024-07-26T11:07:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:37 smithi043 ceph-mon[32384]: pgmap v5354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:37 smithi133 ceph-mon[37053]: pgmap v5354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:37 smithi063 ceph-mon[36747]: pgmap v5354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:39 smithi043 ceph-mon[32384]: pgmap v5355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:39 smithi133 ceph-mon[37053]: pgmap v5355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:39 smithi063 ceph-mon[36747]: pgmap v5355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:41 smithi043 ceph-mon[32384]: pgmap v5356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9106.916014 secs 2024-07-26T11:07:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9122.398275 secs 2024-07-26T11:07:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:41 smithi133 ceph-mon[37053]: pgmap v5356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9106.916014 secs 2024-07-26T11:07:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9122.398275 secs 2024-07-26T11:07:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:41 smithi063 ceph-mon[36747]: pgmap v5356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:07:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9106.916014 secs 2024-07-26T11:07:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9122.398275 secs 2024-07-26T11:07:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:43 smithi043 ceph-mon[32384]: pgmap v5357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:43 smithi133 ceph-mon[37053]: pgmap v5357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:43 smithi063 ceph-mon[36747]: pgmap v5357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:45 smithi043 ceph-mon[32384]: pgmap v5358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:45 smithi133 ceph-mon[37053]: pgmap v5358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:45 smithi063 ceph-mon[36747]: pgmap v5358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:07:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9111.916183 secs 2024-07-26T11:07:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9127.398367 secs 2024-07-26T11:07:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9111.916183 secs 2024-07-26T11:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9127.398367 secs 2024-07-26T11:07:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9111.916183 secs 2024-07-26T11:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9127.398367 secs 2024-07-26T11:07:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:07:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:47 smithi043 ceph-mon[32384]: pgmap v5359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:07:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:07:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:47 smithi133 ceph-mon[37053]: pgmap v5359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:07:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:07:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:47 smithi063 ceph-mon[36747]: pgmap v5359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:07:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:07:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:07:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:48 smithi043 ceph-mon[32384]: pgmap v5360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:07:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:48 smithi043 ceph-mon[32384]: pgmap v5361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:07:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:07:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:48 smithi133 ceph-mon[37053]: pgmap v5360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:07:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:48 smithi133 ceph-mon[37053]: pgmap v5361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:07:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:07:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:48 smithi063 ceph-mon[36747]: pgmap v5360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:07:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:48 smithi063 ceph-mon[36747]: pgmap v5361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:07:48.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:07:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:50 smithi043 ceph-mon[32384]: pgmap v5362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:07:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:50 smithi133 ceph-mon[37053]: pgmap v5362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:07:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:50 smithi063 ceph-mon[36747]: pgmap v5362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:07:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9116.916248 secs 2024-07-26T11:07:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9132.398484 secs 2024-07-26T11:07:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9116.916248 secs 2024-07-26T11:07:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9132.398484 secs 2024-07-26T11:07:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9116.916248 secs 2024-07-26T11:07:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9132.398484 secs 2024-07-26T11:07:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:52 smithi043 ceph-mon[32384]: pgmap v5363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:07:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:52 smithi133 ceph-mon[37053]: pgmap v5363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:07:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:52 smithi063 ceph-mon[36747]: pgmap v5363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:07:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:54 smithi043 ceph-mon[32384]: pgmap v5364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:07:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:54 smithi133 ceph-mon[37053]: pgmap v5364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:07:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:54 smithi063 ceph-mon[36747]: pgmap v5364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:07:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9121.916370 secs 2024-07-26T11:07:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:56 smithi043 ceph-mon[32384]: pgmap v5365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:07:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9137.398624 secs 2024-07-26T11:07:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9121.916370 secs 2024-07-26T11:07:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:56 smithi133 ceph-mon[37053]: pgmap v5365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:07:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9137.398624 secs 2024-07-26T11:07:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9121.916370 secs 2024-07-26T11:07:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:56 smithi063 ceph-mon[36747]: pgmap v5365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:07:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9137.398624 secs 2024-07-26T11:07:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:07:58 smithi043 ceph-mon[32384]: pgmap v5366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:07:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:07:58 smithi133 ceph-mon[37053]: pgmap v5366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:07:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:07:58 smithi063 ceph-mon[36747]: pgmap v5366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:08:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:00 smithi043 ceph-mon[32384]: pgmap v5367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:00 smithi133 ceph-mon[37053]: pgmap v5367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:00 smithi063 ceph-mon[36747]: pgmap v5367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:01.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9126.916436 secs 2024-07-26T11:08:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9142.398768 secs 2024-07-26T11:08:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9126.916436 secs 2024-07-26T11:08:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9142.398768 secs 2024-07-26T11:08:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9126.916436 secs 2024-07-26T11:08:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9142.398768 secs 2024-07-26T11:08:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:02 smithi043 ceph-mon[32384]: pgmap v5368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:02 smithi133 ceph-mon[37053]: pgmap v5368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:02 smithi063 ceph-mon[36747]: pgmap v5368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:04 smithi043 ceph-mon[32384]: pgmap v5369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:04 smithi133 ceph-mon[37053]: pgmap v5369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:04 smithi063 ceph-mon[36747]: pgmap v5369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9131.916562 secs 2024-07-26T11:08:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:06 smithi043 ceph-mon[32384]: pgmap v5370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9147.398902 secs 2024-07-26T11:08:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9131.916562 secs 2024-07-26T11:08:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:06 smithi133 ceph-mon[37053]: pgmap v5370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9147.398902 secs 2024-07-26T11:08:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9131.916562 secs 2024-07-26T11:08:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:06 smithi063 ceph-mon[36747]: pgmap v5370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9147.398902 secs 2024-07-26T11:08:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:08 smithi043 ceph-mon[32384]: pgmap v5371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:08 smithi133 ceph-mon[37053]: pgmap v5371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:08 smithi063 ceph-mon[36747]: pgmap v5371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:10 smithi133 ceph-mon[37053]: pgmap v5372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:10 smithi063 ceph-mon[36747]: pgmap v5372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:10 smithi043 ceph-mon[32384]: pgmap v5372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9136.916681 secs 2024-07-26T11:08:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9152.399039 secs 2024-07-26T11:08:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9136.916681 secs 2024-07-26T11:08:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9152.399039 secs 2024-07-26T11:08:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9136.916681 secs 2024-07-26T11:08:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9152.399039 secs 2024-07-26T11:08:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:12 smithi133 ceph-mon[37053]: pgmap v5373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:12 smithi063 ceph-mon[36747]: pgmap v5373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:12 smithi043 ceph-mon[32384]: pgmap v5373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:13 smithi133 ceph-mon[37053]: pgmap v5374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:13 smithi063 ceph-mon[36747]: pgmap v5374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:13 smithi043 ceph-mon[32384]: pgmap v5374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9141.916780 secs 2024-07-26T11:08:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:16 smithi043 ceph-mon[32384]: pgmap v5375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9157.399145 secs 2024-07-26T11:08:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9141.916780 secs 2024-07-26T11:08:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:16 smithi133 ceph-mon[37053]: pgmap v5375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9157.399145 secs 2024-07-26T11:08:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9141.916780 secs 2024-07-26T11:08:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:16 smithi063 ceph-mon[36747]: pgmap v5375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9157.399145 secs 2024-07-26T11:08:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:18 smithi043 ceph-mon[32384]: pgmap v5376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:18 smithi133 ceph-mon[37053]: pgmap v5376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:18 smithi063 ceph-mon[36747]: pgmap v5376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:20 smithi043 ceph-mon[32384]: pgmap v5377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:20 smithi133 ceph-mon[37053]: pgmap v5377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:20 smithi063 ceph-mon[36747]: pgmap v5377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9146.916902 secs 2024-07-26T11:08:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9162.399211 secs 2024-07-26T11:08:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9146.916902 secs 2024-07-26T11:08:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9162.399211 secs 2024-07-26T11:08:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9146.916902 secs 2024-07-26T11:08:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9162.399211 secs 2024-07-26T11:08:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:22 smithi043 ceph-mon[32384]: pgmap v5378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:22 smithi133 ceph-mon[37053]: pgmap v5378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:22 smithi063 ceph-mon[36747]: pgmap v5378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:24 smithi133 ceph-mon[37053]: pgmap v5379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:24 smithi063 ceph-mon[36747]: pgmap v5379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:24 smithi043 ceph-mon[32384]: pgmap v5379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9151.917022 secs 2024-07-26T11:08:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:25 smithi063 ceph-mon[36747]: pgmap v5380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9151.917022 secs 2024-07-26T11:08:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:25 smithi043 ceph-mon[32384]: pgmap v5380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9151.917022 secs 2024-07-26T11:08:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:25 smithi133 ceph-mon[37053]: pgmap v5380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9167.399331 secs 2024-07-26T11:08:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9167.399331 secs 2024-07-26T11:08:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9167.399331 secs 2024-07-26T11:08:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:27 smithi063 ceph-mon[36747]: pgmap v5381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:27 smithi043 ceph-mon[32384]: pgmap v5381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:27 smithi133 ceph-mon[37053]: pgmap v5381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:30 smithi043 ceph-mon[32384]: pgmap v5382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:30 smithi133 ceph-mon[37053]: pgmap v5382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:30 smithi063 ceph-mon[36747]: pgmap v5382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9156.917140 secs 2024-07-26T11:08:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9172.399412 secs 2024-07-26T11:08:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9156.917140 secs 2024-07-26T11:08:31.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9172.399412 secs 2024-07-26T11:08:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9156.917140 secs 2024-07-26T11:08:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9172.399412 secs 2024-07-26T11:08:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:32 smithi133 ceph-mon[37053]: pgmap v5383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:32 smithi063 ceph-mon[36747]: pgmap v5383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:32 smithi043 ceph-mon[32384]: pgmap v5383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:33 smithi063 ceph-mon[36747]: pgmap v5384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:33 smithi043 ceph-mon[32384]: pgmap v5384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:33 smithi133 ceph-mon[37053]: pgmap v5384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9161.917265 secs 2024-07-26T11:08:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:36 smithi043 ceph-mon[32384]: pgmap v5385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9177.399474 secs 2024-07-26T11:08:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9161.917265 secs 2024-07-26T11:08:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:36 smithi133 ceph-mon[37053]: pgmap v5385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:36.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9177.399474 secs 2024-07-26T11:08:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9161.917265 secs 2024-07-26T11:08:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:36 smithi063 ceph-mon[36747]: pgmap v5385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9177.399474 secs 2024-07-26T11:08:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:38 smithi133 ceph-mon[37053]: pgmap v5386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:38 smithi063 ceph-mon[36747]: pgmap v5386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:38 smithi043 ceph-mon[32384]: pgmap v5386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:40 smithi133 ceph-mon[37053]: pgmap v5387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:40 smithi063 ceph-mon[36747]: pgmap v5387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:40 smithi043 ceph-mon[32384]: pgmap v5387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9166.917379 secs 2024-07-26T11:08:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9182.399618 secs 2024-07-26T11:08:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9166.917379 secs 2024-07-26T11:08:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9182.399618 secs 2024-07-26T11:08:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9166.917379 secs 2024-07-26T11:08:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9182.399618 secs 2024-07-26T11:08:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:42 smithi133 ceph-mon[37053]: pgmap v5388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:42 smithi063 ceph-mon[36747]: pgmap v5388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:42 smithi043 ceph-mon[32384]: pgmap v5388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:08:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:43 smithi133 ceph-mon[37053]: pgmap v5389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:43 smithi063 ceph-mon[36747]: pgmap v5389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:43 smithi043 ceph-mon[32384]: pgmap v5389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9171.917479 secs 2024-07-26T11:08:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:46 smithi133 ceph-mon[37053]: pgmap v5390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:46.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9187.399738 secs 2024-07-26T11:08:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9171.917479 secs 2024-07-26T11:08:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:46 smithi063 ceph-mon[36747]: pgmap v5390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9187.399738 secs 2024-07-26T11:08:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9171.917479 secs 2024-07-26T11:08:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:46 smithi043 ceph-mon[32384]: pgmap v5390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:08:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9187.399738 secs 2024-07-26T11:08:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:48 smithi133 ceph-mon[37053]: pgmap v5391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:08:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:48 smithi063 ceph-mon[36747]: pgmap v5391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:08:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:48 smithi043 ceph-mon[32384]: pgmap v5391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:08:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:08:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:08:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:08:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:49 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:08:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:08:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:08:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:49 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:08:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:08:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:08:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:49 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:08:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:50 smithi133 ceph-mon[37053]: pgmap v5392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:50 smithi133 ceph-mon[37053]: pgmap v5393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9176.917613 secs 2024-07-26T11:08:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:50 smithi063 ceph-mon[36747]: pgmap v5392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:50 smithi063 ceph-mon[36747]: pgmap v5393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:50.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9176.917613 secs 2024-07-26T11:08:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:50 smithi043 ceph-mon[32384]: pgmap v5392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:50 smithi043 ceph-mon[32384]: pgmap v5393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9176.917613 secs 2024-07-26T11:08:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:51 smithi063 ceph-mon[36747]: pgmap v5394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9192.399874 secs 2024-07-26T11:08:51.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:51 smithi043 ceph-mon[32384]: pgmap v5394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:51.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9192.399874 secs 2024-07-26T11:08:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:51 smithi133 ceph-mon[37053]: pgmap v5394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9192.399874 secs 2024-07-26T11:08:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:53 smithi043 ceph-mon[32384]: pgmap v5395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:53 smithi133 ceph-mon[37053]: pgmap v5395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:53 smithi063 ceph-mon[36747]: pgmap v5395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:55 smithi043 ceph-mon[32384]: pgmap v5396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9181.917735 secs 2024-07-26T11:08:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:55 smithi133 ceph-mon[37053]: pgmap v5396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9181.917735 secs 2024-07-26T11:08:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:55 smithi063 ceph-mon[36747]: pgmap v5396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:08:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9181.917735 secs 2024-07-26T11:08:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9197.400031 secs 2024-07-26T11:08:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9197.400031 secs 2024-07-26T11:08:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9197.400031 secs 2024-07-26T11:08:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:57 smithi043 ceph-mon[32384]: pgmap v5397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:08:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:57 smithi133 ceph-mon[37053]: pgmap v5397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:08:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:57 smithi063 ceph-mon[36747]: pgmap v5397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:08:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:08:59 smithi043 ceph-mon[32384]: pgmap v5398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:08:59 smithi133 ceph-mon[37053]: pgmap v5398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:08:59 smithi063 ceph-mon[36747]: pgmap v5398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9186.917893 secs 2024-07-26T11:09:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9186.917893 secs 2024-07-26T11:09:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9186.917893 secs 2024-07-26T11:09:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:01 smithi063 ceph-mon[36747]: pgmap v5399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9202.400162 secs 2024-07-26T11:09:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:01 smithi043 ceph-mon[32384]: pgmap v5399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9202.400162 secs 2024-07-26T11:09:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:01 smithi133 ceph-mon[37053]: pgmap v5399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9202.400162 secs 2024-07-26T11:09:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:03 smithi043 ceph-mon[32384]: pgmap v5400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:03 smithi133 ceph-mon[37053]: pgmap v5400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:03 smithi063 ceph-mon[36747]: pgmap v5400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:05 smithi043 ceph-mon[32384]: pgmap v5401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9191.918012 secs 2024-07-26T11:09:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:05 smithi133 ceph-mon[37053]: pgmap v5401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9191.918012 secs 2024-07-26T11:09:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:05 smithi063 ceph-mon[36747]: pgmap v5401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9191.918012 secs 2024-07-26T11:09:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9207.400308 secs 2024-07-26T11:09:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9207.400308 secs 2024-07-26T11:09:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9207.400308 secs 2024-07-26T11:09:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:07 smithi133 ceph-mon[37053]: pgmap v5402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:07 smithi063 ceph-mon[36747]: pgmap v5402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:08.219 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:07 smithi043 ceph-mon[32384]: pgmap v5402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:10 smithi133 ceph-mon[37053]: pgmap v5403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:10 smithi063 ceph-mon[36747]: pgmap v5403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:10 smithi043 ceph-mon[32384]: pgmap v5403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9196.918169 secs 2024-07-26T11:09:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9212.400453 secs 2024-07-26T11:09:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9196.918169 secs 2024-07-26T11:09:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9212.400453 secs 2024-07-26T11:09:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9196.918169 secs 2024-07-26T11:09:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9212.400453 secs 2024-07-26T11:09:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:12 smithi063 ceph-mon[36747]: pgmap v5404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:12 smithi043 ceph-mon[32384]: pgmap v5404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:12 smithi133 ceph-mon[37053]: pgmap v5404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:14 smithi063 ceph-mon[36747]: pgmap v5405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:14 smithi043 ceph-mon[32384]: pgmap v5405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:14 smithi133 ceph-mon[37053]: pgmap v5405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:16 smithi063 ceph-mon[36747]: pgmap v5406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9201.918282 secs 2024-07-26T11:09:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9217.400558 secs 2024-07-26T11:09:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:16 smithi043 ceph-mon[32384]: pgmap v5406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9201.918282 secs 2024-07-26T11:09:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9217.400558 secs 2024-07-26T11:09:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:16 smithi133 ceph-mon[37053]: pgmap v5406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9201.918282 secs 2024-07-26T11:09:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9217.400558 secs 2024-07-26T11:09:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:18 smithi063 ceph-mon[36747]: pgmap v5407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:18 smithi043 ceph-mon[32384]: pgmap v5407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:18 smithi133 ceph-mon[37053]: pgmap v5407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:20 smithi063 ceph-mon[36747]: pgmap v5408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:20 smithi043 ceph-mon[32384]: pgmap v5408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:20 smithi133 ceph-mon[37053]: pgmap v5408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9206.918407 secs 2024-07-26T11:09:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9222.400722 secs 2024-07-26T11:09:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9206.918407 secs 2024-07-26T11:09:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9222.400722 secs 2024-07-26T11:09:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9206.918407 secs 2024-07-26T11:09:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9222.400722 secs 2024-07-26T11:09:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:22 smithi063 ceph-mon[36747]: pgmap v5409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:22 smithi043 ceph-mon[32384]: pgmap v5409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:22 smithi133 ceph-mon[37053]: pgmap v5409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:24 smithi043 ceph-mon[32384]: pgmap v5410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:24 smithi063 ceph-mon[36747]: pgmap v5410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:24 smithi133 ceph-mon[37053]: pgmap v5410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:26 smithi043 ceph-mon[32384]: pgmap v5411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9211.918528 secs 2024-07-26T11:09:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9227.400850 secs 2024-07-26T11:09:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:26 smithi133 ceph-mon[37053]: pgmap v5411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9211.918528 secs 2024-07-26T11:09:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9227.400850 secs 2024-07-26T11:09:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:26 smithi063 ceph-mon[36747]: pgmap v5411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9211.918528 secs 2024-07-26T11:09:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9227.400850 secs 2024-07-26T11:09:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:28 smithi043 ceph-mon[32384]: pgmap v5412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:28 smithi133 ceph-mon[37053]: pgmap v5412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:28 smithi063 ceph-mon[36747]: pgmap v5412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:30 smithi043 ceph-mon[32384]: pgmap v5413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:30 smithi133 ceph-mon[37053]: pgmap v5413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:30 smithi063 ceph-mon[36747]: pgmap v5413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9216.918663 secs 2024-07-26T11:09:31.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9232.400972 secs 2024-07-26T11:09:31.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9216.918663 secs 2024-07-26T11:09:31.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9232.400972 secs 2024-07-26T11:09:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9216.918663 secs 2024-07-26T11:09:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9232.400972 secs 2024-07-26T11:09:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:32 smithi043 ceph-mon[32384]: pgmap v5414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:32 smithi133 ceph-mon[37053]: pgmap v5414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:32 smithi063 ceph-mon[36747]: pgmap v5414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:09:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:34 smithi043 ceph-mon[32384]: pgmap v5415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:34 smithi133 ceph-mon[37053]: pgmap v5415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:34 smithi063 ceph-mon[36747]: pgmap v5415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:36 smithi043 ceph-mon[32384]: pgmap v5416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9221.918777 secs 2024-07-26T11:09:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9237.401076 secs 2024-07-26T11:09:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:36 smithi133 ceph-mon[37053]: pgmap v5416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9221.918777 secs 2024-07-26T11:09:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9237.401076 secs 2024-07-26T11:09:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:36 smithi063 ceph-mon[36747]: pgmap v5416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:09:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9221.918777 secs 2024-07-26T11:09:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9237.401076 secs 2024-07-26T11:09:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:38 smithi043 ceph-mon[32384]: pgmap v5417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:38 smithi133 ceph-mon[37053]: pgmap v5417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:38 smithi063 ceph-mon[36747]: pgmap v5417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:40 smithi043 ceph-mon[32384]: pgmap v5418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:09:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:40 smithi133 ceph-mon[37053]: pgmap v5418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:09:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:40 smithi063 ceph-mon[36747]: pgmap v5418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:09:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9226.918900 secs 2024-07-26T11:09:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9242.401224 secs 2024-07-26T11:09:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9226.918900 secs 2024-07-26T11:09:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9242.401224 secs 2024-07-26T11:09:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9226.918900 secs 2024-07-26T11:09:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9242.401224 secs 2024-07-26T11:09:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:42 smithi043 ceph-mon[32384]: pgmap v5419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:42 smithi133 ceph-mon[37053]: pgmap v5419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:42 smithi063 ceph-mon[36747]: pgmap v5419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:44 smithi043 ceph-mon[32384]: pgmap v5420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:09:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:44 smithi133 ceph-mon[37053]: pgmap v5420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:09:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:44 smithi063 ceph-mon[36747]: pgmap v5420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:09:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:46 smithi043 ceph-mon[32384]: pgmap v5421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9231.919018 secs 2024-07-26T11:09:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9247.401348 secs 2024-07-26T11:09:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:46 smithi133 ceph-mon[37053]: pgmap v5421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9231.919018 secs 2024-07-26T11:09:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9247.401348 secs 2024-07-26T11:09:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:46 smithi063 ceph-mon[36747]: pgmap v5421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9231.919018 secs 2024-07-26T11:09:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9247.401348 secs 2024-07-26T11:09:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:48 smithi043 ceph-mon[32384]: pgmap v5422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:48 smithi133 ceph-mon[37053]: pgmap v5422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:48 smithi063 ceph-mon[36747]: pgmap v5422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:09:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:09:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:09:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:09:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:50 smithi043 ceph-mon[32384]: pgmap v5423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:09:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:09:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:09:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:50 smithi133 ceph-mon[37053]: pgmap v5423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:09:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:09:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:09:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:50 smithi063 ceph-mon[36747]: pgmap v5423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:09:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:09:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:09:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:09:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:51 smithi043 ceph-mon[32384]: pgmap v5424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:09:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:51 smithi043 ceph-mon[32384]: pgmap v5425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9236.919164 secs 2024-07-26T11:09:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9252.401501 secs 2024-07-26T11:09:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:51 smithi133 ceph-mon[37053]: pgmap v5424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:09:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:51 smithi133 ceph-mon[37053]: pgmap v5425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9236.919164 secs 2024-07-26T11:09:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9252.401501 secs 2024-07-26T11:09:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:51 smithi063 ceph-mon[36747]: pgmap v5424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:09:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:51 smithi063 ceph-mon[36747]: pgmap v5425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9236.919164 secs 2024-07-26T11:09:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9252.401501 secs 2024-07-26T11:09:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:53 smithi043 ceph-mon[32384]: pgmap v5426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:53 smithi133 ceph-mon[37053]: pgmap v5426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:53 smithi063 ceph-mon[36747]: pgmap v5426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:09:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:55 smithi043 ceph-mon[32384]: pgmap v5427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:09:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:55 smithi133 ceph-mon[37053]: pgmap v5427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:09:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:55 smithi063 ceph-mon[36747]: pgmap v5427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:09:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9241.919289 secs 2024-07-26T11:09:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9257.401626 secs 2024-07-26T11:09:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9241.919289 secs 2024-07-26T11:09:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9257.401626 secs 2024-07-26T11:09:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9241.919289 secs 2024-07-26T11:09:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9257.401626 secs 2024-07-26T11:09:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:57 smithi043 ceph-mon[32384]: pgmap v5428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:09:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:57 smithi133 ceph-mon[37053]: pgmap v5428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:09:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:57 smithi063 ceph-mon[36747]: pgmap v5428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:09:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:09:59 smithi043 ceph-mon[32384]: pgmap v5429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:09:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:09:59 smithi133 ceph-mon[37053]: pgmap v5429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:09:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:09:59 smithi063 ceph-mon[36747]: pgmap v5429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:10:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:10:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:10:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:10:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:01 smithi043 ceph-mon[32384]: pgmap v5430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9246.919408 secs 2024-07-26T11:10:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9262.401752 secs 2024-07-26T11:10:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:01 smithi133 ceph-mon[37053]: pgmap v5430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9246.919408 secs 2024-07-26T11:10:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9262.401752 secs 2024-07-26T11:10:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:01 smithi063 ceph-mon[36747]: pgmap v5430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9246.919408 secs 2024-07-26T11:10:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9262.401752 secs 2024-07-26T11:10:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:03 smithi043 ceph-mon[32384]: pgmap v5431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:03 smithi133 ceph-mon[37053]: pgmap v5431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:03 smithi063 ceph-mon[36747]: pgmap v5431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:05 smithi133 ceph-mon[37053]: pgmap v5432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:05 smithi063 ceph-mon[36747]: pgmap v5432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:05 smithi043 ceph-mon[32384]: pgmap v5432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9251.919524 secs 2024-07-26T11:10:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9267.401895 secs 2024-07-26T11:10:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9251.919524 secs 2024-07-26T11:10:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9267.401895 secs 2024-07-26T11:10:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9251.919524 secs 2024-07-26T11:10:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9267.401895 secs 2024-07-26T11:10:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:07 smithi133 ceph-mon[37053]: pgmap v5433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:07 smithi063 ceph-mon[36747]: pgmap v5433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:07 smithi043 ceph-mon[32384]: pgmap v5433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:09 smithi133 ceph-mon[37053]: pgmap v5434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:09 smithi063 ceph-mon[36747]: pgmap v5434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:09 smithi043 ceph-mon[32384]: pgmap v5434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:11 smithi133 ceph-mon[37053]: pgmap v5435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9256.919638 secs 2024-07-26T11:10:11.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9272.401984 secs 2024-07-26T11:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:11 smithi063 ceph-mon[36747]: pgmap v5435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9256.919638 secs 2024-07-26T11:10:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9272.401984 secs 2024-07-26T11:10:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:11 smithi043 ceph-mon[32384]: pgmap v5435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9256.919638 secs 2024-07-26T11:10:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9272.401984 secs 2024-07-26T11:10:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:13 smithi133 ceph-mon[37053]: pgmap v5436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:13 smithi063 ceph-mon[36747]: pgmap v5436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:13 smithi043 ceph-mon[32384]: pgmap v5436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:14 smithi063 ceph-mon[36747]: pgmap v5437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:14 smithi043 ceph-mon[32384]: pgmap v5437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:14 smithi133 ceph-mon[37053]: pgmap v5437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9261.919759 secs 2024-07-26T11:10:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9261.919759 secs 2024-07-26T11:10:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9261.919759 secs 2024-07-26T11:10:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9277.402073 secs 2024-07-26T11:10:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:16 smithi063 ceph-mon[36747]: pgmap v5438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9277.402073 secs 2024-07-26T11:10:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:16 smithi043 ceph-mon[32384]: pgmap v5438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9277.402073 secs 2024-07-26T11:10:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:16 smithi133 ceph-mon[37053]: pgmap v5438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:10:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:18 smithi043 ceph-mon[32384]: pgmap v5439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:18 smithi133 ceph-mon[37053]: pgmap v5439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:18 smithi063 ceph-mon[36747]: pgmap v5439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:10:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:20 smithi043 ceph-mon[32384]: pgmap v5440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9266.919882 secs 2024-07-26T11:10:21.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:20 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9282.402191 secs 2024-07-26T11:10:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:20 smithi133 ceph-mon[37053]: pgmap v5440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9266.919882 secs 2024-07-26T11:10:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:20 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9282.402191 secs 2024-07-26T11:10:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:20 smithi063 ceph-mon[36747]: pgmap v5440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9266.919882 secs 2024-07-26T11:10:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:20 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9282.402191 secs 2024-07-26T11:10:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:22 smithi043 ceph-mon[32384]: pgmap v5441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:22 smithi133 ceph-mon[37053]: pgmap v5441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:22 smithi063 ceph-mon[36747]: pgmap v5441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:24 smithi043 ceph-mon[32384]: pgmap v5442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:24 smithi133 ceph-mon[37053]: pgmap v5442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:24 smithi063 ceph-mon[36747]: pgmap v5442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9271.920020 secs 2024-07-26T11:10:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:25 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9287.402312 secs 2024-07-26T11:10:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9271.920020 secs 2024-07-26T11:10:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:25 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9287.402312 secs 2024-07-26T11:10:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9271.920020 secs 2024-07-26T11:10:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:25 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9287.402312 secs 2024-07-26T11:10:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:26 smithi043 ceph-mon[32384]: pgmap v5443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:26 smithi133 ceph-mon[37053]: pgmap v5443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:26 smithi063 ceph-mon[36747]: pgmap v5443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:28 smithi043 ceph-mon[32384]: pgmap v5444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:28 smithi133 ceph-mon[37053]: pgmap v5444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:28 smithi063 ceph-mon[36747]: pgmap v5444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:30 smithi133 ceph-mon[37053]: pgmap v5445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9276.920139 secs 2024-07-26T11:10:31.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:30 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9292.402406 secs 2024-07-26T11:10:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:30 smithi063 ceph-mon[36747]: pgmap v5445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9276.920139 secs 2024-07-26T11:10:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:30 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9292.402406 secs 2024-07-26T11:10:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:30 smithi043 ceph-mon[32384]: pgmap v5445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9276.920139 secs 2024-07-26T11:10:31.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:30 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9292.402406 secs 2024-07-26T11:10:33.260 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:32 smithi133 ceph-mon[37053]: pgmap v5446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:32 smithi063 ceph-mon[36747]: pgmap v5446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:32 smithi043 ceph-mon[32384]: pgmap v5446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:34 smithi133 ceph-mon[37053]: pgmap v5447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:34 smithi063 ceph-mon[36747]: pgmap v5447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:34 smithi043 ceph-mon[32384]: pgmap v5447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9281.920191 secs 2024-07-26T11:10:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9297.402523 secs 2024-07-26T11:10:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9281.920191 secs 2024-07-26T11:10:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9297.402523 secs 2024-07-26T11:10:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9281.920191 secs 2024-07-26T11:10:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9297.402523 secs 2024-07-26T11:10:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:37 smithi133 ceph-mon[37053]: pgmap v5448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:37 smithi063 ceph-mon[36747]: pgmap v5448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:37 smithi043 ceph-mon[32384]: pgmap v5448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:39 smithi063 ceph-mon[36747]: pgmap v5449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:39 smithi043 ceph-mon[32384]: pgmap v5449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:39 smithi133 ceph-mon[37053]: pgmap v5449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:41 smithi043 ceph-mon[32384]: pgmap v5450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9286.920315 secs 2024-07-26T11:10:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9302.402664 secs 2024-07-26T11:10:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:41 smithi063 ceph-mon[36747]: pgmap v5450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9286.920315 secs 2024-07-26T11:10:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9302.402664 secs 2024-07-26T11:10:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:41 smithi133 ceph-mon[37053]: pgmap v5450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9286.920315 secs 2024-07-26T11:10:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9302.402664 secs 2024-07-26T11:10:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:43 smithi063 ceph-mon[36747]: pgmap v5451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:43.330 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:43 smithi133 ceph-mon[37053]: pgmap v5451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:43 smithi043 ceph-mon[32384]: pgmap v5451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:45 smithi063 ceph-mon[36747]: pgmap v5452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:45 smithi043 ceph-mon[32384]: pgmap v5452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:45 smithi133 ceph-mon[37053]: pgmap v5452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9291.920417 secs 2024-07-26T11:10:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9307.402788 secs 2024-07-26T11:10:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9291.920417 secs 2024-07-26T11:10:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9307.402788 secs 2024-07-26T11:10:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9291.920417 secs 2024-07-26T11:10:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9307.402788 secs 2024-07-26T11:10:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:47 smithi063 ceph-mon[36747]: pgmap v5453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:47 smithi043 ceph-mon[32384]: pgmap v5453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:47 smithi133 ceph-mon[37053]: pgmap v5453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:10:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:49 smithi043 ceph-mon[32384]: pgmap v5454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:49 smithi133 ceph-mon[37053]: pgmap v5454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:49 smithi063 ceph-mon[36747]: pgmap v5454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:10:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:51 smithi043 ceph-mon[32384]: pgmap v5455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:10:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9296.920510 secs 2024-07-26T11:10:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9312.402915 secs 2024-07-26T11:10:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:51 smithi133 ceph-mon[37053]: pgmap v5455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:10:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9296.920510 secs 2024-07-26T11:10:51.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9312.402915 secs 2024-07-26T11:10:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:51 smithi063 ceph-mon[36747]: pgmap v5455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:10:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:10:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9296.920510 secs 2024-07-26T11:10:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9312.402915 secs 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:10:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:10:52.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:10:52.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: pgmap v5456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:10:52.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: pgmap v5457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:10:52.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: pgmap v5456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: pgmap v5457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:10:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: pgmap v5456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: pgmap v5457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:10:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:10:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:54 smithi043 ceph-mon[32384]: pgmap v5458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:10:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:54 smithi133 ceph-mon[37053]: pgmap v5458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:10:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:54 smithi063 ceph-mon[36747]: pgmap v5458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:10:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:56 smithi043 ceph-mon[32384]: pgmap v5459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9301.920632 secs 2024-07-26T11:10:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9317.403044 secs 2024-07-26T11:10:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:56 smithi133 ceph-mon[37053]: pgmap v5459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9301.920632 secs 2024-07-26T11:10:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9317.403044 secs 2024-07-26T11:10:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:56 smithi063 ceph-mon[36747]: pgmap v5459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9301.920632 secs 2024-07-26T11:10:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9317.403044 secs 2024-07-26T11:10:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:10:58 smithi043 ceph-mon[32384]: pgmap v5460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:10:58 smithi133 ceph-mon[37053]: pgmap v5460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:10:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:10:58 smithi063 ceph-mon[36747]: pgmap v5460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:11:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:00 smithi043 ceph-mon[32384]: pgmap v5461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:00 smithi133 ceph-mon[37053]: pgmap v5461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:00 smithi063 ceph-mon[36747]: pgmap v5461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9306.920769 secs 2024-07-26T11:11:01.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9322.403163 secs 2024-07-26T11:11:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9306.920769 secs 2024-07-26T11:11:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9322.403163 secs 2024-07-26T11:11:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9306.920769 secs 2024-07-26T11:11:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9322.403163 secs 2024-07-26T11:11:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:02 smithi043 ceph-mon[32384]: pgmap v5462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:11:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:02 smithi133 ceph-mon[37053]: pgmap v5462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:11:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:02 smithi063 ceph-mon[36747]: pgmap v5462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:11:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:04 smithi043 ceph-mon[32384]: pgmap v5463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:04 smithi133 ceph-mon[37053]: pgmap v5463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:04 smithi063 ceph-mon[36747]: pgmap v5463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:06.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:06 smithi043 ceph-mon[32384]: pgmap v5464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:06.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9311.920893 secs 2024-07-26T11:11:06.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9327.403250 secs 2024-07-26T11:11:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:06 smithi133 ceph-mon[37053]: pgmap v5464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9311.920893 secs 2024-07-26T11:11:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9327.403250 secs 2024-07-26T11:11:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:06 smithi063 ceph-mon[36747]: pgmap v5464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9311.920893 secs 2024-07-26T11:11:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9327.403250 secs 2024-07-26T11:11:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:08 smithi043 ceph-mon[32384]: pgmap v5465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:08 smithi133 ceph-mon[37053]: pgmap v5465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:08 smithi063 ceph-mon[36747]: pgmap v5465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:10 smithi133 ceph-mon[37053]: pgmap v5466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:10 smithi063 ceph-mon[36747]: pgmap v5466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:10 smithi043 ceph-mon[32384]: pgmap v5466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9316.921006 secs 2024-07-26T11:11:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9332.403409 secs 2024-07-26T11:11:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9316.921006 secs 2024-07-26T11:11:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9332.403409 secs 2024-07-26T11:11:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9316.921006 secs 2024-07-26T11:11:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9332.403409 secs 2024-07-26T11:11:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:12 smithi043 ceph-mon[32384]: pgmap v5467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:12 smithi133 ceph-mon[37053]: pgmap v5467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:12 smithi063 ceph-mon[36747]: pgmap v5467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:14 smithi133 ceph-mon[37053]: pgmap v5468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:14 smithi063 ceph-mon[36747]: pgmap v5468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:14 smithi043 ceph-mon[32384]: pgmap v5468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:16 smithi133 ceph-mon[37053]: pgmap v5469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9321.921150 secs 2024-07-26T11:11:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9337.403529 secs 2024-07-26T11:11:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:16 smithi063 ceph-mon[36747]: pgmap v5469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9321.921150 secs 2024-07-26T11:11:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9337.403529 secs 2024-07-26T11:11:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:16 smithi043 ceph-mon[32384]: pgmap v5469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9321.921150 secs 2024-07-26T11:11:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9337.403529 secs 2024-07-26T11:11:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:18 smithi133 ceph-mon[37053]: pgmap v5470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:18 smithi063 ceph-mon[36747]: pgmap v5470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:18 smithi043 ceph-mon[32384]: pgmap v5470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:20 smithi063 ceph-mon[36747]: pgmap v5471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:20 smithi043 ceph-mon[32384]: pgmap v5471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:20 smithi133 ceph-mon[37053]: pgmap v5471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9326.921213 secs 2024-07-26T11:11:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9342.403680 secs 2024-07-26T11:11:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9326.921213 secs 2024-07-26T11:11:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9342.403680 secs 2024-07-26T11:11:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9326.921213 secs 2024-07-26T11:11:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9342.403680 secs 2024-07-26T11:11:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:22 smithi063 ceph-mon[36747]: pgmap v5472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:22 smithi043 ceph-mon[32384]: pgmap v5472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:22 smithi133 ceph-mon[37053]: pgmap v5472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:24 smithi063 ceph-mon[36747]: pgmap v5473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:24 smithi043 ceph-mon[32384]: pgmap v5473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:24 smithi133 ceph-mon[37053]: pgmap v5473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:26 smithi063 ceph-mon[36747]: pgmap v5474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9331.921315 secs 2024-07-26T11:11:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9347.403807 secs 2024-07-26T11:11:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:26 smithi043 ceph-mon[32384]: pgmap v5474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9331.921315 secs 2024-07-26T11:11:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9347.403807 secs 2024-07-26T11:11:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:26 smithi133 ceph-mon[37053]: pgmap v5474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9331.921315 secs 2024-07-26T11:11:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9347.403807 secs 2024-07-26T11:11:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:28 smithi063 ceph-mon[36747]: pgmap v5475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:28 smithi043 ceph-mon[32384]: pgmap v5475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:28 smithi133 ceph-mon[37053]: pgmap v5475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:30 smithi063 ceph-mon[36747]: pgmap v5476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:30 smithi043 ceph-mon[32384]: pgmap v5476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:30 smithi133 ceph-mon[37053]: pgmap v5476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9336.921430 secs 2024-07-26T11:11:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9352.403946 secs 2024-07-26T11:11:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9336.921430 secs 2024-07-26T11:11:31.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9352.403946 secs 2024-07-26T11:11:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9336.921430 secs 2024-07-26T11:11:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9352.403946 secs 2024-07-26T11:11:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:32 smithi043 ceph-mon[32384]: pgmap v5477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:32.758 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:32 smithi063 ceph-mon[36747]: pgmap v5477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:32 smithi133 ceph-mon[37053]: pgmap v5477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:34 smithi043 ceph-mon[32384]: pgmap v5478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:34 smithi133 ceph-mon[37053]: pgmap v5478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:34.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:34 smithi063 ceph-mon[36747]: pgmap v5478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:36 smithi043 ceph-mon[32384]: pgmap v5479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9341.921555 secs 2024-07-26T11:11:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9357.404081 secs 2024-07-26T11:11:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:36 smithi133 ceph-mon[37053]: pgmap v5479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9341.921555 secs 2024-07-26T11:11:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9357.404081 secs 2024-07-26T11:11:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:36 smithi063 ceph-mon[36747]: pgmap v5479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9341.921555 secs 2024-07-26T11:11:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9357.404081 secs 2024-07-26T11:11:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:38 smithi043 ceph-mon[32384]: pgmap v5480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:38 smithi133 ceph-mon[37053]: pgmap v5480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:38 smithi063 ceph-mon[36747]: pgmap v5480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:40 smithi043 ceph-mon[32384]: pgmap v5481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:40 smithi133 ceph-mon[37053]: pgmap v5481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:40 smithi063 ceph-mon[36747]: pgmap v5481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9346.921680 secs 2024-07-26T11:11:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9362.404196 secs 2024-07-26T11:11:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9346.921680 secs 2024-07-26T11:11:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9362.404196 secs 2024-07-26T11:11:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9346.921680 secs 2024-07-26T11:11:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9362.404196 secs 2024-07-26T11:11:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:42 smithi043 ceph-mon[32384]: pgmap v5482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:42 smithi133 ceph-mon[37053]: pgmap v5482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:42 smithi063 ceph-mon[36747]: pgmap v5482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:44 smithi043 ceph-mon[32384]: pgmap v5483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:44 smithi133 ceph-mon[37053]: pgmap v5483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:44 smithi063 ceph-mon[36747]: pgmap v5483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:46 smithi043 ceph-mon[32384]: pgmap v5484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9351.921815 secs 2024-07-26T11:11:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9367.404311 secs 2024-07-26T11:11:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:46 smithi133 ceph-mon[37053]: pgmap v5484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9351.921815 secs 2024-07-26T11:11:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9367.404311 secs 2024-07-26T11:11:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:46 smithi063 ceph-mon[36747]: pgmap v5484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:11:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9351.921815 secs 2024-07-26T11:11:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9367.404311 secs 2024-07-26T11:11:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:48 smithi043 ceph-mon[32384]: pgmap v5485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:48 smithi133 ceph-mon[37053]: pgmap v5485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:48 smithi063 ceph-mon[36747]: pgmap v5485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:50 smithi043 ceph-mon[32384]: pgmap v5486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:50 smithi133 ceph-mon[37053]: pgmap v5486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:50 smithi063 ceph-mon[36747]: pgmap v5486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:11:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9356.921909 secs 2024-07-26T11:11:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9372.404440 secs 2024-07-26T11:11:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:11:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9356.921909 secs 2024-07-26T11:11:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9372.404440 secs 2024-07-26T11:11:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:11:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9356.921909 secs 2024-07-26T11:11:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9372.404440 secs 2024-07-26T11:11:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: pgmap v5487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.735 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: pgmap v5487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: pgmap v5487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:11:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: pgmap v5488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: pgmap v5489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:11:53.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:11:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:11:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:11:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:11:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:11:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:11:53.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:11:53.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: pgmap v5488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:11:53.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: pgmap v5489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:11:53.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:11:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: pgmap v5488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: pgmap v5489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:11:53.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:11:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:55 smithi043 ceph-mon[32384]: pgmap v5490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:55 smithi133 ceph-mon[37053]: pgmap v5490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:55 smithi063 ceph-mon[36747]: pgmap v5490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9361.922031 secs 2024-07-26T11:11:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9377.404514 secs 2024-07-26T11:11:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9361.922031 secs 2024-07-26T11:11:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9377.404514 secs 2024-07-26T11:11:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9361.922031 secs 2024-07-26T11:11:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9377.404514 secs 2024-07-26T11:11:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:57 smithi133 ceph-mon[37053]: pgmap v5491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:57 smithi063 ceph-mon[36747]: pgmap v5491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:57 smithi043 ceph-mon[32384]: pgmap v5491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:11:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:11:59 smithi133 ceph-mon[37053]: pgmap v5492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:11:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:11:59 smithi063 ceph-mon[36747]: pgmap v5492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:11:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:11:59 smithi043 ceph-mon[32384]: pgmap v5492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:12:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9366.922153 secs 2024-07-26T11:12:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:01 smithi133 ceph-mon[37053]: pgmap v5493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9382.404630 secs 2024-07-26T11:12:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9366.922153 secs 2024-07-26T11:12:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:01 smithi063 ceph-mon[36747]: pgmap v5493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9382.404630 secs 2024-07-26T11:12:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9366.922153 secs 2024-07-26T11:12:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:01 smithi043 ceph-mon[32384]: pgmap v5493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9382.404630 secs 2024-07-26T11:12:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:03 smithi133 ceph-mon[37053]: pgmap v5494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:12:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:03 smithi063 ceph-mon[36747]: pgmap v5494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:12:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:03 smithi043 ceph-mon[32384]: pgmap v5494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:12:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:05 smithi133 ceph-mon[37053]: pgmap v5495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:05 smithi063 ceph-mon[36747]: pgmap v5495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:05 smithi043 ceph-mon[32384]: pgmap v5495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9371.922248 secs 2024-07-26T11:12:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9387.404751 secs 2024-07-26T11:12:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9371.922248 secs 2024-07-26T11:12:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9387.404751 secs 2024-07-26T11:12:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9371.922248 secs 2024-07-26T11:12:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9387.404751 secs 2024-07-26T11:12:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:07 smithi063 ceph-mon[36747]: pgmap v5496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:07 smithi043 ceph-mon[32384]: pgmap v5496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:07 smithi133 ceph-mon[37053]: pgmap v5496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:09 smithi063 ceph-mon[36747]: pgmap v5497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:09 smithi043 ceph-mon[32384]: pgmap v5497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:09 smithi133 ceph-mon[37053]: pgmap v5497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9376.922363 secs 2024-07-26T11:12:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9376.922363 secs 2024-07-26T11:12:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9376.922363 secs 2024-07-26T11:12:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:11 smithi063 ceph-mon[36747]: pgmap v5498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9392.404918 secs 2024-07-26T11:12:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:11 smithi043 ceph-mon[32384]: pgmap v5498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9392.404918 secs 2024-07-26T11:12:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:11 smithi133 ceph-mon[37053]: pgmap v5498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9392.404918 secs 2024-07-26T11:12:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:12 smithi063 ceph-mon[36747]: pgmap v5499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:12 smithi043 ceph-mon[32384]: pgmap v5499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:12 smithi133 ceph-mon[37053]: pgmap v5499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:15 smithi133 ceph-mon[37053]: pgmap v5500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:15 smithi063 ceph-mon[36747]: pgmap v5500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:15 smithi043 ceph-mon[32384]: pgmap v5500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9381.922484 secs 2024-07-26T11:12:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9397.405013 secs 2024-07-26T11:12:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9381.922484 secs 2024-07-26T11:12:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9397.405013 secs 2024-07-26T11:12:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9381.922484 secs 2024-07-26T11:12:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9397.405013 secs 2024-07-26T11:12:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:17 smithi133 ceph-mon[37053]: pgmap v5501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:17 smithi063 ceph-mon[36747]: pgmap v5501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:17 smithi043 ceph-mon[32384]: pgmap v5501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:19 smithi133 ceph-mon[37053]: pgmap v5502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:19 smithi063 ceph-mon[36747]: pgmap v5502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:19 smithi043 ceph-mon[32384]: pgmap v5502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9386.922602 secs 2024-07-26T11:12:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:21 smithi133 ceph-mon[37053]: pgmap v5503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:21.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9402.405111 secs 2024-07-26T11:12:21.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9386.922602 secs 2024-07-26T11:12:21.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:21 smithi043 ceph-mon[32384]: pgmap v5503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:21.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9402.405111 secs 2024-07-26T11:12:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9386.922602 secs 2024-07-26T11:12:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:21 smithi063 ceph-mon[36747]: pgmap v5503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9402.405111 secs 2024-07-26T11:12:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:23 smithi063 ceph-mon[36747]: pgmap v5504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:23 smithi043 ceph-mon[32384]: pgmap v5504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:23 smithi133 ceph-mon[37053]: pgmap v5504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:25 smithi063 ceph-mon[36747]: pgmap v5505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:25 smithi043 ceph-mon[32384]: pgmap v5505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:25 smithi133 ceph-mon[37053]: pgmap v5505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9391.922743 secs 2024-07-26T11:12:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9407.405185 secs 2024-07-26T11:12:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9391.922743 secs 2024-07-26T11:12:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9407.405185 secs 2024-07-26T11:12:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9391.922743 secs 2024-07-26T11:12:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9407.405185 secs 2024-07-26T11:12:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:27 smithi063 ceph-mon[36747]: pgmap v5506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:27 smithi043 ceph-mon[32384]: pgmap v5506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:27 smithi133 ceph-mon[37053]: pgmap v5506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:28 smithi043 ceph-mon[32384]: pgmap v5507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:28 smithi133 ceph-mon[37053]: pgmap v5507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:28 smithi063 ceph-mon[36747]: pgmap v5507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9396.922861 secs 2024-07-26T11:12:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:31 smithi133 ceph-mon[37053]: pgmap v5508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:31.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9412.405301 secs 2024-07-26T11:12:31.771 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9396.922861 secs 2024-07-26T11:12:31.771 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:31 smithi063 ceph-mon[36747]: pgmap v5508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:31.772 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9412.405301 secs 2024-07-26T11:12:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9396.922861 secs 2024-07-26T11:12:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:31 smithi043 ceph-mon[32384]: pgmap v5508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:31.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9412.405301 secs 2024-07-26T11:12:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:33 smithi133 ceph-mon[37053]: pgmap v5509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:33 smithi063 ceph-mon[36747]: pgmap v5509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:33 smithi043 ceph-mon[32384]: pgmap v5509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:35 smithi133 ceph-mon[37053]: pgmap v5510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:35 smithi063 ceph-mon[36747]: pgmap v5510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:35 smithi043 ceph-mon[32384]: pgmap v5510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9401.922983 secs 2024-07-26T11:12:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9417.405424 secs 2024-07-26T11:12:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9401.922983 secs 2024-07-26T11:12:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9417.405424 secs 2024-07-26T11:12:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9401.922983 secs 2024-07-26T11:12:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9417.405424 secs 2024-07-26T11:12:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:37 smithi063 ceph-mon[36747]: pgmap v5511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:37 smithi043 ceph-mon[32384]: pgmap v5511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:37 smithi133 ceph-mon[37053]: pgmap v5511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:39 smithi063 ceph-mon[36747]: pgmap v5512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:39 smithi043 ceph-mon[32384]: pgmap v5512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:39 smithi133 ceph-mon[37053]: pgmap v5512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9406.923129 secs 2024-07-26T11:12:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9406.923129 secs 2024-07-26T11:12:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9406.923129 secs 2024-07-26T11:12:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:41 smithi063 ceph-mon[36747]: pgmap v5513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9422.405561 secs 2024-07-26T11:12:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:41 smithi043 ceph-mon[32384]: pgmap v5513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9422.405561 secs 2024-07-26T11:12:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:41 smithi133 ceph-mon[37053]: pgmap v5513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9422.405561 secs 2024-07-26T11:12:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:42 smithi063 ceph-mon[36747]: pgmap v5514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:42 smithi043 ceph-mon[32384]: pgmap v5514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:42 smithi133 ceph-mon[37053]: pgmap v5514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:45.687 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:45 smithi043 ceph-mon[32384]: pgmap v5515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:45 smithi133 ceph-mon[37053]: pgmap v5515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:45 smithi063 ceph-mon[36747]: pgmap v5515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9411.923246 secs 2024-07-26T11:12:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9427.405676 secs 2024-07-26T11:12:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9411.923246 secs 2024-07-26T11:12:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9427.405676 secs 2024-07-26T11:12:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9411.923246 secs 2024-07-26T11:12:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9427.405676 secs 2024-07-26T11:12:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:47 smithi063 ceph-mon[36747]: pgmap v5516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:47 smithi043 ceph-mon[32384]: pgmap v5516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:47 smithi133 ceph-mon[37053]: pgmap v5516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:12:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:49 smithi063 ceph-mon[36747]: pgmap v5517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:49 smithi043 ceph-mon[32384]: pgmap v5517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:50.022 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:49 smithi133 ceph-mon[37053]: pgmap v5517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:51.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9416.923387 secs 2024-07-26T11:12:51.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:51 smithi043 ceph-mon[32384]: pgmap v5518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:51.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9432.405801 secs 2024-07-26T11:12:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9416.923387 secs 2024-07-26T11:12:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:51 smithi063 ceph-mon[36747]: pgmap v5518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9432.405801 secs 2024-07-26T11:12:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9416.923387 secs 2024-07-26T11:12:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:51 smithi133 ceph-mon[37053]: pgmap v5518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:12:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9432.405801 secs 2024-07-26T11:12:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:53 smithi063 ceph-mon[36747]: pgmap v5519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:12:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:53 smithi043 ceph-mon[32384]: pgmap v5519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:12:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:53 smithi133 ceph-mon[37053]: pgmap v5519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:12:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:12:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:12:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:12:54.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:12:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:12:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:12:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:12:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:12:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:12:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:12:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:55 smithi063 ceph-mon[36747]: pgmap v5520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:55 smithi063 ceph-mon[36747]: pgmap v5521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:55.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9421.923516 secs 2024-07-26T11:12:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:55 smithi043 ceph-mon[32384]: pgmap v5520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:55 smithi043 ceph-mon[32384]: pgmap v5521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9421.923516 secs 2024-07-26T11:12:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:55 smithi133 ceph-mon[37053]: pgmap v5520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:55 smithi133 ceph-mon[37053]: pgmap v5521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9421.923516 secs 2024-07-26T11:12:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9437.405919 secs 2024-07-26T11:12:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:56 smithi063 ceph-mon[36747]: pgmap v5522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9437.405919 secs 2024-07-26T11:12:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:56 smithi043 ceph-mon[32384]: pgmap v5522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9437.405919 secs 2024-07-26T11:12:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:56 smithi133 ceph-mon[37053]: pgmap v5522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:12:58 smithi063 ceph-mon[36747]: pgmap v5523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:12:58 smithi043 ceph-mon[32384]: pgmap v5523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:12:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:12:58 smithi133 ceph-mon[37053]: pgmap v5523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:13:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:00 smithi063 ceph-mon[36747]: pgmap v5524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:13:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9426.923620 secs 2024-07-26T11:13:01.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:00 smithi133 ceph-mon[37053]: pgmap v5524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:13:01.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9426.923620 secs 2024-07-26T11:13:01.179 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:00 smithi043 ceph-mon[32384]: pgmap v5524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:13:01.179 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9426.923620 secs 2024-07-26T11:13:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9442.406029 secs 2024-07-26T11:13:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9442.406029 secs 2024-07-26T11:13:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9442.406029 secs 2024-07-26T11:13:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:02 smithi063 ceph-mon[36747]: pgmap v5525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:13:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:02 smithi043 ceph-mon[32384]: pgmap v5525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:13:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:02 smithi133 ceph-mon[37053]: pgmap v5525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:13:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:04 smithi063 ceph-mon[36747]: pgmap v5526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:13:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:04 smithi043 ceph-mon[32384]: pgmap v5526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:13:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:04 smithi133 ceph-mon[37053]: pgmap v5526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:13:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9431.923784 secs 2024-07-26T11:13:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9431.923784 secs 2024-07-26T11:13:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9431.923784 secs 2024-07-26T11:13:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9447.406141 secs 2024-07-26T11:13:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:06 smithi063 ceph-mon[36747]: pgmap v5527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9447.406141 secs 2024-07-26T11:13:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:06 smithi043 ceph-mon[32384]: pgmap v5527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9447.406141 secs 2024-07-26T11:13:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:06 smithi133 ceph-mon[37053]: pgmap v5527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:08 smithi063 ceph-mon[36747]: pgmap v5528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:08 smithi043 ceph-mon[32384]: pgmap v5528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:08 smithi133 ceph-mon[37053]: pgmap v5528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:11 smithi043 ceph-mon[32384]: pgmap v5529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9436.923899 secs 2024-07-26T11:13:11.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9452.406262 secs 2024-07-26T11:13:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:11 smithi133 ceph-mon[37053]: pgmap v5529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9436.923899 secs 2024-07-26T11:13:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9452.406262 secs 2024-07-26T11:13:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:11 smithi063 ceph-mon[36747]: pgmap v5529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9436.923899 secs 2024-07-26T11:13:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9452.406262 secs 2024-07-26T11:13:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:13 smithi043 ceph-mon[32384]: pgmap v5530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:13 smithi133 ceph-mon[37053]: pgmap v5530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:13 smithi063 ceph-mon[36747]: pgmap v5530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:15 smithi043 ceph-mon[32384]: pgmap v5531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:15 smithi133 ceph-mon[37053]: pgmap v5531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:15 smithi063 ceph-mon[36747]: pgmap v5531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9441.923996 secs 2024-07-26T11:13:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9457.406391 secs 2024-07-26T11:13:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9441.923996 secs 2024-07-26T11:13:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9457.406391 secs 2024-07-26T11:13:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9441.923996 secs 2024-07-26T11:13:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9457.406391 secs 2024-07-26T11:13:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:17 smithi043 ceph-mon[32384]: pgmap v5532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:17 smithi133 ceph-mon[37053]: pgmap v5532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:17 smithi063 ceph-mon[36747]: pgmap v5532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:19 smithi043 ceph-mon[32384]: pgmap v5533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:19 smithi133 ceph-mon[37053]: pgmap v5533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:19 smithi063 ceph-mon[36747]: pgmap v5533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:21 smithi043 ceph-mon[32384]: pgmap v5534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9446.924150 secs 2024-07-26T11:13:21.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9462.406536 secs 2024-07-26T11:13:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:21 smithi133 ceph-mon[37053]: pgmap v5534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9446.924150 secs 2024-07-26T11:13:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9462.406536 secs 2024-07-26T11:13:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:21 smithi063 ceph-mon[36747]: pgmap v5534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9446.924150 secs 2024-07-26T11:13:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9462.406536 secs 2024-07-26T11:13:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:23 smithi043 ceph-mon[32384]: pgmap v5535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:23 smithi133 ceph-mon[37053]: pgmap v5535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:23 smithi063 ceph-mon[36747]: pgmap v5535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:25 smithi043 ceph-mon[32384]: pgmap v5536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:25 smithi133 ceph-mon[37053]: pgmap v5536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:25 smithi063 ceph-mon[36747]: pgmap v5536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9451.924197 secs 2024-07-26T11:13:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9467.406619 secs 2024-07-26T11:13:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9451.924197 secs 2024-07-26T11:13:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9467.406619 secs 2024-07-26T11:13:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9451.924197 secs 2024-07-26T11:13:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9467.406619 secs 2024-07-26T11:13:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:27 smithi043 ceph-mon[32384]: pgmap v5537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:27 smithi133 ceph-mon[37053]: pgmap v5537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:27 smithi063 ceph-mon[36747]: pgmap v5537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:29 smithi043 ceph-mon[32384]: pgmap v5538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:29 smithi133 ceph-mon[37053]: pgmap v5538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:29 smithi063 ceph-mon[36747]: pgmap v5538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:31 smithi043 ceph-mon[32384]: pgmap v5539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9456.924265 secs 2024-07-26T11:13:31.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9472.406764 secs 2024-07-26T11:13:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:31 smithi133 ceph-mon[37053]: pgmap v5539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9456.924265 secs 2024-07-26T11:13:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9472.406764 secs 2024-07-26T11:13:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:31 smithi063 ceph-mon[36747]: pgmap v5539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9456.924265 secs 2024-07-26T11:13:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9472.406764 secs 2024-07-26T11:13:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:33 smithi043 ceph-mon[32384]: pgmap v5540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:33 smithi133 ceph-mon[37053]: pgmap v5540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:33 smithi063 ceph-mon[36747]: pgmap v5540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:35 smithi043 ceph-mon[32384]: pgmap v5541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:35 smithi133 ceph-mon[37053]: pgmap v5541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:35 smithi063 ceph-mon[36747]: pgmap v5541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9461.924402 secs 2024-07-26T11:13:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9477.406914 secs 2024-07-26T11:13:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9461.924402 secs 2024-07-26T11:13:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9477.406914 secs 2024-07-26T11:13:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9461.924402 secs 2024-07-26T11:13:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9477.406914 secs 2024-07-26T11:13:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:37 smithi043 ceph-mon[32384]: pgmap v5542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:37 smithi133 ceph-mon[37053]: pgmap v5542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:37 smithi063 ceph-mon[36747]: pgmap v5542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:39 smithi133 ceph-mon[37053]: pgmap v5543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:39 smithi063 ceph-mon[36747]: pgmap v5543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:39 smithi043 ceph-mon[32384]: pgmap v5543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:41 smithi133 ceph-mon[37053]: pgmap v5544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9466.924500 secs 2024-07-26T11:13:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9482.407042 secs 2024-07-26T11:13:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:41 smithi063 ceph-mon[36747]: pgmap v5544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9466.924500 secs 2024-07-26T11:13:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9482.407042 secs 2024-07-26T11:13:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:41 smithi043 ceph-mon[32384]: pgmap v5544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9466.924500 secs 2024-07-26T11:13:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9482.407042 secs 2024-07-26T11:13:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:43 smithi133 ceph-mon[37053]: pgmap v5545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:43 smithi063 ceph-mon[36747]: pgmap v5545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:43 smithi043 ceph-mon[32384]: pgmap v5545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:45 smithi133 ceph-mon[37053]: pgmap v5546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:45 smithi063 ceph-mon[36747]: pgmap v5546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:45 smithi043 ceph-mon[32384]: pgmap v5546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9471.924622 secs 2024-07-26T11:13:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9487.407143 secs 2024-07-26T11:13:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9471.924622 secs 2024-07-26T11:13:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9487.407143 secs 2024-07-26T11:13:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9471.924622 secs 2024-07-26T11:13:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9487.407143 secs 2024-07-26T11:13:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:47 smithi133 ceph-mon[37053]: pgmap v5547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:47 smithi063 ceph-mon[36747]: pgmap v5547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:47 smithi043 ceph-mon[32384]: pgmap v5547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:49 smithi063 ceph-mon[36747]: pgmap v5548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:49 smithi043 ceph-mon[32384]: pgmap v5548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:49 smithi133 ceph-mon[37053]: pgmap v5548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:51.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:51 smithi043 ceph-mon[32384]: pgmap v5549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:51.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9476.924748 secs 2024-07-26T11:13:51.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9492.407273 secs 2024-07-26T11:13:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:51 smithi063 ceph-mon[36747]: pgmap v5549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9476.924748 secs 2024-07-26T11:13:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9492.407273 secs 2024-07-26T11:13:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:51 smithi133 ceph-mon[37053]: pgmap v5549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:13:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9476.924748 secs 2024-07-26T11:13:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9492.407273 secs 2024-07-26T11:13:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:53 smithi063 ceph-mon[36747]: pgmap v5550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:53 smithi043 ceph-mon[32384]: pgmap v5550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:53 smithi133 ceph-mon[37053]: pgmap v5550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:13:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:13:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:13:55.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:55 smithi063 ceph-mon[36747]: pgmap v5551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:55.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:55.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:55 smithi043 ceph-mon[32384]: pgmap v5551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:55 smithi133 ceph-mon[37053]: pgmap v5551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:13:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9481.924883 secs 2024-07-26T11:13:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9497.407401 secs 2024-07-26T11:13:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:13:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:56 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:13:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9481.924883 secs 2024-07-26T11:13:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9497.407401 secs 2024-07-26T11:13:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:13:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:56 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:13:56.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9481.924883 secs 2024-07-26T11:13:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9497.407401 secs 2024-07-26T11:13:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:13:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:56 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:13:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:13:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:57 smithi063 ceph-mon[36747]: pgmap v5552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:57 smithi063 ceph-mon[36747]: pgmap v5553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:13:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:57 smithi043 ceph-mon[32384]: pgmap v5552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:57 smithi043 ceph-mon[32384]: pgmap v5553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:13:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:57 smithi133 ceph-mon[37053]: pgmap v5552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:13:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:57 smithi133 ceph-mon[37053]: pgmap v5553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:13:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:13:59 smithi063 ceph-mon[36747]: pgmap v5554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:13:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:13:59 smithi043 ceph-mon[32384]: pgmap v5554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:13:59 smithi133 ceph-mon[37053]: pgmap v5554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:00 smithi043 ceph-mon[32384]: pgmap v5555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9486.925003 secs 2024-07-26T11:14:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:00 smithi133 ceph-mon[37053]: pgmap v5555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9486.925003 secs 2024-07-26T11:14:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:00 smithi063 ceph-mon[36747]: pgmap v5555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9486.925003 secs 2024-07-26T11:14:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9502.407536 secs 2024-07-26T11:14:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9502.407536 secs 2024-07-26T11:14:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9502.407536 secs 2024-07-26T11:14:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:02 smithi043 ceph-mon[32384]: pgmap v5556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:02 smithi133 ceph-mon[37053]: pgmap v5556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:02 smithi063 ceph-mon[36747]: pgmap v5556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:04 smithi133 ceph-mon[37053]: pgmap v5557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:04 smithi063 ceph-mon[36747]: pgmap v5557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:04 smithi043 ceph-mon[32384]: pgmap v5557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9491.925139 secs 2024-07-26T11:14:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9491.925139 secs 2024-07-26T11:14:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9491.925139 secs 2024-07-26T11:14:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9507.407658 secs 2024-07-26T11:14:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:06 smithi063 ceph-mon[36747]: pgmap v5558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9507.407658 secs 2024-07-26T11:14:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:06 smithi043 ceph-mon[32384]: pgmap v5558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9507.407658 secs 2024-07-26T11:14:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:06 smithi133 ceph-mon[37053]: pgmap v5558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:08 smithi063 ceph-mon[36747]: pgmap v5559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:08 smithi043 ceph-mon[32384]: pgmap v5559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:08 smithi133 ceph-mon[37053]: pgmap v5559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:10 smithi063 ceph-mon[36747]: pgmap v5560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9496.925259 secs 2024-07-26T11:14:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:10 smithi043 ceph-mon[32384]: pgmap v5560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9496.925259 secs 2024-07-26T11:14:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:10 smithi133 ceph-mon[37053]: pgmap v5560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9496.925259 secs 2024-07-26T11:14:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9512.407781 secs 2024-07-26T11:14:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9512.407781 secs 2024-07-26T11:14:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9512.407781 secs 2024-07-26T11:14:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:12 smithi063 ceph-mon[36747]: pgmap v5561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:12 smithi043 ceph-mon[32384]: pgmap v5561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:12 smithi133 ceph-mon[37053]: pgmap v5561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:14 smithi063 ceph-mon[36747]: pgmap v5562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:14 smithi043 ceph-mon[32384]: pgmap v5562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:14 smithi133 ceph-mon[37053]: pgmap v5562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9501.925371 secs 2024-07-26T11:14:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9501.925371 secs 2024-07-26T11:14:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9501.925371 secs 2024-07-26T11:14:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9517.407901 secs 2024-07-26T11:14:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:16 smithi043 ceph-mon[32384]: pgmap v5563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9517.407901 secs 2024-07-26T11:14:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:16 smithi133 ceph-mon[37053]: pgmap v5563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9517.407901 secs 2024-07-26T11:14:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:16 smithi063 ceph-mon[36747]: pgmap v5563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:18 smithi043 ceph-mon[32384]: pgmap v5564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:18 smithi133 ceph-mon[37053]: pgmap v5564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:18 smithi063 ceph-mon[36747]: pgmap v5564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:20 smithi043 ceph-mon[32384]: pgmap v5565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:14:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9506.925460 secs 2024-07-26T11:14:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:20 smithi133 ceph-mon[37053]: pgmap v5565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:14:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9506.925460 secs 2024-07-26T11:14:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:20 smithi063 ceph-mon[36747]: pgmap v5565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:14:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9506.925460 secs 2024-07-26T11:14:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9522.408027 secs 2024-07-26T11:14:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9522.408027 secs 2024-07-26T11:14:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9522.408027 secs 2024-07-26T11:14:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:22 smithi043 ceph-mon[32384]: pgmap v5566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:22 smithi133 ceph-mon[37053]: pgmap v5566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:22 smithi063 ceph-mon[36747]: pgmap v5566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:24 smithi043 ceph-mon[32384]: pgmap v5567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:24 smithi133 ceph-mon[37053]: pgmap v5567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:24 smithi063 ceph-mon[36747]: pgmap v5567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:14:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9511.925541 secs 2024-07-26T11:14:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9511.925541 secs 2024-07-26T11:14:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9511.925541 secs 2024-07-26T11:14:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9527.408181 secs 2024-07-26T11:14:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:26 smithi043 ceph-mon[32384]: pgmap v5568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9527.408181 secs 2024-07-26T11:14:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:26 smithi133 ceph-mon[37053]: pgmap v5568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9527.408181 secs 2024-07-26T11:14:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:26 smithi063 ceph-mon[36747]: pgmap v5568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:14:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:28 smithi043 ceph-mon[32384]: pgmap v5569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:28 smithi133 ceph-mon[37053]: pgmap v5569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:28 smithi063 ceph-mon[36747]: pgmap v5569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:30 smithi043 ceph-mon[32384]: pgmap v5570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9516.925663 secs 2024-07-26T11:14:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:30 smithi133 ceph-mon[37053]: pgmap v5570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9516.925663 secs 2024-07-26T11:14:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:30 smithi063 ceph-mon[36747]: pgmap v5570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:31.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9516.925663 secs 2024-07-26T11:14:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9532.408306 secs 2024-07-26T11:14:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9532.408306 secs 2024-07-26T11:14:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9532.408306 secs 2024-07-26T11:14:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:32 smithi043 ceph-mon[32384]: pgmap v5571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:32 smithi133 ceph-mon[37053]: pgmap v5571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:32 smithi063 ceph-mon[36747]: pgmap v5571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:34 smithi043 ceph-mon[32384]: pgmap v5572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:34 smithi133 ceph-mon[37053]: pgmap v5572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:34 smithi063 ceph-mon[36747]: pgmap v5572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9521.925802 secs 2024-07-26T11:14:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9521.925802 secs 2024-07-26T11:14:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9521.925802 secs 2024-07-26T11:14:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9537.408406 secs 2024-07-26T11:14:37.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:36 smithi043 ceph-mon[32384]: pgmap v5573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9537.408406 secs 2024-07-26T11:14:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:36 smithi133 ceph-mon[37053]: pgmap v5573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9537.408406 secs 2024-07-26T11:14:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:36 smithi063 ceph-mon[36747]: pgmap v5573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:38 smithi043 ceph-mon[32384]: pgmap v5574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:38 smithi133 ceph-mon[37053]: pgmap v5574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:38 smithi063 ceph-mon[36747]: pgmap v5574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:40 smithi043 ceph-mon[32384]: pgmap v5575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9526.925942 secs 2024-07-26T11:14:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:40 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9542.408552 secs 2024-07-26T11:14:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:40 smithi133 ceph-mon[37053]: pgmap v5575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9526.925942 secs 2024-07-26T11:14:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:40 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9542.408552 secs 2024-07-26T11:14:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:40 smithi063 ceph-mon[36747]: pgmap v5575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9526.925942 secs 2024-07-26T11:14:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:40 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9542.408552 secs 2024-07-26T11:14:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:42 smithi043 ceph-mon[32384]: pgmap v5576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:42 smithi133 ceph-mon[37053]: pgmap v5576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:42 smithi063 ceph-mon[36747]: pgmap v5576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:44 smithi043 ceph-mon[32384]: pgmap v5577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:44 smithi133 ceph-mon[37053]: pgmap v5577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:44 smithi063 ceph-mon[36747]: pgmap v5577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9531.926015 secs 2024-07-26T11:14:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:45 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9547.408672 secs 2024-07-26T11:14:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9531.926015 secs 2024-07-26T11:14:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:45 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9547.408672 secs 2024-07-26T11:14:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9531.926015 secs 2024-07-26T11:14:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:45 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9547.408672 secs 2024-07-26T11:14:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:46 smithi043 ceph-mon[32384]: pgmap v5578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:46 smithi133 ceph-mon[37053]: pgmap v5578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:46 smithi063 ceph-mon[36747]: pgmap v5578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:48 smithi043 ceph-mon[32384]: pgmap v5579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:48 smithi133 ceph-mon[37053]: pgmap v5579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:48 smithi063 ceph-mon[36747]: pgmap v5579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:50 smithi043 ceph-mon[32384]: pgmap v5580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9536.926136 secs 2024-07-26T11:14:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:50 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9552.408829 secs 2024-07-26T11:14:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:50 smithi133 ceph-mon[37053]: pgmap v5580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9536.926136 secs 2024-07-26T11:14:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:50 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9552.408829 secs 2024-07-26T11:14:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:50 smithi063 ceph-mon[36747]: pgmap v5580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:14:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9536.926136 secs 2024-07-26T11:14:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:50 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9552.408829 secs 2024-07-26T11:14:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:52 smithi043 ceph-mon[32384]: pgmap v5581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:52 smithi133 ceph-mon[37053]: pgmap v5581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:52 smithi063 ceph-mon[36747]: pgmap v5581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:54 smithi043 ceph-mon[32384]: pgmap v5582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:54 smithi133 ceph-mon[37053]: pgmap v5582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:54 smithi063 ceph-mon[36747]: pgmap v5582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9541.926250 secs 2024-07-26T11:14:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:55 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9557.408958 secs 2024-07-26T11:14:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:14:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9541.926250 secs 2024-07-26T11:14:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:55 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9557.408958 secs 2024-07-26T11:14:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:14:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9541.926250 secs 2024-07-26T11:14:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:55 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9557.408958 secs 2024-07-26T11:14:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:14:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:57 smithi043 ceph-mon[32384]: pgmap v5583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:57 smithi063 ceph-mon[36747]: pgmap v5583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:57 smithi133 ceph-mon[37053]: pgmap v5583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:14:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:57.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:58 smithi133 ceph-mon[37053]: pgmap v5584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:14:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:58 smithi063 ceph-mon[36747]: pgmap v5584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:14:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:58 smithi043 ceph-mon[32384]: pgmap v5584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:14:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:14:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:01 smithi043 ceph-mon[32384]: pgmap v5585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:01 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9546.926368 secs 2024-07-26T11:15:01.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9562.409076 secs 2024-07-26T11:15:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:01 smithi133 ceph-mon[37053]: pgmap v5585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:01 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9546.926368 secs 2024-07-26T11:15:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9562.409076 secs 2024-07-26T11:15:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:01 smithi063 ceph-mon[36747]: pgmap v5585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:01 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9546.926368 secs 2024-07-26T11:15:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9562.409076 secs 2024-07-26T11:15:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:15:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:15:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:02 smithi043 ceph-mon[32384]: pgmap v5586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:15:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:02 smithi043 ceph-mon[32384]: pgmap v5587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:02.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:15:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:15:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:02 smithi133 ceph-mon[37053]: pgmap v5586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:15:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:02 smithi133 ceph-mon[37053]: pgmap v5587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:15:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:15:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:02 smithi063 ceph-mon[36747]: pgmap v5586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:15:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:02 smithi063 ceph-mon[36747]: pgmap v5587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:15:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:04 smithi043 ceph-mon[32384]: pgmap v5588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:04 smithi133 ceph-mon[37053]: pgmap v5588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:04 smithi063 ceph-mon[36747]: pgmap v5588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:06 smithi043 ceph-mon[32384]: pgmap v5589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:15:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9551.926486 secs 2024-07-26T11:15:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9567.409166 secs 2024-07-26T11:15:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:06 smithi133 ceph-mon[37053]: pgmap v5589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:15:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9551.926486 secs 2024-07-26T11:15:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9567.409166 secs 2024-07-26T11:15:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:06 smithi063 ceph-mon[36747]: pgmap v5589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:15:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9551.926486 secs 2024-07-26T11:15:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9567.409166 secs 2024-07-26T11:15:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:08 smithi133 ceph-mon[37053]: pgmap v5590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:15:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:08 smithi063 ceph-mon[36747]: pgmap v5590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:15:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:08 smithi043 ceph-mon[32384]: pgmap v5590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:15:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:10 smithi133 ceph-mon[37053]: pgmap v5591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:10 smithi063 ceph-mon[36747]: pgmap v5591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:10 smithi043 ceph-mon[32384]: pgmap v5591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9556.926628 secs 2024-07-26T11:15:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9572.409289 secs 2024-07-26T11:15:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9556.926628 secs 2024-07-26T11:15:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9572.409289 secs 2024-07-26T11:15:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9556.926628 secs 2024-07-26T11:15:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9572.409289 secs 2024-07-26T11:15:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:12 smithi133 ceph-mon[37053]: pgmap v5592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:15:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:12 smithi063 ceph-mon[36747]: pgmap v5592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:15:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:12 smithi043 ceph-mon[32384]: pgmap v5592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:15:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:14 smithi063 ceph-mon[36747]: pgmap v5593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:14 smithi043 ceph-mon[32384]: pgmap v5593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:14 smithi133 ceph-mon[37053]: pgmap v5593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:16 smithi063 ceph-mon[36747]: pgmap v5594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9561.926693 secs 2024-07-26T11:15:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9577.409415 secs 2024-07-26T11:15:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:16 smithi043 ceph-mon[32384]: pgmap v5594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9561.926693 secs 2024-07-26T11:15:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9577.409415 secs 2024-07-26T11:15:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:16 smithi133 ceph-mon[37053]: pgmap v5594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9561.926693 secs 2024-07-26T11:15:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9577.409415 secs 2024-07-26T11:15:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:18 smithi063 ceph-mon[36747]: pgmap v5595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:18 smithi043 ceph-mon[32384]: pgmap v5595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:18 smithi133 ceph-mon[37053]: pgmap v5595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:20 smithi063 ceph-mon[36747]: pgmap v5596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:20 smithi043 ceph-mon[32384]: pgmap v5596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:20 smithi133 ceph-mon[37053]: pgmap v5596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9566.926828 secs 2024-07-26T11:15:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9582.409540 secs 2024-07-26T11:15:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9566.926828 secs 2024-07-26T11:15:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9582.409540 secs 2024-07-26T11:15:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9566.926828 secs 2024-07-26T11:15:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9582.409540 secs 2024-07-26T11:15:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:22 smithi063 ceph-mon[36747]: pgmap v5597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:22 smithi043 ceph-mon[32384]: pgmap v5597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:22 smithi133 ceph-mon[37053]: pgmap v5597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:24 smithi063 ceph-mon[36747]: pgmap v5598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:24 smithi043 ceph-mon[32384]: pgmap v5598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:24 smithi133 ceph-mon[37053]: pgmap v5598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:26 smithi063 ceph-mon[36747]: pgmap v5599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9571.926974 secs 2024-07-26T11:15:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9587.409669 secs 2024-07-26T11:15:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:26 smithi043 ceph-mon[32384]: pgmap v5599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9571.926974 secs 2024-07-26T11:15:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9587.409669 secs 2024-07-26T11:15:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:26 smithi133 ceph-mon[37053]: pgmap v5599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9571.926974 secs 2024-07-26T11:15:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9587.409669 secs 2024-07-26T11:15:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:28 smithi063 ceph-mon[36747]: pgmap v5600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:28 smithi043 ceph-mon[32384]: pgmap v5600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:28 smithi133 ceph-mon[37053]: pgmap v5600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:30 smithi043 ceph-mon[32384]: pgmap v5601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:30 smithi133 ceph-mon[37053]: pgmap v5601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:30 smithi063 ceph-mon[36747]: pgmap v5601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9576.927095 secs 2024-07-26T11:15:31.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9592.409800 secs 2024-07-26T11:15:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9576.927095 secs 2024-07-26T11:15:31.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9592.409800 secs 2024-07-26T11:15:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9576.927095 secs 2024-07-26T11:15:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9592.409800 secs 2024-07-26T11:15:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:32 smithi043 ceph-mon[32384]: pgmap v5602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:32 smithi133 ceph-mon[37053]: pgmap v5602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:32 smithi063 ceph-mon[36747]: pgmap v5602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:34 smithi043 ceph-mon[32384]: pgmap v5603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:34 smithi133 ceph-mon[37053]: pgmap v5603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:34 smithi063 ceph-mon[36747]: pgmap v5603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:36 smithi043 ceph-mon[32384]: pgmap v5604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9581.927221 secs 2024-07-26T11:15:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9597.409934 secs 2024-07-26T11:15:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:36 smithi133 ceph-mon[37053]: pgmap v5604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9581.927221 secs 2024-07-26T11:15:36.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9597.409934 secs 2024-07-26T11:15:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:36 smithi063 ceph-mon[36747]: pgmap v5604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9581.927221 secs 2024-07-26T11:15:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9597.409934 secs 2024-07-26T11:15:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:38 smithi043 ceph-mon[32384]: pgmap v5605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:38 smithi133 ceph-mon[37053]: pgmap v5605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:38 smithi063 ceph-mon[36747]: pgmap v5605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:40 smithi043 ceph-mon[32384]: pgmap v5606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:40 smithi133 ceph-mon[37053]: pgmap v5606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:40 smithi063 ceph-mon[36747]: pgmap v5606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9586.927342 secs 2024-07-26T11:15:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9602.410046 secs 2024-07-26T11:15:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9586.927342 secs 2024-07-26T11:15:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9602.410046 secs 2024-07-26T11:15:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9586.927342 secs 2024-07-26T11:15:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9602.410046 secs 2024-07-26T11:15:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:42 smithi043 ceph-mon[32384]: pgmap v5607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:42 smithi133 ceph-mon[37053]: pgmap v5607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:42 smithi063 ceph-mon[36747]: pgmap v5607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:44 smithi043 ceph-mon[32384]: pgmap v5608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:44 smithi133 ceph-mon[37053]: pgmap v5608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:44 smithi063 ceph-mon[36747]: pgmap v5608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:46 smithi043 ceph-mon[32384]: pgmap v5609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9591.927440 secs 2024-07-26T11:15:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9607.410158 secs 2024-07-26T11:15:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:46 smithi133 ceph-mon[37053]: pgmap v5609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9591.927440 secs 2024-07-26T11:15:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9607.410158 secs 2024-07-26T11:15:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:46 smithi063 ceph-mon[36747]: pgmap v5609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9591.927440 secs 2024-07-26T11:15:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9607.410158 secs 2024-07-26T11:15:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:48 smithi043 ceph-mon[32384]: pgmap v5610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:48 smithi133 ceph-mon[37053]: pgmap v5610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:48 smithi063 ceph-mon[36747]: pgmap v5610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:50 smithi043 ceph-mon[32384]: pgmap v5611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:50 smithi133 ceph-mon[37053]: pgmap v5611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:50 smithi063 ceph-mon[36747]: pgmap v5611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9596.927559 secs 2024-07-26T11:15:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9612.410239 secs 2024-07-26T11:15:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9596.927559 secs 2024-07-26T11:15:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9612.410239 secs 2024-07-26T11:15:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9596.927559 secs 2024-07-26T11:15:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9612.410239 secs 2024-07-26T11:15:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:52 smithi043 ceph-mon[32384]: pgmap v5612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:52 smithi133 ceph-mon[37053]: pgmap v5612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:52 smithi063 ceph-mon[36747]: pgmap v5612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:54 smithi043 ceph-mon[32384]: pgmap v5613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:54 smithi133 ceph-mon[37053]: pgmap v5613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:54 smithi063 ceph-mon[36747]: pgmap v5613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:15:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:56 smithi043 ceph-mon[32384]: pgmap v5614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9601.927680 secs 2024-07-26T11:15:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9617.410336 secs 2024-07-26T11:15:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:56 smithi133 ceph-mon[37053]: pgmap v5614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9601.927680 secs 2024-07-26T11:15:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9617.410336 secs 2024-07-26T11:15:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:56 smithi063 ceph-mon[36747]: pgmap v5614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:15:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9601.927680 secs 2024-07-26T11:15:56.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9617.410336 secs 2024-07-26T11:15:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:15:58 smithi043 ceph-mon[32384]: pgmap v5615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:15:58 smithi133 ceph-mon[37053]: pgmap v5615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:15:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:15:58 smithi063 ceph-mon[36747]: pgmap v5615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:00 smithi043 ceph-mon[32384]: pgmap v5616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:00 smithi133 ceph-mon[37053]: pgmap v5616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:00 smithi063 ceph-mon[36747]: pgmap v5616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:01.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9606.927819 secs 2024-07-26T11:16:01.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9622.410403 secs 2024-07-26T11:16:01.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:01 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:16:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9606.927819 secs 2024-07-26T11:16:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9622.410403 secs 2024-07-26T11:16:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:01 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9606.927819 secs 2024-07-26T11:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9622.410403 secs 2024-07-26T11:16:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:01 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:16:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:02 smithi043 ceph-mon[32384]: pgmap v5617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:16:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:16:02.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:16:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:02 smithi133 ceph-mon[37053]: pgmap v5617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:16:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:16:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:16:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:02 smithi063 ceph-mon[36747]: pgmap v5617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:16:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:16:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:16:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:03 smithi043 ceph-mon[32384]: pgmap v5618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:16:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:03 smithi043 ceph-mon[32384]: pgmap v5619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:16:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:03 smithi133 ceph-mon[37053]: pgmap v5618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:16:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:03 smithi133 ceph-mon[37053]: pgmap v5619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:16:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:03 smithi063 ceph-mon[36747]: pgmap v5618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:16:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:03 smithi063 ceph-mon[36747]: pgmap v5619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:16:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:05 smithi043 ceph-mon[32384]: pgmap v5620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:05 smithi133 ceph-mon[37053]: pgmap v5620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:05 smithi063 ceph-mon[36747]: pgmap v5620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9611.927966 secs 2024-07-26T11:16:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9627.410520 secs 2024-07-26T11:16:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9611.927966 secs 2024-07-26T11:16:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9627.410520 secs 2024-07-26T11:16:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9611.927966 secs 2024-07-26T11:16:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9627.410520 secs 2024-07-26T11:16:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:07 smithi133 ceph-mon[37053]: pgmap v5621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:07 smithi063 ceph-mon[36747]: pgmap v5621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:07 smithi043 ceph-mon[32384]: pgmap v5621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:09 smithi133 ceph-mon[37053]: pgmap v5622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:16:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:09 smithi063 ceph-mon[36747]: pgmap v5622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:16:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:09 smithi043 ceph-mon[32384]: pgmap v5622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:16:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9616.928084 secs 2024-07-26T11:16:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:11 smithi133 ceph-mon[37053]: pgmap v5623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9632.410651 secs 2024-07-26T11:16:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9616.928084 secs 2024-07-26T11:16:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:11 smithi063 ceph-mon[36747]: pgmap v5623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9632.410651 secs 2024-07-26T11:16:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9616.928084 secs 2024-07-26T11:16:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:11 smithi043 ceph-mon[32384]: pgmap v5623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:16:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9632.410651 secs 2024-07-26T11:16:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:13 smithi133 ceph-mon[37053]: pgmap v5624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:16:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:13 smithi063 ceph-mon[36747]: pgmap v5624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:16:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:13 smithi043 ceph-mon[32384]: pgmap v5624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:16:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:15 smithi063 ceph-mon[36747]: pgmap v5625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:15 smithi043 ceph-mon[32384]: pgmap v5625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:15 smithi133 ceph-mon[37053]: pgmap v5625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9621.928196 secs 2024-07-26T11:16:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9637.410782 secs 2024-07-26T11:16:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9621.928196 secs 2024-07-26T11:16:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9637.410782 secs 2024-07-26T11:16:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9621.928196 secs 2024-07-26T11:16:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9637.410782 secs 2024-07-26T11:16:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:17 smithi063 ceph-mon[36747]: pgmap v5626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:17 smithi043 ceph-mon[32384]: pgmap v5626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:17 smithi133 ceph-mon[37053]: pgmap v5626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:19 smithi063 ceph-mon[36747]: pgmap v5627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:19 smithi043 ceph-mon[32384]: pgmap v5627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:19 smithi133 ceph-mon[37053]: pgmap v5627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9626.928287 secs 2024-07-26T11:16:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:21 smithi063 ceph-mon[36747]: pgmap v5628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9642.410886 secs 2024-07-26T11:16:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9626.928287 secs 2024-07-26T11:16:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:21 smithi043 ceph-mon[32384]: pgmap v5628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:21.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9642.410886 secs 2024-07-26T11:16:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9626.928287 secs 2024-07-26T11:16:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:21 smithi133 ceph-mon[37053]: pgmap v5628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:22.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9642.410886 secs 2024-07-26T11:16:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:23 smithi063 ceph-mon[36747]: pgmap v5629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:23 smithi043 ceph-mon[32384]: pgmap v5629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:23 smithi133 ceph-mon[37053]: pgmap v5629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:25 smithi063 ceph-mon[36747]: pgmap v5630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:25 smithi043 ceph-mon[32384]: pgmap v5630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:25 smithi133 ceph-mon[37053]: pgmap v5630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9631.928414 secs 2024-07-26T11:16:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9647.410990 secs 2024-07-26T11:16:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9631.928414 secs 2024-07-26T11:16:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9647.410990 secs 2024-07-26T11:16:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9631.928414 secs 2024-07-26T11:16:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9647.410990 secs 2024-07-26T11:16:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:27 smithi063 ceph-mon[36747]: pgmap v5631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:27 smithi043 ceph-mon[32384]: pgmap v5631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:27 smithi133 ceph-mon[37053]: pgmap v5631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:29.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:29 smithi043 ceph-mon[32384]: pgmap v5632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:29 smithi133 ceph-mon[37053]: pgmap v5632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:29 smithi063 ceph-mon[36747]: pgmap v5632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9636.928531 secs 2024-07-26T11:16:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9636.928531 secs 2024-07-26T11:16:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9636.928531 secs 2024-07-26T11:16:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:31 smithi133 ceph-mon[37053]: pgmap v5633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9652.411063 secs 2024-07-26T11:16:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:31 smithi063 ceph-mon[36747]: pgmap v5633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9652.411063 secs 2024-07-26T11:16:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:31 smithi043 ceph-mon[32384]: pgmap v5633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9652.411063 secs 2024-07-26T11:16:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:33 smithi043 ceph-mon[32384]: pgmap v5634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:33 smithi133 ceph-mon[37053]: pgmap v5634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:33 smithi063 ceph-mon[36747]: pgmap v5634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:35 smithi043 ceph-mon[32384]: pgmap v5635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9641.928657 secs 2024-07-26T11:16:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:35 smithi133 ceph-mon[37053]: pgmap v5635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9641.928657 secs 2024-07-26T11:16:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:35 smithi063 ceph-mon[36747]: pgmap v5635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9641.928657 secs 2024-07-26T11:16:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9657.411184 secs 2024-07-26T11:16:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:36 smithi043 ceph-mon[32384]: pgmap v5636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9657.411184 secs 2024-07-26T11:16:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:36 smithi133 ceph-mon[37053]: pgmap v5636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9657.411184 secs 2024-07-26T11:16:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:36 smithi063 ceph-mon[36747]: pgmap v5636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:39 smithi133 ceph-mon[37053]: pgmap v5637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:39 smithi063 ceph-mon[36747]: pgmap v5637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:39 smithi043 ceph-mon[32384]: pgmap v5637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9646.928801 secs 2024-07-26T11:16:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:41 smithi063 ceph-mon[36747]: pgmap v5638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:41.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9662.411303 secs 2024-07-26T11:16:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9646.928801 secs 2024-07-26T11:16:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:41 smithi043 ceph-mon[32384]: pgmap v5638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:41.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9662.411303 secs 2024-07-26T11:16:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9646.928801 secs 2024-07-26T11:16:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:41 smithi133 ceph-mon[37053]: pgmap v5638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9662.411303 secs 2024-07-26T11:16:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:43 smithi063 ceph-mon[36747]: pgmap v5639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:43 smithi043 ceph-mon[32384]: pgmap v5639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:43 smithi133 ceph-mon[37053]: pgmap v5639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:45 smithi063 ceph-mon[36747]: pgmap v5640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:45 smithi043 ceph-mon[32384]: pgmap v5640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:45 smithi133 ceph-mon[37053]: pgmap v5640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9651.928922 secs 2024-07-26T11:16:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9667.411425 secs 2024-07-26T11:16:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9651.928922 secs 2024-07-26T11:16:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9667.411425 secs 2024-07-26T11:16:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9651.928922 secs 2024-07-26T11:16:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9667.411425 secs 2024-07-26T11:16:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:47 smithi063 ceph-mon[36747]: pgmap v5641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:47 smithi043 ceph-mon[32384]: pgmap v5641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:47 smithi133 ceph-mon[37053]: pgmap v5641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:49 smithi063 ceph-mon[36747]: pgmap v5642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:49 smithi043 ceph-mon[32384]: pgmap v5642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:49 smithi133 ceph-mon[37053]: pgmap v5642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9656.929045 secs 2024-07-26T11:16:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:51 smithi063 ceph-mon[36747]: pgmap v5643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9672.411543 secs 2024-07-26T11:16:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9656.929045 secs 2024-07-26T11:16:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:51 smithi043 ceph-mon[32384]: pgmap v5643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9672.411543 secs 2024-07-26T11:16:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9656.929045 secs 2024-07-26T11:16:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:51 smithi133 ceph-mon[37053]: pgmap v5643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9672.411543 secs 2024-07-26T11:16:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:53 smithi063 ceph-mon[36747]: pgmap v5644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:53 smithi043 ceph-mon[32384]: pgmap v5644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:53 smithi133 ceph-mon[37053]: pgmap v5644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:16:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:55 smithi063 ceph-mon[36747]: pgmap v5645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:55 smithi043 ceph-mon[32384]: pgmap v5645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:55 smithi133 ceph-mon[37053]: pgmap v5645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:16:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9661.929160 secs 2024-07-26T11:16:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9677.411640 secs 2024-07-26T11:16:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9661.929160 secs 2024-07-26T11:16:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9677.411640 secs 2024-07-26T11:16:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9661.929160 secs 2024-07-26T11:16:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9677.411640 secs 2024-07-26T11:16:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:57 smithi043 ceph-mon[32384]: pgmap v5646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:57 smithi133 ceph-mon[37053]: pgmap v5646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:57 smithi063 ceph-mon[36747]: pgmap v5646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:16:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:16:59 smithi043 ceph-mon[32384]: pgmap v5647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:16:59 smithi133 ceph-mon[37053]: pgmap v5647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:16:59 smithi063 ceph-mon[36747]: pgmap v5647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9666.929250 secs 2024-07-26T11:17:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9666.929250 secs 2024-07-26T11:17:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9666.929250 secs 2024-07-26T11:17:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:01 smithi133 ceph-mon[37053]: pgmap v5648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:01.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9682.411763 secs 2024-07-26T11:17:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:01 smithi063 ceph-mon[36747]: pgmap v5648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9682.411763 secs 2024-07-26T11:17:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:01 smithi043 ceph-mon[32384]: pgmap v5648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9682.411763 secs 2024-07-26T11:17:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:03 smithi043 ceph-mon[32384]: pgmap v5649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:17:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:03 smithi133 ceph-mon[37053]: pgmap v5649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:17:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:03 smithi063 ceph-mon[36747]: pgmap v5649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:17:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:17:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:17:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:04 smithi043 ceph-mon[32384]: pgmap v5650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:04.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:04 smithi043 ceph-mon[32384]: pgmap v5651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:04.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:04 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:17:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:17:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:17:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:04 smithi133 ceph-mon[37053]: pgmap v5650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:04 smithi133 ceph-mon[37053]: pgmap v5651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:04 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:17:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:17:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:17:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:04 smithi063 ceph-mon[36747]: pgmap v5650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:05.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:04 smithi063 ceph-mon[36747]: pgmap v5651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:05.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:04 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:17:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9671.929378 secs 2024-07-26T11:17:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9671.929378 secs 2024-07-26T11:17:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9671.929378 secs 2024-07-26T11:17:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9687.411936 secs 2024-07-26T11:17:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:06 smithi043 ceph-mon[32384]: pgmap v5652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9687.411936 secs 2024-07-26T11:17:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:06 smithi133 ceph-mon[37053]: pgmap v5652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9687.411936 secs 2024-07-26T11:17:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:06 smithi063 ceph-mon[36747]: pgmap v5652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:08 smithi133 ceph-mon[37053]: pgmap v5653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:08 smithi063 ceph-mon[36747]: pgmap v5653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:08 smithi043 ceph-mon[32384]: pgmap v5653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:17:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:11 smithi133 ceph-mon[37053]: pgmap v5654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:17:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9676.929498 secs 2024-07-26T11:17:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9692.412052 secs 2024-07-26T11:17:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:11 smithi063 ceph-mon[36747]: pgmap v5654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:17:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9676.929498 secs 2024-07-26T11:17:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9692.412052 secs 2024-07-26T11:17:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:11 smithi043 ceph-mon[32384]: pgmap v5654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:17:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9676.929498 secs 2024-07-26T11:17:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9692.412052 secs 2024-07-26T11:17:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:13 smithi133 ceph-mon[37053]: pgmap v5655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:17:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:13 smithi063 ceph-mon[36747]: pgmap v5655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:17:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:13 smithi043 ceph-mon[32384]: pgmap v5655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:17:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:15 smithi133 ceph-mon[37053]: pgmap v5656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:15 smithi063 ceph-mon[36747]: pgmap v5656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:15 smithi043 ceph-mon[32384]: pgmap v5656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9681.929619 secs 2024-07-26T11:17:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9697.412171 secs 2024-07-26T11:17:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9681.929619 secs 2024-07-26T11:17:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9697.412171 secs 2024-07-26T11:17:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9681.929619 secs 2024-07-26T11:17:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9697.412171 secs 2024-07-26T11:17:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:17 smithi063 ceph-mon[36747]: pgmap v5657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:17 smithi043 ceph-mon[32384]: pgmap v5657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:17 smithi133 ceph-mon[37053]: pgmap v5657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:19 smithi063 ceph-mon[36747]: pgmap v5658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:19 smithi043 ceph-mon[32384]: pgmap v5658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:19 smithi133 ceph-mon[37053]: pgmap v5658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:21.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:21 smithi043 ceph-mon[32384]: pgmap v5659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:21.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9686.929738 secs 2024-07-26T11:17:21.787 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9702.412337 secs 2024-07-26T11:17:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:21 smithi063 ceph-mon[36747]: pgmap v5659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9686.929738 secs 2024-07-26T11:17:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9702.412337 secs 2024-07-26T11:17:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:21 smithi133 ceph-mon[37053]: pgmap v5659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9686.929738 secs 2024-07-26T11:17:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9702.412337 secs 2024-07-26T11:17:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:23 smithi063 ceph-mon[36747]: pgmap v5660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:23 smithi043 ceph-mon[32384]: pgmap v5660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:23 smithi133 ceph-mon[37053]: pgmap v5660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:25 smithi063 ceph-mon[36747]: pgmap v5661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:25 smithi043 ceph-mon[32384]: pgmap v5661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:25 smithi133 ceph-mon[37053]: pgmap v5661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9691.929865 secs 2024-07-26T11:17:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9707.412434 secs 2024-07-26T11:17:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9691.929865 secs 2024-07-26T11:17:26.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9707.412434 secs 2024-07-26T11:17:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9691.929865 secs 2024-07-26T11:17:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9707.412434 secs 2024-07-26T11:17:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:27 smithi063 ceph-mon[36747]: pgmap v5662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:27 smithi043 ceph-mon[32384]: pgmap v5662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:27 smithi133 ceph-mon[37053]: pgmap v5662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:29 smithi063 ceph-mon[36747]: pgmap v5663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:29 smithi043 ceph-mon[32384]: pgmap v5663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:29 smithi133 ceph-mon[37053]: pgmap v5663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:31 smithi063 ceph-mon[36747]: pgmap v5664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9696.930004 secs 2024-07-26T11:17:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9712.412550 secs 2024-07-26T11:17:31.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:31 smithi133 ceph-mon[37053]: pgmap v5664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:31.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9696.930004 secs 2024-07-26T11:17:31.819 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9712.412550 secs 2024-07-26T11:17:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:31 smithi043 ceph-mon[32384]: pgmap v5664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9696.930004 secs 2024-07-26T11:17:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9712.412550 secs 2024-07-26T11:17:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:33 smithi043 ceph-mon[32384]: pgmap v5665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:33 smithi133 ceph-mon[37053]: pgmap v5665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:33 smithi063 ceph-mon[36747]: pgmap v5665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:35 smithi043 ceph-mon[32384]: pgmap v5666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9701.930142 secs 2024-07-26T11:17:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:35 smithi133 ceph-mon[37053]: pgmap v5666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9701.930142 secs 2024-07-26T11:17:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:35 smithi063 ceph-mon[36747]: pgmap v5666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9701.930142 secs 2024-07-26T11:17:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9717.412681 secs 2024-07-26T11:17:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9717.412681 secs 2024-07-26T11:17:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9717.412681 secs 2024-07-26T11:17:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:37 smithi043 ceph-mon[32384]: pgmap v5667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:37 smithi133 ceph-mon[37053]: pgmap v5667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:37 smithi063 ceph-mon[36747]: pgmap v5667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:39 smithi043 ceph-mon[32384]: pgmap v5668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:39 smithi133 ceph-mon[37053]: pgmap v5668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:39 smithi063 ceph-mon[36747]: pgmap v5668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9706.930261 secs 2024-07-26T11:17:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9706.930261 secs 2024-07-26T11:17:41.071 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9706.930261 secs 2024-07-26T11:17:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:41 smithi043 ceph-mon[32384]: pgmap v5669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:17:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9722.412804 secs 2024-07-26T11:17:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:41 smithi133 ceph-mon[37053]: pgmap v5669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:17:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9722.412804 secs 2024-07-26T11:17:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:41 smithi063 ceph-mon[36747]: pgmap v5669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:17:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9722.412804 secs 2024-07-26T11:17:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:42 smithi043 ceph-mon[32384]: pgmap v5670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:42 smithi133 ceph-mon[37053]: pgmap v5670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:42 smithi063 ceph-mon[36747]: pgmap v5670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:44 smithi063 ceph-mon[36747]: pgmap v5671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:44 smithi043 ceph-mon[32384]: pgmap v5671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:44 smithi133 ceph-mon[37053]: pgmap v5671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9711.930356 secs 2024-07-26T11:17:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9711.930356 secs 2024-07-26T11:17:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9711.930356 secs 2024-07-26T11:17:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9727.412942 secs 2024-07-26T11:17:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:46 smithi063 ceph-mon[36747]: pgmap v5672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9727.412942 secs 2024-07-26T11:17:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:46 smithi043 ceph-mon[32384]: pgmap v5672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9727.412942 secs 2024-07-26T11:17:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:46 smithi133 ceph-mon[37053]: pgmap v5672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:17:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:48 smithi063 ceph-mon[36747]: pgmap v5673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:48 smithi043 ceph-mon[32384]: pgmap v5673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:48 smithi133 ceph-mon[37053]: pgmap v5673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:17:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:50 smithi063 ceph-mon[36747]: pgmap v5674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9716.930474 secs 2024-07-26T11:17:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:50 smithi043 ceph-mon[32384]: pgmap v5674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9716.930474 secs 2024-07-26T11:17:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:50 smithi133 ceph-mon[37053]: pgmap v5674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:17:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9716.930474 secs 2024-07-26T11:17:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9732.413065 secs 2024-07-26T11:17:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9732.413065 secs 2024-07-26T11:17:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9732.413065 secs 2024-07-26T11:17:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:52 smithi043 ceph-mon[32384]: pgmap v5675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:52 smithi133 ceph-mon[37053]: pgmap v5675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:52 smithi063 ceph-mon[36747]: pgmap v5675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:54 smithi043 ceph-mon[32384]: pgmap v5676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:54 smithi133 ceph-mon[37053]: pgmap v5676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:54 smithi063 ceph-mon[36747]: pgmap v5676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:56.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9721.930571 secs 2024-07-26T11:17:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9721.930571 secs 2024-07-26T11:17:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9721.930571 secs 2024-07-26T11:17:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9737.413177 secs 2024-07-26T11:17:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:56 smithi043 ceph-mon[32384]: pgmap v5677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9737.413177 secs 2024-07-26T11:17:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:56 smithi133 ceph-mon[37053]: pgmap v5677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9737.413177 secs 2024-07-26T11:17:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:56 smithi063 ceph-mon[36747]: pgmap v5677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:17:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:17:58 smithi043 ceph-mon[32384]: pgmap v5678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:17:58 smithi133 ceph-mon[37053]: pgmap v5678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:17:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:17:58 smithi063 ceph-mon[36747]: pgmap v5678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:00 smithi063 ceph-mon[36747]: pgmap v5679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:01.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9726.930722 secs 2024-07-26T11:18:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:00 smithi043 ceph-mon[32384]: pgmap v5679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9726.930722 secs 2024-07-26T11:18:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:00 smithi133 ceph-mon[37053]: pgmap v5679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9726.930722 secs 2024-07-26T11:18:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9742.413290 secs 2024-07-26T11:18:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9742.413290 secs 2024-07-26T11:18:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9742.413290 secs 2024-07-26T11:18:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:02 smithi043 ceph-mon[32384]: pgmap v5680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:02 smithi133 ceph-mon[37053]: pgmap v5680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:02 smithi063 ceph-mon[36747]: pgmap v5680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:04 smithi043 ceph-mon[32384]: pgmap v5681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:18:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:04 smithi133 ceph-mon[37053]: pgmap v5681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:18:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:04 smithi063 ceph-mon[36747]: pgmap v5681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:18:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:18:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:18:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:05 smithi043 ceph-mon[32384]: pgmap v5682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:18:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9731.930863 secs 2024-07-26T11:18:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:18:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:18:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:05 smithi133 ceph-mon[37053]: pgmap v5682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:18:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9731.930863 secs 2024-07-26T11:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:05 smithi063 ceph-mon[36747]: pgmap v5682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:18:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9731.930863 secs 2024-07-26T11:18:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9747.413401 secs 2024-07-26T11:18:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9747.413401 secs 2024-07-26T11:18:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9747.413401 secs 2024-07-26T11:18:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:07 smithi043 ceph-mon[32384]: pgmap v5683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:07 smithi133 ceph-mon[37053]: pgmap v5683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:07 smithi063 ceph-mon[36747]: pgmap v5683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:10 smithi133 ceph-mon[37053]: pgmap v5684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:18:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:10 smithi063 ceph-mon[36747]: pgmap v5684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:18:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:10 smithi043 ceph-mon[32384]: pgmap v5684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:18:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9736.930985 secs 2024-07-26T11:18:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9752.413521 secs 2024-07-26T11:18:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9736.930985 secs 2024-07-26T11:18:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9752.413521 secs 2024-07-26T11:18:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9736.930985 secs 2024-07-26T11:18:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9752.413521 secs 2024-07-26T11:18:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:12 smithi063 ceph-mon[36747]: pgmap v5685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:18:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:12 smithi043 ceph-mon[32384]: pgmap v5685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:18:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:12 smithi133 ceph-mon[37053]: pgmap v5685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:18:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:14 smithi063 ceph-mon[36747]: pgmap v5686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:18:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:14 smithi043 ceph-mon[32384]: pgmap v5686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:18:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:14 smithi133 ceph-mon[37053]: pgmap v5686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:18:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:16 smithi063 ceph-mon[36747]: pgmap v5687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9741.931064 secs 2024-07-26T11:18:16.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9757.413642 secs 2024-07-26T11:18:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:16 smithi043 ceph-mon[32384]: pgmap v5687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9741.931064 secs 2024-07-26T11:18:16.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9757.413642 secs 2024-07-26T11:18:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:16 smithi133 ceph-mon[37053]: pgmap v5687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:18:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9741.931064 secs 2024-07-26T11:18:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9757.413642 secs 2024-07-26T11:18:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:18 smithi063 ceph-mon[36747]: pgmap v5688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:18 smithi043 ceph-mon[32384]: pgmap v5688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:18 smithi133 ceph-mon[37053]: pgmap v5688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:20 smithi063 ceph-mon[36747]: pgmap v5689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:20 smithi043 ceph-mon[32384]: pgmap v5689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:20 smithi133 ceph-mon[37053]: pgmap v5689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9746.931201 secs 2024-07-26T11:18:21.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9762.413778 secs 2024-07-26T11:18:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9746.931201 secs 2024-07-26T11:18:21.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9762.413778 secs 2024-07-26T11:18:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9746.931201 secs 2024-07-26T11:18:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9762.413778 secs 2024-07-26T11:18:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:22 smithi063 ceph-mon[36747]: pgmap v5690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:22 smithi043 ceph-mon[32384]: pgmap v5690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:22 smithi133 ceph-mon[37053]: pgmap v5690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:24 smithi063 ceph-mon[36747]: pgmap v5691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:24 smithi043 ceph-mon[32384]: pgmap v5691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:24 smithi133 ceph-mon[37053]: pgmap v5691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:26 smithi043 ceph-mon[32384]: pgmap v5692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9751.931325 secs 2024-07-26T11:18:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9767.413918 secs 2024-07-26T11:18:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:26 smithi133 ceph-mon[37053]: pgmap v5692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9751.931325 secs 2024-07-26T11:18:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9767.413918 secs 2024-07-26T11:18:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:26 smithi063 ceph-mon[36747]: pgmap v5692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9751.931325 secs 2024-07-26T11:18:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9767.413918 secs 2024-07-26T11:18:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:28 smithi043 ceph-mon[32384]: pgmap v5693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:28 smithi133 ceph-mon[37053]: pgmap v5693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:28 smithi063 ceph-mon[36747]: pgmap v5693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:30 smithi043 ceph-mon[32384]: pgmap v5694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:30 smithi133 ceph-mon[37053]: pgmap v5694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:30 smithi063 ceph-mon[36747]: pgmap v5694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:31.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9756.931450 secs 2024-07-26T11:18:31.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9772.414001 secs 2024-07-26T11:18:31.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9756.931450 secs 2024-07-26T11:18:31.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9772.414001 secs 2024-07-26T11:18:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9756.931450 secs 2024-07-26T11:18:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9772.414001 secs 2024-07-26T11:18:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:32 smithi043 ceph-mon[32384]: pgmap v5695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:32 smithi133 ceph-mon[37053]: pgmap v5695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:32 smithi063 ceph-mon[36747]: pgmap v5695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:34 smithi043 ceph-mon[32384]: pgmap v5696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:34 smithi133 ceph-mon[37053]: pgmap v5696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:34 smithi063 ceph-mon[36747]: pgmap v5696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:36 smithi043 ceph-mon[32384]: pgmap v5697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9761.931569 secs 2024-07-26T11:18:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9777.414100 secs 2024-07-26T11:18:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:36 smithi133 ceph-mon[37053]: pgmap v5697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9761.931569 secs 2024-07-26T11:18:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9777.414100 secs 2024-07-26T11:18:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:36 smithi063 ceph-mon[36747]: pgmap v5697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9761.931569 secs 2024-07-26T11:18:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9777.414100 secs 2024-07-26T11:18:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:38 smithi043 ceph-mon[32384]: pgmap v5698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:38 smithi133 ceph-mon[37053]: pgmap v5698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:38 smithi063 ceph-mon[36747]: pgmap v5698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:40 smithi043 ceph-mon[32384]: pgmap v5699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:40 smithi133 ceph-mon[37053]: pgmap v5699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:40 smithi063 ceph-mon[36747]: pgmap v5699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9766.931697 secs 2024-07-26T11:18:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9782.414193 secs 2024-07-26T11:18:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9766.931697 secs 2024-07-26T11:18:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9782.414193 secs 2024-07-26T11:18:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9766.931697 secs 2024-07-26T11:18:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9782.414193 secs 2024-07-26T11:18:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:42 smithi043 ceph-mon[32384]: pgmap v5700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:42 smithi133 ceph-mon[37053]: pgmap v5700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:42 smithi063 ceph-mon[36747]: pgmap v5700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:44 smithi043 ceph-mon[32384]: pgmap v5701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:44 smithi133 ceph-mon[37053]: pgmap v5701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:44 smithi063 ceph-mon[36747]: pgmap v5701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:46 smithi043 ceph-mon[32384]: pgmap v5702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9771.931822 secs 2024-07-26T11:18:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9787.414314 secs 2024-07-26T11:18:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:46 smithi133 ceph-mon[37053]: pgmap v5702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9771.931822 secs 2024-07-26T11:18:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9787.414314 secs 2024-07-26T11:18:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:46 smithi063 ceph-mon[36747]: pgmap v5702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9771.931822 secs 2024-07-26T11:18:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9787.414314 secs 2024-07-26T11:18:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:48 smithi043 ceph-mon[32384]: pgmap v5703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:48 smithi133 ceph-mon[37053]: pgmap v5703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:48 smithi063 ceph-mon[36747]: pgmap v5703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:50 smithi043 ceph-mon[32384]: pgmap v5704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:50 smithi133 ceph-mon[37053]: pgmap v5704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:50 smithi063 ceph-mon[36747]: pgmap v5704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9776.931928 secs 2024-07-26T11:18:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9792.414453 secs 2024-07-26T11:18:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9776.931928 secs 2024-07-26T11:18:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9792.414453 secs 2024-07-26T11:18:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9776.931928 secs 2024-07-26T11:18:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9792.414453 secs 2024-07-26T11:18:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:52 smithi043 ceph-mon[32384]: pgmap v5705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:52 smithi133 ceph-mon[37053]: pgmap v5705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:52 smithi063 ceph-mon[36747]: pgmap v5705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:54 smithi043 ceph-mon[32384]: pgmap v5706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:54 smithi133 ceph-mon[37053]: pgmap v5706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:54 smithi063 ceph-mon[36747]: pgmap v5706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:18:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:56 smithi043 ceph-mon[32384]: pgmap v5707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9781.932062 secs 2024-07-26T11:18:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9797.414566 secs 2024-07-26T11:18:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:56 smithi133 ceph-mon[37053]: pgmap v5707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9781.932062 secs 2024-07-26T11:18:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9797.414566 secs 2024-07-26T11:18:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:56 smithi063 ceph-mon[36747]: pgmap v5707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:18:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9781.932062 secs 2024-07-26T11:18:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9797.414566 secs 2024-07-26T11:18:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:18:58 smithi043 ceph-mon[32384]: pgmap v5708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:18:58 smithi133 ceph-mon[37053]: pgmap v5708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:18:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:18:58 smithi063 ceph-mon[36747]: pgmap v5708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:00 smithi043 ceph-mon[32384]: pgmap v5709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:00 smithi133 ceph-mon[37053]: pgmap v5709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:00 smithi063 ceph-mon[36747]: pgmap v5709: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9786.932150 secs 2024-07-26T11:19:01.470 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9802.414659 secs 2024-07-26T11:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9786.932150 secs 2024-07-26T11:19:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9802.414659 secs 2024-07-26T11:19:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9786.932150 secs 2024-07-26T11:19:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9802.414659 secs 2024-07-26T11:19:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:02 smithi043 ceph-mon[32384]: pgmap v5710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:02 smithi133 ceph-mon[37053]: pgmap v5710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:02 smithi063 ceph-mon[36747]: pgmap v5710: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:04 smithi043 ceph-mon[32384]: pgmap v5711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:04 smithi133 ceph-mon[37053]: pgmap v5711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:04 smithi063 ceph-mon[36747]: pgmap v5711: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:19:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:19:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:19:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:06 smithi043 ceph-mon[32384]: pgmap v5712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9791.932216 secs 2024-07-26T11:19:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9807.414777 secs 2024-07-26T11:19:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:19:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:19:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:06 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:19:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:06 smithi133 ceph-mon[37053]: pgmap v5712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9791.932216 secs 2024-07-26T11:19:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9807.414777 secs 2024-07-26T11:19:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:19:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:19:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:06 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:19:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:06 smithi063 ceph-mon[36747]: pgmap v5712: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9791.932216 secs 2024-07-26T11:19:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9807.414777 secs 2024-07-26T11:19:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:19:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:19:06.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:06 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:19:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:07 smithi043 ceph-mon[32384]: pgmap v5713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:07 smithi043 ceph-mon[32384]: pgmap v5714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:07 smithi133 ceph-mon[37053]: pgmap v5713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:07 smithi133 ceph-mon[37053]: pgmap v5714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:07 smithi063 ceph-mon[36747]: pgmap v5713: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:07 smithi063 ceph-mon[36747]: pgmap v5714: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:09 smithi133 ceph-mon[37053]: pgmap v5715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:19:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:09 smithi063 ceph-mon[36747]: pgmap v5715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:19:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:09 smithi043 ceph-mon[32384]: pgmap v5715: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:19:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:11 smithi133 ceph-mon[37053]: pgmap v5716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:19:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9796.932284 secs 2024-07-26T11:19:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9812.414923 secs 2024-07-26T11:19:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:11 smithi063 ceph-mon[36747]: pgmap v5716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:19:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9796.932284 secs 2024-07-26T11:19:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9812.414923 secs 2024-07-26T11:19:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:11 smithi043 ceph-mon[32384]: pgmap v5716: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:19:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9796.932284 secs 2024-07-26T11:19:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9812.414923 secs 2024-07-26T11:19:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:13 smithi133 ceph-mon[37053]: pgmap v5717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:19:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:13 smithi063 ceph-mon[36747]: pgmap v5717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:19:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:13 smithi043 ceph-mon[32384]: pgmap v5717: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:19:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:15 smithi133 ceph-mon[37053]: pgmap v5718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:15 smithi063 ceph-mon[36747]: pgmap v5718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:15 smithi043 ceph-mon[32384]: pgmap v5718: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:19:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9801.932437 secs 2024-07-26T11:19:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9817.415018 secs 2024-07-26T11:19:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9801.932437 secs 2024-07-26T11:19:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9817.415018 secs 2024-07-26T11:19:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9801.932437 secs 2024-07-26T11:19:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9817.415018 secs 2024-07-26T11:19:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:17 smithi063 ceph-mon[36747]: pgmap v5719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:19:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:17 smithi043 ceph-mon[32384]: pgmap v5719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:19:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:17 smithi133 ceph-mon[37053]: pgmap v5719: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:19:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:19 smithi063 ceph-mon[36747]: pgmap v5720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:19 smithi043 ceph-mon[32384]: pgmap v5720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:19 smithi133 ceph-mon[37053]: pgmap v5720: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:21.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:21 smithi043 ceph-mon[32384]: pgmap v5721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:21.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9806.932501 secs 2024-07-26T11:19:21.536 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9822.415148 secs 2024-07-26T11:19:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:21 smithi063 ceph-mon[36747]: pgmap v5721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9806.932501 secs 2024-07-26T11:19:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9822.415148 secs 2024-07-26T11:19:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:21 smithi133 ceph-mon[37053]: pgmap v5721: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9806.932501 secs 2024-07-26T11:19:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9822.415148 secs 2024-07-26T11:19:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:23 smithi063 ceph-mon[36747]: pgmap v5722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:23 smithi043 ceph-mon[32384]: pgmap v5722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:23 smithi133 ceph-mon[37053]: pgmap v5722: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:25 smithi063 ceph-mon[36747]: pgmap v5723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:25 smithi043 ceph-mon[32384]: pgmap v5723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:25 smithi133 ceph-mon[37053]: pgmap v5723: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9811.932651 secs 2024-07-26T11:19:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9827.415282 secs 2024-07-26T11:19:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9811.932651 secs 2024-07-26T11:19:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9827.415282 secs 2024-07-26T11:19:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9811.932651 secs 2024-07-26T11:19:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9827.415282 secs 2024-07-26T11:19:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:27 smithi063 ceph-mon[36747]: pgmap v5724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:27 smithi043 ceph-mon[32384]: pgmap v5724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:27.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:27 smithi133 ceph-mon[37053]: pgmap v5724: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:29 smithi063 ceph-mon[36747]: pgmap v5725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:29 smithi043 ceph-mon[32384]: pgmap v5725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:29 smithi133 ceph-mon[37053]: pgmap v5725: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:31 smithi063 ceph-mon[36747]: pgmap v5726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:31.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9816.932748 secs 2024-07-26T11:19:31.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9832.415388 secs 2024-07-26T11:19:31.571 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:31 smithi133 ceph-mon[37053]: pgmap v5726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:31.571 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9816.932748 secs 2024-07-26T11:19:31.571 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9832.415388 secs 2024-07-26T11:19:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:31 smithi043 ceph-mon[32384]: pgmap v5726: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9816.932748 secs 2024-07-26T11:19:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9832.415388 secs 2024-07-26T11:19:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:33 smithi043 ceph-mon[32384]: pgmap v5727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:33 smithi133 ceph-mon[37053]: pgmap v5727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:33 smithi063 ceph-mon[36747]: pgmap v5727: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:35 smithi043 ceph-mon[32384]: pgmap v5728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:35 smithi133 ceph-mon[37053]: pgmap v5728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:35 smithi063 ceph-mon[36747]: pgmap v5728: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9821.932877 secs 2024-07-26T11:19:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9837.415507 secs 2024-07-26T11:19:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9821.932877 secs 2024-07-26T11:19:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9837.415507 secs 2024-07-26T11:19:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9821.932877 secs 2024-07-26T11:19:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9837.415507 secs 2024-07-26T11:19:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:37 smithi043 ceph-mon[32384]: pgmap v5729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:37 smithi133 ceph-mon[37053]: pgmap v5729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:37 smithi063 ceph-mon[36747]: pgmap v5729: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:39 smithi043 ceph-mon[32384]: pgmap v5730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:39 smithi133 ceph-mon[37053]: pgmap v5730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:39 smithi063 ceph-mon[36747]: pgmap v5730: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:41 smithi043 ceph-mon[32384]: pgmap v5731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9826.932944 secs 2024-07-26T11:19:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9842.415647 secs 2024-07-26T11:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:41 smithi133 ceph-mon[37053]: pgmap v5731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9826.932944 secs 2024-07-26T11:19:41.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9842.415647 secs 2024-07-26T11:19:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:41 smithi063 ceph-mon[36747]: pgmap v5731: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9826.932944 secs 2024-07-26T11:19:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9842.415647 secs 2024-07-26T11:19:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:43 smithi043 ceph-mon[32384]: pgmap v5732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:43 smithi133 ceph-mon[37053]: pgmap v5732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:43 smithi063 ceph-mon[36747]: pgmap v5732: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:45 smithi043 ceph-mon[32384]: pgmap v5733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:45 smithi133 ceph-mon[37053]: pgmap v5733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:45 smithi063 ceph-mon[36747]: pgmap v5733: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9831.933069 secs 2024-07-26T11:19:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9847.415765 secs 2024-07-26T11:19:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9831.933069 secs 2024-07-26T11:19:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9847.415765 secs 2024-07-26T11:19:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9831.933069 secs 2024-07-26T11:19:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9847.415765 secs 2024-07-26T11:19:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:47 smithi043 ceph-mon[32384]: pgmap v5734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:47 smithi133 ceph-mon[37053]: pgmap v5734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:47 smithi063 ceph-mon[36747]: pgmap v5734: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:49 smithi043 ceph-mon[32384]: pgmap v5735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:49 smithi133 ceph-mon[37053]: pgmap v5735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:49 smithi063 ceph-mon[36747]: pgmap v5735: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:51 smithi043 ceph-mon[32384]: pgmap v5736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9836.933153 secs 2024-07-26T11:19:51.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9852.415893 secs 2024-07-26T11:19:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:51 smithi133 ceph-mon[37053]: pgmap v5736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9836.933153 secs 2024-07-26T11:19:51.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9852.415893 secs 2024-07-26T11:19:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:51 smithi063 ceph-mon[36747]: pgmap v5736: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:19:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9836.933153 secs 2024-07-26T11:19:51.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9852.415893 secs 2024-07-26T11:19:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:53 smithi043 ceph-mon[32384]: pgmap v5737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:53 smithi133 ceph-mon[37053]: pgmap v5737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:53 smithi063 ceph-mon[36747]: pgmap v5737: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:55 smithi043 ceph-mon[32384]: pgmap v5738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:55 smithi133 ceph-mon[37053]: pgmap v5738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:55 smithi063 ceph-mon[36747]: pgmap v5738: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9841.933289 secs 2024-07-26T11:19:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9857.416012 secs 2024-07-26T11:19:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9841.933289 secs 2024-07-26T11:19:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9857.416012 secs 2024-07-26T11:19:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9841.933289 secs 2024-07-26T11:19:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9857.416012 secs 2024-07-26T11:19:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:57 smithi043 ceph-mon[32384]: pgmap v5739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:57 smithi133 ceph-mon[37053]: pgmap v5739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:57 smithi063 ceph-mon[36747]: pgmap v5739: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:19:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:19:59 smithi043 ceph-mon[32384]: pgmap v5740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:19:59 smithi133 ceph-mon[37053]: pgmap v5740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:19:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:19:59 smithi063 ceph-mon[36747]: pgmap v5740: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:20:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:20:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:20:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:01 smithi063 ceph-mon[36747]: pgmap v5741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9846.933411 secs 2024-07-26T11:20:01.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9862.416135 secs 2024-07-26T11:20:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:01 smithi043 ceph-mon[32384]: pgmap v5741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9846.933411 secs 2024-07-26T11:20:01.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9862.416135 secs 2024-07-26T11:20:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:01 smithi133 ceph-mon[37053]: pgmap v5741: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9846.933411 secs 2024-07-26T11:20:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9862.416135 secs 2024-07-26T11:20:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:03 smithi043 ceph-mon[32384]: pgmap v5742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:03 smithi133 ceph-mon[37053]: pgmap v5742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:03 smithi063 ceph-mon[36747]: pgmap v5742: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:05 smithi043 ceph-mon[32384]: pgmap v5743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:05 smithi133 ceph-mon[37053]: pgmap v5743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:05 smithi063 ceph-mon[36747]: pgmap v5743: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9851.933536 secs 2024-07-26T11:20:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9867.416256 secs 2024-07-26T11:20:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:20:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9851.933536 secs 2024-07-26T11:20:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9867.416256 secs 2024-07-26T11:20:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:20:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9851.933536 secs 2024-07-26T11:20:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9867.416256 secs 2024-07-26T11:20:06.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:20:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:07 smithi043 ceph-mon[32384]: pgmap v5744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:20:07.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:20:07.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:20:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:07 smithi133 ceph-mon[37053]: pgmap v5744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:20:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:20:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:20:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:07 smithi063 ceph-mon[36747]: pgmap v5744: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:20:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:20:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:20:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:08 smithi043 ceph-mon[32384]: pgmap v5745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:20:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:08 smithi043 ceph-mon[32384]: pgmap v5746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:08 smithi133 ceph-mon[37053]: pgmap v5745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:20:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:08 smithi133 ceph-mon[37053]: pgmap v5746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:08 smithi063 ceph-mon[36747]: pgmap v5745: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:20:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:08 smithi063 ceph-mon[36747]: pgmap v5746: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:10 smithi043 ceph-mon[32384]: pgmap v5747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:20:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:10 smithi133 ceph-mon[37053]: pgmap v5747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:20:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:10 smithi063 ceph-mon[36747]: pgmap v5747: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:20:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9856.933621 secs 2024-07-26T11:20:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9872.416390 secs 2024-07-26T11:20:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9856.933621 secs 2024-07-26T11:20:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9872.416390 secs 2024-07-26T11:20:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9856.933621 secs 2024-07-26T11:20:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9872.416390 secs 2024-07-26T11:20:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:12 smithi133 ceph-mon[37053]: pgmap v5748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:20:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:12 smithi063 ceph-mon[36747]: pgmap v5748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:20:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:12 smithi043 ceph-mon[32384]: pgmap v5748: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:20:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:14 smithi133 ceph-mon[37053]: pgmap v5749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:20:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:14 smithi063 ceph-mon[36747]: pgmap v5749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:20:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:14 smithi043 ceph-mon[32384]: pgmap v5749: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:20:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9861.933744 secs 2024-07-26T11:20:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:16 smithi133 ceph-mon[37053]: pgmap v5750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9877.416487 secs 2024-07-26T11:20:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9861.933744 secs 2024-07-26T11:20:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:16 smithi063 ceph-mon[36747]: pgmap v5750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9877.416487 secs 2024-07-26T11:20:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9861.933744 secs 2024-07-26T11:20:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:16 smithi043 ceph-mon[32384]: pgmap v5750: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9877.416487 secs 2024-07-26T11:20:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:18 smithi133 ceph-mon[37053]: pgmap v5751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:18 smithi063 ceph-mon[36747]: pgmap v5751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:18 smithi043 ceph-mon[32384]: pgmap v5751: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:20 smithi133 ceph-mon[37053]: pgmap v5752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:20 smithi063 ceph-mon[36747]: pgmap v5752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:20 smithi043 ceph-mon[32384]: pgmap v5752: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9866.933869 secs 2024-07-26T11:20:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9882.416615 secs 2024-07-26T11:20:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9866.933869 secs 2024-07-26T11:20:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9882.416615 secs 2024-07-26T11:20:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9866.933869 secs 2024-07-26T11:20:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9882.416615 secs 2024-07-26T11:20:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:22 smithi063 ceph-mon[36747]: pgmap v5753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:22 smithi043 ceph-mon[32384]: pgmap v5753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:22 smithi133 ceph-mon[37053]: pgmap v5753: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:24 smithi063 ceph-mon[36747]: pgmap v5754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:20:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:24 smithi043 ceph-mon[32384]: pgmap v5754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:20:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:24 smithi133 ceph-mon[37053]: pgmap v5754: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:20:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9871.934000 secs 2024-07-26T11:20:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:26 smithi063 ceph-mon[36747]: pgmap v5755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9887.416747 secs 2024-07-26T11:20:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9871.934000 secs 2024-07-26T11:20:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:26 smithi043 ceph-mon[32384]: pgmap v5755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9887.416747 secs 2024-07-26T11:20:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9871.934000 secs 2024-07-26T11:20:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:26 smithi133 ceph-mon[37053]: pgmap v5755: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:20:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9887.416747 secs 2024-07-26T11:20:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:28 smithi063 ceph-mon[36747]: pgmap v5756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:28 smithi043 ceph-mon[32384]: pgmap v5756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:28 smithi133 ceph-mon[37053]: pgmap v5756: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:30 smithi063 ceph-mon[36747]: pgmap v5757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:20:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:30 smithi043 ceph-mon[32384]: pgmap v5757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:20:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:30 smithi133 ceph-mon[37053]: pgmap v5757: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:20:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9876.934135 secs 2024-07-26T11:20:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9892.416888 secs 2024-07-26T11:20:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9876.934135 secs 2024-07-26T11:20:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9892.416888 secs 2024-07-26T11:20:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9876.934135 secs 2024-07-26T11:20:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9892.416888 secs 2024-07-26T11:20:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:32 smithi063 ceph-mon[36747]: pgmap v5758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:32.937 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:32 smithi133 ceph-mon[37053]: pgmap v5758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:32 smithi043 ceph-mon[32384]: pgmap v5758: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:20:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:34 smithi043 ceph-mon[32384]: pgmap v5759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:34 smithi133 ceph-mon[37053]: pgmap v5759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:34 smithi063 ceph-mon[36747]: pgmap v5759: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9881.934230 secs 2024-07-26T11:20:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:36 smithi043 ceph-mon[32384]: pgmap v5760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9897.417006 secs 2024-07-26T11:20:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9881.934230 secs 2024-07-26T11:20:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:36 smithi133 ceph-mon[37053]: pgmap v5760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9897.417006 secs 2024-07-26T11:20:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9881.934230 secs 2024-07-26T11:20:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:36 smithi063 ceph-mon[36747]: pgmap v5760: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9897.417006 secs 2024-07-26T11:20:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:38 smithi043 ceph-mon[32384]: pgmap v5761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:38 smithi133 ceph-mon[37053]: pgmap v5761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:38 smithi063 ceph-mon[36747]: pgmap v5761: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:40 smithi043 ceph-mon[32384]: pgmap v5762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:40 smithi133 ceph-mon[37053]: pgmap v5762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:40 smithi063 ceph-mon[36747]: pgmap v5762: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:41.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9886.934351 secs 2024-07-26T11:20:41.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9902.417071 secs 2024-07-26T11:20:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9886.934351 secs 2024-07-26T11:20:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9902.417071 secs 2024-07-26T11:20:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9886.934351 secs 2024-07-26T11:20:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9902.417071 secs 2024-07-26T11:20:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:42 smithi063 ceph-mon[36747]: pgmap v5763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:42 smithi043 ceph-mon[32384]: pgmap v5763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:42 smithi133 ceph-mon[37053]: pgmap v5763: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:44 smithi043 ceph-mon[32384]: pgmap v5764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:44 smithi133 ceph-mon[37053]: pgmap v5764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:44 smithi063 ceph-mon[36747]: pgmap v5764: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9891.934480 secs 2024-07-26T11:20:46.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9891.934480 secs 2024-07-26T11:20:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9891.934480 secs 2024-07-26T11:20:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:46 smithi043 ceph-mon[32384]: pgmap v5765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9907.417188 secs 2024-07-26T11:20:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:46 smithi133 ceph-mon[37053]: pgmap v5765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9907.417188 secs 2024-07-26T11:20:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:46 smithi063 ceph-mon[36747]: pgmap v5765: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9907.417188 secs 2024-07-26T11:20:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:48 smithi043 ceph-mon[32384]: pgmap v5766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:48 smithi133 ceph-mon[37053]: pgmap v5766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:48 smithi063 ceph-mon[36747]: pgmap v5766: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:50 smithi043 ceph-mon[32384]: pgmap v5767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9896.934603 secs 2024-07-26T11:20:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:50 smithi133 ceph-mon[37053]: pgmap v5767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9896.934603 secs 2024-07-26T11:20:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:50 smithi063 ceph-mon[36747]: pgmap v5767: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9896.934603 secs 2024-07-26T11:20:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9912.417302 secs 2024-07-26T11:20:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9912.417302 secs 2024-07-26T11:20:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9912.417302 secs 2024-07-26T11:20:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:52 smithi043 ceph-mon[32384]: pgmap v5768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:52 smithi133 ceph-mon[37053]: pgmap v5768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:52 smithi063 ceph-mon[36747]: pgmap v5768: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:53 smithi043 ceph-mon[32384]: pgmap v5769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:53 smithi133 ceph-mon[37053]: pgmap v5769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:53 smithi063 ceph-mon[36747]: pgmap v5769: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:20:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9901.934691 secs 2024-07-26T11:20:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:56 smithi043 ceph-mon[32384]: pgmap v5770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9917.417439 secs 2024-07-26T11:20:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9901.934691 secs 2024-07-26T11:20:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:56 smithi133 ceph-mon[37053]: pgmap v5770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9917.417439 secs 2024-07-26T11:20:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9901.934691 secs 2024-07-26T11:20:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:56 smithi063 ceph-mon[36747]: pgmap v5770: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:20:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9917.417439 secs 2024-07-26T11:20:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:20:58 smithi133 ceph-mon[37053]: pgmap v5771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:20:58 smithi063 ceph-mon[36747]: pgmap v5771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:20:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:20:58 smithi043 ceph-mon[32384]: pgmap v5771: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:00 smithi133 ceph-mon[37053]: pgmap v5772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:00 smithi063 ceph-mon[36747]: pgmap v5772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:00 smithi043 ceph-mon[32384]: pgmap v5772: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9906.934777 secs 2024-07-26T11:21:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9922.417579 secs 2024-07-26T11:21:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9906.934777 secs 2024-07-26T11:21:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9922.417579 secs 2024-07-26T11:21:01.947 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9906.934777 secs 2024-07-26T11:21:01.948 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9922.417579 secs 2024-07-26T11:21:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:02 smithi133 ceph-mon[37053]: pgmap v5773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:02 smithi063 ceph-mon[36747]: pgmap v5773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:02 smithi043 ceph-mon[32384]: pgmap v5773: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:04 smithi133 ceph-mon[37053]: pgmap v5774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:04 smithi063 ceph-mon[36747]: pgmap v5774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:04 smithi043 ceph-mon[32384]: pgmap v5774: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9911.934903 secs 2024-07-26T11:21:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:06 smithi063 ceph-mon[36747]: pgmap v5775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9927.417687 secs 2024-07-26T11:21:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9911.934903 secs 2024-07-26T11:21:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:06 smithi043 ceph-mon[32384]: pgmap v5775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9927.417687 secs 2024-07-26T11:21:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9911.934903 secs 2024-07-26T11:21:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:06 smithi133 ceph-mon[37053]: pgmap v5775: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9927.417687 secs 2024-07-26T11:21:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:08 smithi063 ceph-mon[36747]: pgmap v5776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:08 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:21:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:08 smithi043 ceph-mon[32384]: pgmap v5776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:08 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:21:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:08 smithi133 ceph-mon[37053]: pgmap v5776: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:08 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:21:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:21:09.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:09.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:21:09.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:21:09.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:21:10.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:21:10.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:21:10.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:21:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:10 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:21:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:10 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:21:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:10 smithi043 ceph-mon[32384]: pgmap v5777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:10 smithi043 ceph-mon[32384]: pgmap v5778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9916.935063 secs 2024-07-26T11:21:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:10 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:21:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:10 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:21:11.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:10 smithi133 ceph-mon[37053]: pgmap v5777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:11.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:10 smithi133 ceph-mon[37053]: pgmap v5778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:11.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9916.935063 secs 2024-07-26T11:21:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:10 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:21:11.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:10 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:21:11.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:10 smithi063 ceph-mon[36747]: pgmap v5777: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:11.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:10 smithi063 ceph-mon[36747]: pgmap v5778: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:11.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9916.935063 secs 2024-07-26T11:21:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9932.417841 secs 2024-07-26T11:21:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9932.417841 secs 2024-07-26T11:21:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9932.417841 secs 2024-07-26T11:21:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:12 smithi043 ceph-mon[32384]: pgmap v5779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:12 smithi133 ceph-mon[37053]: pgmap v5779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:12 smithi063 ceph-mon[36747]: pgmap v5779: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:14 smithi043 ceph-mon[32384]: pgmap v5780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:21:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:14 smithi133 ceph-mon[37053]: pgmap v5780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:21:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:14 smithi063 ceph-mon[36747]: pgmap v5780: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:21:15.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9921.935224 secs 2024-07-26T11:21:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9921.935224 secs 2024-07-26T11:21:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9921.935224 secs 2024-07-26T11:21:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:16 smithi043 ceph-mon[32384]: pgmap v5781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9937.417966 secs 2024-07-26T11:21:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:16 smithi133 ceph-mon[37053]: pgmap v5781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9937.417966 secs 2024-07-26T11:21:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:16 smithi063 ceph-mon[36747]: pgmap v5781: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9937.417966 secs 2024-07-26T11:21:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:17 smithi043 ceph-mon[32384]: pgmap v5782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:17 smithi133 ceph-mon[37053]: pgmap v5782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:17 smithi063 ceph-mon[36747]: pgmap v5782: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:21:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:19 smithi063 ceph-mon[36747]: pgmap v5783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:21:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:19 smithi043 ceph-mon[32384]: pgmap v5783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:21:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:19 smithi133 ceph-mon[37053]: pgmap v5783: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:21:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9926.935336 secs 2024-07-26T11:21:21.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9926.935336 secs 2024-07-26T11:21:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9926.935336 secs 2024-07-26T11:21:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9942.418083 secs 2024-07-26T11:21:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:21 smithi063 ceph-mon[36747]: pgmap v5784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9942.418083 secs 2024-07-26T11:21:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:21 smithi043 ceph-mon[32384]: pgmap v5784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9942.418083 secs 2024-07-26T11:21:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:21 smithi133 ceph-mon[37053]: pgmap v5784: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:23 smithi063 ceph-mon[36747]: pgmap v5785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:23 smithi043 ceph-mon[32384]: pgmap v5785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:23 smithi133 ceph-mon[37053]: pgmap v5785: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:25 smithi063 ceph-mon[36747]: pgmap v5786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:26.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9931.935420 secs 2024-07-26T11:21:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:25 smithi043 ceph-mon[32384]: pgmap v5786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:26.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9931.935420 secs 2024-07-26T11:21:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:25 smithi133 ceph-mon[37053]: pgmap v5786: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:26.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9931.935420 secs 2024-07-26T11:21:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9947.418147 secs 2024-07-26T11:21:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9947.418147 secs 2024-07-26T11:21:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9947.418147 secs 2024-07-26T11:21:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:27 smithi063 ceph-mon[36747]: pgmap v5787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:27 smithi043 ceph-mon[32384]: pgmap v5787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:27 smithi133 ceph-mon[37053]: pgmap v5787: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:29 smithi043 ceph-mon[32384]: pgmap v5788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:29 smithi133 ceph-mon[37053]: pgmap v5788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:29 smithi063 ceph-mon[36747]: pgmap v5788: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:31.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9936.935543 secs 2024-07-26T11:21:31.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9936.935543 secs 2024-07-26T11:21:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9936.935543 secs 2024-07-26T11:21:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9952.418272 secs 2024-07-26T11:21:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:31 smithi043 ceph-mon[32384]: pgmap v5789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9952.418272 secs 2024-07-26T11:21:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:31 smithi133 ceph-mon[37053]: pgmap v5789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9952.418272 secs 2024-07-26T11:21:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:31 smithi063 ceph-mon[36747]: pgmap v5789: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:33 smithi043 ceph-mon[32384]: pgmap v5790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:33 smithi133 ceph-mon[37053]: pgmap v5790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:33 smithi063 ceph-mon[36747]: pgmap v5790: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:35 smithi043 ceph-mon[32384]: pgmap v5791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9941.935659 secs 2024-07-26T11:21:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:35 smithi133 ceph-mon[37053]: pgmap v5791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9941.935659 secs 2024-07-26T11:21:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:35 smithi063 ceph-mon[36747]: pgmap v5791: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9941.935659 secs 2024-07-26T11:21:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9957.418388 secs 2024-07-26T11:21:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9957.418388 secs 2024-07-26T11:21:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9957.418388 secs 2024-07-26T11:21:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:37 smithi043 ceph-mon[32384]: pgmap v5792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:37 smithi133 ceph-mon[37053]: pgmap v5792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:37 smithi063 ceph-mon[36747]: pgmap v5792: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:39 smithi043 ceph-mon[32384]: pgmap v5793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:39 smithi133 ceph-mon[37053]: pgmap v5793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:39 smithi063 ceph-mon[36747]: pgmap v5793: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9946.935786 secs 2024-07-26T11:21:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9946.935786 secs 2024-07-26T11:21:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9946.935786 secs 2024-07-26T11:21:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9962.418532 secs 2024-07-26T11:21:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:41 smithi043 ceph-mon[32384]: pgmap v5794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9962.418532 secs 2024-07-26T11:21:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:41 smithi133 ceph-mon[37053]: pgmap v5794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9962.418532 secs 2024-07-26T11:21:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:41 smithi063 ceph-mon[36747]: pgmap v5794: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:43 smithi043 ceph-mon[32384]: pgmap v5795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:43 smithi133 ceph-mon[37053]: pgmap v5795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:43 smithi063 ceph-mon[36747]: pgmap v5795: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:45 smithi043 ceph-mon[32384]: pgmap v5796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9951.935911 secs 2024-07-26T11:21:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:45 smithi133 ceph-mon[37053]: pgmap v5796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9951.935911 secs 2024-07-26T11:21:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:45 smithi063 ceph-mon[36747]: pgmap v5796: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9951.935911 secs 2024-07-26T11:21:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9967.418645 secs 2024-07-26T11:21:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9967.418645 secs 2024-07-26T11:21:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9967.418645 secs 2024-07-26T11:21:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:47 smithi043 ceph-mon[32384]: pgmap v5797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:48.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:47 smithi133 ceph-mon[37053]: pgmap v5797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:47 smithi063 ceph-mon[36747]: pgmap v5797: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:49 smithi043 ceph-mon[32384]: pgmap v5798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:49 smithi133 ceph-mon[37053]: pgmap v5798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:49 smithi063 ceph-mon[36747]: pgmap v5798: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9956.936011 secs 2024-07-26T11:21:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9956.936011 secs 2024-07-26T11:21:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9956.936011 secs 2024-07-26T11:21:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9972.418768 secs 2024-07-26T11:21:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:51 smithi043 ceph-mon[32384]: pgmap v5799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9972.418768 secs 2024-07-26T11:21:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:51 smithi133 ceph-mon[37053]: pgmap v5799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9972.418768 secs 2024-07-26T11:21:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:51 smithi063 ceph-mon[36747]: pgmap v5799: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:53 smithi043 ceph-mon[32384]: pgmap v5800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:53 smithi133 ceph-mon[37053]: pgmap v5800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:54.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:53 smithi063 ceph-mon[36747]: pgmap v5800: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:21:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:55 smithi043 ceph-mon[32384]: pgmap v5801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9961.936141 secs 2024-07-26T11:21:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:55 smithi133 ceph-mon[37053]: pgmap v5801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9961.936141 secs 2024-07-26T11:21:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:55 smithi063 ceph-mon[36747]: pgmap v5801: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:21:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9961.936141 secs 2024-07-26T11:21:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9977.418908 secs 2024-07-26T11:21:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9977.418908 secs 2024-07-26T11:21:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9977.418908 secs 2024-07-26T11:21:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:57 smithi043 ceph-mon[32384]: pgmap v5802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:57 smithi133 ceph-mon[37053]: pgmap v5802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:21:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:57 smithi063 ceph-mon[36747]: pgmap v5802: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:21:59 smithi043 ceph-mon[32384]: pgmap v5803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:21:59 smithi133 ceph-mon[37053]: pgmap v5803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:21:59 smithi063 ceph-mon[36747]: pgmap v5803: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9966.936267 secs 2024-07-26T11:22:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9966.936267 secs 2024-07-26T11:22:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9966.936267 secs 2024-07-26T11:22:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9982.419051 secs 2024-07-26T11:22:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:01 smithi043 ceph-mon[32384]: pgmap v5804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9982.419051 secs 2024-07-26T11:22:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:01 smithi133 ceph-mon[37053]: pgmap v5804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9982.419051 secs 2024-07-26T11:22:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:01 smithi063 ceph-mon[36747]: pgmap v5804: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:03 smithi043 ceph-mon[32384]: pgmap v5805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:03 smithi133 ceph-mon[37053]: pgmap v5805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:03 smithi063 ceph-mon[36747]: pgmap v5805: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:05 smithi133 ceph-mon[37053]: pgmap v5806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9971.936391 secs 2024-07-26T11:22:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:05 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9987.419160 secs 2024-07-26T11:22:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:05 smithi063 ceph-mon[36747]: pgmap v5806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9971.936391 secs 2024-07-26T11:22:06.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:05 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9987.419160 secs 2024-07-26T11:22:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:05 smithi043 ceph-mon[32384]: pgmap v5806: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9971.936391 secs 2024-07-26T11:22:06.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:05 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9987.419160 secs 2024-07-26T11:22:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:07 smithi133 ceph-mon[37053]: pgmap v5807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:07 smithi063 ceph-mon[36747]: pgmap v5807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:07 smithi043 ceph-mon[32384]: pgmap v5807: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:22:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:22:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:22:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: pgmap v5808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:22:10.268 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:22:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: pgmap v5808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:22:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: pgmap v5808: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:22:10.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:22:10.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:22:10.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:22:10.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:22:10.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:22:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:11 smithi133 ceph-mon[37053]: pgmap v5809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:22:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:11 smithi133 ceph-mon[37053]: pgmap v5810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:22:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9976.936518 secs 2024-07-26T11:22:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9992.419224 secs 2024-07-26T11:22:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:11 smithi063 ceph-mon[36747]: pgmap v5809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:22:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:11 smithi063 ceph-mon[36747]: pgmap v5810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:22:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9976.936518 secs 2024-07-26T11:22:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9992.419224 secs 2024-07-26T11:22:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:11 smithi043 ceph-mon[32384]: pgmap v5809: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:22:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:11 smithi043 ceph-mon[32384]: pgmap v5810: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:22:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9976.936518 secs 2024-07-26T11:22:11.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9992.419224 secs 2024-07-26T11:22:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:13 smithi063 ceph-mon[36747]: pgmap v5811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:22:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:13 smithi043 ceph-mon[32384]: pgmap v5811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:22:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:13 smithi133 ceph-mon[37053]: pgmap v5811: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:22:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:15 smithi063 ceph-mon[36747]: pgmap v5812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:22:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:15 smithi043 ceph-mon[32384]: pgmap v5812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:22:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:15 smithi133 ceph-mon[37053]: pgmap v5812: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:22:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9981.936586 secs 2024-07-26T11:22:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 9997.419347 secs 2024-07-26T11:22:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9981.936586 secs 2024-07-26T11:22:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 9997.419347 secs 2024-07-26T11:22:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9981.936586 secs 2024-07-26T11:22:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 9997.419347 secs 2024-07-26T11:22:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:17 smithi063 ceph-mon[36747]: pgmap v5813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:22:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:17 smithi043 ceph-mon[32384]: pgmap v5813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:22:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:17 smithi133 ceph-mon[37053]: pgmap v5813: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:22:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:19 smithi063 ceph-mon[36747]: pgmap v5814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:22:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:19 smithi043 ceph-mon[32384]: pgmap v5814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:22:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:19 smithi133 ceph-mon[37053]: pgmap v5814: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:22:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:21 smithi063 ceph-mon[36747]: pgmap v5815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:22:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9986.936655 secs 2024-07-26T11:22:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10002.419469 secs 2024-07-26T11:22:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:21 smithi043 ceph-mon[32384]: pgmap v5815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:22:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9986.936655 secs 2024-07-26T11:22:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10002.419469 secs 2024-07-26T11:22:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:21 smithi133 ceph-mon[37053]: pgmap v5815: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:22:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9986.936655 secs 2024-07-26T11:22:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10002.419469 secs 2024-07-26T11:22:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:23 smithi063 ceph-mon[36747]: pgmap v5816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:23 smithi043 ceph-mon[32384]: pgmap v5816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:23 smithi133 ceph-mon[37053]: pgmap v5816: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:25 smithi063 ceph-mon[36747]: pgmap v5817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:25 smithi043 ceph-mon[32384]: pgmap v5817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:25 smithi133 ceph-mon[37053]: pgmap v5817: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9991.936778 secs 2024-07-26T11:22:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10007.419581 secs 2024-07-26T11:22:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9991.936778 secs 2024-07-26T11:22:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10007.419581 secs 2024-07-26T11:22:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9991.936778 secs 2024-07-26T11:22:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10007.419581 secs 2024-07-26T11:22:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:27 smithi043 ceph-mon[32384]: pgmap v5818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:27 smithi133 ceph-mon[37053]: pgmap v5818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:27 smithi063 ceph-mon[36747]: pgmap v5818: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:29 smithi043 ceph-mon[32384]: pgmap v5819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:29 smithi133 ceph-mon[37053]: pgmap v5819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:29 smithi063 ceph-mon[36747]: pgmap v5819: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 9996.936929 secs 2024-07-26T11:22:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 9996.936929 secs 2024-07-26T11:22:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 9996.936929 secs 2024-07-26T11:22:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:31 smithi043 ceph-mon[32384]: pgmap v5820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10012.419709 secs 2024-07-26T11:22:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:31 smithi133 ceph-mon[37053]: pgmap v5820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10012.419709 secs 2024-07-26T11:22:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:31 smithi063 ceph-mon[36747]: pgmap v5820: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10012.419709 secs 2024-07-26T11:22:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:33 smithi043 ceph-mon[32384]: pgmap v5821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:33 smithi133 ceph-mon[37053]: pgmap v5821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:33 smithi063 ceph-mon[36747]: pgmap v5821: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:35 smithi043 ceph-mon[32384]: pgmap v5822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10001.937070 secs 2024-07-26T11:22:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:35 smithi133 ceph-mon[37053]: pgmap v5822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10001.937070 secs 2024-07-26T11:22:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:35 smithi063 ceph-mon[36747]: pgmap v5822: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10001.937070 secs 2024-07-26T11:22:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10017.419849 secs 2024-07-26T11:22:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10017.419849 secs 2024-07-26T11:22:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10017.419849 secs 2024-07-26T11:22:37.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:37 smithi043 ceph-mon[32384]: pgmap v5823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:37 smithi133 ceph-mon[37053]: pgmap v5823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:37 smithi063 ceph-mon[36747]: pgmap v5823: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:38 smithi043 ceph-mon[32384]: pgmap v5824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:38 smithi133 ceph-mon[37053]: pgmap v5824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:38 smithi063 ceph-mon[36747]: pgmap v5824: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:41 smithi063 ceph-mon[36747]: pgmap v5825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10006.937198 secs 2024-07-26T11:22:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10022.419971 secs 2024-07-26T11:22:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:41 smithi043 ceph-mon[32384]: pgmap v5825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10006.937198 secs 2024-07-26T11:22:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10022.419971 secs 2024-07-26T11:22:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:41 smithi133 ceph-mon[37053]: pgmap v5825: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10006.937198 secs 2024-07-26T11:22:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10022.419971 secs 2024-07-26T11:22:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:43 smithi063 ceph-mon[36747]: pgmap v5826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:43 smithi043 ceph-mon[32384]: pgmap v5826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:43 smithi133 ceph-mon[37053]: pgmap v5826: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:45 smithi063 ceph-mon[36747]: pgmap v5827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:45 smithi043 ceph-mon[32384]: pgmap v5827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:45 smithi133 ceph-mon[37053]: pgmap v5827: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10011.937283 secs 2024-07-26T11:22:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10027.420088 secs 2024-07-26T11:22:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10011.937283 secs 2024-07-26T11:22:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10027.420088 secs 2024-07-26T11:22:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10011.937283 secs 2024-07-26T11:22:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10027.420088 secs 2024-07-26T11:22:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:47 smithi063 ceph-mon[36747]: pgmap v5828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:47 smithi043 ceph-mon[32384]: pgmap v5828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:47 smithi133 ceph-mon[37053]: pgmap v5828: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:49 smithi063 ceph-mon[36747]: pgmap v5829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:49 smithi043 ceph-mon[32384]: pgmap v5829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:49 smithi133 ceph-mon[37053]: pgmap v5829: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:51.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:51 smithi043 ceph-mon[32384]: pgmap v5830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:51.287 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10016.937405 secs 2024-07-26T11:22:51.287 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10032.420203 secs 2024-07-26T11:22:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:51 smithi063 ceph-mon[36747]: pgmap v5830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10016.937405 secs 2024-07-26T11:22:51.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10032.420203 secs 2024-07-26T11:22:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:51 smithi133 ceph-mon[37053]: pgmap v5830: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:22:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10016.937405 secs 2024-07-26T11:22:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10032.420203 secs 2024-07-26T11:22:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:53 smithi043 ceph-mon[32384]: pgmap v5831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:53 smithi133 ceph-mon[37053]: pgmap v5831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:53 smithi063 ceph-mon[36747]: pgmap v5831: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:55 smithi043 ceph-mon[32384]: pgmap v5832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:55 smithi133 ceph-mon[37053]: pgmap v5832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:55 smithi063 ceph-mon[36747]: pgmap v5832: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10021.937528 secs 2024-07-26T11:22:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10037.420317 secs 2024-07-26T11:22:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10021.937528 secs 2024-07-26T11:22:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10037.420317 secs 2024-07-26T11:22:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10021.937528 secs 2024-07-26T11:22:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10037.420317 secs 2024-07-26T11:22:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:57 smithi043 ceph-mon[32384]: pgmap v5833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:57 smithi133 ceph-mon[37053]: pgmap v5833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:57 smithi063 ceph-mon[36747]: pgmap v5833: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:22:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:22:59 smithi043 ceph-mon[32384]: pgmap v5834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:22:59 smithi133 ceph-mon[37053]: pgmap v5834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:22:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:22:59 smithi063 ceph-mon[36747]: pgmap v5834: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:01.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:01 smithi063 ceph-mon[36747]: pgmap v5835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:01.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10026.937643 secs 2024-07-26T11:23:01.370 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10042.420407 secs 2024-07-26T11:23:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:01 smithi043 ceph-mon[32384]: pgmap v5835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10026.937643 secs 2024-07-26T11:23:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10042.420407 secs 2024-07-26T11:23:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:01 smithi133 ceph-mon[37053]: pgmap v5835: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10026.937643 secs 2024-07-26T11:23:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10042.420407 secs 2024-07-26T11:23:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:03 smithi043 ceph-mon[32384]: pgmap v5836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:03 smithi133 ceph-mon[37053]: pgmap v5836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:03 smithi063 ceph-mon[36747]: pgmap v5836: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:05 smithi043 ceph-mon[32384]: pgmap v5837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:05 smithi133 ceph-mon[37053]: pgmap v5837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:05.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:05 smithi063 ceph-mon[36747]: pgmap v5837: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:06.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10031.937740 secs 2024-07-26T11:23:06.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10047.420551 secs 2024-07-26T11:23:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10031.937740 secs 2024-07-26T11:23:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10047.420551 secs 2024-07-26T11:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10031.937740 secs 2024-07-26T11:23:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10047.420551 secs 2024-07-26T11:23:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:07 smithi043 ceph-mon[32384]: pgmap v5838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:07 smithi133 ceph-mon[37053]: pgmap v5838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:07 smithi063 ceph-mon[36747]: pgmap v5838: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:09 smithi043 ceph-mon[32384]: pgmap v5839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:09 smithi133 ceph-mon[37053]: pgmap v5839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:09 smithi063 ceph-mon[36747]: pgmap v5839: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:11 smithi043 ceph-mon[32384]: pgmap v5840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:11 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10036.937878 secs 2024-07-26T11:23:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10052.420695 secs 2024-07-26T11:23:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:11 smithi133 ceph-mon[37053]: pgmap v5840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:11 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:23:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10036.937878 secs 2024-07-26T11:23:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10052.420695 secs 2024-07-26T11:23:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:11 smithi063 ceph-mon[36747]: pgmap v5840: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:11 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:23:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10036.937878 secs 2024-07-26T11:23:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10052.420695 secs 2024-07-26T11:23:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:23:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:23:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:12 smithi043 ceph-mon[32384]: pgmap v5841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:23:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:12 smithi043 ceph-mon[32384]: pgmap v5842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:23:12.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:23:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:23:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:23:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:12 smithi133 ceph-mon[37053]: pgmap v5841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:23:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:12 smithi133 ceph-mon[37053]: pgmap v5842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:23:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:23:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:23:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:23:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:12 smithi063 ceph-mon[36747]: pgmap v5841: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:23:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:12 smithi063 ceph-mon[36747]: pgmap v5842: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:23:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:23:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:14 smithi063 ceph-mon[36747]: pgmap v5843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:23:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:14 smithi043 ceph-mon[32384]: pgmap v5843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:23:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:14 smithi133 ceph-mon[37053]: pgmap v5843: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:23:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:16 smithi063 ceph-mon[36747]: pgmap v5844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:23:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10041.937997 secs 2024-07-26T11:23:16.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10057.420813 secs 2024-07-26T11:23:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:16 smithi043 ceph-mon[32384]: pgmap v5844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:23:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10041.937997 secs 2024-07-26T11:23:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10057.420813 secs 2024-07-26T11:23:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:16 smithi133 ceph-mon[37053]: pgmap v5844: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:23:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10041.937997 secs 2024-07-26T11:23:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10057.420813 secs 2024-07-26T11:23:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:18 smithi063 ceph-mon[36747]: pgmap v5845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:23:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:18 smithi043 ceph-mon[32384]: pgmap v5845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:23:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:18 smithi133 ceph-mon[37053]: pgmap v5845: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:23:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:20 smithi063 ceph-mon[36747]: pgmap v5846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:23:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:20 smithi043 ceph-mon[32384]: pgmap v5846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:23:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:20 smithi133 ceph-mon[37053]: pgmap v5846: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:23:21.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10046.938137 secs 2024-07-26T11:23:21.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10062.420933 secs 2024-07-26T11:23:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10046.938137 secs 2024-07-26T11:23:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10062.420933 secs 2024-07-26T11:23:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10046.938137 secs 2024-07-26T11:23:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10062.420933 secs 2024-07-26T11:23:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:22 smithi043 ceph-mon[32384]: pgmap v5847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:23:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:22 smithi133 ceph-mon[37053]: pgmap v5847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:23:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:22 smithi063 ceph-mon[36747]: pgmap v5847: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:23:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:24 smithi043 ceph-mon[32384]: pgmap v5848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:24 smithi133 ceph-mon[37053]: pgmap v5848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:24 smithi063 ceph-mon[36747]: pgmap v5848: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:26 smithi043 ceph-mon[32384]: pgmap v5849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10051.938259 secs 2024-07-26T11:23:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10067.421045 secs 2024-07-26T11:23:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:26 smithi133 ceph-mon[37053]: pgmap v5849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10051.938259 secs 2024-07-26T11:23:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10067.421045 secs 2024-07-26T11:23:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:26 smithi063 ceph-mon[36747]: pgmap v5849: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10051.938259 secs 2024-07-26T11:23:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10067.421045 secs 2024-07-26T11:23:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:28 smithi043 ceph-mon[32384]: pgmap v5850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:28 smithi133 ceph-mon[37053]: pgmap v5850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:28 smithi063 ceph-mon[36747]: pgmap v5850: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:30 smithi043 ceph-mon[32384]: pgmap v5851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:30 smithi133 ceph-mon[37053]: pgmap v5851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:30 smithi063 ceph-mon[36747]: pgmap v5851: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10056.938363 secs 2024-07-26T11:23:31.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10072.421121 secs 2024-07-26T11:23:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10056.938363 secs 2024-07-26T11:23:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10072.421121 secs 2024-07-26T11:23:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10056.938363 secs 2024-07-26T11:23:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10072.421121 secs 2024-07-26T11:23:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:32 smithi043 ceph-mon[32384]: pgmap v5852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:32 smithi133 ceph-mon[37053]: pgmap v5852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:32 smithi063 ceph-mon[36747]: pgmap v5852: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:34 smithi043 ceph-mon[32384]: pgmap v5853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:34 smithi133 ceph-mon[37053]: pgmap v5853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:34 smithi063 ceph-mon[36747]: pgmap v5853: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:36 smithi043 ceph-mon[32384]: pgmap v5854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10061.938486 secs 2024-07-26T11:23:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10077.421249 secs 2024-07-26T11:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:36 smithi133 ceph-mon[37053]: pgmap v5854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10061.938486 secs 2024-07-26T11:23:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10077.421249 secs 2024-07-26T11:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:36 smithi063 ceph-mon[36747]: pgmap v5854: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10061.938486 secs 2024-07-26T11:23:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10077.421249 secs 2024-07-26T11:23:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:38 smithi043 ceph-mon[32384]: pgmap v5855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:38 smithi133 ceph-mon[37053]: pgmap v5855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:38 smithi063 ceph-mon[36747]: pgmap v5855: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:40.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:40 smithi043 ceph-mon[32384]: pgmap v5856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:40 smithi133 ceph-mon[37053]: pgmap v5856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:40 smithi063 ceph-mon[36747]: pgmap v5856: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10066.938605 secs 2024-07-26T11:23:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10082.421331 secs 2024-07-26T11:23:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10066.938605 secs 2024-07-26T11:23:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10082.421331 secs 2024-07-26T11:23:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10066.938605 secs 2024-07-26T11:23:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10082.421331 secs 2024-07-26T11:23:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:42 smithi043 ceph-mon[32384]: pgmap v5857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:42 smithi133 ceph-mon[37053]: pgmap v5857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:42 smithi063 ceph-mon[36747]: pgmap v5857: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:44 smithi043 ceph-mon[32384]: pgmap v5858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:44 smithi133 ceph-mon[37053]: pgmap v5858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:44 smithi063 ceph-mon[36747]: pgmap v5858: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:46 smithi043 ceph-mon[32384]: pgmap v5859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10071.938702 secs 2024-07-26T11:23:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10087.421448 secs 2024-07-26T11:23:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:46 smithi133 ceph-mon[37053]: pgmap v5859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10071.938702 secs 2024-07-26T11:23:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10087.421448 secs 2024-07-26T11:23:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:46 smithi063 ceph-mon[36747]: pgmap v5859: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10071.938702 secs 2024-07-26T11:23:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10087.421448 secs 2024-07-26T11:23:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:48 smithi043 ceph-mon[32384]: pgmap v5860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:48 smithi133 ceph-mon[37053]: pgmap v5860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:48 smithi063 ceph-mon[36747]: pgmap v5860: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:50 smithi043 ceph-mon[32384]: pgmap v5861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:50 smithi133 ceph-mon[37053]: pgmap v5861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:50 smithi063 ceph-mon[36747]: pgmap v5861: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10076.938842 secs 2024-07-26T11:23:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10092.421588 secs 2024-07-26T11:23:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10076.938842 secs 2024-07-26T11:23:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10092.421588 secs 2024-07-26T11:23:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10076.938842 secs 2024-07-26T11:23:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10092.421588 secs 2024-07-26T11:23:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:52 smithi043 ceph-mon[32384]: pgmap v5862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:52 smithi133 ceph-mon[37053]: pgmap v5862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:52 smithi063 ceph-mon[36747]: pgmap v5862: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:23:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:54 smithi043 ceph-mon[32384]: pgmap v5863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:54 smithi133 ceph-mon[37053]: pgmap v5863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:54 smithi063 ceph-mon[36747]: pgmap v5863: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:56 smithi043 ceph-mon[32384]: pgmap v5864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10081.938936 secs 2024-07-26T11:23:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10097.421726 secs 2024-07-26T11:23:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:56 smithi133 ceph-mon[37053]: pgmap v5864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10081.938936 secs 2024-07-26T11:23:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10097.421726 secs 2024-07-26T11:23:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:56 smithi063 ceph-mon[36747]: pgmap v5864: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:23:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10081.938936 secs 2024-07-26T11:23:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10097.421726 secs 2024-07-26T11:23:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:23:58 smithi043 ceph-mon[32384]: pgmap v5865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:23:58 smithi133 ceph-mon[37053]: pgmap v5865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:23:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:23:58 smithi063 ceph-mon[36747]: pgmap v5865: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:00 smithi043 ceph-mon[32384]: pgmap v5866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:00 smithi133 ceph-mon[37053]: pgmap v5866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:00 smithi063 ceph-mon[36747]: pgmap v5866: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10086.939036 secs 2024-07-26T11:24:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10102.421852 secs 2024-07-26T11:24:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10086.939036 secs 2024-07-26T11:24:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10102.421852 secs 2024-07-26T11:24:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10086.939036 secs 2024-07-26T11:24:01.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10102.421852 secs 2024-07-26T11:24:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:02 smithi043 ceph-mon[32384]: pgmap v5867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:02 smithi133 ceph-mon[37053]: pgmap v5867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:02 smithi063 ceph-mon[36747]: pgmap v5867: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:04 smithi043 ceph-mon[32384]: pgmap v5868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:04 smithi133 ceph-mon[37053]: pgmap v5868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:04 smithi063 ceph-mon[36747]: pgmap v5868: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:06 smithi133 ceph-mon[37053]: pgmap v5869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:24:06.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10091.939157 secs 2024-07-26T11:24:06.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10107.421983 secs 2024-07-26T11:24:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:06 smithi063 ceph-mon[36747]: pgmap v5869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:24:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10091.939157 secs 2024-07-26T11:24:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10107.421983 secs 2024-07-26T11:24:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:06 smithi043 ceph-mon[32384]: pgmap v5869: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:24:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10091.939157 secs 2024-07-26T11:24:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10107.421983 secs 2024-07-26T11:24:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:08 smithi043 ceph-mon[32384]: pgmap v5870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:08 smithi133 ceph-mon[37053]: pgmap v5870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:08 smithi063 ceph-mon[36747]: pgmap v5870: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:10 smithi043 ceph-mon[32384]: pgmap v5871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10096.939253 secs 2024-07-26T11:24:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:10 smithi133 ceph-mon[37053]: pgmap v5871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10096.939253 secs 2024-07-26T11:24:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:10 smithi063 ceph-mon[36747]: pgmap v5871: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10096.939253 secs 2024-07-26T11:24:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10112.422109 secs 2024-07-26T11:24:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:11 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:24:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10112.422109 secs 2024-07-26T11:24:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:11 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:24:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10112.422109 secs 2024-07-26T11:24:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:11 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:24:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:12 smithi043 ceph-mon[32384]: pgmap v5872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:24:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:12 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:12 smithi133 ceph-mon[37053]: pgmap v5872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:24:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:12 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:12 smithi063 ceph-mon[36747]: pgmap v5872: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:24:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:12 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:24:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:24:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:13 smithi043 ceph-mon[32384]: pgmap v5873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:13 smithi043 ceph-mon[32384]: pgmap v5874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:13.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:13 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:24:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:24:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:13 smithi133 ceph-mon[37053]: pgmap v5873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:14.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:13 smithi133 ceph-mon[37053]: pgmap v5874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:14.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:13 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:24:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:24:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:13 smithi063 ceph-mon[36747]: pgmap v5873: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:13 smithi063 ceph-mon[36747]: pgmap v5874: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:13 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:24:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:16 smithi063 ceph-mon[36747]: pgmap v5875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10101.939348 secs 2024-07-26T11:24:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10117.422230 secs 2024-07-26T11:24:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:16 smithi043 ceph-mon[32384]: pgmap v5875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10101.939348 secs 2024-07-26T11:24:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10117.422230 secs 2024-07-26T11:24:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:16 smithi133 ceph-mon[37053]: pgmap v5875: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10101.939348 secs 2024-07-26T11:24:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10117.422230 secs 2024-07-26T11:24:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:18 smithi063 ceph-mon[36747]: pgmap v5876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:18 smithi043 ceph-mon[32384]: pgmap v5876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:18 smithi133 ceph-mon[37053]: pgmap v5876: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:20 smithi063 ceph-mon[36747]: pgmap v5877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:20 smithi043 ceph-mon[32384]: pgmap v5877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:20 smithi133 ceph-mon[37053]: pgmap v5877: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10106.939418 secs 2024-07-26T11:24:21.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10122.422349 secs 2024-07-26T11:24:21.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10106.939418 secs 2024-07-26T11:24:21.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10122.422349 secs 2024-07-26T11:24:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10106.939418 secs 2024-07-26T11:24:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10122.422349 secs 2024-07-26T11:24:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:22 smithi063 ceph-mon[36747]: pgmap v5878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:22 smithi043 ceph-mon[32384]: pgmap v5878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:22 smithi133 ceph-mon[37053]: pgmap v5878: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:24:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:24 smithi043 ceph-mon[32384]: pgmap v5879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:24:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:24 smithi063 ceph-mon[36747]: pgmap v5879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:24:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:24 smithi133 ceph-mon[37053]: pgmap v5879: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:24:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:26 smithi043 ceph-mon[32384]: pgmap v5880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10111.939545 secs 2024-07-26T11:24:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10127.422501 secs 2024-07-26T11:24:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:26 smithi133 ceph-mon[37053]: pgmap v5880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10111.939545 secs 2024-07-26T11:24:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10127.422501 secs 2024-07-26T11:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:26 smithi063 ceph-mon[36747]: pgmap v5880: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10111.939545 secs 2024-07-26T11:24:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10127.422501 secs 2024-07-26T11:24:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:28 smithi043 ceph-mon[32384]: pgmap v5881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:28 smithi133 ceph-mon[37053]: pgmap v5881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:28 smithi063 ceph-mon[36747]: pgmap v5881: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:30 smithi043 ceph-mon[32384]: pgmap v5882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:30 smithi133 ceph-mon[37053]: pgmap v5882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:30 smithi063 ceph-mon[36747]: pgmap v5882: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10116.939699 secs 2024-07-26T11:24:31.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10132.422630 secs 2024-07-26T11:24:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10116.939699 secs 2024-07-26T11:24:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10132.422630 secs 2024-07-26T11:24:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10116.939699 secs 2024-07-26T11:24:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10132.422630 secs 2024-07-26T11:24:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:32 smithi043 ceph-mon[32384]: pgmap v5883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:32 smithi133 ceph-mon[37053]: pgmap v5883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:32 smithi063 ceph-mon[36747]: pgmap v5883: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:34 smithi043 ceph-mon[32384]: pgmap v5884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:34 smithi133 ceph-mon[37053]: pgmap v5884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:34 smithi063 ceph-mon[36747]: pgmap v5884: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:36 smithi043 ceph-mon[32384]: pgmap v5885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10121.939814 secs 2024-07-26T11:24:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10137.422693 secs 2024-07-26T11:24:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:36 smithi133 ceph-mon[37053]: pgmap v5885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10121.939814 secs 2024-07-26T11:24:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10137.422693 secs 2024-07-26T11:24:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:36 smithi063 ceph-mon[36747]: pgmap v5885: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10121.939814 secs 2024-07-26T11:24:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10137.422693 secs 2024-07-26T11:24:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:38 smithi043 ceph-mon[32384]: pgmap v5886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:38 smithi133 ceph-mon[37053]: pgmap v5886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:38 smithi063 ceph-mon[36747]: pgmap v5886: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:40 smithi043 ceph-mon[32384]: pgmap v5887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:40 smithi133 ceph-mon[37053]: pgmap v5887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:40 smithi063 ceph-mon[36747]: pgmap v5887: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10126.939928 secs 2024-07-26T11:24:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10142.422840 secs 2024-07-26T11:24:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10126.939928 secs 2024-07-26T11:24:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10142.422840 secs 2024-07-26T11:24:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10126.939928 secs 2024-07-26T11:24:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10142.422840 secs 2024-07-26T11:24:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:42 smithi043 ceph-mon[32384]: pgmap v5888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:42 smithi133 ceph-mon[37053]: pgmap v5888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:42 smithi063 ceph-mon[36747]: pgmap v5888: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:44 smithi043 ceph-mon[32384]: pgmap v5889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:44 smithi133 ceph-mon[37053]: pgmap v5889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:44 smithi063 ceph-mon[36747]: pgmap v5889: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:46 smithi043 ceph-mon[32384]: pgmap v5890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10131.940046 secs 2024-07-26T11:24:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10147.422947 secs 2024-07-26T11:24:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:46 smithi133 ceph-mon[37053]: pgmap v5890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10131.940046 secs 2024-07-26T11:24:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10147.422947 secs 2024-07-26T11:24:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:46 smithi063 ceph-mon[36747]: pgmap v5890: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10131.940046 secs 2024-07-26T11:24:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10147.422947 secs 2024-07-26T11:24:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:48 smithi043 ceph-mon[32384]: pgmap v5891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:48 smithi133 ceph-mon[37053]: pgmap v5891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:48 smithi063 ceph-mon[36747]: pgmap v5891: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:50 smithi043 ceph-mon[32384]: pgmap v5892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:50 smithi133 ceph-mon[37053]: pgmap v5892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:50 smithi063 ceph-mon[36747]: pgmap v5892: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10136.940138 secs 2024-07-26T11:24:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10152.423085 secs 2024-07-26T11:24:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10136.940138 secs 2024-07-26T11:24:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10152.423085 secs 2024-07-26T11:24:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10136.940138 secs 2024-07-26T11:24:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10152.423085 secs 2024-07-26T11:24:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:52 smithi043 ceph-mon[32384]: pgmap v5893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:52 smithi133 ceph-mon[37053]: pgmap v5893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:52 smithi063 ceph-mon[36747]: pgmap v5893: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:24:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:54 smithi043 ceph-mon[32384]: pgmap v5894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:54 smithi133 ceph-mon[37053]: pgmap v5894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:54 smithi063 ceph-mon[36747]: pgmap v5894: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:56 smithi043 ceph-mon[32384]: pgmap v5895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10141.940260 secs 2024-07-26T11:24:56.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10157.423186 secs 2024-07-26T11:24:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:56 smithi133 ceph-mon[37053]: pgmap v5895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10141.940260 secs 2024-07-26T11:24:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10157.423186 secs 2024-07-26T11:24:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:56 smithi063 ceph-mon[36747]: pgmap v5895: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:24:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10141.940260 secs 2024-07-26T11:24:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10157.423186 secs 2024-07-26T11:24:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:24:58 smithi043 ceph-mon[32384]: pgmap v5896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:24:58 smithi133 ceph-mon[37053]: pgmap v5896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:24:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:24:58 smithi063 ceph-mon[36747]: pgmap v5896: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:00 smithi043 ceph-mon[32384]: pgmap v5897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:00 smithi133 ceph-mon[37053]: pgmap v5897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:00 smithi063 ceph-mon[36747]: pgmap v5897: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10146.940326 secs 2024-07-26T11:25:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10162.423313 secs 2024-07-26T11:25:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10146.940326 secs 2024-07-26T11:25:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10162.423313 secs 2024-07-26T11:25:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10146.940326 secs 2024-07-26T11:25:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10162.423313 secs 2024-07-26T11:25:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:02 smithi043 ceph-mon[32384]: pgmap v5898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:02 smithi133 ceph-mon[37053]: pgmap v5898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:02 smithi063 ceph-mon[36747]: pgmap v5898: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:04 smithi043 ceph-mon[32384]: pgmap v5899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:04 smithi133 ceph-mon[37053]: pgmap v5899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:04 smithi063 ceph-mon[36747]: pgmap v5899: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:06 smithi133 ceph-mon[37053]: pgmap v5900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10151.940449 secs 2024-07-26T11:25:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10167.423452 secs 2024-07-26T11:25:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:06 smithi063 ceph-mon[36747]: pgmap v5900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10151.940449 secs 2024-07-26T11:25:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10167.423452 secs 2024-07-26T11:25:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:06 smithi043 ceph-mon[32384]: pgmap v5900: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10151.940449 secs 2024-07-26T11:25:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10167.423452 secs 2024-07-26T11:25:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:08 smithi133 ceph-mon[37053]: pgmap v5901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:08 smithi063 ceph-mon[36747]: pgmap v5901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:08 smithi043 ceph-mon[32384]: pgmap v5901: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:10 smithi043 ceph-mon[32384]: pgmap v5902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:10 smithi133 ceph-mon[37053]: pgmap v5902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:10 smithi063 ceph-mon[36747]: pgmap v5902: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10156.940569 secs 2024-07-26T11:25:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10172.423588 secs 2024-07-26T11:25:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10156.940569 secs 2024-07-26T11:25:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10172.423588 secs 2024-07-26T11:25:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10156.940569 secs 2024-07-26T11:25:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10172.423588 secs 2024-07-26T11:25:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:12 smithi133 ceph-mon[37053]: pgmap v5903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:12 smithi063 ceph-mon[36747]: pgmap v5903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:12 smithi043 ceph-mon[32384]: pgmap v5903: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:13 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:25:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:13 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:25:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:13 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:25:14.695 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:14 smithi063 ceph-mon[36747]: pgmap v5904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:14.696 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.696 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.696 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.696 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:14 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:14 smithi133 ceph-mon[37053]: pgmap v5904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:14 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:14 smithi043 ceph-mon[32384]: pgmap v5904: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:14 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: pgmap v5905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10161.940656 secs 2024-07-26T11:25:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10177.423660 secs 2024-07-26T11:25:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:16 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: pgmap v5905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10161.940656 secs 2024-07-26T11:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10177.423660 secs 2024-07-26T11:25:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:16 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: pgmap v5905: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10161.940656 secs 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10177.423660 secs 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:16 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:17 smithi043 ceph-mon[32384]: pgmap v5906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:17 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:17 smithi133 ceph-mon[37053]: pgmap v5906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:17 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:17 smithi063 ceph-mon[36747]: pgmap v5906: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:17 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:25:20.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:25:20.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: pgmap v5907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:20.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: pgmap v5908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:20.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:19 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: pgmap v5907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: pgmap v5908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:19 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:20.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:25:20.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:25:20.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: pgmap v5907: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:20.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: pgmap v5908: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:20.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:19 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:25:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10166.940778 secs 2024-07-26T11:25:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10166.940778 secs 2024-07-26T11:25:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10166.940778 secs 2024-07-26T11:25:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10182.423786 secs 2024-07-26T11:25:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:21 smithi043 ceph-mon[32384]: pgmap v5909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10182.423786 secs 2024-07-26T11:25:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:21 smithi133 ceph-mon[37053]: pgmap v5909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10182.423786 secs 2024-07-26T11:25:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:21 smithi063 ceph-mon[36747]: pgmap v5909: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:24 smithi063 ceph-mon[36747]: pgmap v5910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:24 smithi043 ceph-mon[32384]: pgmap v5910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:24 smithi133 ceph-mon[37053]: pgmap v5910: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:26 smithi063 ceph-mon[36747]: pgmap v5911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10171.940903 secs 2024-07-26T11:25:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10187.423904 secs 2024-07-26T11:25:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:26 smithi043 ceph-mon[32384]: pgmap v5911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10171.940903 secs 2024-07-26T11:25:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10187.423904 secs 2024-07-26T11:25:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:26 smithi133 ceph-mon[37053]: pgmap v5911: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10171.940903 secs 2024-07-26T11:25:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10187.423904 secs 2024-07-26T11:25:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:28 smithi063 ceph-mon[36747]: pgmap v5912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:28 smithi043 ceph-mon[32384]: pgmap v5912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:28 smithi133 ceph-mon[37053]: pgmap v5912: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:30 smithi063 ceph-mon[36747]: pgmap v5913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:25:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:30 smithi043 ceph-mon[32384]: pgmap v5913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:25:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:30 smithi133 ceph-mon[37053]: pgmap v5913: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:25:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10176.941041 secs 2024-07-26T11:25:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10192.424030 secs 2024-07-26T11:25:31.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10176.941041 secs 2024-07-26T11:25:31.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10192.424030 secs 2024-07-26T11:25:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10176.941041 secs 2024-07-26T11:25:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10192.424030 secs 2024-07-26T11:25:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:32 smithi063 ceph-mon[36747]: pgmap v5914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:32 smithi043 ceph-mon[32384]: pgmap v5914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:32 smithi133 ceph-mon[37053]: pgmap v5914: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:34 smithi063 ceph-mon[36747]: pgmap v5915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:34 smithi043 ceph-mon[32384]: pgmap v5915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:34 smithi133 ceph-mon[37053]: pgmap v5915: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:36 smithi063 ceph-mon[36747]: pgmap v5916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10181.941197 secs 2024-07-26T11:25:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10197.424152 secs 2024-07-26T11:25:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:36 smithi043 ceph-mon[32384]: pgmap v5916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10181.941197 secs 2024-07-26T11:25:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10197.424152 secs 2024-07-26T11:25:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:36 smithi133 ceph-mon[37053]: pgmap v5916: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10181.941197 secs 2024-07-26T11:25:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10197.424152 secs 2024-07-26T11:25:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:38 smithi063 ceph-mon[36747]: pgmap v5917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:38 smithi043 ceph-mon[32384]: pgmap v5917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:38 smithi133 ceph-mon[37053]: pgmap v5917: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:40 smithi043 ceph-mon[32384]: pgmap v5918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:40 smithi133 ceph-mon[37053]: pgmap v5918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:40 smithi063 ceph-mon[36747]: pgmap v5918: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10186.941299 secs 2024-07-26T11:25:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10202.424297 secs 2024-07-26T11:25:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10186.941299 secs 2024-07-26T11:25:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10202.424297 secs 2024-07-26T11:25:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10186.941299 secs 2024-07-26T11:25:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10202.424297 secs 2024-07-26T11:25:42.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:42 smithi043 ceph-mon[32384]: pgmap v5919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:42 smithi133 ceph-mon[37053]: pgmap v5919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:42 smithi063 ceph-mon[36747]: pgmap v5919: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:44 smithi043 ceph-mon[32384]: pgmap v5920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:44 smithi133 ceph-mon[37053]: pgmap v5920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:44 smithi063 ceph-mon[36747]: pgmap v5920: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:46 smithi043 ceph-mon[32384]: pgmap v5921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10191.941421 secs 2024-07-26T11:25:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10207.424420 secs 2024-07-26T11:25:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:46 smithi133 ceph-mon[37053]: pgmap v5921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10191.941421 secs 2024-07-26T11:25:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10207.424420 secs 2024-07-26T11:25:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:46 smithi063 ceph-mon[36747]: pgmap v5921: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10191.941421 secs 2024-07-26T11:25:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10207.424420 secs 2024-07-26T11:25:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:48 smithi043 ceph-mon[32384]: pgmap v5922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:48 smithi133 ceph-mon[37053]: pgmap v5922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:48 smithi063 ceph-mon[36747]: pgmap v5922: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:50 smithi043 ceph-mon[32384]: pgmap v5923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:50 smithi133 ceph-mon[37053]: pgmap v5923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:50 smithi063 ceph-mon[36747]: pgmap v5923: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10196.941566 secs 2024-07-26T11:25:51.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10212.424542 secs 2024-07-26T11:25:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10196.941566 secs 2024-07-26T11:25:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10212.424542 secs 2024-07-26T11:25:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10196.941566 secs 2024-07-26T11:25:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10212.424542 secs 2024-07-26T11:25:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:52 smithi043 ceph-mon[32384]: pgmap v5924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:52 smithi133 ceph-mon[37053]: pgmap v5924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:52 smithi063 ceph-mon[36747]: pgmap v5924: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:54 smithi043 ceph-mon[32384]: pgmap v5925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:54 smithi133 ceph-mon[37053]: pgmap v5925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:54 smithi063 ceph-mon[36747]: pgmap v5925: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:25:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:56 smithi043 ceph-mon[32384]: pgmap v5926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10201.941686 secs 2024-07-26T11:25:56.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10217.424680 secs 2024-07-26T11:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:56 smithi133 ceph-mon[37053]: pgmap v5926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10201.941686 secs 2024-07-26T11:25:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10217.424680 secs 2024-07-26T11:25:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:56 smithi063 ceph-mon[36747]: pgmap v5926: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:25:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10201.941686 secs 2024-07-26T11:25:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10217.424680 secs 2024-07-26T11:25:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:25:58 smithi043 ceph-mon[32384]: pgmap v5927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:25:58 smithi133 ceph-mon[37053]: pgmap v5927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:25:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:25:58 smithi063 ceph-mon[36747]: pgmap v5927: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:00 smithi043 ceph-mon[32384]: pgmap v5928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:00 smithi133 ceph-mon[37053]: pgmap v5928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:00 smithi063 ceph-mon[36747]: pgmap v5928: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:01.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10206.941822 secs 2024-07-26T11:26:01.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10222.424826 secs 2024-07-26T11:26:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10206.941822 secs 2024-07-26T11:26:01.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10222.424826 secs 2024-07-26T11:26:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10206.941822 secs 2024-07-26T11:26:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10222.424826 secs 2024-07-26T11:26:02.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:02 smithi043 ceph-mon[32384]: pgmap v5929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:02 smithi133 ceph-mon[37053]: pgmap v5929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:02 smithi063 ceph-mon[36747]: pgmap v5929: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:04.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:04 smithi043 ceph-mon[32384]: pgmap v5930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:04 smithi133 ceph-mon[37053]: pgmap v5930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:04 smithi063 ceph-mon[36747]: pgmap v5930: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:06 smithi043 ceph-mon[32384]: pgmap v5931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10211.941940 secs 2024-07-26T11:26:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10227.424943 secs 2024-07-26T11:26:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:06 smithi133 ceph-mon[37053]: pgmap v5931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10211.941940 secs 2024-07-26T11:26:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10227.424943 secs 2024-07-26T11:26:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:06 smithi063 ceph-mon[36747]: pgmap v5931: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10211.941940 secs 2024-07-26T11:26:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10227.424943 secs 2024-07-26T11:26:08.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:08 smithi043 ceph-mon[32384]: pgmap v5932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:08.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:08 smithi133 ceph-mon[37053]: pgmap v5932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:08 smithi063 ceph-mon[36747]: pgmap v5932: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:10 smithi043 ceph-mon[32384]: pgmap v5933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:10 smithi133 ceph-mon[37053]: pgmap v5933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:10 smithi063 ceph-mon[36747]: pgmap v5933: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10216.942057 secs 2024-07-26T11:26:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10232.425025 secs 2024-07-26T11:26:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10216.942057 secs 2024-07-26T11:26:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10232.425025 secs 2024-07-26T11:26:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10216.942057 secs 2024-07-26T11:26:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10232.425025 secs 2024-07-26T11:26:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:12 smithi043 ceph-mon[32384]: pgmap v5934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:12 smithi133 ceph-mon[37053]: pgmap v5934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:12 smithi063 ceph-mon[36747]: pgmap v5934: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:14 smithi043 ceph-mon[32384]: pgmap v5935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:14.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:14 smithi133 ceph-mon[37053]: pgmap v5935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:14 smithi063 ceph-mon[36747]: pgmap v5935: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:16 smithi043 ceph-mon[32384]: pgmap v5936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10221.942197 secs 2024-07-26T11:26:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10237.425145 secs 2024-07-26T11:26:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:16 smithi133 ceph-mon[37053]: pgmap v5936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10221.942197 secs 2024-07-26T11:26:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10237.425145 secs 2024-07-26T11:26:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:16 smithi063 ceph-mon[36747]: pgmap v5936: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10221.942197 secs 2024-07-26T11:26:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10237.425145 secs 2024-07-26T11:26:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:18 smithi043 ceph-mon[32384]: pgmap v5937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:26:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:18 smithi133 ceph-mon[37053]: pgmap v5937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:26:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:18 smithi063 ceph-mon[36747]: pgmap v5937: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:26:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:19 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:26:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:19 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:26:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:19 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:26:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:20 smithi133 ceph-mon[37053]: pgmap v5938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:26:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:26:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:26:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:20 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:20 smithi063 ceph-mon[36747]: pgmap v5938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:26:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:20 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:26:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:20 smithi043 ceph-mon[32384]: pgmap v5938: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:26:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:26:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:26:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:20 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:21 smithi133 ceph-mon[37053]: pgmap v5939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10226.942310 secs 2024-07-26T11:26:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10242.425259 secs 2024-07-26T11:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:21 smithi063 ceph-mon[36747]: pgmap v5939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10226.942310 secs 2024-07-26T11:26:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10242.425259 secs 2024-07-26T11:26:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:21 smithi043 ceph-mon[32384]: pgmap v5939: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10226.942310 secs 2024-07-26T11:26:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10242.425259 secs 2024-07-26T11:26:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:23 smithi133 ceph-mon[37053]: pgmap v5940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:23 smithi063 ceph-mon[36747]: pgmap v5940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:23 smithi043 ceph-mon[32384]: pgmap v5940: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:25 smithi133 ceph-mon[37053]: pgmap v5941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:25 smithi063 ceph-mon[36747]: pgmap v5941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:25 smithi043 ceph-mon[32384]: pgmap v5941: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10231.942431 secs 2024-07-26T11:26:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10247.425376 secs 2024-07-26T11:26:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10231.942431 secs 2024-07-26T11:26:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10247.425376 secs 2024-07-26T11:26:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10231.942431 secs 2024-07-26T11:26:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10247.425376 secs 2024-07-26T11:26:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:27 smithi133 ceph-mon[37053]: pgmap v5942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:27 smithi063 ceph-mon[36747]: pgmap v5942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:27 smithi043 ceph-mon[32384]: pgmap v5942: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:29 smithi063 ceph-mon[36747]: pgmap v5943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:26:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:29 smithi043 ceph-mon[32384]: pgmap v5943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:26:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:29 smithi133 ceph-mon[37053]: pgmap v5943: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:26:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:31 smithi063 ceph-mon[36747]: pgmap v5944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:26:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10236.942504 secs 2024-07-26T11:26:31.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10252.425495 secs 2024-07-26T11:26:31.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:31 smithi133 ceph-mon[37053]: pgmap v5944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:26:31.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10236.942504 secs 2024-07-26T11:26:31.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10252.425495 secs 2024-07-26T11:26:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:31 smithi043 ceph-mon[32384]: pgmap v5944: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:26:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10236.942504 secs 2024-07-26T11:26:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10252.425495 secs 2024-07-26T11:26:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:33 smithi063 ceph-mon[36747]: pgmap v5945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:33 smithi043 ceph-mon[32384]: pgmap v5945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:33 smithi133 ceph-mon[37053]: pgmap v5945: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:35 smithi063 ceph-mon[36747]: pgmap v5946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:35 smithi043 ceph-mon[32384]: pgmap v5946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:35 smithi133 ceph-mon[37053]: pgmap v5946: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10241.942598 secs 2024-07-26T11:26:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10257.425615 secs 2024-07-26T11:26:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10241.942598 secs 2024-07-26T11:26:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10257.425615 secs 2024-07-26T11:26:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10241.942598 secs 2024-07-26T11:26:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10257.425615 secs 2024-07-26T11:26:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:37 smithi063 ceph-mon[36747]: pgmap v5947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:37 smithi043 ceph-mon[32384]: pgmap v5947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:37 smithi133 ceph-mon[37053]: pgmap v5947: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:39 smithi063 ceph-mon[36747]: pgmap v5948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:39 smithi043 ceph-mon[32384]: pgmap v5948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:39 smithi133 ceph-mon[37053]: pgmap v5948: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:41 smithi063 ceph-mon[36747]: pgmap v5949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10246.942723 secs 2024-07-26T11:26:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10262.425744 secs 2024-07-26T11:26:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:41 smithi043 ceph-mon[32384]: pgmap v5949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10246.942723 secs 2024-07-26T11:26:41.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10262.425744 secs 2024-07-26T11:26:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:41 smithi133 ceph-mon[37053]: pgmap v5949: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10246.942723 secs 2024-07-26T11:26:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10262.425744 secs 2024-07-26T11:26:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:43 smithi043 ceph-mon[32384]: pgmap v5950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:43 smithi133 ceph-mon[37053]: pgmap v5950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:43 smithi063 ceph-mon[36747]: pgmap v5950: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:45 smithi043 ceph-mon[32384]: pgmap v5951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:45 smithi133 ceph-mon[37053]: pgmap v5951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:45 smithi063 ceph-mon[36747]: pgmap v5951: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10251.942863 secs 2024-07-26T11:26:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10267.425839 secs 2024-07-26T11:26:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10251.942863 secs 2024-07-26T11:26:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10267.425839 secs 2024-07-26T11:26:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10251.942863 secs 2024-07-26T11:26:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10267.425839 secs 2024-07-26T11:26:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:47 smithi043 ceph-mon[32384]: pgmap v5952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:47 smithi133 ceph-mon[37053]: pgmap v5952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:47 smithi063 ceph-mon[36747]: pgmap v5952: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:49.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:49 smithi043 ceph-mon[32384]: pgmap v5953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:49.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:49 smithi133 ceph-mon[37053]: pgmap v5953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:49 smithi063 ceph-mon[36747]: pgmap v5953: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:51 smithi043 ceph-mon[32384]: pgmap v5954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10256.943001 secs 2024-07-26T11:26:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10272.425960 secs 2024-07-26T11:26:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:51 smithi133 ceph-mon[37053]: pgmap v5954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10256.943001 secs 2024-07-26T11:26:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10272.425960 secs 2024-07-26T11:26:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:51 smithi063 ceph-mon[36747]: pgmap v5954: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:26:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10256.943001 secs 2024-07-26T11:26:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10272.425960 secs 2024-07-26T11:26:53.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:53 smithi043 ceph-mon[32384]: pgmap v5955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:53 smithi133 ceph-mon[37053]: pgmap v5955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:53 smithi063 ceph-mon[36747]: pgmap v5955: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:55 smithi043 ceph-mon[32384]: pgmap v5956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:55.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:55 smithi133 ceph-mon[37053]: pgmap v5956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:55 smithi063 ceph-mon[36747]: pgmap v5956: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10261.943129 secs 2024-07-26T11:26:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10277.426091 secs 2024-07-26T11:26:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10261.943129 secs 2024-07-26T11:26:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10277.426091 secs 2024-07-26T11:26:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10261.943129 secs 2024-07-26T11:26:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10277.426091 secs 2024-07-26T11:26:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:57 smithi043 ceph-mon[32384]: pgmap v5957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:57 smithi133 ceph-mon[37053]: pgmap v5957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:57 smithi063 ceph-mon[36747]: pgmap v5957: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:26:59.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:26:59 smithi043 ceph-mon[32384]: pgmap v5958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:59.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:26:59 smithi133 ceph-mon[37053]: pgmap v5958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:26:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:26:59 smithi063 ceph-mon[36747]: pgmap v5958: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:01 smithi043 ceph-mon[32384]: pgmap v5959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10266.943248 secs 2024-07-26T11:27:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10282.426174 secs 2024-07-26T11:27:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:01 smithi133 ceph-mon[37053]: pgmap v5959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10266.943248 secs 2024-07-26T11:27:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10282.426174 secs 2024-07-26T11:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:01 smithi063 ceph-mon[36747]: pgmap v5959: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10266.943248 secs 2024-07-26T11:27:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10282.426174 secs 2024-07-26T11:27:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:03 smithi043 ceph-mon[32384]: pgmap v5960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:03 smithi133 ceph-mon[37053]: pgmap v5960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:03 smithi063 ceph-mon[36747]: pgmap v5960: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:05.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:05 smithi043 ceph-mon[32384]: pgmap v5961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:05.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:05 smithi133 ceph-mon[37053]: pgmap v5961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:05 smithi063 ceph-mon[36747]: pgmap v5961: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10271.943342 secs 2024-07-26T11:27:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10287.426259 secs 2024-07-26T11:27:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10271.943342 secs 2024-07-26T11:27:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10287.426259 secs 2024-07-26T11:27:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10271.943342 secs 2024-07-26T11:27:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10287.426259 secs 2024-07-26T11:27:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:07 smithi043 ceph-mon[32384]: pgmap v5962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:07.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:07 smithi133 ceph-mon[37053]: pgmap v5962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:07 smithi063 ceph-mon[36747]: pgmap v5962: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:09 smithi043 ceph-mon[32384]: pgmap v5963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:09 smithi133 ceph-mon[37053]: pgmap v5963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:09 smithi063 ceph-mon[36747]: pgmap v5963: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:11 smithi043 ceph-mon[32384]: pgmap v5964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10276.943442 secs 2024-07-26T11:27:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10292.426383 secs 2024-07-26T11:27:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:11 smithi133 ceph-mon[37053]: pgmap v5964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10276.943442 secs 2024-07-26T11:27:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10292.426383 secs 2024-07-26T11:27:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:11 smithi063 ceph-mon[36747]: pgmap v5964: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10276.943442 secs 2024-07-26T11:27:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10292.426383 secs 2024-07-26T11:27:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:13 smithi043 ceph-mon[32384]: pgmap v5965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:13 smithi133 ceph-mon[37053]: pgmap v5965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:13 smithi063 ceph-mon[36747]: pgmap v5965: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:15 smithi043 ceph-mon[32384]: pgmap v5966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:15 smithi133 ceph-mon[37053]: pgmap v5966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:15 smithi063 ceph-mon[36747]: pgmap v5966: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10281.943525 secs 2024-07-26T11:27:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10297.426505 secs 2024-07-26T11:27:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10281.943525 secs 2024-07-26T11:27:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10297.426505 secs 2024-07-26T11:27:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10281.943525 secs 2024-07-26T11:27:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10297.426505 secs 2024-07-26T11:27:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:17 smithi043 ceph-mon[32384]: pgmap v5967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:17 smithi133 ceph-mon[37053]: pgmap v5967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:17 smithi063 ceph-mon[36747]: pgmap v5967: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:19 smithi043 ceph-mon[32384]: pgmap v5968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:19 smithi133 ceph-mon[37053]: pgmap v5968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:19 smithi063 ceph-mon[36747]: pgmap v5968: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:20 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:27:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:20 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:27:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:20 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:27:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:21 smithi043 ceph-mon[32384]: pgmap v5969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10286.943652 secs 2024-07-26T11:27:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10302.426594 secs 2024-07-26T11:27:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:21 smithi133 ceph-mon[37053]: pgmap v5969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10286.943652 secs 2024-07-26T11:27:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10302.426594 secs 2024-07-26T11:27:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:21 smithi063 ceph-mon[36747]: pgmap v5969: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10286.943652 secs 2024-07-26T11:27:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10302.426594 secs 2024-07-26T11:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:22 smithi133 ceph-mon[37053]: pgmap v5970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:22 smithi133 ceph-mon[37053]: pgmap v5971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:27:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:22 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:22 smithi063 ceph-mon[36747]: pgmap v5970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:22 smithi063 ceph-mon[36747]: pgmap v5971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:27:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:22 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:27:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:27:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:27:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:22 smithi043 ceph-mon[32384]: pgmap v5970: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:22 smithi043 ceph-mon[32384]: pgmap v5971: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:27:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:22 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:27:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:24 smithi063 ceph-mon[36747]: pgmap v5972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:24 smithi043 ceph-mon[32384]: pgmap v5972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:24 smithi133 ceph-mon[37053]: pgmap v5972: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10291.943778 secs 2024-07-26T11:27:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:26 smithi063 ceph-mon[36747]: pgmap v5973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:27:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10307.426734 secs 2024-07-26T11:27:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10291.943778 secs 2024-07-26T11:27:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:26 smithi043 ceph-mon[32384]: pgmap v5973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:27:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10307.426734 secs 2024-07-26T11:27:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10291.943778 secs 2024-07-26T11:27:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:26 smithi133 ceph-mon[37053]: pgmap v5973: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:27:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10307.426734 secs 2024-07-26T11:27:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:28 smithi063 ceph-mon[36747]: pgmap v5974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:28 smithi043 ceph-mon[32384]: pgmap v5974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:28 smithi133 ceph-mon[37053]: pgmap v5974: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:30 smithi063 ceph-mon[36747]: pgmap v5975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:30 smithi043 ceph-mon[32384]: pgmap v5975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:30 smithi133 ceph-mon[37053]: pgmap v5975: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:27:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10296.943908 secs 2024-07-26T11:27:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10312.426857 secs 2024-07-26T11:27:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10296.943908 secs 2024-07-26T11:27:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10312.426857 secs 2024-07-26T11:27:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10296.943908 secs 2024-07-26T11:27:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10312.426857 secs 2024-07-26T11:27:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:32 smithi043 ceph-mon[32384]: pgmap v5976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:27:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:32 smithi133 ceph-mon[37053]: pgmap v5976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:27:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:32 smithi063 ceph-mon[36747]: pgmap v5976: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:27:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:34 smithi043 ceph-mon[32384]: pgmap v5977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:34 smithi133 ceph-mon[37053]: pgmap v5977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:34 smithi063 ceph-mon[36747]: pgmap v5977: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10301.944022 secs 2024-07-26T11:27:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:36 smithi043 ceph-mon[32384]: pgmap v5978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10317.427008 secs 2024-07-26T11:27:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10301.944022 secs 2024-07-26T11:27:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:36 smithi133 ceph-mon[37053]: pgmap v5978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10317.427008 secs 2024-07-26T11:27:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10301.944022 secs 2024-07-26T11:27:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:36 smithi063 ceph-mon[36747]: pgmap v5978: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10317.427008 secs 2024-07-26T11:27:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:38 smithi043 ceph-mon[32384]: pgmap v5979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:38 smithi133 ceph-mon[37053]: pgmap v5979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:38 smithi063 ceph-mon[36747]: pgmap v5979: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:40 smithi043 ceph-mon[32384]: pgmap v5980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:40 smithi133 ceph-mon[37053]: pgmap v5980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:40 smithi063 ceph-mon[36747]: pgmap v5980: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10306.944126 secs 2024-07-26T11:27:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10322.427140 secs 2024-07-26T11:27:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10306.944126 secs 2024-07-26T11:27:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10322.427140 secs 2024-07-26T11:27:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10306.944126 secs 2024-07-26T11:27:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10322.427140 secs 2024-07-26T11:27:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:42 smithi043 ceph-mon[32384]: pgmap v5981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:42 smithi133 ceph-mon[37053]: pgmap v5981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:42 smithi063 ceph-mon[36747]: pgmap v5981: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:44.891 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:44 smithi043 ceph-mon[32384]: pgmap v5982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:44 smithi133 ceph-mon[37053]: pgmap v5982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:44 smithi063 ceph-mon[36747]: pgmap v5982: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10311.944220 secs 2024-07-26T11:27:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:46 smithi043 ceph-mon[32384]: pgmap v5983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10327.427267 secs 2024-07-26T11:27:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10311.944220 secs 2024-07-26T11:27:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:46 smithi133 ceph-mon[37053]: pgmap v5983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10327.427267 secs 2024-07-26T11:27:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10311.944220 secs 2024-07-26T11:27:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:46 smithi063 ceph-mon[36747]: pgmap v5983: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10327.427267 secs 2024-07-26T11:27:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:48 smithi043 ceph-mon[32384]: pgmap v5984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:48 smithi133 ceph-mon[37053]: pgmap v5984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:48 smithi063 ceph-mon[36747]: pgmap v5984: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:50 smithi043 ceph-mon[32384]: pgmap v5985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:50 smithi133 ceph-mon[37053]: pgmap v5985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:50 smithi063 ceph-mon[36747]: pgmap v5985: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10316.944340 secs 2024-07-26T11:27:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10332.427404 secs 2024-07-26T11:27:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10316.944340 secs 2024-07-26T11:27:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10332.427404 secs 2024-07-26T11:27:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10316.944340 secs 2024-07-26T11:27:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10332.427404 secs 2024-07-26T11:27:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:52 smithi043 ceph-mon[32384]: pgmap v5986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:52 smithi133 ceph-mon[37053]: pgmap v5986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:52 smithi063 ceph-mon[36747]: pgmap v5986: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:27:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:54 smithi043 ceph-mon[32384]: pgmap v5987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:54 smithi133 ceph-mon[37053]: pgmap v5987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:54 smithi063 ceph-mon[36747]: pgmap v5987: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:27:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10321.944462 secs 2024-07-26T11:27:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:56 smithi043 ceph-mon[32384]: pgmap v5988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10337.427547 secs 2024-07-26T11:27:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10321.944462 secs 2024-07-26T11:27:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:56 smithi133 ceph-mon[37053]: pgmap v5988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10337.427547 secs 2024-07-26T11:27:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10321.944462 secs 2024-07-26T11:27:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:56 smithi063 ceph-mon[36747]: pgmap v5988: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:27:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10337.427547 secs 2024-07-26T11:27:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:27:58 smithi043 ceph-mon[32384]: pgmap v5989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:27:58 smithi133 ceph-mon[37053]: pgmap v5989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:27:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:27:58 smithi063 ceph-mon[36747]: pgmap v5989: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:00 smithi043 ceph-mon[32384]: pgmap v5990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10326.944591 secs 2024-07-26T11:28:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:00 smithi133 ceph-mon[37053]: pgmap v5990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10326.944591 secs 2024-07-26T11:28:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:00 smithi063 ceph-mon[36747]: pgmap v5990: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10326.944591 secs 2024-07-26T11:28:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10342.427651 secs 2024-07-26T11:28:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10342.427651 secs 2024-07-26T11:28:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10342.427651 secs 2024-07-26T11:28:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:02 smithi043 ceph-mon[32384]: pgmap v5991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:02 smithi133 ceph-mon[37053]: pgmap v5991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:02 smithi063 ceph-mon[36747]: pgmap v5991: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:04 smithi043 ceph-mon[32384]: pgmap v5992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:04 smithi133 ceph-mon[37053]: pgmap v5992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:04 smithi063 ceph-mon[36747]: pgmap v5992: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10331.944713 secs 2024-07-26T11:28:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10331.944713 secs 2024-07-26T11:28:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10331.944713 secs 2024-07-26T11:28:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:06 smithi043 ceph-mon[32384]: pgmap v5993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10347.427768 secs 2024-07-26T11:28:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:06 smithi133 ceph-mon[37053]: pgmap v5993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10347.427768 secs 2024-07-26T11:28:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:06 smithi063 ceph-mon[36747]: pgmap v5993: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10347.427768 secs 2024-07-26T11:28:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:08 smithi043 ceph-mon[32384]: pgmap v5994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:08 smithi133 ceph-mon[37053]: pgmap v5994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:08 smithi063 ceph-mon[36747]: pgmap v5994: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:10 smithi043 ceph-mon[32384]: pgmap v5995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10336.944806 secs 2024-07-26T11:28:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:10 smithi133 ceph-mon[37053]: pgmap v5995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10336.944806 secs 2024-07-26T11:28:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:10 smithi063 ceph-mon[36747]: pgmap v5995: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10336.944806 secs 2024-07-26T11:28:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10352.427892 secs 2024-07-26T11:28:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10352.427892 secs 2024-07-26T11:28:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10352.427892 secs 2024-07-26T11:28:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:12 smithi133 ceph-mon[37053]: pgmap v5996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:12 smithi063 ceph-mon[36747]: pgmap v5996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:12 smithi043 ceph-mon[32384]: pgmap v5996: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:13 smithi133 ceph-mon[37053]: pgmap v5997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:13 smithi063 ceph-mon[36747]: pgmap v5997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:13 smithi043 ceph-mon[32384]: pgmap v5997: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10341.944905 secs 2024-07-26T11:28:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:16 smithi043 ceph-mon[32384]: pgmap v5998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10357.428018 secs 2024-07-26T11:28:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10341.944905 secs 2024-07-26T11:28:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:16 smithi133 ceph-mon[37053]: pgmap v5998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10357.428018 secs 2024-07-26T11:28:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10341.944905 secs 2024-07-26T11:28:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:16 smithi063 ceph-mon[36747]: pgmap v5998: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10357.428018 secs 2024-07-26T11:28:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:18 smithi043 ceph-mon[32384]: pgmap v5999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:18 smithi133 ceph-mon[37053]: pgmap v5999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:18 smithi063 ceph-mon[36747]: pgmap v5999: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:28:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:20 smithi043 ceph-mon[32384]: pgmap v6000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:20 smithi133 ceph-mon[37053]: pgmap v6000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:20 smithi063 ceph-mon[36747]: pgmap v6000: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:21.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10346.945004 secs 2024-07-26T11:28:21.884 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10362.428166 secs 2024-07-26T11:28:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10346.945004 secs 2024-07-26T11:28:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10362.428166 secs 2024-07-26T11:28:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10346.945004 secs 2024-07-26T11:28:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10362.428166 secs 2024-07-26T11:28:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:22 smithi043 ceph-mon[32384]: pgmap v6001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:22 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:28:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:22 smithi133 ceph-mon[37053]: pgmap v6001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:22 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:28:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:22 smithi063 ceph-mon[36747]: pgmap v6001: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:22 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:28:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:28:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:28:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:23 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:28:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:28:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:28:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:23 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:28:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:28:24.097 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:28:24.097 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:23 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:28:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:24 smithi043 ceph-mon[32384]: pgmap v6002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:24 smithi043 ceph-mon[32384]: pgmap v6003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:28:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:24 smithi133 ceph-mon[37053]: pgmap v6002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:24 smithi133 ceph-mon[37053]: pgmap v6003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:28:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:24 smithi063 ceph-mon[36747]: pgmap v6002: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:24 smithi063 ceph-mon[36747]: pgmap v6003: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:28:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:26 smithi043 ceph-mon[32384]: pgmap v6004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10351.945141 secs 2024-07-26T11:28:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10367.428244 secs 2024-07-26T11:28:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:26 smithi133 ceph-mon[37053]: pgmap v6004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10351.945141 secs 2024-07-26T11:28:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10367.428244 secs 2024-07-26T11:28:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:26 smithi063 ceph-mon[36747]: pgmap v6004: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10351.945141 secs 2024-07-26T11:28:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10367.428244 secs 2024-07-26T11:28:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:28 smithi043 ceph-mon[32384]: pgmap v6005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:28:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:28 smithi133 ceph-mon[37053]: pgmap v6005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:28:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:28 smithi063 ceph-mon[36747]: pgmap v6005: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:28:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:30 smithi043 ceph-mon[32384]: pgmap v6006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:30 smithi133 ceph-mon[37053]: pgmap v6006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:30 smithi063 ceph-mon[36747]: pgmap v6006: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10356.945268 secs 2024-07-26T11:28:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10372.428370 secs 2024-07-26T11:28:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10356.945268 secs 2024-07-26T11:28:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10372.428370 secs 2024-07-26T11:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10356.945268 secs 2024-07-26T11:28:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10372.428370 secs 2024-07-26T11:28:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:32 smithi043 ceph-mon[32384]: pgmap v6007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:32 smithi133 ceph-mon[37053]: pgmap v6007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:32 smithi063 ceph-mon[36747]: pgmap v6007: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:28:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:34 smithi043 ceph-mon[32384]: pgmap v6008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:28:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:34 smithi133 ceph-mon[37053]: pgmap v6008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:28:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:34 smithi063 ceph-mon[36747]: pgmap v6008: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:36 smithi043 ceph-mon[32384]: pgmap v6009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10361.945365 secs 2024-07-26T11:28:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10377.428472 secs 2024-07-26T11:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:36 smithi133 ceph-mon[37053]: pgmap v6009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10361.945365 secs 2024-07-26T11:28:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10377.428472 secs 2024-07-26T11:28:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:36 smithi063 ceph-mon[36747]: pgmap v6009: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10361.945365 secs 2024-07-26T11:28:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10377.428472 secs 2024-07-26T11:28:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:38 smithi043 ceph-mon[32384]: pgmap v6010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:38 smithi133 ceph-mon[37053]: pgmap v6010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:38 smithi063 ceph-mon[36747]: pgmap v6010: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:40 smithi043 ceph-mon[32384]: pgmap v6011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10366.945480 secs 2024-07-26T11:28:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:40 smithi133 ceph-mon[37053]: pgmap v6011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10366.945480 secs 2024-07-26T11:28:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:40 smithi063 ceph-mon[36747]: pgmap v6011: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10366.945480 secs 2024-07-26T11:28:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10382.428540 secs 2024-07-26T11:28:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10382.428540 secs 2024-07-26T11:28:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10382.428540 secs 2024-07-26T11:28:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:42 smithi043 ceph-mon[32384]: pgmap v6012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:42 smithi133 ceph-mon[37053]: pgmap v6012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:42 smithi063 ceph-mon[36747]: pgmap v6012: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:44 smithi043 ceph-mon[32384]: pgmap v6013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:44 smithi133 ceph-mon[37053]: pgmap v6013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:44 smithi063 ceph-mon[36747]: pgmap v6013: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10371.945622 secs 2024-07-26T11:28:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10371.945622 secs 2024-07-26T11:28:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10371.945622 secs 2024-07-26T11:28:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:46 smithi043 ceph-mon[32384]: pgmap v6014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10387.428663 secs 2024-07-26T11:28:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:46 smithi133 ceph-mon[37053]: pgmap v6014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10387.428663 secs 2024-07-26T11:28:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:46 smithi063 ceph-mon[36747]: pgmap v6014: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10387.428663 secs 2024-07-26T11:28:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:48 smithi043 ceph-mon[32384]: pgmap v6015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:48 smithi133 ceph-mon[37053]: pgmap v6015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:48 smithi063 ceph-mon[36747]: pgmap v6015: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:50 smithi043 ceph-mon[32384]: pgmap v6016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10376.945745 secs 2024-07-26T11:28:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:50 smithi133 ceph-mon[37053]: pgmap v6016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10376.945745 secs 2024-07-26T11:28:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:50 smithi063 ceph-mon[36747]: pgmap v6016: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10376.945745 secs 2024-07-26T11:28:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10392.428790 secs 2024-07-26T11:28:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10392.428790 secs 2024-07-26T11:28:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10392.428790 secs 2024-07-26T11:28:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:52 smithi133 ceph-mon[37053]: pgmap v6017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:52 smithi063 ceph-mon[36747]: pgmap v6017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:52 smithi043 ceph-mon[32384]: pgmap v6017: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:54 smithi133 ceph-mon[37053]: pgmap v6018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:54 smithi063 ceph-mon[36747]: pgmap v6018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:54 smithi043 ceph-mon[32384]: pgmap v6018: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:28:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10381.945871 secs 2024-07-26T11:28:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10381.945871 secs 2024-07-26T11:28:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10381.945871 secs 2024-07-26T11:28:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:56 smithi133 ceph-mon[37053]: pgmap v6019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10397.428912 secs 2024-07-26T11:28:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:56 smithi063 ceph-mon[36747]: pgmap v6019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10397.428912 secs 2024-07-26T11:28:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:56 smithi043 ceph-mon[32384]: pgmap v6019: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:28:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10397.428912 secs 2024-07-26T11:28:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:57 smithi063 ceph-mon[36747]: pgmap v6020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:57 smithi043 ceph-mon[32384]: pgmap v6020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:28:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:57 smithi133 ceph-mon[37053]: pgmap v6020: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:28:59 smithi043 ceph-mon[32384]: pgmap v6021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:28:59 smithi133 ceph-mon[37053]: pgmap v6021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:28:59 smithi063 ceph-mon[36747]: pgmap v6021: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:01.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10386.945965 secs 2024-07-26T11:29:01.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10386.945965 secs 2024-07-26T11:29:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10386.945965 secs 2024-07-26T11:29:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10402.429037 secs 2024-07-26T11:29:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:01 smithi043 ceph-mon[32384]: pgmap v6022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10402.429037 secs 2024-07-26T11:29:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:01 smithi133 ceph-mon[37053]: pgmap v6022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10402.429037 secs 2024-07-26T11:29:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:01 smithi063 ceph-mon[36747]: pgmap v6022: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:03 smithi043 ceph-mon[32384]: pgmap v6023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:03 smithi133 ceph-mon[37053]: pgmap v6023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:03 smithi063 ceph-mon[36747]: pgmap v6023: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:05 smithi043 ceph-mon[32384]: pgmap v6024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10391.946093 secs 2024-07-26T11:29:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:05 smithi133 ceph-mon[37053]: pgmap v6024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10391.946093 secs 2024-07-26T11:29:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:05 smithi063 ceph-mon[36747]: pgmap v6024: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10391.946093 secs 2024-07-26T11:29:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10407.429160 secs 2024-07-26T11:29:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10407.429160 secs 2024-07-26T11:29:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10407.429160 secs 2024-07-26T11:29:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:07 smithi043 ceph-mon[32384]: pgmap v6025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:07 smithi133 ceph-mon[37053]: pgmap v6025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:07 smithi063 ceph-mon[36747]: pgmap v6025: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:09 smithi043 ceph-mon[32384]: pgmap v6026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:09 smithi133 ceph-mon[37053]: pgmap v6026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:09 smithi063 ceph-mon[36747]: pgmap v6026: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10396.946206 secs 2024-07-26T11:29:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10396.946206 secs 2024-07-26T11:29:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10396.946206 secs 2024-07-26T11:29:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10412.429239 secs 2024-07-26T11:29:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:11 smithi043 ceph-mon[32384]: pgmap v6027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10412.429239 secs 2024-07-26T11:29:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:11 smithi133 ceph-mon[37053]: pgmap v6027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10412.429239 secs 2024-07-26T11:29:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:11 smithi063 ceph-mon[36747]: pgmap v6027: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:13 smithi043 ceph-mon[32384]: pgmap v6028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:13 smithi133 ceph-mon[37053]: pgmap v6028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:13 smithi063 ceph-mon[36747]: pgmap v6028: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:15 smithi043 ceph-mon[32384]: pgmap v6029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10401.946327 secs 2024-07-26T11:29:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:15 smithi133 ceph-mon[37053]: pgmap v6029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10401.946327 secs 2024-07-26T11:29:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:15 smithi063 ceph-mon[36747]: pgmap v6029: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10401.946327 secs 2024-07-26T11:29:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10417.429378 secs 2024-07-26T11:29:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10417.429378 secs 2024-07-26T11:29:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10417.429378 secs 2024-07-26T11:29:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:17 smithi043 ceph-mon[32384]: pgmap v6030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:17 smithi133 ceph-mon[37053]: pgmap v6030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:17 smithi063 ceph-mon[36747]: pgmap v6030: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:19 smithi043 ceph-mon[32384]: pgmap v6031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:19 smithi133 ceph-mon[37053]: pgmap v6031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:19 smithi063 ceph-mon[36747]: pgmap v6031: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10406.946444 secs 2024-07-26T11:29:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10406.946444 secs 2024-07-26T11:29:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10406.946444 secs 2024-07-26T11:29:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10422.429500 secs 2024-07-26T11:29:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:21 smithi043 ceph-mon[32384]: pgmap v6032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10422.429500 secs 2024-07-26T11:29:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:21 smithi133 ceph-mon[37053]: pgmap v6032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10422.429500 secs 2024-07-26T11:29:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:21 smithi063 ceph-mon[36747]: pgmap v6032: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:23 smithi043 ceph-mon[32384]: pgmap v6033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:23 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:29:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:23 smithi133 ceph-mon[37053]: pgmap v6033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:23 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:29:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:23 smithi063 ceph-mon[36747]: pgmap v6033: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:23 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:29:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:29:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:29:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:24 smithi133 ceph-mon[37053]: pgmap v6034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:29:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:24 smithi133 ceph-mon[37053]: pgmap v6035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:29:25.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:24 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:29:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:29:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:29:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:24 smithi063 ceph-mon[36747]: pgmap v6034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:29:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:24 smithi063 ceph-mon[36747]: pgmap v6035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:29:25.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:24 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:29:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:29:25.554 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:29:25.554 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:24 smithi043 ceph-mon[32384]: pgmap v6034: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:29:25.554 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:24 smithi043 ceph-mon[32384]: pgmap v6035: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:29:25.554 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:24 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:29:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10411.946565 secs 2024-07-26T11:29:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10411.946565 secs 2024-07-26T11:29:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10411.946565 secs 2024-07-26T11:29:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10427.429647 secs 2024-07-26T11:29:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:27 smithi133 ceph-mon[37053]: pgmap v6036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:29:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10427.429647 secs 2024-07-26T11:29:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:27 smithi063 ceph-mon[36747]: pgmap v6036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:29:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10427.429647 secs 2024-07-26T11:29:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:27 smithi043 ceph-mon[32384]: pgmap v6036: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:29:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:29 smithi043 ceph-mon[32384]: pgmap v6037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:29:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:29 smithi133 ceph-mon[37053]: pgmap v6037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:29:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:29 smithi063 ceph-mon[36747]: pgmap v6037: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:29:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:30 smithi043 ceph-mon[32384]: pgmap v6038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:29:31.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10416.946679 secs 2024-07-26T11:29:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:30 smithi133 ceph-mon[37053]: pgmap v6038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:29:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10416.946679 secs 2024-07-26T11:29:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:30 smithi063 ceph-mon[36747]: pgmap v6038: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:29:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10416.946679 secs 2024-07-26T11:29:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10432.429767 secs 2024-07-26T11:29:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10432.429767 secs 2024-07-26T11:29:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10432.429767 secs 2024-07-26T11:29:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:32 smithi043 ceph-mon[32384]: pgmap v6039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:29:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:32 smithi133 ceph-mon[37053]: pgmap v6039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:29:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:32 smithi063 ceph-mon[36747]: pgmap v6039: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:29:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:35 smithi043 ceph-mon[32384]: pgmap v6040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:29:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:35 smithi133 ceph-mon[37053]: pgmap v6040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:29:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:35 smithi063 ceph-mon[36747]: pgmap v6040: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:29:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10421.946761 secs 2024-07-26T11:29:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10437.429898 secs 2024-07-26T11:29:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10421.946761 secs 2024-07-26T11:29:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10437.429898 secs 2024-07-26T11:29:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10421.946761 secs 2024-07-26T11:29:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10437.429898 secs 2024-07-26T11:29:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:37 smithi043 ceph-mon[32384]: pgmap v6041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:37 smithi133 ceph-mon[37053]: pgmap v6041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:37 smithi063 ceph-mon[36747]: pgmap v6041: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:39 smithi043 ceph-mon[32384]: pgmap v6042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:39 smithi133 ceph-mon[37053]: pgmap v6042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:39 smithi063 ceph-mon[36747]: pgmap v6042: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:41 smithi043 ceph-mon[32384]: pgmap v6043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10426.946905 secs 2024-07-26T11:29:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10442.430024 secs 2024-07-26T11:29:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:41 smithi133 ceph-mon[37053]: pgmap v6043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10426.946905 secs 2024-07-26T11:29:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10442.430024 secs 2024-07-26T11:29:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:41 smithi063 ceph-mon[36747]: pgmap v6043: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10426.946905 secs 2024-07-26T11:29:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10442.430024 secs 2024-07-26T11:29:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:43 smithi043 ceph-mon[32384]: pgmap v6044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:43 smithi133 ceph-mon[37053]: pgmap v6044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:43 smithi063 ceph-mon[36747]: pgmap v6044: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:45 smithi043 ceph-mon[32384]: pgmap v6045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:45 smithi133 ceph-mon[37053]: pgmap v6045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:45 smithi063 ceph-mon[36747]: pgmap v6045: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10431.947041 secs 2024-07-26T11:29:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10447.430149 secs 2024-07-26T11:29:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10431.947041 secs 2024-07-26T11:29:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10447.430149 secs 2024-07-26T11:29:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10431.947041 secs 2024-07-26T11:29:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10447.430149 secs 2024-07-26T11:29:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:47 smithi043 ceph-mon[32384]: pgmap v6046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:47 smithi133 ceph-mon[37053]: pgmap v6046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:47 smithi063 ceph-mon[36747]: pgmap v6046: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:49 smithi043 ceph-mon[32384]: pgmap v6047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:49 smithi133 ceph-mon[37053]: pgmap v6047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:49 smithi063 ceph-mon[36747]: pgmap v6047: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:51 smithi043 ceph-mon[32384]: pgmap v6048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10436.947165 secs 2024-07-26T11:29:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10452.430253 secs 2024-07-26T11:29:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:51 smithi133 ceph-mon[37053]: pgmap v6048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10436.947165 secs 2024-07-26T11:29:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10452.430253 secs 2024-07-26T11:29:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:51 smithi063 ceph-mon[36747]: pgmap v6048: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:29:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10436.947165 secs 2024-07-26T11:29:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10452.430253 secs 2024-07-26T11:29:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:53 smithi043 ceph-mon[32384]: pgmap v6049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:53 smithi133 ceph-mon[37053]: pgmap v6049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:53 smithi063 ceph-mon[36747]: pgmap v6049: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:55 smithi043 ceph-mon[32384]: pgmap v6050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:55 smithi133 ceph-mon[37053]: pgmap v6050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:55 smithi063 ceph-mon[36747]: pgmap v6050: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10441.947281 secs 2024-07-26T11:29:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10457.430342 secs 2024-07-26T11:29:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10441.947281 secs 2024-07-26T11:29:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10457.430342 secs 2024-07-26T11:29:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10441.947281 secs 2024-07-26T11:29:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10457.430342 secs 2024-07-26T11:29:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:57 smithi043 ceph-mon[32384]: pgmap v6051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:57 smithi133 ceph-mon[37053]: pgmap v6051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:57 smithi063 ceph-mon[36747]: pgmap v6051: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:29:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:29:59 smithi043 ceph-mon[32384]: pgmap v6052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:29:59 smithi133 ceph-mon[37053]: pgmap v6052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:29:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:29:59 smithi063 ceph-mon[36747]: pgmap v6052: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:30:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:30:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:30:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:01 smithi043 ceph-mon[32384]: pgmap v6053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10446.947372 secs 2024-07-26T11:30:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10462.430423 secs 2024-07-26T11:30:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:01 smithi133 ceph-mon[37053]: pgmap v6053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10446.947372 secs 2024-07-26T11:30:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10462.430423 secs 2024-07-26T11:30:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:01 smithi063 ceph-mon[36747]: pgmap v6053: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10446.947372 secs 2024-07-26T11:30:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10462.430423 secs 2024-07-26T11:30:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:03 smithi133 ceph-mon[37053]: pgmap v6054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:03 smithi063 ceph-mon[36747]: pgmap v6054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:03 smithi043 ceph-mon[32384]: pgmap v6054: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:05 smithi043 ceph-mon[32384]: pgmap v6055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:05 smithi133 ceph-mon[37053]: pgmap v6055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:05 smithi063 ceph-mon[36747]: pgmap v6055: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10451.947517 secs 2024-07-26T11:30:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10467.430552 secs 2024-07-26T11:30:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10451.947517 secs 2024-07-26T11:30:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10467.430552 secs 2024-07-26T11:30:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10451.947517 secs 2024-07-26T11:30:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10467.430552 secs 2024-07-26T11:30:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:07 smithi133 ceph-mon[37053]: pgmap v6056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:07 smithi063 ceph-mon[36747]: pgmap v6056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:07 smithi043 ceph-mon[32384]: pgmap v6056: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:09 smithi043 ceph-mon[32384]: pgmap v6057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:09 smithi133 ceph-mon[37053]: pgmap v6057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:09 smithi063 ceph-mon[36747]: pgmap v6057: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:11 smithi133 ceph-mon[37053]: pgmap v6058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10456.947615 secs 2024-07-26T11:30:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10472.430680 secs 2024-07-26T11:30:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:11 smithi063 ceph-mon[36747]: pgmap v6058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:11.608 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10456.947615 secs 2024-07-26T11:30:11.608 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10472.430680 secs 2024-07-26T11:30:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:11 smithi043 ceph-mon[32384]: pgmap v6058: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10456.947615 secs 2024-07-26T11:30:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10472.430680 secs 2024-07-26T11:30:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:13 smithi063 ceph-mon[36747]: pgmap v6059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:13 smithi043 ceph-mon[32384]: pgmap v6059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:13 smithi133 ceph-mon[37053]: pgmap v6059: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:15 smithi063 ceph-mon[36747]: pgmap v6060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:15 smithi043 ceph-mon[32384]: pgmap v6060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:15 smithi133 ceph-mon[37053]: pgmap v6060: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10461.947740 secs 2024-07-26T11:30:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10477.430839 secs 2024-07-26T11:30:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10461.947740 secs 2024-07-26T11:30:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10477.430839 secs 2024-07-26T11:30:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10461.947740 secs 2024-07-26T11:30:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10477.430839 secs 2024-07-26T11:30:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:17 smithi063 ceph-mon[36747]: pgmap v6061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:17.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:17 smithi043 ceph-mon[32384]: pgmap v6061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:17 smithi133 ceph-mon[37053]: pgmap v6061: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:19 smithi063 ceph-mon[36747]: pgmap v6062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:30:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:19 smithi043 ceph-mon[32384]: pgmap v6062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:30:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:19 smithi133 ceph-mon[37053]: pgmap v6062: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:30:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:21 smithi063 ceph-mon[36747]: pgmap v6063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:30:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10466.947819 secs 2024-07-26T11:30:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10482.430940 secs 2024-07-26T11:30:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:21 smithi043 ceph-mon[32384]: pgmap v6063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:30:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10466.947819 secs 2024-07-26T11:30:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10482.430940 secs 2024-07-26T11:30:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:21 smithi133 ceph-mon[37053]: pgmap v6063: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:30:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10466.947819 secs 2024-07-26T11:30:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10482.430940 secs 2024-07-26T11:30:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:23 smithi063 ceph-mon[36747]: pgmap v6064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:30:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:23 smithi043 ceph-mon[32384]: pgmap v6064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:30:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:23 smithi133 ceph-mon[37053]: pgmap v6064: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:30:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:24 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:30:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:24 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:30:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:24 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:30:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:25 smithi043 ceph-mon[32384]: pgmap v6065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:30:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:25 smithi133 ceph-mon[37053]: pgmap v6065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:30:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:25 smithi063 ceph-mon[36747]: pgmap v6065: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:30:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10471.947962 secs 2024-07-26T11:30:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:30:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:30:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: pgmap v6066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: pgmap v6067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:30:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:30:26.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10487.431048 secs 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10471.947962 secs 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: pgmap v6066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: pgmap v6067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:30:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10487.431048 secs 2024-07-26T11:30:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10471.947962 secs 2024-07-26T11:30:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:30:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:30:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: pgmap v6066: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: pgmap v6067: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:30:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:30:26.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10487.431048 secs 2024-07-26T11:30:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:28 smithi043 ceph-mon[32384]: pgmap v6068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:30:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:28 smithi133 ceph-mon[37053]: pgmap v6068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:30:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:28 smithi063 ceph-mon[36747]: pgmap v6068: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:30:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:30 smithi043 ceph-mon[32384]: pgmap v6069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:30:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:30 smithi133 ceph-mon[37053]: pgmap v6069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:30:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:30 smithi063 ceph-mon[36747]: pgmap v6069: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:30:31.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10476.948113 secs 2024-07-26T11:30:31.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10492.431110 secs 2024-07-26T11:30:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10476.948113 secs 2024-07-26T11:30:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10492.431110 secs 2024-07-26T11:30:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10476.948113 secs 2024-07-26T11:30:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10492.431110 secs 2024-07-26T11:30:32.684 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:32 smithi133 ceph-mon[37053]: pgmap v6070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:30:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:32 smithi043 ceph-mon[32384]: pgmap v6070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:30:32.734 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:32 smithi063 ceph-mon[36747]: pgmap v6070: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:30:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:34 smithi043 ceph-mon[32384]: pgmap v6071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:30:34.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:34 smithi133 ceph-mon[37053]: pgmap v6071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:30:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:34 smithi063 ceph-mon[36747]: pgmap v6071: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:30:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10481.948204 secs 2024-07-26T11:30:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:36 smithi043 ceph-mon[32384]: pgmap v6072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:30:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10497.431237 secs 2024-07-26T11:30:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10481.948204 secs 2024-07-26T11:30:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:36 smithi133 ceph-mon[37053]: pgmap v6072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:30:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10497.431237 secs 2024-07-26T11:30:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10481.948204 secs 2024-07-26T11:30:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:36 smithi063 ceph-mon[36747]: pgmap v6072: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:30:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10497.431237 secs 2024-07-26T11:30:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:38 smithi043 ceph-mon[32384]: pgmap v6073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:38 smithi133 ceph-mon[37053]: pgmap v6073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:38 smithi063 ceph-mon[36747]: pgmap v6073: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:40 smithi043 ceph-mon[32384]: pgmap v6074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:40 smithi133 ceph-mon[37053]: pgmap v6074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:40 smithi063 ceph-mon[36747]: pgmap v6074: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10486.948303 secs 2024-07-26T11:30:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10502.431300 secs 2024-07-26T11:30:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10486.948303 secs 2024-07-26T11:30:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10502.431300 secs 2024-07-26T11:30:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10486.948303 secs 2024-07-26T11:30:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10502.431300 secs 2024-07-26T11:30:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:42 smithi043 ceph-mon[32384]: pgmap v6075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:42 smithi133 ceph-mon[37053]: pgmap v6075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:42 smithi063 ceph-mon[36747]: pgmap v6075: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:44 smithi043 ceph-mon[32384]: pgmap v6076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:44 smithi133 ceph-mon[37053]: pgmap v6076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:44 smithi063 ceph-mon[36747]: pgmap v6076: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10491.948411 secs 2024-07-26T11:30:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:46 smithi043 ceph-mon[32384]: pgmap v6077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10507.431386 secs 2024-07-26T11:30:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10491.948411 secs 2024-07-26T11:30:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:46 smithi133 ceph-mon[37053]: pgmap v6077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10507.431386 secs 2024-07-26T11:30:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10491.948411 secs 2024-07-26T11:30:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:46 smithi063 ceph-mon[36747]: pgmap v6077: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10507.431386 secs 2024-07-26T11:30:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:48 smithi043 ceph-mon[32384]: pgmap v6078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:48 smithi133 ceph-mon[37053]: pgmap v6078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:48 smithi063 ceph-mon[36747]: pgmap v6078: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:50 smithi043 ceph-mon[32384]: pgmap v6079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:50 smithi133 ceph-mon[37053]: pgmap v6079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:50 smithi063 ceph-mon[36747]: pgmap v6079: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:51.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10496.948492 secs 2024-07-26T11:30:51.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10512.431520 secs 2024-07-26T11:30:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10496.948492 secs 2024-07-26T11:30:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10512.431520 secs 2024-07-26T11:30:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10496.948492 secs 2024-07-26T11:30:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10512.431520 secs 2024-07-26T11:30:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:52 smithi133 ceph-mon[37053]: pgmap v6080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:52 smithi063 ceph-mon[36747]: pgmap v6080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:52 smithi043 ceph-mon[32384]: pgmap v6080: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:30:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:54 smithi133 ceph-mon[37053]: pgmap v6081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:54 smithi063 ceph-mon[36747]: pgmap v6081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:54 smithi043 ceph-mon[32384]: pgmap v6081: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10501.948576 secs 2024-07-26T11:30:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:56 smithi133 ceph-mon[37053]: pgmap v6082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10517.431637 secs 2024-07-26T11:30:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10501.948576 secs 2024-07-26T11:30:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:56 smithi063 ceph-mon[36747]: pgmap v6082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10517.431637 secs 2024-07-26T11:30:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10501.948576 secs 2024-07-26T11:30:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:56 smithi043 ceph-mon[32384]: pgmap v6082: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:30:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10517.431637 secs 2024-07-26T11:30:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:30:58 smithi133 ceph-mon[37053]: pgmap v6083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:30:58 smithi063 ceph-mon[36747]: pgmap v6083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:30:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:30:58 smithi043 ceph-mon[32384]: pgmap v6083: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:00 smithi133 ceph-mon[37053]: pgmap v6084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:00 smithi063 ceph-mon[36747]: pgmap v6084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:00 smithi043 ceph-mon[32384]: pgmap v6084: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10506.948659 secs 2024-07-26T11:31:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10522.431756 secs 2024-07-26T11:31:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10506.948659 secs 2024-07-26T11:31:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10522.431756 secs 2024-07-26T11:31:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10506.948659 secs 2024-07-26T11:31:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10522.431756 secs 2024-07-26T11:31:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:02 smithi063 ceph-mon[36747]: pgmap v6085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:02 smithi043 ceph-mon[32384]: pgmap v6085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:02 smithi133 ceph-mon[37053]: pgmap v6085: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:04 smithi063 ceph-mon[36747]: pgmap v6086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:04 smithi043 ceph-mon[32384]: pgmap v6086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:04 smithi133 ceph-mon[37053]: pgmap v6086: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10511.948797 secs 2024-07-26T11:31:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:06 smithi063 ceph-mon[36747]: pgmap v6087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10527.431850 secs 2024-07-26T11:31:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10511.948797 secs 2024-07-26T11:31:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:06 smithi043 ceph-mon[32384]: pgmap v6087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10527.431850 secs 2024-07-26T11:31:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10511.948797 secs 2024-07-26T11:31:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:06 smithi133 ceph-mon[37053]: pgmap v6087: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10527.431850 secs 2024-07-26T11:31:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:08 smithi063 ceph-mon[36747]: pgmap v6088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:08 smithi043 ceph-mon[32384]: pgmap v6088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:08 smithi133 ceph-mon[37053]: pgmap v6088: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:10 smithi063 ceph-mon[36747]: pgmap v6089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:10 smithi043 ceph-mon[32384]: pgmap v6089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:10 smithi133 ceph-mon[37053]: pgmap v6089: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10516.948915 secs 2024-07-26T11:31:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10532.431966 secs 2024-07-26T11:31:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10516.948915 secs 2024-07-26T11:31:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10532.431966 secs 2024-07-26T11:31:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10516.948915 secs 2024-07-26T11:31:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10532.431966 secs 2024-07-26T11:31:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:12 smithi063 ceph-mon[36747]: pgmap v6090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:12 smithi043 ceph-mon[32384]: pgmap v6090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:12 smithi133 ceph-mon[37053]: pgmap v6090: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:14 smithi043 ceph-mon[32384]: pgmap v6091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:14 smithi133 ceph-mon[37053]: pgmap v6091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:14 smithi063 ceph-mon[36747]: pgmap v6091: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10521.949040 secs 2024-07-26T11:31:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:16 smithi043 ceph-mon[32384]: pgmap v6092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10537.432121 secs 2024-07-26T11:31:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10521.949040 secs 2024-07-26T11:31:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:16 smithi133 ceph-mon[37053]: pgmap v6092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10537.432121 secs 2024-07-26T11:31:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10521.949040 secs 2024-07-26T11:31:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:16 smithi063 ceph-mon[36747]: pgmap v6092: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10537.432121 secs 2024-07-26T11:31:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:18 smithi043 ceph-mon[32384]: pgmap v6093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:18 smithi133 ceph-mon[37053]: pgmap v6093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:18 smithi063 ceph-mon[36747]: pgmap v6093: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:20 smithi043 ceph-mon[32384]: pgmap v6094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:20 smithi133 ceph-mon[37053]: pgmap v6094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:20 smithi063 ceph-mon[36747]: pgmap v6094: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10526.949143 secs 2024-07-26T11:31:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10542.432246 secs 2024-07-26T11:31:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10526.949143 secs 2024-07-26T11:31:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10542.432246 secs 2024-07-26T11:31:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10526.949143 secs 2024-07-26T11:31:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10542.432246 secs 2024-07-26T11:31:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:22 smithi043 ceph-mon[32384]: pgmap v6095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:22 smithi133 ceph-mon[37053]: pgmap v6095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:22 smithi063 ceph-mon[36747]: pgmap v6095: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:24 smithi043 ceph-mon[32384]: pgmap v6096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:24 smithi133 ceph-mon[37053]: pgmap v6096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:24 smithi063 ceph-mon[36747]: pgmap v6096: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:25 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:31:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:25 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:31:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:25 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:31:26.743 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10531.949226 secs 2024-07-26T11:31:26.743 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:26 smithi063 ceph-mon[36747]: pgmap v6097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:26.743 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10547.432323 secs 2024-07-26T11:31:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10531.949226 secs 2024-07-26T11:31:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:26 smithi043 ceph-mon[32384]: pgmap v6097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10547.432323 secs 2024-07-26T11:31:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10531.949226 secs 2024-07-26T11:31:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:26 smithi133 ceph-mon[37053]: pgmap v6097: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10547.432323 secs 2024-07-26T11:31:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:28 smithi043 ceph-mon[32384]: pgmap v6098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:28 smithi133 ceph-mon[37053]: pgmap v6098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:29.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:28 smithi063 ceph-mon[36747]: pgmap v6098: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:30 smithi043 ceph-mon[32384]: pgmap v6099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:30 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:30 smithi133 ceph-mon[37053]: pgmap v6099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:30 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:30 smithi063 ceph-mon[36747]: pgmap v6099: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:30 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10536.949289 secs 2024-07-26T11:31:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10552.432460 secs 2024-07-26T11:31:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10536.949289 secs 2024-07-26T11:31:31.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10552.432460 secs 2024-07-26T11:31:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10536.949289 secs 2024-07-26T11:31:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10552.432460 secs 2024-07-26T11:31:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: pgmap v6100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:31:32.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:32 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: pgmap v6100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:31:33.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:32 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: pgmap v6100: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:31:33.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:32 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:31:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:33 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:31:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:33 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:31:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:33 smithi043 ceph-mon[32384]: pgmap v6101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:31:33.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:33 smithi043 ceph-mon[32384]: pgmap v6102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:31:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:33 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:31:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:33 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:31:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:33 smithi133 ceph-mon[37053]: pgmap v6101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:31:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:33 smithi133 ceph-mon[37053]: pgmap v6102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:31:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:33 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:31:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:33 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:31:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:33 smithi063 ceph-mon[36747]: pgmap v6101: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:31:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:33 smithi063 ceph-mon[36747]: pgmap v6102: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:31:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:35 smithi043 ceph-mon[32384]: pgmap v6103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:35 smithi133 ceph-mon[37053]: pgmap v6103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:35 smithi063 ceph-mon[36747]: pgmap v6103: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10541.949353 secs 2024-07-26T11:31:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10557.432557 secs 2024-07-26T11:31:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10541.949353 secs 2024-07-26T11:31:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10557.432557 secs 2024-07-26T11:31:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10541.949353 secs 2024-07-26T11:31:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10557.432557 secs 2024-07-26T11:31:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:37 smithi043 ceph-mon[32384]: pgmap v6104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:37 smithi133 ceph-mon[37053]: pgmap v6104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:37 smithi063 ceph-mon[36747]: pgmap v6104: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:39 smithi063 ceph-mon[36747]: pgmap v6105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:39 smithi043 ceph-mon[32384]: pgmap v6105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:39 smithi133 ceph-mon[37053]: pgmap v6105: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-07-26T11:31:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:41 smithi043 ceph-mon[32384]: pgmap v6106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:31:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10546.949416 secs 2024-07-26T11:31:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10562.432656 secs 2024-07-26T11:31:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:41 smithi133 ceph-mon[37053]: pgmap v6106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:31:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10546.949416 secs 2024-07-26T11:31:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10562.432656 secs 2024-07-26T11:31:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:41 smithi063 ceph-mon[36747]: pgmap v6106: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:31:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10546.949416 secs 2024-07-26T11:31:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10562.432656 secs 2024-07-26T11:31:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:43 smithi043 ceph-mon[32384]: pgmap v6107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:31:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:43 smithi133 ceph-mon[37053]: pgmap v6107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:31:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:43 smithi063 ceph-mon[36747]: pgmap v6107: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:31:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:45 smithi043 ceph-mon[32384]: pgmap v6108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:45 smithi133 ceph-mon[37053]: pgmap v6108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:45 smithi063 ceph-mon[36747]: pgmap v6108: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10551.949516 secs 2024-07-26T11:31:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10567.432751 secs 2024-07-26T11:31:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10551.949516 secs 2024-07-26T11:31:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10567.432751 secs 2024-07-26T11:31:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10551.949516 secs 2024-07-26T11:31:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10567.432751 secs 2024-07-26T11:31:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:47 smithi043 ceph-mon[32384]: pgmap v6109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:47 smithi133 ceph-mon[37053]: pgmap v6109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:47 smithi063 ceph-mon[36747]: pgmap v6109: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:49 smithi043 ceph-mon[32384]: pgmap v6110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:49 smithi133 ceph-mon[37053]: pgmap v6110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:49 smithi063 ceph-mon[36747]: pgmap v6110: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10556.949575 secs 2024-07-26T11:31:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10556.949575 secs 2024-07-26T11:31:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10556.949575 secs 2024-07-26T11:31:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:51 smithi133 ceph-mon[37053]: pgmap v6111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10572.432894 secs 2024-07-26T11:31:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:51 smithi063 ceph-mon[36747]: pgmap v6111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10572.432894 secs 2024-07-26T11:31:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:51 smithi043 ceph-mon[32384]: pgmap v6111: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:31:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10572.432894 secs 2024-07-26T11:31:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:53 smithi043 ceph-mon[32384]: pgmap v6112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:53 smithi133 ceph-mon[37053]: pgmap v6112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:53 smithi063 ceph-mon[36747]: pgmap v6112: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:55 smithi133 ceph-mon[37053]: pgmap v6113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10561.949642 secs 2024-07-26T11:31:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:55 smithi063 ceph-mon[36747]: pgmap v6113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10561.949642 secs 2024-07-26T11:31:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:55 smithi043 ceph-mon[32384]: pgmap v6113: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:31:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10561.949642 secs 2024-07-26T11:31:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10577.433011 secs 2024-07-26T11:31:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10577.433011 secs 2024-07-26T11:31:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10577.433011 secs 2024-07-26T11:31:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:57 smithi133 ceph-mon[37053]: pgmap v6114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:57 smithi063 ceph-mon[36747]: pgmap v6114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:31:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:57 smithi043 ceph-mon[32384]: pgmap v6114: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:31:59 smithi133 ceph-mon[37053]: pgmap v6115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:31:59 smithi063 ceph-mon[36747]: pgmap v6115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:31:59 smithi043 ceph-mon[32384]: pgmap v6115: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10566.949737 secs 2024-07-26T11:32:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10566.949737 secs 2024-07-26T11:32:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10566.949737 secs 2024-07-26T11:32:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:01 smithi063 ceph-mon[36747]: pgmap v6116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10582.433127 secs 2024-07-26T11:32:02.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:01 smithi133 ceph-mon[37053]: pgmap v6116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:02.167 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10582.433127 secs 2024-07-26T11:32:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:01 smithi043 ceph-mon[32384]: pgmap v6116: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10582.433127 secs 2024-07-26T11:32:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:03 smithi063 ceph-mon[36747]: pgmap v6117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:03 smithi043 ceph-mon[32384]: pgmap v6117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:03 smithi133 ceph-mon[37053]: pgmap v6117: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:05 smithi063 ceph-mon[36747]: pgmap v6118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10571.949858 secs 2024-07-26T11:32:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:05 smithi043 ceph-mon[32384]: pgmap v6118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10571.949858 secs 2024-07-26T11:32:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:05 smithi133 ceph-mon[37053]: pgmap v6118: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10571.949858 secs 2024-07-26T11:32:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10587.433248 secs 2024-07-26T11:32:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10587.433248 secs 2024-07-26T11:32:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10587.433248 secs 2024-07-26T11:32:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:07 smithi063 ceph-mon[36747]: pgmap v6119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:07 smithi043 ceph-mon[32384]: pgmap v6119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:07 smithi133 ceph-mon[37053]: pgmap v6119: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:08 smithi063 ceph-mon[36747]: pgmap v6120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:08 smithi043 ceph-mon[32384]: pgmap v6120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:08 smithi133 ceph-mon[37053]: pgmap v6120: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:10 smithi043 ceph-mon[32384]: pgmap v6121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:11.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10576.949988 secs 2024-07-26T11:32:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:10 smithi133 ceph-mon[37053]: pgmap v6121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10576.949988 secs 2024-07-26T11:32:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:10 smithi063 ceph-mon[36747]: pgmap v6121: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10576.949988 secs 2024-07-26T11:32:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10592.433360 secs 2024-07-26T11:32:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10592.433360 secs 2024-07-26T11:32:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10592.433360 secs 2024-07-26T11:32:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:12 smithi133 ceph-mon[37053]: pgmap v6122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:12 smithi063 ceph-mon[36747]: pgmap v6122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:12 smithi043 ceph-mon[32384]: pgmap v6122: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:14 smithi133 ceph-mon[37053]: pgmap v6123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:14 smithi063 ceph-mon[36747]: pgmap v6123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:14 smithi043 ceph-mon[32384]: pgmap v6123: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10581.950126 secs 2024-07-26T11:32:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10581.950126 secs 2024-07-26T11:32:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10581.950126 secs 2024-07-26T11:32:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10597.433480 secs 2024-07-26T11:32:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:17 smithi133 ceph-mon[37053]: pgmap v6124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10597.433480 secs 2024-07-26T11:32:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:17 smithi063 ceph-mon[36747]: pgmap v6124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10597.433480 secs 2024-07-26T11:32:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:17 smithi043 ceph-mon[32384]: pgmap v6124: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:19 smithi063 ceph-mon[36747]: pgmap v6125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:32:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:19 smithi043 ceph-mon[32384]: pgmap v6125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:32:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:19 smithi133 ceph-mon[37053]: pgmap v6125: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:32:21.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:21 smithi043 ceph-mon[32384]: pgmap v6126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:32:21.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10586.950250 secs 2024-07-26T11:32:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:21 smithi063 ceph-mon[36747]: pgmap v6126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:32:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10586.950250 secs 2024-07-26T11:32:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:21 smithi133 ceph-mon[37053]: pgmap v6126: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:32:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10586.950250 secs 2024-07-26T11:32:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10602.433558 secs 2024-07-26T11:32:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10602.433558 secs 2024-07-26T11:32:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10602.433558 secs 2024-07-26T11:32:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:23 smithi063 ceph-mon[36747]: pgmap v6127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:23 smithi043 ceph-mon[32384]: pgmap v6127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:23 smithi133 ceph-mon[37053]: pgmap v6127: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:25 smithi043 ceph-mon[32384]: pgmap v6128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:32:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:25 smithi063 ceph-mon[36747]: pgmap v6128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:32:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:25 smithi133 ceph-mon[37053]: pgmap v6128: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:32:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10591.950371 secs 2024-07-26T11:32:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10591.950371 secs 2024-07-26T11:32:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10591.950371 secs 2024-07-26T11:32:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10607.433684 secs 2024-07-26T11:32:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:27 smithi063 ceph-mon[36747]: pgmap v6129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10607.433684 secs 2024-07-26T11:32:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:27 smithi043 ceph-mon[32384]: pgmap v6129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10607.433684 secs 2024-07-26T11:32:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:27 smithi133 ceph-mon[37053]: pgmap v6129: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:29 smithi063 ceph-mon[36747]: pgmap v6130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:29 smithi043 ceph-mon[32384]: pgmap v6130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:29 smithi133 ceph-mon[37053]: pgmap v6130: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:31 smithi043 ceph-mon[32384]: pgmap v6131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10596.950441 secs 2024-07-26T11:32:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:31 smithi133 ceph-mon[37053]: pgmap v6131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10596.950441 secs 2024-07-26T11:32:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:31 smithi063 ceph-mon[36747]: pgmap v6131: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10596.950441 secs 2024-07-26T11:32:32.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10612.433797 secs 2024-07-26T11:32:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10612.433797 secs 2024-07-26T11:32:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10612.433797 secs 2024-07-26T11:32:33.316 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: pgmap v6132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:33.316 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:32:33.316 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:32:33.317 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:33 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:32:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: pgmap v6132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:32:33.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:33 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: pgmap v6132: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:33.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:32:33.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:33 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:32:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:35 smithi043 ceph-mon[32384]: pgmap v6133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:35.503 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:35 smithi133 ceph-mon[37053]: pgmap v6133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:35 smithi063 ceph-mon[36747]: pgmap v6133: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10601.950537 secs 2024-07-26T11:32:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10617.433883 secs 2024-07-26T11:32:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:32:36.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:36 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10601.950537 secs 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10617.433883 secs 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:32:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:32:36.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:36 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10601.950537 secs 2024-07-26T11:32:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10617.433883 secs 2024-07-26T11:32:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:32:36.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:36 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:37 smithi043 ceph-mon[32384]: pgmap v6134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:37 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:37 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:37 smithi043 ceph-mon[32384]: pgmap v6135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:37 smithi043 ceph-mon[32384]: pgmap v6136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:37 smithi133 ceph-mon[37053]: pgmap v6134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:37 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:37 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:37 smithi133 ceph-mon[37053]: pgmap v6135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:37 smithi133 ceph-mon[37053]: pgmap v6136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:32:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:37 smithi063 ceph-mon[36747]: pgmap v6134: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:37 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:32:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:37 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:32:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:37 smithi063 ceph-mon[36747]: pgmap v6135: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:37 smithi063 ceph-mon[36747]: pgmap v6136: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:32:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:39 smithi043 ceph-mon[32384]: pgmap v6137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:32:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:39 smithi133 ceph-mon[37053]: pgmap v6137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:32:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:39 smithi063 ceph-mon[36747]: pgmap v6137: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-07-26T11:32:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:41 smithi043 ceph-mon[32384]: pgmap v6138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:32:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10606.950676 secs 2024-07-26T11:32:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10622.433987 secs 2024-07-26T11:32:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:41 smithi133 ceph-mon[37053]: pgmap v6138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:32:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10606.950676 secs 2024-07-26T11:32:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10622.433987 secs 2024-07-26T11:32:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:41 smithi063 ceph-mon[36747]: pgmap v6138: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:32:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10606.950676 secs 2024-07-26T11:32:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10622.433987 secs 2024-07-26T11:32:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:43 smithi043 ceph-mon[32384]: pgmap v6139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:32:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:43 smithi133 ceph-mon[37053]: pgmap v6139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:32:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:43 smithi063 ceph-mon[36747]: pgmap v6139: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:32:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:45 smithi043 ceph-mon[32384]: pgmap v6140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:32:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:45 smithi133 ceph-mon[37053]: pgmap v6140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:32:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:45 smithi063 ceph-mon[36747]: pgmap v6140: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-07-26T11:32:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10611.950816 secs 2024-07-26T11:32:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10627.434104 secs 2024-07-26T11:32:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10611.950816 secs 2024-07-26T11:32:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10627.434104 secs 2024-07-26T11:32:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10611.950816 secs 2024-07-26T11:32:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10627.434104 secs 2024-07-26T11:32:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:47 smithi043 ceph-mon[32384]: pgmap v6141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:47 smithi133 ceph-mon[37053]: pgmap v6141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:47 smithi063 ceph-mon[36747]: pgmap v6141: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:32:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:49 smithi043 ceph-mon[32384]: pgmap v6142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:49 smithi133 ceph-mon[37053]: pgmap v6142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:49 smithi063 ceph-mon[36747]: pgmap v6142: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:51 smithi043 ceph-mon[32384]: pgmap v6143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10616.950930 secs 2024-07-26T11:32:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10632.434218 secs 2024-07-26T11:32:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:51 smithi133 ceph-mon[37053]: pgmap v6143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10616.950930 secs 2024-07-26T11:32:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10632.434218 secs 2024-07-26T11:32:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:51 smithi063 ceph-mon[36747]: pgmap v6143: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:32:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10616.950930 secs 2024-07-26T11:32:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10632.434218 secs 2024-07-26T11:32:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:53 smithi043 ceph-mon[32384]: pgmap v6144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:53 smithi133 ceph-mon[37053]: pgmap v6144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:53 smithi063 ceph-mon[36747]: pgmap v6144: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:55 smithi043 ceph-mon[32384]: pgmap v6145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:55 smithi133 ceph-mon[37053]: pgmap v6145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:55 smithi063 ceph-mon[36747]: pgmap v6145: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10621.951050 secs 2024-07-26T11:32:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10637.434300 secs 2024-07-26T11:32:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10621.951050 secs 2024-07-26T11:32:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10637.434300 secs 2024-07-26T11:32:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10621.951050 secs 2024-07-26T11:32:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10637.434300 secs 2024-07-26T11:32:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:57 smithi043 ceph-mon[32384]: pgmap v6146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:57 smithi133 ceph-mon[37053]: pgmap v6146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:57 smithi063 ceph-mon[36747]: pgmap v6146: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:32:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:32:59 smithi043 ceph-mon[32384]: pgmap v6147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:32:59 smithi133 ceph-mon[37053]: pgmap v6147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:32:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:32:59 smithi063 ceph-mon[36747]: pgmap v6147: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:01 smithi043 ceph-mon[32384]: pgmap v6148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10626.951181 secs 2024-07-26T11:33:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10642.434367 secs 2024-07-26T11:33:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:01 smithi133 ceph-mon[37053]: pgmap v6148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10626.951181 secs 2024-07-26T11:33:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10642.434367 secs 2024-07-26T11:33:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:01 smithi063 ceph-mon[36747]: pgmap v6148: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10626.951181 secs 2024-07-26T11:33:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10642.434367 secs 2024-07-26T11:33:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:03 smithi043 ceph-mon[32384]: pgmap v6149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:03 smithi133 ceph-mon[37053]: pgmap v6149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:03 smithi063 ceph-mon[36747]: pgmap v6149: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:05 smithi043 ceph-mon[32384]: pgmap v6150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:05 smithi133 ceph-mon[37053]: pgmap v6150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:05 smithi063 ceph-mon[36747]: pgmap v6150: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10631.951300 secs 2024-07-26T11:33:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10647.434501 secs 2024-07-26T11:33:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10631.951300 secs 2024-07-26T11:33:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10647.434501 secs 2024-07-26T11:33:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10631.951300 secs 2024-07-26T11:33:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10647.434501 secs 2024-07-26T11:33:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:07 smithi043 ceph-mon[32384]: pgmap v6151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:07 smithi133 ceph-mon[37053]: pgmap v6151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:07 smithi063 ceph-mon[36747]: pgmap v6151: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:09 smithi043 ceph-mon[32384]: pgmap v6152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:09 smithi133 ceph-mon[37053]: pgmap v6152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:09 smithi063 ceph-mon[36747]: pgmap v6152: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:10 smithi043 ceph-mon[32384]: pgmap v6153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10636.951418 secs 2024-07-26T11:33:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:10 smithi133 ceph-mon[37053]: pgmap v6153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10636.951418 secs 2024-07-26T11:33:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:10 smithi063 ceph-mon[36747]: pgmap v6153: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10636.951418 secs 2024-07-26T11:33:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10652.434617 secs 2024-07-26T11:33:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10652.434617 secs 2024-07-26T11:33:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10652.434617 secs 2024-07-26T11:33:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:12 smithi043 ceph-mon[32384]: pgmap v6154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:12 smithi133 ceph-mon[37053]: pgmap v6154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:12 smithi063 ceph-mon[36747]: pgmap v6154: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:15 smithi063 ceph-mon[36747]: pgmap v6155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:15 smithi043 ceph-mon[32384]: pgmap v6155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:15 smithi133 ceph-mon[37053]: pgmap v6155: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10641.951551 secs 2024-07-26T11:33:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10641.951551 secs 2024-07-26T11:33:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10641.951551 secs 2024-07-26T11:33:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10657.434755 secs 2024-07-26T11:33:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:17 smithi063 ceph-mon[36747]: pgmap v6156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10657.434755 secs 2024-07-26T11:33:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:17 smithi043 ceph-mon[32384]: pgmap v6156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10657.434755 secs 2024-07-26T11:33:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:17 smithi133 ceph-mon[37053]: pgmap v6156: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:19 smithi043 ceph-mon[32384]: pgmap v6157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:19 smithi133 ceph-mon[37053]: pgmap v6157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:19 smithi063 ceph-mon[36747]: pgmap v6157: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:21 smithi043 ceph-mon[32384]: pgmap v6158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10646.951707 secs 2024-07-26T11:33:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:21 smithi133 ceph-mon[37053]: pgmap v6158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10646.951707 secs 2024-07-26T11:33:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:21 smithi063 ceph-mon[36747]: pgmap v6158: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10646.951707 secs 2024-07-26T11:33:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10662.434849 secs 2024-07-26T11:33:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10662.434849 secs 2024-07-26T11:33:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10662.434849 secs 2024-07-26T11:33:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:23 smithi043 ceph-mon[32384]: pgmap v6159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:23 smithi133 ceph-mon[37053]: pgmap v6159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:23 smithi063 ceph-mon[36747]: pgmap v6159: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:25 smithi043 ceph-mon[32384]: pgmap v6160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:25.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:25 smithi133 ceph-mon[37053]: pgmap v6160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:25 smithi063 ceph-mon[36747]: pgmap v6160: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10651.951832 secs 2024-07-26T11:33:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10667.434974 secs 2024-07-26T11:33:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10651.951832 secs 2024-07-26T11:33:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10667.434974 secs 2024-07-26T11:33:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10651.951832 secs 2024-07-26T11:33:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10667.434974 secs 2024-07-26T11:33:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:27 smithi043 ceph-mon[32384]: pgmap v6161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:27 smithi133 ceph-mon[37053]: pgmap v6161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:27 smithi063 ceph-mon[36747]: pgmap v6161: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:29 smithi043 ceph-mon[32384]: pgmap v6162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:29 smithi133 ceph-mon[37053]: pgmap v6162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:29.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:29 smithi063 ceph-mon[36747]: pgmap v6162: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:31 smithi043 ceph-mon[32384]: pgmap v6163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10656.951952 secs 2024-07-26T11:33:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10672.435095 secs 2024-07-26T11:33:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:31 smithi133 ceph-mon[37053]: pgmap v6163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10656.951952 secs 2024-07-26T11:33:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10672.435095 secs 2024-07-26T11:33:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:31 smithi063 ceph-mon[36747]: pgmap v6163: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10656.951952 secs 2024-07-26T11:33:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10672.435095 secs 2024-07-26T11:33:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:33 smithi043 ceph-mon[32384]: pgmap v6164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:33 smithi133 ceph-mon[37053]: pgmap v6164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:33 smithi063 ceph-mon[36747]: pgmap v6164: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:35 smithi043 ceph-mon[32384]: pgmap v6165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:35 smithi133 ceph-mon[37053]: pgmap v6165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:35 smithi063 ceph-mon[36747]: pgmap v6165: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10661.952036 secs 2024-07-26T11:33:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10677.435204 secs 2024-07-26T11:33:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10661.952036 secs 2024-07-26T11:33:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10677.435204 secs 2024-07-26T11:33:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10661.952036 secs 2024-07-26T11:33:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10677.435204 secs 2024-07-26T11:33:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:37 smithi043 ceph-mon[32384]: pgmap v6166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:33:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:37 smithi133 ceph-mon[37053]: pgmap v6166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:33:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:37 smithi063 ceph-mon[36747]: pgmap v6166: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:33:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:33:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:38 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:33:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:38 smithi043 ceph-mon[32384]: pgmap v6167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:33:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:38 smithi043 ceph-mon[32384]: pgmap v6168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:33:38.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:33:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:33:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:38 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:33:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:38 smithi133 ceph-mon[37053]: pgmap v6167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:33:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:38 smithi133 ceph-mon[37053]: pgmap v6168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:33:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:33:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:33:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:38 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:33:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:38 smithi063 ceph-mon[36747]: pgmap v6167: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:33:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:38 smithi063 ceph-mon[36747]: pgmap v6168: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:33:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:33:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:40 smithi043 ceph-mon[32384]: pgmap v6169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:33:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:40 smithi133 ceph-mon[37053]: pgmap v6169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:33:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:40 smithi063 ceph-mon[36747]: pgmap v6169: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:33:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10666.952171 secs 2024-07-26T11:33:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10682.435328 secs 2024-07-26T11:33:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10666.952171 secs 2024-07-26T11:33:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10682.435328 secs 2024-07-26T11:33:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10666.952171 secs 2024-07-26T11:33:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10682.435328 secs 2024-07-26T11:33:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:42 smithi043 ceph-mon[32384]: pgmap v6170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:33:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:42 smithi133 ceph-mon[37053]: pgmap v6170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:33:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:42 smithi063 ceph-mon[36747]: pgmap v6170: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:33:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:44 smithi043 ceph-mon[32384]: pgmap v6171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:33:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:44 smithi133 ceph-mon[37053]: pgmap v6171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:33:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:44 smithi063 ceph-mon[36747]: pgmap v6171: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:33:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:46 smithi043 ceph-mon[32384]: pgmap v6172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:33:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10671.952290 secs 2024-07-26T11:33:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10687.435447 secs 2024-07-26T11:33:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:46 smithi133 ceph-mon[37053]: pgmap v6172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:33:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10671.952290 secs 2024-07-26T11:33:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10687.435447 secs 2024-07-26T11:33:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:46 smithi063 ceph-mon[36747]: pgmap v6172: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:33:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10671.952290 secs 2024-07-26T11:33:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10687.435447 secs 2024-07-26T11:33:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:48 smithi043 ceph-mon[32384]: pgmap v6173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:33:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:48 smithi133 ceph-mon[37053]: pgmap v6173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:33:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:48 smithi063 ceph-mon[36747]: pgmap v6173: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:33:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:50 smithi043 ceph-mon[32384]: pgmap v6174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:50 smithi133 ceph-mon[37053]: pgmap v6174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:50 smithi063 ceph-mon[36747]: pgmap v6174: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:51.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10676.952409 secs 2024-07-26T11:33:51.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10692.435605 secs 2024-07-26T11:33:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10676.952409 secs 2024-07-26T11:33:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10692.435605 secs 2024-07-26T11:33:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10676.952409 secs 2024-07-26T11:33:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10692.435605 secs 2024-07-26T11:33:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:52 smithi043 ceph-mon[32384]: pgmap v6175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:52 smithi133 ceph-mon[37053]: pgmap v6175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:52 smithi063 ceph-mon[36747]: pgmap v6175: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:54 smithi043 ceph-mon[32384]: pgmap v6176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:54 smithi133 ceph-mon[37053]: pgmap v6176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:54 smithi063 ceph-mon[36747]: pgmap v6176: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:33:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:56 smithi043 ceph-mon[32384]: pgmap v6177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10681.952530 secs 2024-07-26T11:33:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10697.435727 secs 2024-07-26T11:33:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:56 smithi133 ceph-mon[37053]: pgmap v6177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10681.952530 secs 2024-07-26T11:33:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10697.435727 secs 2024-07-26T11:33:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:56 smithi063 ceph-mon[36747]: pgmap v6177: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:33:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10681.952530 secs 2024-07-26T11:33:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10697.435727 secs 2024-07-26T11:33:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:33:58 smithi043 ceph-mon[32384]: pgmap v6178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:33:58 smithi133 ceph-mon[37053]: pgmap v6178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:33:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:33:58 smithi063 ceph-mon[36747]: pgmap v6178: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:00 smithi043 ceph-mon[32384]: pgmap v6179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:00 smithi133 ceph-mon[37053]: pgmap v6179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:00 smithi063 ceph-mon[36747]: pgmap v6179: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:01.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10686.952627 secs 2024-07-26T11:34:01.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10702.435847 secs 2024-07-26T11:34:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10686.952627 secs 2024-07-26T11:34:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10702.435847 secs 2024-07-26T11:34:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10686.952627 secs 2024-07-26T11:34:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10702.435847 secs 2024-07-26T11:34:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:02 smithi043 ceph-mon[32384]: pgmap v6180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:02 smithi133 ceph-mon[37053]: pgmap v6180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:02 smithi063 ceph-mon[36747]: pgmap v6180: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:04 smithi043 ceph-mon[32384]: pgmap v6181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:04 smithi133 ceph-mon[37053]: pgmap v6181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:04 smithi063 ceph-mon[36747]: pgmap v6181: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:06 smithi043 ceph-mon[32384]: pgmap v6182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10691.952749 secs 2024-07-26T11:34:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10707.435986 secs 2024-07-26T11:34:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:06 smithi133 ceph-mon[37053]: pgmap v6182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10691.952749 secs 2024-07-26T11:34:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10707.435986 secs 2024-07-26T11:34:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:06 smithi063 ceph-mon[36747]: pgmap v6182: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10691.952749 secs 2024-07-26T11:34:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10707.435986 secs 2024-07-26T11:34:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:08 smithi043 ceph-mon[32384]: pgmap v6183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:08 smithi133 ceph-mon[37053]: pgmap v6183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:08 smithi063 ceph-mon[36747]: pgmap v6183: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:10 smithi043 ceph-mon[32384]: pgmap v6184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:10 smithi133 ceph-mon[37053]: pgmap v6184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:10 smithi063 ceph-mon[36747]: pgmap v6184: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10696.952864 secs 2024-07-26T11:34:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10712.436103 secs 2024-07-26T11:34:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10696.952864 secs 2024-07-26T11:34:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10712.436103 secs 2024-07-26T11:34:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10696.952864 secs 2024-07-26T11:34:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10712.436103 secs 2024-07-26T11:34:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:12 smithi043 ceph-mon[32384]: pgmap v6185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:12 smithi133 ceph-mon[37053]: pgmap v6185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:12 smithi063 ceph-mon[36747]: pgmap v6185: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:14 smithi043 ceph-mon[32384]: pgmap v6186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:14 smithi133 ceph-mon[37053]: pgmap v6186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:14 smithi063 ceph-mon[36747]: pgmap v6186: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:16 smithi043 ceph-mon[32384]: pgmap v6187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10701.952980 secs 2024-07-26T11:34:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10717.436273 secs 2024-07-26T11:34:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:16 smithi133 ceph-mon[37053]: pgmap v6187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10701.952980 secs 2024-07-26T11:34:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10717.436273 secs 2024-07-26T11:34:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:16 smithi063 ceph-mon[36747]: pgmap v6187: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10701.952980 secs 2024-07-26T11:34:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10717.436273 secs 2024-07-26T11:34:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:18 smithi043 ceph-mon[32384]: pgmap v6188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:18.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:18 smithi133 ceph-mon[37053]: pgmap v6188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:18 smithi063 ceph-mon[36747]: pgmap v6188: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:20 smithi043 ceph-mon[32384]: pgmap v6189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:20 smithi133 ceph-mon[37053]: pgmap v6189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:20 smithi063 ceph-mon[36747]: pgmap v6189: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10706.953112 secs 2024-07-26T11:34:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10722.436419 secs 2024-07-26T11:34:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10706.953112 secs 2024-07-26T11:34:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10722.436419 secs 2024-07-26T11:34:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10706.953112 secs 2024-07-26T11:34:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10722.436419 secs 2024-07-26T11:34:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:22 smithi133 ceph-mon[37053]: pgmap v6190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:22 smithi063 ceph-mon[36747]: pgmap v6190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:22 smithi043 ceph-mon[32384]: pgmap v6190: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:24 smithi133 ceph-mon[37053]: pgmap v6191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:24 smithi063 ceph-mon[36747]: pgmap v6191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:24 smithi043 ceph-mon[32384]: pgmap v6191: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:26 smithi133 ceph-mon[37053]: pgmap v6192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10711.953170 secs 2024-07-26T11:34:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10727.436547 secs 2024-07-26T11:34:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:26 smithi063 ceph-mon[36747]: pgmap v6192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10711.953170 secs 2024-07-26T11:34:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10727.436547 secs 2024-07-26T11:34:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:26 smithi043 ceph-mon[32384]: pgmap v6192: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10711.953170 secs 2024-07-26T11:34:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10727.436547 secs 2024-07-26T11:34:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:28 smithi133 ceph-mon[37053]: pgmap v6193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:28 smithi063 ceph-mon[36747]: pgmap v6193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:28 smithi043 ceph-mon[32384]: pgmap v6193: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:30 smithi133 ceph-mon[37053]: pgmap v6194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:30 smithi063 ceph-mon[36747]: pgmap v6194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:30 smithi043 ceph-mon[32384]: pgmap v6194: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10716.953293 secs 2024-07-26T11:34:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10732.436695 secs 2024-07-26T11:34:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10716.953293 secs 2024-07-26T11:34:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10732.436695 secs 2024-07-26T11:34:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10716.953293 secs 2024-07-26T11:34:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10732.436695 secs 2024-07-26T11:34:32.488 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-07-26T11:34:32.489 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-07-26T11:34:32.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-07-26T11:34:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:32 smithi063 ceph-mon[36747]: pgmap v6195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:32 smithi043 ceph-mon[32384]: pgmap v6195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:32 smithi133 ceph-mon[37053]: pgmap v6195: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:33.609 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/norstats/kernel_untar_tar.sh) on smithi043 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh' 2024-07-26T11:34:33.836 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=75599aa586a1464ca36cce64a1c30f4f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/norstats/kernel_untar_tar.sh) on smithi043 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh' 2024-07-26T11:34:33.838 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-07-26T11:34:33.857 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-07-26T11:34:33.857 INFO:teuthology.task.exec:Executing custom commands... 2024-07-26T11:34:33.858 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T11:34:33.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-07-26T11:34:33.958 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-07-26T11:34:34.053 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-07-26T11:34:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.315+0000 7f02af200640 1 -- 172.21.15.43:0/4072982252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 msgr2=0x7f02b00755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:34:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.315+0000 7f02af200640 1 --2- 172.21.15.43:0/4072982252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 0x7f02b00755f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009900 tx=0x7f02a002a400 comp rx=0 tx=0).stop 2024-07-26T11:34:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 -- 172.21.15.43:0/4072982252 shutdown_connections 2024-07-26T11:34:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 --2- 172.21.15.43:0/4072982252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b010f8a0 0x7f02b0111d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:34:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 --2- 172.21.15.43:0/4072982252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b0075b30 0x7f02b010f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:34:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 --2- 172.21.15.43:0/4072982252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 0x7f02b00755f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:34:34.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 -- 172.21.15.43:0/4072982252 >> 172.21.15.43:0/4072982252 conn(0x7f02b00fed50 msgr2=0x7f02b01011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:34:34.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 -- 172.21.15.43:0/4072982252 shutdown_connections 2024-07-26T11:34:34.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.316+0000 7f02af200640 1 -- 172.21.15.43:0/4072982252 wait complete. 2024-07-26T11:34:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 Processor -- start 2024-07-26T11:34:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 -- start start 2024-07-26T11:34:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 0x7f02b019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:34:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b0075b30 0x7f02b019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:34:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b010f8a0 0x7f02b01a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:34:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f02b0115600 con 0x7f02b00751e0 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f02b0115480 con 0x7f02b0075b30 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.317+0000 7f02af200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f02b0115780 con 0x7f02b010f8a0 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 0x7f02b019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 0x7f02b019c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45642/0 (socket says 172.21.15.43:45642) 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 -- 172.21.15.43:0/2804401857 learned_addr learned my addr 172.21.15.43:0/2804401857 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ae800640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b010f8a0 0x7f02b01a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ad400640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b0075b30 0x7f02b019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:34:34.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 -- 172.21.15.43:0/2804401857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b010f8a0 msgr2=0x7f02b01a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b010f8a0 0x7f02b01a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 -- 172.21.15.43:0/2804401857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b0075b30 msgr2=0x7f02b019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02b0075b30 0x7f02b019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.318+0000 7f02ade00640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b01a1f30 con 0x7f02b00751e0 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.319+0000 7f02ade00640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02b00751e0 0x7f02b019c000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f02a00314b0 tx=0x7f02a0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.319+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a003f070 con 0x7f02b00751e0 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.319+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02a0031bf0 con 0x7f02b00751e0 2024-07-26T11:34:34.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.319+0000 7f02af200640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b01a21c0 con 0x7f02b00751e0 2024-07-26T11:34:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.319+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0035030 con 0x7f02b00751e0 2024-07-26T11:34:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.319+0000 7f02af200640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b01a89b0 con 0x7f02b00751e0 2024-07-26T11:34:34.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.320+0000 7f02af200640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b00755f0 con 0x7f02b00751e0 2024-07-26T11:34:34.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.324+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f02a0042070 con 0x7f02b00751e0 2024-07-26T11:34:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.326+0000 7f02a6a00640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 0x7f02940b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:34:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.326+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f02a0106100 con 0x7f02b00751e0 2024-07-26T11:34:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.326+0000 7f02ad400640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 0x7f02940b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:34:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.327+0000 7f02ad400640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 0x7f02940b6250 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f02b0111c20 tx=0x7f029c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:34:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.328+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f02a00cb9f0 con 0x7f02b00751e0 2024-07-26T11:34:34.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:34:34.564+0000 7f02af200640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f02b0101f60 con 0x7f02940b3d40 2024-07-26T11:34:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:34 smithi063 ceph-mon[36747]: pgmap v6196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:34.818 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:34 smithi133 ceph-mon[37053]: pgmap v6196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:34 smithi043 ceph-mon[32384]: pgmap v6196: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:35 smithi063 ceph-mon[36747]: from='client.16329 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T11:34:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:35 smithi043 ceph-mon[32384]: from='client.16329 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T11:34:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:35 smithi133 ceph-mon[37053]: from='client.16329 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T11:34:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:36 smithi063 ceph-mon[36747]: pgmap v6197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10721.953426 secs 2024-07-26T11:34:36.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10737.436811 secs 2024-07-26T11:34:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:36 smithi043 ceph-mon[32384]: pgmap v6197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10721.953426 secs 2024-07-26T11:34:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10737.436811 secs 2024-07-26T11:34:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:36 smithi133 ceph-mon[37053]: pgmap v6197: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10721.953426 secs 2024-07-26T11:34:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10737.436811 secs 2024-07-26T11:34:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:37 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:34:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:37 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:34:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:37 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:34:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:38 smithi063 ceph-mon[36747]: pgmap v6198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:38.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:38.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:38 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:38 smithi043 ceph-mon[32384]: pgmap v6198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:38 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:38 smithi133 ceph-mon[37053]: pgmap v6198: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:38 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:34:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:34:39.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:39.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:34:39.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:34:39.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:34:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:34:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:34:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:40 smithi043 ceph-mon[32384]: pgmap v6199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:40 smithi043 ceph-mon[32384]: pgmap v6200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:40 smithi133 ceph-mon[37053]: pgmap v6199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:40 smithi133 ceph-mon[37053]: pgmap v6200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:40 smithi063 ceph-mon[36747]: pgmap v6199: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:40 smithi063 ceph-mon[36747]: pgmap v6200: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10726.953510 secs 2024-07-26T11:34:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10742.436967 secs 2024-07-26T11:34:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10726.953510 secs 2024-07-26T11:34:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10742.436967 secs 2024-07-26T11:34:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10726.953510 secs 2024-07-26T11:34:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10742.436967 secs 2024-07-26T11:34:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:42 smithi043 ceph-mon[32384]: pgmap v6201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:42 smithi133 ceph-mon[37053]: pgmap v6201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:42 smithi063 ceph-mon[36747]: pgmap v6201: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:44 smithi043 ceph-mon[32384]: pgmap v6202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:44 smithi133 ceph-mon[37053]: pgmap v6202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:44 smithi063 ceph-mon[36747]: pgmap v6202: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:46 smithi043 ceph-mon[32384]: pgmap v6203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10731.953628 secs 2024-07-26T11:34:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10747.437088 secs 2024-07-26T11:34:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:46 smithi133 ceph-mon[37053]: pgmap v6203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10731.953628 secs 2024-07-26T11:34:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10747.437088 secs 2024-07-26T11:34:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:46 smithi063 ceph-mon[36747]: pgmap v6203: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:34:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10731.953628 secs 2024-07-26T11:34:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10747.437088 secs 2024-07-26T11:34:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:48 smithi043 ceph-mon[32384]: pgmap v6204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:34:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:48 smithi133 ceph-mon[37053]: pgmap v6204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:34:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:48 smithi063 ceph-mon[36747]: pgmap v6204: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:34:50.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:50 smithi043 ceph-mon[32384]: pgmap v6205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:34:51.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:50 smithi133 ceph-mon[37053]: pgmap v6205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:34:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:50 smithi063 ceph-mon[36747]: pgmap v6205: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:34:51.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10736.953729 secs 2024-07-26T11:34:51.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10752.437216 secs 2024-07-26T11:34:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10736.953729 secs 2024-07-26T11:34:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10752.437216 secs 2024-07-26T11:34:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10736.953729 secs 2024-07-26T11:34:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10752.437216 secs 2024-07-26T11:34:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:52 smithi043 ceph-mon[32384]: pgmap v6206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:53.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:52 smithi133 ceph-mon[37053]: pgmap v6206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:52 smithi063 ceph-mon[36747]: pgmap v6206: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:54.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:54 smithi043 ceph-mon[32384]: pgmap v6207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:54 smithi133 ceph-mon[37053]: pgmap v6207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:54 smithi063 ceph-mon[36747]: pgmap v6207: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:34:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:56 smithi043 ceph-mon[32384]: pgmap v6208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10741.953851 secs 2024-07-26T11:34:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10757.437299 secs 2024-07-26T11:34:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:56 smithi133 ceph-mon[37053]: pgmap v6208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10741.953851 secs 2024-07-26T11:34:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10757.437299 secs 2024-07-26T11:34:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:56 smithi063 ceph-mon[36747]: pgmap v6208: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:34:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10741.953851 secs 2024-07-26T11:34:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10757.437299 secs 2024-07-26T11:34:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:34:58 smithi043 ceph-mon[32384]: pgmap v6209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:34:58 smithi133 ceph-mon[37053]: pgmap v6209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:34:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:34:58 smithi063 ceph-mon[36747]: pgmap v6209: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:00 smithi043 ceph-mon[32384]: pgmap v6210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:01.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:00 smithi133 ceph-mon[37053]: pgmap v6210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:00 smithi063 ceph-mon[36747]: pgmap v6210: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10746.953930 secs 2024-07-26T11:35:01.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10762.437416 secs 2024-07-26T11:35:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10746.953930 secs 2024-07-26T11:35:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10762.437416 secs 2024-07-26T11:35:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10746.953930 secs 2024-07-26T11:35:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10762.437416 secs 2024-07-26T11:35:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:02 smithi043 ceph-mon[32384]: pgmap v6211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:03.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:02 smithi133 ceph-mon[37053]: pgmap v6211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:02 smithi063 ceph-mon[36747]: pgmap v6211: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:04 smithi043 ceph-mon[32384]: pgmap v6212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:05.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:04 smithi133 ceph-mon[37053]: pgmap v6212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:04 smithi063 ceph-mon[36747]: pgmap v6212: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:06 smithi043 ceph-mon[32384]: pgmap v6213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10751.954048 secs 2024-07-26T11:35:06.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10767.437530 secs 2024-07-26T11:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:06 smithi133 ceph-mon[37053]: pgmap v6213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10751.954048 secs 2024-07-26T11:35:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10767.437530 secs 2024-07-26T11:35:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:06 smithi063 ceph-mon[36747]: pgmap v6213: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10751.954048 secs 2024-07-26T11:35:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10767.437530 secs 2024-07-26T11:35:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:08 smithi043 ceph-mon[32384]: pgmap v6214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:08 smithi133 ceph-mon[37053]: pgmap v6214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:08 smithi063 ceph-mon[36747]: pgmap v6214: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:10 smithi043 ceph-mon[32384]: pgmap v6215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:10 smithi133 ceph-mon[37053]: pgmap v6215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:10 smithi063 ceph-mon[36747]: pgmap v6215: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10756.954170 secs 2024-07-26T11:35:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10772.437595 secs 2024-07-26T11:35:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10756.954170 secs 2024-07-26T11:35:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10772.437595 secs 2024-07-26T11:35:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10756.954170 secs 2024-07-26T11:35:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10772.437595 secs 2024-07-26T11:35:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:12 smithi043 ceph-mon[32384]: pgmap v6216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:12 smithi133 ceph-mon[37053]: pgmap v6216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:12 smithi063 ceph-mon[36747]: pgmap v6216: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:14 smithi043 ceph-mon[32384]: pgmap v6217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:14 smithi133 ceph-mon[37053]: pgmap v6217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:14 smithi063 ceph-mon[36747]: pgmap v6217: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:16 smithi043 ceph-mon[32384]: pgmap v6218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10761.954291 secs 2024-07-26T11:35:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10777.437731 secs 2024-07-26T11:35:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:16 smithi133 ceph-mon[37053]: pgmap v6218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10761.954291 secs 2024-07-26T11:35:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10777.437731 secs 2024-07-26T11:35:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:16 smithi063 ceph-mon[36747]: pgmap v6218: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10761.954291 secs 2024-07-26T11:35:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10777.437731 secs 2024-07-26T11:35:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:18 smithi043 ceph-mon[32384]: pgmap v6219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:18 smithi133 ceph-mon[37053]: pgmap v6219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:18 smithi063 ceph-mon[36747]: pgmap v6219: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:20 smithi043 ceph-mon[32384]: pgmap v6220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10766.954414 secs 2024-07-26T11:35:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:20 smithi133 ceph-mon[37053]: pgmap v6220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10766.954414 secs 2024-07-26T11:35:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:20 smithi063 ceph-mon[36747]: pgmap v6220: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10766.954414 secs 2024-07-26T11:35:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10782.437900 secs 2024-07-26T11:35:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10782.437900 secs 2024-07-26T11:35:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10782.437900 secs 2024-07-26T11:35:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:22 smithi133 ceph-mon[37053]: pgmap v6221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:22 smithi063 ceph-mon[36747]: pgmap v6221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:22 smithi043 ceph-mon[32384]: pgmap v6221: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:24 smithi133 ceph-mon[37053]: pgmap v6222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:24 smithi063 ceph-mon[36747]: pgmap v6222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:24 smithi043 ceph-mon[32384]: pgmap v6222: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10771.954505 secs 2024-07-26T11:35:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10771.954505 secs 2024-07-26T11:35:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10771.954505 secs 2024-07-26T11:35:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:26 smithi063 ceph-mon[36747]: pgmap v6223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10787.438047 secs 2024-07-26T11:35:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:26 smithi043 ceph-mon[32384]: pgmap v6223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10787.438047 secs 2024-07-26T11:35:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:26 smithi133 ceph-mon[37053]: pgmap v6223: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10787.438047 secs 2024-07-26T11:35:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:28 smithi063 ceph-mon[36747]: pgmap v6224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:28 smithi043 ceph-mon[32384]: pgmap v6224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:28 smithi133 ceph-mon[37053]: pgmap v6224: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:30 smithi063 ceph-mon[36747]: pgmap v6225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10776.954669 secs 2024-07-26T11:35:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:30 smithi043 ceph-mon[32384]: pgmap v6225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10776.954669 secs 2024-07-26T11:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:30 smithi133 ceph-mon[37053]: pgmap v6225: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10776.954669 secs 2024-07-26T11:35:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10792.438144 secs 2024-07-26T11:35:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10792.438144 secs 2024-07-26T11:35:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10792.438144 secs 2024-07-26T11:35:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:32 smithi063 ceph-mon[36747]: pgmap v6226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:32 smithi043 ceph-mon[32384]: pgmap v6226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:32 smithi133 ceph-mon[37053]: pgmap v6226: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:34 smithi063 ceph-mon[36747]: pgmap v6227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:35.068 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:34 smithi133 ceph-mon[37053]: pgmap v6227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:34 smithi043 ceph-mon[32384]: pgmap v6227: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10781.954796 secs 2024-07-26T11:35:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10781.954796 secs 2024-07-26T11:35:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10781.954796 secs 2024-07-26T11:35:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:36 smithi043 ceph-mon[32384]: pgmap v6228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10797.438225 secs 2024-07-26T11:35:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:36 smithi133 ceph-mon[37053]: pgmap v6228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10797.438225 secs 2024-07-26T11:35:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:36 smithi063 ceph-mon[36747]: pgmap v6228: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10797.438225 secs 2024-07-26T11:35:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:38 smithi043 ceph-mon[32384]: pgmap v6229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:38 smithi133 ceph-mon[37053]: pgmap v6229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:38 smithi063 ceph-mon[36747]: pgmap v6229: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:40.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:39 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:35:40.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:39 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:39 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:35:40.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:39 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:39 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:35:40.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:39 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:40 smithi063 ceph-mon[36747]: pgmap v6230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:40 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10786.954913 secs 2024-07-26T11:35:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:40 smithi043 ceph-mon[32384]: pgmap v6230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:40 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10786.954913 secs 2024-07-26T11:35:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:40 smithi133 ceph-mon[37053]: pgmap v6230: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:40 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:41.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10786.954913 secs 2024-07-26T11:35:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10802.438353 secs 2024-07-26T11:35:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:41 smithi043 ceph-mon[32384]: pgmap v6231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:42.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:41 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10802.438353 secs 2024-07-26T11:35:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:41 smithi133 ceph-mon[37053]: pgmap v6231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:41 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10802.438353 secs 2024-07-26T11:35:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:41 smithi063 ceph-mon[36747]: pgmap v6231: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:41 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:43 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:43 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:43 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:44 smithi043 ceph-mon[32384]: pgmap v6232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:44 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:44 smithi133 ceph-mon[37053]: pgmap v6232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:44 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:44 smithi063 ceph-mon[36747]: pgmap v6232: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:44 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:35:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:35:46.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:45 smithi133 ceph-mon[37053]: pgmap v6233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:46.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:45 smithi133 ceph-mon[37053]: pgmap v6234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:46.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:45 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:35:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:35:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:45 smithi063 ceph-mon[36747]: pgmap v6233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:45 smithi063 ceph-mon[36747]: pgmap v6234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:46.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:45 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:35:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:35:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:45 smithi043 ceph-mon[32384]: pgmap v6233: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:35:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:45 smithi043 ceph-mon[32384]: pgmap v6234: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:46.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:45 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10791.955036 secs 2024-07-26T11:35:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10807.438475 secs 2024-07-26T11:35:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10791.955036 secs 2024-07-26T11:35:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10807.438475 secs 2024-07-26T11:35:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10791.955036 secs 2024-07-26T11:35:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10807.438475 secs 2024-07-26T11:35:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:47 smithi133 ceph-mon[37053]: pgmap v6235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:47 smithi063 ceph-mon[36747]: pgmap v6235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:48.219 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:47 smithi043 ceph-mon[32384]: pgmap v6235: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:48 smithi043 ceph-mon[32384]: pgmap v6236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:48 smithi133 ceph-mon[37053]: pgmap v6236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:48 smithi063 ceph-mon[36747]: pgmap v6236: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:51.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10796.955136 secs 2024-07-26T11:35:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10796.955136 secs 2024-07-26T11:35:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10796.955136 secs 2024-07-26T11:35:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10812.438557 secs 2024-07-26T11:35:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:51 smithi063 ceph-mon[36747]: pgmap v6237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10812.438557 secs 2024-07-26T11:35:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:51 smithi043 ceph-mon[32384]: pgmap v6237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10812.438557 secs 2024-07-26T11:35:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:51 smithi133 ceph-mon[37053]: pgmap v6237: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:52 smithi043 ceph-mon[32384]: pgmap v6238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:52 smithi133 ceph-mon[37053]: pgmap v6238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:52 smithi063 ceph-mon[36747]: pgmap v6238: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:54 smithi043 ceph-mon[32384]: pgmap v6239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:35:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:54 smithi133 ceph-mon[37053]: pgmap v6239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:35:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:54 smithi063 ceph-mon[36747]: pgmap v6239: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:35:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10801.955269 secs 2024-07-26T11:35:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10801.955269 secs 2024-07-26T11:35:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10801.955269 secs 2024-07-26T11:35:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10817.438688 secs 2024-07-26T11:35:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:56 smithi043 ceph-mon[32384]: pgmap v6240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10817.438688 secs 2024-07-26T11:35:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:56 smithi133 ceph-mon[37053]: pgmap v6240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10817.438688 secs 2024-07-26T11:35:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:56 smithi063 ceph-mon[36747]: pgmap v6240: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:35:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:35:58 smithi043 ceph-mon[32384]: pgmap v6241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:35:58 smithi133 ceph-mon[37053]: pgmap v6241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:35:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:35:58 smithi063 ceph-mon[36747]: pgmap v6241: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10806.955382 secs 2024-07-26T11:36:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10806.955382 secs 2024-07-26T11:36:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10806.955382 secs 2024-07-26T11:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10822.438792 secs 2024-07-26T11:36:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:01 smithi063 ceph-mon[36747]: pgmap v6242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10822.438792 secs 2024-07-26T11:36:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:01 smithi043 ceph-mon[32384]: pgmap v6242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10822.438792 secs 2024-07-26T11:36:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:01 smithi133 ceph-mon[37053]: pgmap v6242: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:02 smithi043 ceph-mon[32384]: pgmap v6243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:02 smithi133 ceph-mon[37053]: pgmap v6243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:02 smithi063 ceph-mon[36747]: pgmap v6243: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:04 smithi043 ceph-mon[32384]: pgmap v6244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:04 smithi133 ceph-mon[37053]: pgmap v6244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:04 smithi063 ceph-mon[36747]: pgmap v6244: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10811.955462 secs 2024-07-26T11:36:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10811.955462 secs 2024-07-26T11:36:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10811.955462 secs 2024-07-26T11:36:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10827.438918 secs 2024-07-26T11:36:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:06 smithi043 ceph-mon[32384]: pgmap v6245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10827.438918 secs 2024-07-26T11:36:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:06 smithi133 ceph-mon[37053]: pgmap v6245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10827.438918 secs 2024-07-26T11:36:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:06 smithi063 ceph-mon[36747]: pgmap v6245: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:08 smithi043 ceph-mon[32384]: pgmap v6246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:08 smithi133 ceph-mon[37053]: pgmap v6246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:08 smithi063 ceph-mon[36747]: pgmap v6246: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10816.955584 secs 2024-07-26T11:36:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10816.955584 secs 2024-07-26T11:36:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10816.955584 secs 2024-07-26T11:36:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10832.439042 secs 2024-07-26T11:36:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:11 smithi063 ceph-mon[36747]: pgmap v6247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10832.439042 secs 2024-07-26T11:36:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:11 smithi043 ceph-mon[32384]: pgmap v6247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10832.439042 secs 2024-07-26T11:36:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:11 smithi133 ceph-mon[37053]: pgmap v6247: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:12 smithi043 ceph-mon[32384]: pgmap v6248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:12 smithi133 ceph-mon[37053]: pgmap v6248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:12 smithi063 ceph-mon[36747]: pgmap v6248: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:14 smithi043 ceph-mon[32384]: pgmap v6249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:14 smithi133 ceph-mon[37053]: pgmap v6249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:14 smithi063 ceph-mon[36747]: pgmap v6249: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10821.955651 secs 2024-07-26T11:36:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10821.955651 secs 2024-07-26T11:36:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10821.955651 secs 2024-07-26T11:36:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10837.439198 secs 2024-07-26T11:36:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:16 smithi043 ceph-mon[32384]: pgmap v6250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10837.439198 secs 2024-07-26T11:36:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:16 smithi133 ceph-mon[37053]: pgmap v6250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10837.439198 secs 2024-07-26T11:36:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:16 smithi063 ceph-mon[36747]: pgmap v6250: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:18 smithi043 ceph-mon[32384]: pgmap v6251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:18 smithi133 ceph-mon[37053]: pgmap v6251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:18 smithi063 ceph-mon[36747]: pgmap v6251: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10826.955775 secs 2024-07-26T11:36:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10826.955775 secs 2024-07-26T11:36:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10826.955775 secs 2024-07-26T11:36:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10842.439320 secs 2024-07-26T11:36:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:21 smithi063 ceph-mon[36747]: pgmap v6252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10842.439320 secs 2024-07-26T11:36:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:21 smithi043 ceph-mon[32384]: pgmap v6252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10842.439320 secs 2024-07-26T11:36:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:21 smithi133 ceph-mon[37053]: pgmap v6252: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:22 smithi043 ceph-mon[32384]: pgmap v6253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:22 smithi133 ceph-mon[37053]: pgmap v6253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:22 smithi063 ceph-mon[36747]: pgmap v6253: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:24 smithi043 ceph-mon[32384]: pgmap v6254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:24 smithi133 ceph-mon[37053]: pgmap v6254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:24 smithi063 ceph-mon[36747]: pgmap v6254: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10831.955913 secs 2024-07-26T11:36:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10831.955913 secs 2024-07-26T11:36:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10831.955913 secs 2024-07-26T11:36:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10847.439438 secs 2024-07-26T11:36:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:26 smithi043 ceph-mon[32384]: pgmap v6255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10847.439438 secs 2024-07-26T11:36:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:26 smithi133 ceph-mon[37053]: pgmap v6255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10847.439438 secs 2024-07-26T11:36:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:26 smithi063 ceph-mon[36747]: pgmap v6255: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:28 smithi043 ceph-mon[32384]: pgmap v6256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:28 smithi133 ceph-mon[37053]: pgmap v6256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:28 smithi063 ceph-mon[36747]: pgmap v6256: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10836.956055 secs 2024-07-26T11:36:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10836.956055 secs 2024-07-26T11:36:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10836.956055 secs 2024-07-26T11:36:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10852.439562 secs 2024-07-26T11:36:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:31 smithi063 ceph-mon[36747]: pgmap v6257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10852.439562 secs 2024-07-26T11:36:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:31 smithi043 ceph-mon[32384]: pgmap v6257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10852.439562 secs 2024-07-26T11:36:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:31 smithi133 ceph-mon[37053]: pgmap v6257: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:32 smithi043 ceph-mon[32384]: pgmap v6258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:32 smithi133 ceph-mon[37053]: pgmap v6258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:32 smithi063 ceph-mon[36747]: pgmap v6258: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:34 smithi043 ceph-mon[32384]: pgmap v6259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:34 smithi133 ceph-mon[37053]: pgmap v6259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:34 smithi063 ceph-mon[36747]: pgmap v6259: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10841.956180 secs 2024-07-26T11:36:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10841.956180 secs 2024-07-26T11:36:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10841.956180 secs 2024-07-26T11:36:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10857.439678 secs 2024-07-26T11:36:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:36 smithi043 ceph-mon[32384]: pgmap v6260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10857.439678 secs 2024-07-26T11:36:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:36 smithi133 ceph-mon[37053]: pgmap v6260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10857.439678 secs 2024-07-26T11:36:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:36 smithi063 ceph-mon[36747]: pgmap v6260: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:38 smithi043 ceph-mon[32384]: pgmap v6261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:38 smithi133 ceph-mon[37053]: pgmap v6261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:38 smithi063 ceph-mon[36747]: pgmap v6261: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10846.956301 secs 2024-07-26T11:36:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10846.956301 secs 2024-07-26T11:36:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10846.956301 secs 2024-07-26T11:36:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10862.439807 secs 2024-07-26T11:36:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:41 smithi063 ceph-mon[36747]: pgmap v6262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10862.439807 secs 2024-07-26T11:36:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:41 smithi043 ceph-mon[32384]: pgmap v6262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10862.439807 secs 2024-07-26T11:36:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:41 smithi133 ceph-mon[37053]: pgmap v6262: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:36:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:42 smithi043 ceph-mon[32384]: pgmap v6263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:42 smithi133 ceph-mon[37053]: pgmap v6263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:42 smithi063 ceph-mon[36747]: pgmap v6263: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:44 smithi043 ceph-mon[32384]: pgmap v6264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:44 smithi133 ceph-mon[37053]: pgmap v6264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:44 smithi063 ceph-mon[36747]: pgmap v6264: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:45 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:36:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10851.956362 secs 2024-07-26T11:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:45 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:36:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10851.956362 secs 2024-07-26T11:36:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:45 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:36:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10851.956362 secs 2024-07-26T11:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10867.439922 secs 2024-07-26T11:36:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:36:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:46 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:36:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:46 smithi043 ceph-mon[32384]: pgmap v6265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:36:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:46 smithi043 ceph-mon[32384]: pgmap v6266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:36:47.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:46 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:36:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10867.439922 secs 2024-07-26T11:36:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:36:47.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:46 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:36:47.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:46 smithi133 ceph-mon[37053]: pgmap v6265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:36:47.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:46 smithi133 ceph-mon[37053]: pgmap v6266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:36:47.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:46 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10867.439922 secs 2024-07-26T11:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:46 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:36:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:46 smithi063 ceph-mon[36747]: pgmap v6265: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:36:47.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:46 smithi063 ceph-mon[36747]: pgmap v6266: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:36:47.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:46 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:36:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:49 smithi043 ceph-mon[32384]: pgmap v6267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:36:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:49 smithi133 ceph-mon[37053]: pgmap v6267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:36:49.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:49 smithi063 ceph-mon[36747]: pgmap v6267: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:36:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:51 smithi043 ceph-mon[32384]: pgmap v6268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:36:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10856.956469 secs 2024-07-26T11:36:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10872.440016 secs 2024-07-26T11:36:51.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:51 smithi133 ceph-mon[37053]: pgmap v6268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:36:51.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10856.956469 secs 2024-07-26T11:36:51.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10872.440016 secs 2024-07-26T11:36:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:51 smithi063 ceph-mon[36747]: pgmap v6268: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:36:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10856.956469 secs 2024-07-26T11:36:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10872.440016 secs 2024-07-26T11:36:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:53 smithi043 ceph-mon[32384]: pgmap v6269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:36:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:53 smithi133 ceph-mon[37053]: pgmap v6269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:36:53.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:53 smithi063 ceph-mon[36747]: pgmap v6269: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:36:55.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:55 smithi043 ceph-mon[32384]: pgmap v6270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:36:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:55 smithi133 ceph-mon[37053]: pgmap v6270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:36:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:55 smithi063 ceph-mon[36747]: pgmap v6270: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:36:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10861.956592 secs 2024-07-26T11:36:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10877.440108 secs 2024-07-26T11:36:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10861.956592 secs 2024-07-26T11:36:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10877.440108 secs 2024-07-26T11:36:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10861.956592 secs 2024-07-26T11:36:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10877.440108 secs 2024-07-26T11:36:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:57 smithi043 ceph-mon[32384]: pgmap v6271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:36:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:57 smithi133 ceph-mon[37053]: pgmap v6271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:36:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:57 smithi063 ceph-mon[36747]: pgmap v6271: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:36:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:36:59 smithi043 ceph-mon[32384]: pgmap v6272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:36:59 smithi133 ceph-mon[37053]: pgmap v6272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:36:59.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:36:59 smithi063 ceph-mon[36747]: pgmap v6272: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:01 smithi043 ceph-mon[32384]: pgmap v6273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10866.956739 secs 2024-07-26T11:37:01.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10882.440202 secs 2024-07-26T11:37:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:01 smithi133 ceph-mon[37053]: pgmap v6273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10866.956739 secs 2024-07-26T11:37:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10882.440202 secs 2024-07-26T11:37:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:01 smithi063 ceph-mon[36747]: pgmap v6273: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10866.956739 secs 2024-07-26T11:37:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10882.440202 secs 2024-07-26T11:37:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:03 smithi043 ceph-mon[32384]: pgmap v6274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:03 smithi133 ceph-mon[37053]: pgmap v6274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:03.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:03 smithi063 ceph-mon[36747]: pgmap v6274: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:05 smithi043 ceph-mon[32384]: pgmap v6275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:05 smithi133 ceph-mon[37053]: pgmap v6275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:05 smithi063 ceph-mon[36747]: pgmap v6275: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:06.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10871.956819 secs 2024-07-26T11:37:06.386 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10887.440321 secs 2024-07-26T11:37:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10871.956819 secs 2024-07-26T11:37:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10887.440321 secs 2024-07-26T11:37:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10871.956819 secs 2024-07-26T11:37:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10887.440321 secs 2024-07-26T11:37:07.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:07 smithi043 ceph-mon[32384]: pgmap v6276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:07 smithi133 ceph-mon[37053]: pgmap v6276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:07 smithi063 ceph-mon[36747]: pgmap v6276: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:09 smithi043 ceph-mon[32384]: pgmap v6277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:09 smithi133 ceph-mon[37053]: pgmap v6277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:09 smithi063 ceph-mon[36747]: pgmap v6277: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:11 smithi043 ceph-mon[32384]: pgmap v6278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10876.956960 secs 2024-07-26T11:37:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:11 smithi133 ceph-mon[37053]: pgmap v6278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10876.956960 secs 2024-07-26T11:37:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:11 smithi063 ceph-mon[36747]: pgmap v6278: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10876.956960 secs 2024-07-26T11:37:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10892.440436 secs 2024-07-26T11:37:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10892.440436 secs 2024-07-26T11:37:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10892.440436 secs 2024-07-26T11:37:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:13 smithi043 ceph-mon[32384]: pgmap v6279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:13.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:13 smithi133 ceph-mon[37053]: pgmap v6279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:13.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:13 smithi063 ceph-mon[36747]: pgmap v6279: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:15 smithi043 ceph-mon[32384]: pgmap v6280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:15 smithi133 ceph-mon[37053]: pgmap v6280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:15.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:15 smithi063 ceph-mon[36747]: pgmap v6280: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10881.957091 secs 2024-07-26T11:37:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10897.440560 secs 2024-07-26T11:37:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10881.957091 secs 2024-07-26T11:37:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10897.440560 secs 2024-07-26T11:37:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10881.957091 secs 2024-07-26T11:37:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10897.440560 secs 2024-07-26T11:37:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:17 smithi043 ceph-mon[32384]: pgmap v6281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:17 smithi133 ceph-mon[37053]: pgmap v6281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:17 smithi063 ceph-mon[36747]: pgmap v6281: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:19 smithi043 ceph-mon[32384]: pgmap v6282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:19 smithi133 ceph-mon[37053]: pgmap v6282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:19.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:19 smithi063 ceph-mon[36747]: pgmap v6282: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:21 smithi043 ceph-mon[32384]: pgmap v6283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10886.957213 secs 2024-07-26T11:37:21.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10902.440698 secs 2024-07-26T11:37:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:21 smithi133 ceph-mon[37053]: pgmap v6283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10886.957213 secs 2024-07-26T11:37:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10902.440698 secs 2024-07-26T11:37:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:21 smithi063 ceph-mon[36747]: pgmap v6283: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10886.957213 secs 2024-07-26T11:37:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10902.440698 secs 2024-07-26T11:37:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:23 smithi043 ceph-mon[32384]: pgmap v6284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:23 smithi133 ceph-mon[37053]: pgmap v6284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:23.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:23 smithi063 ceph-mon[36747]: pgmap v6284: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:25 smithi043 ceph-mon[32384]: pgmap v6285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:25 smithi133 ceph-mon[37053]: pgmap v6285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:25.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:25 smithi063 ceph-mon[36747]: pgmap v6285: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10891.957316 secs 2024-07-26T11:37:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10907.440838 secs 2024-07-26T11:37:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10891.957316 secs 2024-07-26T11:37:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10907.440838 secs 2024-07-26T11:37:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10891.957316 secs 2024-07-26T11:37:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10907.440838 secs 2024-07-26T11:37:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:27 smithi043 ceph-mon[32384]: pgmap v6286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:27 smithi133 ceph-mon[37053]: pgmap v6286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:27 smithi063 ceph-mon[36747]: pgmap v6286: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:29 smithi043 ceph-mon[32384]: pgmap v6287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:29 smithi133 ceph-mon[37053]: pgmap v6287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:29.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:29 smithi063 ceph-mon[36747]: pgmap v6287: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:31 smithi133 ceph-mon[37053]: pgmap v6288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10896.957439 secs 2024-07-26T11:37:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10912.440914 secs 2024-07-26T11:37:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:31 smithi063 ceph-mon[36747]: pgmap v6288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10896.957439 secs 2024-07-26T11:37:31.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10912.440914 secs 2024-07-26T11:37:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:31 smithi043 ceph-mon[32384]: pgmap v6288: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10896.957439 secs 2024-07-26T11:37:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10912.440914 secs 2024-07-26T11:37:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:33 smithi133 ceph-mon[37053]: pgmap v6289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:33.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:33 smithi063 ceph-mon[36747]: pgmap v6289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:33 smithi043 ceph-mon[32384]: pgmap v6289: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:34.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:37:34.349+0000 7f02a5600640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f02880034c0 con 0x7f02b00751e0 2024-07-26T11:37:34.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:37:34.350+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f02880034c0 con 0x7f02b00751e0 2024-07-26T11:37:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:35 smithi133 ceph-mon[37053]: pgmap v6290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:35.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:35 smithi063 ceph-mon[36747]: pgmap v6290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:35 smithi043 ceph-mon[32384]: pgmap v6290: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10901.957528 secs 2024-07-26T11:37:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10917.441034 secs 2024-07-26T11:37:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10901.957528 secs 2024-07-26T11:37:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10917.441034 secs 2024-07-26T11:37:36.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10901.957528 secs 2024-07-26T11:37:36.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10917.441034 secs 2024-07-26T11:37:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:37 smithi133 ceph-mon[37053]: pgmap v6291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:37 smithi063 ceph-mon[36747]: pgmap v6291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:37 smithi043 ceph-mon[32384]: pgmap v6291: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:39 smithi063 ceph-mon[36747]: pgmap v6292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:39.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:39 smithi043 ceph-mon[32384]: pgmap v6292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:39.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:39 smithi133 ceph-mon[37053]: pgmap v6292: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:41 smithi063 ceph-mon[36747]: pgmap v6293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10906.957611 secs 2024-07-26T11:37:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10922.441161 secs 2024-07-26T11:37:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:41 smithi043 ceph-mon[32384]: pgmap v6293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10906.957611 secs 2024-07-26T11:37:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10922.441161 secs 2024-07-26T11:37:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:41 smithi133 ceph-mon[37053]: pgmap v6293: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:37:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10906.957611 secs 2024-07-26T11:37:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10922.441161 secs 2024-07-26T11:37:43.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:43 smithi063 ceph-mon[36747]: pgmap v6294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:43.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:43 smithi043 ceph-mon[32384]: pgmap v6294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:43.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:43 smithi133 ceph-mon[37053]: pgmap v6294: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:45 smithi063 ceph-mon[36747]: pgmap v6295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:45 smithi043 ceph-mon[32384]: pgmap v6295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:45.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:45 smithi133 ceph-mon[37053]: pgmap v6295: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:37:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10911.957739 secs 2024-07-26T11:37:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10927.441279 secs 2024-07-26T11:37:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10911.957739 secs 2024-07-26T11:37:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10927.441279 secs 2024-07-26T11:37:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10911.957739 secs 2024-07-26T11:37:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10927.441279 secs 2024-07-26T11:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:47 smithi063 ceph-mon[36747]: pgmap v6296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:37:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:47 smithi043 ceph-mon[32384]: pgmap v6296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:47.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:37:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:47 smithi133 ceph-mon[37053]: pgmap v6296: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:37:47.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:37:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:37:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:48 smithi063 ceph-mon[36747]: pgmap v6297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:37:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:48 smithi063 ceph-mon[36747]: pgmap v6298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:37:48.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:37:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:37:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:37:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:48 smithi043 ceph-mon[32384]: pgmap v6297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:37:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:48 smithi043 ceph-mon[32384]: pgmap v6298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:37:48.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:48 smithi133 ceph-mon[37053]: pgmap v6297: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:48 smithi133 ceph-mon[37053]: pgmap v6298: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:37:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:37:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:50 smithi043 ceph-mon[32384]: pgmap v6299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:37:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:50 smithi133 ceph-mon[37053]: pgmap v6299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:37:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:50 smithi063 ceph-mon[36747]: pgmap v6299: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:37:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10916.957858 secs 2024-07-26T11:37:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10932.441407 secs 2024-07-26T11:37:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10916.957858 secs 2024-07-26T11:37:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10932.441407 secs 2024-07-26T11:37:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10916.957858 secs 2024-07-26T11:37:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10932.441407 secs 2024-07-26T11:37:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:52 smithi043 ceph-mon[32384]: pgmap v6300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:37:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:52 smithi133 ceph-mon[37053]: pgmap v6300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:37:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:52 smithi063 ceph-mon[36747]: pgmap v6300: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:37:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:54 smithi043 ceph-mon[32384]: pgmap v6301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:37:54.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:54 smithi133 ceph-mon[37053]: pgmap v6301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:37:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:54 smithi063 ceph-mon[36747]: pgmap v6301: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:37:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10921.958006 secs 2024-07-26T11:37:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:56 smithi043 ceph-mon[32384]: pgmap v6302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:37:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10937.441545 secs 2024-07-26T11:37:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10921.958006 secs 2024-07-26T11:37:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:56 smithi133 ceph-mon[37053]: pgmap v6302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:37:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10937.441545 secs 2024-07-26T11:37:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10921.958006 secs 2024-07-26T11:37:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:56 smithi063 ceph-mon[36747]: pgmap v6302: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:37:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10937.441545 secs 2024-07-26T11:37:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:37:58 smithi133 ceph-mon[37053]: pgmap v6303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:37:58.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:37:58 smithi063 ceph-mon[36747]: pgmap v6303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:37:58.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:37:58 smithi043 ceph-mon[32384]: pgmap v6303: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:38:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:00 smithi133 ceph-mon[37053]: pgmap v6304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:00.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:00 smithi063 ceph-mon[36747]: pgmap v6304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:00 smithi043 ceph-mon[32384]: pgmap v6304: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10926.958150 secs 2024-07-26T11:38:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10942.441664 secs 2024-07-26T11:38:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10926.958150 secs 2024-07-26T11:38:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10942.441664 secs 2024-07-26T11:38:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10926.958150 secs 2024-07-26T11:38:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10942.441664 secs 2024-07-26T11:38:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:02 smithi133 ceph-mon[37053]: pgmap v6305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:02 smithi063 ceph-mon[36747]: pgmap v6305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:02.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:02 smithi043 ceph-mon[32384]: pgmap v6305: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:04 smithi133 ceph-mon[37053]: pgmap v6306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:04.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:04 smithi063 ceph-mon[36747]: pgmap v6306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:04.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:04 smithi043 ceph-mon[32384]: pgmap v6306: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10931.958265 secs 2024-07-26T11:38:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:06 smithi133 ceph-mon[37053]: pgmap v6307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10947.441785 secs 2024-07-26T11:38:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10931.958265 secs 2024-07-26T11:38:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:06 smithi063 ceph-mon[36747]: pgmap v6307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10947.441785 secs 2024-07-26T11:38:06.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10931.958265 secs 2024-07-26T11:38:06.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:06 smithi043 ceph-mon[32384]: pgmap v6307: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:06.986 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10947.441785 secs 2024-07-26T11:38:08.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:08 smithi063 ceph-mon[36747]: pgmap v6308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:08 smithi043 ceph-mon[32384]: pgmap v6308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:08 smithi133 ceph-mon[37053]: pgmap v6308: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:10 smithi063 ceph-mon[36747]: pgmap v6309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:10 smithi043 ceph-mon[32384]: pgmap v6309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:10 smithi133 ceph-mon[37053]: pgmap v6309: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10936.958371 secs 2024-07-26T11:38:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10952.441882 secs 2024-07-26T11:38:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10936.958371 secs 2024-07-26T11:38:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10952.441882 secs 2024-07-26T11:38:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10936.958371 secs 2024-07-26T11:38:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10952.441882 secs 2024-07-26T11:38:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:12 smithi063 ceph-mon[36747]: pgmap v6310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:12 smithi043 ceph-mon[32384]: pgmap v6310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:12 smithi133 ceph-mon[37053]: pgmap v6310: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:14 smithi063 ceph-mon[36747]: pgmap v6311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:38:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:14 smithi043 ceph-mon[32384]: pgmap v6311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:38:15.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:14 smithi133 ceph-mon[37053]: pgmap v6311: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:38:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10941.958442 secs 2024-07-26T11:38:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:16 smithi063 ceph-mon[36747]: pgmap v6312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:38:16.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10957.441932 secs 2024-07-26T11:38:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10941.958442 secs 2024-07-26T11:38:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:16 smithi043 ceph-mon[32384]: pgmap v6312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:38:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10957.441932 secs 2024-07-26T11:38:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10941.958442 secs 2024-07-26T11:38:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:16 smithi133 ceph-mon[37053]: pgmap v6312: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:38:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10957.441932 secs 2024-07-26T11:38:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:18 smithi063 ceph-mon[36747]: pgmap v6313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:18 smithi043 ceph-mon[32384]: pgmap v6313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:18 smithi133 ceph-mon[37053]: pgmap v6313: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:20 smithi063 ceph-mon[36747]: pgmap v6314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:20 smithi043 ceph-mon[32384]: pgmap v6314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:21.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:20 smithi133 ceph-mon[37053]: pgmap v6314: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:21.885 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10946.958566 secs 2024-07-26T11:38:21.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10962.442072 secs 2024-07-26T11:38:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10946.958566 secs 2024-07-26T11:38:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10962.442072 secs 2024-07-26T11:38:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10946.958566 secs 2024-07-26T11:38:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10962.442072 secs 2024-07-26T11:38:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:22 smithi043 ceph-mon[32384]: pgmap v6315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:22 smithi133 ceph-mon[37053]: pgmap v6315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:22 smithi063 ceph-mon[36747]: pgmap v6315: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:24 smithi043 ceph-mon[32384]: pgmap v6316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:24 smithi133 ceph-mon[37053]: pgmap v6316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:24 smithi063 ceph-mon[36747]: pgmap v6316: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:38:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10951.958705 secs 2024-07-26T11:38:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:26 smithi043 ceph-mon[32384]: pgmap v6317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:38:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10967.442139 secs 2024-07-26T11:38:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10951.958705 secs 2024-07-26T11:38:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:26 smithi133 ceph-mon[37053]: pgmap v6317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:38:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10967.442139 secs 2024-07-26T11:38:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10951.958705 secs 2024-07-26T11:38:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:26 smithi063 ceph-mon[36747]: pgmap v6317: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:38:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10967.442139 secs 2024-07-26T11:38:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:28 smithi043 ceph-mon[32384]: pgmap v6318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:38:29.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:28 smithi133 ceph-mon[37053]: pgmap v6318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:38:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:28 smithi063 ceph-mon[36747]: pgmap v6318: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:38:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:30 smithi043 ceph-mon[32384]: pgmap v6319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:31.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:30 smithi133 ceph-mon[37053]: pgmap v6319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:30 smithi063 ceph-mon[36747]: pgmap v6319: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10956.958845 secs 2024-07-26T11:38:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10972.442224 secs 2024-07-26T11:38:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10956.958845 secs 2024-07-26T11:38:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10972.442224 secs 2024-07-26T11:38:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10956.958845 secs 2024-07-26T11:38:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10972.442224 secs 2024-07-26T11:38:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:32 smithi043 ceph-mon[32384]: pgmap v6320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:33.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:32 smithi133 ceph-mon[37053]: pgmap v6320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:33.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:32 smithi063 ceph-mon[36747]: pgmap v6320: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:34 smithi043 ceph-mon[32384]: pgmap v6321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:34 smithi133 ceph-mon[37053]: pgmap v6321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:34 smithi063 ceph-mon[36747]: pgmap v6321: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10961.958973 secs 2024-07-26T11:38:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:36 smithi043 ceph-mon[32384]: pgmap v6322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10977.442344 secs 2024-07-26T11:38:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10961.958973 secs 2024-07-26T11:38:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:36 smithi133 ceph-mon[37053]: pgmap v6322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10977.442344 secs 2024-07-26T11:38:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10961.958973 secs 2024-07-26T11:38:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:36 smithi063 ceph-mon[36747]: pgmap v6322: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10977.442344 secs 2024-07-26T11:38:38.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:38 smithi043 ceph-mon[32384]: pgmap v6323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:38 smithi133 ceph-mon[37053]: pgmap v6323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:38 smithi063 ceph-mon[36747]: pgmap v6323: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:40.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:40 smithi043 ceph-mon[32384]: pgmap v6324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:40 smithi133 ceph-mon[37053]: pgmap v6324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:40 smithi063 ceph-mon[36747]: pgmap v6324: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10966.959091 secs 2024-07-26T11:38:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10982.442433 secs 2024-07-26T11:38:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10966.959091 secs 2024-07-26T11:38:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10982.442433 secs 2024-07-26T11:38:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10966.959091 secs 2024-07-26T11:38:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10982.442433 secs 2024-07-26T11:38:42.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:42 smithi043 ceph-mon[32384]: pgmap v6325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:42 smithi133 ceph-mon[37053]: pgmap v6325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:42 smithi063 ceph-mon[36747]: pgmap v6325: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:38:44.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:44 smithi043 ceph-mon[32384]: pgmap v6326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:44 smithi133 ceph-mon[37053]: pgmap v6326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:44 smithi063 ceph-mon[36747]: pgmap v6326: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10971.959174 secs 2024-07-26T11:38:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:46 smithi043 ceph-mon[32384]: pgmap v6327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10987.442655 secs 2024-07-26T11:38:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10971.959174 secs 2024-07-26T11:38:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:46 smithi133 ceph-mon[37053]: pgmap v6327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10987.442655 secs 2024-07-26T11:38:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10971.959174 secs 2024-07-26T11:38:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:46 smithi063 ceph-mon[36747]: pgmap v6327: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:38:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10987.442655 secs 2024-07-26T11:38:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:47 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:38:48.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:47 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:38:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:47 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:38:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:48 smithi043 ceph-mon[32384]: pgmap v6328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:38:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:38:48.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:48 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:48 smithi133 ceph-mon[37053]: pgmap v6328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:38:49.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:48 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:48 smithi063 ceph-mon[36747]: pgmap v6328: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:38:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:48 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:38:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:49 smithi043 ceph-mon[32384]: pgmap v6329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:49 smithi043 ceph-mon[32384]: pgmap v6330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:49 smithi133 ceph-mon[37053]: pgmap v6329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:49 smithi133 ceph-mon[37053]: pgmap v6330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:49 smithi063 ceph-mon[36747]: pgmap v6329: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:49 smithi063 ceph-mon[36747]: pgmap v6330: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10976.959287 secs 2024-07-26T11:38:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:51 smithi043 ceph-mon[32384]: pgmap v6331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10992.442656 secs 2024-07-26T11:38:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10976.959287 secs 2024-07-26T11:38:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:51 smithi133 ceph-mon[37053]: pgmap v6331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10992.442656 secs 2024-07-26T11:38:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10976.959287 secs 2024-07-26T11:38:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:51 smithi063 ceph-mon[36747]: pgmap v6331: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10992.442656 secs 2024-07-26T11:38:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:53 smithi043 ceph-mon[32384]: pgmap v6332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:53 smithi133 ceph-mon[37053]: pgmap v6332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:53 smithi063 ceph-mon[36747]: pgmap v6332: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:55 smithi043 ceph-mon[32384]: pgmap v6333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:55 smithi133 ceph-mon[37053]: pgmap v6333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:55 smithi063 ceph-mon[36747]: pgmap v6333: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:38:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10981.959409 secs 2024-07-26T11:38:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 10997.442773 secs 2024-07-26T11:38:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10981.959409 secs 2024-07-26T11:38:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 10997.442773 secs 2024-07-26T11:38:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10981.959409 secs 2024-07-26T11:38:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 10997.442773 secs 2024-07-26T11:38:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:57 smithi043 ceph-mon[32384]: pgmap v6334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:38:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:57 smithi133 ceph-mon[37053]: pgmap v6334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:38:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:57 smithi063 ceph-mon[36747]: pgmap v6334: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:39:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:38:59 smithi133 ceph-mon[37053]: pgmap v6335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:39:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:38:59 smithi063 ceph-mon[36747]: pgmap v6335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:39:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:38:59 smithi043 ceph-mon[32384]: pgmap v6335: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:39:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10986.959528 secs 2024-07-26T11:39:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:01 smithi133 ceph-mon[37053]: pgmap v6336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11002.442914 secs 2024-07-26T11:39:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10986.959528 secs 2024-07-26T11:39:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:01 smithi063 ceph-mon[36747]: pgmap v6336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11002.442914 secs 2024-07-26T11:39:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10986.959528 secs 2024-07-26T11:39:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:01 smithi043 ceph-mon[32384]: pgmap v6336: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11002.442914 secs 2024-07-26T11:39:04.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:03 smithi133 ceph-mon[37053]: pgmap v6337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:03 smithi063 ceph-mon[36747]: pgmap v6337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:03 smithi043 ceph-mon[32384]: pgmap v6337: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:05 smithi133 ceph-mon[37053]: pgmap v6338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:05 smithi063 ceph-mon[36747]: pgmap v6338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:05 smithi043 ceph-mon[32384]: pgmap v6338: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10991.959610 secs 2024-07-26T11:39:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11007.442981 secs 2024-07-26T11:39:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10991.959610 secs 2024-07-26T11:39:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11007.442981 secs 2024-07-26T11:39:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10991.959610 secs 2024-07-26T11:39:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11007.442981 secs 2024-07-26T11:39:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:07 smithi133 ceph-mon[37053]: pgmap v6339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:07 smithi063 ceph-mon[36747]: pgmap v6339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:07 smithi043 ceph-mon[32384]: pgmap v6339: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:10.036 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:09 smithi043 ceph-mon[32384]: pgmap v6340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:10.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:09 smithi063 ceph-mon[36747]: pgmap v6340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:09 smithi133 ceph-mon[37053]: pgmap v6340: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 10996.959732 secs 2024-07-26T11:39:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 10996.959732 secs 2024-07-26T11:39:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 10996.959732 secs 2024-07-26T11:39:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:11 smithi063 ceph-mon[36747]: pgmap v6341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11012.443097 secs 2024-07-26T11:39:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:11 smithi043 ceph-mon[32384]: pgmap v6341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11012.443097 secs 2024-07-26T11:39:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:11 smithi133 ceph-mon[37053]: pgmap v6341: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11012.443097 secs 2024-07-26T11:39:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:13 smithi063 ceph-mon[36747]: pgmap v6342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:13 smithi043 ceph-mon[32384]: pgmap v6342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:13 smithi133 ceph-mon[37053]: pgmap v6342: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:15 smithi063 ceph-mon[36747]: pgmap v6343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11001.959850 secs 2024-07-26T11:39:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:15 smithi043 ceph-mon[32384]: pgmap v6343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11001.959850 secs 2024-07-26T11:39:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:15 smithi133 ceph-mon[37053]: pgmap v6343: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11001.959850 secs 2024-07-26T11:39:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11017.443200 secs 2024-07-26T11:39:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11017.443200 secs 2024-07-26T11:39:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11017.443200 secs 2024-07-26T11:39:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:17 smithi063 ceph-mon[36747]: pgmap v6344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:17 smithi043 ceph-mon[32384]: pgmap v6344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:18.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:17 smithi133 ceph-mon[37053]: pgmap v6344: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:19 smithi063 ceph-mon[36747]: pgmap v6345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:19 smithi043 ceph-mon[32384]: pgmap v6345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:19 smithi133 ceph-mon[37053]: pgmap v6345: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:21.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11006.959992 secs 2024-07-26T11:39:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11006.959992 secs 2024-07-26T11:39:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11006.959992 secs 2024-07-26T11:39:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:21 smithi043 ceph-mon[32384]: pgmap v6346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11022.443316 secs 2024-07-26T11:39:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:21 smithi133 ceph-mon[37053]: pgmap v6346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11022.443316 secs 2024-07-26T11:39:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:21 smithi063 ceph-mon[36747]: pgmap v6346: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11022.443316 secs 2024-07-26T11:39:24.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:23 smithi043 ceph-mon[32384]: pgmap v6347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:23 smithi133 ceph-mon[37053]: pgmap v6347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:23 smithi063 ceph-mon[36747]: pgmap v6347: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:25 smithi043 ceph-mon[32384]: pgmap v6348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11011.960136 secs 2024-07-26T11:39:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:25 smithi133 ceph-mon[37053]: pgmap v6348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11011.960136 secs 2024-07-26T11:39:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:25 smithi063 ceph-mon[36747]: pgmap v6348: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11011.960136 secs 2024-07-26T11:39:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11027.443428 secs 2024-07-26T11:39:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11027.443428 secs 2024-07-26T11:39:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11027.443428 secs 2024-07-26T11:39:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:27 smithi043 ceph-mon[32384]: pgmap v6349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:27 smithi133 ceph-mon[37053]: pgmap v6349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:27 smithi063 ceph-mon[36747]: pgmap v6349: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:30.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:29 smithi043 ceph-mon[32384]: pgmap v6350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:29 smithi133 ceph-mon[37053]: pgmap v6350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:29 smithi063 ceph-mon[36747]: pgmap v6350: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:31.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11016.960276 secs 2024-07-26T11:39:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11016.960276 secs 2024-07-26T11:39:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11016.960276 secs 2024-07-26T11:39:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:31 smithi043 ceph-mon[32384]: pgmap v6351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11032.443548 secs 2024-07-26T11:39:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:31 smithi133 ceph-mon[37053]: pgmap v6351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11032.443548 secs 2024-07-26T11:39:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:31 smithi063 ceph-mon[36747]: pgmap v6351: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11032.443548 secs 2024-07-26T11:39:34.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:33 smithi043 ceph-mon[32384]: pgmap v6352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:34.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:33 smithi133 ceph-mon[37053]: pgmap v6352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:33 smithi063 ceph-mon[36747]: pgmap v6352: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:35 smithi043 ceph-mon[32384]: pgmap v6353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11021.960376 secs 2024-07-26T11:39:36.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:35 smithi133 ceph-mon[37053]: pgmap v6353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11021.960376 secs 2024-07-26T11:39:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:35 smithi063 ceph-mon[36747]: pgmap v6353: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11021.960376 secs 2024-07-26T11:39:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11037.443660 secs 2024-07-26T11:39:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11037.443660 secs 2024-07-26T11:39:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11037.443660 secs 2024-07-26T11:39:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:37 smithi043 ceph-mon[32384]: pgmap v6354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:38.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:37 smithi133 ceph-mon[37053]: pgmap v6354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:37 smithi063 ceph-mon[36747]: pgmap v6354: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:38 smithi043 ceph-mon[32384]: pgmap v6355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:38 smithi133 ceph-mon[37053]: pgmap v6355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:38 smithi063 ceph-mon[36747]: pgmap v6355: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11026.960490 secs 2024-07-26T11:39:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:41 smithi133 ceph-mon[37053]: pgmap v6356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11042.443780 secs 2024-07-26T11:39:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11026.960490 secs 2024-07-26T11:39:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:41 smithi063 ceph-mon[36747]: pgmap v6356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11042.443780 secs 2024-07-26T11:39:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11026.960490 secs 2024-07-26T11:39:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:41 smithi043 ceph-mon[32384]: pgmap v6356: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11042.443780 secs 2024-07-26T11:39:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:43 smithi133 ceph-mon[37053]: pgmap v6357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:43 smithi063 ceph-mon[36747]: pgmap v6357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:43 smithi043 ceph-mon[32384]: pgmap v6357: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:45 smithi133 ceph-mon[37053]: pgmap v6358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:45 smithi063 ceph-mon[36747]: pgmap v6358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:45 smithi043 ceph-mon[32384]: pgmap v6358: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:39:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11031.960557 secs 2024-07-26T11:39:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11047.443896 secs 2024-07-26T11:39:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11031.960557 secs 2024-07-26T11:39:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11047.443896 secs 2024-07-26T11:39:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11031.960557 secs 2024-07-26T11:39:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11047.443896 secs 2024-07-26T11:39:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:47 smithi133 ceph-mon[37053]: pgmap v6359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:47 smithi063 ceph-mon[36747]: pgmap v6359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:47 smithi043 ceph-mon[32384]: pgmap v6359: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:39:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:49 smithi063 ceph-mon[36747]: pgmap v6360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:49 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:39:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:49 smithi043 ceph-mon[32384]: pgmap v6360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:49 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:49 smithi133 ceph-mon[37053]: pgmap v6360: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:39:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:49 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:39:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:39:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:39:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:50 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:39:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11036.960687 secs 2024-07-26T11:39:51.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:39:51.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:39:51.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:50 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:39:51.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11036.960687 secs 2024-07-26T11:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:50 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:39:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11036.960687 secs 2024-07-26T11:39:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:51 smithi063 ceph-mon[36747]: pgmap v6361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:39:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:51 smithi063 ceph-mon[36747]: pgmap v6362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:39:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11052.444023 secs 2024-07-26T11:39:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:51 smithi043 ceph-mon[32384]: pgmap v6361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:39:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:51 smithi043 ceph-mon[32384]: pgmap v6362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:39:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11052.444023 secs 2024-07-26T11:39:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:51 smithi133 ceph-mon[37053]: pgmap v6361: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:39:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:51 smithi133 ceph-mon[37053]: pgmap v6362: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:39:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11052.444023 secs 2024-07-26T11:39:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:53 smithi063 ceph-mon[36747]: pgmap v6363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:39:54.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:53 smithi043 ceph-mon[32384]: pgmap v6363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:39:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:53 smithi133 ceph-mon[37053]: pgmap v6363: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:39:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:55 smithi063 ceph-mon[36747]: pgmap v6364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:39:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11041.960796 secs 2024-07-26T11:39:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:55 smithi043 ceph-mon[32384]: pgmap v6364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:39:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11041.960796 secs 2024-07-26T11:39:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:55 smithi133 ceph-mon[37053]: pgmap v6364: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:39:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11041.960796 secs 2024-07-26T11:39:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11057.444139 secs 2024-07-26T11:39:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11057.444139 secs 2024-07-26T11:39:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11057.444139 secs 2024-07-26T11:39:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:57 smithi063 ceph-mon[36747]: pgmap v6365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:39:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:57 smithi043 ceph-mon[32384]: pgmap v6365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:39:58.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:57 smithi133 ceph-mon[37053]: pgmap v6365: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:40:00.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:39:59 smithi043 ceph-mon[32384]: pgmap v6366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:00.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:39:59 smithi133 ceph-mon[37053]: pgmap v6366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:39:59 smithi063 ceph-mon[36747]: pgmap v6366: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:01.219 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:40:01.220 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11046.960913 secs 2024-07-26T11:40:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:40:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11046.960913 secs 2024-07-26T11:40:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:40:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11046.960913 secs 2024-07-26T11:40:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:01 smithi043 ceph-mon[32384]: pgmap v6367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:40:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11062.444268 secs 2024-07-26T11:40:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:01 smithi133 ceph-mon[37053]: pgmap v6367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:40:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11062.444268 secs 2024-07-26T11:40:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:01 smithi063 ceph-mon[36747]: pgmap v6367: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:40:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11062.444268 secs 2024-07-26T11:40:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:03 smithi043 ceph-mon[32384]: pgmap v6368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:03 smithi133 ceph-mon[37053]: pgmap v6368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:03 smithi063 ceph-mon[36747]: pgmap v6368: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:05 smithi043 ceph-mon[32384]: pgmap v6369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11051.960998 secs 2024-07-26T11:40:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:05 smithi133 ceph-mon[37053]: pgmap v6369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11051.960998 secs 2024-07-26T11:40:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:05 smithi063 ceph-mon[36747]: pgmap v6369: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11051.960998 secs 2024-07-26T11:40:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11067.444387 secs 2024-07-26T11:40:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11067.444387 secs 2024-07-26T11:40:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11067.444387 secs 2024-07-26T11:40:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:07 smithi043 ceph-mon[32384]: pgmap v6370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:07 smithi133 ceph-mon[37053]: pgmap v6370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:07 smithi063 ceph-mon[36747]: pgmap v6370: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:09 smithi043 ceph-mon[32384]: pgmap v6371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:10.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:09 smithi133 ceph-mon[37053]: pgmap v6371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:09 smithi063 ceph-mon[36747]: pgmap v6371: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11056.961098 secs 2024-07-26T11:40:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11056.961098 secs 2024-07-26T11:40:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11056.961098 secs 2024-07-26T11:40:12.137 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:11 smithi043 ceph-mon[32384]: pgmap v6372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:12.137 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11072.444451 secs 2024-07-26T11:40:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:11 smithi133 ceph-mon[37053]: pgmap v6372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11072.444451 secs 2024-07-26T11:40:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:11 smithi063 ceph-mon[36747]: pgmap v6372: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11072.444451 secs 2024-07-26T11:40:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:13 smithi043 ceph-mon[32384]: pgmap v6373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:13 smithi133 ceph-mon[37053]: pgmap v6373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:13 smithi063 ceph-mon[36747]: pgmap v6373: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:15 smithi043 ceph-mon[32384]: pgmap v6374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11061.961215 secs 2024-07-26T11:40:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:15 smithi133 ceph-mon[37053]: pgmap v6374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11061.961215 secs 2024-07-26T11:40:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:15 smithi063 ceph-mon[36747]: pgmap v6374: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11061.961215 secs 2024-07-26T11:40:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11077.444568 secs 2024-07-26T11:40:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11077.444568 secs 2024-07-26T11:40:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11077.444568 secs 2024-07-26T11:40:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:17 smithi043 ceph-mon[32384]: pgmap v6375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:17 smithi133 ceph-mon[37053]: pgmap v6375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:17 smithi063 ceph-mon[36747]: pgmap v6375: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:18 smithi133 ceph-mon[37053]: pgmap v6376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:18 smithi063 ceph-mon[36747]: pgmap v6376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:20 smithi133 ceph-mon[37053]: pgmap v6377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11066.961321 secs 2024-07-26T11:40:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:20 smithi063 ceph-mon[36747]: pgmap v6377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11066.961321 secs 2024-07-26T11:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:18 smithi043 ceph-mon[32384]: pgmap v6376: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:20 smithi043 ceph-mon[32384]: pgmap v6377: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:21.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11066.961321 secs 2024-07-26T11:40:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11082.444690 secs 2024-07-26T11:40:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11082.444690 secs 2024-07-26T11:40:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11082.444690 secs 2024-07-26T11:40:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:23 smithi133 ceph-mon[37053]: pgmap v6378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:23.271 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:23 smithi043 ceph-mon[32384]: pgmap v6378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:23 smithi063 ceph-mon[36747]: pgmap v6378: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:25 smithi133 ceph-mon[37053]: pgmap v6379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:25 smithi063 ceph-mon[36747]: pgmap v6379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:25 smithi043 ceph-mon[32384]: pgmap v6379: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11071.961438 secs 2024-07-26T11:40:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11071.961438 secs 2024-07-26T11:40:26.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11071.961438 secs 2024-07-26T11:40:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11087.444808 secs 2024-07-26T11:40:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:27 smithi063 ceph-mon[36747]: pgmap v6380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11087.444808 secs 2024-07-26T11:40:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:27 smithi043 ceph-mon[32384]: pgmap v6380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11087.444808 secs 2024-07-26T11:40:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:27 smithi133 ceph-mon[37053]: pgmap v6380: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:29 smithi063 ceph-mon[36747]: pgmap v6381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:29 smithi043 ceph-mon[32384]: pgmap v6381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:29 smithi133 ceph-mon[37053]: pgmap v6381: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:31 smithi063 ceph-mon[36747]: pgmap v6382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11076.961558 secs 2024-07-26T11:40:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:31 smithi043 ceph-mon[32384]: pgmap v6382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11076.961558 secs 2024-07-26T11:40:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:31 smithi133 ceph-mon[37053]: pgmap v6382: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11076.961558 secs 2024-07-26T11:40:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11092.444925 secs 2024-07-26T11:40:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11092.444925 secs 2024-07-26T11:40:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11092.444925 secs 2024-07-26T11:40:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:33 smithi063 ceph-mon[36747]: pgmap v6383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:33 smithi043 ceph-mon[32384]: pgmap v6383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:33 smithi133 ceph-mon[37053]: pgmap v6383: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:40:34.381+0000 7f02a5600640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f0288005850 con 0x7f02b00751e0 2024-07-26T11:40:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:40:34.382+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f0288005850 con 0x7f02b00751e0 2024-07-26T11:40:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:35 smithi063 ceph-mon[36747]: pgmap v6384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:35 smithi043 ceph-mon[32384]: pgmap v6384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:35 smithi133 ceph-mon[37053]: pgmap v6384: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:36.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11081.961658 secs 2024-07-26T11:40:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11081.961658 secs 2024-07-26T11:40:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11081.961658 secs 2024-07-26T11:40:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11097.445041 secs 2024-07-26T11:40:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:37 smithi043 ceph-mon[32384]: pgmap v6385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11097.445041 secs 2024-07-26T11:40:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:37 smithi133 ceph-mon[37053]: pgmap v6385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11097.445041 secs 2024-07-26T11:40:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:37 smithi063 ceph-mon[36747]: pgmap v6385: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:39 smithi043 ceph-mon[32384]: pgmap v6386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:39 smithi133 ceph-mon[37053]: pgmap v6386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:39.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:39 smithi063 ceph-mon[36747]: pgmap v6386: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:41 smithi043 ceph-mon[32384]: pgmap v6387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11086.961779 secs 2024-07-26T11:40:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:41 smithi133 ceph-mon[37053]: pgmap v6387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11086.961779 secs 2024-07-26T11:40:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:41 smithi063 ceph-mon[36747]: pgmap v6387: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11086.961779 secs 2024-07-26T11:40:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11102.445126 secs 2024-07-26T11:40:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11102.445126 secs 2024-07-26T11:40:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11102.445126 secs 2024-07-26T11:40:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:43 smithi063 ceph-mon[36747]: pgmap v6388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:43.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:43 smithi043 ceph-mon[32384]: pgmap v6388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:43 smithi133 ceph-mon[37053]: pgmap v6388: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:45 smithi043 ceph-mon[32384]: pgmap v6389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:45 smithi133 ceph-mon[37053]: pgmap v6389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:45.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:45 smithi063 ceph-mon[36747]: pgmap v6389: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11091.961859 secs 2024-07-26T11:40:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11091.961859 secs 2024-07-26T11:40:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11091.961859 secs 2024-07-26T11:40:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11107.445265 secs 2024-07-26T11:40:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:47 smithi043 ceph-mon[32384]: pgmap v6390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11107.445265 secs 2024-07-26T11:40:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:47 smithi133 ceph-mon[37053]: pgmap v6390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11107.445265 secs 2024-07-26T11:40:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:47 smithi063 ceph-mon[36747]: pgmap v6390: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:40:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:49 smithi043 ceph-mon[32384]: pgmap v6391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:49 smithi133 ceph-mon[37053]: pgmap v6391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:49.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:49 smithi063 ceph-mon[36747]: pgmap v6391: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:40:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:51 smithi043 ceph-mon[32384]: pgmap v6392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:40:51.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11096.961953 secs 2024-07-26T11:40:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:51 smithi133 ceph-mon[37053]: pgmap v6392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:40:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11096.961953 secs 2024-07-26T11:40:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:51 smithi063 ceph-mon[36747]: pgmap v6392: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:40:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:40:51.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11096.961953 secs 2024-07-26T11:40:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11112.445411 secs 2024-07-26T11:40:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:40:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:40:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:52 smithi043 ceph-mon[32384]: pgmap v6393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:52 smithi043 ceph-mon[32384]: pgmap v6394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:40:52.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:40:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11112.445411 secs 2024-07-26T11:40:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:40:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:40:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:52 smithi133 ceph-mon[37053]: pgmap v6393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:52 smithi133 ceph-mon[37053]: pgmap v6394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:40:52.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:40:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11112.445411 secs 2024-07-26T11:40:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:40:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:40:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:52 smithi063 ceph-mon[36747]: pgmap v6393: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:52 smithi063 ceph-mon[36747]: pgmap v6394: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:40:52.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:40:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:54 smithi133 ceph-mon[37053]: pgmap v6395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:54 smithi063 ceph-mon[36747]: pgmap v6395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:54 smithi043 ceph-mon[32384]: pgmap v6395: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:40:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:56 smithi063 ceph-mon[36747]: pgmap v6396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:40:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11101.962095 secs 2024-07-26T11:40:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11117.445517 secs 2024-07-26T11:40:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:56 smithi043 ceph-mon[32384]: pgmap v6396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:40:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11101.962095 secs 2024-07-26T11:40:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11117.445517 secs 2024-07-26T11:40:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:56 smithi133 ceph-mon[37053]: pgmap v6396: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:40:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11101.962095 secs 2024-07-26T11:40:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11117.445517 secs 2024-07-26T11:40:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:40:58 smithi063 ceph-mon[36747]: pgmap v6397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:40:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:40:58 smithi043 ceph-mon[32384]: pgmap v6397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:40:58.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:40:58 smithi133 ceph-mon[37053]: pgmap v6397: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:41:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:00 smithi063 ceph-mon[36747]: pgmap v6398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:00 smithi043 ceph-mon[32384]: pgmap v6398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:00.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:00 smithi133 ceph-mon[37053]: pgmap v6398: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11106.962143 secs 2024-07-26T11:41:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11122.445623 secs 2024-07-26T11:41:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11106.962143 secs 2024-07-26T11:41:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11122.445623 secs 2024-07-26T11:41:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11106.962143 secs 2024-07-26T11:41:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11122.445623 secs 2024-07-26T11:41:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:02 smithi063 ceph-mon[36747]: pgmap v6399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:41:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:02 smithi043 ceph-mon[32384]: pgmap v6399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:41:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:02 smithi133 ceph-mon[37053]: pgmap v6399: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:41:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:04 smithi063 ceph-mon[36747]: pgmap v6400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:04 smithi043 ceph-mon[32384]: pgmap v6400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:04.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:04 smithi133 ceph-mon[37053]: pgmap v6400: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:06 smithi063 ceph-mon[36747]: pgmap v6401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11111.962208 secs 2024-07-26T11:41:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11127.445737 secs 2024-07-26T11:41:06.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:06 smithi133 ceph-mon[37053]: pgmap v6401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:06.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11111.962208 secs 2024-07-26T11:41:06.569 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11127.445737 secs 2024-07-26T11:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:06 smithi043 ceph-mon[32384]: pgmap v6401: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11111.962208 secs 2024-07-26T11:41:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11127.445737 secs 2024-07-26T11:41:08.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:08 smithi063 ceph-mon[36747]: pgmap v6402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:08.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:08 smithi043 ceph-mon[32384]: pgmap v6402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:08.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:08 smithi133 ceph-mon[37053]: pgmap v6402: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:10.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:10 smithi043 ceph-mon[32384]: pgmap v6403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:10.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:10 smithi133 ceph-mon[37053]: pgmap v6403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:10.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:10 smithi063 ceph-mon[36747]: pgmap v6403: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11116.962337 secs 2024-07-26T11:41:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11132.445841 secs 2024-07-26T11:41:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11116.962337 secs 2024-07-26T11:41:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11132.445841 secs 2024-07-26T11:41:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11116.962337 secs 2024-07-26T11:41:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11132.445841 secs 2024-07-26T11:41:12.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:12 smithi043 ceph-mon[32384]: pgmap v6404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:12.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:12 smithi133 ceph-mon[37053]: pgmap v6404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:12.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:12 smithi063 ceph-mon[36747]: pgmap v6404: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:14.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:14 smithi043 ceph-mon[32384]: pgmap v6405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:14.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:14 smithi133 ceph-mon[37053]: pgmap v6405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:14.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:14 smithi063 ceph-mon[36747]: pgmap v6405: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:16 smithi043 ceph-mon[32384]: pgmap v6406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11121.962382 secs 2024-07-26T11:41:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11137.445964 secs 2024-07-26T11:41:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:16 smithi133 ceph-mon[37053]: pgmap v6406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11121.962382 secs 2024-07-26T11:41:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11137.445964 secs 2024-07-26T11:41:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:16 smithi063 ceph-mon[36747]: pgmap v6406: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11121.962382 secs 2024-07-26T11:41:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11137.445964 secs 2024-07-26T11:41:18.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:18 smithi043 ceph-mon[32384]: pgmap v6407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:18.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:18 smithi133 ceph-mon[37053]: pgmap v6407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:18.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:18 smithi063 ceph-mon[36747]: pgmap v6407: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:20.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:20 smithi043 ceph-mon[32384]: pgmap v6408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:20.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:20 smithi133 ceph-mon[37053]: pgmap v6408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:20.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:20 smithi063 ceph-mon[36747]: pgmap v6408: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11126.962487 secs 2024-07-26T11:41:21.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11142.446057 secs 2024-07-26T11:41:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11126.962487 secs 2024-07-26T11:41:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11142.446057 secs 2024-07-26T11:41:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11126.962487 secs 2024-07-26T11:41:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11142.446057 secs 2024-07-26T11:41:22.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:22 smithi043 ceph-mon[32384]: pgmap v6409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:22.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:22 smithi133 ceph-mon[37053]: pgmap v6409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:22.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:22 smithi063 ceph-mon[36747]: pgmap v6409: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:24.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:24 smithi043 ceph-mon[32384]: pgmap v6410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:24.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:24 smithi133 ceph-mon[37053]: pgmap v6410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:24.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:24 smithi063 ceph-mon[36747]: pgmap v6410: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:26 smithi043 ceph-mon[32384]: pgmap v6411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11131.962613 secs 2024-07-26T11:41:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11147.446208 secs 2024-07-26T11:41:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:26 smithi133 ceph-mon[37053]: pgmap v6411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11131.962613 secs 2024-07-26T11:41:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11147.446208 secs 2024-07-26T11:41:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:26 smithi063 ceph-mon[36747]: pgmap v6411: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11131.962613 secs 2024-07-26T11:41:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11147.446208 secs 2024-07-26T11:41:28.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:28 smithi043 ceph-mon[32384]: pgmap v6412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:28.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:28 smithi133 ceph-mon[37053]: pgmap v6412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:28.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:28 smithi063 ceph-mon[36747]: pgmap v6412: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:30.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:30 smithi043 ceph-mon[32384]: pgmap v6413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:30.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:30 smithi133 ceph-mon[37053]: pgmap v6413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:30.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:30 smithi063 ceph-mon[36747]: pgmap v6413: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:31.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11136.962732 secs 2024-07-26T11:41:31.720 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11152.446289 secs 2024-07-26T11:41:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11136.962732 secs 2024-07-26T11:41:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11152.446289 secs 2024-07-26T11:41:31.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11136.962732 secs 2024-07-26T11:41:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11152.446289 secs 2024-07-26T11:41:32.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:32 smithi043 ceph-mon[32384]: pgmap v6414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:32.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:32 smithi133 ceph-mon[37053]: pgmap v6414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:32.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:32 smithi063 ceph-mon[36747]: pgmap v6414: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:34.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:34 smithi043 ceph-mon[32384]: pgmap v6415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:34.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:34 smithi133 ceph-mon[37053]: pgmap v6415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:34.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:34 smithi063 ceph-mon[36747]: pgmap v6415: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:36 smithi043 ceph-mon[32384]: pgmap v6416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11141.962830 secs 2024-07-26T11:41:36.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11157.446405 secs 2024-07-26T11:41:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:36 smithi133 ceph-mon[37053]: pgmap v6416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11141.962830 secs 2024-07-26T11:41:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11157.446405 secs 2024-07-26T11:41:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:36 smithi063 ceph-mon[36747]: pgmap v6416: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11141.962830 secs 2024-07-26T11:41:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11157.446405 secs 2024-07-26T11:41:38.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:38 smithi043 ceph-mon[32384]: pgmap v6417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:38.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:38 smithi133 ceph-mon[37053]: pgmap v6417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:38.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:38 smithi063 ceph-mon[36747]: pgmap v6417: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:40.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:40 smithi043 ceph-mon[32384]: pgmap v6418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:40.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:40 smithi133 ceph-mon[37053]: pgmap v6418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:40.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:40 smithi063 ceph-mon[36747]: pgmap v6418: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11146.962951 secs 2024-07-26T11:41:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11162.446544 secs 2024-07-26T11:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11146.962951 secs 2024-07-26T11:41:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11162.446544 secs 2024-07-26T11:41:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11146.962951 secs 2024-07-26T11:41:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11162.446544 secs 2024-07-26T11:41:42.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:42 smithi043 ceph-mon[32384]: pgmap v6419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:42.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:42 smithi133 ceph-mon[37053]: pgmap v6419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:42.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:42 smithi063 ceph-mon[36747]: pgmap v6419: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:44.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:44 smithi043 ceph-mon[32384]: pgmap v6420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:44.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:44 smithi133 ceph-mon[37053]: pgmap v6420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:44.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:44 smithi063 ceph-mon[36747]: pgmap v6420: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:46 smithi043 ceph-mon[32384]: pgmap v6421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11151.963071 secs 2024-07-26T11:41:46.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11167.446661 secs 2024-07-26T11:41:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:46 smithi133 ceph-mon[37053]: pgmap v6421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11151.963071 secs 2024-07-26T11:41:46.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11167.446661 secs 2024-07-26T11:41:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:46 smithi063 ceph-mon[36747]: pgmap v6421: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:41:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11151.963071 secs 2024-07-26T11:41:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11167.446661 secs 2024-07-26T11:41:48.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:48 smithi043 ceph-mon[32384]: pgmap v6422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:48.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:48 smithi133 ceph-mon[37053]: pgmap v6422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:48.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:48 smithi063 ceph-mon[36747]: pgmap v6422: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:50.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:50 smithi043 ceph-mon[32384]: pgmap v6423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:50.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:50 smithi133 ceph-mon[37053]: pgmap v6423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:50.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:50 smithi063 ceph-mon[36747]: pgmap v6423: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:41:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11156.963192 secs 2024-07-26T11:41:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11172.446786 secs 2024-07-26T11:41:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:51 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:41:51.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11156.963192 secs 2024-07-26T11:41:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11172.446786 secs 2024-07-26T11:41:51.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:51 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:41:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11156.963192 secs 2024-07-26T11:41:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11172.446786 secs 2024-07-26T11:41:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:51 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:41:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: pgmap v6424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:41:52.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:41:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: pgmap v6424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:41:52.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:41:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: pgmap v6424: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:41:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:41:52.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:41:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:53 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:41:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:53 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:41:53.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:53 smithi133 ceph-mon[37053]: pgmap v6425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:53.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:53 smithi133 ceph-mon[37053]: pgmap v6426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:53.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:41:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:53 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:41:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:53 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:41:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:53 smithi063 ceph-mon[36747]: pgmap v6425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:53 smithi063 ceph-mon[36747]: pgmap v6426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:41:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:53 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:41:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:53 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:41:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:53 smithi043 ceph-mon[32384]: pgmap v6425: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:53 smithi043 ceph-mon[32384]: pgmap v6426: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:41:55.767 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:55 smithi133 ceph-mon[37053]: pgmap v6427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:55 smithi063 ceph-mon[36747]: pgmap v6427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:55 smithi043 ceph-mon[32384]: pgmap v6427: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11161.963310 secs 2024-07-26T11:41:56.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11177.446904 secs 2024-07-26T11:41:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11161.963310 secs 2024-07-26T11:41:56.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11177.446904 secs 2024-07-26T11:41:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11161.963310 secs 2024-07-26T11:41:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11177.446904 secs 2024-07-26T11:41:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:57 smithi133 ceph-mon[37053]: pgmap v6428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:57.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:57 smithi063 ceph-mon[36747]: pgmap v6428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:57 smithi043 ceph-mon[32384]: pgmap v6428: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:59.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:41:59 smithi063 ceph-mon[36747]: pgmap v6429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:41:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:41:59 smithi043 ceph-mon[32384]: pgmap v6429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:41:59 smithi133 ceph-mon[37053]: pgmap v6429: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11166.963401 secs 2024-07-26T11:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:01 smithi063 ceph-mon[36747]: pgmap v6430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:01.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11182.447022 secs 2024-07-26T11:42:01.979 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11166.963401 secs 2024-07-26T11:42:01.979 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:01 smithi043 ceph-mon[32384]: pgmap v6430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:01.979 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11182.447022 secs 2024-07-26T11:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11166.963401 secs 2024-07-26T11:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:01 smithi133 ceph-mon[37053]: pgmap v6430: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11182.447022 secs 2024-07-26T11:42:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:03 smithi063 ceph-mon[36747]: pgmap v6431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:42:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:03 smithi043 ceph-mon[32384]: pgmap v6431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:42:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:03 smithi133 ceph-mon[37053]: pgmap v6431: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:42:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:05 smithi063 ceph-mon[36747]: pgmap v6432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:05 smithi043 ceph-mon[32384]: pgmap v6432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:05 smithi133 ceph-mon[37053]: pgmap v6432: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11171.963528 secs 2024-07-26T11:42:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11187.447155 secs 2024-07-26T11:42:06.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11171.963528 secs 2024-07-26T11:42:06.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11187.447155 secs 2024-07-26T11:42:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11171.963528 secs 2024-07-26T11:42:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11187.447155 secs 2024-07-26T11:42:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:07 smithi063 ceph-mon[36747]: pgmap v6433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:07 smithi043 ceph-mon[32384]: pgmap v6433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:08.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:07 smithi133 ceph-mon[37053]: pgmap v6433: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:09 smithi063 ceph-mon[36747]: pgmap v6434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:09 smithi043 ceph-mon[32384]: pgmap v6434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:10.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:09 smithi133 ceph-mon[37053]: pgmap v6434: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11176.963627 secs 2024-07-26T11:42:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:11 smithi043 ceph-mon[32384]: pgmap v6435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:11.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11192.447209 secs 2024-07-26T11:42:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11176.963627 secs 2024-07-26T11:42:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:11 smithi133 ceph-mon[37053]: pgmap v6435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11192.447209 secs 2024-07-26T11:42:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11176.963627 secs 2024-07-26T11:42:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:11 smithi063 ceph-mon[36747]: pgmap v6435: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11192.447209 secs 2024-07-26T11:42:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:13 smithi043 ceph-mon[32384]: pgmap v6436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:13 smithi133 ceph-mon[37053]: pgmap v6436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:14.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:13 smithi063 ceph-mon[36747]: pgmap v6436: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:15 smithi043 ceph-mon[32384]: pgmap v6437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:15 smithi133 ceph-mon[37053]: pgmap v6437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:15 smithi063 ceph-mon[36747]: pgmap v6437: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11181.963748 secs 2024-07-26T11:42:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11197.447284 secs 2024-07-26T11:42:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11181.963748 secs 2024-07-26T11:42:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11197.447284 secs 2024-07-26T11:42:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11181.963748 secs 2024-07-26T11:42:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11197.447284 secs 2024-07-26T11:42:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:17 smithi043 ceph-mon[32384]: pgmap v6438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:17 smithi133 ceph-mon[37053]: pgmap v6438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:17 smithi063 ceph-mon[36747]: pgmap v6438: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:19 smithi043 ceph-mon[32384]: pgmap v6439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:19 smithi133 ceph-mon[37053]: pgmap v6439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:19 smithi063 ceph-mon[36747]: pgmap v6439: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11186.963873 secs 2024-07-26T11:42:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:21 smithi043 ceph-mon[32384]: pgmap v6440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11202.447404 secs 2024-07-26T11:42:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11186.963873 secs 2024-07-26T11:42:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:21 smithi133 ceph-mon[37053]: pgmap v6440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:22.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11202.447404 secs 2024-07-26T11:42:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11186.963873 secs 2024-07-26T11:42:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:21 smithi063 ceph-mon[36747]: pgmap v6440: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11202.447404 secs 2024-07-26T11:42:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:23 smithi043 ceph-mon[32384]: pgmap v6441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:23 smithi133 ceph-mon[37053]: pgmap v6441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:23 smithi063 ceph-mon[36747]: pgmap v6441: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:25 smithi043 ceph-mon[32384]: pgmap v6442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:26.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:25 smithi133 ceph-mon[37053]: pgmap v6442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:25 smithi063 ceph-mon[36747]: pgmap v6442: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11191.963993 secs 2024-07-26T11:42:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11207.447526 secs 2024-07-26T11:42:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11191.963993 secs 2024-07-26T11:42:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11207.447526 secs 2024-07-26T11:42:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11191.963993 secs 2024-07-26T11:42:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11207.447526 secs 2024-07-26T11:42:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:27 smithi043 ceph-mon[32384]: pgmap v6443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:27 smithi133 ceph-mon[37053]: pgmap v6443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:27 smithi063 ceph-mon[36747]: pgmap v6443: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:29 smithi043 ceph-mon[32384]: pgmap v6444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:29 smithi133 ceph-mon[37053]: pgmap v6444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:29 smithi063 ceph-mon[36747]: pgmap v6444: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11196.964136 secs 2024-07-26T11:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:31 smithi043 ceph-mon[32384]: pgmap v6445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11212.447653 secs 2024-07-26T11:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11196.964136 secs 2024-07-26T11:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:31 smithi133 ceph-mon[37053]: pgmap v6445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11212.447653 secs 2024-07-26T11:42:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11196.964136 secs 2024-07-26T11:42:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:31 smithi063 ceph-mon[36747]: pgmap v6445: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:32.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11212.447653 secs 2024-07-26T11:42:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:33 smithi043 ceph-mon[32384]: pgmap v6446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:33 smithi133 ceph-mon[37053]: pgmap v6446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:34.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:33 smithi063 ceph-mon[36747]: pgmap v6446: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:35 smithi043 ceph-mon[32384]: pgmap v6447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:35 smithi133 ceph-mon[37053]: pgmap v6447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:35 smithi063 ceph-mon[36747]: pgmap v6447: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:36.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11201.964176 secs 2024-07-26T11:42:36.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11217.447787 secs 2024-07-26T11:42:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11201.964176 secs 2024-07-26T11:42:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11217.447787 secs 2024-07-26T11:42:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11201.964176 secs 2024-07-26T11:42:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11217.447787 secs 2024-07-26T11:42:37.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:37 smithi043 ceph-mon[32384]: pgmap v6448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:38.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:37 smithi133 ceph-mon[37053]: pgmap v6448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:37 smithi063 ceph-mon[36747]: pgmap v6448: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:39 smithi043 ceph-mon[32384]: pgmap v6449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:39 smithi133 ceph-mon[37053]: pgmap v6449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:39 smithi063 ceph-mon[36747]: pgmap v6449: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11206.964297 secs 2024-07-26T11:42:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:41 smithi043 ceph-mon[32384]: pgmap v6450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11222.447937 secs 2024-07-26T11:42:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11206.964297 secs 2024-07-26T11:42:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:41 smithi133 ceph-mon[37053]: pgmap v6450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11222.447937 secs 2024-07-26T11:42:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11206.964297 secs 2024-07-26T11:42:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:41 smithi063 ceph-mon[36747]: pgmap v6450: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11222.447937 secs 2024-07-26T11:42:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:43 smithi043 ceph-mon[32384]: pgmap v6451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:43 smithi133 ceph-mon[37053]: pgmap v6451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:44.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:43 smithi063 ceph-mon[36747]: pgmap v6451: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:45 smithi043 ceph-mon[32384]: pgmap v6452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:45 smithi133 ceph-mon[37053]: pgmap v6452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:45 smithi063 ceph-mon[36747]: pgmap v6452: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:42:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11211.964436 secs 2024-07-26T11:42:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11227.448022 secs 2024-07-26T11:42:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11211.964436 secs 2024-07-26T11:42:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11227.448022 secs 2024-07-26T11:42:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11211.964436 secs 2024-07-26T11:42:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11227.448022 secs 2024-07-26T11:42:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:47 smithi043 ceph-mon[32384]: pgmap v6453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:47 smithi133 ceph-mon[37053]: pgmap v6453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:47 smithi063 ceph-mon[36747]: pgmap v6453: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:42:49.404+0000 7f02a5600640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f0288005b90 con 0x7f02b00751e0 2024-07-26T11:42:49.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:42:49.405+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f0288005b90 con 0x7f02b00751e0 2024-07-26T11:42:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:49 smithi043 ceph-mon[32384]: pgmap v6454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:49 smithi133 ceph-mon[37053]: pgmap v6454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:49 smithi063 ceph-mon[36747]: pgmap v6454: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11216.964522 secs 2024-07-26T11:42:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:51 smithi043 ceph-mon[32384]: pgmap v6455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11232.448143 secs 2024-07-26T11:42:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11216.964522 secs 2024-07-26T11:42:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:51 smithi133 ceph-mon[37053]: pgmap v6455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11232.448143 secs 2024-07-26T11:42:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11216.964522 secs 2024-07-26T11:42:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:51 smithi063 ceph-mon[36747]: pgmap v6455: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11232.448143 secs 2024-07-26T11:42:52.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:52 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:42:53.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:52 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:42:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:52 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:42:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: pgmap v6456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:42:54.018 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:53 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:42:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: pgmap v6456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:42:54.070 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:53 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:42:54.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: pgmap v6456: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:54.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.235 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:42:54.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:42:54.236 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:53 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:42:55.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: pgmap v6457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:42:55.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: pgmap v6458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:55.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:54 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:42:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:42:55.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:42:55.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: pgmap v6457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:42:55.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: pgmap v6458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:55.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:54 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:42:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi063 to 176.2M 2024-07-26T11:42:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi133 to 176.2M 2024-07-26T11:42:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi063 to 184793190: error parsing value: Value '184793190' is below minimum 939524096 2024-07-26T11:42:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi133 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-26T11:42:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: pgmap v6457: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:42:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: pgmap v6458: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:42:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:54 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:42:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11221.964598 secs 2024-07-26T11:42:57.117 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11237.448258 secs 2024-07-26T11:42:57.117 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:56 smithi133 ceph-mon[37053]: pgmap v6459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:57.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11221.964598 secs 2024-07-26T11:42:57.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11237.448258 secs 2024-07-26T11:42:57.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:56 smithi063 ceph-mon[36747]: pgmap v6459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11221.964598 secs 2024-07-26T11:42:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11237.448258 secs 2024-07-26T11:42:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:56 smithi043 ceph-mon[32384]: pgmap v6459: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:42:59.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:42:58 smithi133 ceph-mon[37053]: pgmap v6460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:42:58 smithi063 ceph-mon[36747]: pgmap v6460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:42:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:42:58 smithi043 ceph-mon[32384]: pgmap v6460: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:00 smithi133 ceph-mon[37053]: pgmap v6461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:43:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:00 smithi063 ceph-mon[36747]: pgmap v6461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:43:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:00 smithi043 ceph-mon[32384]: pgmap v6461: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:43:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11226.964742 secs 2024-07-26T11:43:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11242.448377 secs 2024-07-26T11:43:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11226.964742 secs 2024-07-26T11:43:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11242.448377 secs 2024-07-26T11:43:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11226.964742 secs 2024-07-26T11:43:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11242.448377 secs 2024-07-26T11:43:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:02 smithi063 ceph-mon[36747]: pgmap v6462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:43:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:02 smithi043 ceph-mon[32384]: pgmap v6462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:43:03.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:02 smithi133 ceph-mon[37053]: pgmap v6462: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T11:43:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:04 smithi063 ceph-mon[36747]: pgmap v6463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:43:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:04 smithi043 ceph-mon[32384]: pgmap v6463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:43:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:04 smithi133 ceph-mon[37053]: pgmap v6463: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-07-26T11:43:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11231.964860 secs 2024-07-26T11:43:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11247.448505 secs 2024-07-26T11:43:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:06 smithi063 ceph-mon[36747]: pgmap v6464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:43:07.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11231.964860 secs 2024-07-26T11:43:07.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11247.448505 secs 2024-07-26T11:43:07.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:06 smithi133 ceph-mon[37053]: pgmap v6464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:43:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11231.964860 secs 2024-07-26T11:43:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11247.448505 secs 2024-07-26T11:43:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:06 smithi043 ceph-mon[32384]: pgmap v6464: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:43:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:08 smithi063 ceph-mon[36747]: pgmap v6465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:08 smithi043 ceph-mon[32384]: pgmap v6465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:09.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:08 smithi133 ceph-mon[37053]: pgmap v6465: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:10 smithi063 ceph-mon[36747]: pgmap v6466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11236.964999 secs 2024-07-26T11:43:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:10 smithi043 ceph-mon[32384]: pgmap v6466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11236.964999 secs 2024-07-26T11:43:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:10 smithi133 ceph-mon[37053]: pgmap v6466: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11236.964999 secs 2024-07-26T11:43:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11252.448579 secs 2024-07-26T11:43:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11252.448579 secs 2024-07-26T11:43:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11252.448579 secs 2024-07-26T11:43:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:12 smithi063 ceph-mon[36747]: pgmap v6467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:12 smithi043 ceph-mon[32384]: pgmap v6467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:12 smithi133 ceph-mon[37053]: pgmap v6467: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:14 smithi043 ceph-mon[32384]: pgmap v6468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:14 smithi133 ceph-mon[37053]: pgmap v6468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:14 smithi063 ceph-mon[36747]: pgmap v6468: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11241.965148 secs 2024-07-26T11:43:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11241.965148 secs 2024-07-26T11:43:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11241.965148 secs 2024-07-26T11:43:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11257.448713 secs 2024-07-26T11:43:17.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:16 smithi043 ceph-mon[32384]: pgmap v6469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11257.448713 secs 2024-07-26T11:43:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:16 smithi133 ceph-mon[37053]: pgmap v6469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11257.448713 secs 2024-07-26T11:43:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:16 smithi063 ceph-mon[36747]: pgmap v6469: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:18 smithi043 ceph-mon[32384]: pgmap v6470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:18 smithi133 ceph-mon[37053]: pgmap v6470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:18 smithi063 ceph-mon[36747]: pgmap v6470: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:21.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:20 smithi043 ceph-mon[32384]: pgmap v6471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:21.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11246.965215 secs 2024-07-26T11:43:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:20 smithi133 ceph-mon[37053]: pgmap v6471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11246.965215 secs 2024-07-26T11:43:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:20 smithi063 ceph-mon[36747]: pgmap v6471: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11246.965215 secs 2024-07-26T11:43:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11262.448814 secs 2024-07-26T11:43:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11262.448814 secs 2024-07-26T11:43:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11262.448814 secs 2024-07-26T11:43:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:22 smithi043 ceph-mon[32384]: pgmap v6472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:22 smithi133 ceph-mon[37053]: pgmap v6472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:23.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:22 smithi063 ceph-mon[36747]: pgmap v6472: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:24 smithi043 ceph-mon[32384]: pgmap v6473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:25.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:24 smithi133 ceph-mon[37053]: pgmap v6473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:24 smithi063 ceph-mon[36747]: pgmap v6473: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11251.965300 secs 2024-07-26T11:43:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11251.965300 secs 2024-07-26T11:43:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11251.965300 secs 2024-07-26T11:43:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11267.448935 secs 2024-07-26T11:43:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:26 smithi043 ceph-mon[32384]: pgmap v6474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11267.448935 secs 2024-07-26T11:43:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:26 smithi133 ceph-mon[37053]: pgmap v6474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11267.448935 secs 2024-07-26T11:43:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:26 smithi063 ceph-mon[36747]: pgmap v6474: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:28 smithi043 ceph-mon[32384]: pgmap v6475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:28 smithi133 ceph-mon[37053]: pgmap v6475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:28 smithi063 ceph-mon[36747]: pgmap v6475: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:30 smithi043 ceph-mon[32384]: pgmap v6476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11256.965438 secs 2024-07-26T11:43:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:30 smithi133 ceph-mon[37053]: pgmap v6476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11256.965438 secs 2024-07-26T11:43:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:30 smithi063 ceph-mon[36747]: pgmap v6476: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11256.965438 secs 2024-07-26T11:43:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11272.449062 secs 2024-07-26T11:43:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11272.449062 secs 2024-07-26T11:43:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11272.449062 secs 2024-07-26T11:43:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:32 smithi043 ceph-mon[32384]: pgmap v6477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:32 smithi133 ceph-mon[37053]: pgmap v6477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:32 smithi063 ceph-mon[36747]: pgmap v6477: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:34.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:43:34.413+0000 7f02a5600640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f0288005ee0 con 0x7f02b00751e0 2024-07-26T11:43:34.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:43:34.414+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f0288005ee0 con 0x7f02b00751e0 2024-07-26T11:43:35.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:34 smithi043 ceph-mon[32384]: pgmap v6478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:34 smithi133 ceph-mon[37053]: pgmap v6478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:34 smithi063 ceph-mon[36747]: pgmap v6478: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11261.965556 secs 2024-07-26T11:43:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11261.965556 secs 2024-07-26T11:43:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11261.965556 secs 2024-07-26T11:43:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11277.449178 secs 2024-07-26T11:43:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:36 smithi043 ceph-mon[32384]: pgmap v6479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11277.449178 secs 2024-07-26T11:43:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:36 smithi133 ceph-mon[37053]: pgmap v6479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11277.449178 secs 2024-07-26T11:43:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:36 smithi063 ceph-mon[36747]: pgmap v6479: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:38 smithi043 ceph-mon[32384]: pgmap v6480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:39.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:38 smithi133 ceph-mon[37053]: pgmap v6480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:39.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:38 smithi063 ceph-mon[36747]: pgmap v6480: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:40 smithi043 ceph-mon[32384]: pgmap v6481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:41.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11266.965666 secs 2024-07-26T11:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:40 smithi133 ceph-mon[37053]: pgmap v6481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11266.965666 secs 2024-07-26T11:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:40 smithi063 ceph-mon[36747]: pgmap v6481: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11266.965666 secs 2024-07-26T11:43:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11282.449299 secs 2024-07-26T11:43:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11282.449299 secs 2024-07-26T11:43:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11282.449299 secs 2024-07-26T11:43:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:42 smithi043 ceph-mon[32384]: pgmap v6482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:42 smithi133 ceph-mon[37053]: pgmap v6482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:42 smithi063 ceph-mon[36747]: pgmap v6482: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:43 smithi043 ceph-mon[32384]: pgmap v6483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:44.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:43 smithi133 ceph-mon[37053]: pgmap v6483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:43 smithi063 ceph-mon[36747]: pgmap v6483: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11271.965779 secs 2024-07-26T11:43:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11271.965779 secs 2024-07-26T11:43:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11271.965779 secs 2024-07-26T11:43:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11287.449400 secs 2024-07-26T11:43:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:46 smithi043 ceph-mon[32384]: pgmap v6484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11287.449400 secs 2024-07-26T11:43:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:46 smithi133 ceph-mon[37053]: pgmap v6484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11287.449400 secs 2024-07-26T11:43:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:46 smithi063 ceph-mon[36747]: pgmap v6484: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:48 smithi043 ceph-mon[32384]: pgmap v6485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:48 smithi133 ceph-mon[37053]: pgmap v6485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:48 smithi063 ceph-mon[36747]: pgmap v6485: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:50 smithi043 ceph-mon[32384]: pgmap v6486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11276.965899 secs 2024-07-26T11:43:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:50 smithi133 ceph-mon[37053]: pgmap v6486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11276.965899 secs 2024-07-26T11:43:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:50 smithi063 ceph-mon[36747]: pgmap v6486: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:43:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11276.965899 secs 2024-07-26T11:43:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11292.449525 secs 2024-07-26T11:43:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11292.449525 secs 2024-07-26T11:43:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11292.449525 secs 2024-07-26T11:43:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:52 smithi043 ceph-mon[32384]: pgmap v6487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:52 smithi133 ceph-mon[37053]: pgmap v6487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:52 smithi063 ceph-mon[36747]: pgmap v6487: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:43:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:54 smithi043 ceph-mon[32384]: pgmap v6488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:55.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:54 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:43:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:54 smithi133 ceph-mon[37053]: pgmap v6488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:54 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:43:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:54 smithi063 ceph-mon[36747]: pgmap v6488: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:43:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:54 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:43:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:43:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:43:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:55 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:43:56.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:55 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11281.966032 secs 2024-07-26T11:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:43:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:55 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:43:56.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:55 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11281.966032 secs 2024-07-26T11:43:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:43:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:43:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:55 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:43:56.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:55 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11281.966032 secs 2024-07-26T11:43:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:56 smithi043 ceph-mon[32384]: pgmap v6489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:43:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:56 smithi043 ceph-mon[32384]: pgmap v6490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:43:57.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11297.449598 secs 2024-07-26T11:43:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:56 smithi133 ceph-mon[37053]: pgmap v6489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:43:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:56 smithi133 ceph-mon[37053]: pgmap v6490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:43:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11297.449598 secs 2024-07-26T11:43:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:56 smithi063 ceph-mon[36747]: pgmap v6489: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:43:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:56 smithi063 ceph-mon[36747]: pgmap v6490: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:43:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11297.449598 secs 2024-07-26T11:43:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:43:58 smithi043 ceph-mon[32384]: pgmap v6491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:43:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:43:58 smithi133 ceph-mon[37053]: pgmap v6491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:43:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:43:58 smithi063 ceph-mon[36747]: pgmap v6491: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:44:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:00 smithi043 ceph-mon[32384]: pgmap v6492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:44:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11286.966151 secs 2024-07-26T11:44:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:00 smithi133 ceph-mon[37053]: pgmap v6492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:44:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11286.966151 secs 2024-07-26T11:44:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:00 smithi063 ceph-mon[36747]: pgmap v6492: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:44:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11286.966151 secs 2024-07-26T11:44:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11302.449712 secs 2024-07-26T11:44:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11302.449712 secs 2024-07-26T11:44:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11302.449712 secs 2024-07-26T11:44:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:02 smithi043 ceph-mon[32384]: pgmap v6493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:44:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:02 smithi133 ceph-mon[37053]: pgmap v6493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:44:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:02 smithi063 ceph-mon[36747]: pgmap v6493: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:44:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:04 smithi043 ceph-mon[32384]: pgmap v6494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:44:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:04 smithi133 ceph-mon[37053]: pgmap v6494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:44:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:04 smithi063 ceph-mon[36747]: pgmap v6494: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:44:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:05 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11291.966239 secs 2024-07-26T11:44:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:05 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11291.966239 secs 2024-07-26T11:44:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:05 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11291.966239 secs 2024-07-26T11:44:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:06 smithi043 ceph-mon[32384]: pgmap v6495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11307.449848 secs 2024-07-26T11:44:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:06 smithi133 ceph-mon[37053]: pgmap v6495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11307.449848 secs 2024-07-26T11:44:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:06 smithi063 ceph-mon[36747]: pgmap v6495: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11307.449848 secs 2024-07-26T11:44:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:07 smithi043 ceph-mon[32384]: pgmap v6496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:08.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:07 smithi133 ceph-mon[37053]: pgmap v6496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:07 smithi063 ceph-mon[36747]: pgmap v6496: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:10 smithi063 ceph-mon[36747]: pgmap v6497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:10.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:10 smithi043 ceph-mon[32384]: pgmap v6497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:10 smithi133 ceph-mon[37053]: pgmap v6497: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11296.966361 secs 2024-07-26T11:44:11.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11296.966361 secs 2024-07-26T11:44:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11296.966361 secs 2024-07-26T11:44:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:12 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11312.449942 secs 2024-07-26T11:44:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:12 smithi063 ceph-mon[36747]: pgmap v6498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:12.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:12 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11312.449942 secs 2024-07-26T11:44:12.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:12 smithi043 ceph-mon[32384]: pgmap v6498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:12 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11312.449942 secs 2024-07-26T11:44:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:12 smithi133 ceph-mon[37053]: pgmap v6498: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:14.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:14 smithi043 ceph-mon[32384]: pgmap v6499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:14.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:14 smithi133 ceph-mon[37053]: pgmap v6499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:14.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:14 smithi063 ceph-mon[36747]: pgmap v6499: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:16 smithi043 ceph-mon[32384]: pgmap v6500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:16.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11301.966453 secs 2024-07-26T11:44:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:16 smithi133 ceph-mon[37053]: pgmap v6500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11301.966453 secs 2024-07-26T11:44:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:16 smithi063 ceph-mon[36747]: pgmap v6500: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:16.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11301.966453 secs 2024-07-26T11:44:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11317.450076 secs 2024-07-26T11:44:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11317.450076 secs 2024-07-26T11:44:17.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11317.450076 secs 2024-07-26T11:44:18.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:18 smithi043 ceph-mon[32384]: pgmap v6501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:18.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:18 smithi133 ceph-mon[37053]: pgmap v6501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:18.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:18 smithi063 ceph-mon[36747]: pgmap v6501: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:20.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:20 smithi043 ceph-mon[32384]: pgmap v6502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:20.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:20 smithi133 ceph-mon[37053]: pgmap v6502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:20.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:20 smithi063 ceph-mon[36747]: pgmap v6502: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:21.384 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11306.966553 secs 2024-07-26T11:44:21.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11306.966553 secs 2024-07-26T11:44:21.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11306.966553 secs 2024-07-26T11:44:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:22 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11322.450200 secs 2024-07-26T11:44:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:22 smithi043 ceph-mon[32384]: pgmap v6503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:22 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11322.450200 secs 2024-07-26T11:44:22.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:22 smithi133 ceph-mon[37053]: pgmap v6503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:22 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11322.450200 secs 2024-07-26T11:44:22.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:22 smithi063 ceph-mon[36747]: pgmap v6503: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:24 smithi043 ceph-mon[32384]: pgmap v6504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:24.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:24 smithi133 ceph-mon[37053]: pgmap v6504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:24.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:24 smithi063 ceph-mon[36747]: pgmap v6504: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:26 smithi043 ceph-mon[32384]: pgmap v6505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11311.966709 secs 2024-07-26T11:44:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:26 smithi133 ceph-mon[37053]: pgmap v6505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11311.966709 secs 2024-07-26T11:44:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:26 smithi063 ceph-mon[36747]: pgmap v6505: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:26.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11311.966709 secs 2024-07-26T11:44:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11327.450297 secs 2024-07-26T11:44:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11327.450297 secs 2024-07-26T11:44:27.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11327.450297 secs 2024-07-26T11:44:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:28 smithi043 ceph-mon[32384]: pgmap v6506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:28 smithi133 ceph-mon[37053]: pgmap v6506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:28.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:28 smithi063 ceph-mon[36747]: pgmap v6506: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:30 smithi043 ceph-mon[32384]: pgmap v6507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:30 smithi133 ceph-mon[37053]: pgmap v6507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:30 smithi063 ceph-mon[36747]: pgmap v6507: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:31.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11316.966851 secs 2024-07-26T11:44:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11316.966851 secs 2024-07-26T11:44:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11316.966851 secs 2024-07-26T11:44:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11332.450418 secs 2024-07-26T11:44:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:32 smithi043 ceph-mon[32384]: pgmap v6508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11332.450418 secs 2024-07-26T11:44:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:32 smithi133 ceph-mon[37053]: pgmap v6508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11332.450418 secs 2024-07-26T11:44:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:32 smithi063 ceph-mon[36747]: pgmap v6508: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:34 smithi043 ceph-mon[32384]: pgmap v6509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:34 smithi133 ceph-mon[37053]: pgmap v6509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:34 smithi063 ceph-mon[36747]: pgmap v6509: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:36 smithi043 ceph-mon[32384]: pgmap v6510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:44:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11321.966975 secs 2024-07-26T11:44:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:36 smithi133 ceph-mon[37053]: pgmap v6510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:44:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11321.966975 secs 2024-07-26T11:44:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:36 smithi063 ceph-mon[36747]: pgmap v6510: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:44:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11321.966975 secs 2024-07-26T11:44:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11337.450534 secs 2024-07-26T11:44:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11337.450534 secs 2024-07-26T11:44:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11337.450534 secs 2024-07-26T11:44:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:38 smithi043 ceph-mon[32384]: pgmap v6511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:38 smithi133 ceph-mon[37053]: pgmap v6511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:38 smithi063 ceph-mon[36747]: pgmap v6511: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:40 smithi043 ceph-mon[32384]: pgmap v6512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:40 smithi133 ceph-mon[37053]: pgmap v6512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:40 smithi063 ceph-mon[36747]: pgmap v6512: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11326.967129 secs 2024-07-26T11:44:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11342.450661 secs 2024-07-26T11:44:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11326.967129 secs 2024-07-26T11:44:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11342.450661 secs 2024-07-26T11:44:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11326.967129 secs 2024-07-26T11:44:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11342.450661 secs 2024-07-26T11:44:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:42 smithi043 ceph-mon[32384]: pgmap v6513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:42 smithi133 ceph-mon[37053]: pgmap v6513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:42 smithi063 ceph-mon[36747]: pgmap v6513: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:44 smithi043 ceph-mon[32384]: pgmap v6514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:44 smithi133 ceph-mon[37053]: pgmap v6514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:44 smithi063 ceph-mon[36747]: pgmap v6514: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:44:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:46 smithi043 ceph-mon[32384]: pgmap v6515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11331.967253 secs 2024-07-26T11:44:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11347.450777 secs 2024-07-26T11:44:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:46 smithi133 ceph-mon[37053]: pgmap v6515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11331.967253 secs 2024-07-26T11:44:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11347.450777 secs 2024-07-26T11:44:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:46 smithi063 ceph-mon[36747]: pgmap v6515: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11331.967253 secs 2024-07-26T11:44:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11347.450777 secs 2024-07-26T11:44:48.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:48 smithi043 ceph-mon[32384]: pgmap v6516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:48.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:48 smithi133 ceph-mon[37053]: pgmap v6516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:48 smithi063 ceph-mon[36747]: pgmap v6516: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:50.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:50 smithi043 ceph-mon[32384]: pgmap v6517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:50.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:50 smithi133 ceph-mon[37053]: pgmap v6517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:50 smithi063 ceph-mon[36747]: pgmap v6517: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11336.967394 secs 2024-07-26T11:44:51.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11352.450882 secs 2024-07-26T11:44:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11336.967394 secs 2024-07-26T11:44:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11352.450882 secs 2024-07-26T11:44:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11336.967394 secs 2024-07-26T11:44:51.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11352.450882 secs 2024-07-26T11:44:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:52 smithi133 ceph-mon[37053]: pgmap v6518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:52 smithi063 ceph-mon[36747]: pgmap v6518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:52.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:52 smithi043 ceph-mon[32384]: pgmap v6518: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:54 smithi133 ceph-mon[37053]: pgmap v6519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:54 smithi063 ceph-mon[36747]: pgmap v6519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:54 smithi043 ceph-mon[32384]: pgmap v6519: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:44:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:55 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:44:55.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:55 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:44:55.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:55 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:44:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:56 smithi133 ceph-mon[37053]: pgmap v6520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11341.967451 secs 2024-07-26T11:44:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11357.451009 secs 2024-07-26T11:44:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:56.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:56 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:56 smithi063 ceph-mon[36747]: pgmap v6520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11341.967451 secs 2024-07-26T11:44:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11357.451009 secs 2024-07-26T11:44:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:56.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:56 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:56.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:56 smithi043 ceph-mon[32384]: pgmap v6520: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:44:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11341.967451 secs 2024-07-26T11:44:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11357.451009 secs 2024-07-26T11:44:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:56 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:44:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:57 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:44:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:57 smithi063 ceph-mon[36747]: pgmap v6521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:57.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:57 smithi063 ceph-mon[36747]: pgmap v6522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:57.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:57 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:44:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:57 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:44:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:57 smithi043 ceph-mon[32384]: pgmap v6521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:57 smithi043 ceph-mon[32384]: pgmap v6522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:57.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:57 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:44:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:57 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:44:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:57 smithi133 ceph-mon[37053]: pgmap v6521: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:44:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:57 smithi133 ceph-mon[37053]: pgmap v6522: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:57.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:57 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:44:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:44:59 smithi063 ceph-mon[36747]: pgmap v6523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:59.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:44:59 smithi043 ceph-mon[32384]: pgmap v6523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:44:59.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:44:59 smithi133 ceph-mon[37053]: pgmap v6523: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:01.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11346.967514 secs 2024-07-26T11:45:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11346.967514 secs 2024-07-26T11:45:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11346.967514 secs 2024-07-26T11:45:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11362.451087 secs 2024-07-26T11:45:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:01 smithi043 ceph-mon[32384]: pgmap v6524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11362.451087 secs 2024-07-26T11:45:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:01 smithi133 ceph-mon[37053]: pgmap v6524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11362.451087 secs 2024-07-26T11:45:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:01 smithi063 ceph-mon[36747]: pgmap v6524: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:03 smithi063 ceph-mon[36747]: pgmap v6525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:03.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:03 smithi043 ceph-mon[32384]: pgmap v6525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:03.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:03 smithi133 ceph-mon[37053]: pgmap v6525: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:05 smithi063 ceph-mon[36747]: pgmap v6526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:05.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:05 smithi043 ceph-mon[32384]: pgmap v6526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:05.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:05 smithi133 ceph-mon[37053]: pgmap v6526: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:45:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11351.967650 secs 2024-07-26T11:45:06.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11351.967650 secs 2024-07-26T11:45:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11351.967650 secs 2024-07-26T11:45:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11367.451237 secs 2024-07-26T11:45:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:07 smithi063 ceph-mon[36747]: pgmap v6527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:45:07.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11367.451237 secs 2024-07-26T11:45:07.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:07 smithi133 ceph-mon[37053]: pgmap v6527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:45:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11367.451237 secs 2024-07-26T11:45:07.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:07 smithi043 ceph-mon[32384]: pgmap v6527: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:45:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:09 smithi063 ceph-mon[36747]: pgmap v6528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:09.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:09 smithi043 ceph-mon[32384]: pgmap v6528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:09 smithi133 ceph-mon[37053]: pgmap v6528: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11356.967789 secs 2024-07-26T11:45:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11372.451335 secs 2024-07-26T11:45:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:11 smithi063 ceph-mon[36747]: pgmap v6529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11356.967789 secs 2024-07-26T11:45:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11372.451335 secs 2024-07-26T11:45:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:11 smithi043 ceph-mon[32384]: pgmap v6529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11356.967789 secs 2024-07-26T11:45:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11372.451335 secs 2024-07-26T11:45:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:11 smithi133 ceph-mon[37053]: pgmap v6529: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:13 smithi063 ceph-mon[36747]: pgmap v6530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:13.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:13 smithi043 ceph-mon[32384]: pgmap v6530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:13.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:13 smithi133 ceph-mon[37053]: pgmap v6530: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:15 smithi063 ceph-mon[36747]: pgmap v6531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:15.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:15 smithi043 ceph-mon[32384]: pgmap v6531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:15.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:15 smithi133 ceph-mon[37053]: pgmap v6531: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11361.967906 secs 2024-07-26T11:45:16.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11361.967906 secs 2024-07-26T11:45:16.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11361.967906 secs 2024-07-26T11:45:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:17 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11377.451455 secs 2024-07-26T11:45:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:17 smithi063 ceph-mon[36747]: pgmap v6532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:17 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11377.451455 secs 2024-07-26T11:45:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:17 smithi043 ceph-mon[32384]: pgmap v6532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:17 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11377.451455 secs 2024-07-26T11:45:17.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:17 smithi133 ceph-mon[37053]: pgmap v6532: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:19 smithi063 ceph-mon[36747]: pgmap v6533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:19.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:19 smithi043 ceph-mon[32384]: pgmap v6533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:19.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:19 smithi133 ceph-mon[37053]: pgmap v6533: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11366.968042 secs 2024-07-26T11:45:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11366.968042 secs 2024-07-26T11:45:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11366.968042 secs 2024-07-26T11:45:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11382.451577 secs 2024-07-26T11:45:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:21 smithi043 ceph-mon[32384]: pgmap v6534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11382.451577 secs 2024-07-26T11:45:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:21 smithi133 ceph-mon[37053]: pgmap v6534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11382.451577 secs 2024-07-26T11:45:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:21 smithi063 ceph-mon[36747]: pgmap v6534: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:23 smithi063 ceph-mon[36747]: pgmap v6535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:23 smithi043 ceph-mon[32384]: pgmap v6535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:23.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:23 smithi133 ceph-mon[37053]: pgmap v6535: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:25 smithi063 ceph-mon[36747]: pgmap v6536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:25 smithi043 ceph-mon[32384]: pgmap v6536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:25.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:25 smithi133 ceph-mon[37053]: pgmap v6536: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11371.968145 secs 2024-07-26T11:45:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11371.968145 secs 2024-07-26T11:45:26.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11371.968145 secs 2024-07-26T11:45:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11387.451711 secs 2024-07-26T11:45:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:27 smithi063 ceph-mon[36747]: pgmap v6537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11387.451711 secs 2024-07-26T11:45:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:27 smithi043 ceph-mon[32384]: pgmap v6537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11387.451711 secs 2024-07-26T11:45:27.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:27 smithi133 ceph-mon[37053]: pgmap v6537: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:29 smithi063 ceph-mon[36747]: pgmap v6538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:29 smithi043 ceph-mon[32384]: pgmap v6538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:29.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:29 smithi133 ceph-mon[37053]: pgmap v6538: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:31.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11376.968273 secs 2024-07-26T11:45:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11376.968273 secs 2024-07-26T11:45:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11376.968273 secs 2024-07-26T11:45:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11392.451834 secs 2024-07-26T11:45:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:31 smithi043 ceph-mon[32384]: pgmap v6539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:32.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11392.451834 secs 2024-07-26T11:45:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:31 smithi133 ceph-mon[37053]: pgmap v6539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11392.451834 secs 2024-07-26T11:45:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:31 smithi063 ceph-mon[36747]: pgmap v6539: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:33 smithi063 ceph-mon[36747]: pgmap v6540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:33.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:33 smithi043 ceph-mon[32384]: pgmap v6540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:33.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:33 smithi133 ceph-mon[37053]: pgmap v6540: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:35 smithi063 ceph-mon[36747]: pgmap v6541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:35.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:35 smithi043 ceph-mon[32384]: pgmap v6541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:35.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:35 smithi133 ceph-mon[37053]: pgmap v6541: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11381.968386 secs 2024-07-26T11:45:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11381.968386 secs 2024-07-26T11:45:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11381.968386 secs 2024-07-26T11:45:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11397.451953 secs 2024-07-26T11:45:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:37 smithi063 ceph-mon[36747]: pgmap v6542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:37.418 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11397.451953 secs 2024-07-26T11:45:37.419 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:37 smithi133 ceph-mon[37053]: pgmap v6542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11397.451953 secs 2024-07-26T11:45:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:37 smithi043 ceph-mon[32384]: pgmap v6542: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:39 smithi063 ceph-mon[36747]: pgmap v6543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:39 smithi043 ceph-mon[32384]: pgmap v6543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:39 smithi133 ceph-mon[37053]: pgmap v6543: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11386.968450 secs 2024-07-26T11:45:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11386.968450 secs 2024-07-26T11:45:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11386.968450 secs 2024-07-26T11:45:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11402.452073 secs 2024-07-26T11:45:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:41 smithi043 ceph-mon[32384]: pgmap v6544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11402.452073 secs 2024-07-26T11:45:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:41 smithi133 ceph-mon[37053]: pgmap v6544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11402.452073 secs 2024-07-26T11:45:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:41 smithi063 ceph-mon[36747]: pgmap v6544: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:43 smithi063 ceph-mon[36747]: pgmap v6545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:43.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:43 smithi043 ceph-mon[32384]: pgmap v6545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:43.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:43 smithi133 ceph-mon[37053]: pgmap v6545: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:45 smithi063 ceph-mon[36747]: pgmap v6546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:45.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:45 smithi043 ceph-mon[32384]: pgmap v6546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:45.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:45 smithi133 ceph-mon[37053]: pgmap v6546: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11391.968611 secs 2024-07-26T11:45:46.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11391.968611 secs 2024-07-26T11:45:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11391.968611 secs 2024-07-26T11:45:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11407.452155 secs 2024-07-26T11:45:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:47 smithi063 ceph-mon[36747]: pgmap v6547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11407.452155 secs 2024-07-26T11:45:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:47 smithi043 ceph-mon[32384]: pgmap v6547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11407.452155 secs 2024-07-26T11:45:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:47 smithi133 ceph-mon[37053]: pgmap v6547: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:49 smithi063 ceph-mon[36747]: pgmap v6548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:49 smithi043 ceph-mon[32384]: pgmap v6548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:49.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:49 smithi133 ceph-mon[37053]: pgmap v6548: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11396.968724 secs 2024-07-26T11:45:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11396.968724 secs 2024-07-26T11:45:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11396.968724 secs 2024-07-26T11:45:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11412.452256 secs 2024-07-26T11:45:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:51 smithi043 ceph-mon[32384]: pgmap v6549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11412.452256 secs 2024-07-26T11:45:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:51 smithi133 ceph-mon[37053]: pgmap v6549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11412.452256 secs 2024-07-26T11:45:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:51 smithi063 ceph-mon[36747]: pgmap v6549: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:53.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:53 smithi063 ceph-mon[36747]: pgmap v6550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:53.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:53 smithi043 ceph-mon[32384]: pgmap v6550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:53.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:53 smithi133 ceph-mon[37053]: pgmap v6550: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:45:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:55 smithi043 ceph-mon[32384]: pgmap v6551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:55 smithi063 ceph-mon[36747]: pgmap v6551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:55.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:55 smithi133 ceph-mon[37053]: pgmap v6551: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:45:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11401.968866 secs 2024-07-26T11:45:56.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11401.968866 secs 2024-07-26T11:45:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11401.968866 secs 2024-07-26T11:45:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11417.452347 secs 2024-07-26T11:45:57.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11417.452347 secs 2024-07-26T11:45:57.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11417.452347 secs 2024-07-26T11:45:58.306 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:58 smithi133 ceph-mon[37053]: pgmap v6552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:58.306 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:58 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:45:58.306 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.306 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.306 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.306 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:45:58 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:58 smithi063 ceph-mon[36747]: pgmap v6552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:58 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:45:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:45:58 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:58 smithi043 ceph-mon[32384]: pgmap v6552: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:45:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:58 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:45:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:45:58.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:45:58 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:00 smithi043 ceph-mon[32384]: pgmap v6553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:00.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.484 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:00 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:00 smithi133 ceph-mon[37053]: pgmap v6553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:00 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:00 smithi063 ceph-mon[36747]: pgmap v6553: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:00.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:00 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11406.968979 secs 2024-07-26T11:46:01.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11422.452486 secs 2024-07-26T11:46:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11406.968979 secs 2024-07-26T11:46:01.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11422.452486 secs 2024-07-26T11:46:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11406.968979 secs 2024-07-26T11:46:01.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11422.452486 secs 2024-07-26T11:46:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:02 smithi043 ceph-mon[32384]: pgmap v6554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:02 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:02 smithi133 ceph-mon[37053]: pgmap v6554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:02 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:02 smithi063 ceph-mon[36747]: pgmap v6554: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:02.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:02.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:02 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:46:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:46:03.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:03 smithi043 ceph-mon[32384]: pgmap v6555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:46:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:03 smithi043 ceph-mon[32384]: pgmap v6556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:03.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:46:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:46:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:03 smithi133 ceph-mon[37053]: pgmap v6555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:46:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:03 smithi133 ceph-mon[37053]: pgmap v6556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:03.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:46:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:46:03.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:03 smithi063 ceph-mon[36747]: pgmap v6555: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:46:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:03 smithi063 ceph-mon[36747]: pgmap v6556: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:03.819 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:46:05.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:05 smithi063 ceph-mon[36747]: pgmap v6557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:05 smithi043 ceph-mon[32384]: pgmap v6557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:06.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:05 smithi133 ceph-mon[37053]: pgmap v6557: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11411.969139 secs 2024-07-26T11:46:06.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11427.452607 secs 2024-07-26T11:46:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11411.969139 secs 2024-07-26T11:46:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11427.452607 secs 2024-07-26T11:46:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11411.969139 secs 2024-07-26T11:46:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11427.452607 secs 2024-07-26T11:46:07.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:07 smithi063 ceph-mon[36747]: pgmap v6558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:07.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:07 smithi133 ceph-mon[37053]: pgmap v6558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:07 smithi043 ceph-mon[32384]: pgmap v6558: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:09 smithi063 ceph-mon[36747]: pgmap v6559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:09.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:09 smithi043 ceph-mon[32384]: pgmap v6559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:10.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:09 smithi133 ceph-mon[37053]: pgmap v6559: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11416.969184 secs 2024-07-26T11:46:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:11 smithi043 ceph-mon[32384]: pgmap v6560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11432.452701 secs 2024-07-26T11:46:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11416.969184 secs 2024-07-26T11:46:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:11 smithi133 ceph-mon[37053]: pgmap v6560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11432.452701 secs 2024-07-26T11:46:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11416.969184 secs 2024-07-26T11:46:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:11 smithi063 ceph-mon[36747]: pgmap v6560: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11432.452701 secs 2024-07-26T11:46:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:13 smithi063 ceph-mon[36747]: pgmap v6561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:46:13.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:13 smithi043 ceph-mon[32384]: pgmap v6561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:46:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:13 smithi133 ceph-mon[37053]: pgmap v6561: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:46:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:15 smithi063 ceph-mon[36747]: pgmap v6562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:15.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:15 smithi043 ceph-mon[32384]: pgmap v6562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:15 smithi133 ceph-mon[37053]: pgmap v6562: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11421.969346 secs 2024-07-26T11:46:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11437.452820 secs 2024-07-26T11:46:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11421.969346 secs 2024-07-26T11:46:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11437.452820 secs 2024-07-26T11:46:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11421.969346 secs 2024-07-26T11:46:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11437.452820 secs 2024-07-26T11:46:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:17 smithi043 ceph-mon[32384]: pgmap v6563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:17 smithi133 ceph-mon[37053]: pgmap v6563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:18.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:17 smithi063 ceph-mon[36747]: pgmap v6563: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:19 smithi043 ceph-mon[32384]: pgmap v6564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:19 smithi133 ceph-mon[37053]: pgmap v6564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:19 smithi063 ceph-mon[36747]: pgmap v6564: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11426.969482 secs 2024-07-26T11:46:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:21 smithi043 ceph-mon[32384]: pgmap v6565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11442.452943 secs 2024-07-26T11:46:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11426.969482 secs 2024-07-26T11:46:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:21 smithi133 ceph-mon[37053]: pgmap v6565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11442.452943 secs 2024-07-26T11:46:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11426.969482 secs 2024-07-26T11:46:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:21 smithi063 ceph-mon[36747]: pgmap v6565: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11442.452943 secs 2024-07-26T11:46:23.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:23 smithi043 ceph-mon[32384]: pgmap v6566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:23 smithi133 ceph-mon[37053]: pgmap v6566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:23 smithi063 ceph-mon[36747]: pgmap v6566: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:25.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:25 smithi043 ceph-mon[32384]: pgmap v6567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:25 smithi133 ceph-mon[37053]: pgmap v6567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:25 smithi063 ceph-mon[36747]: pgmap v6567: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11431.969565 secs 2024-07-26T11:46:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11447.453034 secs 2024-07-26T11:46:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11431.969565 secs 2024-07-26T11:46:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11447.453034 secs 2024-07-26T11:46:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11431.969565 secs 2024-07-26T11:46:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11447.453034 secs 2024-07-26T11:46:27.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:27 smithi043 ceph-mon[32384]: pgmap v6568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:27 smithi133 ceph-mon[37053]: pgmap v6568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:27 smithi063 ceph-mon[36747]: pgmap v6568: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:29.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:29 smithi043 ceph-mon[32384]: pgmap v6569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:30.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:29 smithi133 ceph-mon[37053]: pgmap v6569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:29 smithi063 ceph-mon[36747]: pgmap v6569: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:31.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11436.969646 secs 2024-07-26T11:46:31.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:31 smithi063 ceph-mon[36747]: pgmap v6570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:31.870 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11452.453139 secs 2024-07-26T11:46:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11436.969646 secs 2024-07-26T11:46:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:31 smithi043 ceph-mon[32384]: pgmap v6570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11452.453139 secs 2024-07-26T11:46:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11436.969646 secs 2024-07-26T11:46:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:31 smithi133 ceph-mon[37053]: pgmap v6570: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11452.453139 secs 2024-07-26T11:46:33.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:33 smithi043 ceph-mon[32384]: pgmap v6571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:34.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:33 smithi133 ceph-mon[37053]: pgmap v6571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:34.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:33 smithi063 ceph-mon[36747]: pgmap v6571: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:34.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:46:34.445+0000 7f02a5600640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f0288006120 con 0x7f02b00751e0 2024-07-26T11:46:34.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:46:34.446+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f0288006120 con 0x7f02b00751e0 2024-07-26T11:46:35.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:35 smithi043 ceph-mon[32384]: pgmap v6572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:36.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:35 smithi133 ceph-mon[37053]: pgmap v6572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:36.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:35 smithi063 ceph-mon[36747]: pgmap v6572: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11441.969767 secs 2024-07-26T11:46:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11457.453239 secs 2024-07-26T11:46:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11441.969767 secs 2024-07-26T11:46:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11457.453239 secs 2024-07-26T11:46:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11441.969767 secs 2024-07-26T11:46:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11457.453239 secs 2024-07-26T11:46:37.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:37 smithi133 ceph-mon[37053]: pgmap v6573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:37.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:37 smithi043 ceph-mon[32384]: pgmap v6573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:38.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:37 smithi063 ceph-mon[36747]: pgmap v6573: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:39.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:39 smithi043 ceph-mon[32384]: pgmap v6574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:40.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:39 smithi133 ceph-mon[37053]: pgmap v6574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:40.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:39 smithi063 ceph-mon[36747]: pgmap v6574: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11446.969893 secs 2024-07-26T11:46:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:41 smithi043 ceph-mon[32384]: pgmap v6575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:41.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11462.453322 secs 2024-07-26T11:46:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11446.969893 secs 2024-07-26T11:46:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:41 smithi133 ceph-mon[37053]: pgmap v6575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11462.453322 secs 2024-07-26T11:46:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11446.969893 secs 2024-07-26T11:46:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:41 smithi063 ceph-mon[36747]: pgmap v6575: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11462.453322 secs 2024-07-26T11:46:43.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:43 smithi043 ceph-mon[32384]: pgmap v6576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:43 smithi133 ceph-mon[37053]: pgmap v6576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:44.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:43 smithi063 ceph-mon[36747]: pgmap v6576: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:45.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:45 smithi043 ceph-mon[32384]: pgmap v6577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:46.017 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:45 smithi133 ceph-mon[37053]: pgmap v6577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:46.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:45 smithi063 ceph-mon[36747]: pgmap v6577: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11451.970016 secs 2024-07-26T11:46:46.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11467.453435 secs 2024-07-26T11:46:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11451.970016 secs 2024-07-26T11:46:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11467.453435 secs 2024-07-26T11:46:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11451.970016 secs 2024-07-26T11:46:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11467.453435 secs 2024-07-26T11:46:47.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:47 smithi043 ceph-mon[32384]: pgmap v6578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:47 smithi133 ceph-mon[37053]: pgmap v6578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:48.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:47 smithi063 ceph-mon[36747]: pgmap v6578: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:49.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:49 smithi043 ceph-mon[32384]: pgmap v6579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:49 smithi133 ceph-mon[37053]: pgmap v6579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:50.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:49 smithi063 ceph-mon[36747]: pgmap v6579: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11456.970131 secs 2024-07-26T11:46:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:51 smithi043 ceph-mon[32384]: pgmap v6580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11472.453576 secs 2024-07-26T11:46:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11456.970131 secs 2024-07-26T11:46:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:51 smithi133 ceph-mon[37053]: pgmap v6580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11472.453576 secs 2024-07-26T11:46:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11456.970131 secs 2024-07-26T11:46:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:51 smithi063 ceph-mon[36747]: pgmap v6580: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11472.453576 secs 2024-07-26T11:46:53.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:53 smithi043 ceph-mon[32384]: pgmap v6581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:53 smithi133 ceph-mon[37053]: pgmap v6581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:54.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:53 smithi063 ceph-mon[36747]: pgmap v6581: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:46:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:55 smithi043 ceph-mon[32384]: pgmap v6582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:55 smithi133 ceph-mon[37053]: pgmap v6582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:56.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:55 smithi063 ceph-mon[36747]: pgmap v6582: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11461.970237 secs 2024-07-26T11:46:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11477.453698 secs 2024-07-26T11:46:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11461.970237 secs 2024-07-26T11:46:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11477.453698 secs 2024-07-26T11:46:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11461.970237 secs 2024-07-26T11:46:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11477.453698 secs 2024-07-26T11:46:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:57 smithi043 ceph-mon[32384]: pgmap v6583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:58.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:57 smithi133 ceph-mon[37053]: pgmap v6583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:57 smithi063 ceph-mon[36747]: pgmap v6583: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:46:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:46:59 smithi043 ceph-mon[32384]: pgmap v6584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:46:59 smithi133 ceph-mon[37053]: pgmap v6584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:46:59 smithi063 ceph-mon[36747]: pgmap v6584: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11466.970322 secs 2024-07-26T11:47:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:01 smithi043 ceph-mon[32384]: pgmap v6585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11482.453798 secs 2024-07-26T11:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11466.970322 secs 2024-07-26T11:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:01 smithi133 ceph-mon[37053]: pgmap v6585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11482.453798 secs 2024-07-26T11:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11466.970322 secs 2024-07-26T11:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:01 smithi063 ceph-mon[36747]: pgmap v6585: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:02.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11482.453798 secs 2024-07-26T11:47:03.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:02 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:47:03.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:02 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:47:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:02 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:47:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:03 smithi063 ceph-mon[36747]: pgmap v6586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:47:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:03 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:47:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:03 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:47:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:03 smithi043 ceph-mon[32384]: pgmap v6586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:47:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:03 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:47:04.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:03 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:47:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:03 smithi133 ceph-mon[37053]: pgmap v6586: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:47:04.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:03 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:47:04.267 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:03 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:47:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:04 smithi063 ceph-mon[36747]: pgmap v6587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:47:05.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:04 smithi063 ceph-mon[36747]: pgmap v6588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:47:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:04 smithi043 ceph-mon[32384]: pgmap v6587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:47:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:04 smithi043 ceph-mon[32384]: pgmap v6588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:47:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:04 smithi133 ceph-mon[37053]: pgmap v6587: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:47:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:04 smithi133 ceph-mon[37053]: pgmap v6588: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:47:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11471.970405 secs 2024-07-26T11:47:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11487.453905 secs 2024-07-26T11:47:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:06 smithi063 ceph-mon[36747]: pgmap v6589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:47:07.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11471.970405 secs 2024-07-26T11:47:07.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11487.453905 secs 2024-07-26T11:47:07.069 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:06 smithi133 ceph-mon[37053]: pgmap v6589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:47:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11471.970405 secs 2024-07-26T11:47:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11487.453905 secs 2024-07-26T11:47:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:06 smithi043 ceph-mon[32384]: pgmap v6589: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:47:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:08 smithi063 ceph-mon[36747]: pgmap v6590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:47:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:08 smithi043 ceph-mon[32384]: pgmap v6590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:47:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:08 smithi133 ceph-mon[37053]: pgmap v6590: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:47:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:10 smithi063 ceph-mon[36747]: pgmap v6591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:47:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:10 smithi043 ceph-mon[32384]: pgmap v6591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:47:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:10 smithi133 ceph-mon[37053]: pgmap v6591: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:47:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11476.970521 secs 2024-07-26T11:47:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11492.454030 secs 2024-07-26T11:47:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11476.970521 secs 2024-07-26T11:47:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11492.454030 secs 2024-07-26T11:47:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11476.970521 secs 2024-07-26T11:47:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11492.454030 secs 2024-07-26T11:47:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:12 smithi043 ceph-mon[32384]: pgmap v6592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:47:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:12 smithi133 ceph-mon[37053]: pgmap v6592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:47:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:12 smithi063 ceph-mon[36747]: pgmap v6592: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:47:15.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:14 smithi043 ceph-mon[32384]: pgmap v6593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:47:15.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:14 smithi133 ceph-mon[37053]: pgmap v6593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:47:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:14 smithi063 ceph-mon[36747]: pgmap v6593: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:47:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11481.970616 secs 2024-07-26T11:47:16.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11481.970616 secs 2024-07-26T11:47:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11481.970616 secs 2024-07-26T11:47:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11497.454147 secs 2024-07-26T11:47:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:16 smithi043 ceph-mon[32384]: pgmap v6594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11497.454147 secs 2024-07-26T11:47:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:16 smithi133 ceph-mon[37053]: pgmap v6594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:17.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11497.454147 secs 2024-07-26T11:47:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:16 smithi063 ceph-mon[36747]: pgmap v6594: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:18 smithi043 ceph-mon[32384]: pgmap v6595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:18 smithi133 ceph-mon[37053]: pgmap v6595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:18 smithi063 ceph-mon[36747]: pgmap v6595: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:20 smithi043 ceph-mon[32384]: pgmap v6596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11486.970759 secs 2024-07-26T11:47:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:20 smithi133 ceph-mon[37053]: pgmap v6596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11486.970759 secs 2024-07-26T11:47:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:20 smithi063 ceph-mon[36747]: pgmap v6596: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11486.970759 secs 2024-07-26T11:47:22.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11502.454238 secs 2024-07-26T11:47:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11502.454238 secs 2024-07-26T11:47:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11502.454238 secs 2024-07-26T11:47:23.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:22 smithi043 ceph-mon[32384]: pgmap v6597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:22 smithi133 ceph-mon[37053]: pgmap v6597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:22 smithi063 ceph-mon[36747]: pgmap v6597: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:25.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:24 smithi043 ceph-mon[32384]: pgmap v6598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:24 smithi133 ceph-mon[37053]: pgmap v6598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:24 smithi063 ceph-mon[36747]: pgmap v6598: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:26.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11491.970889 secs 2024-07-26T11:47:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11491.970889 secs 2024-07-26T11:47:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11491.970889 secs 2024-07-26T11:47:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11507.454389 secs 2024-07-26T11:47:27.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:26 smithi043 ceph-mon[32384]: pgmap v6599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11507.454389 secs 2024-07-26T11:47:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:26 smithi133 ceph-mon[37053]: pgmap v6599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11507.454389 secs 2024-07-26T11:47:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:26 smithi063 ceph-mon[36747]: pgmap v6599: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:29.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:28 smithi043 ceph-mon[32384]: pgmap v6600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:29.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:28 smithi133 ceph-mon[37053]: pgmap v6600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:29.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:28 smithi063 ceph-mon[36747]: pgmap v6600: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:30 smithi043 ceph-mon[32384]: pgmap v6601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:31.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:30 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11496.971035 secs 2024-07-26T11:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:30 smithi133 ceph-mon[37053]: pgmap v6601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:31.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:30 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11496.971035 secs 2024-07-26T11:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:30 smithi063 ceph-mon[36747]: pgmap v6601: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:30 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11496.971035 secs 2024-07-26T11:47:32.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11512.454499 secs 2024-07-26T11:47:32.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11512.454499 secs 2024-07-26T11:47:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11512.454499 secs 2024-07-26T11:47:33.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:32 smithi043 ceph-mon[32384]: pgmap v6602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:33.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:32 smithi133 ceph-mon[37053]: pgmap v6602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:33.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:32 smithi063 ceph-mon[36747]: pgmap v6602: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:35.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:34 smithi043 ceph-mon[32384]: pgmap v6603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:35.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:34 smithi133 ceph-mon[37053]: pgmap v6603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:35.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:34 smithi063 ceph-mon[36747]: pgmap v6603: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:36.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:35 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11501.971158 secs 2024-07-26T11:47:36.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:35 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11501.971158 secs 2024-07-26T11:47:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:35 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11501.971158 secs 2024-07-26T11:47:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11517.454600 secs 2024-07-26T11:47:37.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:36 smithi043 ceph-mon[32384]: pgmap v6604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11517.454600 secs 2024-07-26T11:47:37.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:36 smithi133 ceph-mon[37053]: pgmap v6604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11517.454600 secs 2024-07-26T11:47:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:36 smithi063 ceph-mon[36747]: pgmap v6604: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:38 smithi043 ceph-mon[32384]: pgmap v6605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:39.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:38 smithi133 ceph-mon[37053]: pgmap v6605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:38 smithi063 ceph-mon[36747]: pgmap v6605: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:40 smithi043 ceph-mon[32384]: pgmap v6606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11506.971225 secs 2024-07-26T11:47:41.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:40 smithi133 ceph-mon[37053]: pgmap v6606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11506.971225 secs 2024-07-26T11:47:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:40 smithi063 ceph-mon[36747]: pgmap v6606: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11506.971225 secs 2024-07-26T11:47:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:41 smithi043 ceph-mon[32384]: 1 slow requests, 1 included below; oldest blocked for > 11522.454687 secs 2024-07-26T11:47:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:41 smithi043 ceph-mon[32384]: slow request 11522.454687 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T11:47:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:41 smithi133 ceph-mon[37053]: 1 slow requests, 1 included below; oldest blocked for > 11522.454687 secs 2024-07-26T11:47:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:41 smithi133 ceph-mon[37053]: slow request 11522.454687 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T11:47:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:41 smithi063 ceph-mon[36747]: 1 slow requests, 1 included below; oldest blocked for > 11522.454687 secs 2024-07-26T11:47:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:41 smithi063 ceph-mon[36747]: slow request 11522.454687 seconds old, received at 2024-07-26T08:35:38.255057+0000: client_request(client.15216:15882 rmdir #0x10000000203/DocBook 2024-07-26T08:35:38.253406+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T11:47:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:42 smithi043 ceph-mon[32384]: pgmap v6607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:43.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:42 smithi133 ceph-mon[37053]: pgmap v6607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:43.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:42 smithi063 ceph-mon[36747]: pgmap v6607: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:44 smithi043 ceph-mon[32384]: pgmap v6608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:45.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:44 smithi133 ceph-mon[37053]: pgmap v6608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:45.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:44 smithi063 ceph-mon[36747]: pgmap v6608: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11511.971349 secs 2024-07-26T11:47:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11511.971349 secs 2024-07-26T11:47:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11511.971349 secs 2024-07-26T11:47:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11527.454756 secs 2024-07-26T11:47:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:46 smithi133 ceph-mon[37053]: pgmap v6609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11527.454756 secs 2024-07-26T11:47:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:46 smithi063 ceph-mon[36747]: pgmap v6609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11527.454756 secs 2024-07-26T11:47:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:46 smithi043 ceph-mon[32384]: pgmap v6609: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:48 smithi133 ceph-mon[37053]: pgmap v6610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:49.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:48 smithi063 ceph-mon[36747]: pgmap v6610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:49.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:48 smithi043 ceph-mon[32384]: pgmap v6610: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:51 smithi133 ceph-mon[37053]: pgmap v6611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11516.971470 secs 2024-07-26T11:47:51.285 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:51 smithi043 ceph-mon[32384]: pgmap v6611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:51.286 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11516.971470 secs 2024-07-26T11:47:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:51 smithi063 ceph-mon[36747]: pgmap v6611: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:47:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11516.971470 secs 2024-07-26T11:47:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11532.454892 secs 2024-07-26T11:47:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:52 smithi133 ceph-mon[37053]: pgmap v6612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11532.454892 secs 2024-07-26T11:47:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:52 smithi063 ceph-mon[36747]: pgmap v6612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11532.454892 secs 2024-07-26T11:47:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:52 smithi043 ceph-mon[32384]: pgmap v6612: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:54 smithi043 ceph-mon[32384]: pgmap v6613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:54 smithi133 ceph-mon[37053]: pgmap v6613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:55.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:54 smithi063 ceph-mon[36747]: pgmap v6613: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:55 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 11521.971585 secs 2024-07-26T11:47:56.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:55 smithi043 ceph-mon[32384]: slow request 11521.971584 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T11:47:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:55 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 11521.971585 secs 2024-07-26T11:47:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:55 smithi133 ceph-mon[37053]: slow request 11521.971584 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T11:47:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:55 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 11521.971585 secs 2024-07-26T11:47:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:55 smithi063 ceph-mon[36747]: slow request 11521.971584 seconds old, received at 2024-07-26T08:35:53.349815+0000: peer_request:client.15216:15882 currently dispatched 2024-07-26T11:47:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11537.455013 secs 2024-07-26T11:47:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:56 smithi043 ceph-mon[32384]: pgmap v6614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11537.455013 secs 2024-07-26T11:47:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:56 smithi133 ceph-mon[37053]: pgmap v6614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11537.455013 secs 2024-07-26T11:47:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:56 smithi063 ceph-mon[36747]: pgmap v6614: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:47:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:47:58 smithi043 ceph-mon[32384]: pgmap v6615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:47:58 smithi133 ceph-mon[37053]: pgmap v6615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:47:59.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:47:58 smithi063 ceph-mon[36747]: pgmap v6615: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:00 smithi043 ceph-mon[32384]: pgmap v6616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:00 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11526.971706 secs 2024-07-26T11:48:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:00 smithi133 ceph-mon[37053]: pgmap v6616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:00 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11526.971706 secs 2024-07-26T11:48:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:00 smithi063 ceph-mon[36747]: pgmap v6616: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:00 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11526.971706 secs 2024-07-26T11:48:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11542.455134 secs 2024-07-26T11:48:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11542.455134 secs 2024-07-26T11:48:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11542.455134 secs 2024-07-26T11:48:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:02 smithi043 ceph-mon[32384]: pgmap v6617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:02 smithi133 ceph-mon[37053]: pgmap v6617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:02 smithi063 ceph-mon[36747]: pgmap v6617: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:04 smithi043 ceph-mon[32384]: pgmap v6618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:04 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:48:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:04 smithi133 ceph-mon[37053]: pgmap v6618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:04 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:48:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:04 smithi063 ceph-mon[36747]: pgmap v6618: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:04 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:48:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:48:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:48:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:05 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:48:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:05 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 11531.971829 secs 2024-07-26T11:48:06.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:05 smithi043 ceph-mon[32384]: slow request 11524.664842 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T11:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:05 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:05 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 11531.971829 secs 2024-07-26T11:48:06.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:05 smithi133 ceph-mon[37053]: slow request 11524.664842 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T11:48:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:48:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:48:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:05 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:48:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:05 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 11531.971829 secs 2024-07-26T11:48:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:05 smithi063 ceph-mon[36747]: slow request 11524.664842 seconds old, received at 2024-07-26T08:36:00.656802+0000: client_request(client.25498:16 mksnap #0x1//scheduled-2024-07-26-08_36_00_UTC 2024-07-26T08:36:00.656459+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-07-26T11:48:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:06 smithi043 ceph-mon[32384]: pgmap v6619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:48:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:06 smithi043 ceph-mon[32384]: pgmap v6620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:48:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11547.455224 secs 2024-07-26T11:48:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:06 smithi133 ceph-mon[37053]: pgmap v6619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:48:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:06 smithi133 ceph-mon[37053]: pgmap v6620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:48:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11547.455224 secs 2024-07-26T11:48:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:06 smithi063 ceph-mon[36747]: pgmap v6619: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:48:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:06 smithi063 ceph-mon[36747]: pgmap v6620: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:48:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11547.455224 secs 2024-07-26T11:48:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:08 smithi043 ceph-mon[32384]: pgmap v6621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:48:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:08 smithi133 ceph-mon[37053]: pgmap v6621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:48:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:08 smithi063 ceph-mon[36747]: pgmap v6621: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:48:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:10 smithi043 ceph-mon[32384]: pgmap v6622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:48:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11536.971949 secs 2024-07-26T11:48:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:10 smithi133 ceph-mon[37053]: pgmap v6622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:48:11.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11536.971949 secs 2024-07-26T11:48:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:10 smithi063 ceph-mon[36747]: pgmap v6622: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:48:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11536.971949 secs 2024-07-26T11:48:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11552.455357 secs 2024-07-26T11:48:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11552.455357 secs 2024-07-26T11:48:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11552.455357 secs 2024-07-26T11:48:13.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:12 smithi043 ceph-mon[32384]: pgmap v6623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:48:13.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:12 smithi133 ceph-mon[37053]: pgmap v6623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:48:13.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:12 smithi063 ceph-mon[36747]: pgmap v6623: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:48:15.227 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:14 smithi043 ceph-mon[32384]: pgmap v6624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:48:15.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:14 smithi133 ceph-mon[37053]: pgmap v6624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:48:15.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:14 smithi063 ceph-mon[36747]: pgmap v6624: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:48:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11541.972067 secs 2024-07-26T11:48:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11541.972067 secs 2024-07-26T11:48:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11541.972067 secs 2024-07-26T11:48:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:16 smithi043 ceph-mon[32384]: pgmap v6625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:48:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11557.455477 secs 2024-07-26T11:48:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:16 smithi133 ceph-mon[37053]: pgmap v6625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:48:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11557.455477 secs 2024-07-26T11:48:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:16 smithi063 ceph-mon[36747]: pgmap v6625: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:48:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11557.455477 secs 2024-07-26T11:48:19.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:18 smithi043 ceph-mon[32384]: pgmap v6626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:19.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:18 smithi133 ceph-mon[37053]: pgmap v6626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:19.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:18 smithi063 ceph-mon[36747]: pgmap v6626: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:20 smithi043 ceph-mon[32384]: pgmap v6627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11546.972195 secs 2024-07-26T11:48:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:20 smithi133 ceph-mon[37053]: pgmap v6627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:21.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11546.972195 secs 2024-07-26T11:48:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:20 smithi063 ceph-mon[36747]: pgmap v6627: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11546.972195 secs 2024-07-26T11:48:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11562.455618 secs 2024-07-26T11:48:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11562.455618 secs 2024-07-26T11:48:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11562.455618 secs 2024-07-26T11:48:23.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:22 smithi133 ceph-mon[37053]: pgmap v6628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:23.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:22 smithi063 ceph-mon[36747]: pgmap v6628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:23.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:22 smithi043 ceph-mon[32384]: pgmap v6628: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:25.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:24 smithi133 ceph-mon[37053]: pgmap v6629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:25.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:24 smithi063 ceph-mon[36747]: pgmap v6629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:25.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:24 smithi043 ceph-mon[32384]: pgmap v6629: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11551.972305 secs 2024-07-26T11:48:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11551.972305 secs 2024-07-26T11:48:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11551.972305 secs 2024-07-26T11:48:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:27 smithi133 ceph-mon[37053]: pgmap v6630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11567.455711 secs 2024-07-26T11:48:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:27 smithi063 ceph-mon[36747]: pgmap v6630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11567.455711 secs 2024-07-26T11:48:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:27 smithi043 ceph-mon[32384]: pgmap v6630: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11567.455711 secs 2024-07-26T11:48:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:28 smithi063 ceph-mon[36747]: pgmap v6631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:28 smithi043 ceph-mon[32384]: pgmap v6631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:28.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:28 smithi133 ceph-mon[37053]: pgmap v6631: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:30 smithi043 ceph-mon[32384]: pgmap v6632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:30.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:30 smithi133 ceph-mon[37053]: pgmap v6632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:30.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:30 smithi063 ceph-mon[36747]: pgmap v6632: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:31.385 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11556.972392 secs 2024-07-26T11:48:31.469 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11556.972392 secs 2024-07-26T11:48:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11556.972392 secs 2024-07-26T11:48:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11572.455844 secs 2024-07-26T11:48:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:32 smithi043 ceph-mon[32384]: pgmap v6633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11572.455844 secs 2024-07-26T11:48:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:32 smithi133 ceph-mon[37053]: pgmap v6633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11572.455844 secs 2024-07-26T11:48:32.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:32 smithi063 ceph-mon[36747]: pgmap v6633: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:34 smithi043 ceph-mon[32384]: pgmap v6634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:34.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:34 smithi133 ceph-mon[37053]: pgmap v6634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:34.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:34 smithi063 ceph-mon[36747]: pgmap v6634: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:36 smithi043 ceph-mon[32384]: pgmap v6635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11561.972540 secs 2024-07-26T11:48:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:36 smithi133 ceph-mon[37053]: pgmap v6635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11561.972540 secs 2024-07-26T11:48:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:36 smithi063 ceph-mon[36747]: pgmap v6635: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:36.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11561.972540 secs 2024-07-26T11:48:37.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11577.455927 secs 2024-07-26T11:48:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11577.455927 secs 2024-07-26T11:48:37.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11577.455927 secs 2024-07-26T11:48:38.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:38 smithi043 ceph-mon[32384]: pgmap v6636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:38.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:38 smithi133 ceph-mon[37053]: pgmap v6636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:38.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:38 smithi063 ceph-mon[36747]: pgmap v6636: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:40.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:40 smithi043 ceph-mon[32384]: pgmap v6637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:40.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:40 smithi133 ceph-mon[37053]: pgmap v6637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:40.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:40 smithi063 ceph-mon[36747]: pgmap v6637: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:41.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11566.972619 secs 2024-07-26T11:48:41.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11566.972619 secs 2024-07-26T11:48:41.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11566.972619 secs 2024-07-26T11:48:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:42 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11582.456005 secs 2024-07-26T11:48:42.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:42 smithi043 ceph-mon[32384]: pgmap v6638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:42 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11582.456005 secs 2024-07-26T11:48:42.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:42 smithi133 ceph-mon[37053]: pgmap v6638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:42 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11582.456005 secs 2024-07-26T11:48:42.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:42 smithi063 ceph-mon[36747]: pgmap v6638: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:44.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:44 smithi043 ceph-mon[32384]: pgmap v6639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:44.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:44 smithi133 ceph-mon[37053]: pgmap v6639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:44.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:44 smithi063 ceph-mon[36747]: pgmap v6639: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:46 smithi043 ceph-mon[32384]: pgmap v6640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:46 smithi043 ceph-mon[32384]: 3 slow requests, 1 included below; oldest blocked for > 11571.972722 secs 2024-07-26T11:48:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:46 smithi043 ceph-mon[32384]: slow request 11520.482419 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T11:48:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:46 smithi133 ceph-mon[37053]: pgmap v6640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:46 smithi133 ceph-mon[37053]: 3 slow requests, 1 included below; oldest blocked for > 11571.972722 secs 2024-07-26T11:48:46.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:46 smithi133 ceph-mon[37053]: slow request 11520.482419 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T11:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:46 smithi063 ceph-mon[36747]: pgmap v6640: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:46 smithi063 ceph-mon[36747]: 3 slow requests, 1 included below; oldest blocked for > 11571.972722 secs 2024-07-26T11:48:46.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:46 smithi063 ceph-mon[36747]: slow request 11520.482419 seconds old, received at 2024-07-26T08:36:44.840118+0000: internal op ???:mds.0:4 currently failed to rdlock, waiting 2024-07-26T11:48:47.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:47 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11587.456101 secs 2024-07-26T11:48:47.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:47 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11587.456101 secs 2024-07-26T11:48:47.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:47 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11587.456101 secs 2024-07-26T11:48:48.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:48 smithi043 ceph-mon[32384]: pgmap v6641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:48.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:48 smithi133 ceph-mon[37053]: pgmap v6641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:48.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:48 smithi063 ceph-mon[36747]: pgmap v6641: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:50.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:50 smithi043 ceph-mon[32384]: pgmap v6642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:50.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:50 smithi133 ceph-mon[37053]: pgmap v6642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:50.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:50 smithi063 ceph-mon[36747]: pgmap v6642: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11576.972801 secs 2024-07-26T11:48:51.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11576.972801 secs 2024-07-26T11:48:51.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11576.972801 secs 2024-07-26T11:48:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:52 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11592.456249 secs 2024-07-26T11:48:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:52 smithi043 ceph-mon[32384]: pgmap v6643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:52.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:52 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11592.456249 secs 2024-07-26T11:48:52.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:52 smithi133 ceph-mon[37053]: pgmap v6643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:52 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11592.456249 secs 2024-07-26T11:48:52.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:52 smithi063 ceph-mon[36747]: pgmap v6643: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:48:54.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:54 smithi133 ceph-mon[37053]: pgmap v6644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:54.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:54 smithi063 ceph-mon[36747]: pgmap v6644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:54.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:54 smithi043 ceph-mon[32384]: pgmap v6644: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:56 smithi133 ceph-mon[37053]: pgmap v6645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11581.972888 secs 2024-07-26T11:48:56.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11597.456363 secs 2024-07-26T11:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:56 smithi063 ceph-mon[36747]: pgmap v6645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11581.972888 secs 2024-07-26T11:48:56.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11597.456363 secs 2024-07-26T11:48:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:56 smithi043 ceph-mon[32384]: pgmap v6645: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:48:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11581.972888 secs 2024-07-26T11:48:56.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11597.456363 secs 2024-07-26T11:48:58.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:48:58 smithi133 ceph-mon[37053]: pgmap v6646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:48:58.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:48:58 smithi063 ceph-mon[36747]: pgmap v6646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:48:58.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:48:58 smithi043 ceph-mon[32384]: pgmap v6646: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:00 smithi133 ceph-mon[37053]: pgmap v6647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:49:00.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:00 smithi063 ceph-mon[36747]: pgmap v6647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:49:00.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:00 smithi043 ceph-mon[32384]: pgmap v6647: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-07-26T11:49:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11586.973013 secs 2024-07-26T11:49:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11602.456481 secs 2024-07-26T11:49:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11586.973013 secs 2024-07-26T11:49:01.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11602.456481 secs 2024-07-26T11:49:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11586.973013 secs 2024-07-26T11:49:01.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11602.456481 secs 2024-07-26T11:49:02.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:02 smithi063 ceph-mon[36747]: pgmap v6648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:02.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:02 smithi043 ceph-mon[32384]: pgmap v6648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:02.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:02 smithi133 ceph-mon[37053]: pgmap v6648: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:04.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:04 smithi063 ceph-mon[36747]: pgmap v6649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:04.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:04 smithi043 ceph-mon[32384]: pgmap v6649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:04.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:04 smithi133 ceph-mon[37053]: pgmap v6649: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:49:05.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:05 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:49:05.732 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:05 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:49:05.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:05 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:06 smithi063 ceph-mon[36747]: pgmap v6650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11591.973121 secs 2024-07-26T11:49:06.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11607.456606 secs 2024-07-26T11:49:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:06 smithi043 ceph-mon[32384]: pgmap v6650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:49:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11591.973121 secs 2024-07-26T11:49:06.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11607.456606 secs 2024-07-26T11:49:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:06 smithi133 ceph-mon[37053]: pgmap v6650: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:49:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11591.973121 secs 2024-07-26T11:49:06.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11607.456606 secs 2024-07-26T11:49:07.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:49:07.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:49:07.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:07 smithi063 ceph-mon[36747]: pgmap v6651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:07.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:49:07.667 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:49:07.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:49:07.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:07 smithi133 ceph-mon[37053]: pgmap v6651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:07.668 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:49:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:49:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:49:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:07 smithi043 ceph-mon[32384]: pgmap v6651: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:07.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:49:09.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:09 smithi043 ceph-mon[32384]: pgmap v6652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:49:09.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:09 smithi133 ceph-mon[37053]: pgmap v6652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:49:09.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:09 smithi063 ceph-mon[36747]: pgmap v6652: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:49:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:11 smithi043 ceph-mon[32384]: pgmap v6653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:49:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11596.973241 secs 2024-07-26T11:49:11.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11612.456720 secs 2024-07-26T11:49:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:11 smithi133 ceph-mon[37053]: pgmap v6653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:49:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11596.973241 secs 2024-07-26T11:49:11.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11612.456720 secs 2024-07-26T11:49:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:11 smithi063 ceph-mon[36747]: pgmap v6653: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:49:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11596.973241 secs 2024-07-26T11:49:11.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11612.456720 secs 2024-07-26T11:49:13.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:13 smithi043 ceph-mon[32384]: pgmap v6654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:49:13.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:13 smithi133 ceph-mon[37053]: pgmap v6654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:49:13.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:13 smithi063 ceph-mon[36747]: pgmap v6654: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:49:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:15 smithi043 ceph-mon[32384]: pgmap v6655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:49:15.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:15 smithi133 ceph-mon[37053]: pgmap v6655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:49:15.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:15 smithi063 ceph-mon[36747]: pgmap v6655: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:49:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11601.973358 secs 2024-07-26T11:49:16.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11617.456836 secs 2024-07-26T11:49:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11601.973358 secs 2024-07-26T11:49:16.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11617.456836 secs 2024-07-26T11:49:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11601.973358 secs 2024-07-26T11:49:16.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11617.456836 secs 2024-07-26T11:49:17.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:17 smithi043 ceph-mon[32384]: pgmap v6656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:49:17.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:17 smithi133 ceph-mon[37053]: pgmap v6656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:49:17.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:17 smithi063 ceph-mon[36747]: pgmap v6656: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:49:19.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:19 smithi043 ceph-mon[32384]: pgmap v6657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:19.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:19 smithi133 ceph-mon[37053]: pgmap v6657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:19.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:19 smithi063 ceph-mon[36747]: pgmap v6657: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11606.973450 secs 2024-07-26T11:49:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:21 smithi043 ceph-mon[32384]: pgmap v6658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:21.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11622.456958 secs 2024-07-26T11:49:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11606.973450 secs 2024-07-26T11:49:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:21 smithi133 ceph-mon[37053]: pgmap v6658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:21.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11622.456958 secs 2024-07-26T11:49:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11606.973450 secs 2024-07-26T11:49:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:21 smithi063 ceph-mon[36747]: pgmap v6658: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:21.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11622.456958 secs 2024-07-26T11:49:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:23 smithi043 ceph-mon[32384]: pgmap v6659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:23.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:23 smithi133 ceph-mon[37053]: pgmap v6659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:23.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:23 smithi063 ceph-mon[36747]: pgmap v6659: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:25.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:25 smithi043 ceph-mon[32384]: pgmap v6660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:25.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:25 smithi133 ceph-mon[37053]: pgmap v6660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:25.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:25 smithi063 ceph-mon[36747]: pgmap v6660: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11611.973560 secs 2024-07-26T11:49:26.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11627.457023 secs 2024-07-26T11:49:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11611.973560 secs 2024-07-26T11:49:26.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11627.457023 secs 2024-07-26T11:49:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11611.973560 secs 2024-07-26T11:49:26.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11627.457023 secs 2024-07-26T11:49:27.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:27 smithi043 ceph-mon[32384]: pgmap v6661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:27.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:27 smithi133 ceph-mon[37053]: pgmap v6661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:27.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:27 smithi063 ceph-mon[36747]: pgmap v6661: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:29.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:29 smithi043 ceph-mon[32384]: pgmap v6662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:29.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:29 smithi133 ceph-mon[37053]: pgmap v6662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:29.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:29 smithi063 ceph-mon[36747]: pgmap v6662: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11616.973717 secs 2024-07-26T11:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:31 smithi043 ceph-mon[32384]: pgmap v6663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:31.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11632.457150 secs 2024-07-26T11:49:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11616.973717 secs 2024-07-26T11:49:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:31 smithi133 ceph-mon[37053]: pgmap v6663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:31.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11632.457150 secs 2024-07-26T11:49:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11616.973717 secs 2024-07-26T11:49:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:31 smithi063 ceph-mon[36747]: pgmap v6663: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:31.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11632.457150 secs 2024-07-26T11:49:33.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:33 smithi043 ceph-mon[32384]: pgmap v6664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:33.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:33 smithi133 ceph-mon[37053]: pgmap v6664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:33.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:33 smithi063 ceph-mon[36747]: pgmap v6664: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:34.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02ad400640 1 -- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 msgr2=0x7f02940b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900029257) for more than 900000000 us, fault. 2024-07-26T11:49:34.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02ad400640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 0x7f02940b6250 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f02b0111c20 tx=0x7f029c005f90 comp rx=0 tx=0).stop 2024-07-26T11:49:34.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 msgr2=0x7f02940b6250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-07-26T11:49:34.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02a6a00640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940b3d40 0x7f02940b6250 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02a6a00640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940c1b10 0x7f02940c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:34.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f02940c4510 con 0x7f02940c1b10 2024-07-26T11:49:34.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.357+0000 7f02ad400640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940c1b10 0x7f02940c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:34.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.359+0000 7f02ad400640 1 --2- 172.21.15.43:0/2804401857 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f02940c1b10 0x7f02940c3f30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f029c005fd0 tx=0x7f029c017000 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.477+0000 7f02a5600640 1 -- 172.21.15.43:0/2804401857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f02880062f0 con 0x7f02b00751e0 2024-07-26T11:49:34.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.485+0000 7f02a6a00640 1 -- 172.21.15.43:0/2804401857 <== mon.0 v2:172.21.15.43:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f02880062f0 con 0x7f02b00751e0 2024-07-26T11:49:34.567 INFO:teuthology.orchestra.run.smithi043.stderr:Error ETIMEDOUT: Connection timed out. Please check the client's permission and connection. 2024-07-26T11:49:34.615 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-07-26T11:49:34.616 ERROR:teuthology.run_tasks:Manager failed: full_sequential_finally Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/full_sequential_finally.py", line 45, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/'" 2024-07-26T11:49:34.623 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-07-26T11:49:34.634 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-07-26T11:49:34.635 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/fwd_scrub.py", line 152, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/full_sequential_finally.py", line 45, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2024-07-26T11:49:34.645 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-07-26T11:49:34.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-26T11:49:34.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 -- 172.21.15.43:0/3647075463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 msgr2=0x7f2998102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:34.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 --2- 172.21.15.43:0/3647075463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 0x7f2998102340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2990009ca0 tx=0x7f299002a8c0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 -- 172.21.15.43:0/3647075463 shutdown_connections 2024-07-26T11:49:34.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 --2- 172.21.15.43:0/3647075463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981073f0 0x7f2998107860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 --2- 172.21.15.43:0/3647075463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2998102880 0x7f2998106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 --2- 172.21.15.43:0/3647075463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 0x7f2998102340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.953+0000 7f299f200640 1 -- 172.21.15.43:0/3647075463 >> 172.21.15.43:0/3647075463 conn(0x7f29980fdc10 msgr2=0x7f2998100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.954+0000 7f299f200640 1 -- 172.21.15.43:0/3647075463 shutdown_connections 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.954+0000 7f299f200640 1 -- 172.21.15.43:0/3647075463 wait complete. 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.955+0000 7f299f200640 1 Processor -- start 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.955+0000 7f299f200640 1 -- start start 2024-07-26T11:49:34.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 0x7f29981a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 0x7f29981a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29981073f0 0x7f29981a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2998119970 con 0x7f2998102880 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f29981197f0 con 0x7f29981073f0 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2998119af0 con 0x7f2998101f30 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 0x7f29981a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 0x7f29981a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38054/0 (socket says 172.21.15.43:38054) 2024-07-26T11:49:34.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299d400640 1 -- 172.21.15.43:0/3723010285 learned_addr learned my addr 172.21.15.43:0/3723010285 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299e800640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29981073f0 0x7f29981a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.956+0000 7f299de00640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 0x7f29981a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299e800640 1 -- 172.21.15.43:0/3723010285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 msgr2=0x7f29981a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299e800640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 0x7f29981a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299e800640 1 -- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 msgr2=0x7f29981a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299e800640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 0x7f29981a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299e800640 1 -- 172.21.15.43:0/3723010285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29981a62a0 con 0x7f29981073f0 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299d400640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 0x7f29981a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:49:34.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f299e800640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29981073f0 0x7f29981a5ba0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f299400e940 tx=0x7f299400ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:34.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299400ccc0 con 0x7f29981073f0 2024-07-26T11:49:34.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.957+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2994005020 con 0x7f29981073f0 2024-07-26T11:49:34.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.958+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29981a6590 con 0x7f29981073f0 2024-07-26T11:49:34.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.958+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994004a00 con 0x7f29981073f0 2024-07-26T11:49:34.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.958+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29981acd20 con 0x7f29981073f0 2024-07-26T11:49:34.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.959+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2998106da0 con 0x7f29981073f0 2024-07-26T11:49:34.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.962+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f29940051d0 con 0x7f29981073f0 2024-07-26T11:49:34.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.963+0000 7f298ea00640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f29840b3dc0 0x7f29840b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:34.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.963+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f29940e53c0 con 0x7f29981073f0 2024-07-26T11:49:34.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.963+0000 7f299de00640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f29840b3dc0 0x7f29840b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:34.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.964+0000 7f299de00640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f29840b3dc0 0x7f29840b62d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2990005e30 tx=0x7f2990009360 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:34.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:34.965+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f29940ab390 con 0x7f29981073f0 2024-07-26T11:49:35.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.187+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29981a1490 con 0x7f29981073f0 2024-07-26T11:49:35.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.189+0000 7f298ea00640 1 -- 172.21.15.43:0/3723010285 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+31176 (secure 0 0 0) 0x7f29940aac90 con 0x7f29981073f0 2024-07-26T11:49:35.192 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T11:49:35.192 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":137,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:48:36.627059+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6834/1153480487":"2024-07-27T08:48:36.627023+0000","172.21.15.43:6834/1786973356":"2024-07-27T08:48:19.910805+0000","172.21.15.43:6834/1337199959":"2024-07-27T08:48:02.577599+0000","172.21.15.43:6837/3942566175":"2024-07-27T08:47:45.167883+0000","172.21.15.43:6836/3942566175":"2024-07-27T08:47:45.167883+0000","172.21.15.43:6834/3989413214":"2024-07-27T08:46:52.883914+0000","172.21.15.43:6836/1364452024":"2024-07-27T08:46:36.685805+0000","172.21.15.63:6833/2807089237":"2024-07-27T08:46:20.120464+0000","172.21.15.63:6832/2807089237":"2024-07-27T08:46:20.120464+0000","172.21.15.43:6837/2435252716":"2024-07-27T08:45:58.267217+0000","172.21.15.63:6833/2161114143":"2024-07-27T08:45:39.403951+0000","172.21.15.43:6835/254024538":"2024-07-27T08:47:26.902442+0000","172.21.15.43:6838/1379895152":"2024-07-27T08:45:23.678907+0000","172.21.15.63:6833/194735852":"2024-07-27T08:45:05.988342+0000","172.21.15.43:6837/1562341679":"2024-07-27T08:44:50.072260+0000","172.21.15.63:6832/2026223441":"2024-07-27T08:44:29.479233+0000","172.21.15.63:6833/1808516906":"2024-07-27T08:43:56.375072+0000","172.21.15.43:6837/90216852":"2024-07-27T08:43:40.441207+0000","172.21.15.43:6835/3989413214":"2024-07-27T08:46:52.883914+0000","172.21.15.43:6837/170031347":"2024-07-27T08:43:07.408273+0000","172.21.15.43:6835/1153480487":"2024-07-27T08:48:36.627023+0000","172.21.15.133:6833/4140446689":"2024-07-27T08:42:50.009454+0000","172.21.15.43:6837/888824582":"2024-07-27T08:42:31.421407+0000","172.21.15.43:6835/1786973356":"2024-07-27T08:48:19.910805+0000","172.21.15.43:6836/888824582":"2024-07-27T08:42:31.421407+0000","172.21.15.43:6836/2435252716":"2024-07-27T08:45:58.267217+0000","172.21.15.43:6836/170031347":"2024-07-27T08:43:07.408273+0000","172.21.15.133:6833/1169720192":"2024-07-27T08:42:14.076955+0000","172.21.15.43:6834/254024538":"2024-07-27T08:47:26.902442+0000","172.21.15.133:6832/1169720192":"2024-07-27T08:42:14.076955+0000","172.21.15.133:6833/3876188029":"2024-07-27T08:41:41.060326+0000","172.21.15.63:6836/1305832455":"2024-07-27T08:37:12.350150+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.63:6835/847478222":"2024-07-27T08:40:18.130776+0000","172.21.15.43:6838/2240411764":"2024-07-27T08:36:08.851244+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6837/10005976":"2024-07-27T08:47:10.135865+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.63:6832/1808516906":"2024-07-27T08:43:56.375072+0000","172.21.15.133:6832/1827419050":"2024-07-27T08:40:02.356166+0000","172.21.15.63:6838/2678612487":"2024-07-27T08:38:04.857675+0000","172.21.15.63:6837/3374136004":"2024-07-27T08:39:29.902320+0000","172.21.15.63:6834/847478222":"2024-07-27T08:40:18.130776+0000","172.21.15.63:6837/185000899":"2024-07-27T08:36:40.915762+0000","172.21.15.43:6839/1379895152":"2024-07-27T08:45:23.678907+0000","172.21.15.63:6839/3045590383":"2024-07-27T08:35:50.103234+0000","172.21.15.63:6834/2899086135":"2024-07-27T08:39:46.123624+0000","172.21.15.63:6832/10975952":"2024-07-27T08:43:23.659470+0000","172.21.15.63:6838/3045590383":"2024-07-27T08:35:50.103234+0000","172.21.15.63:6839/1532671211":"2024-07-27T08:36:25.086271+0000","172.21.15.43:6836/10005976":"2024-07-27T08:47:10.135865+0000","172.21.15.43:6841/445875183":"2024-07-27T08:35:49.778048+0000","172.21.15.63:6832/2161114143":"2024-07-27T08:45:39.403951+0000","172.21.15.63:6839/2003000329":"2024-07-27T08:36:56.485489+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.63:6835/2899086135":"2024-07-27T08:39:46.123624+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6839/2240411764":"2024-07-27T08:36:08.851244+0000","172.21.15.63:6837/2043430794":"2024-07-27T08:37:44.544250+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.63:6835/3210906292":"2024-07-27T08:40:49.870638+0000","172.21.15.43:6836/300735951":"2024-07-27T08:44:13.411147+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6835/1337199959":"2024-07-27T08:48:02.577599+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6837/1364452024":"2024-07-27T08:46:36.685805+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6836/737804035":"2024-07-27T08:41:57.894825+0000","172.21.15.63:6838/2003000329":"2024-07-27T08:36:56.485489+0000","172.21.15.133:6832/4140446689":"2024-07-27T08:42:50.009454+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000","172.21.15.133:6833/1827419050":"2024-07-27T08:40:02.356166+0000","172.21.15.43:6836/1562341679":"2024-07-27T08:44:50.072260+0000","172.21.15.43:6836/90216852":"2024-07-27T08:43:40.441207+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.63:6836/185000899":"2024-07-27T08:36:40.915762+0000","172.21.15.63:6832/194735852":"2024-07-27T08:45:05.988342+0000","172.21.15.63:6833/2026223441":"2024-07-27T08:44:29.479233+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.63:6838/2669403450":"2024-07-27T08:37:28.492219+0000","172.21.15.63:6837/1305832455":"2024-07-27T08:37:12.350150+0000","172.21.15.63:6836/2043430794":"2024-07-27T08:37:44.544250+0000","172.21.15.63:6839/2678612487":"2024-07-27T08:38:04.857675+0000","172.21.15.133:6832/3876188029":"2024-07-27T08:41:41.060326+0000","172.21.15.63:6836/4138037593":"2024-07-27T08:38:21.266602+0000","172.21.15.43:6840/445875183":"2024-07-27T08:35:49.778048+0000","172.21.15.63:6834/302781783":"2024-07-27T08:38:36.767530+0000","172.21.15.63:6835/302781783":"2024-07-27T08:38:36.767530+0000","172.21.15.63:6839/2669403450":"2024-07-27T08:37:28.492219+0000","172.21.15.63:6837/2786607239":"2024-07-27T08:38:53.713088+0000","172.21.15.63:6834/3551536194":"2024-07-27T08:41:24.959653+0000","172.21.15.63:6834/763173638":"2024-07-27T08:39:09.711725+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.63:6835/763173638":"2024-07-27T08:39:09.711725+0000","172.21.15.43:6837/300735951":"2024-07-27T08:44:13.411147+0000","172.21.15.63:6836/3374136004":"2024-07-27T08:39:29.902320+0000","172.21.15.133:6832/4203458458":"2024-07-27T08:40:33.812857+0000","172.21.15.63:6833/10975952":"2024-07-27T08:43:23.659470+0000","172.21.15.63:6836/2786607239":"2024-07-27T08:38:53.713088+0000","172.21.15.63:6838/1532671211":"2024-07-27T08:36:25.086271+0000","172.21.15.133:6833/4203458458":"2024-07-27T08:40:33.812857+0000","172.21.15.43:6837/737804035":"2024-07-27T08:41:57.894825+0000","172.21.15.63:6835/3551536194":"2024-07-27T08:41:24.959653+0000","172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.63:6834/3210906292":"2024-07-27T08:40:49.870638+0000","172.21.15.63:6837/4138037593":"2024-07-27T08:38:21.266602+0000","172.21.15.133:6832/641002587":"2024-07-27T08:41:05.579347+0000","172.21.15.133:6833/641002587":"2024-07-27T08:41:05.579347+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f29840b3dc0 msgr2=0x7f29840b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f29840b3dc0 0x7f29840b62d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2990005e30 tx=0x7f2990009360 comp rx=0 tx=0).stop 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29981073f0 msgr2=0x7f29981a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29981073f0 0x7f29981a5ba0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f299400e940 tx=0x7f299400ee00 comp rx=0 tx=0).stop 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 shutdown_connections 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f29840b3dc0 0x7f29840b62d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29981073f0 0x7f29981a5ba0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102880 0x7f29981a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 --2- 172.21.15.43:0/3723010285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2998101f30 0x7f29981a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 >> 172.21.15.43:0/3723010285 conn(0x7f29980fdc10 msgr2=0x7f2998104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:35.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 shutdown_connections 2024-07-26T11:49:35.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.192+0000 7f299f200640 1 -- 172.21.15.43:0/3723010285 wait complete. 2024-07-26T11:49:35.222 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-26T08:22:02.663853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-26T08:27:28.061294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-26T08:27:32.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-07-26T08:27:46.378868+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-07-26T11:49:35.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-26T11:49:35.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 -- 172.21.15.43:0/1159025319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104c60 msgr2=0x7f47bc10d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 --2- 172.21.15.43:0/1159025319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104c60 0x7f47bc10d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009900 tx=0x7f47a402a3f0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 -- 172.21.15.43:0/1159025319 shutdown_connections 2024-07-26T11:49:35.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 --2- 172.21.15.43:0/1159025319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 0x7f47bc10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 --2- 172.21.15.43:0/1159025319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104c60 0x7f47bc10d1a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 --2- 172.21.15.43:0/1159025319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47bc104310 0x7f47bc104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 -- 172.21.15.43:0/1159025319 >> 172.21.15.43:0/1159025319 conn(0x7f47bc0fdde0 msgr2=0x7f47bc100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 -- 172.21.15.43:0/1159025319 shutdown_connections 2024-07-26T11:49:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.500+0000 7f47c3800640 1 -- 172.21.15.43:0/1159025319 wait complete. 2024-07-26T11:49:35.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.501+0000 7f47c3800640 1 Processor -- start 2024-07-26T11:49:35.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.501+0000 7f47c3800640 1 -- start start 2024-07-26T11:49:35.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c3800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 0x7f47bc199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:35.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c3800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47bc104c60 0x7f47bc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c3800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 0x7f47bc19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c3800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc113520 con 0x7f47bc104310 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c3800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc1133a0 con 0x7f47bc10d770 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c3800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc1136a0 con 0x7f47bc104c60 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 0x7f47bc199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 0x7f47bc199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38070/0 (socket says 172.21.15.43:38070) 2024-07-26T11:49:35.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c0e00640 1 -- 172.21.15.43:0/657041761 learned_addr learned my addr 172.21.15.43:0/657041761 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47c1800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 0x7f47bc19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.502+0000 7f47bbe00640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47bc104c60 0x7f47bc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c1800640 1 -- 172.21.15.43:0/657041761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47bc104c60 msgr2=0x7f47bc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c1800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47bc104c60 0x7f47bc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c1800640 1 -- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 msgr2=0x7f47bc199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c1800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 0x7f47bc199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c1800640 1 -- 172.21.15.43:0/657041761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc19fdf0 con 0x7f47bc10d770 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c0e00640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 0x7f47bc199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:49:35.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c1800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 0x7f47bc19f6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e970 tx=0x7f47b400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:35.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400ccc0 con 0x7f47bc10d770 2024-07-26T11:49:35.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47b4005020 con 0x7f47bc10d770 2024-07-26T11:49:35.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc1a00e0 con 0x7f47bc10d770 2024-07-26T11:49:35.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4004a00 con 0x7f47bc10d770 2024-07-26T11:49:35.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.503+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1a6870 con 0x7f47bc10d770 2024-07-26T11:49:35.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.505+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc104720 con 0x7f47bc10d770 2024-07-26T11:49:35.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.507+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f47b40051d0 con 0x7f47bc10d770 2024-07-26T11:49:35.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.509+0000 7f47b9600640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f47a00b3dc0 0x7f47a00b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:35.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.509+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f47b40e53b0 con 0x7f47bc10d770 2024-07-26T11:49:35.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.509+0000 7f47c0e00640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f47a00b3dc0 0x7f47a00b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:35.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.510+0000 7f47c0e00640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f47a00b3dc0 0x7f47a00b62d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00f7d0 tx=0x7f47ac009500 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:35.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.510+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f47b40ab2f0 con 0x7f47bc10d770 2024-07-26T11:49:35.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.725+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47bc1a6ad0 con 0x7f47bc10d770 2024-07-26T11:49:35.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.727+0000 7f47b9600640 1 -- 172.21.15.43:0/657041761 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) ==== 93+0+10 (secure 0 0 0) 0x7f47b40aabf0 con 0x7f47bc10d770 2024-07-26T11:49:35.728 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-07-26T11:49:35.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f47a00b3dc0 msgr2=0x7f47a00b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f47a00b3dc0 0x7f47a00b62d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00f7d0 tx=0x7f47ac009500 comp rx=0 tx=0).stop 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 msgr2=0x7f47bc19f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 0x7f47bc19f6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e970 tx=0x7f47b400ee30 comp rx=0 tx=0).stop 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 shutdown_connections 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f47a00b3dc0 0x7f47a00b62d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47bc104c60 0x7f47bc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47bc10d770 0x7f47bc19f6f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 --2- 172.21.15.43:0/657041761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47bc104310 0x7f47bc199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:35.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 >> 172.21.15.43:0/657041761 conn(0x7f47bc0fdde0 msgr2=0x7f47bc1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:35.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 shutdown_connections 2024-07-26T11:49:35.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:35.729+0000 7f47c3800640 1 -- 172.21.15.43:0/657041761 wait complete. 2024-07-26T11:49:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:35 smithi043 ceph-mon[32384]: pgmap v6665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:35 smithi043 ceph-mon[32384]: from='client.16329 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T11:49:35.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:35 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3723010285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T11:49:35.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-26T11:49:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:35 smithi133 ceph-mon[37053]: pgmap v6665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:35 smithi133 ceph-mon[37053]: from='client.16329 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T11:49:35.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:35 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3723010285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T11:49:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:35 smithi063 ceph-mon[36747]: pgmap v6665: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:35 smithi063 ceph-mon[36747]: from='client.16329 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T11:49:35.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:35 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3723010285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T11:49:36.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 -- 172.21.15.43:0/3368309798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 msgr2=0x7f07fc108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 --2- 172.21.15.43:0/3368309798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc108100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009900 tx=0x7f07e802a3f0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 -- 172.21.15.43:0/3368309798 shutdown_connections 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 --2- 172.21.15.43:0/3368309798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc108640 0x7f07fc10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 --2- 172.21.15.43:0/3368309798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc108100 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 --2- 172.21.15.43:0/3368309798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc1023c0 0x7f07fc1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 -- 172.21.15.43:0/3368309798 >> 172.21.15.43:0/3368309798 conn(0x7f07fc0fdde0 msgr2=0x7f07fc100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 -- 172.21.15.43:0/3368309798 shutdown_connections 2024-07-26T11:49:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.036+0000 7f0802000640 1 -- 172.21.15.43:0/3368309798 wait complete. 2024-07-26T11:49:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 Processor -- start 2024-07-26T11:49:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 -- start start 2024-07-26T11:49:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 0x7f07fc0fe310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc0fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc108640 0x7f07fc0fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112470 con 0x7f07fc1023c0 2024-07-26T11:49:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1122f0 con 0x7f07fc107cf0 2024-07-26T11:49:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.038+0000 7f0802000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1125f0 con 0x7f07fc108640 2024-07-26T11:49:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 0x7f07fc0fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07faa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc0fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 0x7f07fc0fe310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38090/0 (socket says 172.21.15.43:38090) 2024-07-26T11:49:36.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 -- 172.21.15.43:0/1367614987 learned_addr learned my addr 172.21.15.43:0/1367614987 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:36.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fbe00640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc108640 0x7f07fc0fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 -- 172.21.15.43:0/1367614987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc108640 msgr2=0x7f07fc0fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc108640 0x7f07fc0fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 -- 172.21.15.43:0/1367614987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 msgr2=0x7f07fc0fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc0fe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fb400640 1 -- 172.21.15.43:0/1367614987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc1a8190 con 0x7f07fc1023c0 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07fbe00640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc108640 0x7f07fc0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:49:36.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.039+0000 7f07faa00640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc0fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:49:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.040+0000 7f07fb400640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 0x7f07fc0fe310 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e9f0 tx=0x7f07ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.040+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00cd80 con 0x7f07fc1023c0 2024-07-26T11:49:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.040+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f07ec010900 con 0x7f07fc1023c0 2024-07-26T11:49:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.040+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec018920 con 0x7f07fc1023c0 2024-07-26T11:49:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.040+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc1a8480 con 0x7f07fc1023c0 2024-07-26T11:49:36.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.040+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc1a8950 con 0x7f07fc1023c0 2024-07-26T11:49:36.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.042+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc1027d0 con 0x7f07fc1023c0 2024-07-26T11:49:36.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.044+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f07ec010ab0 con 0x7f07fc1023c0 2024-07-26T11:49:36.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.046+0000 7f07f3e00640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f07e00b3d70 0x7f07e00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.046+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f07ec0e5740 con 0x7f07fc1023c0 2024-07-26T11:49:36.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.046+0000 7f07faa00640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f07e00b3d70 0x7f07e00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.047+0000 7f07faa00640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f07e00b3d70 0x7f07e00b6280 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07e802a9e0 tx=0x7f07e8000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:36.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.050+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f07ec0ab030 con 0x7f07fc1023c0 2024-07-26T11:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.262+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f07fc1a8d50 con 0x7f07fc1023c0 2024-07-26T11:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.263+0000 7f07f3e00640 1 -- 172.21.15.43:0/1367614987 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) ==== 104+0+11 (secure 0 0 0) 0x7f07ec0af580 con 0x7f07fc1023c0 2024-07-26T11:49:36.265 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-07-26T11:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f07e00b3d70 msgr2=0x7f07e00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f07e00b3d70 0x7f07e00b6280 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07e802a9e0 tx=0x7f07e8000bc0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 msgr2=0x7f07fc0fe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 0x7f07fc0fe310 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e9f0 tx=0x7f07ec00eeb0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 shutdown_connections 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f07e00b3d70 0x7f07e00b6280 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07fc108640 0x7f07fc0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07fc107cf0 0x7f07fc0fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 --2- 172.21.15.43:0/1367614987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07fc1023c0 0x7f07fc0fe310 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.266+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 >> 172.21.15.43:0/1367614987 conn(0x7f07fc0fdde0 msgr2=0x7f07fc105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.267+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 shutdown_connections 2024-07-26T11:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.267+0000 7f0802000640 1 -- 172.21.15.43:0/1367614987 wait complete. 2024-07-26T11:49:36.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-26T11:49:36.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 -- 172.21.15.43:0/3013471273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c113ec0 msgr2=0x7f8c4c1162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 --2- 172.21.15.43:0/3013471273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c113ec0 0x7f8c4c1162e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009be0 tx=0x7f8c4402a6d0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 -- 172.21.15.43:0/3013471273 shutdown_connections 2024-07-26T11:49:36.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 --2- 172.21.15.43:0/3013471273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c113ec0 0x7f8c4c1162e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 --2- 172.21.15.43:0/3013471273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4c077cc0 0x7f8c4c113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 --2- 172.21.15.43:0/3013471273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c4c077370 0x7f8c4c077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 -- 172.21.15.43:0/3013471273 >> 172.21.15.43:0/3013471273 conn(0x7f8c4c100f90 msgr2=0x7f8c4c1033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:36.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 -- 172.21.15.43:0/3013471273 shutdown_connections 2024-07-26T11:49:36.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.581+0000 7f8c4b200640 1 -- 172.21.15.43:0/3013471273 wait complete. 2024-07-26T11:49:36.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.582+0000 7f8c4b200640 1 Processor -- start 2024-07-26T11:49:36.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.582+0000 7f8c4b200640 1 -- start start 2024-07-26T11:49:36.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 0x7f8c4c1a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c4c077cc0 0x7f8c4c1a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4c113ec0 0x7f8c4c1a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c119970 con 0x7f8c4c113ec0 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1197f0 con 0x7f8c4c077370 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c119af0 con 0x7f8c4c077cc0 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c49e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 0x7f8c4c1a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c49e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 0x7f8c4c1a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:46484/0 (socket says 172.21.15.43:46484) 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c49e00640 1 -- 172.21.15.43:0/1346493728 learned_addr learned my addr 172.21.15.43:0/1346493728 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:36.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c41400640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c4c077cc0 0x7f8c4c1a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c4a800640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4c113ec0 0x7f8c4c1a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c49e00640 1 -- 172.21.15.43:0/1346493728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c4c077cc0 msgr2=0x7f8c4c1a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.583+0000 7f8c49e00640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c4c077cc0 0x7f8c4c1a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c49e00640 1 -- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4c113ec0 msgr2=0x7f8c4c1a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c49e00640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4c113ec0 0x7f8c4c1a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c49e00640 1 -- 172.21.15.43:0/1346493728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c1a6220 con 0x7f8c4c077370 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c49e00640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 0x7f8c4c1a02f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d950 tx=0x7f8c3c00dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c017030 con 0x7f8c4c077370 2024-07-26T11:49:36.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c3c004020 con 0x7f8c4c077370 2024-07-26T11:49:36.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c1a6510 con 0x7f8c4c077370 2024-07-26T11:49:36.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c005610 con 0x7f8c4c077370 2024-07-26T11:49:36.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.584+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c1acca0 con 0x7f8c4c077370 2024-07-26T11:49:36.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.586+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4c077780 con 0x7f8c4c077370 2024-07-26T11:49:36.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.588+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8c3c0041d0 con 0x7f8c4c077370 2024-07-26T11:49:36.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.589+0000 7f8c43400640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8c300b3d40 0x7f8c300b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:36.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.589+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f8c3c0e4e30 con 0x7f8c4c077370 2024-07-26T11:49:36.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.590+0000 7f8c41400640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8c300b3d40 0x7f8c300b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:36.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.590+0000 7f8c41400640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8c300b3d40 0x7f8c300b6250 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c07abe0 tx=0x7f8c34009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:36.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.594+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8c3c0aad70 con 0x7f8c4c077370 2024-07-26T11:49:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11621.973856 secs 2024-07-26T11:49:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11637.457252 secs 2024-07-26T11:49:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/657041761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T11:49:36.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:36 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1367614987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T11:49:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11621.973856 secs 2024-07-26T11:49:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11637.457252 secs 2024-07-26T11:49:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:36 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/657041761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T11:49:36.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:36 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1367614987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T11:49:36.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.812+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8c4c02e0c0 con 0x7f8c4c077370 2024-07-26T11:49:36.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.813+0000 7f8c43400640 1 -- 172.21.15.43:0/1346493728 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) ==== 100+0+11 (secure 0 0 0) 0x7f8c3c0aa670 con 0x7f8c4c077370 2024-07-26T11:49:36.815 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-07-26T11:49:36.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11621.973856 secs 2024-07-26T11:49:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11637.457252 secs 2024-07-26T11:49:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:36 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/657041761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T11:49:36.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:36 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1367614987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T11:49:36.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.816+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8c300b3d40 msgr2=0x7f8c300b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.816+0000 7f8c4b200640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8c300b3d40 0x7f8c300b6250 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c07abe0 tx=0x7f8c34009260 comp rx=0 tx=0).stop 2024-07-26T11:49:36.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.816+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 msgr2=0x7f8c4c1a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:36.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.816+0000 7f8c4b200640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 0x7f8c4c1a02f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d950 tx=0x7f8c3c00dd50 comp rx=0 tx=0).stop 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 shutdown_connections 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f8c300b3d40 0x7f8c300b6250 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c4c077cc0 0x7f8c4c1a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4c113ec0 0x7f8c4c1a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 --2- 172.21.15.43:0/1346493728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c4c077370 0x7f8c4c1a02f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 >> 172.21.15.43:0/1346493728 conn(0x7f8c4c100f90 msgr2=0x7f8c4c115ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 shutdown_connections 2024-07-26T11:49:36.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:36.817+0000 7f8c4b200640 1 -- 172.21.15.43:0/1346493728 wait complete. 2024-07-26T11:49:36.848 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-07-26T11:49:37.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.137+0000 7f0661600640 1 -- 172.21.15.43:0/4086373711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c108f80 msgr2=0x7f065c109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.137+0000 7f0661600640 1 --2- 172.21.15.43:0/4086373711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c108f80 0x7f065c109390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0648009900 tx=0x7f064802a3f0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 -- 172.21.15.43:0/4086373711 shutdown_connections 2024-07-26T11:49:37.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 --2- 172.21.15.43:0/4086373711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c1098d0 0x7f065c110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 --2- 172.21.15.43:0/4086373711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c108f80 0x7f065c109390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 --2- 172.21.15.43:0/4086373711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c101550 0x7f065c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 -- 172.21.15.43:0/4086373711 >> 172.21.15.43:0/4086373711 conn(0x7f065c076020 msgr2=0x7f065c076480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:37.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 -- 172.21.15.43:0/4086373711 shutdown_connections 2024-07-26T11:49:37.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.138+0000 7f0661600640 1 -- 172.21.15.43:0/4086373711 wait complete. 2024-07-26T11:49:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.139+0000 7f0661600640 1 Processor -- start 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.139+0000 7f0661600640 1 -- start start 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f0661600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c101550 0x7f065c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f0661600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 0x7f065c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f0661600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c1098d0 0x7f065c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f0661600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f065c113530 con 0x7f065c108f80 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f0661600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f065c1133b0 con 0x7f065c1098d0 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f0661600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f065c1136b0 con 0x7f065c101550 2024-07-26T11:49:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f065a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 0x7f065c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f065a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 0x7f065c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38118/0 (socket says 172.21.15.43:38118) 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f065a000640 1 -- 172.21.15.43:0/2539924189 learned_addr learned my addr 172.21.15.43:0/2539924189 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f065b400640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c1098d0 0x7f065c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.140+0000 7f065aa00640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c101550 0x7f065c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065a000640 1 -- 172.21.15.43:0/2539924189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c101550 msgr2=0x7f065c199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065a000640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c101550 0x7f065c199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065a000640 1 -- 172.21.15.43:0/2539924189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c1098d0 msgr2=0x7f065c19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065a000640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c1098d0 0x7f065c19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065a000640 1 -- 172.21.15.43:0/2539924189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c19ff00 con 0x7f065c108f80 2024-07-26T11:49:37.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065b400640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c1098d0 0x7f065c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:49:37.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.141+0000 7f065a000640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 0x7f065c19a570 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0648005940 tx=0x7f06480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:37.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.142+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064803f030 con 0x7f065c108f80 2024-07-26T11:49:37.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.142+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c1a0190 con 0x7f065c108f80 2024-07-26T11:49:37.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.142+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06480318f0 con 0x7f065c108f80 2024-07-26T11:49:37.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.142+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648035070 con 0x7f065c108f80 2024-07-26T11:49:37.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.142+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c1a6980 con 0x7f065c108f80 2024-07-26T11:49:37.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.143+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c102540 con 0x7f065c108f80 2024-07-26T11:49:37.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.147+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0648042030 con 0x7f065c108f80 2024-07-26T11:49:37.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.149+0000 7f0653400640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f06400b3d40 0x7f06400b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.149+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f0648105a10 con 0x7f065c108f80 2024-07-26T11:49:37.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.149+0000 7f065aa00640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f06400b3d40 0x7f06400b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.150+0000 7f065aa00640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f06400b3d40 0x7f06400b6250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f064c00bbe0 tx=0x7f064c00b390 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:37.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.151+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f06480cb300 con 0x7f065c108f80 2024-07-26T11:49:37.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.368+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f065c10b6a0 con 0x7f065c108f80 2024-07-26T11:49:37.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.369+0000 7f0653400640 1 -- 172.21.15.43:0/2539924189 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v137) ==== 103+0+11 (secure 0 0 0) 0x7f06480cf850 con 0x7f065c108f80 2024-07-26T11:49:37.371 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-07-26T11:49:37.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f06400b3d40 msgr2=0x7f06400b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f06400b3d40 0x7f06400b6250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f064c00bbe0 tx=0x7f064c00b390 comp rx=0 tx=0).stop 2024-07-26T11:49:37.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 msgr2=0x7f065c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 0x7f065c19a570 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0648005940 tx=0x7f06480042f0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 shutdown_connections 2024-07-26T11:49:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f06400b3d40 0x7f06400b6250 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f065c1098d0 0x7f065c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f065c108f80 0x7f065c19a570 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 --2- 172.21.15.43:0/2539924189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c101550 0x7f065c199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 >> 172.21.15.43:0/2539924189 conn(0x7f065c076020 msgr2=0x7f065c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:37.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.372+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 shutdown_connections 2024-07-26T11:49:37.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.373+0000 7f0661600640 1 -- 172.21.15.43:0/2539924189 wait complete. 2024-07-26T11:49:37.401 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-07-26T11:49:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.679+0000 7f7b53200640 1 -- 172.21.15.43:0/4079753803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5410ae60 msgr2=0x7f7b5410b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.679+0000 7f7b53200640 1 --2- 172.21.15.43:0/4079753803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5410ae60 0x7f7b5410b270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009900 tx=0x7f7b3c02a3f0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 -- 172.21.15.43:0/4079753803 shutdown_connections 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 --2- 172.21.15.43:0/4079753803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b5410b7b0 0x7f7b54111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 --2- 172.21.15.43:0/4079753803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5410ae60 0x7f7b5410b270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 --2- 172.21.15.43:0/4079753803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b54105530 0x7f7b54105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 -- 172.21.15.43:0/4079753803 >> 172.21.15.43:0/4079753803 conn(0x7f7b54100f90 msgr2=0x7f7b541033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 -- 172.21.15.43:0/4079753803 shutdown_connections 2024-07-26T11:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.680+0000 7f7b53200640 1 -- 172.21.15.43:0/4079753803 wait complete. 2024-07-26T11:49:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 Processor -- start 2024-07-26T11:49:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 -- start start 2024-07-26T11:49:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b54105530 0x7f7b5419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 0x7f7b5419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b5410b7b0 0x7f7b541a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7b541155e0 con 0x7f7b54105530 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54115460 con 0x7f7b5410b7b0 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.681+0000 7f7b53200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54115760 con 0x7f7b5410ae60 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b54105530 0x7f7b5419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 0x7f7b5419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 0x7f7b5419c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:35786/0 (socket says 172.21.15.43:35786) 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 -- 172.21.15.43:0/3179496812 learned_addr learned my addr 172.21.15.43:0/3179496812 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b54105530 0x7f7b5419bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38132/0 (socket says 172.21.15.43:38132) 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b52800640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b5410b7b0 0x7f7b541a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 -- 172.21.15.43:0/3179496812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b5410b7b0 msgr2=0x7f7b541a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b5410b7b0 0x7f7b541a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 -- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b54105530 msgr2=0x7f7b5419bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b54105530 0x7f7b5419bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 -- 172.21.15.43:0/3179496812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b541a1eb0 con 0x7f7b5410ae60 2024-07-26T11:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.682+0000 7f7b51400640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 0x7f7b5419c520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c02a9e0 tx=0x7f7b3c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.683+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c03f070 con 0x7f7b5410ae60 2024-07-26T11:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.683+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b3c031be0 con 0x7f7b5410ae60 2024-07-26T11:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.683+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b541a2140 con 0x7f7b5410ae60 2024-07-26T11:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.683+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c035030 con 0x7f7b5410ae60 2024-07-26T11:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.683+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b541a8930 con 0x7f7b5410ae60 2024-07-26T11:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.684+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b54105940 con 0x7f7b5410ae60 2024-07-26T11:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.687+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7b3c042070 con 0x7f7b5410ae60 2024-07-26T11:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.688+0000 7f7b4aa00640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7b380b3d40 0x7f7b380b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.688+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f7b3c105d70 con 0x7f7b5410ae60 2024-07-26T11:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.689+0000 7f7b51e00640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7b380b3d40 0x7f7b380b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.689+0000 7f7b51e00640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7b380b3d40 0x7f7b380b6250 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009bd0 tx=0x7f7b44005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.690+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7b3c0cbcb0 con 0x7f7b5410ae60 2024-07-26T11:49:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:37 smithi043 ceph-mon[32384]: pgmap v6666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:37 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1346493728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T11:49:37.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:37 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/2539924189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-07-26T11:49:37.765 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:37 smithi133 ceph-mon[37053]: pgmap v6666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:37 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1346493728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T11:49:37.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:37 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/2539924189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-07-26T11:49:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:37 smithi063 ceph-mon[36747]: pgmap v6666: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:37 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1346493728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T11:49:37.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:37 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/2539924189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-07-26T11:49:37.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.963+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f7b5419d0a0 con 0x7f7b5410ae60 2024-07-26T11:49:37.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.973+0000 7f7b4aa00640 1 -- 172.21.15.43:0/3179496812 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+821908 (secure 0 0 0) 0x7f7b5419d0a0 con 0x7f7b5410ae60 2024-07-26T11:49:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 25, 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "active_gid": 24110, 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "active_name": "x", 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addrs": { 2024-07-26T11:49:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6800", 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3495158800 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-07-26T11:49:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6801", 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3495158800 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addr": "172.21.15.43:6801/3495158800", 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "active_change": "2024-07-26T08:19:34.498245+0000", 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "active_mgr_features": 4540701547738038271, 2024-07-26T11:49:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "available": true, 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "standbys": [ 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 24145, 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "z", 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-07-26T11:49:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-07-26T11:49:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-07-26T11:49:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-07-26T11:49:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-07-26T11:49:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-07-26T11:49:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-07-26T11:49:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.030 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.031 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.032 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.034 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.036 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.037 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.038 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.039 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.040 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.041 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.043 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.044 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.045 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-07-26T11:49:38.047 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.048 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-07-26T11:49:38.049 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-26T11:49:38.050 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.051 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.053 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.054 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-07-26T11:49:38.055 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.057 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.058 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.061 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-26T11:49:38.063 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.064 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.065 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.066 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.067 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.068 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.069 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-07-26T11:49:38.070 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.071 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.073 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-26T11:49:38.074 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.075 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-07-26T11:49:38.077 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-07-26T11:49:38.078 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.079 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.081 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.082 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.084 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nginx": { 2024-07-26T11:49:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nginx", 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.086 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nginx container image", 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.087 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.088 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.089 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-07-26T11:49:38.090 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.091 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.094 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-07-26T11:49:38.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.096 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.097 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.098 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.099 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.100 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-07-26T11:49:38.101 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.102 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-07-26T11:49:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-07-26T11:49:38.104 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.105 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.106 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.107 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.108 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-07-26T11:49:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.110 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.111 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.112 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.113 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-07-26T11:49:38.114 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-26T11:49:38.115 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.116 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.117 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.118 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.119 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.120 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.121 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.122 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.123 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.124 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.125 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.126 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.127 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.128 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.129 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.130 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.133 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.135 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-07-26T11:49:38.136 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.137 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.138 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-26T11:49:38.139 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.140 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.141 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.142 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.143 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.144 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.145 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.146 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-07-26T11:49:38.147 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.148 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.149 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.150 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.151 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.152 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-07-26T11:49:38.154 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-26T11:49:38.155 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.156 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.157 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.158 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.159 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-07-26T11:49:38.161 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-26T11:49:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-07-26T11:49:38.163 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.164 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.165 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.167 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.168 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.169 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.170 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.171 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.173 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.174 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.175 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.176 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.177 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.178 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.179 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-26T11:49:38.180 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.181 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.183 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-26T11:49:38.185 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.186 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-26T11:49:38.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.188 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.189 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.190 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.191 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-26T11:49:38.192 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.196 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-26T11:49:38.197 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.198 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.199 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.200 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.201 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-26T11:49:38.202 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.203 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.204 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-07-26T11:49:38.207 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.210 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.211 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.213 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.214 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.215 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.216 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.217 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.218 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.219 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.220 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.221 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-26T11:49:38.222 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.223 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.225 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-26T11:49:38.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.228 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.229 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.230 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.231 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.233 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-26T11:49:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.235 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.236 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-26T11:49:38.239 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.240 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-26T11:49:38.241 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.242 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.243 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.244 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:38.245 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.247 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-26T11:49:38.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.249 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.250 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.251 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.252 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.254 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-26T11:49:38.255 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.257 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.258 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.259 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.260 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.261 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.262 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.263 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-07-26T11:49:38.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.265 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.265 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.265 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.266 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.266 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.266 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.266 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.266 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.267 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.268 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.269 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.270 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.272 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.273 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.275 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.276 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-07-26T11:49:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.278 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.279 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.281 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.282 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.283 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.284 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-07-26T11:49:38.287 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-07-26T11:49:38.289 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.290 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.291 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.292 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.293 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.294 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.295 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.296 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.297 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.298 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.300 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.301 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.302 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.303 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.304 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-07-26T11:49:38.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-26T11:49:38.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.307 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.309 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.310 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.311 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.312 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.313 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.314 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.316 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.317 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.319 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.320 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.323 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.324 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.325 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.326 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.327 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-07-26T11:49:38.328 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.329 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.330 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-07-26T11:49:38.333 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-07-26T11:49:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-07-26T11:49:38.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-26T11:49:38.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.338 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-07-26T11:49:38.339 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.340 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.341 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.342 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.343 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.344 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.345 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.346 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.347 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.348 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.349 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-07-26T11:49:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-07-26T11:49:38.351 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.352 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.353 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.354 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-07-26T11:49:38.355 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-26T11:49:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.357 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.360 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.362 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.363 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.365 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.366 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.367 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.368 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.369 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.372 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.373 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.374 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.375 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.376 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.379 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.380 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.381 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.382 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.383 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.384 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-07-26T11:49:38.385 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-26T11:49:38.386 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.391 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.392 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.393 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.394 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.397 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-07-26T11:49:38.398 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.400 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.401 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.402 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.404 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.405 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.406 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.408 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-07-26T11:49:38.409 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.410 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.411 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.412 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.413 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.415 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.416 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.417 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.419 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.420 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.422 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.423 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.424 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.425 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.426 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.427 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.428 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.429 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.430 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.432 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.437 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.438 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.439 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.440 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.443 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.445 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.446 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.447 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.448 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.449 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.451 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.452 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.453 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.454 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.455 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.456 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.457 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.458 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.459 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.460 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.461 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.463 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.465 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.466 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.467 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.468 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.469 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.470 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.471 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.472 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.474 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.475 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.476 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.477 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.478 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.480 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.481 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.483 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.485 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.486 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.487 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.488 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.489 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.490 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.491 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.492 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.494 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.495 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.496 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.497 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.498 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.499 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.500 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.501 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-07-26T11:49:38.502 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.503 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.505 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.506 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.508 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.509 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.510 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.511 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.512 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.513 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.514 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-07-26T11:49:38.515 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-07-26T11:49:38.516 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.517 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.519 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.520 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.521 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.522 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.523 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-26T11:49:38.524 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-26T11:49:38.524 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.524 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.524 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.524 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.525 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.527 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-07-26T11:49:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.541 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.543 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.544 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.546 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.547 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.548 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.549 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.550 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.552 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.553 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.554 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.555 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.556 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-07-26T11:49:38.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.558 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.559 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.560 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.561 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.562 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.563 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.564 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.565 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.566 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.567 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.568 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.569 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.570 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.571 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.572 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.573 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.574 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.575 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.576 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.577 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.578 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.579 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.580 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-07-26T11:49:38.582 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.583 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.584 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.586 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.588 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.589 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.591 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "secondary_zone_period_retry_limit": { 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.593 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.594 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.595 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.596 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.597 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.600 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.601 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.602 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.603 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.604 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.605 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.608 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.611 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.612 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.614 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.615 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.617 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.618 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.619 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-07-26T11:49:38.620 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.621 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-07-26T11:49:38.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.623 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.624 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.626 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-07-26T11:49:38.627 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.628 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.629 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.630 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.631 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.634 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.635 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.636 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.637 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.638 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.639 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.640 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smb", 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.641 INFO:teuthology.orchestra.run.smithi043.stdout: "internal_store_backend": { 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "internal_store_backend", 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.643 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.644 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.645 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.647 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.648 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.649 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.650 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.651 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.652 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.653 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "update_orchestration": { 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "update_orchestration", 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.654 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.655 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.656 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.657 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.658 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-07-26T11:49:38.659 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.660 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.661 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.663 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.665 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.666 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.667 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.668 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.669 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.670 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.671 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.672 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.673 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.674 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.675 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.676 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.677 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.689 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.692 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.693 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.694 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.695 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.696 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.697 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.698 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.699 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.700 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.701 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.702 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.703 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.704 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.705 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.706 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.707 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.709 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.711 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-07-26T11:49:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-26T11:49:38.713 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.714 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.715 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.716 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-07-26T11:49:38.717 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.718 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-07-26T11:49:38.719 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.720 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.721 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.722 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.723 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:38.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.726 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.727 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.728 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-07-26T11:49:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.730 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.731 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.733 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.734 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.735 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.736 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.738 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.740 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.741 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.742 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.743 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-07-26T11:49:38.744 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.745 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-07-26T11:49:38.746 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.747 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.748 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.749 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.750 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.751 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.753 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.754 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.755 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-07-26T11:49:38.757 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.758 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.759 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.760 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.761 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.763 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.764 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.766 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-07-26T11:49:38.768 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-07-26T11:49:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.770 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.774 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.775 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.776 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.778 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:38.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.780 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.781 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.782 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.783 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.784 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.785 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.786 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.788 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.789 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.790 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.791 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.792 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.793 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.794 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.795 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 24152, 2024-07-26T11:49:38.796 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "y", 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:38.797 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.799 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.800 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.801 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.802 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.803 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.804 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.805 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.806 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.807 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.808 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.809 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.810 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.811 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-07-26T11:49:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-07-26T11:49:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.814 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.815 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.816 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.817 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.818 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-07-26T11:49:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-07-26T11:49:38.820 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.821 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.822 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.823 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.824 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-07-26T11:49:38.825 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.826 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-07-26T11:49:38.827 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.829 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-26T11:49:38.830 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.831 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.832 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-07-26T11:49:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-07-26T11:49:38.834 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-07-26T11:49:38.835 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.836 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.837 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.838 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.839 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.841 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.842 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.843 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.844 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-07-26T11:49:38.846 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.847 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.848 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-07-26T11:49:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-07-26T11:49:38.850 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-26T11:49:38.851 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.855 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.855 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.857 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.858 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.859 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.860 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-07-26T11:49:38.862 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.863 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.864 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.867 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.868 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.869 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.870 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.873 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.874 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-07-26T11:49:38.874 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-07-26T11:49:38.874 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-07-26T11:49:38.874 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.874 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-26T11:49:38.874 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.875 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.875 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.875 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.876 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-07-26T11:49:38.877 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.878 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.879 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.880 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-26T11:49:38.881 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.883 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-07-26T11:49:38.884 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-07-26T11:49:38.885 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.886 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.888 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-07-26T11:49:38.889 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-07-26T11:49:38.890 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.891 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.893 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-07-26T11:49:38.894 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.896 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nginx": { 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nginx", 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.898 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nginx container image", 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.899 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.900 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.901 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.902 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.905 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-07-26T11:49:38.906 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.907 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.908 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.909 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.910 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.911 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.912 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.914 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.915 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.916 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.917 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.918 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.919 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.920 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.921 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-07-26T11:49:38.922 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.923 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.924 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.925 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.926 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.928 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.929 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.931 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.932 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.933 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.934 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.935 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.936 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.937 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.938 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.939 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.940 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.941 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-26T11:49:38.942 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.943 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.944 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.946 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.947 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.948 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-07-26T11:49:38.949 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-07-26T11:49:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-26T11:49:38.951 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.952 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.953 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.955 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.956 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.957 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-26T11:49:38.958 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.959 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.960 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.961 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-07-26T11:49:38.962 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-07-26T11:49:38.963 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.964 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.965 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.966 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.967 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.968 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.969 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.970 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.971 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.972 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.973 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.974 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.975 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:38.977 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.978 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.979 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.980 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.981 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:38.982 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.983 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.983 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:38.983 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:38.983 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:38.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:38 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3179496812' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-26T11:49:38.984 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:38 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3179496812' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-26T11:49:38.987 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:38.987 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.988 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.989 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-07-26T11:49:38.990 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.991 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.992 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.995 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-26T11:49:38.996 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.997 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:38.998 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:38.999 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.000 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.002 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-26T11:49:39.003 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.005 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.006 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.007 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-26T11:49:39.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.009 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.010 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.012 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-26T11:49:39.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.014 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.015 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.017 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-26T11:49:39.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:39.020 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-26T11:49:39.021 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.022 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-07-26T11:49:39.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.024 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.025 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.026 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.027 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.028 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.029 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.030 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.031 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.032 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.033 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.034 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.035 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.036 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.037 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.039 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.040 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.041 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.042 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-26T11:49:39.045 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.046 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.047 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.048 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.049 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.050 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.052 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.053 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-26T11:49:39.054 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.055 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.056 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.057 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.058 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-26T11:49:39.059 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.061 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.062 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-26T11:49:39.064 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.065 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.066 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.068 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.069 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.070 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.071 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.072 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.073 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-07-26T11:49:39.074 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.075 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.076 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.077 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.078 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.079 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.080 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.081 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.084 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.085 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.086 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.088 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.090 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-07-26T11:49:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-07-26T11:49:39.092 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.093 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.094 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-07-26T11:49:39.095 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.096 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.097 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.098 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.099 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.100 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-07-26T11:49:39.101 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.102 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.103 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.104 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.105 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.106 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.107 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.108 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.109 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.110 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.111 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.112 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.113 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.114 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.115 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.116 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.117 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.118 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-07-26T11:49:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-07-26T11:49:39.121 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-07-26T11:49:39.123 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.124 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.125 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-07-26T11:49:39.126 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-26T11:49:39.127 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.128 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.129 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.130 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.131 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.132 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-07-26T11:49:39.133 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.134 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.135 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.136 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.137 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.138 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.139 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.140 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.141 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.142 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.143 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-07-26T11:49:39.144 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.145 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.146 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.147 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.148 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-07-26T11:49:39.149 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.152 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-07-26T11:49:39.153 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.154 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.155 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.156 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.157 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.158 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.159 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.160 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.161 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.162 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.163 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.164 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.165 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.166 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.167 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.168 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.169 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.170 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.172 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:39.173 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.174 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.175 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-07-26T11:49:39.176 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.179 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.180 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.181 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.182 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.183 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.184 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.186 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.187 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.188 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-07-26T11:49:39.189 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.190 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.191 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.192 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.195 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.200 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.201 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-07-26T11:49:39.202 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.203 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.205 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.206 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.207 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.208 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.209 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.210 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.212 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.212 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.212 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.213 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.214 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.215 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.218 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.219 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.220 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.221 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.222 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.223 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.225 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-07-26T11:49:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.227 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.228 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.229 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.230 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.234 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.235 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.236 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.237 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.238 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.239 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.243 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.243 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.243 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.243 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.244 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.244 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.244 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.246 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.246 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.247 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.247 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.247 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.248 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.248 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.249 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.249 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.249 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.249 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.250 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.250 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.250 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.252 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.252 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.252 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.254 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.255 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.255 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.255 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.255 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.256 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.256 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.257 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.258 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.258 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.258 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.258 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.259 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.259 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.259 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.260 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.260 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.260 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.261 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.261 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.261 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.261 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.262 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.262 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.262 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-07-26T11:49:39.262 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.263 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.263 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.263 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.264 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.264 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.264 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.265 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.265 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.266 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.266 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.266 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.266 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.270 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.270 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.271 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.271 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.271 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.272 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.272 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.272 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.273 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.273 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.273 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.274 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.274 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.274 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.275 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.275 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.275 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.276 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.277 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.277 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.277 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.277 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.278 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.278 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.278 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.279 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.279 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.279 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.279 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.280 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.280 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.280 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.280 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.281 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.281 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.281 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.281 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.282 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.282 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.282 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.283 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.283 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.283 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.284 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.284 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.284 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.284 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.285 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.285 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.285 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.286 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.286 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.287 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.288 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.290 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.291 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.292 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.293 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.294 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.296 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.297 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.298 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.300 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.301 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.302 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.303 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.304 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.305 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.306 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.307 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.308 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.311 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.315 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.316 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.317 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.319 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.320 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.322 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.323 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.325 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.327 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.329 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.330 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.331 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.332 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.333 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.334 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.335 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.336 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.337 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.338 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.340 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.341 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.342 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.344 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.346 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.347 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.348 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.349 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.351 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.353 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.354 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.356 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.357 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.358 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.360 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.362 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-07-26T11:49:39.363 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.364 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.365 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.366 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.367 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.368 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.370 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.372 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.374 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.375 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.376 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.377 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.378 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.379 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.380 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.381 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.383 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-07-26T11:49:39.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.385 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.386 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.388 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.390 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.391 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.392 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.393 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.394 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-07-26T11:49:39.396 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.397 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.399 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.400 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.401 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.402 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.403 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.404 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.405 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.406 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.407 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.409 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.410 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.411 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-07-26T11:49:39.412 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.416 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.417 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.418 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.419 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.420 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.421 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.423 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:39.424 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.425 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.426 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.429 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.430 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.431 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.432 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.434 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.435 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.436 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.437 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.438 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "secondary_zone_period_retry_limit": { 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.439 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.440 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.441 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.443 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.444 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.445 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.446 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.447 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.448 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.449 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.450 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.452 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.453 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.454 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.455 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.456 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.458 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.459 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.460 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.461 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.462 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.463 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.464 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.465 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.466 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-07-26T11:49:39.467 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.468 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.469 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.470 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.471 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.471 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-07-26T11:49:39.471 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-07-26T11:49:39.473 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.474 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.475 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.477 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.478 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-07-26T11:49:39.480 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.481 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.483 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.484 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-07-26T11:49:39.485 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.486 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.487 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.488 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smb", 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.489 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "internal_store_backend": { 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "internal_store_backend", 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.490 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.492 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.493 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.494 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.495 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.496 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.497 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.498 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.499 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "update_orchestration": { 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "update_orchestration", 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.503 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.506 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.507 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.508 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.509 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.510 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.511 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.513 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.515 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.516 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.518 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.519 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.521 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.522 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.523 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.524 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.525 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.528 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.529 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.530 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.531 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.532 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.533 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.534 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.535 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.536 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.537 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-07-26T11:49:39.539 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.540 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.541 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.543 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.544 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.546 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.547 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.548 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.549 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.550 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.551 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.552 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.553 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-07-26T11:49:39.555 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-26T11:49:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.557 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.558 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.559 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-07-26T11:49:39.560 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-26T11:49:39.561 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.562 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.563 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-07-26T11:49:39.565 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.566 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.567 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:39.568 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.569 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.570 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.572 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-07-26T11:49:39.573 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.574 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.575 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.576 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.577 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.578 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.579 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.580 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.582 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-07-26T11:49:39.583 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.584 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.585 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.586 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-07-26T11:49:39.588 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.589 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.590 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.592 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.593 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.594 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.597 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.598 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.599 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.600 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-07-26T11:49:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.602 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.603 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.604 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.605 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.606 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.607 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.608 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.609 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.610 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.611 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.612 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.615 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.616 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.617 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.618 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.619 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.620 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-07-26T11:49:39.621 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.622 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.623 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.624 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.625 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.627 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.628 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.629 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.630 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.631 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.632 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.633 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.634 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.635 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.636 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.637 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-07-26T11:49:39.638 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.639 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.640 INFO:teuthology.orchestra.run.smithi043.stdout: "modules": [ 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "dashboard", 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "iostat", 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "nfs", 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "restful", 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_schedule" 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-07-26T11:49:39.641 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.642 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.643 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.644 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.645 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.646 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.647 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.648 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.650 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.651 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.652 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-07-26T11:49:39.654 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.655 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.656 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-07-26T11:49:39.657 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-07-26T11:49:39.658 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.659 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.660 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.661 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.662 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.663 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-07-26T11:49:39.664 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-07-26T11:49:39.665 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.666 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.667 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.668 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.669 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-07-26T11:49:39.670 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-07-26T11:49:39.671 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.673 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-07-26T11:49:39.674 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.675 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.676 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.677 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-07-26T11:49:39.678 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.679 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.680 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-07-26T11:49:39.681 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.682 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.683 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.684 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.686 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.688 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.690 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-07-26T11:49:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.692 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.693 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-07-26T11:49:39.694 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.695 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.697 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.698 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.699 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.700 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.701 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.702 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.704 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-07-26T11:49:39.705 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.706 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-07-26T11:49:39.707 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-26T11:49:39.708 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.709 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.711 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-07-26T11:49:39.712 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.713 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-07-26T11:49:39.714 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-26T11:49:39.715 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.716 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-07-26T11:49:39.717 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-07-26T11:49:39.718 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-26T11:49:39.719 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.721 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.722 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.723 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.724 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-07-26T11:49:39.725 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-07-26T11:49:39.726 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.727 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.729 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-07-26T11:49:39.730 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-07-26T11:49:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.732 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.733 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.734 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-07-26T11:49:39.735 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-07-26T11:49:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.739 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nginx": { 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nginx", 2024-07-26T11:49:39.740 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nginx container image", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.742 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.745 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.746 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.747 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.749 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-07-26T11:49:39.750 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-07-26T11:49:39.751 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.754 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-07-26T11:49:39.755 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.756 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.758 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-07-26T11:49:39.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-07-26T11:49:39.760 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.761 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.762 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.763 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-26T11:49:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.765 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.766 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-07-26T11:49:39.767 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.769 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.770 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.772 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.772 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.772 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.772 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.773 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.774 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.775 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.779 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.779 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.779 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.779 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.779 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.780 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.781 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.782 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.784 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.785 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.787 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-07-26T11:49:39.788 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-07-26T11:49:39.789 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.790 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.791 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.793 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.795 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-07-26T11:49:39.796 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-07-26T11:49:39.797 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.801 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.802 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.803 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-07-26T11:49:39.804 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-26T11:49:39.805 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.806 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.808 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.810 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.811 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.812 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.813 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.815 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.816 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.817 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-07-26T11:49:39.818 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.819 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.820 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.822 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.823 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.826 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.827 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.828 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.828 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.828 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7b380b3d40 msgr2=0x7f7b380b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7b380b3d40 0x7f7b380b6250 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009bd0 tx=0x7f7b44005f90 comp rx=0 tx=0).stop 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 msgr2=0x7f7b5419c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 0x7f7b5419c520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c02a9e0 tx=0x7f7b3c003b90 comp rx=0 tx=0).stop 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 shutdown_connections 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f7b380b3d40 0x7f7b380b6250 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b5410ae60 0x7f7b5419c520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b5410b7b0 0x7f7b541a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 --2- 172.21.15.43:0/3179496812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b54105530 0x7f7b5419bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.992+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 >> 172.21.15.43:0/3179496812 conn(0x7f7b54100f90 msgr2=0x7f7b541033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.993+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 shutdown_connections 2024-07-26T11:49:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:37.993+0000 7f7b53200640 1 -- 172.21.15.43:0/3179496812 wait complete. 2024-07-26T11:49:39.832 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:39 smithi063 ceph-mon[36747]: pgmap v6667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:39.832 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:39 smithi133 ceph-mon[37053]: pgmap v6667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:39.833 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.833 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.833 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.834 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-07-26T11:49:39.836 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-26T11:49:39.837 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.838 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.839 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-07-26T11:49:39.840 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.841 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.843 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-26T11:49:39.844 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.846 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.847 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.848 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-26T11:49:39.849 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-26T11:49:39.851 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.852 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.854 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.855 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.856 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.857 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-26T11:49:39.858 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.859 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.860 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.861 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.862 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.863 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.864 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-26T11:49:39.865 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.866 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.867 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.869 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.870 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.871 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-26T11:49:39.872 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.873 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.874 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-26T11:49:39.877 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.878 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.879 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.880 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-07-26T11:49:39.881 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.882 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.883 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-26T11:49:39.884 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.886 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-26T11:49:39.887 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.888 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.889 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.890 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.891 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-26T11:49:39.892 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.894 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.895 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.896 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-26T11:49:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.898 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-26T11:49:39.899 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.900 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.901 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.902 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.903 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.904 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-07-26T11:49:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-07-26T11:49:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.911 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-26T11:49:39.912 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.913 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.914 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.916 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.917 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.918 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.919 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.920 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.921 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-07-26T11:49:39.922 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.923 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.924 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.925 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.926 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.927 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.928 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.929 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.930 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.931 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.933 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.934 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.935 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.936 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.937 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.938 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.939 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.940 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.941 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-07-26T11:49:39.943 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.944 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-07-26T11:49:39.946 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.947 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.948 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.949 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-07-26T11:49:39.950 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.951 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-07-26T11:49:39.952 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.953 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.954 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.955 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.956 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.957 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.958 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.959 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.960 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.961 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.962 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.963 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.964 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.965 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.966 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.967 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.968 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-07-26T11:49:39.969 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-07-26T11:49:39.970 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.971 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.972 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:39.973 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.974 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.975 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.977 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:39.978 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.979 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:39.980 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.984 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.985 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:39.986 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.987 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.989 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-07-26T11:49:39.991 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.992 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.994 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.996 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-07-26T11:49:39.997 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:39.998 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:39.999 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.000 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.002 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.003 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.004 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.005 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.009 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.010 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.011 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.012 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.013 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-07-26T11:49:40.014 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.017 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.018 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-07-26T11:49:40.019 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-26T11:49:40.020 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.021 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.022 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.023 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.025 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.026 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.027 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.028 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.029 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.030 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.031 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.032 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.034 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-07-26T11:49:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-07-26T11:49:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-07-26T11:49:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-07-26T11:49:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.092 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.093 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.094 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.096 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.099 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.100 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.101 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.102 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.103 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.104 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.105 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.106 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.107 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.108 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.109 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.110 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.111 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.112 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.113 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.114 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.116 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.117 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.118 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.119 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.120 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.121 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.122 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.123 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.124 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.125 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.126 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.127 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.128 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-07-26T11:49:40.129 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.130 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.131 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.132 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.133 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.134 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.135 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.136 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.137 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.138 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.139 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.140 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.141 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.143 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.144 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.145 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.147 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.148 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.149 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.151 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.152 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.153 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.154 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.155 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.156 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.157 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.158 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.159 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.160 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.161 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.162 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.163 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.164 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.165 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-07-26T11:49:40.166 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-07-26T11:49:40.167 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.168 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.169 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.170 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.172 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.173 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.174 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.176 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.177 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.178 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.179 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.180 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.181 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-07-26T11:49:40.182 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-07-26T11:49:40.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.185 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-07-26T11:49:40.186 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.189 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.190 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.191 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.192 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.193 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.198 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-26T11:49:40.199 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.200 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-07-26T11:49:40.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.202 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.205 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-07-26T11:49:40.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.208 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-07-26T11:49:40.209 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.210 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.211 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.212 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.214 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.216 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.217 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.218 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.219 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.220 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-07-26T11:49:40.221 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.222 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.224 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.225 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.227 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-07-26T11:49:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.229 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.231 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.232 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.233 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.234 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.235 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.236 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.237 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-07-26T11:49:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.240 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.241 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.242 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.243 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-07-26T11:49:40.244 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.245 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.246 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.248 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.249 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.250 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.251 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.252 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "secondary_zone_period_retry_limit": { 2024-07-26T11:49:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.254 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.255 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.258 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.259 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.260 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.262 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.263 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.264 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.265 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.266 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.267 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.268 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.269 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.273 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.275 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.277 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-07-26T11:49:40.278 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.279 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.281 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.282 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-07-26T11:49:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-07-26T11:49:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-07-26T11:49:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.297 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.298 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.299 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smb", 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: "internal_store_backend": { 2024-07-26T11:49:40.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "internal_store_backend", 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.301 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.303 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.305 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.306 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.307 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.308 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.309 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.310 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.311 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "update_orchestration": { 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "update_orchestration", 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.312 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.313 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-07-26T11:49:40.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-07-26T11:49:40.315 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.316 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.317 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.318 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.319 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.320 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.321 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.322 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.323 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.324 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.325 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.326 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.327 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.328 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.329 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.330 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.331 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.332 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.333 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.338 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.340 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.341 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.342 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.343 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.344 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.345 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.346 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.349 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.350 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.351 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.352 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.354 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.355 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.356 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.357 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.358 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.359 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.360 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.362 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.363 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.364 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-07-26T11:49:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-26T11:49:40.366 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.367 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.368 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-07-26T11:49:40.370 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.371 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.372 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-07-26T11:49:40.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.374 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.375 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.376 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:40.378 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.379 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.381 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.382 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-07-26T11:49:40.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.384 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.385 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.386 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.390 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.393 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.394 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.396 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.397 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.398 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.399 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.400 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.401 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.404 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.405 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.406 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.407 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.408 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.409 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.410 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.411 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.412 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.413 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.414 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.416 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.417 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.418 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.420 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.421 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.422 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.424 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.425 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-07-26T11:49:40.427 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.428 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-07-26T11:49:40.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.430 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.432 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.433 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.434 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.435 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-07-26T11:49:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-07-26T11:49:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-07-26T11:49:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-07-26T11:49:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-07-26T11:49:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "services": { 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "dashboard": "https://172.21.15.43:8443/" 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "always_on_modules": { 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus": [ 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-07-26T11:49:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-07-26T11:49:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific": [ 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-07-26T11:49:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy": [ 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-07-26T11:49:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.452 INFO:teuthology.orchestra.run.smithi043.stdout: "reef": [ 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-07-26T11:49:40.453 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "squid": [ 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-07-26T11:49:40.454 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.455 INFO:teuthology.orchestra.run.smithi043.stdout: "last_failure_osd_epoch": 5, 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: "active_clients": [ 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2218302798 2024-07-26T11:49:40.456 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "libcephsqlite", 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-07-26T11:49:40.457 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 598261277 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.458 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 298793317 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.459 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3935288130 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:40.460 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3037420582 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.461 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3165740017 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:40.462 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-07-26T11:49:40.463 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T11:49:40.470 DEBUG:tasks.check_counter:Getting stats from a 2024-07-26T11:49:40.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph daemon mds.a perf dump 2024-07-26T11:49:40.471 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:38 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3179496812' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-26T11:49:40.471 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:39 smithi043 ceph-mon[32384]: pgmap v6667: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:49:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11626.974022 secs 2024-07-26T11:49:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:41 smithi043 ceph-mon[32384]: pgmap v6668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:41.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11642.457384 secs 2024-07-26T11:49:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11626.974022 secs 2024-07-26T11:49:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:41 smithi133 ceph-mon[37053]: pgmap v6668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:41.766 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11642.457384 secs 2024-07-26T11:49:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11626.974022 secs 2024-07-26T11:49:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:41 smithi063 ceph-mon[36747]: pgmap v6668: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:41.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11642.457384 secs 2024-07-26T11:49:43.587 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-07-26T11:49:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-07-26T11:49:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 11603, 2024-07-26T11:49:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 11603, 2024-07-26T11:49:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 12289035, 2024-07-26T11:49:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 3688940, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 17, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 3.460374711, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 1.600595434, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.749379807, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.804440962, 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-07-26T11:49:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 11602, 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1.364836288, 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000117638 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 23208, 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 25537, 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 11540599, 2024-07-26T11:49:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 12170631, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 11, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 6.654812064, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 3.450799213, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 1.261332043, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 1.551577359, 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-07-26T11:49:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 25535, 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 3.705677474, 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000145121 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1120, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 4792656 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 3403, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 3103, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 10610639, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 1909104, 2024-07-26T11:49:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 26, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 1.039894602, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.512660723, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.588442088, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000201980, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3102, 2024-07-26T11:49:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.355838407, 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000114712 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2220144, 2024-07-26T11:49:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 1907504 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-07-26T11:49:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-07-26T11:49:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 57986, 2024-07-26T11:49:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 3.505565028, 2024-07-26T11:49:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000060455 2024-07-26T11:49:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-07-26T11:49:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-07-26T11:49:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 1878, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 0, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 1878, 2024-07-26T11:49:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 1878, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 8, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-07-26T11:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-07-26T11:49:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 2679, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 123340012, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 2, 2024-07-26T11:49:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-07-26T11:49:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-07-26T11:49:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-07-26T11:49:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-07-26T11:49:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-07-26T11:49:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-07-26T11:49:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 9332, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 12, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 2, 2024-07-26T11:49:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 4194304, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 26617963, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 26612450, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 9332 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 884, 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 5447, 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 4563, 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 75, 2024-07-26T11:49:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 380, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 305, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 1878, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 5632, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 3754, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-07-26T11:49:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 129352, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 347987968 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-07-26T11:49:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-07-26T11:49:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-07-26T11:49:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-07-26T11:49:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-07-26T11:49:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 2, 2024-07-26T11:49:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 4, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 2, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 2, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 13359, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-07-26T11:49:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-07-26T11:49:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-07-26T11:49:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-07-26T11:49:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 232796, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 970, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-07-26T11:49:43.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 16392, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 385, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-07-26T11:49:43.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 3552910, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 35545, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-07-26T11:49:43.643 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 34805, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 26, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 0, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 34805, 2024-07-26T11:49:43.644 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 34805, 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 36.659554925, 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001053284 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 34805, 2024-07-26T11:49:43.645 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 34806 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 34805, 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 34805, 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-07-26T11:49:43.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 23188, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 11614, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-07-26T11:49:43.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 2, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-07-26T11:49:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-07-26T11:49:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-07-26T11:49:43.650 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-07-26T11:49:43.651 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 137, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 45, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 6, 2024-07-26T11:49:43.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 39, 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 33, 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-07-26T11:49:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-07-26T11:49:43.655 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 38210, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 30824757, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 38210, 2024-07-26T11:49:43.656 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 38210, 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 30824757, 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.657 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-07-26T11:49:43.658 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 34805, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 22423669, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 34805, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 22423669, 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-07-26T11:49:43.659 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-07-26T11:49:43.660 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 34805, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 34805, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 34805, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 34805, 2024-07-26T11:49:43.661 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-07-26T11:49:43.662 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-07-26T11:49:43.663 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x555ace2d2750": { 2024-07-26T11:49:43.664 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-07-26T11:49:43.665 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.666 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-07-26T11:49:43.667 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-07-26T11:49:43.667 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:43 smithi043 ceph-mon[32384]: pgmap v6669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:43.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:43 smithi063 ceph-mon[36747]: pgmap v6669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:44.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:43 smithi133 ceph-mon[37053]: pgmap v6669: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:44.519 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-07-26T11:49:44.519 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-07-26T11:49:44.519 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-07-26T11:49:44.519 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-07-26T11:49:44.520 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=2 2024-07-26T11:49:44.520 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-07-26T11:49:44.520 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-07-26T11:49:44.520 DEBUG:tasks.check_counter:Getting stats from d 2024-07-26T11:49:44.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph daemon mds.d perf dump 2024-07-26T11:49:44.994 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:49:45.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:45 smithi043 ceph-mon[32384]: pgmap v6670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:45.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:45 smithi063 ceph-mon[36747]: pgmap v6670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:46.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:45 smithi133 ceph-mon[37053]: pgmap v6670: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:46.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11631.974156 secs 2024-07-26T11:49:46.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11647.457520 secs 2024-07-26T11:49:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11631.974156 secs 2024-07-26T11:49:46.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11647.457520 secs 2024-07-26T11:49:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11631.974156 secs 2024-07-26T11:49:47.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11647.457520 secs 2024-07-26T11:49:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-07-26T11:49:47.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:47 smithi063 ceph-mon[36747]: pgmap v6671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:47.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:47 smithi043 ceph-mon[32384]: pgmap v6671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:48.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:47 smithi133 ceph-mon[37053]: pgmap v6671: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:48.049 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-07-26T11:49:48.050 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/check_counter.py", line 84, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/ceph_manager.py", line 1921, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph daemon mds.d perf dump' 2024-07-26T11:49:48.058 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-07-26T11:49:48.068 INFO:tasks.kclient:Unmounting kernel clients... 2024-07-26T11:49:48.068 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T11:49:48.068 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T11:49:48.132 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T11:49:48.133 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T11:49:48.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd blocklist ls 2024-07-26T11:49:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:49:49.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:49 smithi063 ceph-mon[36747]: pgmap v6672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:49.862 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:49 smithi043 ceph-mon[32384]: pgmap v6672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:50.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:49 smithi133 ceph-mon[37053]: pgmap v6672: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:50.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 -- 172.21.15.43:0/2210481711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c1057e0 msgr2=0x7f1f3c105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 --2- 172.21.15.43:0/2210481711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c105bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009900 tx=0x7f1f2c02a3f0 comp rx=0 tx=0).stop 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 -- 172.21.15.43:0/2210481711 shutdown_connections 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 --2- 172.21.15.43:0/2210481711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c10ba70 0x7f1f3c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 --2- 172.21.15.43:0/2210481711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c10b120 0x7f1f3c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 --2- 172.21.15.43:0/2210481711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c105bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 -- 172.21.15.43:0/2210481711 >> 172.21.15.43:0/2210481711 conn(0x7f1f3c1011f0 msgr2=0x7f1f3c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 -- 172.21.15.43:0/2210481711 shutdown_connections 2024-07-26T11:49:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.945+0000 7f1f41e00640 1 -- 172.21.15.43:0/2210481711 wait complete. 2024-07-26T11:49:50.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 Processor -- start 2024-07-26T11:49:50.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 -- start start 2024-07-26T11:49:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c19c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c10b120 0x7f1f3c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c10ba70 0x7f1f3c1a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c1158a0 con 0x7f1f3c1057e0 2024-07-26T11:49:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c115720 con 0x7f1f3c10ba70 2024-07-26T11:49:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.947+0000 7f1f41e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c115a20 con 0x7f1f3c10b120 2024-07-26T11:49:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c19c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c19c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55508/0 (socket says 172.21.15.43:55508) 2024-07-26T11:49:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3aa00640 1 -- 172.21.15.43:0/1696993917 learned_addr learned my addr 172.21.15.43:0/1696993917 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:49:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3b400640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c10ba70 0x7f1f3c1a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3a000640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c10b120 0x7f1f3c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3a000640 1 -- 172.21.15.43:0/1696993917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c10ba70 msgr2=0x7f1f3c1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3a000640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c10ba70 0x7f1f3c1a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3a000640 1 -- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 msgr2=0x7f1f3c19c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3a000640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c19c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3a000640 1 -- 172.21.15.43:0/1696993917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c1a2160 con 0x7f1f3c10b120 2024-07-26T11:49:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.948+0000 7f1f3aa00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:49:50.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.949+0000 7f1f3a000640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c10b120 0x7f1f3c19c790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c06c3a0 tx=0x7f1f2800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:50.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.949+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800cc40 con 0x7f1f3c10b120 2024-07-26T11:49:50.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.949+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c1a2450 con 0x7f1f3c10b120 2024-07-26T11:49:50.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.949+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f2800cde0 con 0x7f1f3c10b120 2024-07-26T11:49:50.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.949+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28018820 con 0x7f1f3c10b120 2024-07-26T11:49:50.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.949+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3c1a8bb0 con 0x7f1f3c10b120 2024-07-26T11:49:50.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.951+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3c105bf0 con 0x7f1f3c10b120 2024-07-26T11:49:50.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.953+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1f28010b40 con 0x7f1f3c10b120 2024-07-26T11:49:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.955+0000 7f1f40a00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f200b3d40 0x7f1f200b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:49:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.955+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f1f280e58a0 con 0x7f1f3c10b120 2024-07-26T11:49:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.955+0000 7f1f3aa00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f200b3d40 0x7f1f200b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:49:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.956+0000 7f1f3aa00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f200b3d40 0x7f1f200b6250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005f70 tx=0x7f1f2c031400 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:49:50.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:50.957+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1f2807d600 con 0x7f1f3c10b120 2024-07-26T11:49:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.176+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1f3c10d7a0 con 0x7f1f3c10b120 2024-07-26T11:49:51.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.177+0000 7f1f40a00640 1 -- 172.21.15.43:0/1696993917 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 109 entries v137) ==== 82+0+6597 (secure 0 0 0) 0x7f1f280ab190 con 0x7f1f3c10b120 2024-07-26T11:49:51.183 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6834/1153480487 2024-07-27T08:48:36.627023+0000 2024-07-26T11:49:51.183 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6834/1786973356 2024-07-27T08:48:19.910805+0000 2024-07-26T11:49:51.183 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6834/1337199959 2024-07-27T08:48:02.577599+0000 2024-07-26T11:49:51.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/3942566175 2024-07-27T08:47:45.167883+0000 2024-07-26T11:49:51.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/3942566175 2024-07-27T08:47:45.167883+0000 2024-07-26T11:49:51.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6834/3989413214 2024-07-27T08:46:52.883914+0000 2024-07-26T11:49:51.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/1364452024 2024-07-27T08:46:36.685805+0000 2024-07-26T11:49:51.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6833/2807089237 2024-07-27T08:46:20.120464+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6832/2807089237 2024-07-27T08:46:20.120464+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/2435252716 2024-07-27T08:45:58.267217+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6833/2161114143 2024-07-27T08:45:39.403951+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6835/254024538 2024-07-27T08:47:26.902442+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6838/1379895152 2024-07-27T08:45:23.678907+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6833/194735852 2024-07-27T08:45:05.988342+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/1562341679 2024-07-27T08:44:50.072260+0000 2024-07-26T11:49:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6832/2026223441 2024-07-27T08:44:29.479233+0000 2024-07-26T11:49:51.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6833/1808516906 2024-07-27T08:43:56.375072+0000 2024-07-26T11:49:51.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/90216852 2024-07-27T08:43:40.441207+0000 2024-07-26T11:49:51.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6835/3989413214 2024-07-27T08:46:52.883914+0000 2024-07-26T11:49:51.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/170031347 2024-07-27T08:43:07.408273+0000 2024-07-26T11:49:51.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6835/1153480487 2024-07-27T08:48:36.627023+0000 2024-07-26T11:49:51.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6833/4140446689 2024-07-27T08:42:50.009454+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/888824582 2024-07-27T08:42:31.421407+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6835/1786973356 2024-07-27T08:48:19.910805+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/888824582 2024-07-27T08:42:31.421407+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/2435252716 2024-07-27T08:45:58.267217+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/170031347 2024-07-27T08:43:07.408273+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6833/1169720192 2024-07-27T08:42:14.076955+0000 2024-07-26T11:49:51.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6834/254024538 2024-07-27T08:47:26.902442+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6832/1169720192 2024-07-27T08:42:14.076955+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6833/3876188029 2024-07-27T08:41:41.060326+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6836/1305832455 2024-07-27T08:37:12.350150+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/711369665 2024-07-27T08:18:11.763386+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6835/847478222 2024-07-27T08:40:18.130776+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6838/2240411764 2024-07-27T08:36:08.851244+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3582942481 2024-07-27T08:17:40.568271+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/10005976 2024-07-27T08:47:10.135865+0000 2024-07-26T11:49:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2372393330 2024-07-27T08:19:34.498126+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6832/1808516906 2024-07-27T08:43:56.375072+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6832/1827419050 2024-07-27T08:40:02.356166+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6838/2678612487 2024-07-27T08:38:04.857675+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6837/3374136004 2024-07-27T08:39:29.902320+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6834/847478222 2024-07-27T08:40:18.130776+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6837/185000899 2024-07-27T08:36:40.915762+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6839/1379895152 2024-07-27T08:45:23.678907+0000 2024-07-26T11:49:51.189 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6839/3045590383 2024-07-27T08:35:50.103234+0000 2024-07-26T11:49:51.190 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6834/2899086135 2024-07-27T08:39:46.123624+0000 2024-07-26T11:49:51.190 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6832/10975952 2024-07-27T08:43:23.659470+0000 2024-07-26T11:49:51.190 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6838/3045590383 2024-07-27T08:35:50.103234+0000 2024-07-26T11:49:51.190 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6839/1532671211 2024-07-27T08:36:25.086271+0000 2024-07-26T11:49:51.190 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/10005976 2024-07-27T08:47:10.135865+0000 2024-07-26T11:49:51.190 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6841/445875183 2024-07-27T08:35:49.778048+0000 2024-07-26T11:49:51.191 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6832/2161114143 2024-07-27T08:45:39.403951+0000 2024-07-26T11:49:51.191 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6839/2003000329 2024-07-27T08:36:56.485489+0000 2024-07-26T11:49:51.191 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1444395529 2024-07-27T08:17:40.568271+0000 2024-07-26T11:49:51.191 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4108155415 2024-07-27T08:19:34.498126+0000 2024-07-26T11:49:51.191 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6835/2899086135 2024-07-27T08:39:46.123624+0000 2024-07-26T11:49:51.191 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1591014211 2024-07-27T08:17:40.568271+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6839/2240411764 2024-07-27T08:36:08.851244+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6837/2043430794 2024-07-27T08:37:44.544250+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1663543642 2024-07-27T08:17:40.568271+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6835/3210906292 2024-07-27T08:40:49.870638+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/300735951 2024-07-27T08:44:13.411147+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3446770894 2024-07-27T08:19:34.498126+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6835/1337199959 2024-07-27T08:48:02.577599+0000 2024-07-26T11:49:51.192 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3742875375 2024-07-27T08:19:34.498126+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/1364452024 2024-07-27T08:46:36.685805+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2150907670 2024-07-27T08:18:11.763386+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/737804035 2024-07-27T08:41:57.894825+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6838/2003000329 2024-07-27T08:36:56.485489+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6832/4140446689 2024-07-27T08:42:50.009454+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1785866462 2024-07-27T08:18:11.763386+0000 2024-07-26T11:49:51.193 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6833/1827419050 2024-07-27T08:40:02.356166+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/1562341679 2024-07-27T08:44:50.072260+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6836/90216852 2024-07-27T08:43:40.441207+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1482734723 2024-07-27T08:18:11.763386+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6836/185000899 2024-07-27T08:36:40.915762+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6832/194735852 2024-07-27T08:45:05.988342+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6833/2026223441 2024-07-27T08:44:29.479233+0000 2024-07-26T11:49:51.194 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1482734723 2024-07-27T08:18:11.763386+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6838/2669403450 2024-07-27T08:37:28.492219+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6837/1305832455 2024-07-27T08:37:12.350150+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6836/2043430794 2024-07-27T08:37:44.544250+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6839/2678612487 2024-07-27T08:38:04.857675+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6832/3876188029 2024-07-27T08:41:41.060326+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6836/4138037593 2024-07-27T08:38:21.266602+0000 2024-07-26T11:49:51.195 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6840/445875183 2024-07-27T08:35:49.778048+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6834/302781783 2024-07-27T08:38:36.767530+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6835/302781783 2024-07-27T08:38:36.767530+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6839/2669403450 2024-07-27T08:37:28.492219+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6837/2786607239 2024-07-27T08:38:53.713088+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6834/3551536194 2024-07-27T08:41:24.959653+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6834/763173638 2024-07-27T08:39:09.711725+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1663543642 2024-07-27T08:17:40.568271+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6835/763173638 2024-07-27T08:39:09.711725+0000 2024-07-26T11:49:51.196 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/300735951 2024-07-27T08:44:13.411147+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6836/3374136004 2024-07-27T08:39:29.902320+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6832/4203458458 2024-07-27T08:40:33.812857+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6833/10975952 2024-07-27T08:43:23.659470+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6836/2786607239 2024-07-27T08:38:53.713088+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6838/1532671211 2024-07-27T08:36:25.086271+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6833/4203458458 2024-07-27T08:40:33.812857+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6837/737804035 2024-07-27T08:41:57.894825+0000 2024-07-26T11:49:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6835/3551536194 2024-07-27T08:41:24.959653+0000 2024-07-26T11:49:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3742875375 2024-07-27T08:19:34.498126+0000 2024-07-26T11:49:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6834/3210906292 2024-07-27T08:40:49.870638+0000 2024-07-26T11:49:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.63:6837/4138037593 2024-07-27T08:38:21.266602+0000 2024-07-26T11:49:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6832/641002587 2024-07-27T08:41:05.579347+0000 2024-07-26T11:49:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.133:6833/641002587 2024-07-27T08:41:05.579347+0000 2024-07-26T11:49:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:listed 109 entries 2024-07-26T11:49:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.180+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f200b3d40 msgr2=0x7f1f200b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.180+0000 7f1f41e00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f200b3d40 0x7f1f200b6250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005f70 tx=0x7f1f2c031400 comp rx=0 tx=0).stop 2024-07-26T11:49:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c10b120 msgr2=0x7f1f3c19c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:49:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c10b120 0x7f1f3c19c790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c06c3a0 tx=0x7f1f2800ee50 comp rx=0 tx=0).stop 2024-07-26T11:49:51.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 shutdown_connections 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f1f200b3d40 0x7f1f200b6250 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f3c10b120 0x7f1f3c19c790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f3c10ba70 0x7f1f3c1a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 --2- 172.21.15.43:0/1696993917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f3c1057e0 0x7f1f3c19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 >> 172.21.15.43:0/1696993917 conn(0x7f1f3c1011f0 msgr2=0x7f1f3c1046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 shutdown_connections 2024-07-26T11:49:51.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:49:51.181+0000 7f1f41e00640 1 -- 172.21.15.43:0/1696993917 wait complete. 2024-07-26T11:49:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11636.974277 secs 2024-07-26T11:49:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:51 smithi063 ceph-mon[36747]: pgmap v6673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11652.457641 secs 2024-07-26T11:49:51.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:51 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1696993917' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T11:49:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11636.974277 secs 2024-07-26T11:49:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:51 smithi043 ceph-mon[32384]: pgmap v6673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11652.457641 secs 2024-07-26T11:49:51.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:51 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1696993917' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T11:49:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11636.974277 secs 2024-07-26T11:49:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:51 smithi133 ceph-mon[37053]: pgmap v6673: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:49:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11652.457641 secs 2024-07-26T11:49:52.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:51 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1696993917' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T11:49:52.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-26T11:49:52.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:49:52.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-26T11:49:53.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:53 smithi063 ceph-mon[36747]: pgmap v6674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:53.877 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:53 smithi043 ceph-mon[32384]: pgmap v6674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:54.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:53 smithi133 ceph-mon[37053]: pgmap v6674: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:55.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:55 smithi063 ceph-mon[36747]: pgmap v6675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:55.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:55 smithi043 ceph-mon[32384]: pgmap v6675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:56.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:55 smithi133 ceph-mon[37053]: pgmap v6675: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:49:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11641.974395 secs 2024-07-26T11:49:56.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11657.457738 secs 2024-07-26T11:49:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11641.974395 secs 2024-07-26T11:49:57.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11657.457738 secs 2024-07-26T11:49:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11641.974395 secs 2024-07-26T11:49:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11657.457738 secs 2024-07-26T11:49:57.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:57 smithi043 ceph-mon[32384]: pgmap v6676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:58.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:57 smithi133 ceph-mon[37053]: pgmap v6676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:58.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:57 smithi063 ceph-mon[36747]: pgmap v6676: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:49:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:49:59 smithi043 ceph-mon[32384]: pgmap v6677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:00.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:49:59 smithi133 ceph-mon[37053]: pgmap v6677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:00.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:49:59 smithi063 ceph-mon[36747]: pgmap v6677: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:00.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:00 smithi043 ceph-mon[32384]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:50:01.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:00 smithi133 ceph-mon[37053]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:50:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:00 smithi063 ceph-mon[36747]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-07-26T11:50:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11646.974478 secs 2024-07-26T11:50:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:01 smithi063 ceph-mon[36747]: pgmap v6678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:01.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11662.457883 secs 2024-07-26T11:50:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11646.974478 secs 2024-07-26T11:50:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:01 smithi043 ceph-mon[32384]: pgmap v6678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:01.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11662.457883 secs 2024-07-26T11:50:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11646.974478 secs 2024-07-26T11:50:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:01 smithi133 ceph-mon[37053]: pgmap v6678: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:02.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11662.457883 secs 2024-07-26T11:50:03.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:03 smithi043 ceph-mon[32384]: pgmap v6679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:04.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:03 smithi133 ceph-mon[37053]: pgmap v6679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:04.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:03 smithi063 ceph-mon[36747]: pgmap v6679: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:05.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:05 smithi043 ceph-mon[32384]: pgmap v6680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:06.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:05 smithi133 ceph-mon[37053]: pgmap v6680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:06.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:05 smithi063 ceph-mon[36747]: pgmap v6680: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11651.974561 secs 2024-07-26T11:50:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11667.457980 secs 2024-07-26T11:50:06.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:06 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11651.974561 secs 2024-07-26T11:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11667.457980 secs 2024-07-26T11:50:07.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:06 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:50:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11651.974561 secs 2024-07-26T11:50:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11667.457980 secs 2024-07-26T11:50:07.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:06 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:50:07.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:07 smithi133 ceph-mon[37053]: pgmap v6681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:07.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:50:07.917 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:50:07.918 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:07 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:50:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:07 smithi043 ceph-mon[32384]: pgmap v6681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:50:07.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:50:07.985 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:07 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:50:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:07 smithi063 ceph-mon[36747]: pgmap v6681: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:50:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:50:08.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:07 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:50:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:08 smithi043 ceph-mon[32384]: pgmap v6682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:08.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:08 smithi043 ceph-mon[32384]: pgmap v6683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:08 smithi133 ceph-mon[37053]: pgmap v6682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:09.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:08 smithi133 ceph-mon[37053]: pgmap v6683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:08 smithi063 ceph-mon[36747]: pgmap v6682: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:09.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:08 smithi063 ceph-mon[36747]: pgmap v6683: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:10.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:10 smithi043 ceph-mon[32384]: pgmap v6684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:11.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:10 smithi133 ceph-mon[37053]: pgmap v6684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:11.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:10 smithi063 ceph-mon[36747]: pgmap v6684: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:11 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11656.974708 secs 2024-07-26T11:50:11.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11672.458101 secs 2024-07-26T11:50:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:11 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11656.974708 secs 2024-07-26T11:50:12.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11672.458101 secs 2024-07-26T11:50:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:11 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11656.974708 secs 2024-07-26T11:50:12.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11672.458101 secs 2024-07-26T11:50:12.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:12 smithi043 ceph-mon[32384]: pgmap v6685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:13.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:12 smithi133 ceph-mon[37053]: pgmap v6685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:13.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:12 smithi063 ceph-mon[36747]: pgmap v6685: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:14.982 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:14 smithi043 ceph-mon[32384]: pgmap v6686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:14 smithi133 ceph-mon[37053]: pgmap v6686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:15.096 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:14 smithi063 ceph-mon[36747]: pgmap v6686: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:16 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11661.974826 secs 2024-07-26T11:50:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:16 smithi043 ceph-mon[32384]: pgmap v6687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:16.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11677.458194 secs 2024-07-26T11:50:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:16 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11661.974826 secs 2024-07-26T11:50:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:16 smithi133 ceph-mon[37053]: pgmap v6687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:17.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11677.458194 secs 2024-07-26T11:50:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:16 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11661.974826 secs 2024-07-26T11:50:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:16 smithi063 ceph-mon[36747]: pgmap v6687: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:50:17.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11677.458194 secs 2024-07-26T11:50:18.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:18 smithi043 ceph-mon[32384]: pgmap v6688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:50:19.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:18 smithi133 ceph-mon[37053]: pgmap v6688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:50:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:18 smithi063 ceph-mon[36747]: pgmap v6688: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:50:20.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:20 smithi043 ceph-mon[32384]: pgmap v6689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:21.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:20 smithi133 ceph-mon[37053]: pgmap v6689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:21.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:20 smithi063 ceph-mon[36747]: pgmap v6689: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:21 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11666.974945 secs 2024-07-26T11:50:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11682.458313 secs 2024-07-26T11:50:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:21 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11666.974945 secs 2024-07-26T11:50:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11682.458313 secs 2024-07-26T11:50:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:21 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11666.974945 secs 2024-07-26T11:50:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11682.458313 secs 2024-07-26T11:50:22.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:22 smithi043 ceph-mon[32384]: pgmap v6690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:23.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:22 smithi133 ceph-mon[37053]: pgmap v6690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:22 smithi063 ceph-mon[36747]: pgmap v6690: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:24.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:24 smithi043 ceph-mon[32384]: pgmap v6691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:25.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:24 smithi133 ceph-mon[37053]: pgmap v6691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:25.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:24 smithi063 ceph-mon[36747]: pgmap v6691: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:26 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11671.975062 secs 2024-07-26T11:50:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:26 smithi043 ceph-mon[32384]: pgmap v6692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:26 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11687.458394 secs 2024-07-26T11:50:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:26 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11671.975062 secs 2024-07-26T11:50:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:26 smithi133 ceph-mon[37053]: pgmap v6692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:26 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11687.458394 secs 2024-07-26T11:50:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:26 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11671.975062 secs 2024-07-26T11:50:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:26 smithi063 ceph-mon[36747]: pgmap v6692: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:26 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11687.458394 secs 2024-07-26T11:50:28.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:28 smithi043 ceph-mon[32384]: pgmap v6693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:29.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:28 smithi133 ceph-mon[37053]: pgmap v6693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:29.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:28 smithi063 ceph-mon[36747]: pgmap v6693: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:30.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:30 smithi043 ceph-mon[32384]: pgmap v6694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:31.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:30 smithi133 ceph-mon[37053]: pgmap v6694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:31.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:30 smithi063 ceph-mon[36747]: pgmap v6694: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:31.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11676.975206 secs 2024-07-26T11:50:31.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:31 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11692.458513 secs 2024-07-26T11:50:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11676.975206 secs 2024-07-26T11:50:31.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:31 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11692.458513 secs 2024-07-26T11:50:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11676.975206 secs 2024-07-26T11:50:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:31 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11692.458513 secs 2024-07-26T11:50:32.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:32 smithi043 ceph-mon[32384]: pgmap v6695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:32.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:32 smithi063 ceph-mon[36747]: pgmap v6695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:33.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:32 smithi133 ceph-mon[37053]: pgmap v6695: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:34.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:34 smithi043 ceph-mon[32384]: pgmap v6696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:35.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:34 smithi133 ceph-mon[37053]: pgmap v6696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:35.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:34 smithi063 ceph-mon[36747]: pgmap v6696: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11681.975321 secs 2024-07-26T11:50:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:36 smithi043 ceph-mon[32384]: pgmap v6697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:36.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:36 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11697.458628 secs 2024-07-26T11:50:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11681.975321 secs 2024-07-26T11:50:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:36 smithi133 ceph-mon[37053]: pgmap v6697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:37.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:36 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11697.458628 secs 2024-07-26T11:50:37.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11681.975321 secs 2024-07-26T11:50:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:36 smithi063 ceph-mon[36747]: pgmap v6697: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:37.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:36 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11697.458628 secs 2024-07-26T11:50:39.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:38 smithi133 ceph-mon[37053]: pgmap v6698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:39.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:38 smithi063 ceph-mon[36747]: pgmap v6698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:39.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:38 smithi043 ceph-mon[32384]: pgmap v6698: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:41.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:40 smithi133 ceph-mon[37053]: pgmap v6699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:41.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:40 smithi063 ceph-mon[36747]: pgmap v6699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:40 smithi043 ceph-mon[32384]: pgmap v6699: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:41 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11686.975438 secs 2024-07-26T11:50:42.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11702.458748 secs 2024-07-26T11:50:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:41 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11686.975438 secs 2024-07-26T11:50:42.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11702.458748 secs 2024-07-26T11:50:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:41 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11686.975438 secs 2024-07-26T11:50:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11702.458748 secs 2024-07-26T11:50:43.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:42 smithi133 ceph-mon[37053]: pgmap v6700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:43.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:42 smithi063 ceph-mon[36747]: pgmap v6700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:43.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:42 smithi043 ceph-mon[32384]: pgmap v6700: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:45.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:44 smithi133 ceph-mon[37053]: pgmap v6701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:45.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:44 smithi063 ceph-mon[36747]: pgmap v6701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:45.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:44 smithi043 ceph-mon[32384]: pgmap v6701: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:47.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:46 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11691.975574 secs 2024-07-26T11:50:47.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:46 smithi063 ceph-mon[36747]: pgmap v6702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:47.069 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11707.458827 secs 2024-07-26T11:50:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:46 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11691.975574 secs 2024-07-26T11:50:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:46 smithi043 ceph-mon[32384]: pgmap v6702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11707.458827 secs 2024-07-26T11:50:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:46 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11691.975574 secs 2024-07-26T11:50:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:46 smithi133 ceph-mon[37053]: pgmap v6702: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11707.458827 secs 2024-07-26T11:50:49.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:48 smithi063 ceph-mon[36747]: pgmap v6703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:49.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:48 smithi043 ceph-mon[32384]: pgmap v6703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:49.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:48 smithi133 ceph-mon[37053]: pgmap v6703: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:51.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:50 smithi063 ceph-mon[36747]: pgmap v6704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:51.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:50 smithi043 ceph-mon[32384]: pgmap v6704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:50 smithi133 ceph-mon[37053]: pgmap v6704: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:50:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:51 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11696.975702 secs 2024-07-26T11:50:52.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11712.458974 secs 2024-07-26T11:50:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:51 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11696.975702 secs 2024-07-26T11:50:52.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11712.458974 secs 2024-07-26T11:50:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:51 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11696.975702 secs 2024-07-26T11:50:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11712.458974 secs 2024-07-26T11:50:53.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:52 smithi063 ceph-mon[36747]: pgmap v6705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:53.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:52 smithi043 ceph-mon[32384]: pgmap v6705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:53.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:52 smithi133 ceph-mon[37053]: pgmap v6705: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:50:55.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:54 smithi063 ceph-mon[36747]: pgmap v6706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:55.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:54 smithi043 ceph-mon[32384]: pgmap v6706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:55.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:54 smithi133 ceph-mon[37053]: pgmap v6706: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:50:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11701.975822 secs 2024-07-26T11:50:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:56 smithi063 ceph-mon[36747]: pgmap v6707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-07-26T11:50:57.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:56 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11717.459114 secs 2024-07-26T11:50:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11701.975822 secs 2024-07-26T11:50:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:56 smithi043 ceph-mon[32384]: pgmap v6707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-07-26T11:50:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:56 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11717.459114 secs 2024-07-26T11:50:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11701.975822 secs 2024-07-26T11:50:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:56 smithi133 ceph-mon[37053]: pgmap v6707: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-07-26T11:50:57.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:56 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11717.459114 secs 2024-07-26T11:50:59.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:50:58 smithi063 ceph-mon[36747]: pgmap v6708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-26T11:50:59.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:50:58 smithi043 ceph-mon[32384]: pgmap v6708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-26T11:50:59.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:50:58 smithi133 ceph-mon[37053]: pgmap v6708: 129 pgs: 129 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-26T11:51:01.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:00 smithi063 ceph-mon[36747]: pgmap v6709: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:01.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:00 smithi043 ceph-mon[32384]: pgmap v6709: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:01.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:00 smithi133 ceph-mon[37053]: pgmap v6709: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11706.975924 secs 2024-07-26T11:51:02.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:01 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11722.459209 secs 2024-07-26T11:51:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11706.975924 secs 2024-07-26T11:51:02.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:01 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11722.459209 secs 2024-07-26T11:51:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11706.975924 secs 2024-07-26T11:51:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:01 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11722.459209 secs 2024-07-26T11:51:03.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:02 smithi043 ceph-mon[32384]: pgmap v6710: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:03.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:02 smithi133 ceph-mon[37053]: pgmap v6710: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:03.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:02 smithi063 ceph-mon[36747]: pgmap v6710: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:05.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:04 smithi043 ceph-mon[32384]: pgmap v6711: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-26T11:51:05.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:04 smithi133 ceph-mon[37053]: pgmap v6711: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-26T11:51:05.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:04 smithi063 ceph-mon[36747]: pgmap v6711: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-26T11:51:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11711.976040 secs 2024-07-26T11:51:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:06 smithi043 ceph-mon[32384]: pgmap v6712: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:06 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11727.459306 secs 2024-07-26T11:51:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11711.976040 secs 2024-07-26T11:51:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:06 smithi133 ceph-mon[37053]: pgmap v6712: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:07.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:06 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11727.459306 secs 2024-07-26T11:51:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11711.976040 secs 2024-07-26T11:51:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:06 smithi063 ceph-mon[36747]: pgmap v6712: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-07-26T11:51:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:06 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11727.459306 secs 2024-07-26T11:51:08.166 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:07 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:51:08.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:07 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:51:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:07 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:51:09.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:08 smithi043 ceph-mon[32384]: pgmap v6713: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-26T11:51:09.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:08 smithi133 ceph-mon[37053]: pgmap v6713: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-26T11:51:09.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:08 smithi063 ceph-mon[36747]: pgmap v6713: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-26T11:51:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:51:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:09 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:51:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:09 smithi043 ceph-mon[32384]: pgmap v6714: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 181 B/s wr, 4 op/s 2024-07-26T11:51:10.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:09 smithi043 ceph-mon[32384]: pgmap v6715: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:51:10.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:09 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:51:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:51:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:09 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:51:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:09 smithi133 ceph-mon[37053]: pgmap v6714: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 181 B/s wr, 4 op/s 2024-07-26T11:51:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:09 smithi133 ceph-mon[37053]: pgmap v6715: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:51:10.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:09 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:51:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:51:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:09 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:51:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:09 smithi063 ceph-mon[36747]: pgmap v6714: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 181 B/s wr, 4 op/s 2024-07-26T11:51:10.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:09 smithi063 ceph-mon[36747]: pgmap v6715: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:51:10.319 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:09 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:51:11.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:10 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11716.976193 secs 2024-07-26T11:51:11.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:10 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11716.976193 secs 2024-07-26T11:51:11.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:10 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11716.976193 secs 2024-07-26T11:51:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:11 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11732.459431 secs 2024-07-26T11:51:12.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:11 smithi043 ceph-mon[32384]: pgmap v6716: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:51:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:11 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11732.459431 secs 2024-07-26T11:51:12.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:11 smithi133 ceph-mon[37053]: pgmap v6716: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:51:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:11 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11732.459431 secs 2024-07-26T11:51:12.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:11 smithi063 ceph-mon[36747]: pgmap v6716: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-07-26T11:51:14.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:13 smithi043 ceph-mon[32384]: pgmap v6717: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:51:14.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:13 smithi133 ceph-mon[37053]: pgmap v6717: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:51:14.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:13 smithi063 ceph-mon[36747]: pgmap v6717: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-07-26T11:51:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:15 smithi043 ceph-mon[32384]: pgmap v6718: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:51:16.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:15 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11721.976260 secs 2024-07-26T11:51:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:15 smithi133 ceph-mon[37053]: pgmap v6718: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:51:16.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:15 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11721.976260 secs 2024-07-26T11:51:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:15 smithi063 ceph-mon[36747]: pgmap v6718: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:51:16.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:15 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11721.976260 secs 2024-07-26T11:51:17.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:16 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11737.459551 secs 2024-07-26T11:51:17.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:16 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11737.459551 secs 2024-07-26T11:51:17.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:16 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11737.459551 secs 2024-07-26T11:51:18.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:17 smithi043 ceph-mon[32384]: pgmap v6719: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:51:18.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:17 smithi133 ceph-mon[37053]: pgmap v6719: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:51:18.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:17 smithi063 ceph-mon[36747]: pgmap v6719: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:51:20.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:19 smithi043 ceph-mon[32384]: pgmap v6720: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:51:20.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:19 smithi133 ceph-mon[37053]: pgmap v6720: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:51:20.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:19 smithi063 ceph-mon[36747]: pgmap v6720: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T11:51:21.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:20 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11726.976344 secs 2024-07-26T11:51:21.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:20 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11726.976344 secs 2024-07-26T11:51:21.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:20 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11726.976344 secs 2024-07-26T11:51:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:21 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11742.459686 secs 2024-07-26T11:51:22.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:21 smithi133 ceph-mon[37053]: pgmap v6721: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:21 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11742.459686 secs 2024-07-26T11:51:22.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:21 smithi063 ceph-mon[36747]: pgmap v6721: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:21 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11742.459686 secs 2024-07-26T11:51:22.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:21 smithi043 ceph-mon[32384]: pgmap v6721: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:24.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:23 smithi133 ceph-mon[37053]: pgmap v6722: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:24.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:23 smithi063 ceph-mon[36747]: pgmap v6722: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:24.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:23 smithi043 ceph-mon[32384]: pgmap v6722: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:25 smithi133 ceph-mon[37053]: pgmap v6723: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:26.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:25 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11731.976473 secs 2024-07-26T11:51:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:25 smithi063 ceph-mon[36747]: pgmap v6723: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:26.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:25 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11731.976473 secs 2024-07-26T11:51:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:25 smithi043 ceph-mon[32384]: pgmap v6723: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:26.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:25 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11731.976473 secs 2024-07-26T11:51:27.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:27 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11747.459803 secs 2024-07-26T11:51:27.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:27 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11747.459803 secs 2024-07-26T11:51:27.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:27 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11747.459803 secs 2024-07-26T11:51:28.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:28 smithi133 ceph-mon[37053]: pgmap v6724: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:28.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:28 smithi063 ceph-mon[36747]: pgmap v6724: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:28.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:28 smithi043 ceph-mon[32384]: pgmap v6724: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:30.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:30 smithi133 ceph-mon[37053]: pgmap v6725: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:30.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:30 smithi063 ceph-mon[36747]: pgmap v6725: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:30 smithi043 ceph-mon[32384]: pgmap v6725: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:31.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:31 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11736.976595 secs 2024-07-26T11:51:31.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:31 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11736.976595 secs 2024-07-26T11:51:31.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:31 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11736.976595 secs 2024-07-26T11:51:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:32 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11752.459921 secs 2024-07-26T11:51:32.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:32 smithi063 ceph-mon[36747]: pgmap v6726: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:32 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11752.459921 secs 2024-07-26T11:51:32.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:32 smithi043 ceph-mon[32384]: pgmap v6726: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:32 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11752.459921 secs 2024-07-26T11:51:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:32 smithi133 ceph-mon[37053]: pgmap v6726: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:34.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:34 smithi063 ceph-mon[36747]: pgmap v6727: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:34.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:34 smithi043 ceph-mon[32384]: pgmap v6727: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:34.515 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:34 smithi133 ceph-mon[37053]: pgmap v6727: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:36 smithi063 ceph-mon[36747]: pgmap v6728: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:36.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:36 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11741.976718 secs 2024-07-26T11:51:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:36 smithi043 ceph-mon[32384]: pgmap v6728: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:36.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:36 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11741.976718 secs 2024-07-26T11:51:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:36 smithi133 ceph-mon[37053]: pgmap v6728: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:36.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:36 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11741.976718 secs 2024-07-26T11:51:37.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:37 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11757.459996 secs 2024-07-26T11:51:37.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:37 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11757.459996 secs 2024-07-26T11:51:37.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:37 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11757.459996 secs 2024-07-26T11:51:38.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:38 smithi043 ceph-mon[32384]: pgmap v6729: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:38.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:38 smithi063 ceph-mon[36747]: pgmap v6729: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:38.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:38 smithi133 ceph-mon[37053]: pgmap v6729: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:39.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:39 smithi063 ceph-mon[36747]: pgmap v6730: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:39.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:39 smithi043 ceph-mon[32384]: pgmap v6730: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:39.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:39 smithi133 ceph-mon[37053]: pgmap v6730: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:41.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:40 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11746.976860 secs 2024-07-26T11:51:41.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:40 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11746.976860 secs 2024-07-26T11:51:41.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:40 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11746.976860 secs 2024-07-26T11:51:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:41 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11762.460120 secs 2024-07-26T11:51:42.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:41 smithi043 ceph-mon[32384]: pgmap v6731: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:41 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11762.460120 secs 2024-07-26T11:51:42.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:41 smithi133 ceph-mon[37053]: pgmap v6731: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:41 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11762.460120 secs 2024-07-26T11:51:42.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:41 smithi063 ceph-mon[36747]: pgmap v6731: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:44.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:43 smithi043 ceph-mon[32384]: pgmap v6732: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:44.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:43 smithi133 ceph-mon[37053]: pgmap v6732: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:44.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:43 smithi063 ceph-mon[36747]: pgmap v6732: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:45 smithi043 ceph-mon[32384]: pgmap v6733: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:46.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:45 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11751.976957 secs 2024-07-26T11:51:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:45 smithi133 ceph-mon[37053]: pgmap v6733: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:46.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:45 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11751.976957 secs 2024-07-26T11:51:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:45 smithi063 ceph-mon[36747]: pgmap v6733: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:46.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:45 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11751.976957 secs 2024-07-26T11:51:47.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:46 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11767.460243 secs 2024-07-26T11:51:47.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:46 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11767.460243 secs 2024-07-26T11:51:47.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:46 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11767.460243 secs 2024-07-26T11:51:48.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:47 smithi043 ceph-mon[32384]: pgmap v6734: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:48.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:47 smithi133 ceph-mon[37053]: pgmap v6734: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:48.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:47 smithi063 ceph-mon[36747]: pgmap v6734: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:50.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:49 smithi043 ceph-mon[32384]: pgmap v6735: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:50.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:49 smithi133 ceph-mon[37053]: pgmap v6735: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:50.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:49 smithi063 ceph-mon[36747]: pgmap v6735: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:51.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:50 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11756.977056 secs 2024-07-26T11:51:51.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:50 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11756.977056 secs 2024-07-26T11:51:51.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:50 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11756.977056 secs 2024-07-26T11:51:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:51 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11772.460372 secs 2024-07-26T11:51:52.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:51 smithi133 ceph-mon[37053]: pgmap v6736: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:52.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:51 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11772.460372 secs 2024-07-26T11:51:52.382 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:51 smithi063 ceph-mon[36747]: pgmap v6736: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:51 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11772.460372 secs 2024-07-26T11:51:52.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:51 smithi043 ceph-mon[32384]: pgmap v6736: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:54.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:53 smithi133 ceph-mon[37053]: pgmap v6737: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:54.317 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:53 smithi063 ceph-mon[36747]: pgmap v6737: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:54.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:53 smithi043 ceph-mon[32384]: pgmap v6737: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:51:55.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T11:51:55.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:51:55.392 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-26T11:51:55.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:51:55.454 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-07-26T11:51:55.505 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-26T11:51:55.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:51:55.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T11:51:55.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:51:55.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-07-26T11:51:56.012 INFO:tasks.kclient:Unmounting kernel clients... 2024-07-26T11:51:56.012 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-07-26T11:51:56.013 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T11:51:56.056 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053458,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499220k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249608k,nr_inodes=812402,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/ffc6a391e36a74d2449138d7192a7770d4fed72c30ef1769afee409a24fb9dbe/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/ffc6a391e36a74d2449138d7192a7770d4fed72c30ef1769afee409a24fb9dbe/diff,workdir=/var/lib/containers/storage/overlay/ffc6a391e36a74d2449138d7192a7770d4fed72c30ef1769afee409a24fb9dbe/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/751ff7e842818fc9300134748c04e9a426bfeca5fa841a1d8e7824d038f7558a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/751ff7e842818fc9300134748c04e9a426bfeca5fa841a1d8e7824d038f7558a/diff,workdir=/var/lib/containers/storage/overlay/751ff7e842818fc9300134748c04e9a426bfeca5fa841a1d8e7824d038f7558a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249608k,nr_inodes=812402,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/dc500e497cef5d7b0cadd1cdc613442ddac138bf0fb1d27533ef83ec1e4f670f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/dc500e497cef5d7b0cadd1cdc613442ddac138bf0fb1d27533ef83ec1e4f670f/diff,workdir=/var/lib/containers/storage/overlay/dc500e497cef5d7b0cadd1cdc613442ddac138bf0fb1d27533ef83ec1e4f670f/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/4c41721906ac2f55a175eb8ed1cc971a394e2959e5a0858d8b8a7d9bda0117af/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/4c41721906ac2f55a175eb8ed1cc971a394e2959e5a0858d8b8a7d9bda0117af/diff,workdir=/var/lib/containers/storage/overlay/4c41721906ac2f55a175eb8ed1cc971a394e2959e5a0858d8b8a7d9bda0117af/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2e1f04ac5f99fb4b1169e7e22e6418f110f4adfb9d1d9199e5ba4400a5008d9d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/2e1f04ac5f99fb4b1169e7e22e6418f110f4adfb9d1d9199e5ba4400a5008d9d/diff,workdir=/var/lib/containers/storage/overlay/2e1f04ac5f99fb4b1169e7e22e6418f110f4adfb9d1d9199e5ba4400a5008d9d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3f4092fd352380b2d0ed8ba9d69829a5aa0ae3bb6f33e2308f9bf27a54d0d236/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/3f4092fd352380b2d0ed8ba9d69829a5aa0ae3bb6f33e2308f9bf27a54d0d236/diff,workdir=/var/lib/containers/storage/overlay/3f4092fd352380b2d0ed8ba9d69829a5aa0ae3bb6f33e2308f9bf27a54d0d236/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499220k,nr_inodes=819200,mode=755 0 0 overlay /var/lib/containers/storage/overlay/ff402acb6bce76c1bd44986d4299b16215f59d2d7049cda5d9455e9c749dad43/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WBEQYWU7MAVBM327AB7XDHWNDQ:/var/lib/containers/storage/overlay/l/JJFNOIN7TTVJER3PKKD6Q2NVHK,upperdir=/var/lib/containers/storage/overlay/ff402acb6bce76c1bd44986d4299b16215f59d2d7049cda5d9455e9c749dad43/diff,workdir=/var/lib/containers/storage/overlay/ff402acb6bce76c1bd44986d4299b16215f59d2d7049cda5d9455e9c749dad43/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 2024-07-26T11:51:56.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:51:56.057 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-07-26T11:51:56.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T11:51:56.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-07-26T11:51:56.224 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:56 smithi043 ceph-mon[32384]: pgmap v6738: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:56.224 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:56 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11761.977145 secs 2024-07-26T11:51:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-07-26T11:51:56.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:51:56.246 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-07-26T11:51:56.258 INFO:tasks.cephadm:Teardown begin 2024-07-26T11:51:56.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-26T11:51:56.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T11:51:56.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:56 smithi133 ceph-mon[37053]: pgmap v6738: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:56.266 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:56 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11761.977145 secs 2024-07-26T11:51:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:56 smithi063 ceph-mon[36747]: pgmap v6738: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:51:56.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:56 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11761.977145 secs 2024-07-26T11:51:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:51:57.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:57 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11777.460498 secs 2024-07-26T11:51:57.265 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:57 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11777.460498 secs 2024-07-26T11:51:57.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:57 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11777.460498 secs 2024-07-26T11:51:58.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:51:58 smithi043 ceph-mon[32384]: pgmap v6739: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:58.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:51:58 smithi063 ceph-mon[36747]: pgmap v6739: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:58.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:51:58 smithi133 ceph-mon[37053]: pgmap v6739: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:51:59.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 -- 172.21.15.43:0/4076092284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac077370 msgr2=0x7f50ac077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:51:59.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 --2- 172.21.15.43:0/4076092284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac077370 0x7f50ac077780 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f509c009900 tx=0x7f509c02a3f0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 -- 172.21.15.43:0/4076092284 shutdown_connections 2024-07-26T11:51:59.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 --2- 172.21.15.43:0/4076092284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac113fb0 0x7f50ac1163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 --2- 172.21.15.43:0/4076092284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50ac077cc0 0x7f50ac113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 --2- 172.21.15.43:0/4076092284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac077370 0x7f50ac077780 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.170+0000 7f50b1c00640 1 -- 172.21.15.43:0/4076092284 >> 172.21.15.43:0/4076092284 conn(0x7f50ac1010a0 msgr2=0x7f50ac1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:51:59.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.171+0000 7f50b1c00640 1 -- 172.21.15.43:0/4076092284 shutdown_connections 2024-07-26T11:51:59.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.171+0000 7f50b1c00640 1 -- 172.21.15.43:0/4076092284 wait complete. 2024-07-26T11:51:59.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.172+0000 7f50b1c00640 1 Processor -- start 2024-07-26T11:51:59.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.172+0000 7f50b1c00640 1 -- start start 2024-07-26T11:51:59.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.173+0000 7f50b1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50ac077370 0x7f50ac1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:51:59.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.173+0000 7f50b1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac077cc0 0x7f50ac1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.173+0000 7f50b1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 0x7f50ac1a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.173+0000 7f50b1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac119a70 con 0x7f50ac077370 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.173+0000 7f50b1c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac1198f0 con 0x7f50ac113fb0 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.173+0000 7f50b1c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac119bf0 con 0x7f50ac077cc0 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50abe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50ac077370 0x7f50ac1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50ab400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac077cc0 0x7f50ac1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50b1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 0x7f50ac1a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:51:59.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50b1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 0x7f50ac1a5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36510/0 (socket says 172.21.15.43:36510) 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50b1200640 1 -- 172.21.15.43:0/3277248158 learned_addr learned my addr 172.21.15.43:0/3277248158 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50ab400640 1 -- 172.21.15.43:0/3277248158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 msgr2=0x7f50ac1a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50ab400640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 0x7f50ac1a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50ab400640 1 -- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50ac077370 msgr2=0x7f50ac1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50ab400640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50ac077370 0x7f50ac1a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50ab400640 1 -- 172.21.15.43:0/3277248158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac1a62b0 con 0x7f50ac077cc0 2024-07-26T11:51:59.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.174+0000 7f50b1200640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 0x7f50ac1a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:51:59.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.175+0000 7f50ab400640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac077cc0 0x7f50ac1a09a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f50ac06c2d0 tx=0x7f509800cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:51:59.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.175+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098007bb0 con 0x7f50ac077cc0 2024-07-26T11:51:59.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.175+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac1a65a0 con 0x7f50ac077cc0 2024-07-26T11:51:59.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.175+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5098007d50 con 0x7f50ac077cc0 2024-07-26T11:51:59.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.175+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098018780 con 0x7f50ac077cc0 2024-07-26T11:51:59.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.175+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac1acdc0 con 0x7f50ac077cc0 2024-07-26T11:51:59.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.177+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac077780 con 0x7f50ac077cc0 2024-07-26T11:51:59.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.181+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f509800f450 con 0x7f50ac077cc0 2024-07-26T11:51:59.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.183+0000 7f50a8c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f50900b3df0 0x7f50900b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:51:59.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.183+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f50980e5590 con 0x7f50ac077cc0 2024-07-26T11:51:59.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.183+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5098014030 con 0x7f50ac077cc0 2024-07-26T11:51:59.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.184+0000 7f50abe00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f50900b3df0 0x7f50900b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:51:59.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.185+0000 7f50abe00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f50900b3df0 0x7f50900b6300 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f509c009230 tx=0x7f509c0058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:51:59.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.429+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50ac1a1530 con 0x7f50ac077cc0 2024-07-26T11:51:59.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.431+0000 7f50a8c00640 1 -- 172.21.15.43:0/3277248158 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+6183 (secure 0 0 0) 0x7f50ac1a1530 con 0x7f50ac077cc0 2024-07-26T11:51:59.433 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T11:51:59.433 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":336,"btime":"2024-07-26T08:48:55:211772+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":336,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:48:55.211715+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24697,"mds_1":16164,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_16164":{"gid":16164,"name":"j","rank":1,"incarnation":331,"state":"up:active","state_seq":5,"addr":"172.21.15.43:6835/3604421927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3604421927},{"type":"v1","addr":"172.21.15.43:6835","nonce":3604421927}]},"join_fscid":-1,"laggy_since":"2024-07-26T08:48:55.211714+0000","export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":197,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":177,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25757":{"gid":25757,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/3085651024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3085651024},{"type":"v1","addr":"172.21.15.43:6841","nonce":3085651024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24697,"qdb_cluster":[24709,24697,16164]},"id":1}]} 2024-07-26T11:51:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 336 2024-07-26T11:51:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.434+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f50900b3df0 msgr2=0x7f50900b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:51:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.434+0000 7f50b1c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f50900b3df0 0x7f50900b6300 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f509c009230 tx=0x7f509c0058d0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.434+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac077cc0 msgr2=0x7f50ac1a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.434+0000 7f50b1c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac077cc0 0x7f50ac1a09a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f50ac06c2d0 tx=0x7f509800cdd0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.434+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 shutdown_connections 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f50900b3df0 0x7f50900b6300 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50ac077cc0 0x7f50ac1a09a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50ac113fb0 0x7f50ac1a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 --2- 172.21.15.43:0/3277248158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50ac077370 0x7f50ac1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 >> 172.21.15.43:0/3277248158 conn(0x7f50ac1010a0 msgr2=0x7f50ac115fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:51:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 shutdown_connections 2024-07-26T11:51:59.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:51:59.435+0000 7f50b1c00640 1 -- 172.21.15.43:0/3277248158 wait complete. 2024-07-26T11:52:00.174 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:00 smithi043 ceph-mon[32384]: pgmap v6740: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:00.174 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:00 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3277248158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T11:52:00.253 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs dump --format=json 2024-07-26T11:52:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:00 smithi063 ceph-mon[36747]: pgmap v6740: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:00.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:00 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3277248158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T11:52:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:00 smithi133 ceph-mon[37053]: pgmap v6740: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:00.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:00 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3277248158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T11:52:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:01.138 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:01 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11766.977257 secs 2024-07-26T11:52:01.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:01 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11766.977257 secs 2024-07-26T11:52:01.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:01 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11766.977257 secs 2024-07-26T11:52:02.313 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:02 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11782.460638 secs 2024-07-26T11:52:02.313 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:02 smithi043 ceph-mon[32384]: pgmap v6741: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:02 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11782.460638 secs 2024-07-26T11:52:02.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:02 smithi063 ceph-mon[36747]: pgmap v6741: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:02 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11782.460638 secs 2024-07-26T11:52:02.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:02 smithi133 ceph-mon[37053]: pgmap v6741: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:02.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.851+0000 7f546d200640 1 -- 172.21.15.43:0/1875730941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810af10 msgr2=0x7f546810b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:02.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.851+0000 7f546d200640 1 --2- 172.21.15.43:0/1875730941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810af10 0x7f546810b320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5454009860 tx=0x7f545402a340 comp rx=0 tx=0).stop 2024-07-26T11:52:02.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 -- 172.21.15.43:0/1875730941 shutdown_connections 2024-07-26T11:52:02.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 --2- 172.21.15.43:0/1875730941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546810b860 0x7f5468112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:02.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 --2- 172.21.15.43:0/1875730941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810af10 0x7f546810b320 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:02.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 --2- 172.21.15.43:0/1875730941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f54681059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:02.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 -- 172.21.15.43:0/1875730941 >> 172.21.15.43:0/1875730941 conn(0x7f5468101040 msgr2=0x7f5468103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:02.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 -- 172.21.15.43:0/1875730941 shutdown_connections 2024-07-26T11:52:02.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.852+0000 7f546d200640 1 -- 172.21.15.43:0/1875730941 wait complete. 2024-07-26T11:52:02.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.853+0000 7f546d200640 1 Processor -- start 2024-07-26T11:52:02.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.853+0000 7f546d200640 1 -- start start 2024-07-26T11:52:02.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f546d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f546819c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:02.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f546d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546810af10 0x7f546819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:02.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f546d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 0x7f54681a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f546d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5468115640 con 0x7f54681055d0 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f546d200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54681154c0 con 0x7f546810b860 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f546d200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f54681157c0 con 0x7f546810af10 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f5467400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f546819c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f5467e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 0x7f54681a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f5467e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 0x7f54681a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:36516/0 (socket says 172.21.15.43:36516) 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f5467e00640 1 -- 172.21.15.43:0/1072805755 learned_addr learned my addr 172.21.15.43:0/1072805755 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f5467400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f546819c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37480/0 (socket says 172.21.15.43:37480) 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.854+0000 7f5466a00640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546810af10 0x7f546819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467400640 1 -- 172.21.15.43:0/1072805755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546810af10 msgr2=0x7f546819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467400640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546810af10 0x7f546819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467400640 1 -- 172.21.15.43:0/1072805755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 msgr2=0x7f54681a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467400640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 0x7f54681a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467400640 1 -- 172.21.15.43:0/1072805755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54681a1fc0 con 0x7f54681055d0 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467e00640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 0x7f54681a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f5467400640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f546819c050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f545800e790 tx=0x7f545800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:02.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545800eea0 con 0x7f54681055d0 2024-07-26T11:52:02.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f545800ccc0 con 0x7f54681055d0 2024-07-26T11:52:02.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.855+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54681a22b0 con 0x7f54681055d0 2024-07-26T11:52:02.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.856+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54580187e0 con 0x7f54681055d0 2024-07-26T11:52:02.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.856+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54681a8a10 con 0x7f54681055d0 2024-07-26T11:52:02.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.857+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54681059e0 con 0x7f54681055d0 2024-07-26T11:52:02.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.860+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5458010430 con 0x7f54681055d0 2024-07-26T11:52:02.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.861+0000 7f545fe00640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f544c0b3d40 0x7f544c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:02.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.862+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f54580e59e0 con 0x7f54681055d0 2024-07-26T11:52:02.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.862+0000 7f5466a00640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f544c0b3d40 0x7f544c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:02.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.863+0000 7f5466a00640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f544c0b3d40 0x7f544c0b6250 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5454005940 tx=0x7f54540058d0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:02.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:02.864+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f54580ab2d0 con 0x7f54681055d0 2024-07-26T11:52:03.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.104+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f546802e0c0 con 0x7f54681055d0 2024-07-26T11:52:03.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.106+0000 7f545fe00640 1 -- 172.21.15.43:0/1072805755 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) ==== 95+0+6183 (secure 0 0 0) 0x7f54580af820 con 0x7f54681055d0 2024-07-26T11:52:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T11:52:03.108 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":336,"btime":"2024-07-26T08:48:55:211772+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":336,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T08:27:37.509952+0000","modified":"2024-07-26T08:48:55.211715+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24697,"mds_1":16164,"mds_2":24709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_16164":{"gid":16164,"name":"j","rank":1,"incarnation":331,"state":"up:active","state_seq":5,"addr":"172.21.15.43:6835/3604421927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3604421927},{"type":"v1","addr":"172.21.15.43:6835","nonce":3604421927}]},"join_fscid":-1,"laggy_since":"2024-07-26T08:48:55.211714+0000","export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1306232427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1306232427},{"type":"v1","addr":"172.21.15.133:6835","nonce":1306232427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":197,"addr":"172.21.15.133:6837/2370435591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2370435591},{"type":"v1","addr":"172.21.15.133:6837","nonce":2370435591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24709":{"gid":24709,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":177,"addr":"172.21.15.133:6839/475376324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":475376324},{"type":"v1","addr":"172.21.15.133:6839","nonce":475376324}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25757":{"gid":25757,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/3085651024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3085651024},{"type":"v1","addr":"172.21.15.43:6841","nonce":3085651024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24697,"qdb_cluster":[24709,24697,16164]},"id":1}]} 2024-07-26T11:52:03.108 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 336 2024-07-26T11:52:03.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.108+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f544c0b3d40 msgr2=0x7f544c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:03.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.108+0000 7f546d200640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f544c0b3d40 0x7f544c0b6250 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5454005940 tx=0x7f54540058d0 comp rx=0 tx=0).stop 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.108+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 msgr2=0x7f546819c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.108+0000 7f546d200640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f546819c050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f545800e790 tx=0x7f545800ec50 comp rx=0 tx=0).stop 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 shutdown_connections 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f544c0b3d40 0x7f544c0b6250 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546810af10 0x7f546819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f546810b860 0x7f54681a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 --2- 172.21.15.43:0/1072805755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54681055d0 0x7f546819c050 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 >> 172.21.15.43:0/1072805755 conn(0x7f5468101040 msgr2=0x7f5468103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 shutdown_connections 2024-07-26T11:52:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:03.109+0000 7f546d200640 1 -- 172.21.15.43:0/1072805755 wait complete. 2024-07-26T11:52:03.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd dump --format=json 2024-07-26T11:52:04.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:04 smithi043 ceph-mon[32384]: pgmap v6742: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:04.232 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:04 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1072805755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T11:52:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:04 smithi063 ceph-mon[36747]: pgmap v6742: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:04.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:04 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1072805755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T11:52:04.382 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:04 smithi133 ceph-mon[37053]: pgmap v6742: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:04.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:04 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1072805755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T11:52:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:06 smithi063 ceph-mon[36747]: pgmap v6743: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:52:06.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:06 smithi063 ceph-mon[36747]: 3 slow requests, 0 included below; oldest blocked for > 11771.977370 secs 2024-07-26T11:52:06.342 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:06 smithi043 ceph-mon[32384]: pgmap v6743: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:52:06.343 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:06 smithi043 ceph-mon[32384]: 3 slow requests, 0 included below; oldest blocked for > 11771.977370 secs 2024-07-26T11:52:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:06 smithi133 ceph-mon[37053]: pgmap v6743: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-07-26T11:52:06.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:06 smithi133 ceph-mon[37053]: 3 slow requests, 0 included below; oldest blocked for > 11771.977370 secs 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.665+0000 7f0e1e600640 1 -- 172.21.15.43:0/2406133015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 msgr2=0x7f0e181164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.665+0000 7f0e1e600640 1 --2- 172.21.15.43:0/2406133015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181164b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009be0 tx=0x7f0e1002a6c0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 -- 172.21.15.43:0/2406133015 shutdown_connections 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 --2- 172.21.15.43:0/2406133015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181164b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 --2- 172.21.15.43:0/2406133015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1810f330 0x7f0e1810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 --2- 172.21.15.43:0/2406133015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 0x7f0e18109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 -- 172.21.15.43:0/2406133015 >> 172.21.15.43:0/2406133015 conn(0x7f0e18078ff0 msgr2=0x7f0e18107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 -- 172.21.15.43:0/2406133015 shutdown_connections 2024-07-26T11:52:06.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.666+0000 7f0e1e600640 1 -- 172.21.15.43:0/2406133015 wait complete. 2024-07-26T11:52:06.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.667+0000 7f0e1e600640 1 Processor -- start 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.667+0000 7f0e1e600640 1 -- start start 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 0x7f0e181a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1e600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1810f330 0x7f0e181a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1e600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18119a60 con 0x7f0e181099f0 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1e600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181198e0 con 0x7f0e1810f330 2024-07-26T11:52:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1e600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18119be0 con 0x7f0e1810fc80 2024-07-26T11:52:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 0x7f0e181a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 0x7f0e181a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41382/0 (socket says 172.21.15.43:41382) 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1d200640 1 -- 172.21.15.43:0/1980768217 learned_addr learned my addr 172.21.15.43:0/1980768217 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e1dc00640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.668+0000 7f0e17e00640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1810f330 0x7f0e181a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.669+0000 7f0e1dc00640 1 -- 172.21.15.43:0/1980768217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1810f330 msgr2=0x7f0e181a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.669+0000 7f0e1dc00640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1810f330 0x7f0e181a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.669+0000 7f0e1dc00640 1 -- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 msgr2=0x7f0e181a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.669+0000 7f0e1dc00640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 0x7f0e181a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.669+0000 7f0e1dc00640 1 -- 172.21.15.43:0/1980768217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e181a62e0 con 0x7f0e1810fc80 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.669+0000 7f0e1dc00640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181a5bb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e1002abe0 tx=0x7f0e10032f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.670+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10041020 con 0x7f0e1810fc80 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.670+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e10030e90 con 0x7f0e1810fc80 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.670+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e181a6570 con 0x7f0e1810fc80 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.670+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10036040 con 0x7f0e1810fc80 2024-07-26T11:52:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.670+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e181acd30 con 0x7f0e1810fc80 2024-07-26T11:52:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.671+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e18109e00 con 0x7f0e1810fc80 2024-07-26T11:52:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.674+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0e10044020 con 0x7f0e1810fc80 2024-07-26T11:52:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.675+0000 7f0e15600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e000b3dc0 0x7f0e000b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.675+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7f0e101062c0 con 0x7f0e1810fc80 2024-07-26T11:52:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.676+0000 7f0e1d200640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e000b3dc0 0x7f0e000b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.676+0000 7f0e1d200640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e000b3dc0 0x7f0e000b62d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0058c0 tx=0x7f0e0c009260 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.677+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0e1004b030 con 0x7f0e1810fc80 2024-07-26T11:52:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.884+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e18111a70 con 0x7f0e1810fc80 2024-07-26T11:52:06.889 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-07-26T11:52:06.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.887+0000 7f0e15600640 1 -- 172.21.15.43:0/1980768217 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+31176 (secure 0 0 0) 0x7f0e100cc200 con 0x7f0e1810fc80 2024-07-26T11:52:06.891 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":137,"fsid":"4bbb8ba0-4b27-11ef-bcb6-c7b262605968","created":"2024-07-26T08:17:03.796350+0000","modified":"2024-07-26T08:48:36.627059+0000","last_up_change":"2024-07-26T08:26:20.804084+0000","last_in_change":"2024-07-26T08:26:00.556048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T08:22:02.663853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T08:27:28.061294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T08:27:32.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-26T08:27:46.378868+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dce96d84-5cb4-44d8-8562-8b0c37d34d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6803","nonce":4198258089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6805","nonce":4198258089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6809","nonce":4198258089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4198258089},{"type":"v1","addr":"172.21.15.43:6807","nonce":4198258089}]},"public_addr":"172.21.15.43:6803/4198258089","cluster_addr":"172.21.15.43:6805/4198258089","heartbeat_back_addr":"172.21.15.43:6809/4198258089","heartbeat_front_addr":"172.21.15.43:6807/4198258089","state":["exists","up"]},{"osd":1,"uuid":"2eae29bd-b685-4687-be6b-b9bc8014a1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6801","nonce":2190025564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6803","nonce":2190025564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6807","nonce":2190025564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2190025564},{"type":"v1","addr":"172.21.15.63:6805","nonce":2190025564}]},"public_addr":"172.21.15.63:6801/2190025564","cluster_addr":"172.21.15.63:6803/2190025564","heartbeat_back_addr":"172.21.15.63:6807/2190025564","heartbeat_front_addr":"172.21.15.63:6805/2190025564","state":["exists","up"]},{"osd":2,"uuid":"db61971e-05a7-4ea1-8c58-162bd956e3e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6801","nonce":2705571289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6803","nonce":2705571289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6807","nonce":2705571289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2705571289},{"type":"v1","addr":"172.21.15.133:6805","nonce":2705571289}]},"public_addr":"172.21.15.133:6801/2705571289","cluster_addr":"172.21.15.133:6803/2705571289","heartbeat_back_addr":"172.21.15.133:6807/2705571289","heartbeat_front_addr":"172.21.15.133:6805/2705571289","state":["exists","up"]},{"osd":3,"uuid":"b0df5a8b-b8dd-4bc2-be8e-a38c8f080fa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6811","nonce":1603187116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6813","nonce":1603187116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6817","nonce":1603187116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1603187116},{"type":"v1","addr":"172.21.15.43:6815","nonce":1603187116}]},"public_addr":"172.21.15.43:6811/1603187116","cluster_addr":"172.21.15.43:6813/1603187116","heartbeat_back_addr":"172.21.15.43:6817/1603187116","heartbeat_front_addr":"172.21.15.43:6815/1603187116","state":["exists","up"]},{"osd":4,"uuid":"3d643d69-23cc-46a6-9d86-2ca64b4ac93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6809","nonce":4195824513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6811","nonce":4195824513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6815","nonce":4195824513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":4195824513},{"type":"v1","addr":"172.21.15.63:6813","nonce":4195824513}]},"public_addr":"172.21.15.63:6809/4195824513","cluster_addr":"172.21.15.63:6811/4195824513","heartbeat_back_addr":"172.21.15.63:6815/4195824513","heartbeat_front_addr":"172.21.15.63:6813/4195824513","state":["exists","up"]},{"osd":5,"uuid":"bd66c187-2fc3-4e36-bf8c-6e9af071950f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6809","nonce":3668705015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6811","nonce":3668705015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6815","nonce":3668705015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3668705015},{"type":"v1","addr":"172.21.15.133:6813","nonce":3668705015}]},"public_addr":"172.21.15.133:6809/3668705015","cluster_addr":"172.21.15.133:6811/3668705015","heartbeat_back_addr":"172.21.15.133:6815/3668705015","heartbeat_front_addr":"172.21.15.133:6813/3668705015","state":["exists","up"]},{"osd":6,"uuid":"ff098a4b-47d7-4d9f-856a-dc459c4c50de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6819","nonce":4290651023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6821","nonce":4290651023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6825","nonce":4290651023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":4290651023},{"type":"v1","addr":"172.21.15.43:6823","nonce":4290651023}]},"public_addr":"172.21.15.43:6819/4290651023","cluster_addr":"172.21.15.43:6821/4290651023","heartbeat_back_addr":"172.21.15.43:6825/4290651023","heartbeat_front_addr":"172.21.15.43:6823/4290651023","state":["exists","up"]},{"osd":7,"uuid":"d2265c2c-251d-48f2-9310-172326a91490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6817","nonce":2487519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6819","nonce":2487519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6823","nonce":2487519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2487519},{"type":"v1","addr":"172.21.15.63:6821","nonce":2487519}]},"public_addr":"172.21.15.63:6817/2487519","cluster_addr":"172.21.15.63:6819/2487519","heartbeat_back_addr":"172.21.15.63:6823/2487519","heartbeat_front_addr":"172.21.15.63:6821/2487519","state":["exists","up"]},{"osd":8,"uuid":"13ecadf6-6a1a-4f91-a2b2-eac06fb449d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6817","nonce":868830377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6819","nonce":868830377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6823","nonce":868830377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":868830377},{"type":"v1","addr":"172.21.15.133:6821","nonce":868830377}]},"public_addr":"172.21.15.133:6817/868830377","cluster_addr":"172.21.15.133:6819/868830377","heartbeat_back_addr":"172.21.15.133:6823/868830377","heartbeat_front_addr":"172.21.15.133:6821/868830377","state":["exists","up"]},{"osd":9,"uuid":"4273c6ec-9a65-4f59-8200-0aad0c554159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6827","nonce":2141095989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6829","nonce":2141095989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6833","nonce":2141095989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":2141095989},{"type":"v1","addr":"172.21.15.43:6831","nonce":2141095989}]},"public_addr":"172.21.15.43:6827/2141095989","cluster_addr":"172.21.15.43:6829/2141095989","heartbeat_back_addr":"172.21.15.43:6833/2141095989","heartbeat_front_addr":"172.21.15.43:6831/2141095989","state":["exists","up"]},{"osd":10,"uuid":"8edd2a1c-458b-4853-894d-572b92611d54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6825","nonce":2504233154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6827","nonce":2504233154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6831","nonce":2504233154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2504233154},{"type":"v1","addr":"172.21.15.63:6829","nonce":2504233154}]},"public_addr":"172.21.15.63:6825/2504233154","cluster_addr":"172.21.15.63:6827/2504233154","heartbeat_back_addr":"172.21.15.63:6831/2504233154","heartbeat_front_addr":"172.21.15.63:6829/2504233154","state":["exists","up"]},{"osd":11,"uuid":"0b14cd08-5f61-4099-ade0-1f87dcee15d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6825","nonce":1325192368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6827","nonce":1325192368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6831","nonce":1325192368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1325192368},{"type":"v1","addr":"172.21.15.133:6829","nonce":1325192368}]},"public_addr":"172.21.15.133:6825/1325192368","cluster_addr":"172.21.15.133:6827/1325192368","heartbeat_back_addr":"172.21.15.133:6831/1325192368","heartbeat_front_addr":"172.21.15.133:6829/1325192368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:12.637010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:21:37.351481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:00.672880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:22:35.404739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:02.213698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:25.430704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:23:59.869199+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:26.455172+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:24:51.468060+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:26.262207+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:25:53.464030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T08:26:18.117079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6834/1153480487":"2024-07-27T08:48:36.627023+0000","172.21.15.43:6834/1786973356":"2024-07-27T08:48:19.910805+0000","172.21.15.43:6834/1337199959":"2024-07-27T08:48:02.577599+0000","172.21.15.43:6837/3942566175":"2024-07-27T08:47:45.167883+0000","172.21.15.43:6836/3942566175":"2024-07-27T08:47:45.167883+0000","172.21.15.43:6834/3989413214":"2024-07-27T08:46:52.883914+0000","172.21.15.43:6836/1364452024":"2024-07-27T08:46:36.685805+0000","172.21.15.63:6833/2807089237":"2024-07-27T08:46:20.120464+0000","172.21.15.63:6832/2807089237":"2024-07-27T08:46:20.120464+0000","172.21.15.43:6837/2435252716":"2024-07-27T08:45:58.267217+0000","172.21.15.63:6833/2161114143":"2024-07-27T08:45:39.403951+0000","172.21.15.43:6835/254024538":"2024-07-27T08:47:26.902442+0000","172.21.15.43:6838/1379895152":"2024-07-27T08:45:23.678907+0000","172.21.15.63:6833/194735852":"2024-07-27T08:45:05.988342+0000","172.21.15.43:6837/1562341679":"2024-07-27T08:44:50.072260+0000","172.21.15.63:6832/2026223441":"2024-07-27T08:44:29.479233+0000","172.21.15.63:6833/1808516906":"2024-07-27T08:43:56.375072+0000","172.21.15.43:6837/90216852":"2024-07-27T08:43:40.441207+0000","172.21.15.43:6835/3989413214":"2024-07-27T08:46:52.883914+0000","172.21.15.43:6837/170031347":"2024-07-27T08:43:07.408273+0000","172.21.15.43:6835/1153480487":"2024-07-27T08:48:36.627023+0000","172.21.15.133:6833/4140446689":"2024-07-27T08:42:50.009454+0000","172.21.15.43:6837/888824582":"2024-07-27T08:42:31.421407+0000","172.21.15.43:6835/1786973356":"2024-07-27T08:48:19.910805+0000","172.21.15.43:6836/888824582":"2024-07-27T08:42:31.421407+0000","172.21.15.43:6836/2435252716":"2024-07-27T08:45:58.267217+0000","172.21.15.43:6836/170031347":"2024-07-27T08:43:07.408273+0000","172.21.15.133:6833/1169720192":"2024-07-27T08:42:14.076955+0000","172.21.15.43:6834/254024538":"2024-07-27T08:47:26.902442+0000","172.21.15.133:6832/1169720192":"2024-07-27T08:42:14.076955+0000","172.21.15.133:6833/3876188029":"2024-07-27T08:41:41.060326+0000","172.21.15.63:6836/1305832455":"2024-07-27T08:37:12.350150+0000","172.21.15.43:0/711369665":"2024-07-27T08:18:11.763386+0000","172.21.15.63:6835/847478222":"2024-07-27T08:40:18.130776+0000","172.21.15.43:6838/2240411764":"2024-07-27T08:36:08.851244+0000","172.21.15.43:0/3582942481":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6837/10005976":"2024-07-27T08:47:10.135865+0000","172.21.15.43:0/2372393330":"2024-07-27T08:19:34.498126+0000","172.21.15.63:6832/1808516906":"2024-07-27T08:43:56.375072+0000","172.21.15.133:6832/1827419050":"2024-07-27T08:40:02.356166+0000","172.21.15.63:6838/2678612487":"2024-07-27T08:38:04.857675+0000","172.21.15.63:6837/3374136004":"2024-07-27T08:39:29.902320+0000","172.21.15.63:6834/847478222":"2024-07-27T08:40:18.130776+0000","172.21.15.63:6837/185000899":"2024-07-27T08:36:40.915762+0000","172.21.15.43:6839/1379895152":"2024-07-27T08:45:23.678907+0000","172.21.15.63:6839/3045590383":"2024-07-27T08:35:50.103234+0000","172.21.15.63:6834/2899086135":"2024-07-27T08:39:46.123624+0000","172.21.15.63:6832/10975952":"2024-07-27T08:43:23.659470+0000","172.21.15.63:6838/3045590383":"2024-07-27T08:35:50.103234+0000","172.21.15.63:6839/1532671211":"2024-07-27T08:36:25.086271+0000","172.21.15.43:6836/10005976":"2024-07-27T08:47:10.135865+0000","172.21.15.43:6841/445875183":"2024-07-27T08:35:49.778048+0000","172.21.15.63:6832/2161114143":"2024-07-27T08:45:39.403951+0000","172.21.15.63:6839/2003000329":"2024-07-27T08:36:56.485489+0000","172.21.15.43:0/1444395529":"2024-07-27T08:17:40.568271+0000","172.21.15.43:0/4108155415":"2024-07-27T08:19:34.498126+0000","172.21.15.63:6835/2899086135":"2024-07-27T08:39:46.123624+0000","172.21.15.43:0/1591014211":"2024-07-27T08:17:40.568271+0000","172.21.15.43:6839/2240411764":"2024-07-27T08:36:08.851244+0000","172.21.15.63:6837/2043430794":"2024-07-27T08:37:44.544250+0000","172.21.15.43:6801/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.63:6835/3210906292":"2024-07-27T08:40:49.870638+0000","172.21.15.43:6836/300735951":"2024-07-27T08:44:13.411147+0000","172.21.15.43:0/3446770894":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6835/1337199959":"2024-07-27T08:48:02.577599+0000","172.21.15.43:6801/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.43:6837/1364452024":"2024-07-27T08:46:36.685805+0000","172.21.15.43:0/2150907670":"2024-07-27T08:18:11.763386+0000","172.21.15.43:6836/737804035":"2024-07-27T08:41:57.894825+0000","172.21.15.63:6838/2003000329":"2024-07-27T08:36:56.485489+0000","172.21.15.133:6832/4140446689":"2024-07-27T08:42:50.009454+0000","172.21.15.43:0/1785866462":"2024-07-27T08:18:11.763386+0000","172.21.15.133:6833/1827419050":"2024-07-27T08:40:02.356166+0000","172.21.15.43:6836/1562341679":"2024-07-27T08:44:50.072260+0000","172.21.15.43:6836/90216852":"2024-07-27T08:43:40.441207+0000","172.21.15.43:6801/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.63:6836/185000899":"2024-07-27T08:36:40.915762+0000","172.21.15.63:6832/194735852":"2024-07-27T08:45:05.988342+0000","172.21.15.63:6833/2026223441":"2024-07-27T08:44:29.479233+0000","172.21.15.43:6800/1482734723":"2024-07-27T08:18:11.763386+0000","172.21.15.63:6838/2669403450":"2024-07-27T08:37:28.492219+0000","172.21.15.63:6837/1305832455":"2024-07-27T08:37:12.350150+0000","172.21.15.63:6836/2043430794":"2024-07-27T08:37:44.544250+0000","172.21.15.63:6839/2678612487":"2024-07-27T08:38:04.857675+0000","172.21.15.133:6832/3876188029":"2024-07-27T08:41:41.060326+0000","172.21.15.63:6836/4138037593":"2024-07-27T08:38:21.266602+0000","172.21.15.43:6840/445875183":"2024-07-27T08:35:49.778048+0000","172.21.15.63:6834/302781783":"2024-07-27T08:38:36.767530+0000","172.21.15.63:6835/302781783":"2024-07-27T08:38:36.767530+0000","172.21.15.63:6839/2669403450":"2024-07-27T08:37:28.492219+0000","172.21.15.63:6837/2786607239":"2024-07-27T08:38:53.713088+0000","172.21.15.63:6834/3551536194":"2024-07-27T08:41:24.959653+0000","172.21.15.63:6834/763173638":"2024-07-27T08:39:09.711725+0000","172.21.15.43:6800/1663543642":"2024-07-27T08:17:40.568271+0000","172.21.15.63:6835/763173638":"2024-07-27T08:39:09.711725+0000","172.21.15.43:6837/300735951":"2024-07-27T08:44:13.411147+0000","172.21.15.63:6836/3374136004":"2024-07-27T08:39:29.902320+0000","172.21.15.133:6832/4203458458":"2024-07-27T08:40:33.812857+0000","172.21.15.63:6833/10975952":"2024-07-27T08:43:23.659470+0000","172.21.15.63:6836/2786607239":"2024-07-27T08:38:53.713088+0000","172.21.15.63:6838/1532671211":"2024-07-27T08:36:25.086271+0000","172.21.15.133:6833/4203458458":"2024-07-27T08:40:33.812857+0000","172.21.15.43:6837/737804035":"2024-07-27T08:41:57.894825+0000","172.21.15.63:6835/3551536194":"2024-07-27T08:41:24.959653+0000","172.21.15.43:6800/3742875375":"2024-07-27T08:19:34.498126+0000","172.21.15.63:6834/3210906292":"2024-07-27T08:40:49.870638+0000","172.21.15.63:6837/4138037593":"2024-07-27T08:38:21.266602+0000","172.21.15.133:6832/641002587":"2024-07-27T08:41:05.579347+0000","172.21.15.133:6833/641002587":"2024-07-27T08:41:05.579347+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T11:52:06.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e000b3dc0 msgr2=0x7f0e000b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:06.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e000b3dc0 0x7f0e000b62d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0058c0 tx=0x7f0e0c009260 comp rx=0 tx=0).stop 2024-07-26T11:52:06.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 msgr2=0x7f0e181a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:06.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181a5bb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e1002abe0 tx=0x7f0e10032f90 comp rx=0 tx=0).stop 2024-07-26T11:52:06.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 shutdown_connections 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f0e000b3dc0 0x7f0e000b62d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1810fc80 0x7f0e181a5bb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e1810f330 0x7f0e181a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 --2- 172.21.15.43:0/1980768217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e181099f0 0x7f0e181a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.891+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 >> 172.21.15.43:0/1980768217 conn(0x7f0e18078ff0 msgr2=0x7f0e1810c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.892+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 shutdown_connections 2024-07-26T11:52:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:06.892+0000 7f0e1e600640 1 -- 172.21.15.43:0/1980768217 wait complete. 2024-07-26T11:52:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:07 smithi043 ceph-mon[32384]: 1 slow requests, 0 included below; oldest blocked for > 11787.460754 secs 2024-07-26T11:52:07.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:07 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1980768217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T11:52:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:07 smithi063 ceph-mon[36747]: 1 slow requests, 0 included below; oldest blocked for > 11787.460754 secs 2024-07-26T11:52:07.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:07 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1980768217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T11:52:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:07 smithi133 ceph-mon[37053]: 1 slow requests, 0 included below; oldest blocked for > 11787.460754 secs 2024-07-26T11:52:07.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:07 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1980768217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T11:52:07.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs fail cephfs 2024-07-26T11:52:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:08.318 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:08 smithi063 ceph-mon[36747]: pgmap v6744: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:08.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:08 smithi043 ceph-mon[32384]: pgmap v6744: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:08.417 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:08 smithi133 ceph-mon[37053]: pgmap v6744: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:09.338 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:09 smithi043 ceph-mon[32384]: pgmap v6745: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:09.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:09 smithi133 ceph-mon[37053]: pgmap v6745: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:09.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:09 smithi063 ceph-mon[36747]: pgmap v6745: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-07-26T11:52:10.077 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:52:10.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.387+0000 7fb3e1200640 1 -- 172.21.15.43:0/2363689154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc1033e0 msgr2=0x7fb3dc1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:10.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.387+0000 7fb3e1200640 1 --2- 172.21.15.43:0/2363689154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc1037f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009900 tx=0x7fb3cc02a410 comp rx=0 tx=0).stop 2024-07-26T11:52:10.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 -- 172.21.15.43:0/2363689154 shutdown_connections 2024-07-26T11:52:10.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 --2- 172.21.15.43:0/2363689154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc108d20 0x7fb3dc109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 --2- 172.21.15.43:0/2363689154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3dc109670 0x7fb3dc10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 --2- 172.21.15.43:0/2363689154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc1037f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 -- 172.21.15.43:0/2363689154 >> 172.21.15.43:0/2363689154 conn(0x7fb3dc0fee70 msgr2=0x7fb3dc1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:10.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 -- 172.21.15.43:0/2363689154 shutdown_connections 2024-07-26T11:52:10.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.388+0000 7fb3e1200640 1 -- 172.21.15.43:0/2363689154 wait complete. 2024-07-26T11:52:10.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.392 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.389+0000 7fb3e1200640 1 Processor -- start 2024-07-26T11:52:10.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.389+0000 7fb3e1200640 1 -- start start 2024-07-26T11:52:10.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3e1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:10.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3e1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3dc108d20 0x7fb3dc19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:10.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3e1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc109670 0x7fb3dc19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:10.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3e1200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc113450 con 0x7fb3dc108d20 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3e1200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc1132d0 con 0x7fb3dc109670 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3e1200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc1135d0 con 0x7fb3dc1033e0 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.390+0000 7fb3db400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3daa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3dc108d20 0x7fb3dc19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3db400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41546/0 (socket says 172.21.15.43:41546) 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3db400640 1 -- 172.21.15.43:0/751651588 learned_addr learned my addr 172.21.15.43:0/751651588 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc109670 0x7fb3dc19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 -- 172.21.15.43:0/751651588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc1033e0 msgr2=0x7fb3dc199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:10.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 -- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3dc108d20 msgr2=0x7fb3dc19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:10.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3dc108d20 0x7fb3dc19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 -- 172.21.15.43:0/751651588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc19fd90 con 0x7fb3dc109670 2024-07-26T11:52:10.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.391+0000 7fb3dbe00640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc109670 0x7fb3dc19f660 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009fd0 tx=0x7fb3d400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:10.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.392+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400ce20 con 0x7fb3dc109670 2024-07-26T11:52:10.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.392+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc1a0080 con 0x7fb3dc109670 2024-07-26T11:52:10.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.392+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb3d4005020 con 0x7fb3dc109670 2024-07-26T11:52:10.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.392+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4010720 con 0x7fb3dc109670 2024-07-26T11:52:10.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.392+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3dc1a67e0 con 0x7fb3dc109670 2024-07-26T11:52:10.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.393+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3dc1037f0 con 0x7fb3dc109670 2024-07-26T11:52:10.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.396+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb3d4005560 con 0x7fb3dc109670 2024-07-26T11:52:10.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.397+0000 7fb3d3e00640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3c00b3d40 0x7fb3c00b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:10.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.398+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 13494+0+0 (secure 0 0 0) 0x7fb3d40e60b0 con 0x7fb3dc109670 2024-07-26T11:52:10.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.398+0000 7fb3db400640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3c00b3d40 0x7fb3c00b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.399+0000 7fb3db400640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3c00b3d40 0x7fb3c00b6250 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc005f70 tx=0x7fb3cc005a20 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:10.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.399+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb3d40abff0 con 0x7fb3dc109670 2024-07-26T11:52:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:52:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:10 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T11:52:10.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.644+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb3dc19af50 con 0x7fb3dc109670 2024-07-26T11:52:10.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.657+0000 7fb3d3e00640 1 -- 172.21.15.43:0/751651588 <== mon.2 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v337) ==== 161+0+0 (secure 0 0 0) 0x7fb3dc19af50 con 0x7fb3dc109670 2024-07-26T11:52:10.661 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-26T11:52:10.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3c00b3d40 msgr2=0x7fb3c00b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:10.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3c00b3d40 0x7fb3c00b6250 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc005f70 tx=0x7fb3cc005a20 comp rx=0 tx=0).stop 2024-07-26T11:52:10.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc109670 msgr2=0x7fb3dc19f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:10.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc109670 0x7fb3dc19f660 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009fd0 tx=0x7fb3d400ef10 comp rx=0 tx=0).stop 2024-07-26T11:52:10.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 shutdown_connections 2024-07-26T11:52:10.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fb3c00b3d40 0x7fb3c00b6250 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3dc109670 0x7fb3dc19f660 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3dc108d20 0x7fb3dc19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 --2- 172.21.15.43:0/751651588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3dc1033e0 0x7fb3dc199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.665+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 >> 172.21.15.43:0/751651588 conn(0x7fb3dc0fee70 msgr2=0x7fb3dc101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.666+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 shutdown_connections 2024-07-26T11:52:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:10.666+0000 7fb3e1200640 1 -- 172.21.15.43:0/751651588 wait complete. 2024-07-26T11:52:10.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a[32380]: 2024-07-26T11:52:10.647+0000 7f5f40200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-26T11:52:10.984 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[101330]: ignoring --setuser ceph since I am not root 2024-07-26T11:52:10.984 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[101330]: ignoring --setgroup ceph since I am not root 2024-07-26T11:52:10.985 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-mds[101334]: -- 172.21.15.43:0/2433562771 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef117af860 con 0x55ef15951600 2024-07-26T11:52:10.985 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:52:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[101330]: starting mds.a at 2024-07-26T11:52:11.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: ignoring --setuser ceph since I am not root 2024-07-26T11:52:11.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: ignoring --setgroup ceph since I am not root 2024-07-26T11:52:11.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mds[68726]: -- 172.21.15.133:0/1392349747 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc7ddad860 con 0x55cc81f4f600 2024-07-26T11:52:11.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: starting mds.c at 2024-07-26T11:52:11.017 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i[69034]: ignoring --setuser ceph since I am not root 2024-07-26T11:52:11.017 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i[69034]: ignoring --setgroup ceph since I am not root 2024-07-26T11:52:11.017 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mds[69038]: -- 172.21.15.133:0/1823267647 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e300d1860 con 0x556e34273180 2024-07-26T11:52:11.017 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i[69034]: starting mds.i at 2024-07-26T11:52:11.017 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f[68416]: ignoring --setuser ceph since I am not root 2024-07-26T11:52:11.017 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f[68416]: ignoring --setgroup ceph since I am not root 2024-07-26T11:52:11.018 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-mds[68420]: -- 172.21.15.133:0/1868951666 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556808933860 con 0x55680cad5600 2024-07-26T11:52:11.018 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:52:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f[68416]: starting mds.f at 2024-07-26T11:52:11.398 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: pgmap v6746: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: pgmap v6747: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:52:11.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/751651588' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: Health check cleared: MDS_SLOW_REQUEST (was: 2 MDSs report slow requests) 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-07-26T11:52:11.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: osdmap e138: 12 total, 12 up, 12 in 2024-07-26T11:52:11.401 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:11 smithi043 ceph-mon[32384]: fsmap cephfs:0/3, 3 failed 2024-07-26T11:52:11.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-07-26T11:52:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:52:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:52:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:52:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:52:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: pgmap v6746: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:52:11.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: pgmap v6747: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/751651588' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: Health check cleared: MDS_SLOW_REQUEST (was: 2 MDSs report slow requests) 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-07-26T11:52:11.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: osdmap e138: 12 total, 12 up, 12 in 2024-07-26T11:52:11.518 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:11 smithi133 ceph-mon[37053]: fsmap cephfs:0/3, 3 failed 2024-07-26T11:52:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: Adjusting osd_memory_target on smithi043 to 177.5M 2024-07-26T11:52:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: Unable to set osd_memory_target on smithi043 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T11:52:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T11:52:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T11:52:11.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: pgmap v6746: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: pgmap v6747: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: from='mgr.24110 ' entity='mgr.x' 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/751651588' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-26T11:52:11.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: Health check cleared: MDS_SLOW_REQUEST (was: 2 MDSs report slow requests) 2024-07-26T11:52:11.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-07-26T11:52:11.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: osdmap e138: 12 total, 12 up, 12 in 2024-07-26T11:52:11.570 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:11 smithi063 ceph-mon[36747]: fsmap cephfs:0/3, 3 failed 2024-07-26T11:52:11.884 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: Health check cleared: FS_WITH_FAILED_MDS (was: 1 filesystem has a failed mds daemon) 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6832/3032421694,v1:172.21.15.133:6833/3032421694] up:boot 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6834/1058601787,v1:172.21.15.133:6835/1058601787] up:boot 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.133:6836/3275203067,v1:172.21.15.133:6837/3275203067] up:boot 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: mds.? [v2:172.21.15.43:6834/4244440627,v1:172.21.15.43:6835/4244440627] up:boot 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: fsmap cephfs:0/3 4 up:standby, 3 failed 2024-07-26T11:52:12.350 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T11:52:12.351 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T11:52:12.351 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T11:52:12.351 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:12 smithi043 ceph-mon[32384]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T11:52:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: Health check cleared: FS_WITH_FAILED_MDS (was: 1 filesystem has a failed mds daemon) 2024-07-26T11:52:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6832/3032421694,v1:172.21.15.133:6833/3032421694] up:boot 2024-07-26T11:52:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6834/1058601787,v1:172.21.15.133:6835/1058601787] up:boot 2024-07-26T11:52:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.133:6836/3275203067,v1:172.21.15.133:6837/3275203067] up:boot 2024-07-26T11:52:12.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: mds.? [v2:172.21.15.43:6834/4244440627,v1:172.21.15.43:6835/4244440627] up:boot 2024-07-26T11:52:12.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: fsmap cephfs:0/3 4 up:standby, 3 failed 2024-07-26T11:52:12.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T11:52:12.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T11:52:12.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T11:52:12.517 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:12 smithi133 ceph-mon[37053]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T11:52:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: Health check cleared: FS_WITH_FAILED_MDS (was: 1 filesystem has a failed mds daemon) 2024-07-26T11:52:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6832/3032421694,v1:172.21.15.133:6833/3032421694] up:boot 2024-07-26T11:52:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6834/1058601787,v1:172.21.15.133:6835/1058601787] up:boot 2024-07-26T11:52:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.133:6836/3275203067,v1:172.21.15.133:6837/3275203067] up:boot 2024-07-26T11:52:12.568 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: mds.? [v2:172.21.15.43:6834/4244440627,v1:172.21.15.43:6835/4244440627] up:boot 2024-07-26T11:52:12.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: fsmap cephfs:0/3 4 up:standby, 3 failed 2024-07-26T11:52:12.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T11:52:12.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T11:52:12.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T11:52:12.569 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:12 smithi063 ceph-mon[36747]: from='mgr.24110 172.21.15.43:0/398982085' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T11:52:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:13 smithi043 ceph-mon[32384]: pgmap v6749: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:14.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:13 smithi133 ceph-mon[37053]: pgmap v6749: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:14.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:13 smithi063 ceph-mon[36747]: pgmap v6749: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-07-26T11:52:14.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 -- 172.21.15.43:0/2207778253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d81057e0 msgr2=0x7fe2d8105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:14.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 --2- 172.21.15.43:0/2207778253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d81057e0 0x7fe2d8105bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009900 tx=0x7fe2c802a3f0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 -- 172.21.15.43:0/2207778253 shutdown_connections 2024-07-26T11:52:14.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 --2- 172.21.15.43:0/2207778253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d810ba70 0x7fe2d81122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 --2- 172.21.15.43:0/2207778253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2d810b120 0x7fe2d810b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 --2- 172.21.15.43:0/2207778253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d81057e0 0x7fe2d8105bf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 -- 172.21.15.43:0/2207778253 >> 172.21.15.43:0/2207778253 conn(0x7fe2d8101210 msgr2=0x7fe2d8103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:14.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 -- 172.21.15.43:0/2207778253 shutdown_connections 2024-07-26T11:52:14.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.069+0000 7fe2df200640 1 -- 172.21.15.43:0/2207778253 wait complete. 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.070+0000 7fe2df200640 1 Processor -- start 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 -- start start 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 0x7fe2d819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2d810b120 0x7fe2d819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d810ba70 0x7fe2d81a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81158a0 con 0x7fe2d810b120 2024-07-26T11:52:14.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8115720 con 0x7fe2d810ba70 2024-07-26T11:52:14.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.071+0000 7fe2df200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8115a20 con 0x7fe2d81057e0 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 0x7fe2d819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d810ba70 0x7fe2d81a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2cf400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2d810b120 0x7fe2d819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 0x7fe2d819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41588/0 (socket says 172.21.15.43:41588) 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 -- 172.21.15.43:0/1989507491 learned_addr learned my addr 172.21.15.43:0/1989507491 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 -- 172.21.15.43:0/1989507491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d810ba70 msgr2=0x7fe2d81a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:14.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d810ba70 0x7fe2d81a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 -- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2d810b120 msgr2=0x7fe2d819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2d810b120 0x7fe2d819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2d7e00640 1 -- 172.21.15.43:0/1989507491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d81a2260 con 0x7fe2d81057e0 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.072+0000 7fe2dd200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d810ba70 0x7fe2d81a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.073+0000 7fe2d7e00640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 0x7fe2d819c2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80314b0 tx=0x7fe2c8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.073+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c803f070 con 0x7fe2d81057e0 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.073+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d81a24f0 con 0x7fe2d81057e0 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.073+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2c8031bf0 con 0x7fe2d81057e0 2024-07-26T11:52:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.073+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8035030 con 0x7fe2d81057e0 2024-07-26T11:52:14.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.073+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d81a8cb0 con 0x7fe2d81057e0 2024-07-26T11:52:14.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.074+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d8105bf0 con 0x7fe2d81057e0 2024-07-26T11:52:14.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.077+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe2c8042070 con 0x7fe2d81057e0 2024-07-26T11:52:14.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.078+0000 7fe2d5600640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe2bc0b3d40 0x7fe2bc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:14.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.079+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 13752+0+0 (secure 0 0 0) 0x7fe2c8106110 con 0x7fe2d81057e0 2024-07-26T11:52:14.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.079+0000 7fe2cf400640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe2bc0b3d40 0x7fe2bc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.080+0000 7fe2cf400640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe2bc0b3d40 0x7fe2bc0b6250 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8104910 tx=0x7fe2c000b410 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.080+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe2c80cb900 con 0x7fe2d81057e0 2024-07-26T11:52:14.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.323+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe2d802e0c0 con 0x7fe2d81057e0 2024-07-26T11:52:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.676+0000 7fe2d5600640 1 -- 172.21.15.43:0/1989507491 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v339) ==== 104+0+0 (secure 0 0 0) 0x7fe2c80cfe50 con 0x7fe2d81057e0 2024-07-26T11:52:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.679+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe2bc0b3d40 msgr2=0x7fe2bc0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.679+0000 7fe2df200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe2bc0b3d40 0x7fe2bc0b6250 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8104910 tx=0x7fe2c000b410 comp rx=0 tx=0).stop 2024-07-26T11:52:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.679+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 msgr2=0x7fe2d819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.679+0000 7fe2df200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 0x7fe2d819c2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80314b0 tx=0x7fe2c8003c10 comp rx=0 tx=0).stop 2024-07-26T11:52:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 shutdown_connections 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fe2bc0b3d40 0x7fe2bc0b6250 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2d810ba70 0x7fe2d81a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2d810b120 0x7fe2d819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 --2- 172.21.15.43:0/1989507491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d81057e0 0x7fe2d819c2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 >> 172.21.15.43:0/1989507491 conn(0x7fe2d8101210 msgr2=0x7fe2d810a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 shutdown_connections 2024-07-26T11:52:14.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:14.680+0000 7fe2df200640 1 -- 172.21.15.43:0/1989507491 wait complete. 2024-07-26T11:52:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:14 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1989507491' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T11:52:14.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:14 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T11:52:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:14 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1989507491' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T11:52:15.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:14 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T11:52:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:14 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1989507491' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T11:52:15.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:14 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T11:52:15.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-26T11:52:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:15 smithi043 ceph-mon[32384]: pgmap v6750: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:52:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:15 smithi043 ceph-mon[32384]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T11:52:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:15 smithi043 ceph-mon[32384]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-07-26T11:52:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:15 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-07-26T11:52:15.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:15 smithi043 ceph-mon[32384]: fsmap 4 up:standby 2024-07-26T11:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:15 smithi133 ceph-mon[37053]: pgmap v6750: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:15 smithi133 ceph-mon[37053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T11:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:15 smithi133 ceph-mon[37053]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-07-26T11:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:15 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-07-26T11:52:16.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:15 smithi133 ceph-mon[37053]: fsmap 4 up:standby 2024-07-26T11:52:16.058 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:15 smithi063 ceph-mon[36747]: pgmap v6750: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-07-26T11:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:15 smithi063 ceph-mon[36747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T11:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:15 smithi063 ceph-mon[36747]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-07-26T11:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:15 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-07-26T11:52:16.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:15 smithi063 ceph-mon[36747]: fsmap 4 up:standby 2024-07-26T11:52:17.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:17 smithi043 ceph-mon[32384]: pgmap v6751: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T11:52:18.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:17 smithi133 ceph-mon[37053]: pgmap v6751: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T11:52:18.067 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:17 smithi063 ceph-mon[36747]: pgmap v6751: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T11:52:18.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.210+0000 7f913f000640 1 -- 172.21.15.43:0/2147954679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f913810f330 msgr2=0x7f913810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:18.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 --2- 172.21.15.43:0/2147954679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f913810f330 0x7f913810f740 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9124009900 tx=0x7f912402a3f0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 -- 172.21.15.43:0/2147954679 shutdown_connections 2024-07-26T11:52:18.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 --2- 172.21.15.43:0/2147954679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 0x7f91381164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 --2- 172.21.15.43:0/2147954679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f913810f330 0x7f913810f740 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 --2- 172.21.15.43:0/2147954679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91381099f0 0x7f9138109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 -- 172.21.15.43:0/2147954679 >> 172.21.15.43:0/2147954679 conn(0x7f9138078ff0 msgr2=0x7f9138107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:18.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 -- 172.21.15.43:0/2147954679 shutdown_connections 2024-07-26T11:52:18.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.211+0000 7f913f000640 1 -- 172.21.15.43:0/2147954679 wait complete. 2024-07-26T11:52:18.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.212+0000 7f913f000640 1 Processor -- start 2024-07-26T11:52:18.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.212+0000 7f913f000640 1 -- start start 2024-07-26T11:52:18.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91381099f0 0x7f91381a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f913810f330 0x7f91381a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 0x7f91381a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9138119ab0 con 0x7f913810fc80 2024-07-26T11:52:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9138119930 con 0x7f91381099f0 2024-07-26T11:52:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9138119c30 con 0x7f913810f330 2024-07-26T11:52:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91381099f0 0x7f91381a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 0x7f91381a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f913810f330 0x7f91381a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f913810f330 0x7f91381a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:38490/0 (socket says 172.21.15.43:38490) 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91381099f0 0x7f91381a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.43:45972/0 (socket says 172.21.15.43:45972) 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.213+0000 7f913d200640 1 -- 172.21.15.43:0/1567815431 learned_addr learned my addr 172.21.15.43:0/1567815431 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f913e600640 1 -- 172.21.15.43:0/1567815431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f913810f330 msgr2=0x7f91381a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f913e600640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f913810f330 0x7f91381a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f913e600640 1 -- 172.21.15.43:0/1567815431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91381099f0 msgr2=0x7f91381a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:18.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f913e600640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91381099f0 0x7f91381a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f913e600640 1 -- 172.21.15.43:0/1567815431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91381a6370 con 0x7f913810fc80 2024-07-26T11:52:18.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f913e600640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 0x7f91381a5c40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9130009fd0 tx=0x7f913000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:18.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.214+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913000ce20 con 0x7f913810fc80 2024-07-26T11:52:18.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.215+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9130005020 con 0x7f913810fc80 2024-07-26T11:52:18.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.215+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91381a6660 con 0x7f913810fc80 2024-07-26T11:52:18.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.215+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130010720 con 0x7f913810fc80 2024-07-26T11:52:18.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.215+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91381acdc0 con 0x7f913810fc80 2024-07-26T11:52:18.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.216+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9138109e00 con 0x7f913810fc80 2024-07-26T11:52:18.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.219+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f9130005560 con 0x7f913810fc80 2024-07-26T11:52:18.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.221+0000 7f9136000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f91200b3d40 0x7f91200b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:18.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.222+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 13752+0+0 (secure 0 0 0) 0x7f91300e5b60 con 0x7f913810fc80 2024-07-26T11:52:18.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.222+0000 7f913dc00640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f91200b3d40 0x7f91200b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:18.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.222+0000 7f913dc00640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f91200b3d40 0x7f91200b6250 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f912c009bd0 tx=0x7f912c005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:18.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.224+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f91300ab9a0 con 0x7f913810fc80 2024-07-26T11:52:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.425+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f91381a1530 con 0x7f913810fc80 2024-07-26T11:52:18.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.695+0000 7f9136000640 1 -- 172.21.15.43:0/1567815431 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v139) ==== 181+0+0 (secure 0 0 0) 0x7f91381a1530 con 0x7f913810fc80 2024-07-26T11:52:18.698 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-07-26T11:52:18.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f91200b3d40 msgr2=0x7f91200b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:18.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f91200b3d40 0x7f91200b6250 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f912c009bd0 tx=0x7f912c005f90 comp rx=0 tx=0).stop 2024-07-26T11:52:18.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 msgr2=0x7f91381a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:18.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 0x7f91381a5c40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9130009fd0 tx=0x7f913000ef10 comp rx=0 tx=0).stop 2024-07-26T11:52:18.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 shutdown_connections 2024-07-26T11:52:18.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7f91200b3d40 0x7f91200b6250 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f913810f330 0x7f91381a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913810fc80 0x7f91381a5c40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 --2- 172.21.15.43:0/1567815431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91381099f0 0x7f91381a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:18.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.700+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 >> 172.21.15.43:0/1567815431 conn(0x7f9138078ff0 msgr2=0x7f9138107df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:18.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.701+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 shutdown_connections 2024-07-26T11:52:18.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:18.702+0000 7f913f000640 1 -- 172.21.15.43:0/1567815431 wait complete. 2024-07-26T11:52:18.984 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:18 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1567815431' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:19.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:18 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1567815431' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:19.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:18 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1567815431' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:19.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-26T11:52:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:19 smithi043 ceph-mon[32384]: pgmap v6752: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T11:52:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:19 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/1567815431' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:19.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:19 smithi043 ceph-mon[32384]: osdmap e139: 12 total, 12 up, 12 in 2024-07-26T11:52:20.015 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:19 smithi133 ceph-mon[37053]: pgmap v6752: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T11:52:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:19 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/1567815431' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:20.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:19 smithi133 ceph-mon[37053]: osdmap e139: 12 total, 12 up, 12 in 2024-07-26T11:52:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:19 smithi063 ceph-mon[36747]: pgmap v6752: 129 pgs: 129 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T11:52:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:19 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/1567815431' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:20.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:19 smithi063 ceph-mon[36747]: osdmap e139: 12 total, 12 up, 12 in 2024-07-26T11:52:20.071 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:21.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:21 smithi043 ceph-mon[32384]: pgmap v6754: 97 pgs: 97 active+clean; 129 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:22.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:21 smithi133 ceph-mon[37053]: pgmap v6754: 97 pgs: 97 active+clean; 129 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:22.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:21 smithi063 ceph-mon[36747]: pgmap v6754: 97 pgs: 97 active+clean; 129 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.241+0000 7fd1c7000640 1 -- 172.21.15.43:0/3582439775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 msgr2=0x7fd1c010b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.241+0000 7fd1c7000640 1 --2- 172.21.15.43:0/3582439775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 0x7fd1c010b530 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009900 tx=0x7fd1ac02a3f0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 -- 172.21.15.43:0/3582439775 shutdown_connections 2024-07-26T11:52:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 --2- 172.21.15.43:0/3582439775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 0x7fd1c010b530 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 --2- 172.21.15.43:0/3582439775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 0x7fd1c01122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 --2- 172.21.15.43:0/3582439775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c0105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 -- 172.21.15.43:0/3582439775 >> 172.21.15.43:0/3582439775 conn(0x7fd1c01011f0 msgr2=0x7fd1c0103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 -- 172.21.15.43:0/3582439775 shutdown_connections 2024-07-26T11:52:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.242+0000 7fd1c7000640 1 -- 172.21.15.43:0/3582439775 wait complete. 2024-07-26T11:52:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.243+0000 7fd1c7000640 1 Processor -- start 2024-07-26T11:52:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.244+0000 7fd1c7000640 1 -- start start 2024-07-26T11:52:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.244+0000 7fd1c7000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.244+0000 7fd1c7000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 0x7fd1c019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1c7000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 0x7fd1c01a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1c7000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0115880 con 0x7fd1c01057e0 2024-07-26T11:52:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1c7000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0115700 con 0x7fd1c010ba70 2024-07-26T11:52:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1c7000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0115a00 con 0x7fd1c010b120 2024-07-26T11:52:22.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:22.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c019c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60488/0 (socket says 172.21.15.43:60488) 2024-07-26T11:52:22.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1bfe00640 1 -- 172.21.15.43:0/737643865 learned_addr learned my addr 172.21.15.43:0/737643865 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:22.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1bf400640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 0x7fd1c019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1c5000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 0x7fd1c01a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1bfe00640 1 -- 172.21.15.43:0/737643865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 msgr2=0x7fd1c019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.245+0000 7fd1bfe00640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 0x7fd1c019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bfe00640 1 -- 172.21.15.43:0/737643865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 msgr2=0x7fd1c01a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bfe00640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 0x7fd1c01a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bfe00640 1 -- 172.21.15.43:0/737643865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c01a2140 con 0x7fd1c01057e0 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1c5000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 0x7fd1c01a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T11:52:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bfe00640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c019c1d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000e9f0 tx=0x7fd1b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000cd80 con 0x7fd1c01057e0 2024-07-26T11:52:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c01a2430 con 0x7fd1c01057e0 2024-07-26T11:52:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd1b0010900 con 0x7fd1c01057e0 2024-07-26T11:52:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00188d0 con 0x7fd1c01057e0 2024-07-26T11:52:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.246+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c01a8b90 con 0x7fd1c01057e0 2024-07-26T11:52:22.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.248+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c0105bf0 con 0x7fd1c01057e0 2024-07-26T11:52:22.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.250+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd1b0010ab0 con 0x7fd1c01057e0 2024-07-26T11:52:22.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.252+0000 7fd1bcc00640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd1a40b3d40 0x7fd1a40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:22.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.252+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 13227+0+0 (secure 0 0 0) 0x7fd1b00e5aa0 con 0x7fd1c01057e0 2024-07-26T11:52:22.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.252+0000 7fd1bf400640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd1a40b3d40 0x7fd1a40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:22.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.253+0000 7fd1bf400640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd1a40b3d40 0x7fd1a40b6250 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac02a9e0 tx=0x7fd1ac000bc0 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:22.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.255+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd1b00ab4a0 con 0x7fd1c01057e0 2024-07-26T11:52:22.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.464+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1c019d300 con 0x7fd1c01057e0 2024-07-26T11:52:22.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.718+0000 7fd1bcc00640 1 -- 172.21.15.43:0/737643865 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v140) ==== 169+0+0 (secure 0 0 0) 0x7fd1b00af9f0 con 0x7fd1c01057e0 2024-07-26T11:52:22.720 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-07-26T11:52:22.721 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:22 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/737643865' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd1a40b3d40 msgr2=0x7fd1a40b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd1a40b3d40 0x7fd1a40b6250 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac02a9e0 tx=0x7fd1ac000bc0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 msgr2=0x7fd1c019c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c019c1d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000e9f0 tx=0x7fd1b000eeb0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 shutdown_connections 2024-07-26T11:52:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fd1a40b3d40 0x7fd1a40b6250 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c010b120 0x7fd1c019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c010ba70 0x7fd1c01a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 --2- 172.21.15.43:0/737643865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c01057e0 0x7fd1c019c1d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.723+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 >> 172.21.15.43:0/737643865 conn(0x7fd1c01011f0 msgr2=0x7fd1c010a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.725+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 shutdown_connections 2024-07-26T11:52:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:22.725+0000 7fd1c7000640 1 -- 172.21.15.43:0/737643865 wait complete. 2024-07-26T11:52:23.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:22 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/737643865' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:23.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:22 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/737643865' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:23.521 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-07-26T11:52:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:23 smithi043 ceph-mon[32384]: pgmap v6755: 97 pgs: 97 active+clean; 129 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:23 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/737643865' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:23.733 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:23 smithi043 ceph-mon[32384]: osdmap e140: 12 total, 12 up, 12 in 2024-07-26T11:52:23.965 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/mon.a/config 2024-07-26T11:52:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:23 smithi133 ceph-mon[37053]: pgmap v6755: 97 pgs: 97 active+clean; 129 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:23 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/737643865' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:24.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:23 smithi133 ceph-mon[37053]: osdmap e140: 12 total, 12 up, 12 in 2024-07-26T11:52:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:23 smithi063 ceph-mon[36747]: pgmap v6755: 97 pgs: 97 active+clean; 129 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:23 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/737643865' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:24.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:23 smithi063 ceph-mon[36747]: osdmap e140: 12 total, 12 up, 12 in 2024-07-26T11:52:25.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:25 smithi043 ceph-mon[32384]: pgmap v6757: 33 pgs: 33 active+clean; 129 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:26.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:25 smithi133 ceph-mon[37053]: pgmap v6757: 33 pgs: 33 active+clean; 129 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:26.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:25 smithi063 ceph-mon[36747]: pgmap v6757: 33 pgs: 33 active+clean; 129 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 -- 172.21.15.43:0/2802904955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c1055e0 msgr2=0x7fa52c1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 --2- 172.21.15.43:0/2802904955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c1055e0 0x7fa52c1059f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa520009900 tx=0x7fa52002a3f0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 -- 172.21.15.43:0/2802904955 shutdown_connections 2024-07-26T11:52:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 --2- 172.21.15.43:0/2802904955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c10b870 0x7fa52c1120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 --2- 172.21.15.43:0/2802904955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa52c10af20 0x7fa52c10b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 --2- 172.21.15.43:0/2802904955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c1055e0 0x7fa52c1059f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 -- 172.21.15.43:0/2802904955 >> 172.21.15.43:0/2802904955 conn(0x7fa52c1010b0 msgr2=0x7fa52c103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.398+0000 7fa532800640 1 -- 172.21.15.43:0/2802904955 shutdown_connections 2024-07-26T11:52:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.399+0000 7fa532800640 1 -- 172.21.15.43:0/2802904955 wait complete. 2024-07-26T11:52:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 Processor -- start 2024-07-26T11:52:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 -- start start 2024-07-26T11:52:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 0x7fa52c19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c10af20 0x7fa52c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa52c10b870 0x7fa52c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c115670 con 0x7fa52c10af20 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c1154f0 con 0x7fa52c10b870 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.400+0000 7fa532800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c1157f0 con 0x7fa52c1055e0 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa530a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c10af20 0x7fa52c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 0x7fa52c19c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 0x7fa52c19c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.43:41524/0 (socket says 172.21.15.43:41524) 2024-07-26T11:52:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 -- 172.21.15.43:0/3463293964 learned_addr learned my addr 172.21.15.43:0/3463293964 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa530a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c10af20 0x7fa52c19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56206/0 (socket says 172.21.15.43:56206) 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531e00640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa52c10b870 0x7fa52c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 -- 172.21.15.43:0/3463293964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa52c10b870 msgr2=0x7fa52c1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa52c10b870 0x7fa52c1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 -- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c10af20 msgr2=0x7fa52c19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c10af20 0x7fa52c19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.401+0000 7fa531400640 1 -- 172.21.15.43:0/3463293964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c1a2070 con 0x7fa52c1055e0 2024-07-26T11:52:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.402+0000 7fa531400640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 0x7fa52c19c100 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa520005ab0 tx=0x7fa5200040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.402+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52003f030 con 0x7fa52c1055e0 2024-07-26T11:52:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.402+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa520003ac0 con 0x7fa52c1055e0 2024-07-26T11:52:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.402+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52c1a2300 con 0x7fa52c1055e0 2024-07-26T11:52:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.402+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520035070 con 0x7fa52c1055e0 2024-07-26T11:52:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.402+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52c1a8ac0 con 0x7fa52c1055e0 2024-07-26T11:52:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.403+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52c1059f0 con 0x7fa52c1055e0 2024-07-26T11:52:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.406+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa520042030 con 0x7fa52c1055e0 2024-07-26T11:52:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.407+0000 7fa52a000640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5140b3d40 0x7fa5140b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T11:52:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.407+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 12581+0+0 (secure 0 0 0) 0x7fa520105900 con 0x7fa52c1055e0 2024-07-26T11:52:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.408+0000 7fa530a00640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5140b3d40 0x7fa5140b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T11:52:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.409+0000 7fa530a00640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5140b3d40 0x7fa5140b6250 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa5180095f0 tx=0x7fa518005f90 comp rx=0 tx=0).ready entity=mgr.24110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T11:52:26.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.409+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa5200cb580 con 0x7fa52c1055e0 2024-07-26T11:52:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.611+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa52c10d640 con 0x7fa52c1055e0 2024-07-26T11:52:26.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.746+0000 7fa52a000640 1 -- 172.21.15.43:0/3463293964 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v141) ==== 178+0+0 (secure 0 0 0) 0x7fa5200cfad0 con 0x7fa52c1055e0 2024-07-26T11:52:26.750 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' removed 2024-07-26T11:52:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5140b3d40 msgr2=0x7fa5140b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5140b3d40 0x7fa5140b6250 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa5180095f0 tx=0x7fa518005f90 comp rx=0 tx=0).stop 2024-07-26T11:52:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 msgr2=0x7fa52c19c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T11:52:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 0x7fa52c19c100 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa520005ab0 tx=0x7fa5200040c0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 shutdown_connections 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:6800/3495158800,v1:172.21.15.43:6801/3495158800] conn(0x7fa5140b3d40 0x7fa5140b6250 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa52c10b870 0x7fa52c1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52c10af20 0x7fa52c19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 --2- 172.21.15.43:0/3463293964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa52c1055e0 0x7fa52c19c100 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa520005ab0 tx=0x7fa5200040c0 comp rx=0 tx=0).stop 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 >> 172.21.15.43:0/3463293964 conn(0x7fa52c1010b0 msgr2=0x7fa52c10a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.751+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 shutdown_connections 2024-07-26T11:52:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-07-26T11:52:26.752+0000 7fa532800640 1 -- 172.21.15.43:0/3463293964 wait complete. 2024-07-26T11:52:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:26 smithi043 ceph-mon[32384]: from='client.? 172.21.15.43:0/3463293964' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:26.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:26 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:26 smithi133 ceph-mon[37053]: from='client.? 172.21.15.43:0/3463293964' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:27.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:26 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:26 smithi063 ceph-mon[36747]: from='client.? 172.21.15.43:0/3463293964' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:27.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:26 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-26T11:52:27.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-26T11:52:27.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-26T11:52:27.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-26T11:52:27.631 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-07-26T11:52:27.631 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-07-26T11:52:27.690 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-07-26T11:52:27.707 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-07-26T11:52:27.722 INFO:tasks.cephadm:Stopping all daemons... 2024-07-26T11:52:27.723 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-07-26T11:52:27.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a 2024-07-26T11:52:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:27 smithi133 ceph-mon[37053]: pgmap v6758: 33 pgs: 33 active+clean; 129 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:27 smithi133 ceph-mon[37053]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:28.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:27 smithi133 ceph-mon[37053]: osdmap e141: 12 total, 12 up, 12 in 2024-07-26T11:52:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:27 smithi063 ceph-mon[36747]: pgmap v6758: 33 pgs: 33 active+clean; 129 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:27 smithi063 ceph-mon[36747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:28.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:27 smithi063 ceph-mon[36747]: osdmap e141: 12 total, 12 up, 12 in 2024-07-26T11:52:28.233 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:27 smithi043 ceph-mon[32384]: pgmap v6758: 33 pgs: 33 active+clean; 129 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T11:52:28.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:27 smithi043 ceph-mon[32384]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-07-26T11:52:28.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:27 smithi043 ceph-mon[32384]: osdmap e141: 12 total, 12 up, 12 in 2024-07-26T11:52:28.234 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:27 smithi043 systemd[1]: Stopping Ceph mon.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a[32380]: 2024-07-26T11:52:28.319+0000 7f5f47000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a[32380]: 2024-07-26T11:52:28.319+0000 7f5f47000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-07-26T11:52:28.734 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:28 smithi043 podman[162247]: 2024-07-26 11:52:28.453353304 +0000 UTC m=+0.278813829 container died c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T11:52:29.074 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:28 smithi043 podman[162247]: 2024-07-26 11:52:28.854425633 +0000 UTC m=+0.679886194 container cleanup c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-07-26T11:52:29.075 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:28 smithi043 bash[162247]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a 2024-07-26T11:52:29.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Jul 26 11:52:29 smithi043 podman[162260]: 2024-07-26 11:52:29.072442458 +0000 UTC m=+0.601312844 container remove c8e48164867c99b16291608d5d1476db44906966056cc9dda1eb7958adff2a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0) 2024-07-26T11:52:29.627 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.a.service' 2024-07-26T11:52:29.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:29.776 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-07-26T11:52:29.777 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-07-26T11:52:29.777 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.b 2024-07-26T11:52:30.068 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:29 smithi063 systemd[1]: Stopping Ceph mon.b for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:30.476 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-b[36742]: 2024-07-26T11:52:30.099+0000 7f7254694640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:30.476 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-b[36742]: 2024-07-26T11:52:30.099+0000 7f7254694640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-07-26T11:52:30.476 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:30 smithi063 podman[123878]: 2024-07-26 11:52:30.201723128 +0000 UTC m=+0.223981605 container died a03d099b5780b5f7b1e8f530629eba025943876b12ceb1ca37b26b703c29be87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-07-26T11:52:31.052 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:30 smithi063 podman[123878]: 2024-07-26 11:52:30.791937913 +0000 UTC m=+0.814196388 container cleanup a03d099b5780b5f7b1e8f530629eba025943876b12ceb1ca37b26b703c29be87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True) 2024-07-26T11:52:31.053 INFO:journalctl@ceph.mon.b.smithi063.stdout:Jul 26 11:52:30 smithi063 bash[123878]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-b 2024-07-26T11:52:31.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.b.service' 2024-07-26T11:52:31.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:31.277 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-07-26T11:52:31.277 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-07-26T11:52:31.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.c 2024-07-26T11:52:31.661 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:31 smithi133 systemd[1]: Stopping Ceph mon.c for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c[37039]: 2024-07-26T11:52:31.659+0000 7facf3b6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c[37039]: 2024-07-26T11:52:31.659+0000 7facf3b6b640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-07-26T11:52:32.016 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:31 smithi133 podman[122321]: 2024-07-26 11:52:31.782613698 +0000 UTC m=+0.314783652 container died 690b7b291788330724b60214e96a73772dea8f2c796c6bf8767383f15a9a015a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:52:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:32 smithi133 podman[122321]: 2024-07-26 11:52:32.257924629 +0000 UTC m=+0.790094575 container cleanup 690b7b291788330724b60214e96a73772dea8f2c796c6bf8767383f15a9a015a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:52:32.516 INFO:journalctl@ceph.mon.c.smithi133.stdout:Jul 26 11:52:32 smithi133 bash[122321]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mon-c 2024-07-26T11:52:32.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mon.c.service' 2024-07-26T11:52:32.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:32.744 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-07-26T11:52:32.745 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-07-26T11:52:32.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x 2024-07-26T11:52:33.233 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:32 smithi043 systemd[1]: Stopping Ceph mgr.x for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:33.734 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T11:52:33.414+0000 7fb57f600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:33.734 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x[32610]: 2024-07-26T11:52:33.414+0000 7fb57f600640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-07-26T11:52:33.734 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:33 smithi043 podman[162366]: 2024-07-26 11:52:33.528426872 +0000 UTC m=+0.293255421 container died 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-07-26T11:52:34.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:34 smithi043 podman[162366]: 2024-07-26 11:52:34.009295051 +0000 UTC m=+0.774123601 container cleanup 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-07-26T11:52:34.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:34 smithi043 bash[162366]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x 2024-07-26T11:52:34.482 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Jul 26 11:52:34 smithi043 podman[162377]: 2024-07-26 11:52:34.211109461 +0000 UTC m=+0.663479812 container remove 875cd6275e7c2db855e1c46f011dfb68072042f322fc045a623497ae5fc4e205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724) 2024-07-26T11:52:34.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.x.service' 2024-07-26T11:52:34.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:34.815 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-07-26T11:52:34.815 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-07-26T11:52:34.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.y 2024-07-26T11:52:35.259 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 11:52:34 smithi063 systemd[1]: Stopping Ceph mgr.y for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:35.557 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 11:52:35 smithi063 podman[124000]: 2024-07-26 11:52:35.25901049 +0000 UTC m=+0.247313912 container died cd5c040c0d7b78c291bcb60d08d766167577cd720052621f62af455f2589bc7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=) 2024-07-26T11:52:35.818 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 11:52:35 smithi063 podman[124000]: 2024-07-26 11:52:35.622202027 +0000 UTC m=+0.610505448 container cleanup cd5c040c0d7b78c291bcb60d08d766167577cd720052621f62af455f2589bc7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-26T11:52:35.818 INFO:journalctl@ceph.mgr.y.smithi063.stdout:Jul 26 11:52:35 smithi063 bash[124000]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-y 2024-07-26T11:52:36.099 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.y.service' 2024-07-26T11:52:36.132 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:36.132 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-07-26T11:52:36.132 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-07-26T11:52:36.133 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.z 2024-07-26T11:52:36.476 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 11:52:36 smithi133 systemd[1]: Stopping Ceph mgr.z for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:36.766 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 11:52:36 smithi133 podman[122447]: 2024-07-26 11:52:36.475113286 +0000 UTC m=+0.147488084 container died 26bbfd43db7cc3d9978cdd2c2dd8872fe1fdeccd11f72a7677181a4a785650d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240724) 2024-07-26T11:52:37.149 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 11:52:36 smithi133 podman[122447]: 2024-07-26 11:52:36.89689314 +0000 UTC m=+0.569267949 container cleanup 26bbfd43db7cc3d9978cdd2c2dd8872fe1fdeccd11f72a7677181a4a785650d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:52:37.150 INFO:journalctl@ceph.mgr.z.smithi133.stdout:Jul 26 11:52:36 smithi133 bash[122447]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mgr-z 2024-07-26T11:52:37.377 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mgr.z.service' 2024-07-26T11:52:37.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:37.411 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-07-26T11:52:37.411 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-07-26T11:52:37.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.0 2024-07-26T11:52:37.983 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:37 smithi043 systemd[1]: Stopping Ceph osd.0 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:38.483 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0[52147]: 2024-07-26T11:52:38.019+0000 7f0974600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:38.484 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0[52147]: 2024-07-26T11:52:38.019+0000 7f0974600640 -1 osd.0 141 *** Got signal Terminated *** 2024-07-26T11:52:38.484 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0[52147]: 2024-07-26T11:52:38.019+0000 7f0974600640 -1 osd.0 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:52:43.784 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:43 smithi043 podman[162485]: 2024-07-26 11:52:43.49635237 +0000 UTC m=+5.617293667 container died 442aa16642ef66c81e54942694bf0043eafc23dcf042f799b4b48550dd51d6a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:52:44.118 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:43 smithi043 podman[162485]: 2024-07-26 11:52:43.92241786 +0000 UTC m=+6.043359178 container cleanup 442aa16642ef66c81e54942694bf0043eafc23dcf042f799b4b48550dd51d6a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-26T11:52:44.119 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:43 smithi043 bash[162485]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0 2024-07-26T11:52:44.483 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:44 smithi043 podman[162502]: 2024-07-26 11:52:44.115321243 +0000 UTC m=+0.606942418 container remove 442aa16642ef66c81e54942694bf0043eafc23dcf042f799b4b48550dd51d6a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True) 2024-07-26T11:52:45.307 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:44 smithi043 podman[162594]: 2024-07-26 11:52:44.891261625 +0000 UTC m=+0.039842007 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:52:45.307 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:45 smithi043 podman[162594]: 2024-07-26 11:52:45.016230445 +0000 UTC m=+0.164810840 container create 6d86f55cdf87cec4d75509ad89c263cce2c5eb8aa238adaa12810ddc1fe67833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-07-26T11:52:45.636 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:45 smithi043 podman[162594]: 2024-07-26 11:52:45.304287959 +0000 UTC m=+0.452868401 container init 6d86f55cdf87cec4d75509ad89c263cce2c5eb8aa238adaa12810ddc1fe67833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-07-26T11:52:45.636 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:45 smithi043 podman[162594]: 2024-07-26 11:52:45.315978057 +0000 UTC m=+0.464558422 container start 6d86f55cdf87cec4d75509ad89c263cce2c5eb8aa238adaa12810ddc1fe67833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS) 2024-07-26T11:52:45.637 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:45 smithi043 podman[162594]: 2024-07-26 11:52:45.37699437 +0000 UTC m=+0.525574828 container attach 6d86f55cdf87cec4d75509ad89c263cce2c5eb8aa238adaa12810ddc1fe67833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-07-26T11:52:45.985 INFO:journalctl@ceph.osd.0.smithi043.stdout:Jul 26 11:52:45 smithi043 podman[162620]: 2024-07-26 11:52:45.685759571 +0000 UTC m=+0.033662211 container died 6d86f55cdf87cec4d75509ad89c263cce2c5eb8aa238adaa12810ddc1fe67833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724) 2024-07-26T11:52:46.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.0.service' 2024-07-26T11:52:46.435 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:46.435 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-07-26T11:52:46.435 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-07-26T11:52:46.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.1 2024-07-26T11:52:46.817 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:46 smithi063 systemd[1]: Stopping Ceph osd.1 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:47.318 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1[42607]: 2024-07-26T11:52:46.876+0000 7f0616693640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:47.318 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1[42607]: 2024-07-26T11:52:46.876+0000 7f0616693640 -1 osd.1 141 *** Got signal Terminated *** 2024-07-26T11:52:47.318 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1[42607]: 2024-07-26T11:52:46.876+0000 7f0616693640 -1 osd.1 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:52:52.568 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:52 smithi063 podman[124128]: 2024-07-26 11:52:52.304482022 +0000 UTC m=+5.674304897 container died 5970db2ce0366bb88473070b9fcdb2c967cbcedeb164ad377ff52197b08f2dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:52:53.021 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:52 smithi063 podman[124128]: 2024-07-26 11:52:52.768168142 +0000 UTC m=+6.137991013 container cleanup 5970db2ce0366bb88473070b9fcdb2c967cbcedeb164ad377ff52197b08f2dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-26T11:52:53.021 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:52 smithi063 bash[124128]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1 2024-07-26T11:52:53.318 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124146]: 2024-07-26 11:52:53.019706894 +0000 UTC m=+0.708136252 container remove 5970db2ce0366bb88473070b9fcdb2c967cbcedeb164ad377ff52197b08f2dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-07-26T11:52:53.682 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124232]: 2024-07-26 11:52:53.248756943 +0000 UTC m=+0.018083163 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:52:53.682 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124232]: 2024-07-26 11:52:53.445959264 +0000 UTC m=+0.215285515 container create b296aa402bc92fdea35231ed5cf511e93046e06b75523560d95ef4f18e449857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:52:53.683 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124232]: 2024-07-26 11:52:53.681577499 +0000 UTC m=+0.450903708 container init b296aa402bc92fdea35231ed5cf511e93046e06b75523560d95ef4f18e449857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240724, ceph=True) 2024-07-26T11:52:54.068 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124232]: 2024-07-26 11:52:53.684777921 +0000 UTC m=+0.454104130 container start b296aa402bc92fdea35231ed5cf511e93046e06b75523560d95ef4f18e449857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-07-26T11:52:54.068 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124232]: 2024-07-26 11:52:53.781745622 +0000 UTC m=+0.551071833 container attach b296aa402bc92fdea35231ed5cf511e93046e06b75523560d95ef4f18e449857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-07-26T11:52:54.068 INFO:journalctl@ceph.osd.1.smithi063.stdout:Jul 26 11:52:53 smithi063 podman[124232]: 2024-07-26 11:52:53.882652904 +0000 UTC m=+0.651979113 container died b296aa402bc92fdea35231ed5cf511e93046e06b75523560d95ef4f18e449857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-26T11:52:54.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.1.service' 2024-07-26T11:52:54.582 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:52:54.582 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-07-26T11:52:54.582 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-07-26T11:52:54.582 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.2 2024-07-26T11:52:54.910 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:52:54 smithi133 systemd[1]: Stopping Ceph osd.2 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:52:55.266 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:52:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2[43450]: 2024-07-26T11:52:54.908+0000 7ff78d05f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:52:55.266 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:52:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2[43450]: 2024-07-26T11:52:54.908+0000 7ff78d05f640 -1 osd.2 141 *** Got signal Terminated *** 2024-07-26T11:52:55.266 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:52:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2[43450]: 2024-07-26T11:52:54.908+0000 7ff78d05f640 -1 osd.2 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:00.733 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:00 smithi133 podman[122588]: 2024-07-26 11:53:00.369370484 +0000 UTC m=+5.594605124 container died e95db173573b91ddb9fbc141eab7daa8211abf9fc17ac4efe0b42fb764588cf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-07-26T11:53:01.016 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:00 smithi133 podman[122588]: 2024-07-26 11:53:00.834242637 +0000 UTC m=+6.059477259 container cleanup e95db173573b91ddb9fbc141eab7daa8211abf9fc17ac4efe0b42fb764588cf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-07-26T11:53:01.016 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:00 smithi133 bash[122588]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2 2024-07-26T11:53:01.456 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122606]: 2024-07-26 11:53:01.127565418 +0000 UTC m=+0.754933370 container remove e95db173573b91ddb9fbc141eab7daa8211abf9fc17ac4efe0b42fb764588cf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-07-26T11:53:01.723 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122695]: 2024-07-26 11:53:01.358253314 +0000 UTC m=+0.017091425 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:01.724 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122695]: 2024-07-26 11:53:01.49517041 +0000 UTC m=+0.154008524 container create 95511d7d45f141391d666cb6e10bb9c70e545b7f5f93582e0fca538f3c1969d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-07-26T11:53:01.724 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122695]: 2024-07-26 11:53:01.722729246 +0000 UTC m=+0.381567357 container init 95511d7d45f141391d666cb6e10bb9c70e545b7f5f93582e0fca538f3c1969d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:53:02.016 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122695]: 2024-07-26 11:53:01.726019549 +0000 UTC m=+0.384857661 container start 95511d7d45f141391d666cb6e10bb9c70e545b7f5f93582e0fca538f3c1969d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:02.016 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122695]: 2024-07-26 11:53:01.822805783 +0000 UTC m=+0.481643914 container attach 95511d7d45f141391d666cb6e10bb9c70e545b7f5f93582e0fca538f3c1969d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:02.016 INFO:journalctl@ceph.osd.2.smithi133.stdout:Jul 26 11:53:01 smithi133 podman[122695]: 2024-07-26 11:53:01.910746099 +0000 UTC m=+0.569584214 container died 95511d7d45f141391d666cb6e10bb9c70e545b7f5f93582e0fca538f3c1969d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-07-26T11:53:02.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.2.service' 2024-07-26T11:53:02.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:02.659 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-07-26T11:53:02.659 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-07-26T11:53:02.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.3 2024-07-26T11:53:03.233 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:02 smithi043 systemd[1]: Stopping Ceph osd.3 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:03.733 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:03 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:03.264+0000 7fcd74a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:03.734 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:03 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:03.264+0000 7fcd74a00640 -1 osd.3 141 *** Got signal Terminated *** 2024-07-26T11:53:03.734 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:03 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:03.264+0000 7fcd74a00640 -1 osd.3 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:04.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:04.529+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:05.233 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:04 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:04.758+0000 7fcd6b400640 -1 osd.3 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.058057+0000 front 2024-07-26T11:52:41.058117+0000 (oldest deadline 2024-07-26T11:53:04.557456+0000) 2024-07-26T11:53:05.809 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:05 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:05.494+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:05.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:05.529+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:06.016 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:05.870+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:06.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:05.760+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:06.233 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:05 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:05.806+0000 7fcd6b400640 -1 osd.3 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.058057+0000 front 2024-07-26T11:52:41.058117+0000 (oldest deadline 2024-07-26T11:53:04.557456+0000) 2024-07-26T11:53:06.799 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:06 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:06.489+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:06.529+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:07.233 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:06 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:06.797+0000 7fcd6b400640 -1 osd.3 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.058057+0000 front 2024-07-26T11:52:41.058117+0000 (oldest deadline 2024-07-26T11:53:04.557456+0000) 2024-07-26T11:53:07.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:06.900+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:07.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:06.809+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:07.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:07.478+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:07.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:07 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:07.503+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:08.233 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:07 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3[58610]: 2024-07-26T11:53:07.795+0000 7fcd6b400640 -1 osd.3 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.058057+0000 front 2024-07-26T11:52:41.058117+0000 (oldest deadline 2024-07-26T11:53:04.557456+0000) 2024-07-26T11:53:08.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:07.936+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:08.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:07.827+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:08.703 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:08 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:08.431+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:08.703 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:08 smithi043 podman[162720]: 2024-07-26 11:53:08.669856982 +0000 UTC m=+5.566181345 container died 93d18ee03156f18773b7c733d1950e65d5659d9a2235c97f63771b2d4ee0d03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True) 2024-07-26T11:53:08.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:08 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:08.528+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:09.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:08.939+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:09.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:08.812+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:09.338 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:09 smithi043 podman[162720]: 2024-07-26 11:53:09.149964153 +0000 UTC m=+6.046288551 container cleanup 93d18ee03156f18773b7c733d1950e65d5659d9a2235c97f63771b2d4ee0d03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-07-26T11:53:09.338 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:09 smithi043 bash[162720]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3 2024-07-26T11:53:09.733 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:09 smithi043 podman[162735]: 2024-07-26 11:53:09.334528055 +0000 UTC m=+0.649138818 container remove 93d18ee03156f18773b7c733d1950e65d5659d9a2235c97f63771b2d4ee0d03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS) 2024-07-26T11:53:09.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:09 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:09.473+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:09.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:09 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:09.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:10.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:09.964+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:10.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:09.789+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:10.483 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:10 smithi043 podman[162819]: 2024-07-26 11:53:10.077115893 +0000 UTC m=+0.035885294 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:10.483 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:10 smithi043 podman[162819]: 2024-07-26 11:53:10.202179454 +0000 UTC m=+0.160948850 container create d447afd2fa203d94612c365eb061282f706d3e3579ca4fdc088115f9bf1fbab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:10.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:10 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:10.522+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:10.837 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:10 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:10.505+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:10.838 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:10 smithi043 podman[162819]: 2024-07-26 11:53:10.514084516 +0000 UTC m=+0.472853949 container init d447afd2fa203d94612c365eb061282f706d3e3579ca4fdc088115f9bf1fbab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:53:10.838 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:10 smithi043 podman[162819]: 2024-07-26 11:53:10.525790459 +0000 UTC m=+0.484559862 container start d447afd2fa203d94612c365eb061282f706d3e3579ca4fdc088115f9bf1fbab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-07-26T11:53:10.838 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:10 smithi043 podman[162819]: 2024-07-26 11:53:10.629782173 +0000 UTC m=+0.588551636 container attach d447afd2fa203d94612c365eb061282f706d3e3579ca4fdc088115f9bf1fbab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-07-26T11:53:11.199 INFO:journalctl@ceph.osd.3.smithi043.stdout:Jul 26 11:53:10 smithi043 podman[162842]: 2024-07-26 11:53:10.897071422 +0000 UTC m=+0.037028079 container died d447afd2fa203d94612c365eb061282f706d3e3579ca4fdc088115f9bf1fbab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-07-26T11:53:11.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:11.003+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:11.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:10.780+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:11.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.3.service' 2024-07-26T11:53:11.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:11.669 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-07-26T11:53:11.669 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-07-26T11:53:11.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.4 2024-07-26T11:53:11.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:11 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:11.464+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:11.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:11 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:11.525+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:11.818 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:11 smithi063 systemd[1]: Stopping Ceph osd.4 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:12.016 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:11.971+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:12.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:11.734+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:12.318 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:12 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:12.013+0000 7f9572697640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:12.318 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:12 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:12.013+0000 7f9572697640 -1 osd.4 141 *** Got signal Terminated *** 2024-07-26T11:53:12.318 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:12 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:12.013+0000 7f9572697640 -1 osd.4 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:12.732 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:12 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:12.421+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:12.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:12 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:12.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:13.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:12.772+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:13.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:13.011+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:13.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:13.011+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:13.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:13 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:13.441+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:13.818 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:13.422+0000 7f956ac7a640 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.937674+0000 front 2024-07-26T11:52:50.937712+0000 (oldest deadline 2024-07-26T11:53:13.237821+0000) 2024-07-26T11:53:13.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:13.430+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:13.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:13 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:13.430+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:14.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:13.801+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:14.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:13.801+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:14.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:13.971+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:14.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:13.971+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:14.732 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:14 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:14.407+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:14.818 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:14.388+0000 7f956ac7a640 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.937674+0000 front 2024-07-26T11:52:50.937712+0000 (oldest deadline 2024-07-26T11:53:13.237821+0000) 2024-07-26T11:53:14.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:14.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:14.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:14 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:14.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:15.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:14.778+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:15.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:14.778+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:15.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:14.992+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:15.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:14.992+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:15.539 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:15 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:15.497+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:15.732 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:15.376+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:15.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:15 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:15.329+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:15.818 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:15 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:15.346+0000 7f956ac7a640 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.937674+0000 front 2024-07-26T11:52:50.937712+0000 (oldest deadline 2024-07-26T11:53:13.237821+0000) 2024-07-26T11:53:15.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:15 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:15.416+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:15.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:15 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:15.416+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:15.987 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:15 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:15.773+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:15.987 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:15 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:15.773+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:16.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:15 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:15.984+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:16.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:15 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:15.984+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:16.568 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4[49494]: 2024-07-26T11:53:16.296+0000 7f956ac7a640 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.937674+0000 front 2024-07-26T11:52:50.937712+0000 (oldest deadline 2024-07-26T11:53:13.237821+0000) 2024-07-26T11:53:16.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:16.353+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:16.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:16.414+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:16.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:16 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:16.414+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:16.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:16 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:16.374+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:16.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:16 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:16.341+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:16.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:16 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:16.341+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:16.766 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:16 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:16.517+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:17.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:16 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:16.808+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:17.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:16 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:16.808+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:17.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:16 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:16.942+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:17.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:16 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:16.942+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:17.732 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:17 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:17.393+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:17.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:17 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:17.318+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:17.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:17 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:17.318+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:17.765 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:17 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:17.493+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:17.814 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:17 smithi063 podman[124344]: 2024-07-26 11:53:17.51398344 +0000 UTC m=+5.642870861 container died a78be144ec2abbb808204f836d703ffb2817ad230eb018b60cdd202251026c4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-07-26T11:53:17.815 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:17.344+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:17.815 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:17.384+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:17.815 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:17 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:17.384+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:18.068 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:17 smithi063 podman[124344]: 2024-07-26 11:53:17.89666496 +0000 UTC m=+6.025552426 container cleanup a78be144ec2abbb808204f836d703ffb2817ad230eb018b60cdd202251026c4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-07-26T11:53:18.068 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:17 smithi063 bash[124344]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4 2024-07-26T11:53:18.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:17 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:17.940+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:18.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:17 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:17.940+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:18.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:17 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:17.851+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:18.267 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:17 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:17.851+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:18.427 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:18 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:18.338+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:18.428 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124360]: 2024-07-26 11:53:18.164792923 +0000 UTC m=+0.642110348 container remove a78be144ec2abbb808204f836d703ffb2817ad230eb018b60cdd202251026c4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:53:18.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:18.349+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:18.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:18.280+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:18.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:18 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:18.280+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:18.744 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:18 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:18.425+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:18.744 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:18 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:18.425+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:18.744 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124456]: 2024-07-26 11:53:18.424680597 +0000 UTC m=+0.017701063 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:18.744 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124456]: 2024-07-26 11:53:18.52383839 +0000 UTC m=+0.116858844 container create 46b25fef39c09d5052836671ad145593f0da837d19f5701d49f7edeb0ca3a2c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-26T11:53:18.745 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124456]: 2024-07-26 11:53:18.743298767 +0000 UTC m=+0.336319221 container init 46b25fef39c09d5052836671ad145593f0da837d19f5701d49f7edeb0ca3a2c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:53:18.844 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:18 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:18.529+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:19.068 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124456]: 2024-07-26 11:53:18.746684736 +0000 UTC m=+0.339705188 container start 46b25fef39c09d5052836671ad145593f0da837d19f5701d49f7edeb0ca3a2c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-07-26T11:53:19.069 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124456]: 2024-07-26 11:53:18.851652883 +0000 UTC m=+0.444673338 container attach 46b25fef39c09d5052836671ad145593f0da837d19f5701d49f7edeb0ca3a2c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:53:19.069 INFO:journalctl@ceph.osd.4.smithi063.stdout:Jul 26 11:53:18 smithi063 podman[124456]: 2024-07-26 11:53:18.951548685 +0000 UTC m=+0.544569153 container died 46b25fef39c09d5052836671ad145593f0da837d19f5701d49f7edeb0ca3a2c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:53:19.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:18 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:18.984+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:19.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:18 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:18.984+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:19.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:18 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:18.842+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:19.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:18 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:18.842+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:19.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:19 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:19.386+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:19.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:19 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:19.474+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:19.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:19 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:19.474+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:19.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.4.service' 2024-07-26T11:53:19.683 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:19.683 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-07-26T11:53:19.683 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-07-26T11:53:19.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.5 2024-07-26T11:53:19.734 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:19 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:19.322+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:19.735 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:19 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:19.287+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:19.735 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:19 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:19.287+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:19.822 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:19.536+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:19.823 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:19 smithi133 systemd[1]: Stopping Ceph osd.5 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:20.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:19.820+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:20.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:19.820+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:20.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:19.960+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:20.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:19.960+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:20.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:19.987+0000 7f734cb89640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:20.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:19.987+0000 7f734cb89640 -1 osd.5 141 *** Got signal Terminated *** 2024-07-26T11:53:20.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:19 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:19.987+0000 7f734cb89640 -1 osd.5 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:20.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:20 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:20.295+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:20.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:20 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:20.277+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:20.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:20 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:20.277+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:20.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:20 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:20.419+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:20.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:20 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:20.450+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:20.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:20 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:20.450+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:21.006 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:20 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:20.564+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:21.006 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:20 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:20.778+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:21.007 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:20 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:20.778+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:21.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:21.004+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:21.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:21.004+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:21.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:21.004+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:56.751528+0000 front 2024-07-26T11:52:56.751638+0000 (oldest deadline 2024-07-26T11:53:20.851663+0000) 2024-07-26T11:53:21.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:21 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:21.273+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:21.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:21 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:21.254+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:21.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:21 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:21.254+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:21.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:21 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:21.390+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:21.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:21 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:21.498+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:21.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:21 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:21.498+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:21.825 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:21.565+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:21.825 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:21.565+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:22.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:21.823+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:22.266 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:21.823+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:22.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:22.046+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:22.266 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:22.046+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:22.267 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:22.046+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:56.751528+0000 front 2024-07-26T11:52:56.751638+0000 (oldest deadline 2024-07-26T11:53:20.851663+0000) 2024-07-26T11:53:22.454 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:22 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:22.357+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:22.454 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:22 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:22.450+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:22.454 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:22 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:22.450+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:22.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:22 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:22.259+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:22.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:22 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:22.259+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:22.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:22 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:22.208+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:22.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:22 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:22.208+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:22.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:22 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:22.208+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:23.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:22.581+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:23.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:22.581+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:23.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:22.802+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:23.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:22 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:22.802+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:23.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:23.254+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:23.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:23.254+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:23.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:23.222+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:23.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:23.222+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:23.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:23 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:23.222+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:23.516 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:23.031+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:23.516 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:23.031+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:23.516 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:23.031+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:56.751528+0000 front 2024-07-26T11:52:56.751638+0000 (oldest deadline 2024-07-26T11:53:20.851663+0000) 2024-07-26T11:53:23.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:23 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:23.319+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:23.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:23 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:23.415+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:23.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:23 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:23.415+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:23.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:23 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:23.415+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:24.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:23.596+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:24.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:23.596+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:24.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:23.825+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:24.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:23.825+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:24.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:23.825+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:24.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:24.263+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:24.493 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:24.263+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:24.493 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:24.188+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:24.494 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:24.188+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:24.494 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:24 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:24.188+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:24.516 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:24.039+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.547312+0000 front 2024-07-26T11:52:39.547368+0000 (oldest deadline 2024-07-26T11:53:05.447268+0000) 2024-07-26T11:53:24.516 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:24.039+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:50.450029+0000 front 2024-07-26T11:52:50.450110+0000 (oldest deadline 2024-07-26T11:53:12.749997+0000) 2024-07-26T11:53:24.516 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5[50179]: 2024-07-26T11:53:24.039+0000 7f734516c640 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:56.751528+0000 front 2024-07-26T11:52:56.751638+0000 (oldest deadline 2024-07-26T11:53:20.851663+0000) 2024-07-26T11:53:24.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:24.312+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:24.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:24.407+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:24.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:24.407+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:24.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:24 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:24.407+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:25.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:24.556+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:25.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:24.556+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:25.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:24.799+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:25.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:24.799+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:25.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:24 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:24.799+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:25.731 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:25 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:25.561+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:25.732 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:25 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:25.561+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:25.732 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:25 smithi133 podman[122824]: 2024-07-26 11:53:25.442170824 +0000 UTC m=+5.561479070 container died f6e50d31565f0b0477bfd84cbe74f77966edfe3822cb7e73262bb25508d70abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-26T11:53:25.732 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:25 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:25.239+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:25.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:25 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:25.239+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:25.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:25 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:25.236+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:25.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:25 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:25.236+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:25.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:25 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:25.236+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:25.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:25 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:25.345+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:25.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:25 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:25.406+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:25.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:25 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:25.406+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:25.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:25 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:25.406+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:26.016 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:25 smithi133 podman[122824]: 2024-07-26 11:53:25.838246392 +0000 UTC m=+5.957554629 container cleanup f6e50d31565f0b0477bfd84cbe74f77966edfe3822cb7e73262bb25508d70abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-07-26T11:53:26.016 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:25 smithi133 bash[122824]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5 2024-07-26T11:53:26.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:25 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:25.777+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:26.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:25 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:25.777+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:26.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:25 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:25.777+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:26.431 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122843]: 2024-07-26 11:53:26.114861137 +0000 UTC m=+0.670313480 container remove f6e50d31565f0b0477bfd84cbe74f77966edfe3822cb7e73262bb25508d70abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:53:26.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:26 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:26.212+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:26.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:26 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:26.212+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:26.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:26 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:26.194+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:26.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:26 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:26.194+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:26.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:26 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:26.194+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:26.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:26.315+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:26.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:26.315+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:26.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:26.393+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:26.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:26.393+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:26.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:26 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:26.393+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:26.694 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:26 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:26.601+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:26.694 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:26 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:26.601+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:26.695 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122934]: 2024-07-26 11:53:26.332932313 +0000 UTC m=+0.017113096 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:26.695 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122934]: 2024-07-26 11:53:26.465598796 +0000 UTC m=+0.149779568 container create 8530e905f519433b09d2d2cf45ea061760f8b55e0fbc18b789834ce79b7ab1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-07-26T11:53:26.695 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122934]: 2024-07-26 11:53:26.693349039 +0000 UTC m=+0.377529812 container init 8530e905f519433b09d2d2cf45ea061760f8b55e0fbc18b789834ce79b7ab1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:27.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:26 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:26.768+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:27.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:26 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:26.768+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:27.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:26 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:26.768+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:27.017 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122934]: 2024-07-26 11:53:26.696524114 +0000 UTC m=+0.380704891 container start 8530e905f519433b09d2d2cf45ea061760f8b55e0fbc18b789834ce79b7ab1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:27.017 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122934]: 2024-07-26 11:53:26.801799903 +0000 UTC m=+0.485980689 container attach 8530e905f519433b09d2d2cf45ea061760f8b55e0fbc18b789834ce79b7ab1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-07-26T11:53:27.017 INFO:journalctl@ceph.osd.5.smithi133.stdout:Jul 26 11:53:26 smithi133 podman[122934]: 2024-07-26 11:53:26.887961795 +0000 UTC m=+0.572142569 container died 8530e905f519433b09d2d2cf45ea061760f8b55e0fbc18b789834ce79b7ab1ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-07-26T11:53:27.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:27.166+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:27.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:27.166+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:27.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:27.205+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:27.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:27.205+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:27.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:27 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:27.205+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:27.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:27.278+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:27.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:27.278+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:27.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:27.442+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:27.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:27.442+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:27.569 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:27 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:27.442+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:27.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.5.service' 2024-07-26T11:53:27.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:27.662 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-07-26T11:53:27.662 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-07-26T11:53:27.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.6 2024-07-26T11:53:28.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:27.573+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:28.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:27.573+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:28.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:27.721+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:28.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:27.721+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:28.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:27.721+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:28.154 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:27 smithi043 systemd[1]: Stopping Ceph osd.6 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:28.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:28.197+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:28.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:28.197+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:28.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:28.197+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:28.484 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:28.167+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:28.484 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:28.167+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:28.484 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:28.241+0000 7f1d3c600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:28.484 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:28.241+0000 7f1d3c600640 -1 osd.6 141 *** Got signal Terminated *** 2024-07-26T11:53:28.484 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:28 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:28.241+0000 7f1d3c600640 -1 osd.6 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:28.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:28 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:28.253+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:28.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:28 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:28.253+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:28.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:28 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:28.475+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:28.569 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:28 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:28.475+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:28.569 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:28 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:28.475+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:29.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:28 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:28.550+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:29.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:28 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:28.550+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:29.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:28 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:28.675+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:29.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:28 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:28.675+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:29.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:28 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:28.675+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:29.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:29 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:29.169+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:29.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:29 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:29.169+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:29.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:29 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:29.199+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:29.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:29 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:29.199+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:29.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:29 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:29.199+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:29.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:29.290+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:29.568 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:29.290+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:29.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:29.437+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:29.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:29.437+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:29.569 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:29 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:29.437+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:30.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:29.629+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:30.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:29.629+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:30.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:29.629+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:30.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:29.579+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:30.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:29 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:29.579+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:30.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:30.211+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:30.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:30.211+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:30.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:30.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:30.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:30.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:30.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:30 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:30.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:30.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:30.325+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:30.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:30.325+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:30.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:30.482+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:30.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:30.482+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:30.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:30.482+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:30.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:30 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:30.482+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:31.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:30 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:30.578+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:31.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:30 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:30.578+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:31.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:30 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:30.582+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:31.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:30 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:30.582+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:31.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:30 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:30.582+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:31.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:31.199+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:31.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:31.199+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:31.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:31.191+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:31.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:31.191+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:31.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:31.191+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:31.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:31 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:31.191+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:31.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:31 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:31.363+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:31.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:31 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:31.363+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:31.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:31 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:31.516+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:31.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:31 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:31.516+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:31.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:31 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:31.516+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:31.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:31 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:31.516+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:32.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:31.570+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:32.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:31.570+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:32.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:31.570+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:32.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:31.548+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:32.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:31 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:31.548+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:32.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:32 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:32.159+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:32.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:32 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:32.159+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:32.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:32 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:32.186+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:32.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:32 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:32.186+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:32.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:32 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:32.186+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:32.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:32 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:32.186+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:32.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:32.317+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:32.819 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:32.317+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:32.819 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:32.317+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:32.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:32.507+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:32.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:32.507+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:32.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:32.507+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:32.820 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:32 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:32.507+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:33.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:32 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:32.585+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:33.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:32 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:32.585+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:33.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:32 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:32.585+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:33.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:32 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:32.543+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:33.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:32 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:32.543+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:33.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:32 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:32.543+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:33.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:33.205+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.734103+0000 front 2024-07-26T11:52:51.734310+0000 (oldest deadline 2024-07-26T11:53:14.634351+0000) 2024-07-26T11:53:33.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:33.205+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.336851+0000 front 2024-07-26T11:52:59.336962+0000 (oldest deadline 2024-07-26T11:53:21.637096+0000) 2024-07-26T11:53:33.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6[65105]: 2024-07-26T11:53:33.205+0000 7f1d38000640 -1 osd.6 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.841196+0000 front 2024-07-26T11:53:06.841389+0000 (oldest deadline 2024-07-26T11:53:32.741475+0000) 2024-07-26T11:53:33.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:33.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:33.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:33.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:33.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:33.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:33.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:33 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:33.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:33.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:33.352+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:33.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:33.352+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:33.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:33.352+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:33.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:33.554+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:33.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:33.554+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:33.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:33.554+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:33.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:33 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:33.554+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:34.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:33.604+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:34.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:33.604+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:34.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:33.604+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:34.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:33.585+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:34.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:33.585+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:34.018 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:33 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:33.585+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:34.101 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:33 smithi043 podman[162931]: 2024-07-26 11:53:33.75436114 +0000 UTC m=+5.663730697 container died 9fc94f290a76391b52be04d7546782a03f45a6acdb998ce2eba07081cd2016d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T11:53:34.431 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:34 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:34.237+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:34.431 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:34 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:34.237+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:34.431 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:34 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:34.237+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:34.431 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:34 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:34.237+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:34.431 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:34 smithi043 podman[162931]: 2024-07-26 11:53:34.210385766 +0000 UTC m=+6.119755368 container cleanup 9fc94f290a76391b52be04d7546782a03f45a6acdb998ce2eba07081cd2016d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T11:53:34.432 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:34 smithi043 bash[162931]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6 2024-07-26T11:53:34.720 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:34.398+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:34.720 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:34.398+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:34.720 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:34.398+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:34.721 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:34.541+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:34.721 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:34.541+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:34.721 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:34.541+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:34.721 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:34 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:34.541+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:34.733 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:34 smithi043 podman[162950]: 2024-07-26 11:53:34.428109705 +0000 UTC m=+0.661228678 container remove 9fc94f290a76391b52be04d7546782a03f45a6acdb998ce2eba07081cd2016d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T11:53:35.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:34.561+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:35.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:34.561+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:35.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:34.561+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:35.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:34.559+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:35.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:34.559+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:35.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:34 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:34.559+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:35.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:35 smithi043 podman[163039]: 2024-07-26 11:53:35.195067747 +0000 UTC m=+0.038274644 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:35.483 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:35 smithi043 podman[163039]: 2024-07-26 11:53:35.412608914 +0000 UTC m=+0.255815838 container create 4d8adc00be86e8c41b902c89ab83a7bf55e24791eab088c50ffa6b8af480d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:35.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:35 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:35.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:35.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:35 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:35.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:35.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:35 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:35.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:35.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:35 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:35.211+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:35.736 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:35.421+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:35.736 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:35.421+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:35.736 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:35.421+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:35.736 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:35.592+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:35.736 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:35.592+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:35.737 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:35.592+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:35.737 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:35 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:35.592+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:35.983 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:35 smithi043 podman[163039]: 2024-07-26 11:53:35.683119656 +0000 UTC m=+0.526326573 container init 4d8adc00be86e8c41b902c89ab83a7bf55e24791eab088c50ffa6b8af480d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:53:35.983 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:35 smithi043 podman[163039]: 2024-07-26 11:53:35.695494594 +0000 UTC m=+0.538701506 container start 4d8adc00be86e8c41b902c89ab83a7bf55e24791eab088c50ffa6b8af480d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:53:35.983 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:35 smithi043 podman[163039]: 2024-07-26 11:53:35.773352909 +0000 UTC m=+0.616559857 container attach 4d8adc00be86e8c41b902c89ab83a7bf55e24791eab088c50ffa6b8af480d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:36.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:35.514+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:36.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:35.514+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:36.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:35.514+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:36.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:35.596+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:36.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:35.596+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:36.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:35 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:35.596+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:36.482 INFO:journalctl@ceph.osd.6.smithi043.stdout:Jul 26 11:53:36 smithi043 podman[163039]: 2024-07-26 11:53:36.000232892 +0000 UTC m=+0.843439862 container died 4d8adc00be86e8c41b902c89ab83a7bf55e24791eab088c50ffa6b8af480d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-07-26T11:53:36.482 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:36 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:36.176+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:36.482 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:36 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:36.176+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:36.482 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:36 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:36.176+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:36.482 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:36 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:36.176+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:36.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:36.569+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:36.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:36.569+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:36.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:36.569+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:36.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:36.569+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:36.819 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:36.379+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:36.819 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:36.379+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:36.819 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:36 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:36.379+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:36.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.6.service' 2024-07-26T11:53:36.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:36.978 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-07-26T11:53:36.979 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-07-26T11:53:36.979 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.7 2024-07-26T11:53:37.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:36 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:36.541+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:37.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:36 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:36.541+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:37.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:36 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:36.541+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:37.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:36 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:36.621+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:37.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:36 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:36.621+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:37.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:36 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:36.621+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:37.292 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 systemd[1]: Stopping Ceph osd.7 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:37.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:37.184+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:37.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:37.184+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:37.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:37.184+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:37.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:37 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:37.184+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:37.554 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:37.290+0000 7f43b5c39640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:37.554 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:37.290+0000 7f43b5c39640 -1 osd.7 141 *** Got signal Terminated *** 2024-07-26T11:53:37.555 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:37.290+0000 7f43b5c39640 -1 osd.7 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:37.555 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:37.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:37.555 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:37.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:37.555 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:37.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:37.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:37 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:37.510+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:37.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:37 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:37.510+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:37.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:37 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:37.510+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:37.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:37 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:37.669+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:37.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:37 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:37.669+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:37.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:37 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:37.669+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:37.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:37.552+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:37.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:37.552+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:37.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:37.552+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:37.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:37 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:37.552+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:38.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:38.218+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:38.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:38.218+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:38.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:38.218+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:38.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:38.218+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:38.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:38 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:38.218+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:38.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:38.386+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:38.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:38.386+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:38.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:38.386+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:38.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:38.519+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:38.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:38.519+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:38.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:38.519+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:38.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:38.519+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:38.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:38 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:38.519+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:39.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:38.529+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:39.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:38.529+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:39.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:38.529+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:39.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:38.529+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:39.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:38.707+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:39.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:38.707+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:39.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:38.707+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:39.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:38 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:38.707+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:39.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:39 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:39.180+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:39.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:39 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:39.180+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:39.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:39 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:39.180+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:39.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:39 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:39.180+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:39.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:39 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:39.180+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:39.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:39.508+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:39.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:39.508+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:39.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:39.508+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:39.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:39.508+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:39.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:39.756+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:39.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:39.756+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:39.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:39.756+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:39.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:39 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:39.756+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:39.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:39.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:39.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:39.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:39.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:39.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:39.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:39.416+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.154139+0000 front 2024-07-26T11:53:16.154082+0000 (oldest deadline 2024-07-26T11:53:38.454286+0000) 2024-07-26T11:53:39.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:39.568+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:39.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:39.568+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:39.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:39.568+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:39.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:39.568+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:39.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:39 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:39.568+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:40.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:40.213+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:40.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:40.213+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:40.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:40.213+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:40.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:40.213+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:40.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:40 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:40.213+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:40.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:40.448+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:40.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:40.448+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:40.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:40.448+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:40.819 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:40.448+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.154139+0000 front 2024-07-26T11:53:16.154082+0000 (oldest deadline 2024-07-26T11:53:38.454286+0000) 2024-07-26T11:53:40.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:40.602+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:40.820 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:40.602+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:40.820 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:40.602+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:40.820 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:40.602+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:40.820 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:40 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:40.602+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:41.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:40.527+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:41.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:40.527+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:41.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:40.527+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:41.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:40.527+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:41.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:40.774+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:41.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:40.774+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:41.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:40.774+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:41.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:40 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:40.774+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:41.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:41.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:41.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:41.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:41.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:41.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:41.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:41.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:41.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:41 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:41.227+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:41.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:41.511+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:41.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:41.511+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:41.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:41.511+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:41.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:41.511+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:41.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:41.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:41.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:41.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:41.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:41.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:41.767 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:41 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:41.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:41.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:41.477+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.049527+0000 front 2024-07-26T11:52:51.049723+0000 (oldest deadline 2024-07-26T11:53:16.349668+0000) 2024-07-26T11:53:41.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:41.477+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:59.851133+0000 front 2024-07-26T11:52:59.850966+0000 (oldest deadline 2024-07-26T11:53:25.751054+0000) 2024-07-26T11:53:41.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:41.477+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.751966+0000 front 2024-07-26T11:53:05.751837+0000 (oldest deadline 2024-07-26T11:53:31.651597+0000) 2024-07-26T11:53:41.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7[56024]: 2024-07-26T11:53:41.477+0000 7f43b2224640 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.154139+0000 front 2024-07-26T11:53:16.154082+0000 (oldest deadline 2024-07-26T11:53:38.454286+0000) 2024-07-26T11:53:41.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:41.560+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:41.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:41.560+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:41.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:41.560+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:41.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:41.560+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:41.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:41 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:41.560+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:42.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:42.264+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:42.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:42.264+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:42.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:42.264+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:42.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:42.264+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:42.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:42 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:42.264+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:42.818 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:42 smithi063 podman[124572]: 2024-07-26 11:53:42.680487617 +0000 UTC m=+5.516710619 container died 368ac63831dd6233cce86b383889d4180a06de6eb9cf3a6e493d9564b8553e6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:53:42.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:42 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:42.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:42.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:42 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:42.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:42.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:42 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:42.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:42.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:42 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:42.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:42.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:42 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:42.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:43.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:42.552+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:43.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:42.552+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:43.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:42.552+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:43.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:42.552+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:43.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:42.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:43.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:42.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:43.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:42.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:43.017 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:42 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:42.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:43.318 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:43 smithi063 podman[124572]: 2024-07-26 11:53:43.090891381 +0000 UTC m=+5.927114381 container cleanup 368ac63831dd6233cce86b383889d4180a06de6eb9cf3a6e493d9564b8553e6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240724) 2024-07-26T11:53:43.318 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:43 smithi063 bash[124572]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7 2024-07-26T11:53:43.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:43.272+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:43.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:43.272+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:43.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:43.272+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:43.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:43.272+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:43.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:43 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:43.272+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:43.760 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:43 smithi063 podman[124587]: 2024-07-26 11:53:43.333812657 +0000 UTC m=+0.652114238 container remove 368ac63831dd6233cce86b383889d4180a06de6eb9cf3a6e493d9564b8553e6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724) 2024-07-26T11:53:43.761 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:43 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:43.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:43.761 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:43 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:43.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:43.761 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:43 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:43.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:43.761 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:43 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:43.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:43.761 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:43 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:43.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:43.791 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:43.522+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:43.791 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:43.522+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:43.791 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:43.522+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:43.791 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:43.522+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:44.021 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:43 smithi063 podman[124675]: 2024-07-26 11:53:43.759643281 +0000 UTC m=+0.103814286 container create fe6d56cc2f0c36ec5b53857b0b77d06c51b3a829181b89e89d91e89da0b002c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-07-26T11:53:44.021 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:43 smithi063 podman[124675]: 2024-07-26 11:53:43.673852145 +0000 UTC m=+0.018023123 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:44.021 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:44 smithi063 podman[124675]: 2024-07-26 11:53:44.020348876 +0000 UTC m=+0.364519843 container init fe6d56cc2f0c36ec5b53857b0b77d06c51b3a829181b89e89d91e89da0b002c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-07-26T11:53:44.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:43.789+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:44.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:43.789+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:44.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:43.789+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:44.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:43 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:43.789+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:44.318 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:44 smithi063 podman[124675]: 2024-07-26 11:53:44.023801028 +0000 UTC m=+0.367971997 container start fe6d56cc2f0c36ec5b53857b0b77d06c51b3a829181b89e89d91e89da0b002c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7-deactivate, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:44.318 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:44 smithi063 podman[124675]: 2024-07-26 11:53:44.145510478 +0000 UTC m=+0.489681457 container attach fe6d56cc2f0c36ec5b53857b0b77d06c51b3a829181b89e89d91e89da0b002c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-07-26T11:53:44.318 INFO:journalctl@ceph.osd.7.smithi063.stdout:Jul 26 11:53:44 smithi063 podman[124675]: 2024-07-26 11:53:44.219319929 +0000 UTC m=+0.563490906 container died fe6d56cc2f0c36ec5b53857b0b77d06c51b3a829181b89e89d91e89da0b002c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T11:53:44.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:44 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:44.247+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:44.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:44 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:44.247+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:44.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:44 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:44.247+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:44.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:44 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:44.247+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:44.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:44 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:44.247+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:44.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:44.495+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:44.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:44.495+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:44.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:44.495+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:44.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:44.495+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:44.792 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:44.484+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:44.792 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:44.484+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:44.792 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:44.484+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:44.792 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:44.484+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:44.792 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:44 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:44.484+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:44.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.7.service' 2024-07-26T11:53:44.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:44.856 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-07-26T11:53:44.856 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-07-26T11:53:44.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.8 2024-07-26T11:53:45.052 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:44.836+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:45.052 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:44.836+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:45.052 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:44.836+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:45.053 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:44 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:44.836+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:45.053 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:44 smithi133 systemd[1]: Stopping Ceph osd.8 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:45.463 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.157+0000 7f9306b8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:45.463 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.157+0000 7f9306b8b640 -1 osd.8 141 *** Got signal Terminated *** 2024-07-26T11:53:45.463 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.157+0000 7f9306b8b640 -1 osd.8 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:45.463 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:45.461+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:45.463 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:45.461+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:45.464 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:45.461+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:45.464 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:45.461+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:45.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:45.235+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:45.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:45.235+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:45.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:45.235+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:45.735 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:45.235+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:45.735 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:45 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:45.235+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:45.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:45 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:45.438+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:45.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:45 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:45.438+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:45.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:45 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:45.438+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:45.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:45 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:45.438+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:45.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:45 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:45.438+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:46.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.807+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:46.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.807+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:46.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.807+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:46.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:45 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:45.807+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:46.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:46.198+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:46.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:46.198+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:46.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:46.198+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:46.483 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:46.198+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:46.484 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:46 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:46.198+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:46.760 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:46.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:46.760 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:46.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:46.760 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:46.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:46.760 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:46.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:46.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:46.443+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:46.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:46.443+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:46.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:46.443+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:46.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:46.443+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:46.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:46 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:46.443+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:47.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:46.758+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:47.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:46.758+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:47.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:46.758+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:47.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:46.758+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:47.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:46 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:46.758+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:21.496228+0000 front 2024-07-26T11:53:21.496250+0000 (oldest deadline 2024-07-26T11:53:46.096913+0000) 2024-07-26T11:53:47.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:47 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:47.239+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:47.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:47 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:47.239+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:47.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:47 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:47.239+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:47.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:47 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:47.239+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:47.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:47 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:47.239+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:47.766 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:47.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:47.766 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:47.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:47.766 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:47.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:47.766 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:47.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:47.766 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:47.739+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:21.496228+0000 front 2024-07-26T11:53:21.496250+0000 (oldest deadline 2024-07-26T11:53:46.096913+0000) 2024-07-26T11:53:47.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:47.501+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:47.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:47.501+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:47.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:47.501+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:47.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:47 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:47.501+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:47.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:47 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:47.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:47.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:47 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:47.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:47.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:47 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:47.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:47.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:47 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:47.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:47.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:47 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:47.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:47.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:47 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:47.435+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:48.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:48 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:48.267+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:48.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:48 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:48.267+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:48.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:48 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:48.267+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:48.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:48 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:48.267+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:48.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:48 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:48.267+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:48.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:48 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:48.470+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:48.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:48 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:48.470+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:48.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:48 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:48.470+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:48.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:48 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:48.470+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:48.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:48 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:48.470+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:48.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:48 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:48.470+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:49.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:48.711+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:49.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:48.711+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:49.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:48.711+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:49.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:48.711+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:49.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:48.711+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:21.496228+0000 front 2024-07-26T11:53:21.496250+0000 (oldest deadline 2024-07-26T11:53:46.096913+0000) 2024-07-26T11:53:49.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:48.548+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:49.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:48.549+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:49.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:48.549+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:49.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:48.549+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:49.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:48 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:48.549+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:49.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:49.291+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:49.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:49.291+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:49.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:49.291+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:49.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:49.291+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:49.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:49 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:49.291+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:49.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:49.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:49.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:49.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:49.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:49.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:49.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:49.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:49.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:49.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:49.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:49 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:49.515+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:50.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:49.736+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.192772+0000 front 2024-07-26T11:52:49.192752+0000 (oldest deadline 2024-07-26T11:53:15.092725+0000) 2024-07-26T11:53:50.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:49.736+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.093056+0000 front 2024-07-26T11:52:55.093160+0000 (oldest deadline 2024-07-26T11:53:20.993260+0000) 2024-07-26T11:53:50.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:49.737+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:06.294680+0000 front 2024-07-26T11:53:06.294882+0000 (oldest deadline 2024-07-26T11:53:32.194488+0000) 2024-07-26T11:53:50.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:49.737+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.095454+0000 front 2024-07-26T11:53:15.095370+0000 (oldest deadline 2024-07-26T11:53:37.995341+0000) 2024-07-26T11:53:50.016 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8[56720]: 2024-07-26T11:53:49.737+0000 7f92ff16e640 -1 osd.8 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:21.496228+0000 front 2024-07-26T11:53:21.496250+0000 (oldest deadline 2024-07-26T11:53:46.096913+0000) 2024-07-26T11:53:50.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:49.573+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:50.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:49.573+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:50.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:49.573+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:50.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:49.573+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:50.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:49 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:49.573+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:50.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:50 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:50.303+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:50.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:50 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:50.303+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:50.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:50 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:50.303+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:50.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:50 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:50.303+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:50.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:50 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:50.303+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:50.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:50.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:50.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:50.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:50.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:50.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:50.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:50.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:50.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:50.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:50.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:50 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:50.517+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:50.968 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:50 smithi133 podman[123037]: 2024-07-26 11:53:50.648573058 +0000 UTC m=+5.597427622 container died 34cee34cf67d0f8ea21afb8edbbe20338fddb9bb27ba8b267d7dc6517d41c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-07-26T11:53:50.969 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:50 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:50.551+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:50.969 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:50 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:50.551+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:50.969 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:50 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:50.551+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:50.969 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:50 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:50.551+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:50.969 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:50 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:50.551+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:51.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 podman[123037]: 2024-07-26 11:53:51.057958376 +0000 UTC m=+6.006812939 container cleanup 34cee34cf67d0f8ea21afb8edbbe20338fddb9bb27ba8b267d7dc6517d41c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-26T11:53:51.266 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 bash[123037]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8 2024-07-26T11:53:51.534 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 podman[123063]: 2024-07-26 11:53:51.275965073 +0000 UTC m=+0.621764951 container remove 34cee34cf67d0f8ea21afb8edbbe20338fddb9bb27ba8b267d7dc6517d41c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:53:51.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:51.289+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:51.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:51.289+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:51.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:51.289+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:51.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:51.289+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:51.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:51.289+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:51.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:51 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:51.289+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:51.788 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 podman[123150]: 2024-07-26 11:53:51.589650814 +0000 UTC m=+0.017051978 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:53:51.789 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 podman[123150]: 2024-07-26 11:53:51.693198967 +0000 UTC m=+0.120600119 container create 609a5adf8e92ec4425def75569a7b8ceaa64c90f9be6ba5c152d59a66699f19d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-07-26T11:53:51.789 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:51 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:51.533+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:51.789 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:51 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:51.533+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:51.789 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:51 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:51.533+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:51.789 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:51 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:51.533+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:51.790 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:51 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:51.533+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:51.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:51 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:51.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:51.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:51 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:51.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:51.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:51 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:51.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:51.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:51 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:51.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:51.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:51 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:51.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:51.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:51 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:51.477+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:52.100 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 podman[123150]: 2024-07-26 11:53:51.912446943 +0000 UTC m=+0.339848109 container init 609a5adf8e92ec4425def75569a7b8ceaa64c90f9be6ba5c152d59a66699f19d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:52.100 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:51 smithi133 podman[123150]: 2024-07-26 11:53:51.915475543 +0000 UTC m=+0.342876694 container start 609a5adf8e92ec4425def75569a7b8ceaa64c90f9be6ba5c152d59a66699f19d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:53:52.100 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:52 smithi133 podman[123150]: 2024-07-26 11:53:52.020777876 +0000 UTC m=+0.448179044 container attach 609a5adf8e92ec4425def75569a7b8ceaa64c90f9be6ba5c152d59a66699f19d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0) 2024-07-26T11:53:52.442 INFO:journalctl@ceph.osd.8.smithi133.stdout:Jul 26 11:53:52 smithi133 podman[123150]: 2024-07-26 11:53:52.099297603 +0000 UTC m=+0.526698753 container died 609a5adf8e92ec4425def75569a7b8ceaa64c90f9be6ba5c152d59a66699f19d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-07-26T11:53:52.725 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:52 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:52.485+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:52.726 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:52 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:52.485+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:52.726 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:52 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:52.485+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:52.726 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:52 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:52.485+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:52.726 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:52 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:52.485+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:52.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:52.324+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:52.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:52.324+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:52.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:52.324+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:52.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:52.324+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:52.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:52.324+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:52.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:52.324+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:52.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.8.service' 2024-07-26T11:53:52.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:53:52.787 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-07-26T11:53:52.788 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-07-26T11:53:52.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.9 2024-07-26T11:53:52.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:52 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:52.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:52.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:52 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:52.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:52.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:52 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:52.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:52.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:52 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:52.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:52.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:52 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:52.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:52.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:52 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:52.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:53.232 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:52 smithi043 systemd[1]: Stopping Ceph osd.9 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:53:53.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.284+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.284+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.284+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.284+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.284+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.284+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.395+0000 7fbfb8c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.395+0000 7fbfb8c00640 -1 osd.9 141 *** Got signal Terminated *** 2024-07-26T11:53:53.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:53 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:53.395+0000 7fbfb8c00640 -1 osd.9 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:53:53.765 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:53.447+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:53.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:53.447+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:53.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:53.447+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:53.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:53.447+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:53.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:53 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:53.447+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:53.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:53.492+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:53.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:53.492+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:53.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:53.492+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:53.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:53.492+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:53.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:53.492+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:53.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:53 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:53.492+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:54.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:54.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:54.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:54.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:54.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:54.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:54.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:54.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:54.568 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:54.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:54.569 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:54 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:54.521+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:54.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:54.317+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:54.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:54.317+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:54.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:54.317+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:54.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:54.317+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:54.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:54.317+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:54.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:54 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:54.317+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:54.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:54.471+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:54.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:54.471+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:54.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:54.471+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:54.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:54.471+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:54.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:54 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:54.471+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:55.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:55 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:55.339+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:55.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:55 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:55.339+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:55.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:55 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:55.339+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:55.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:55 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:55.339+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:55.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:55 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:55.339+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:55.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:55 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:55.339+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:55.765 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:55.467+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:55.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:55.467+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:55.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:55.467+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:55.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:55.467+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:55.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:55.467+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:55.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:55 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:55.467+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:53:55.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:55 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:55.532+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:55.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:55 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:55.532+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:55.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:55 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:55.532+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:55.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:55 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:55.532+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:55.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:55 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:55.532+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:55.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:55 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:55.532+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:56.635 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:56 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:56.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:56.636 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:56 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:56.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:56.636 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:56 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:56.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:56.636 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:56 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:56.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:56.636 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:56 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:56.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:56.636 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:56 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:56.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:56.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:56 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:56.427+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:56.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:56 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:56.427+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:56.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:56 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:56.427+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:56.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:56 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:56.427+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:56.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:56 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:56.427+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:56.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:56 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:56.427+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:53:56.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:56.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:56.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:56.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:56.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:56.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:56.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:56.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:56.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:56.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:56.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:56 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:56.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:57.371 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:57.256+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:57.371 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:57.256+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:57.371 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:57.256+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:57.371 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:57.256+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:57.371 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:57.256+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:57.371 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:57 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:57.256+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:57.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:57 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:57.384+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:57.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:57 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:57.384+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:57.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:57 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:57.384+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:57.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:57 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:57.384+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:57.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:57 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:57.384+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:57.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:57 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:57.384+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:53:57.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:57.508+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:57.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:57.508+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:57.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:57.508+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:57.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:57.508+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:57.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:57.508+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:57.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:57 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:57.508+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:58.733 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:58.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.086056+0000 front 2024-07-26T11:52:41.086253+0000 (oldest deadline 2024-07-26T11:53:04.586315+0000) 2024-07-26T11:53:58.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:58.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.790504+0000 front 2024-07-26T11:52:49.790586+0000 (oldest deadline 2024-07-26T11:53:15.690752+0000) 2024-07-26T11:53:58.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:58.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:55.691713+0000 front 2024-07-26T11:52:55.692031+0000 (oldest deadline 2024-07-26T11:53:21.591841+0000) 2024-07-26T11:53:58.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:58.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:07.996095+0000 front 2024-07-26T11:53:07.995768+0000 (oldest deadline 2024-07-26T11:53:30.895162+0000) 2024-07-26T11:53:58.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:58.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:16.000052+0000 front 2024-07-26T11:53:16.000511+0000 (oldest deadline 2024-07-26T11:53:37.700231+0000) 2024-07-26T11:53:58.734 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:58 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9[71658]: 2024-07-26T11:53:58.300+0000 7fbfaf600640 -1 osd.9 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.605677+0000 front 2024-07-26T11:53:24.605358+0000 (oldest deadline 2024-07-26T11:53:50.505592+0000) 2024-07-26T11:53:58.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:58 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:58.415+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:58.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:58 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:58.415+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:58.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:58 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:58.415+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:58.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:58 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:58.415+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:58.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:58 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:58.415+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:58.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:58 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:58.415+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:53:58.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:58.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:58.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:58.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:58.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:58.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:58.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:58 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:58.547+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:53:59.301 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:59 smithi043 podman[163141]: 2024-07-26 11:53:59.01651818 +0000 UTC m=+5.770336421 container died 677b1956aab054d9fef8e84afcc77698201d21ecea6fb872e766c6b0ce29999f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-07-26T11:53:59.689 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:59 smithi043 podman[163141]: 2024-07-26 11:53:59.411699496 +0000 UTC m=+6.165517757 container cleanup 677b1956aab054d9fef8e84afcc77698201d21ecea6fb872e766c6b0ce29999f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-07-26T11:53:59.689 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:59 smithi043 bash[163141]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9 2024-07-26T11:53:59.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:59 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:59.452+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:53:59.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:59 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:59.452+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:53:59.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:59 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:59.452+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:53:59.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:59 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:59.452+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:53:59.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:59 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:59.452+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:53:59.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:53:59 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:53:59.452+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:53:59.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:53:59.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:53:59.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:53:59.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:53:59.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:53:59.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:53:59.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:53:59 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:53:59.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:53:59.983 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:53:59 smithi043 podman[163172]: 2024-07-26 11:53:59.68741193 +0000 UTC m=+0.649458058 container remove 677b1956aab054d9fef8e84afcc77698201d21ecea6fb872e766c6b0ce29999f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T11:54:00.626 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:00 smithi043 podman[163261]: 2024-07-26 11:54:00.267161845 +0000 UTC m=+0.034980453 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:54:00.627 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:00 smithi043 podman[163261]: 2024-07-26 11:54:00.363229056 +0000 UTC m=+0.131047690 container create 2e3db78a83ff5645585ce7f9a5129574809a9f7276bda4de8c13b26ef299fcff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-07-26T11:54:00.627 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:00 smithi043 podman[163261]: 2024-07-26 11:54:00.625086166 +0000 UTC m=+0.392904801 container init 2e3db78a83ff5645585ce7f9a5129574809a9f7276bda4de8c13b26ef299fcff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, ceph=True, GIT_BRANCH=HEAD) 2024-07-26T11:54:00.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:00.493+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:00.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:00.493+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:00.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:00.493+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:00.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:00.493+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:00.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:00.493+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:00.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:00 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:00.493+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:00.950 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:00 smithi043 podman[163261]: 2024-07-26 11:54:00.63726428 +0000 UTC m=+0.405082911 container start 2e3db78a83ff5645585ce7f9a5129574809a9f7276bda4de8c13b26ef299fcff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:54:00.950 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:00 smithi043 podman[163261]: 2024-07-26 11:54:00.715431052 +0000 UTC m=+0.483249670 container attach 2e3db78a83ff5645585ce7f9a5129574809a9f7276bda4de8c13b26ef299fcff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9-deactivate, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:54:01.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:01.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:01.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:01.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:01.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:01.069 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:01.069 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:00 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:00.574+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:01.232 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:00 smithi043 podman[163261]: 2024-07-26 11:54:00.949187256 +0000 UTC m=+0.717005865 container died 2e3db78a83ff5645585ce7f9a5129574809a9f7276bda4de8c13b26ef299fcff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T11:54:01.532 INFO:journalctl@ceph.osd.9.smithi043.stdout:Jul 26 11:54:01 smithi043 podman[163284]: 2024-07-26 11:54:01.5185042 +0000 UTC m=+0.549473468 container remove 2e3db78a83ff5645585ce7f9a5129574809a9f7276bda4de8c13b26ef299fcff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T11:54:01.563 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.9.service' 2024-07-26T11:54:01.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:01.681 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-07-26T11:54:01.681 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-07-26T11:54:01.681 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.10 2024-07-26T11:54:01.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:01.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:01.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:01.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:01.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:01.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:01.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:01.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:01.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:01.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:01.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:01 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:01.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:01.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:01.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:01.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:01.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:01.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:01.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:01.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:01.546+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:01.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:01 smithi063 systemd[1]: Stopping Ceph osd.10 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:54:02.318 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.009+0000 7f97f0814640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:54:02.318 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.009+0000 7f97f0814640 -1 osd.10 141 *** Got signal Terminated *** 2024-07-26T11:54:02.318 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.009+0000 7f97f0814640 -1 osd.10 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:54:02.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:02.423+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:02.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:02.423+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:02.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:02.423+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:02.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:02.423+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:02.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:02.423+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:02.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:02 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:02.423+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:02.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:02.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:02.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:02.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:02.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:02.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:02.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:02 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:02.501+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:03.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:03.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:03.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:03.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:03.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:03.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:03.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:03 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:03.377+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:03.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:03.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:03.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:03.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:03.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:03.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:03.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:03 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:03.543+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:04.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:04.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:04.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:04.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:04.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:04.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:04.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:04 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:04.382+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:04.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:04.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:04.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:04.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:04.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:04.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:04.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:04 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:04.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:05.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:05.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:05.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:05.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:05.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:05.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:05.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:05 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:05.424+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:05.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:05.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:05.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:05.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:05.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:05.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:05.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:05 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:05.530+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:06.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:06.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:06.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:06.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:06.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:06.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:06.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:06 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:06.431+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:41.708242+0000 front 2024-07-26T11:52:41.708327+0000 (oldest deadline 2024-07-26T11:53:04.008120+0000) 2024-07-26T11:54:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:51.009808+0000 front 2024-07-26T11:52:51.009728+0000 (oldest deadline 2024-07-26T11:53:13.210684+0000) 2024-07-26T11:54:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.812234+0000 front 2024-07-26T11:52:57.812361+0000 (oldest deadline 2024-07-26T11:53:22.512218+0000) 2024-07-26T11:54:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-07-26T11:53:05.413672+0000 front 2024-07-26T11:53:05.413536+0000 (oldest deadline 2024-07-26T11:53:29.513285+0000) 2024-07-26T11:54:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:15.414075+0000 front 2024-07-26T11:53:15.414037+0000 (oldest deadline 2024-07-26T11:53:38.314208+0000) 2024-07-26T11:54:06.818 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:22.415634+0000 front 2024-07-26T11:53:22.415773+0000 (oldest deadline 2024-07-26T11:53:47.115412+0000) 2024-07-26T11:54:06.819 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:06 smithi063 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10[63019]: 2024-07-26T11:54:06.493+0000 7f97ecdff640 -1 osd.10 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:31.816474+0000 front 2024-07-26T11:53:31.816548+0000 (oldest deadline 2024-07-26T11:53:57.716320+0000) 2024-07-26T11:54:07.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:07.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:07.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:07.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:07.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:07.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:07.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:07 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:07.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:07.786 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:07 smithi063 podman[124777]: 2024-07-26 11:54:07.531338259 +0000 UTC m=+5.642650282 container died 5fd5e8e49cc9e7aebfd9daee72b02b33dc402c4d688232bdc8bd69c437125252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:54:08.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:07 smithi063 podman[124777]: 2024-07-26 11:54:07.867095203 +0000 UTC m=+5.978407226 container cleanup 5fd5e8e49cc9e7aebfd9daee72b02b33dc402c4d688232bdc8bd69c437125252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T11:54:08.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:07 smithi063 bash[124777]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10 2024-07-26T11:54:08.486 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124805]: 2024-07-26 11:54:08.067942751 +0000 UTC m=+0.533249696 container remove 5fd5e8e49cc9e7aebfd9daee72b02b33dc402c4d688232bdc8bd69c437125252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0) 2024-07-26T11:54:08.764 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124893]: 2024-07-26 11:54:08.485371395 +0000 UTC m=+0.104046250 container create 86da88740e04d84675ec0ebce0d4d31ad39978c0051f440a34c600d52b1331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-07-26T11:54:08.764 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124893]: 2024-07-26 11:54:08.398673561 +0000 UTC m=+0.017348424 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:54:08.764 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124893]: 2024-07-26 11:54:08.687833043 +0000 UTC m=+0.306507897 container init 86da88740e04d84675ec0ebce0d4d31ad39978c0051f440a34c600d52b1331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:54:08.764 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124893]: 2024-07-26 11:54:08.692157959 +0000 UTC m=+0.310832815 container start 86da88740e04d84675ec0ebce0d4d31ad39978c0051f440a34c600d52b1331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-26T11:54:08.764 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124893]: 2024-07-26 11:54:08.762803838 +0000 UTC m=+0.381478705 container attach 86da88740e04d84675ec0ebce0d4d31ad39978c0051f440a34c600d52b1331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:54:08.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:08.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:08.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:08.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:08.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:08.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:08.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:08 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:08.500+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:09.068 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:08 smithi063 podman[124893]: 2024-07-26 11:54:08.890096049 +0000 UTC m=+0.508770903 container died 86da88740e04d84675ec0ebce0d4d31ad39978c0051f440a34c600d52b1331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10-deactivate, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-07-26T11:54:09.405 INFO:journalctl@ceph.osd.10.smithi063.stdout:Jul 26 11:54:09 smithi063 podman[124915]: 2024-07-26 11:54:09.382182398 +0000 UTC m=+0.486037898 container remove 86da88740e04d84675ec0ebce0d4d31ad39978c0051f440a34c600d52b1331ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-07-26T11:54:09.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.10.service' 2024-07-26T11:54:09.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:09.451 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-07-26T11:54:09.451 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-07-26T11:54:09.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.11 2024-07-26T11:54:09.744 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:09.744 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.462+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 systemd[1]: Stopping Ceph osd.11 for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:54:09.745 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.742+0000 7f811c2c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:54:09.746 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.742+0000 7f811c2c0640 -1 osd.11 141 *** Got signal Terminated *** 2024-07-26T11:54:09.746 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:09 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:09.742+0000 7f811c2c0640 -1 osd.11 141 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-26T11:54:10.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:10.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:10.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:10.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:10.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:10.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:10.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:10 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:10.463+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:11.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:11.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:11.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:11.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:11.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:11.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:11.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:11 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:11.456+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:12.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:12.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:12.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:12.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:12.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:12.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:12.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:12.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:12 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:12.459+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6820 osd.8 since back 2024-07-26T11:53:44.484378+0000 front 2024-07-26T11:53:44.484402+0000 (oldest deadline 2024-07-26T11:54:11.484942+0000) 2024-07-26T11:54:13.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:13.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:13.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:13.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:13.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:13.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:13.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:13.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:13 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:13.492+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6820 osd.8 since back 2024-07-26T11:53:44.484378+0000 front 2024-07-26T11:53:44.484402+0000 (oldest deadline 2024-07-26T11:54:11.484942+0000) 2024-07-26T11:54:15.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-07-26T11:52:39.872762+0000 front 2024-07-26T11:52:39.872618+0000 (oldest deadline 2024-07-26T11:53:05.172473+0000) 2024-07-26T11:54:15.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6804 osd.1 since back 2024-07-26T11:52:49.774442+0000 front 2024-07-26T11:52:49.774497+0000 (oldest deadline 2024-07-26T11:53:13.274602+0000) 2024-07-26T11:54:15.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6804 osd.2 since back 2024-07-26T11:52:57.876187+0000 front 2024-07-26T11:52:57.876270+0000 (oldest deadline 2024-07-26T11:53:23.176299+0000) 2024-07-26T11:54:15.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6812 osd.4 since back 2024-07-26T11:53:13.078724+0000 front 2024-07-26T11:53:13.078703+0000 (oldest deadline 2024-07-26T11:53:37.778808+0000) 2024-07-26T11:54:15.016 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6812 osd.5 since back 2024-07-26T11:53:24.180564+0000 front 2024-07-26T11:53:24.180614+0000 (oldest deadline 2024-07-26T11:53:47.680701+0000) 2024-07-26T11:54:15.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-07-26T11:53:32.381957+0000 front 2024-07-26T11:53:32.382064+0000 (oldest deadline 2024-07-26T11:53:54.681734+0000) 2024-07-26T11:54:15.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.63:6820 osd.7 since back 2024-07-26T11:53:41.083433+0000 front 2024-07-26T11:53:41.083504+0000 (oldest deadline 2024-07-26T11:54:02.783378+0000) 2024-07-26T11:54:15.017 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:14 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11[63729]: 2024-07-26T11:54:14.540+0000 7f81148a3640 -1 osd.11 141 heartbeat_check: no reply from 172.21.15.133:6820 osd.8 since back 2024-07-26T11:53:44.484378+0000 front 2024-07-26T11:53:44.484402+0000 (oldest deadline 2024-07-26T11:54:11.484942+0000) 2024-07-26T11:54:15.376 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:15 smithi133 podman[123253]: 2024-07-26 11:54:15.064640366 +0000 UTC m=+5.427196875 container died 2c871e17bde34e45a2f645e8ffefadc365fdbfc98136766467b54740815aba56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:54:15.681 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:15 smithi133 podman[123253]: 2024-07-26 11:54:15.375714294 +0000 UTC m=+5.738270812 container cleanup 2c871e17bde34e45a2f645e8ffefadc365fdbfc98136766467b54740815aba56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T11:54:15.681 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:15 smithi133 bash[123253]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11 2024-07-26T11:54:15.681 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:15 smithi133 podman[123268]: 2024-07-26 11:54:15.610247736 +0000 UTC m=+0.547848792 container remove 2c871e17bde34e45a2f645e8ffefadc365fdbfc98136766467b54740815aba56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T11:54:16.331 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:16 smithi133 podman[123370]: 2024-07-26 11:54:15.976381654 +0000 UTC m=+0.017674608 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T11:54:16.331 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:16 smithi133 podman[123370]: 2024-07-26 11:54:16.111000882 +0000 UTC m=+0.152293831 container create 0228c4fd245e040bb7ab81b4e3f54b8a35810e107fe0fbebf04266607192cf62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240724) 2024-07-26T11:54:16.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:16 smithi133 podman[123370]: 2024-07-26 11:54:16.330132611 +0000 UTC m=+0.371425562 container init 0228c4fd245e040bb7ab81b4e3f54b8a35810e107fe0fbebf04266607192cf62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-07-26T11:54:16.766 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:16 smithi133 podman[123370]: 2024-07-26 11:54:16.333664396 +0000 UTC m=+0.374957342 container start 0228c4fd245e040bb7ab81b4e3f54b8a35810e107fe0fbebf04266607192cf62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-07-26T11:54:16.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:16 smithi133 podman[123370]: 2024-07-26 11:54:16.41344561 +0000 UTC m=+0.454738558 container attach 0228c4fd245e040bb7ab81b4e3f54b8a35810e107fe0fbebf04266607192cf62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:54:16.767 INFO:journalctl@ceph.osd.11.smithi133.stdout:Jul 26 11:54:16 smithi133 podman[123370]: 2024-07-26 11:54:16.52623155 +0000 UTC m=+0.567524499 container died 0228c4fd245e040bb7ab81b4e3f54b8a35810e107fe0fbebf04266607192cf62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T11:54:17.133 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@osd.11.service' 2024-07-26T11:54:17.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:17.170 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-07-26T11:54:17.171 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-07-26T11:54:17.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a 2024-07-26T11:54:17.733 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:17 smithi043 systemd[1]: Stopping Ceph mds.a for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:54:18.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:17 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[101330]: 2024-07-26T11:54:17.787+0000 7fdde7a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:54:18.233 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:17 smithi043 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a[101330]: 2024-07-26T11:54:17.787+0000 7fdde7a00640 -1 mds.a *** got signal Terminated *** 2024-07-26T11:54:19.168 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:18 smithi043 podman[163363]: 2024-07-26 11:54:18.892525704 +0000 UTC m=+1.234229170 container died 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-07-26T11:54:19.463 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:19 smithi043 podman[163363]: 2024-07-26 11:54:19.277563371 +0000 UTC m=+1.619266834 container cleanup 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T11:54:19.464 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:19 smithi043 bash[163363]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a 2024-07-26T11:54:19.733 INFO:journalctl@ceph.mds.a.smithi043.stdout:Jul 26 11:54:19 smithi043 podman[163375]: 2024-07-26 11:54:19.461511467 +0000 UTC m=+0.550918011 container remove 2745c6e19e129d02c5e1704d0b735cbda7d8f7093a84bbc1edd9ae5d9857a963 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-07-26T11:54:19.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.a.service' 2024-07-26T11:54:20.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:20.101 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-07-26T11:54:20.101 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-07-26T11:54:20.101 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d 2024-07-26T11:54:20.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.d.service' 2024-07-26T11:54:20.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:20.305 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-07-26T11:54:20.305 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-07-26T11:54:20.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g 2024-07-26T11:54:20.454 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.g.service' 2024-07-26T11:54:20.560 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:20.560 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-07-26T11:54:20.560 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-07-26T11:54:20.561 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j 2024-07-26T11:54:20.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.j.service' 2024-07-26T11:54:20.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:20.813 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-07-26T11:54:20.813 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-07-26T11:54:20.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b 2024-07-26T11:54:20.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.b.service' 2024-07-26T11:54:20.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:20.928 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-07-26T11:54:20.928 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-07-26T11:54:20.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e 2024-07-26T11:54:21.001 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.e.service' 2024-07-26T11:54:21.075 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:21.076 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-07-26T11:54:21.076 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-07-26T11:54:21.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h 2024-07-26T11:54:21.146 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.h.service' 2024-07-26T11:54:21.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:21.219 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-07-26T11:54:21.219 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-07-26T11:54:21.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k 2024-07-26T11:54:21.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.k.service' 2024-07-26T11:54:21.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:21.360 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-07-26T11:54:21.360 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-07-26T11:54:21.360 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.c 2024-07-26T11:54:21.662 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:54:21 smithi133 systemd[1]: Stopping Ceph mds.c for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:54:22.018 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:54:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T11:54:21.660+0000 7f676638c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:54:22.018 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:54:21 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c[68722]: 2024-07-26T11:54:21.660+0000 7f676638c640 -1 mds.c *** got signal Terminated *** 2024-07-26T11:54:23.016 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:54:22 smithi133 podman[123472]: 2024-07-26 11:54:22.756163267 +0000 UTC m=+1.200079159 container died 4515fb61174c9e0aee4fc43c9ed546007cfd1b00b50337831241a7396069bbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-07-26T11:54:23.395 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:54:23 smithi133 podman[123472]: 2024-07-26 11:54:23.126869114 +0000 UTC m=+1.570785003 container cleanup 4515fb61174c9e0aee4fc43c9ed546007cfd1b00b50337831241a7396069bbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, io.buildah.version=1.36.0) 2024-07-26T11:54:23.396 INFO:journalctl@ceph.mds.c.smithi133.stdout:Jul 26 11:54:23 smithi133 bash[123472]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-c 2024-07-26T11:54:23.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.c.service' 2024-07-26T11:54:23.559 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:23.559 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-07-26T11:54:23.559 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-07-26T11:54:23.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.f 2024-07-26T11:54:23.765 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:23 smithi133 systemd[1]: Stopping Ceph mds.f for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:54:24.266 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f[68416]: 2024-07-26T11:54:23.872+0000 7f689d3d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:54:24.266 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:23 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f[68416]: 2024-07-26T11:54:23.872+0000 7f689d3d1640 -1 mds.f *** got signal Terminated *** 2024-07-26T11:54:27.016 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:26 smithi133 podman[123594]: 2024-07-26 11:54:26.749675346 +0000 UTC m=+2.977873719 container died 5324255a14621cc7baecdc5aa64f10b99add35ceb863a64289bc27fa3e26bced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-07-26T11:54:27.374 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:27 smithi133 podman[123594]: 2024-07-26 11:54:27.172284485 +0000 UTC m=+3.400482855 container cleanup 5324255a14621cc7baecdc5aa64f10b99add35ceb863a64289bc27fa3e26bced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, ceph=True) 2024-07-26T11:54:27.374 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:27 smithi133 bash[123594]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f 2024-07-26T11:54:27.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.f.service' 2024-07-26T11:54:27.625 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:27 smithi133 podman[123610]: 2024-07-26 11:54:27.373387293 +0000 UTC m=+0.616997635 container remove 5324255a14621cc7baecdc5aa64f10b99add35ceb863a64289bc27fa3e26bced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-07-26T11:54:27.626 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:27 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.f.service: Deactivated successfully. 2024-07-26T11:54:27.626 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:27 smithi133 systemd[1]: Stopped Ceph mds.f for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968. 2024-07-26T11:54:27.626 INFO:journalctl@ceph.mds.f.smithi133.stdout:Jul 26 11:54:27 smithi133 systemd[1]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.f.service: Consumed 25.960s CPU time. 2024-07-26T11:54:27.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:27.636 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-07-26T11:54:27.636 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-07-26T11:54:27.636 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.i 2024-07-26T11:54:27.943 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:27 smithi133 systemd[1]: Stopping Ceph mds.i for 4bbb8ba0-4b27-11ef-bcb6-c7b262605968... 2024-07-26T11:54:28.265 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i[69034]: 2024-07-26T11:54:27.941+0000 7f246265c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T11:54:28.266 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:27 smithi133 ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i[69034]: 2024-07-26T11:54:27.941+0000 7f246265c640 -1 mds.i *** got signal Terminated *** 2024-07-26T11:54:31.016 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:30 smithi133 podman[123717]: 2024-07-26 11:54:30.758037098 +0000 UTC m=+2.909072905 container died 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:54:31.497 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:31 smithi133 podman[123717]: 2024-07-26 11:54:31.083674088 +0000 UTC m=+3.234709898 container cleanup 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T11:54:31.497 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:31 smithi133 bash[123717]: ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i 2024-07-26T11:54:31.497 INFO:journalctl@ceph.mds.i.smithi133.stdout:Jul 26 11:54:31 smithi133 podman[123729]: 2024-07-26 11:54:31.268249118 +0000 UTC m=+0.509121167 container remove 391e1529dced310069a212682ad24c88d399889f8860025ead818a1698b0a7ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968-mds-i, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-07-26T11:54:31.513 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.i.service' 2024-07-26T11:54:31.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:31.543 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-07-26T11:54:31.544 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-07-26T11:54:31.544 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l 2024-07-26T11:54:31.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bbb8ba0-4b27-11ef-bcb6-c7b262605968@mds.l.service' 2024-07-26T11:54:31.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-26T11:54:31.682 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-07-26T11:54:31.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --force --keep-logs 2024-07-26T11:54:32.040 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T11:54:37.312 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --force --keep-logs 2024-07-26T11:54:37.526 INFO:teuthology.orchestra.run.smithi063.stdout:Deleting cluster with fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T11:54:40.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --force --keep-logs 2024-07-26T11:54:40.287 INFO:teuthology.orchestra.run.smithi133.stdout:Deleting cluster with fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T11:54:42.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-26T11:54:42.729 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-26T11:54:42.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-26T11:54:42.788 INFO:tasks.cephadm:Archiving crash dumps... 2024-07-26T11:54:42.790 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi043/crash 2024-07-26T11:54:42.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash -- . 2024-07-26T11:54:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash: Cannot open: No such file or directory 2024-07-26T11:54:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2024-07-26T11:54:42.885 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi063/crash 2024-07-26T11:54:42.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash -- . 2024-07-26T11:54:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash: Cannot open: No such file or directory 2024-07-26T11:54:43.052 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2024-07-26T11:54:43.054 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi133/crash 2024-07-26T11:54:43.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash -- . 2024-07-26T11:54:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:tar: /var/lib/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/crash: Cannot open: No such file or directory 2024-07-26T11:54:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:tar: Error is not recoverable: exiting now 2024-07-26T11:54:43.093 INFO:tasks.cephadm:Checking cluster log for badness... 2024-07-26T11:54:43.093 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-07-26T11:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout:2024-07-26T08:39:53.413793+0000 mon.a (mon.0) 1279 : cluster [WRN] Health check failed: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T11:54:43.213 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-07-26T11:54:43.213 INFO:tasks.cephadm:Compressing logs... 2024-07-26T11:54:43.213 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-26T11:54:43.217 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-26T11:54:43.220 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-26T11:54:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log 2024-07-26T11:54:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:: No such file or directory 2024-07-26T11:54:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.2.log 2024-07-26T11:54:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.f.log 2024-07-26T11:54:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log 2024-07-26T11:54:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.2.log: /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.5.log 2024-07-26T11:54:43.246 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.c.log 2024-07-26T11:54:43.246 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log: /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.c.log 2024-07-26T11:54:43.247 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.z.log 2024-07-26T11:54:43.247 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.i.log 2024-07-26T11:54:43.249 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log 2024-07-26T11:54:43.249 INFO:teuthology.orchestra.run.smithi063.stderr:: No such file or directory 2024-07-26T11:54:43.249 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log 2024-07-26T11:54:43.249 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.7.log 2024-07-26T11:54:43.250 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log: /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.b.log 2024-07-26T11:54:43.250 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.4.log 2024-07-26T11:54:43.250 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.1.log 2024-07-26T11:54:43.250 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.y.log 2024-07-26T11:54:43.250 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.h.log 2024-07-26T11:54:43.250 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.10.log 2024-07-26T11:54:43.251 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.z.log: 91.2% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log.gz 2024-07-26T11:54:43.252 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log 2024-07-26T11:54:43.253 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.h.log: 91.2% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log.gz 2024-07-26T11:54:43.254 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log 2024-07-26T11:54:43.263 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.e.log 2024-07-26T11:54:43.264 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.11.log 2024-07-26T11:54:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log: 87.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log.gz 2024-07-26T11:54:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.8.log 2024-07-26T11:54:43.272 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-07-26T11:54:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log 2024-07-26T11:54:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log 2024-07-26T11:54:43.274 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.g.log 2024-07-26T11:54:43.275 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.j.log 2024-07-26T11:54:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.3.log 2024-07-26T11:54:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log: 87.1%gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log 2024-07-26T11:54:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.e.log: -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log.gz 2024-07-26T11:54:43.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.11.log: 89.4% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log.gz 2024-07-26T11:54:43.278 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log 2024-07-26T11:54:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.0.log 2024-07-26T11:54:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.x.log 2024-07-26T11:54:43.280 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.a.log 2024-07-26T11:54:43.281 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log.gz 2024-07-26T11:54:43.282 INFO:teuthology.orchestra.run.smithi043.stderr: 91.0%/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.x.log: -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.audit.log.gz 2024-07-26T11:54:43.282 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.6.log 2024-07-26T11:54:43.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.l.log 2024-07-26T11:54:43.286 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.a.log: /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log 2024-07-26T11:54:43.287 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.b.log 2024-07-26T11:54:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.a.log 2024-07-26T11:54:43.292 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log: 94.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.z.log.gz 2024-07-26T11:54:43.293 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log: 87.3% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.cephadm.log.gz 2024-07-26T11:54:43.293 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log 2024-07-26T11:54:43.295 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log: 94.4% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.y.log.gz 2024-07-26T11:54:43.296 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.d.log 2024-07-26T11:54:43.299 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-07-26T11:54:43.301 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.9.log 2024-07-26T11:54:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.k.log 2024-07-26T11:54:43.305 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-07-26T11:54:43.310 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-07-26T11:54:43.311 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.9.log: /var/log/ceph/cephadm.log: gzip -5 --verbose 89.4% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph.log.gz 2024-07-26T11:54:43.311 INFO:teuthology.orchestra.run.smithi043.stderr: -- /var/log/ceph/ceph-client.admin.log 2024-07-26T11:54:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-07-26T11:54:43.321 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log.gz 2024-07-26T11:54:43.322 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-07-26T11:54:43.326 INFO:teuthology.orchestra.run.smithi043.stderr: 94.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-07-26T11:54:43.330 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log.gz 2024-07-26T11:54:43.331 INFO:teuthology.orchestra.run.smithi063.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-07-26T11:54:43.346 INFO:teuthology.orchestra.run.smithi043.stderr: 91.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-volume.log.gz 2024-07-26T11:54:45.915 INFO:teuthology.orchestra.run.smithi133.stderr: 95.3% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.f.log.gz 2024-07-26T11:54:46.186 INFO:teuthology.orchestra.run.smithi043.stderr: 90.7% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mgr.x.log.gz 2024-07-26T11:54:46.646 INFO:teuthology.orchestra.run.smithi133.stderr: 93.3% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.c.log.gz 2024-07-26T11:54:47.605 INFO:teuthology.orchestra.run.smithi063.stderr: 92.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.b.log.gz 2024-07-26T11:54:47.712 INFO:teuthology.orchestra.run.smithi133.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.l.log.gz 2024-07-26T11:54:47.817 INFO:teuthology.orchestra.run.smithi063.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.e.log.gz 2024-07-26T11:54:47.860 INFO:teuthology.orchestra.run.smithi063.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.h.log.gz 2024-07-26T11:54:48.041 INFO:teuthology.orchestra.run.smithi063.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.k.log.gz 2024-07-26T11:54:48.339 INFO:teuthology.orchestra.run.smithi043.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.d.log.gz 2024-07-26T11:54:48.563 INFO:teuthology.orchestra.run.smithi043.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.j.log.gz 2024-07-26T11:54:48.899 INFO:teuthology.orchestra.run.smithi043.stderr: 95.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.g.log.gz 2024-07-26T11:54:49.351 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.c.log.gz 2024-07-26T11:54:52.550 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.b.log.gz 2024-07-26T11:54:52.781 INFO:teuthology.orchestra.run.smithi133.stderr: 92.7% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.11.log.gz 2024-07-26T11:54:53.255 INFO:teuthology.orchestra.run.smithi063.stderr: 92.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.1.log.gz 2024-07-26T11:54:53.984 INFO:teuthology.orchestra.run.smithi133.stderr: 92.6% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.2.log.gz 2024-07-26T11:54:54.284 INFO:teuthology.orchestra.run.smithi063.stderr: 92.1% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.10.log.gz 2024-07-26T11:54:55.748 INFO:teuthology.orchestra.run.smithi063.stderr: 92.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.7.log.gz 2024-07-26T11:54:55.857 INFO:teuthology.orchestra.run.smithi043.stderr: 90.1% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mon.a.log.gz 2024-07-26T11:54:56.857 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.a.log.gz 2024-07-26T11:54:57.011 INFO:teuthology.orchestra.run.smithi043.stderr: 92.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.3.log.gz 2024-07-26T11:54:57.271 INFO:teuthology.orchestra.run.smithi043.stderr: 92.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.0.log.gz 2024-07-26T11:54:57.536 INFO:teuthology.orchestra.run.smithi063.stderr: 92.6% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.4.log.gz 2024-07-26T11:54:57.538 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-07-26T11:54:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m14.302s 2024-07-26T11:54:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:user 1m9.001s 2024-07-26T11:54:57.539 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m1.962s 2024-07-26T11:54:57.847 INFO:teuthology.orchestra.run.smithi133.stderr: 92.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.8.log.gz 2024-07-26T11:54:57.947 INFO:teuthology.orchestra.run.smithi043.stderr: 92.1% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.6.log.gz 2024-07-26T11:54:57.977 INFO:teuthology.orchestra.run.smithi133.stderr: 92.7% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.5.log.gz 2024-07-26T11:54:59.202 INFO:teuthology.orchestra.run.smithi043.stderr: 92.5% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-osd.9.log.gz 2024-07-26T11:54:59.206 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-07-26T11:54:59.206 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m15.957s 2024-07-26T11:54:59.206 INFO:teuthology.orchestra.run.smithi043.stderr:user 1m28.384s 2024-07-26T11:54:59.206 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m6.931s 2024-07-26T11:54:59.417 INFO:teuthology.orchestra.run.smithi133.stderr: 93.0% -- replaced with /var/log/ceph/4bbb8ba0-4b27-11ef-bcb6-c7b262605968/ceph-mds.i.log.gz 2024-07-26T11:54:59.420 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-07-26T11:54:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m16.186s 2024-07-26T11:54:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:user 1m17.217s 2024-07-26T11:54:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m2.396s 2024-07-26T11:54:59.421 INFO:tasks.cephadm:Archiving logs... 2024-07-26T11:54:59.421 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi043/log 2024-07-26T11:54:59.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-26T11:55:09.226 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi063/log 2024-07-26T11:55:09.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-26T11:55:17.045 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi133/log 2024-07-26T11:55:17.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-26T11:55:26.295 INFO:tasks.cephadm:Removing cluster... 2024-07-26T11:55:26.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --force 2024-07-26T11:55:26.645 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T11:55:27.486 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --force 2024-07-26T11:55:27.704 INFO:teuthology.orchestra.run.smithi063.stdout:Deleting cluster with fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T11:55:28.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 --force 2024-07-26T11:55:28.241 INFO:teuthology.orchestra.run.smithi133.stdout:Deleting cluster with fsid: 4bbb8ba0-4b27-11ef-bcb6-c7b262605968 2024-07-26T11:55:28.577 INFO:tasks.cephadm:Removing cephadm ... 2024-07-26T11:55:28.577 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/cephadm 2024-07-26T11:55:28.637 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/cephadm 2024-07-26T11:55:28.655 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/cephadm 2024-07-26T11:55:28.670 INFO:tasks.cephadm:Teardown complete 2024-07-26T11:55:28.670 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-07-26T11:55:28.681 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-07-26T11:55:28.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-26T11:55:28.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-26T11:55:28.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-26T11:55:28.855 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-07-26T11:55:28.866 INFO:teuthology.task.clock:Checking final clock skew... 2024-07-26T11:55:28.866 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T11:55:28.874 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T11:55:28.877 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T11:55:28.890 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-07-26T11:55:28.890 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-07-26T11:55:28.894 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T11:55:28.894 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-07-26T11:55:28.894 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv01.front.sepia.ceph.com 3 7 377 25 +218us[ +235us] +/- 49ms 2024-07-26T11:55:28.894 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 37 -525us[ -508us] +/- 79ms 2024-07-26T11:55:28.894 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 94 +194us[ +213us] +/- 74ms 2024-07-26T11:55:28.894 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T11:55:28.896 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T11:55:28.896 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-07-26T11:55:28.896 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 7 377 38 +222us[ +221us] +/- 48ms 2024-07-26T11:55:28.896 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 103 -505us[ -504us] +/- 78ms 2024-07-26T11:55:28.897 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +154us[ +154us] +/- 75ms 2024-07-26T11:55:28.897 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T11:55:28.923 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-07-26T11:55:28.933 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T11:55:28.933 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-07-26T11:55:28.934 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 8 377 23 +258us[ +232us] +/- 49ms 2024-07-26T11:55:28.934 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 161 -459us[ -488us] +/- 77ms 2024-07-26T11:55:28.934 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +188us[ +161us] +/- 75ms 2024-07-26T11:55:28.934 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T11:55:28.935 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-07-26T11:55:28.945 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-07-26T11:55:28.946 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-07-26T11:55:29.076 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-26T11:55:29.337 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-26T11:55:29.425 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-26T11:55:29.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T11:55:29.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:55:29.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T11:55:29.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:55:29.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T11:55:29.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:55:29.671 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-07-26T11:55:29.682 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-07-26T11:55:29.720 INFO:teuthology.task.internal:Duration was 13679.609812 seconds 2024-07-26T11:55:29.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-07-26T11:55:29.731 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-07-26T11:55:29.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-26T11:55:29.739 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-26T11:55:29.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-26T11:55:29.779 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T11:55:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T11:55:29.890 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T11:55:30.326 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-07-26T11:55:30.326 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-07-26T11:55:30.326 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-26T11:55:30.390 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-07-26T11:55:30.391 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-26T11:55:30.417 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-07-26T11:55:30.417 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-26T11:55:30.444 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-07-26T11:55:30.444 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-26T11:55:30.449 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-26T11:55:30.460 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-26T11:55:30.511 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-07-26T11:55:30.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-26T11:55:30.516 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-26T11:55:30.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-26T11:55:31.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-07-26T11:55:31.946 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-07-26T11:55:31.946 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-26T11:55:32.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-26T11:55:32.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-26T11:55:32.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-07-26T11:55:32.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-26T11:55:32.106 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-26T11:55:32.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-26T11:55:32.132 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-07-26T11:55:32.150 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-07-26T11:55:32.193 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-07-26T11:55:32.236 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-26T11:55:32.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:55:32.285 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-26T11:55:32.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:55:32.302 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-26T11:55:32.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:55:32.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-07-26T11:55:32.329 INFO:teuthology.task.internal:Transferring archived files... 2024-07-26T11:55:32.330 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi043 2024-07-26T11:55:32.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-26T11:55:32.466 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi063 2024-07-26T11:55:32.467 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-26T11:55:32.511 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818705/remote/smithi133 2024-07-26T11:55:32.512 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-26T11:55:32.553 INFO:teuthology.task.internal:Removing archive directory... 2024-07-26T11:55:32.553 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-26T11:55:32.561 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-26T11:55:32.564 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-26T11:55:32.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-07-26T11:55:32.628 INFO:teuthology.task.internal:Not uploading archives. 2024-07-26T11:55:32.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-07-26T11:55:32.639 INFO:teuthology.task.internal:Tidying up after the test... 2024-07-26T11:55:32.640 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-26T11:55:32.647 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-26T11:55:32.650 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-26T11:55:32.666 INFO:teuthology.orchestra.run.smithi063.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 26 11:55 /home/ubuntu/cephtest 2024-07-26T11:55:32.666 INFO:teuthology.orchestra.run.smithi133.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 26 11:55 /home/ubuntu/cephtest 2024-07-26T11:55:32.700 INFO:teuthology.orchestra.run.smithi043.stdout: 393307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 26 11:55 /home/ubuntu/cephtest 2024-07-26T11:55:32.703 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-07-26T11:55:32.715 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-07-26T11:55:32.771 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3e9255e907100f88049f320ca33d977e29155d12 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} duration: 13679.609811782837 failure_reason: 'Command failed (workunit test fs/norstats/kernel_untar_tar.sh) on smithi043 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh''' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=75599aa586a1464ca36cce64a1c30f4f status: fail success: false 2024-07-26T11:55:32.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-26T11:55:32.993 INFO:teuthology.run:FAIL